2024-05-08T20:55:44.665 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-08T20:55:44.666 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698040 --name pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mds 2-workunit/suites/ffsb}} --verbose --owner scheduled_pdonnell@teuthology -- /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698040/orig.config.yaml 2024-05-08T20:55:44.718 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-08T20:55:44.813 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698040 branch: wip-pdonnell-testing-20240508.150423-reef description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mds 2-workunit/suites/ffsb}} email: pdonnell@redhat.com first_in_suite: false job_id: '7698040' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-pdonnell-testing-20240508.150423-reef ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd session_timeout: 300 conf: client: client mount timeout: 600 client_shutdown_timeout: 120 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds oft prefetch dirfrags: false mds op complaint time: 180 mds verify scatter: true mds_dir_prefetch: false mds_sleep_rank_change: 5000000.0 mon client directed command retry: 5 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds osd ms inject socket failures: 2500 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 filestore flush min: 0 mon client directed command retry: 5 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds ms inject socket failures: 2500 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - Replacing daemon mds - SLOW_OPS - slow request sha1: d21e4f961318b56f0d915caa2490c3711bf13c34 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: d21e4f961318b56f0d915caa2490c3711bf13c34 kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240508.150423-reef sha1: d21e4f961318b56f0d915caa2490c3711bf13c34 owner: scheduled_pdonnell@teuthology priority: 65 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 2738 sha1: d21e4f961318b56f0d915caa2490c3711bf13c34 sleep_before_teardown: 0 subset: 17/512 suite: fs suite_branch: wip-pdonnell-testing-20240508.150423-reef suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_d21e4f961318b56f0d915caa2490c3711bf13c34/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: d21e4f961318b56f0d915caa2490c3711bf13c34 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi080.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBALjNiYXrENSLdJzNeatoU+OZ+wcWUhRkop+vWtzVltIN4h4ub1O16LVNnSPsLemTMBwtfRd27qiq4FsPm4nqe8= smithi106.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLdzLzRBvC8gnMmcZLNLn+UGt/CF9RvwErwx33Yy7VZuhsxUSF0rNqzawjqImDrk5gUQR6IdoPURsvCSl5pYtEc= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - mds_thrash: null - workunit: clients: all: - suites/ffsb.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-08_19:22:21 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-08T20:55:44.813 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_d21e4f961318b56f0d915caa2490c3711bf13c34/qa; will attempt to use it 2024-05-08T20:55:44.814 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_d21e4f961318b56f0d915caa2490c3711bf13c34/qa/tasks 2024-05-08T20:55:44.814 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-08T20:55:44.816 INFO:teuthology.task.internal:Checking packages... 2024-05-08T20:55:44.838 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash 'd21e4f961318b56f0d915caa2490c3711bf13c34' 2024-05-08T20:55:44.839 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-08T20:55:44.839 INFO:teuthology.packaging:ref: None 2024-05-08T20:55:44.839 INFO:teuthology.packaging:tag: None 2024-05-08T20:55:44.839 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240508.150423-reef 2024-05-08T20:55:44.839 INFO:teuthology.packaging:sha1: d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T20:55:44.839 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-pdonnell-testing-20240508.150423-reef 2024-05-08T20:55:45.059 INFO:teuthology.task.internal:Found packages for ceph version 18.2.2-1322.gd21e4f96 2024-05-08T20:55:45.060 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-08T20:55:45.066 INFO:teuthology.task.internal:no buildpackages task found 2024-05-08T20:55:45.067 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-08T20:55:45.134 INFO:teuthology.task.internal:Saving configuration 2024-05-08T20:55:45.154 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-08T20:55:45.165 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-08T20:55:45.189 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi080.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698040', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-08 20:50:46.108900', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBALjNiYXrENSLdJzNeatoU+OZ+wcWUhRkop+vWtzVltIN4h4ub1O16LVNnSPsLemTMBwtfRd27qiq4FsPm4nqe8='} 2024-05-08T20:55:45.214 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi106.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698040', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-08 20:50:46.110359', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLdzLzRBvC8gnMmcZLNLn+UGt/CF9RvwErwx33Yy7VZuhsxUSF0rNqzawjqImDrk5gUQR6IdoPURsvCSl5pYtEc='} 2024-05-08T20:55:45.214 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-08T20:55:45.231 INFO:teuthology.task.internal:roles: ubuntu@smithi080.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-05-08T20:55:45.231 INFO:teuthology.task.internal:roles: ubuntu@smithi106.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-05-08T20:55:45.231 INFO:teuthology.run_tasks:Running task console_log... 2024-05-08T20:55:45.297 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f83fadc5160>, signals=[15]) 2024-05-08T20:55:45.297 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-08T20:55:45.303 INFO:teuthology.task.internal:Opening connections... 2024-05-08T20:55:45.303 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi080.front.sepia.ceph.com 2024-05-08T20:55:45.305 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T20:55:45.398 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi106.front.sepia.ceph.com 2024-05-08T20:55:45.399 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T20:55:45.473 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-08T20:55:45.479 DEBUG:teuthology.orchestra.run.smithi080:> uname -m 2024-05-08T20:55:45.499 INFO:teuthology.orchestra.run.smithi080.stdout:x86_64 2024-05-08T20:55:45.500 DEBUG:teuthology.orchestra.run.smithi080:> cat /etc/os-release 2024-05-08T20:55:45.559 INFO:teuthology.orchestra.run.smithi080.stdout:NAME="Red Hat Enterprise Linux" 2024-05-08T20:55:45.560 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION="8.6 (Ootpa)" 2024-05-08T20:55:45.560 INFO:teuthology.orchestra.run.smithi080.stdout:ID="rhel" 2024-05-08T20:55:45.560 INFO:teuthology.orchestra.run.smithi080.stdout:ID_LIKE="fedora" 2024-05-08T20:55:45.560 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION_ID="8.6" 2024-05-08T20:55:45.560 INFO:teuthology.orchestra.run.smithi080.stdout:PLATFORM_ID="platform:el8" 2024-05-08T20:55:45.560 INFO:teuthology.orchestra.run.smithi080.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-05-08T20:55:45.560 INFO:teuthology.orchestra.run.smithi080.stdout:ANSI_COLOR="0;31" 2024-05-08T20:55:45.560 INFO:teuthology.orchestra.run.smithi080.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-05-08T20:55:45.560 INFO:teuthology.orchestra.run.smithi080.stdout:HOME_URL="https://www.redhat.com/" 2024-05-08T20:55:45.560 INFO:teuthology.orchestra.run.smithi080.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-05-08T20:55:45.561 INFO:teuthology.orchestra.run.smithi080.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-08T20:55:45.561 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T20:55:45.561 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-05-08T20:55:45.561 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-05-08T20:55:45.561 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-05-08T20:55:45.561 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-05-08T20:55:45.562 INFO:teuthology.lock.ops:Updating smithi080.front.sepia.ceph.com on lock server 2024-05-08T20:55:45.588 DEBUG:teuthology.orchestra.run.smithi106:> uname -m 2024-05-08T20:55:45.609 INFO:teuthology.orchestra.run.smithi106.stdout:x86_64 2024-05-08T20:55:45.609 DEBUG:teuthology.orchestra.run.smithi106:> cat /etc/os-release 2024-05-08T20:55:45.669 INFO:teuthology.orchestra.run.smithi106.stdout:NAME="Red Hat Enterprise Linux" 2024-05-08T20:55:45.669 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION="8.6 (Ootpa)" 2024-05-08T20:55:45.669 INFO:teuthology.orchestra.run.smithi106.stdout:ID="rhel" 2024-05-08T20:55:45.669 INFO:teuthology.orchestra.run.smithi106.stdout:ID_LIKE="fedora" 2024-05-08T20:55:45.669 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION_ID="8.6" 2024-05-08T20:55:45.669 INFO:teuthology.orchestra.run.smithi106.stdout:PLATFORM_ID="platform:el8" 2024-05-08T20:55:45.669 INFO:teuthology.orchestra.run.smithi106.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-05-08T20:55:45.670 INFO:teuthology.orchestra.run.smithi106.stdout:ANSI_COLOR="0;31" 2024-05-08T20:55:45.670 INFO:teuthology.orchestra.run.smithi106.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-05-08T20:55:45.670 INFO:teuthology.orchestra.run.smithi106.stdout:HOME_URL="https://www.redhat.com/" 2024-05-08T20:55:45.670 INFO:teuthology.orchestra.run.smithi106.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-05-08T20:55:45.670 INFO:teuthology.orchestra.run.smithi106.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-08T20:55:45.670 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-08T20:55:45.670 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-05-08T20:55:45.670 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-05-08T20:55:45.670 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-05-08T20:55:45.670 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-05-08T20:55:45.671 INFO:teuthology.lock.ops:Updating smithi106.front.sepia.ceph.com on lock server 2024-05-08T20:55:45.687 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-08T20:55:45.696 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-08T20:55:45.711 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-08T20:55:45.711 DEBUG:teuthology.orchestra.run.smithi080:> test '!' -e /home/ubuntu/cephtest 2024-05-08T20:55:45.714 DEBUG:teuthology.orchestra.run.smithi106:> test '!' -e /home/ubuntu/cephtest 2024-05-08T20:55:45.736 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-08T20:55:45.742 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-08T20:55:45.742 DEBUG:teuthology.orchestra.run.smithi080:> test -z $(ls -A /var/lib/ceph) 2024-05-08T20:55:45.773 DEBUG:teuthology.orchestra.run.smithi106:> test -z $(ls -A /var/lib/ceph) 2024-05-08T20:55:45.803 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-08T20:55:45.858 INFO:teuthology.run_tasks:Running task kernel... 2024-05-08T20:55:45.875 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-05-08T20:55:45.875 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-05-08T20:55:45.875 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-05-08T20:55:45.876 DEBUG:teuthology.orchestra.run.smithi080:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-08T20:55:45.895 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T20:55:45.896 DEBUG:teuthology.orchestra.run.smithi080:> uname -r 2024-05-08T20:55:45.955 INFO:teuthology.orchestra.run.smithi080.stdout:4.18.0-513.9.1.el8_9.x86_64 2024-05-08T20:55:45.956 INFO:teuthology.task.kernel:Running kernel on smithi080: 4.18.0-513.9.1.el8_9.x86_64 2024-05-08T20:55:45.956 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum install -y kernel 2024-05-08T20:55:47.538 INFO:teuthology.orchestra.run.smithi080.stdout:Updating Subscription Management repositories. 2024-05-08T20:55:47.539 INFO:teuthology.orchestra.run.smithi080.stdout:Unable to read consumer identity 2024-05-08T20:55:47.832 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T20:55:47.832 INFO:teuthology.orchestra.run.smithi080.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-05-08T20:55:47.832 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T20:55:49.523 INFO:teuthology.orchestra.run.smithi080.stdout:Copr repo for python3-asyncssh owned by ceph 25 kB/s | 3.5 kB 00:00 2024-05-08T20:55:50.083 INFO:teuthology.orchestra.run.smithi080.stdout:Extra Packages for Enterprise Linux 30 MB/s | 16 MB 00:00 2024-05-08T20:55:53.774 INFO:teuthology.orchestra.run.smithi080.stdout:lab-extras 395 kB/s | 24 kB 00:00 2024-05-08T20:55:54.521 INFO:teuthology.orchestra.run.smithi080.stdout:Package kernel-4.18.0-513.9.1.el8_9.x86_64 is already installed. 2024-05-08T20:55:54.521 INFO:teuthology.orchestra.run.smithi080.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2024-05-08T20:55:54.610 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-05-08T20:55:54.611 INFO:teuthology.orchestra.run.smithi080.stdout:Nothing to do. 2024-05-08T20:55:54.611 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-05-08T20:55:54.756 DEBUG:teuthology.orchestra.run.smithi080:> echo no | sudo yum reinstall kernel || true 2024-05-08T20:55:55.091 INFO:teuthology.orchestra.run.smithi080.stdout:Updating Subscription Management repositories. 2024-05-08T20:55:55.091 INFO:teuthology.orchestra.run.smithi080.stdout:Unable to read consumer identity 2024-05-08T20:55:55.553 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T20:55:55.553 INFO:teuthology.orchestra.run.smithi080.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-05-08T20:55:55.553 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T20:55:55.865 INFO:teuthology.orchestra.run.smithi080.stdout:Last metadata expiration check: 0:00:02 ago on Wed 08 May 2024 08:55:53 PM UTC. 2024-05-08T20:55:55.946 INFO:teuthology.orchestra.run.smithi080.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2024-05-08T20:55:55.952 INFO:teuthology.orchestra.run.smithi080.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2024-05-08T20:55:55.987 INFO:teuthology.orchestra.run.smithi080.stderr:Error: No packages marked for reinstall. 2024-05-08T20:55:56.034 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum reinstall -y kernel || true 2024-05-08T20:55:56.411 INFO:teuthology.orchestra.run.smithi080.stdout:Updating Subscription Management repositories. 2024-05-08T20:55:56.412 INFO:teuthology.orchestra.run.smithi080.stdout:Unable to read consumer identity 2024-05-08T20:55:56.622 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T20:55:56.622 INFO:teuthology.orchestra.run.smithi080.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-05-08T20:55:56.623 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T20:55:56.923 INFO:teuthology.orchestra.run.smithi080.stdout:Last metadata expiration check: 0:00:03 ago on Wed 08 May 2024 08:55:53 PM UTC. 2024-05-08T20:55:56.991 INFO:teuthology.orchestra.run.smithi080.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2024-05-08T20:55:56.991 INFO:teuthology.orchestra.run.smithi080.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2024-05-08T20:55:57.029 INFO:teuthology.orchestra.run.smithi080.stderr:Error: No packages marked for reinstall. 2024-05-08T20:55:57.075 DEBUG:teuthology.orchestra.run.smithi080:> rpm -q kernel | sort -rV | head -n 1 2024-05-08T20:55:57.231 INFO:teuthology.orchestra.run.smithi080.stdout:kernel-4.18.0-513.9.1.el8_9.x86_64 2024-05-08T20:55:57.231 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-513.9.1.el8_9.x86_64 2024-05-08T20:55:57.232 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-05-08T20:55:57.232 DEBUG:teuthology.parallel:result is None 2024-05-08T20:55:57.232 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-08T20:55:57.243 INFO:teuthology.task.internal:Creating test directory... 2024-05-08T20:55:57.244 DEBUG:teuthology.orchestra.run.smithi080:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-08T20:55:57.246 DEBUG:teuthology.orchestra.run.smithi106:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-08T20:55:57.268 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-08T20:55:57.329 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-08T20:55:57.360 INFO:teuthology.task.internal:Creating archive directory... 2024-05-08T20:55:57.360 DEBUG:teuthology.orchestra.run.smithi080:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-08T20:55:57.363 DEBUG:teuthology.orchestra.run.smithi106:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-08T20:55:57.400 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-08T20:55:57.407 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-08T20:55:57.407 DEBUG:teuthology.orchestra.run.smithi106:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-08T20:55:57.455 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T20:55:57.455 DEBUG:teuthology.orchestra.run.smithi080:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-08T20:55:57.457 DEBUG:teuthology.orchestra.run.smithi106:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-08T20:55:57.488 INFO:teuthology.orchestra.run.smithi080.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T20:55:57.507 INFO:teuthology.orchestra.run.smithi080.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T20:55:57.541 INFO:teuthology.orchestra.run.smithi106.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T20:55:57.562 INFO:teuthology.orchestra.run.smithi106.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T20:55:57.564 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-08T20:55:57.571 INFO:teuthology.task.internal:Configuring sudo... 2024-05-08T20:55:57.571 DEBUG:teuthology.orchestra.run.smithi080:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-08T20:55:57.573 DEBUG:teuthology.orchestra.run.smithi106:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-08T20:55:57.603 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-08T20:55:57.612 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-08T20:55:57.612 DEBUG:teuthology.orchestra.run.smithi080:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-08T20:55:57.641 DEBUG:teuthology.orchestra.run.smithi106:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-08T20:55:57.661 DEBUG:teuthology.orchestra.run.smithi080:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T20:55:57.740 DEBUG:teuthology.orchestra.run.smithi080:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T20:55:57.799 DEBUG:teuthology.orchestra.run.smithi080:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T20:55:57.882 DEBUG:teuthology.orchestra.run.smithi080:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T20:55:57.923 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T20:55:57.924 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-08T20:55:57.991 DEBUG:teuthology.orchestra.run.smithi106:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T20:55:58.034 DEBUG:teuthology.orchestra.run.smithi106:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T20:55:58.103 DEBUG:teuthology.orchestra.run.smithi106:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T20:55:58.146 DEBUG:teuthology.orchestra.run.smithi106:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T20:55:58.199 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-08T20:55:58.199 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-08T20:55:58.272 DEBUG:teuthology.orchestra.run.smithi080:> sudo service rsyslog restart 2024-05-08T20:55:58.275 DEBUG:teuthology.orchestra.run.smithi106:> sudo service rsyslog restart 2024-05-08T20:55:58.319 INFO:teuthology.orchestra.run.smithi080.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T20:55:58.368 INFO:teuthology.orchestra.run.smithi106.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T20:55:58.812 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-08T20:55:58.819 INFO:teuthology.task.internal:Starting timer... 2024-05-08T20:55:58.819 INFO:teuthology.run_tasks:Running task pcp... 2024-05-08T20:55:58.833 INFO:teuthology.run_tasks:Running task selinux... 2024-05-08T20:55:58.840 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-05-08T20:55:58.840 DEBUG:teuthology.orchestra.run.smithi080:> sudo service auditd rotate 2024-05-08T20:55:58.898 INFO:teuthology.orchestra.run.smithi080.stdout:Rotating logs: 2024-05-08T20:55:58.900 DEBUG:teuthology.orchestra.run.smithi106:> sudo service auditd rotate 2024-05-08T20:55:58.969 INFO:teuthology.orchestra.run.smithi106.stdout:Rotating logs: 2024-05-08T20:55:58.971 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-08T20:55:58.971 DEBUG:teuthology.orchestra.run.smithi080:> /usr/sbin/getenforce 2024-05-08T20:55:58.997 INFO:teuthology.orchestra.run.smithi080.stdout:Permissive 2024-05-08T20:55:58.998 DEBUG:teuthology.orchestra.run.smithi106:> /usr/sbin/getenforce 2024-05-08T20:55:59.027 INFO:teuthology.orchestra.run.smithi106.stdout:Permissive 2024-05-08T20:55:59.027 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi080.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi106.front.sepia.ceph.com': 'permissive'} 2024-05-08T20:55:59.027 DEBUG:teuthology.orchestra.run.smithi080:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-08T20:55:59.065 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T20:55:59.065 DEBUG:teuthology.orchestra.run.smithi106:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-08T20:55:59.096 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T20:55:59.096 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-08T20:55:59.096 DEBUG:teuthology.orchestra.run.smithi080:> sudo /usr/sbin/setenforce permissive 2024-05-08T20:55:59.134 DEBUG:teuthology.orchestra.run.smithi106:> sudo /usr/sbin/setenforce permissive 2024-05-08T20:55:59.164 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-08T20:55:59.173 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-05-08T20:55:59.179 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-05-08T20:55:59.317 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-08T20:55:59.333 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-08T20:55:59.334 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi080.front.sepia.ceph.com,smithi106.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-08T21:06:07.790 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi080.front.sepia.ceph.com'), Remote(name='ubuntu@smithi106.front.sepia.ceph.com')] 2024-05-08T21:06:07.792 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-05-08T21:06:07.793 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T21:06:07.870 DEBUG:teuthology.orchestra.run.smithi080:> true 2024-05-08T21:06:07.935 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-05-08T21:06:07.935 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-05-08T21:06:07.936 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T21:06:08.032 DEBUG:teuthology.orchestra.run.smithi106:> true 2024-05-08T21:06:08.057 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-05-08T21:06:08.058 INFO:teuthology.run_tasks:Running task clock... 2024-05-08T21:06:08.068 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-08T21:06:08.068 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-08T21:06:08.069 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T21:06:08.071 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-08T21:06:08.071 DEBUG:teuthology.orchestra.run.smithi106:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T21:06:08.101 INFO:teuthology.orchestra.run.smithi080.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-08T21:06:08.115 INFO:teuthology.orchestra.run.smithi080.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-08T21:06:08.129 INFO:teuthology.orchestra.run.smithi106.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-08T21:06:08.144 INFO:teuthology.orchestra.run.smithi106.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-08T21:06:08.181 INFO:teuthology.orchestra.run.smithi080.stderr:sudo: ntpd: command not found 2024-05-08T21:06:08.193 INFO:teuthology.orchestra.run.smithi080.stdout:506 Cannot talk to daemon 2024-05-08T21:06:08.208 INFO:teuthology.orchestra.run.smithi080.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-08T21:06:08.214 INFO:teuthology.orchestra.run.smithi106.stderr:sudo: ntpd: command not found 2024-05-08T21:06:08.221 INFO:teuthology.orchestra.run.smithi080.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-08T21:06:08.225 INFO:teuthology.orchestra.run.smithi106.stdout:506 Cannot talk to daemon 2024-05-08T21:06:08.241 INFO:teuthology.orchestra.run.smithi106.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-08T21:06:08.255 INFO:teuthology.orchestra.run.smithi106.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-08T21:06:08.300 INFO:teuthology.orchestra.run.smithi080.stderr:bash: ntpq: command not found 2024-05-08T21:06:08.303 INFO:teuthology.orchestra.run.smithi080.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T21:06:08.304 INFO:teuthology.orchestra.run.smithi080.stdout:=============================================================================== 2024-05-08T21:06:08.304 INFO:teuthology.orchestra.run.smithi080.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T21:06:08.304 INFO:teuthology.orchestra.run.smithi080.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T21:06:08.304 INFO:teuthology.orchestra.run.smithi080.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T21:06:08.304 INFO:teuthology.orchestra.run.smithi080.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T21:06:08.330 INFO:teuthology.orchestra.run.smithi106.stderr:bash: ntpq: command not found 2024-05-08T21:06:08.333 INFO:teuthology.orchestra.run.smithi106.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T21:06:08.333 INFO:teuthology.orchestra.run.smithi106.stdout:=============================================================================== 2024-05-08T21:06:08.333 INFO:teuthology.orchestra.run.smithi106.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T21:06:08.333 INFO:teuthology.orchestra.run.smithi106.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T21:06:08.333 INFO:teuthology.orchestra.run.smithi106.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T21:06:08.333 INFO:teuthology.orchestra.run.smithi106.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T21:06:08.334 INFO:teuthology.run_tasks:Running task install... 2024-05-08T21:06:08.343 DEBUG:teuthology.task.install:project ceph 2024-05-08T21:06:08.343 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34'}} 2024-05-08T21:06:08.343 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34'} 2024-05-08T21:06:08.343 INFO:teuthology.task.install:Using flavor: default 2024-05-08T21:06:08.349 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-08T21:06:08.349 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-05-08T21:06:08.349 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34', 'tag': None, 'wait_for_package': False} 2024-05-08T21:06:08.349 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T21:06:08.351 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34', 'tag': None, 'wait_for_package': False} 2024-05-08T21:06:08.352 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T21:06:08.496 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/ 2024-05-08T21:06:08.496 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1322.gd21e4f96 2024-05-08T21:06:08.569 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/ 2024-05-08T21:06:08.569 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1322.gd21e4f96 2024-05-08T21:06:08.725 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-08T21:06:08.726 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-08T21:06:08.726 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-08T21:06:08.734 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-08T21:06:08.734 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T21:06:08.734 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-08T21:06:08.755 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-08T21:06:08.755 DEBUG:teuthology.orchestra.run.smithi106:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d21e4f961318b56f0d915caa2490c3711bf13c34/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-08T21:06:08.762 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-08T21:06:08.762 DEBUG:teuthology.orchestra.run.smithi080:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d21e4f961318b56f0d915caa2490c3711bf13c34/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-08T21:06:08.824 DEBUG:teuthology.orchestra.run.smithi106:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-08T21:06:08.830 DEBUG:teuthology.orchestra.run.smithi080:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-08T21:06:08.902 DEBUG:teuthology.orchestra.run.smithi106:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-08T21:06:08.908 DEBUG:teuthology.orchestra.run.smithi080:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-08T21:06:08.969 INFO:teuthology.orchestra.run.smithi106.stdout:check_obsoletes = 1 2024-05-08T21:06:08.971 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum clean all 2024-05-08T21:06:08.974 INFO:teuthology.orchestra.run.smithi080.stdout:check_obsoletes = 1 2024-05-08T21:06:08.975 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum clean all 2024-05-08T21:06:09.348 INFO:teuthology.orchestra.run.smithi106.stdout:Updating Subscription Management repositories. 2024-05-08T21:06:09.351 INFO:teuthology.orchestra.run.smithi080.stdout:Updating Subscription Management repositories. 2024-05-08T21:06:10.455 INFO:teuthology.orchestra.run.smithi106.stdout:63 files removed 2024-05-08T21:06:10.505 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-08T21:06:10.674 INFO:teuthology.orchestra.run.smithi080.stdout:63 files removed 2024-05-08T21:06:10.723 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-08T21:06:10.841 INFO:teuthology.orchestra.run.smithi106.stdout:Updating Subscription Management repositories. 2024-05-08T21:06:11.057 INFO:teuthology.orchestra.run.smithi080.stdout:Updating Subscription Management repositories. 2024-05-08T21:06:12.603 INFO:teuthology.orchestra.run.smithi106.stdout:ceph packages for x86_64 234 kB/s | 80 kB 00:00 2024-05-08T21:06:12.866 INFO:teuthology.orchestra.run.smithi080.stdout:ceph packages for x86_64 236 kB/s | 80 kB 00:00 2024-05-08T21:06:12.970 INFO:teuthology.orchestra.run.smithi106.stdout:ceph noarch packages 34 kB/s | 11 kB 00:00 2024-05-08T21:06:13.158 INFO:teuthology.orchestra.run.smithi080.stdout:ceph noarch packages 44 kB/s | 11 kB 00:00 2024-05-08T21:06:13.287 INFO:teuthology.orchestra.run.smithi106.stdout:ceph source packages 5.1 kB/s | 1.5 kB 00:00 2024-05-08T21:06:13.438 INFO:teuthology.orchestra.run.smithi106.stdout:Copr repo for python3-asyncssh owned by ceph 28 kB/s | 3.5 kB 00:00 2024-05-08T21:06:13.534 INFO:teuthology.orchestra.run.smithi080.stdout:ceph source packages 4.3 kB/s | 1.5 kB 00:00 2024-05-08T21:06:13.684 INFO:teuthology.orchestra.run.smithi080.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2024-05-08T21:06:14.489 INFO:teuthology.orchestra.run.smithi106.stdout:Extra Packages for Enterprise Linux 16 MB/s | 16 MB 00:01 2024-05-08T21:06:14.593 INFO:teuthology.orchestra.run.smithi080.stdout:Extra Packages for Enterprise Linux 18 MB/s | 16 MB 00:00 2024-05-08T21:06:18.064 INFO:teuthology.orchestra.run.smithi106.stdout:lab-extras 362 kB/s | 24 kB 00:00 2024-05-08T21:06:18.243 INFO:teuthology.orchestra.run.smithi080.stdout:lab-extras 439 kB/s | 24 kB 00:00 2024-05-08T21:06:18.774 INFO:teuthology.orchestra.run.smithi106.stdout:Red Hat CodeReady Linux Builder for RHEL 8 x86_ 14 MB/s | 8.8 MB 00:00 2024-05-08T21:06:19.595 INFO:teuthology.orchestra.run.smithi080.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 53 MB/s | 67 MB 00:01 2024-05-08T21:06:21.609 INFO:teuthology.orchestra.run.smithi106.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 51 MB/s | 67 MB 00:01 2024-05-08T21:06:30.061 INFO:teuthology.orchestra.run.smithi080.stdout:Red Hat CodeReady Linux Builder for RHEL 8 x86_ 13 MB/s | 8.8 MB 00:00 2024-05-08T21:06:32.342 INFO:teuthology.orchestra.run.smithi106.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 52 MB/s | 61 MB 00:01 2024-05-08T21:06:33.387 INFO:teuthology.orchestra.run.smithi080.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 38 MB/s | 61 MB 00:01 2024-05-08T21:06:48.075 INFO:teuthology.orchestra.run.smithi106.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-05-08T21:06:48.076 INFO:teuthology.orchestra.run.smithi106.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-05-08T21:06:48.095 INFO:teuthology.orchestra.run.smithi106.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2024-05-08T21:06:48.096 INFO:teuthology.orchestra.run.smithi106.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2024-05-08T21:06:48.097 INFO:teuthology.orchestra.run.smithi106.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2024-05-08T21:06:48.099 INFO:teuthology.orchestra.run.smithi106.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2024-05-08T21:06:48.101 INFO:teuthology.orchestra.run.smithi106.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2024-05-08T21:06:48.105 INFO:teuthology.orchestra.run.smithi106.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2024-05-08T21:06:48.107 INFO:teuthology.orchestra.run.smithi106.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2024-05-08T21:06:48.327 INFO:teuthology.orchestra.run.smithi106.stdout:Dependencies resolved. 2024-05-08T21:06:48.341 INFO:teuthology.orchestra.run.smithi106.stdout:=================================================================================================================================== 2024-05-08T21:06:48.341 INFO:teuthology.orchestra.run.smithi106.stdout: Package Arch Version Repository Size 2024-05-08T21:06:48.341 INFO:teuthology.orchestra.run.smithi106.stdout:=================================================================================================================================== 2024-05-08T21:06:48.341 INFO:teuthology.orchestra.run.smithi106.stdout:Installing: 2024-05-08T21:06:48.341 INFO:teuthology.orchestra.run.smithi106.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-15.el8_9 rhel-8-for-x86_64-baseos-rpms 144 k 2024-05-08T21:06:48.341 INFO:teuthology.orchestra.run.smithi106.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2024-05-08T21:06:48.342 INFO:teuthology.orchestra.run.smithi106.stdout: ceph x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 6.4 k 2024-05-08T21:06:48.342 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-base x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 5.5 M 2024-05-08T21:06:48.342 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-fuse x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 860 k 2024-05-08T21:06:48.342 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 166 k 2024-05-08T21:06:48.342 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 1.6 M 2024-05-08T21:06:48.342 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 138 k 2024-05-08T21:06:48.342 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 3.5 M 2024-05-08T21:06:48.342 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 7.4 M 2024-05-08T21:06:48.345 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-rook noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 49 k 2024-05-08T21:06:48.346 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-radosgw x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 13 M 2024-05-08T21:06:48.346 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-test x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 47 M 2024-05-08T21:06:48.346 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-volume noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 263 k 2024-05-08T21:06:48.346 INFO:teuthology.orchestra.run.smithi106.stdout: cephadm noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 170 k 2024-05-08T21:06:48.346 INFO:teuthology.orchestra.run.smithi106.stdout: cephfs-mirror x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 261 k 2024-05-08T21:06:48.346 INFO:teuthology.orchestra.run.smithi106.stdout: cephfs-top noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 18 k 2024-05-08T21:06:48.346 INFO:teuthology.orchestra.run.smithi106.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 62 k 2024-05-08T21:06:48.346 INFO:teuthology.orchestra.run.smithi106.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2024-05-08T21:06:48.346 INFO:teuthology.orchestra.run.smithi106.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2024-05-08T21:06:48.346 INFO:teuthology.orchestra.run.smithi106.stdout: libcephfs-devel x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 31 k 2024-05-08T21:06:48.346 INFO:teuthology.orchestra.run.smithi106.stdout: libcephfs2 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 782 k 2024-05-08T21:06:48.347 INFO:teuthology.orchestra.run.smithi106.stdout: librados-devel x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 139 k 2024-05-08T21:06:48.347 INFO:teuthology.orchestra.run.smithi106.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2024-05-08T21:06:48.347 INFO:teuthology.orchestra.run.smithi106.stdout: libuuid-devel x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 100 k 2024-05-08T21:06:48.347 INFO:teuthology.orchestra.run.smithi106.stdout: openssl-devel x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 2.3 M 2024-05-08T21:06:48.347 INFO:teuthology.orchestra.run.smithi106.stdout: postgresql x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 1.5 M 2024-05-08T21:06:48.347 INFO:teuthology.orchestra.run.smithi106.stdout: postgresql-contrib x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 812 k 2024-05-08T21:06:48.347 INFO:teuthology.orchestra.run.smithi106.stdout: postgresql-server x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 5.1 M 2024-05-08T21:06:48.347 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cephfs x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 197 k 2024-05-08T21:06:48.347 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rados x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 370 k 2024-05-08T21:06:48.347 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rbd x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 365 k 2024-05-08T21:06:48.347 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rgw x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 107 k 2024-05-08T21:06:48.347 INFO:teuthology.orchestra.run.smithi106.stdout: rbd-fuse x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 95 k 2024-05-08T21:06:48.347 INFO:teuthology.orchestra.run.smithi106.stdout: rbd-mirror x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 3.5 M 2024-05-08T21:06:48.347 INFO:teuthology.orchestra.run.smithi106.stdout: rbd-nbd x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 181 k 2024-05-08T21:06:48.348 INFO:teuthology.orchestra.run.smithi106.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 73 k 2024-05-08T21:06:48.348 INFO:teuthology.orchestra.run.smithi106.stdout:Upgrading: 2024-05-08T21:06:48.348 INFO:teuthology.orchestra.run.smithi106.stdout: elfutils-libelf x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 232 k 2024-05-08T21:06:48.348 INFO:teuthology.orchestra.run.smithi106.stdout: elfutils-libs x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 303 k 2024-05-08T21:06:48.348 INFO:teuthology.orchestra.run.smithi106.stdout: iproute x86_64 6.2.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 854 k 2024-05-08T21:06:48.348 INFO:teuthology.orchestra.run.smithi106.stdout: libblkid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 221 k 2024-05-08T21:06:48.348 INFO:teuthology.orchestra.run.smithi106.stdout: libfdisk x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 254 k 2024-05-08T21:06:48.348 INFO:teuthology.orchestra.run.smithi106.stdout: libmount x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 237 k 2024-05-08T21:06:48.348 INFO:teuthology.orchestra.run.smithi106.stdout: librados2 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 3.7 M 2024-05-08T21:06:48.348 INFO:teuthology.orchestra.run.smithi106.stdout: librbd1 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 3.6 M 2024-05-08T21:06:48.348 INFO:teuthology.orchestra.run.smithi106.stdout: libsmartcols x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 180 k 2024-05-08T21:06:48.348 INFO:teuthology.orchestra.run.smithi106.stdout: libuuid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 99 k 2024-05-08T21:06:48.349 INFO:teuthology.orchestra.run.smithi106.stdout: openssl x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 711 k 2024-05-08T21:06:48.349 INFO:teuthology.orchestra.run.smithi106.stdout: openssl-libs x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 1.5 M 2024-05-08T21:06:48.349 INFO:teuthology.orchestra.run.smithi106.stdout: util-linux x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 2.5 M 2024-05-08T21:06:48.349 INFO:teuthology.orchestra.run.smithi106.stdout: util-linux-user x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 103 k 2024-05-08T21:06:48.349 INFO:teuthology.orchestra.run.smithi106.stdout: xfsdump x86_64 3.1.8-7.el8_9 rhel-8-for-x86_64-baseos-rpms 333 k 2024-05-08T21:06:48.349 INFO:teuthology.orchestra.run.smithi106.stdout: xfsprogs x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 1.1 M 2024-05-08T21:06:48.349 INFO:teuthology.orchestra.run.smithi106.stdout:Installing dependencies: 2024-05-08T21:06:48.349 INFO:teuthology.orchestra.run.smithi106.stdout: automake noarch 1.16.1-8.el8 rhel-8-for-x86_64-appstream-rpms 714 k 2024-05-08T21:06:48.349 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-common x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 22 M 2024-05-08T21:06:48.349 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 24 k 2024-05-08T21:06:48.349 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mds x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 2.3 M 2024-05-08T21:06:48.349 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 245 k 2024-05-08T21:06:48.349 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mon x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 4.8 M 2024-05-08T21:06:48.349 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-osd x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 18 M 2024-05-08T21:06:48.350 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 16 k 2024-05-08T21:06:48.350 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-selinux x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 24 k 2024-05-08T21:06:48.350 INFO:teuthology.orchestra.run.smithi106.stdout: fuse x86_64 2.9.7-17.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2024-05-08T21:06:48.350 INFO:teuthology.orchestra.run.smithi106.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-05-08T21:06:48.350 INFO:teuthology.orchestra.run.smithi106.stdout: jq x86_64 1.6-7.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2024-05-08T21:06:48.350 INFO:teuthology.orchestra.run.smithi106.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2024-05-08T21:06:48.350 INFO:teuthology.orchestra.run.smithi106.stdout: krb5-devel x86_64 1.18.2-26.el8_9 rhel-8-for-x86_64-baseos-rpms 562 k 2024-05-08T21:06:48.350 INFO:teuthology.orchestra.run.smithi106.stdout: libcephsqlite x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 142 k 2024-05-08T21:06:48.350 INFO:teuthology.orchestra.run.smithi106.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2024-05-08T21:06:48.350 INFO:teuthology.orchestra.run.smithi106.stdout: libgfortran x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 645 k 2024-05-08T21:06:48.350 INFO:teuthology.orchestra.run.smithi106.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-05-08T21:06:48.350 INFO:teuthology.orchestra.run.smithi106.stdout: libpq x86_64 13.11-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2024-05-08T21:06:48.350 INFO:teuthology.orchestra.run.smithi106.stdout: libquadmath x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 172 k 2024-05-08T21:06:48.351 INFO:teuthology.orchestra.run.smithi106.stdout: librabbitmq x86_64 0.9.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 47 k 2024-05-08T21:06:48.351 INFO:teuthology.orchestra.run.smithi106.stdout: libradosstriper1 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 474 k 2024-05-08T21:06:48.351 INFO:teuthology.orchestra.run.smithi106.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2024-05-08T21:06:48.351 INFO:teuthology.orchestra.run.smithi106.stdout: librgw2 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 6.5 M 2024-05-08T21:06:48.351 INFO:teuthology.orchestra.run.smithi106.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2024-05-08T21:06:48.351 INFO:teuthology.orchestra.run.smithi106.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2024-05-08T21:06:48.351 INFO:teuthology.orchestra.run.smithi106.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-05-08T21:06:48.351 INFO:teuthology.orchestra.run.smithi106.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2024-05-08T21:06:48.351 INFO:teuthology.orchestra.run.smithi106.stdout: libzstd-devel x86_64 1.4.4-1.el8 rhel-8-for-x86_64-baseos-rpms 44 k 2024-05-08T21:06:48.351 INFO:teuthology.orchestra.run.smithi106.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2024-05-08T21:06:48.351 INFO:teuthology.orchestra.run.smithi106.stdout: oniguruma x86_64 6.8.2-2.1.el8_9 rhel-8-for-x86_64-appstream-rpms 188 k 2024-05-08T21:06:48.351 INFO:teuthology.orchestra.run.smithi106.stdout: openblas x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.0 M 2024-05-08T21:06:48.352 INFO:teuthology.orchestra.run.smithi106.stdout: openblas-threads x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.2 M 2024-05-08T21:06:48.352 INFO:teuthology.orchestra.run.smithi106.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2024-05-08T21:06:48.352 INFO:teuthology.orchestra.run.smithi106.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2024-05-08T21:06:48.352 INFO:teuthology.orchestra.run.smithi106.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2024-05-08T21:06:48.352 INFO:teuthology.orchestra.run.smithi106.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-05-08T21:06:48.352 INFO:teuthology.orchestra.run.smithi106.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2024-05-08T21:06:48.352 INFO:teuthology.orchestra.run.smithi106.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-05-08T21:06:48.352 INFO:teuthology.orchestra.run.smithi106.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-05-08T21:06:48.352 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-05-08T21:06:48.352 INFO:teuthology.orchestra.run.smithi106.stdout: python3-ceph-argparse x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 45 k 2024-05-08T21:06:48.352 INFO:teuthology.orchestra.run.smithi106.stdout: python3-ceph-common x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 129 k 2024-05-08T21:06:48.352 INFO:teuthology.orchestra.run.smithi106.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-05-08T21:06:48.352 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cffi x86_64 1.11.5-6.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2024-05-08T21:06:48.353 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-05-08T21:06:48.353 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-05-08T21:06:48.353 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cryptography x86_64 3.2.1-7.el8_9 rhel-8-for-x86_64-baseos-rpms 559 k 2024-05-08T21:06:48.353 INFO:teuthology.orchestra.run.smithi106.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-05-08T21:06:48.353 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-05-08T21:06:48.353 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-05-08T21:06:48.353 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2024-05-08T21:06:48.353 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2024-05-08T21:06:48.353 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2024-05-08T21:06:48.353 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-05-08T21:06:48.353 INFO:teuthology.orchestra.run.smithi106.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-05-08T21:06:48.353 INFO:teuthology.orchestra.run.smithi106.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-05-08T21:06:48.353 INFO:teuthology.orchestra.run.smithi106.stdout: python3-mako noarch 1.0.6-14.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2024-05-08T21:06:48.353 INFO:teuthology.orchestra.run.smithi106.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2024-05-08T21:06:48.354 INFO:teuthology.orchestra.run.smithi106.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-05-08T21:06:48.354 INFO:teuthology.orchestra.run.smithi106.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-05-08T21:06:48.354 INFO:teuthology.orchestra.run.smithi106.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-05-08T21:06:48.354 INFO:teuthology.orchestra.run.smithi106.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2024-05-08T21:06:48.354 INFO:teuthology.orchestra.run.smithi106.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2024-05-08T21:06:48.354 INFO:teuthology.orchestra.run.smithi106.stdout: python3-packaging noarch 16.8-9.el8 codeready-builder-for-rhel-8-x86_64-rpms 48 k 2024-05-08T21:06:48.354 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-05-08T21:06:48.354 INFO:teuthology.orchestra.run.smithi106.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-05-08T21:06:48.354 INFO:teuthology.orchestra.run.smithi106.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2024-05-08T21:06:48.354 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2024-05-08T21:06:48.354 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2024-05-08T21:06:48.354 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2024-05-08T21:06:48.354 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2024-05-08T21:06:48.354 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pytz noarch 2017.2-11.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2024-05-08T21:06:48.355 INFO:teuthology.orchestra.run.smithi106.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-05-08T21:06:48.355 INFO:teuthology.orchestra.run.smithi106.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-05-08T21:06:48.355 INFO:teuthology.orchestra.run.smithi106.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-05-08T21:06:48.355 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-05-08T21:06:48.355 INFO:teuthology.orchestra.run.smithi106.stdout: python3-scipy x86_64 1.0.0-21.module+el8.9.0+20976+d3c38525 rhel-8-for-x86_64-appstream-rpms 14 M 2024-05-08T21:06:48.355 INFO:teuthology.orchestra.run.smithi106.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-05-08T21:06:48.355 INFO:teuthology.orchestra.run.smithi106.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-05-08T21:06:48.355 INFO:teuthology.orchestra.run.smithi106.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-05-08T21:06:48.355 INFO:teuthology.orchestra.run.smithi106.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-05-08T21:06:48.355 INFO:teuthology.orchestra.run.smithi106.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-05-08T21:06:48.355 INFO:teuthology.orchestra.run.smithi106.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-05-08T21:06:48.355 INFO:teuthology.orchestra.run.smithi106.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-05-08T21:06:48.355 INFO:teuthology.orchestra.run.smithi106.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-05-08T21:06:48.355 INFO:teuthology.orchestra.run.smithi106.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2024-05-08T21:06:48.356 INFO:teuthology.orchestra.run.smithi106.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-05-08T21:06:48.356 INFO:teuthology.orchestra.run.smithi106.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2024-05-08T21:06:48.356 INFO:teuthology.orchestra.run.smithi106.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-05-08T21:06:48.356 INFO:teuthology.orchestra.run.smithi106.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2024-05-08T21:06:48.356 INFO:teuthology.orchestra.run.smithi106.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2024-05-08T21:06:48.356 INFO:teuthology.orchestra.run.smithi106.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2024-05-08T21:06:48.356 INFO:teuthology.orchestra.run.smithi106.stdout:Enabling module streams: 2024-05-08T21:06:48.356 INFO:teuthology.orchestra.run.smithi106.stdout: postgresql 10 2024-05-08T21:06:48.356 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-08T21:06:48.356 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction Summary 2024-05-08T21:06:48.356 INFO:teuthology.orchestra.run.smithi106.stdout:=================================================================================================================================== 2024-05-08T21:06:48.356 INFO:teuthology.orchestra.run.smithi106.stdout:Install 130 Packages 2024-05-08T21:06:48.356 INFO:teuthology.orchestra.run.smithi106.stdout:Upgrade 16 Packages 2024-05-08T21:06:48.356 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-08T21:06:48.357 INFO:teuthology.orchestra.run.smithi106.stdout:Total download size: 215 M 2024-05-08T21:06:48.357 INFO:teuthology.orchestra.run.smithi106.stdout:Downloading Packages: 2024-05-08T21:06:49.076 INFO:teuthology.orchestra.run.smithi106.stdout:(1/146): ceph-18.2.2-1322.gd21e4f96.el8.x86_64. 17 kB/s | 6.4 kB 00:00 2024-05-08T21:06:49.509 INFO:teuthology.orchestra.run.smithi080.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-05-08T21:06:49.511 INFO:teuthology.orchestra.run.smithi080.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-05-08T21:06:49.530 INFO:teuthology.orchestra.run.smithi080.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2024-05-08T21:06:49.532 INFO:teuthology.orchestra.run.smithi080.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2024-05-08T21:06:49.533 INFO:teuthology.orchestra.run.smithi080.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2024-05-08T21:06:49.535 INFO:teuthology.orchestra.run.smithi080.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2024-05-08T21:06:49.538 INFO:teuthology.orchestra.run.smithi080.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2024-05-08T21:06:49.542 INFO:teuthology.orchestra.run.smithi080.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2024-05-08T21:06:49.544 INFO:teuthology.orchestra.run.smithi080.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2024-05-08T21:06:49.763 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-05-08T21:06:49.777 INFO:teuthology.orchestra.run.smithi080.stdout:=================================================================================================================================== 2024-05-08T21:06:49.777 INFO:teuthology.orchestra.run.smithi080.stdout: Package Arch Version Repository Size 2024-05-08T21:06:49.777 INFO:teuthology.orchestra.run.smithi080.stdout:=================================================================================================================================== 2024-05-08T21:06:49.777 INFO:teuthology.orchestra.run.smithi080.stdout:Installing: 2024-05-08T21:06:49.777 INFO:teuthology.orchestra.run.smithi080.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-15.el8_9 rhel-8-for-x86_64-baseos-rpms 144 k 2024-05-08T21:06:49.778 INFO:teuthology.orchestra.run.smithi080.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2024-05-08T21:06:49.778 INFO:teuthology.orchestra.run.smithi080.stdout: ceph x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 6.4 k 2024-05-08T21:06:49.778 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-base x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 5.5 M 2024-05-08T21:06:49.778 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-fuse x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 860 k 2024-05-08T21:06:49.778 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 166 k 2024-05-08T21:06:49.778 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 1.6 M 2024-05-08T21:06:49.778 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 138 k 2024-05-08T21:06:49.778 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 3.5 M 2024-05-08T21:06:49.778 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 7.4 M 2024-05-08T21:06:49.778 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-rook noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 49 k 2024-05-08T21:06:49.778 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-radosgw x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 13 M 2024-05-08T21:06:49.778 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-test x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 47 M 2024-05-08T21:06:49.778 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-volume noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 263 k 2024-05-08T21:06:49.779 INFO:teuthology.orchestra.run.smithi080.stdout: cephadm noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 170 k 2024-05-08T21:06:49.779 INFO:teuthology.orchestra.run.smithi080.stdout: cephfs-mirror x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 261 k 2024-05-08T21:06:49.779 INFO:teuthology.orchestra.run.smithi080.stdout: cephfs-top noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 18 k 2024-05-08T21:06:49.781 INFO:teuthology.orchestra.run.smithi080.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 62 k 2024-05-08T21:06:49.781 INFO:teuthology.orchestra.run.smithi080.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2024-05-08T21:06:49.781 INFO:teuthology.orchestra.run.smithi080.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2024-05-08T21:06:49.782 INFO:teuthology.orchestra.run.smithi080.stdout: libcephfs-devel x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 31 k 2024-05-08T21:06:49.782 INFO:teuthology.orchestra.run.smithi080.stdout: libcephfs2 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 782 k 2024-05-08T21:06:49.782 INFO:teuthology.orchestra.run.smithi080.stdout: librados-devel x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 139 k 2024-05-08T21:06:49.782 INFO:teuthology.orchestra.run.smithi080.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2024-05-08T21:06:49.782 INFO:teuthology.orchestra.run.smithi080.stdout: libuuid-devel x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 100 k 2024-05-08T21:06:49.782 INFO:teuthology.orchestra.run.smithi080.stdout: openssl-devel x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 2.3 M 2024-05-08T21:06:49.782 INFO:teuthology.orchestra.run.smithi080.stdout: postgresql x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 1.5 M 2024-05-08T21:06:49.782 INFO:teuthology.orchestra.run.smithi080.stdout: postgresql-contrib x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 812 k 2024-05-08T21:06:49.782 INFO:teuthology.orchestra.run.smithi080.stdout: postgresql-server x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 5.1 M 2024-05-08T21:06:49.782 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cephfs x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 197 k 2024-05-08T21:06:49.782 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rados x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 370 k 2024-05-08T21:06:49.782 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rbd x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 365 k 2024-05-08T21:06:49.782 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rgw x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 107 k 2024-05-08T21:06:49.783 INFO:teuthology.orchestra.run.smithi080.stdout: rbd-fuse x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 95 k 2024-05-08T21:06:49.783 INFO:teuthology.orchestra.run.smithi080.stdout: rbd-mirror x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 3.5 M 2024-05-08T21:06:49.783 INFO:teuthology.orchestra.run.smithi080.stdout: rbd-nbd x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 181 k 2024-05-08T21:06:49.783 INFO:teuthology.orchestra.run.smithi080.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 73 k 2024-05-08T21:06:49.783 INFO:teuthology.orchestra.run.smithi080.stdout:Upgrading: 2024-05-08T21:06:49.783 INFO:teuthology.orchestra.run.smithi080.stdout: elfutils-libelf x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 232 k 2024-05-08T21:06:49.783 INFO:teuthology.orchestra.run.smithi080.stdout: elfutils-libs x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 303 k 2024-05-08T21:06:49.783 INFO:teuthology.orchestra.run.smithi080.stdout: iproute x86_64 6.2.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 854 k 2024-05-08T21:06:49.783 INFO:teuthology.orchestra.run.smithi080.stdout: libblkid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 221 k 2024-05-08T21:06:49.783 INFO:teuthology.orchestra.run.smithi080.stdout: libfdisk x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 254 k 2024-05-08T21:06:49.783 INFO:teuthology.orchestra.run.smithi080.stdout: libmount x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 237 k 2024-05-08T21:06:49.783 INFO:teuthology.orchestra.run.smithi080.stdout: librados2 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 3.7 M 2024-05-08T21:06:49.783 INFO:teuthology.orchestra.run.smithi080.stdout: librbd1 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 3.6 M 2024-05-08T21:06:49.784 INFO:teuthology.orchestra.run.smithi080.stdout: libsmartcols x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 180 k 2024-05-08T21:06:49.784 INFO:teuthology.orchestra.run.smithi080.stdout: libuuid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 99 k 2024-05-08T21:06:49.784 INFO:teuthology.orchestra.run.smithi080.stdout: openssl x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 711 k 2024-05-08T21:06:49.784 INFO:teuthology.orchestra.run.smithi080.stdout: openssl-libs x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 1.5 M 2024-05-08T21:06:49.784 INFO:teuthology.orchestra.run.smithi080.stdout: util-linux x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 2.5 M 2024-05-08T21:06:49.784 INFO:teuthology.orchestra.run.smithi080.stdout: util-linux-user x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 103 k 2024-05-08T21:06:49.784 INFO:teuthology.orchestra.run.smithi080.stdout: xfsdump x86_64 3.1.8-7.el8_9 rhel-8-for-x86_64-baseos-rpms 333 k 2024-05-08T21:06:49.784 INFO:teuthology.orchestra.run.smithi080.stdout: xfsprogs x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 1.1 M 2024-05-08T21:06:49.784 INFO:teuthology.orchestra.run.smithi080.stdout:Installing dependencies: 2024-05-08T21:06:49.784 INFO:teuthology.orchestra.run.smithi080.stdout: automake noarch 1.16.1-8.el8 rhel-8-for-x86_64-appstream-rpms 714 k 2024-05-08T21:06:49.784 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-common x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 22 M 2024-05-08T21:06:49.784 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 24 k 2024-05-08T21:06:49.784 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mds x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 2.3 M 2024-05-08T21:06:49.785 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 245 k 2024-05-08T21:06:49.785 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mon x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 4.8 M 2024-05-08T21:06:49.785 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-osd x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 18 M 2024-05-08T21:06:49.785 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 16 k 2024-05-08T21:06:49.785 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-selinux x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 24 k 2024-05-08T21:06:49.785 INFO:teuthology.orchestra.run.smithi080.stdout: fuse x86_64 2.9.7-17.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2024-05-08T21:06:49.785 INFO:teuthology.orchestra.run.smithi080.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-05-08T21:06:49.785 INFO:teuthology.orchestra.run.smithi080.stdout: jq x86_64 1.6-7.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2024-05-08T21:06:49.785 INFO:teuthology.orchestra.run.smithi080.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2024-05-08T21:06:49.785 INFO:teuthology.orchestra.run.smithi080.stdout: krb5-devel x86_64 1.18.2-26.el8_9 rhel-8-for-x86_64-baseos-rpms 562 k 2024-05-08T21:06:49.785 INFO:teuthology.orchestra.run.smithi080.stdout: libcephsqlite x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 142 k 2024-05-08T21:06:49.785 INFO:teuthology.orchestra.run.smithi080.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2024-05-08T21:06:49.785 INFO:teuthology.orchestra.run.smithi080.stdout: libgfortran x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 645 k 2024-05-08T21:06:49.786 INFO:teuthology.orchestra.run.smithi080.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-05-08T21:06:49.786 INFO:teuthology.orchestra.run.smithi080.stdout: libpq x86_64 13.11-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2024-05-08T21:06:49.786 INFO:teuthology.orchestra.run.smithi080.stdout: libquadmath x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 172 k 2024-05-08T21:06:49.786 INFO:teuthology.orchestra.run.smithi080.stdout: librabbitmq x86_64 0.9.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 47 k 2024-05-08T21:06:49.786 INFO:teuthology.orchestra.run.smithi080.stdout: libradosstriper1 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 474 k 2024-05-08T21:06:49.786 INFO:teuthology.orchestra.run.smithi080.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2024-05-08T21:06:49.786 INFO:teuthology.orchestra.run.smithi080.stdout: librgw2 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 6.5 M 2024-05-08T21:06:49.786 INFO:teuthology.orchestra.run.smithi080.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2024-05-08T21:06:49.786 INFO:teuthology.orchestra.run.smithi080.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2024-05-08T21:06:49.786 INFO:teuthology.orchestra.run.smithi080.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-05-08T21:06:49.786 INFO:teuthology.orchestra.run.smithi080.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2024-05-08T21:06:49.786 INFO:teuthology.orchestra.run.smithi080.stdout: libzstd-devel x86_64 1.4.4-1.el8 rhel-8-for-x86_64-baseos-rpms 44 k 2024-05-08T21:06:49.787 INFO:teuthology.orchestra.run.smithi080.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2024-05-08T21:06:49.787 INFO:teuthology.orchestra.run.smithi080.stdout: oniguruma x86_64 6.8.2-2.1.el8_9 rhel-8-for-x86_64-appstream-rpms 188 k 2024-05-08T21:06:49.787 INFO:teuthology.orchestra.run.smithi080.stdout: openblas x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.0 M 2024-05-08T21:06:49.787 INFO:teuthology.orchestra.run.smithi080.stdout: openblas-threads x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.2 M 2024-05-08T21:06:49.787 INFO:teuthology.orchestra.run.smithi080.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2024-05-08T21:06:49.787 INFO:teuthology.orchestra.run.smithi080.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2024-05-08T21:06:49.787 INFO:teuthology.orchestra.run.smithi080.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2024-05-08T21:06:49.787 INFO:teuthology.orchestra.run.smithi080.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-05-08T21:06:49.787 INFO:teuthology.orchestra.run.smithi080.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2024-05-08T21:06:49.787 INFO:teuthology.orchestra.run.smithi080.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-05-08T21:06:49.787 INFO:teuthology.orchestra.run.smithi080.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-05-08T21:06:49.787 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-05-08T21:06:49.787 INFO:teuthology.orchestra.run.smithi080.stdout: python3-ceph-argparse x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 45 k 2024-05-08T21:06:49.787 INFO:teuthology.orchestra.run.smithi080.stdout: python3-ceph-common x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 129 k 2024-05-08T21:06:49.788 INFO:teuthology.orchestra.run.smithi080.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-05-08T21:06:49.788 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cffi x86_64 1.11.5-6.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2024-05-08T21:06:49.788 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-05-08T21:06:49.788 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-05-08T21:06:49.788 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cryptography x86_64 3.2.1-7.el8_9 rhel-8-for-x86_64-baseos-rpms 559 k 2024-05-08T21:06:49.788 INFO:teuthology.orchestra.run.smithi080.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-05-08T21:06:49.788 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-05-08T21:06:49.788 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-05-08T21:06:49.788 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2024-05-08T21:06:49.788 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2024-05-08T21:06:49.788 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2024-05-08T21:06:49.788 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-05-08T21:06:49.788 INFO:teuthology.orchestra.run.smithi080.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-05-08T21:06:49.789 INFO:teuthology.orchestra.run.smithi080.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-05-08T21:06:49.789 INFO:teuthology.orchestra.run.smithi080.stdout: python3-mako noarch 1.0.6-14.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2024-05-08T21:06:49.789 INFO:teuthology.orchestra.run.smithi080.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2024-05-08T21:06:49.789 INFO:teuthology.orchestra.run.smithi080.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-05-08T21:06:49.789 INFO:teuthology.orchestra.run.smithi080.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-05-08T21:06:49.789 INFO:teuthology.orchestra.run.smithi080.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-05-08T21:06:49.789 INFO:teuthology.orchestra.run.smithi080.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2024-05-08T21:06:49.789 INFO:teuthology.orchestra.run.smithi080.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2024-05-08T21:06:49.789 INFO:teuthology.orchestra.run.smithi080.stdout: python3-packaging noarch 16.8-9.el8 codeready-builder-for-rhel-8-x86_64-rpms 48 k 2024-05-08T21:06:49.789 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-05-08T21:06:49.789 INFO:teuthology.orchestra.run.smithi080.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-05-08T21:06:49.789 INFO:teuthology.orchestra.run.smithi080.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2024-05-08T21:06:49.790 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2024-05-08T21:06:49.790 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2024-05-08T21:06:49.790 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2024-05-08T21:06:49.790 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2024-05-08T21:06:49.790 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pytz noarch 2017.2-11.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2024-05-08T21:06:49.790 INFO:teuthology.orchestra.run.smithi080.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-05-08T21:06:49.790 INFO:teuthology.orchestra.run.smithi080.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-05-08T21:06:49.790 INFO:teuthology.orchestra.run.smithi080.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-05-08T21:06:49.790 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-05-08T21:06:49.790 INFO:teuthology.orchestra.run.smithi080.stdout: python3-scipy x86_64 1.0.0-21.module+el8.9.0+20976+d3c38525 rhel-8-for-x86_64-appstream-rpms 14 M 2024-05-08T21:06:49.790 INFO:teuthology.orchestra.run.smithi080.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-05-08T21:06:49.790 INFO:teuthology.orchestra.run.smithi080.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-05-08T21:06:49.790 INFO:teuthology.orchestra.run.smithi080.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-05-08T21:06:49.791 INFO:teuthology.orchestra.run.smithi080.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-05-08T21:06:49.791 INFO:teuthology.orchestra.run.smithi080.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-05-08T21:06:49.791 INFO:teuthology.orchestra.run.smithi080.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-05-08T21:06:49.791 INFO:teuthology.orchestra.run.smithi080.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-05-08T21:06:49.791 INFO:teuthology.orchestra.run.smithi080.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-05-08T21:06:49.791 INFO:teuthology.orchestra.run.smithi080.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2024-05-08T21:06:49.791 INFO:teuthology.orchestra.run.smithi080.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-05-08T21:06:49.791 INFO:teuthology.orchestra.run.smithi080.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2024-05-08T21:06:49.791 INFO:teuthology.orchestra.run.smithi080.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-05-08T21:06:49.791 INFO:teuthology.orchestra.run.smithi080.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2024-05-08T21:06:49.791 INFO:teuthology.orchestra.run.smithi080.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2024-05-08T21:06:49.791 INFO:teuthology.orchestra.run.smithi080.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2024-05-08T21:06:49.791 INFO:teuthology.orchestra.run.smithi080.stdout:Enabling module streams: 2024-05-08T21:06:49.791 INFO:teuthology.orchestra.run.smithi080.stdout: postgresql 10 2024-05-08T21:06:49.792 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:06:49.792 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction Summary 2024-05-08T21:06:49.792 INFO:teuthology.orchestra.run.smithi080.stdout:=================================================================================================================================== 2024-05-08T21:06:49.792 INFO:teuthology.orchestra.run.smithi080.stdout:Install 130 Packages 2024-05-08T21:06:49.792 INFO:teuthology.orchestra.run.smithi080.stdout:Upgrade 16 Packages 2024-05-08T21:06:49.792 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:06:49.793 INFO:teuthology.orchestra.run.smithi080.stdout:Total download size: 215 M 2024-05-08T21:06:49.793 INFO:teuthology.orchestra.run.smithi080.stdout:Downloading Packages: 2024-05-08T21:06:49.897 INFO:teuthology.orchestra.run.smithi106.stdout:(2/146): ceph-fuse-18.2.2-1322.gd21e4f96.el8.x8 1.0 MB/s | 860 kB 00:00 2024-05-08T21:06:50.085 INFO:teuthology.orchestra.run.smithi106.stdout:(3/146): ceph-immutable-object-cache-18.2.2-132 885 kB/s | 166 kB 00:00 2024-05-08T21:06:50.161 INFO:teuthology.orchestra.run.smithi080.stdout:(1/146): ceph-18.2.2-1322.gd21e4f96.el8.x86_64. 21 kB/s | 6.4 kB 00:00 2024-05-08T21:06:51.461 INFO:teuthology.orchestra.run.smithi080.stdout:(2/146): ceph-fuse-18.2.2-1322.gd21e4f96.el8.x8 662 kB/s | 860 kB 00:01 2024-05-08T21:06:51.669 INFO:teuthology.orchestra.run.smithi080.stdout:(3/146): ceph-immutable-object-cache-18.2.2-132 797 kB/s | 166 kB 00:00 2024-05-08T21:06:51.893 INFO:teuthology.orchestra.run.smithi106.stdout:(4/146): ceph-mds-18.2.2-1322.gd21e4f96.el8.x86 1.3 MB/s | 2.3 MB 00:01 2024-05-08T21:06:52.186 INFO:teuthology.orchestra.run.smithi080.stdout:(4/146): ceph-base-18.2.2-1322.gd21e4f96.el8.x8 2.4 MB/s | 5.5 MB 00:02 2024-05-08T21:06:52.870 INFO:teuthology.orchestra.run.smithi080.stdout:(5/146): ceph-mgr-18.2.2-1322.gd21e4f96.el8.x86 2.3 MB/s | 1.6 MB 00:00 2024-05-08T21:06:53.233 INFO:teuthology.orchestra.run.smithi106.stdout:(5/146): ceph-mgr-18.2.2-1322.gd21e4f96.el8.x86 1.2 MB/s | 1.6 MB 00:01 2024-05-08T21:06:54.203 INFO:teuthology.orchestra.run.smithi080.stdout:(6/146): ceph-mds-18.2.2-1322.gd21e4f96.el8.x86 918 kB/s | 2.3 MB 00:02 2024-05-08T21:06:55.020 INFO:teuthology.orchestra.run.smithi080.stdout:(7/146): ceph-mon-18.2.2-1322.gd21e4f96.el8.x86 2.2 MB/s | 4.8 MB 00:02 2024-05-08T21:06:55.285 INFO:teuthology.orchestra.run.smithi106.stdout:(6/146): ceph-common-18.2.2-1322.gd21e4f96.el8. 3.3 MB/s | 22 MB 00:06 2024-05-08T21:06:56.602 INFO:teuthology.orchestra.run.smithi106.stdout:(7/146): ceph-mon-18.2.2-1322.gd21e4f96.el8.x86 1.4 MB/s | 4.8 MB 00:03 2024-05-08T21:06:58.452 INFO:teuthology.orchestra.run.smithi106.stdout:(8/146): ceph-base-18.2.2-1322.gd21e4f96.el8.x8 579 kB/s | 5.5 MB 00:09 2024-05-08T21:06:58.552 INFO:teuthology.orchestra.run.smithi106.stdout:(9/146): ceph-selinux-18.2.2-1322.gd21e4f96.el8 243 kB/s | 24 kB 00:00 2024-05-08T21:07:00.236 INFO:teuthology.orchestra.run.smithi106.stdout:(10/146): ceph-osd-18.2.2-1322.gd21e4f96.el8.x8 3.7 MB/s | 18 MB 00:04 2024-05-08T21:07:00.344 INFO:teuthology.orchestra.run.smithi106.stdout:(11/146): cephfs-mirror-18.2.2-1322.gd21e4f96.e 2.4 MB/s | 261 kB 00:00 2024-05-08T21:07:00.436 INFO:teuthology.orchestra.run.smithi106.stdout:(12/146): libcephfs-devel-18.2.2-1322.gd21e4f96 338 kB/s | 31 kB 00:00 2024-05-08T21:07:00.720 INFO:teuthology.orchestra.run.smithi106.stdout:(13/146): libcephfs2-18.2.2-1322.gd21e4f96.el8. 2.7 MB/s | 782 kB 00:00 2024-05-08T21:07:00.828 INFO:teuthology.orchestra.run.smithi106.stdout:(14/146): libcephsqlite-18.2.2-1322.gd21e4f96.e 1.3 MB/s | 142 kB 00:00 2024-05-08T21:07:00.920 INFO:teuthology.orchestra.run.smithi106.stdout:(15/146): librados-devel-18.2.2-1322.gd21e4f96. 1.5 MB/s | 139 kB 00:00 2024-05-08T21:07:01.154 INFO:teuthology.orchestra.run.smithi106.stdout:(16/146): libradosstriper1-18.2.2-1322.gd21e4f9 2.0 MB/s | 474 kB 00:00 2024-05-08T21:07:02.519 INFO:teuthology.orchestra.run.smithi080.stdout:(8/146): ceph-radosgw-18.2.2-1322.gd21e4f96.el8 1.7 MB/s | 13 MB 00:07 2024-05-08T21:07:02.619 INFO:teuthology.orchestra.run.smithi080.stdout:(9/146): ceph-selinux-18.2.2-1322.gd21e4f96.el8 244 kB/s | 24 kB 00:00 2024-05-08T21:07:03.254 INFO:teuthology.orchestra.run.smithi106.stdout:(17/146): librgw2-18.2.2-1322.gd21e4f96.el8.x86 3.1 MB/s | 6.5 MB 00:02 2024-05-08T21:07:03.329 INFO:teuthology.orchestra.run.smithi106.stdout:(18/146): python3-ceph-argparse-18.2.2-1322.gd2 598 kB/s | 45 kB 00:00 2024-05-08T21:07:03.421 INFO:teuthology.orchestra.run.smithi106.stdout:(19/146): python3-ceph-common-18.2.2-1322.gd21e 1.4 MB/s | 129 kB 00:00 2024-05-08T21:07:03.588 INFO:teuthology.orchestra.run.smithi106.stdout:(20/146): python3-cephfs-18.2.2-1322.gd21e4f96. 1.2 MB/s | 197 kB 00:00 2024-05-08T21:07:03.755 INFO:teuthology.orchestra.run.smithi106.stdout:(21/146): python3-rados-18.2.2-1322.gd21e4f96.e 2.2 MB/s | 370 kB 00:00 2024-05-08T21:07:04.035 INFO:teuthology.orchestra.run.smithi106.stdout:(22/146): ceph-radosgw-18.2.2-1322.gd21e4f96.el 1.8 MB/s | 13 MB 00:07 2024-05-08T21:07:04.138 INFO:teuthology.orchestra.run.smithi106.stdout:(23/146): python3-rbd-18.2.2-1322.gd21e4f96.el8 951 kB/s | 365 kB 00:00 2024-05-08T21:07:04.236 INFO:teuthology.orchestra.run.smithi080.stdout:(10/146): ceph-osd-18.2.2-1322.gd21e4f96.el8.x8 1.8 MB/s | 18 MB 00:10 2024-05-08T21:07:04.328 INFO:teuthology.orchestra.run.smithi080.stdout:(11/146): cephfs-mirror-18.2.2-1322.gd21e4f96.e 2.8 MB/s | 261 kB 00:00 2024-05-08T21:07:04.386 INFO:teuthology.orchestra.run.smithi080.stdout:(12/146): libcephfs-devel-18.2.2-1322.gd21e4f96 530 kB/s | 31 kB 00:00 2024-05-08T21:07:04.426 INFO:teuthology.orchestra.run.smithi106.stdout:(24/146): python3-rgw-18.2.2-1322.gd21e4f96.el8 273 kB/s | 107 kB 00:00 2024-05-08T21:07:04.448 INFO:teuthology.orchestra.run.smithi106.stdout:(25/146): rbd-fuse-18.2.2-1322.gd21e4f96.el8.x8 308 kB/s | 95 kB 00:00 2024-05-08T21:07:04.582 INFO:teuthology.orchestra.run.smithi106.stdout:(26/146): rbd-nbd-18.2.2-1322.gd21e4f96.el8.x86 1.3 MB/s | 181 kB 00:00 2024-05-08T21:07:04.673 INFO:teuthology.orchestra.run.smithi106.stdout:(27/146): ceph-grafana-dashboards-18.2.2-1322.g 265 kB/s | 24 kB 00:00 2024-05-08T21:07:04.678 INFO:teuthology.orchestra.run.smithi080.stdout:(13/146): libcephfs2-18.2.2-1322.gd21e4f96.el8. 2.6 MB/s | 782 kB 00:00 2024-05-08T21:07:04.770 INFO:teuthology.orchestra.run.smithi080.stdout:(14/146): libcephsqlite-18.2.2-1322.gd21e4f96.e 1.5 MB/s | 142 kB 00:00 2024-05-08T21:07:04.773 INFO:teuthology.orchestra.run.smithi106.stdout:(28/146): ceph-mgr-cephadm-18.2.2-1322.gd21e4f9 1.4 MB/s | 138 kB 00:00 2024-05-08T21:07:04.846 INFO:teuthology.orchestra.run.smithi080.stdout:(15/146): librados-devel-18.2.2-1322.gd21e4f96. 1.8 MB/s | 139 kB 00:00 2024-05-08T21:07:05.071 INFO:teuthology.orchestra.run.smithi080.stdout:(16/146): libradosstriper1-18.2.2-1322.gd21e4f9 2.1 MB/s | 474 kB 00:00 2024-05-08T21:07:06.040 INFO:teuthology.orchestra.run.smithi106.stdout:(29/146): rbd-mirror-18.2.2-1322.gd21e4f96.el8. 2.1 MB/s | 3.5 MB 00:01 2024-05-08T21:07:06.132 INFO:teuthology.orchestra.run.smithi106.stdout:(30/146): ceph-mgr-dashboard-18.2.2-1322.gd21e4 2.6 MB/s | 3.5 MB 00:01 2024-05-08T21:07:06.293 INFO:teuthology.orchestra.run.smithi106.stdout:(31/146): ceph-mgr-modules-core-18.2.2-1322.gd2 1.5 MB/s | 245 kB 00:00 2024-05-08T21:07:06.393 INFO:teuthology.orchestra.run.smithi106.stdout:(32/146): ceph-mgr-rook-18.2.2-1322.gd21e4f96.e 491 kB/s | 49 kB 00:00 2024-05-08T21:07:06.494 INFO:teuthology.orchestra.run.smithi106.stdout:(33/146): ceph-prometheus-alerts-18.2.2-1322.gd 163 kB/s | 16 kB 00:00 2024-05-08T21:07:06.661 INFO:teuthology.orchestra.run.smithi106.stdout:(34/146): ceph-volume-18.2.2-1322.gd21e4f96.el8 1.5 MB/s | 263 kB 00:00 2024-05-08T21:07:06.827 INFO:teuthology.orchestra.run.smithi106.stdout:(35/146): cephadm-18.2.2-1322.gd21e4f96.el8.noa 1.0 MB/s | 170 kB 00:00 2024-05-08T21:07:06.919 INFO:teuthology.orchestra.run.smithi106.stdout:(36/146): cephfs-top-18.2.2-1322.gd21e4f96.el8. 197 kB/s | 18 kB 00:00 2024-05-08T21:07:07.328 INFO:teuthology.orchestra.run.smithi106.stdout:(37/146): gperftools-libs-2.7-9.el8.x86_64.rpm 750 kB/s | 306 kB 00:00 2024-05-08T21:07:07.406 INFO:teuthology.orchestra.run.smithi106.stdout:(38/146): liboath-2.6.2-3.el8.x86_64.rpm 787 kB/s | 59 kB 00:00 2024-05-08T21:07:07.487 INFO:teuthology.orchestra.run.smithi106.stdout:(39/146): libunwind-1.3.1-3.el8.x86_64.rpm 900 kB/s | 75 kB 00:00 2024-05-08T21:07:07.620 INFO:teuthology.orchestra.run.smithi106.stdout:(40/146): python3-asyncssh-2.7.0-2.el8.noarch.r 3.5 MB/s | 476 kB 00:00 2024-05-08T21:07:07.688 INFO:teuthology.orchestra.run.smithi106.stdout:(41/146): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 654 kB/s | 44 kB 00:00 2024-05-08T21:07:07.754 INFO:teuthology.orchestra.run.smithi080.stdout:(17/146): librgw2-18.2.2-1322.gd21e4f96.el8.x86 2.4 MB/s | 6.5 MB 00:02 2024-05-08T21:07:07.771 INFO:teuthology.orchestra.run.smithi106.stdout:(42/146): python3-beautifulsoup4-4.6.3-2.el8.1. 2.2 MB/s | 185 kB 00:00 2024-05-08T21:07:07.829 INFO:teuthology.orchestra.run.smithi080.stdout:(18/146): python3-ceph-argparse-18.2.2-1322.gd2 599 kB/s | 45 kB 00:00 2024-05-08T21:07:07.838 INFO:teuthology.orchestra.run.smithi106.stdout:(43/146): python3-cachetools-3.1.1-4.el8.noarch 495 kB/s | 33 kB 00:00 2024-05-08T21:07:07.904 INFO:teuthology.orchestra.run.smithi080.stdout:(19/146): python3-ceph-common-18.2.2-1322.gd21e 1.7 MB/s | 129 kB 00:00 2024-05-08T21:07:07.905 INFO:teuthology.orchestra.run.smithi106.stdout:(44/146): python3-certifi-2018.10.15-7.el8.noar 245 kB/s | 16 kB 00:00 2024-05-08T21:07:07.989 INFO:teuthology.orchestra.run.smithi106.stdout:(45/146): python3-cheroot-8.5.2-1.el8.noarch.rp 2.0 MB/s | 173 kB 00:00 2024-05-08T21:07:08.029 INFO:teuthology.orchestra.run.smithi080.stdout:(20/146): python3-cephfs-18.2.2-1322.gd21e4f96. 1.5 MB/s | 197 kB 00:00 2024-05-08T21:07:08.081 INFO:teuthology.orchestra.run.smithi106.stdout:(46/146): python3-cherrypy-18.4.0-1.el8.noarch. 4.1 MB/s | 384 kB 00:00 2024-05-08T21:07:08.148 INFO:teuthology.orchestra.run.smithi106.stdout:(47/146): python3-google-auth-1.1.1-10.el8.noar 1.2 MB/s | 81 kB 00:00 2024-05-08T21:07:08.213 INFO:teuthology.orchestra.run.smithi080.stdout:(21/146): python3-rados-18.2.2-1322.gd21e4f96.e 2.0 MB/s | 370 kB 00:00 2024-05-08T21:07:08.223 INFO:teuthology.orchestra.run.smithi106.stdout:(48/146): python3-jaraco-6.2-6.el8.noarch.rpm 148 kB/s | 11 kB 00:00 2024-05-08T21:07:08.298 INFO:teuthology.orchestra.run.smithi106.stdout:(49/146): python3-jaraco-functools-2.0-4.el8.no 235 kB/s | 18 kB 00:00 2024-05-08T21:07:08.432 INFO:teuthology.orchestra.run.smithi106.stdout:(50/146): python3-kubernetes-11.0.0-6.el8.noarc 8.7 MB/s | 1.2 MB 00:00 2024-05-08T21:07:08.464 INFO:teuthology.orchestra.run.smithi080.stdout:(22/146): ceph-common-18.2.2-1322.gd21e4f96.el8 1.2 MB/s | 22 MB 00:18 2024-05-08T21:07:08.489 INFO:teuthology.orchestra.run.smithi080.stdout:(23/146): python3-rbd-18.2.2-1322.gd21e4f96.el8 1.3 MB/s | 365 kB 00:00 2024-05-08T21:07:08.507 INFO:teuthology.orchestra.run.smithi106.stdout:(51/146): python3-logutils-0.3.5-11.el8.noarch. 651 kB/s | 49 kB 00:00 2024-05-08T21:07:08.547 INFO:teuthology.orchestra.run.smithi080.stdout:(24/146): python3-rgw-18.2.2-1322.gd21e4f96.el8 1.3 MB/s | 107 kB 00:00 2024-05-08T21:07:08.573 INFO:teuthology.orchestra.run.smithi080.stdout:(25/146): rbd-fuse-18.2.2-1322.gd21e4f96.el8.x8 1.1 MB/s | 95 kB 00:00 2024-05-08T21:07:08.583 INFO:teuthology.orchestra.run.smithi106.stdout:(52/146): python3-more-itertools-7.2.0-3.el8.no 784 kB/s | 59 kB 00:00 2024-05-08T21:07:08.658 INFO:teuthology.orchestra.run.smithi106.stdout:(53/146): python3-natsort-7.1.1-2.el8.noarch.rp 803 kB/s | 60 kB 00:00 2024-05-08T21:07:08.698 INFO:teuthology.orchestra.run.smithi080.stdout:(26/146): rbd-nbd-18.2.2-1322.gd21e4f96.el8.x86 1.4 MB/s | 181 kB 00:00 2024-05-08T21:07:08.741 INFO:teuthology.orchestra.run.smithi106.stdout:(54/146): python3-pecan-1.3.2-9.el8.noarch.rpm 3.3 MB/s | 283 kB 00:00 2024-05-08T21:07:08.773 INFO:teuthology.orchestra.run.smithi080.stdout:(27/146): ceph-grafana-dashboards-18.2.2-1322.g 323 kB/s | 24 kB 00:00 2024-05-08T21:07:08.809 INFO:teuthology.orchestra.run.smithi106.stdout:(55/146): python3-portend-2.6-1.el8.noarch.rpm 233 kB/s | 16 kB 00:00 2024-05-08T21:07:08.857 INFO:teuthology.orchestra.run.smithi080.stdout:(28/146): ceph-mgr-cephadm-18.2.2-1322.gd21e4f9 1.6 MB/s | 138 kB 00:00 2024-05-08T21:07:08.875 INFO:teuthology.orchestra.run.smithi106.stdout:(56/146): python3-repoze-lru-0.7-6.el8.noarch.r 506 kB/s | 34 kB 00:00 2024-05-08T21:07:08.951 INFO:teuthology.orchestra.run.smithi106.stdout:(57/146): python3-routes-2.4.1-12.el8.noarch.rp 2.6 MB/s | 196 kB 00:00 2024-05-08T21:07:09.043 INFO:teuthology.orchestra.run.smithi106.stdout:(58/146): python3-rsa-4.9-2.el8.noarch.rpm 699 kB/s | 64 kB 00:00 2024-05-08T21:07:09.118 INFO:teuthology.orchestra.run.smithi106.stdout:(59/146): python3-simplegeneric-0.8.1-17.el8.no 250 kB/s | 19 kB 00:00 2024-05-08T21:07:09.202 INFO:teuthology.orchestra.run.smithi106.stdout:(60/146): ceph-mgr-diskprediction-local-18.2.2- 2.3 MB/s | 7.4 MB 00:03 2024-05-08T21:07:09.216 INFO:teuthology.orchestra.run.smithi080.stdout:(29/146): rbd-mirror-18.2.2-1322.gd21e4f96.el8. 5.2 MB/s | 3.5 MB 00:00 2024-05-08T21:07:09.227 INFO:teuthology.orchestra.run.smithi106.stdout:(61/146): python3-singledispatch-3.4.0.3-18.el8 220 kB/s | 24 kB 00:00 2024-05-08T21:07:09.303 INFO:teuthology.orchestra.run.smithi106.stdout:(62/146): python3-trustme-0.6.0-4.el8.noarch.rp 367 kB/s | 27 kB 00:00 2024-05-08T21:07:09.386 INFO:teuthology.orchestra.run.smithi106.stdout:(63/146): python3-waitress-1.4.3-1.el8.noarch.r 3.0 MB/s | 255 kB 00:00 2024-05-08T21:07:09.436 INFO:teuthology.orchestra.run.smithi106.stdout:(64/146): python3-tempora-1.14.1-5.el8.noarch.r 125 kB/s | 29 kB 00:00 2024-05-08T21:07:09.470 INFO:teuthology.orchestra.run.smithi106.stdout:(65/146): python3-webob-1.8.5-1.el8.1.noarch.rp 2.9 MB/s | 251 kB 00:00 2024-05-08T21:07:09.545 INFO:teuthology.orchestra.run.smithi106.stdout:(66/146): python3-webtest-2.0.33-1.el8.noarch.r 1.1 MB/s | 85 kB 00:00 2024-05-08T21:07:09.571 INFO:teuthology.orchestra.run.smithi106.stdout:(67/146): python3-websocket-client-0.56.0-5.el8 457 kB/s | 61 kB 00:00 2024-05-08T21:07:09.621 INFO:teuthology.orchestra.run.smithi106.stdout:(68/146): python3-zc-lockfile-2.0-2.el8.noarch. 305 kB/s | 23 kB 00:00 2024-05-08T21:07:09.646 INFO:teuthology.orchestra.run.smithi106.stdout:(69/146): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2024-05-08T21:07:09.813 INFO:teuthology.orchestra.run.smithi106.stdout:(70/146): python3-packaging-16.8-9.el8.noarch.r 289 kB/s | 48 kB 00:00 2024-05-08T21:07:09.888 INFO:teuthology.orchestra.run.smithi106.stdout:(71/146): thrift-0.13.0-2.el8.x86_64.rpm 5.5 MB/s | 1.7 MB 00:00 2024-05-08T21:07:09.947 INFO:teuthology.orchestra.run.smithi106.stdout:(72/146): libverto-devel-0.3.0-5.el8.x86_64.rpm 134 kB/s | 18 kB 00:00 2024-05-08T21:07:09.966 INFO:teuthology.orchestra.run.smithi080.stdout:(30/146): ceph-mgr-dashboard-18.2.2-1322.gd21e4 3.2 MB/s | 3.5 MB 00:01 2024-05-08T21:07:10.031 INFO:teuthology.orchestra.run.smithi106.stdout:(73/146): python3-jwt-1.6.1-2.el8.noarch.rpm 300 kB/s | 43 kB 00:00 2024-05-08T21:07:10.090 INFO:teuthology.orchestra.run.smithi106.stdout:(74/146): python3-oauthlib-2.1.0-1.el8.noarch.r 1.1 MB/s | 155 kB 00:00 2024-05-08T21:07:10.116 INFO:teuthology.orchestra.run.smithi080.stdout:(31/146): ceph-mgr-modules-core-18.2.2-1322.gd2 1.6 MB/s | 245 kB 00:00 2024-05-08T21:07:10.200 INFO:teuthology.orchestra.run.smithi080.stdout:(32/146): ceph-mgr-rook-18.2.2-1322.gd21e4f96.e 590 kB/s | 49 kB 00:00 2024-05-08T21:07:10.206 INFO:teuthology.orchestra.run.smithi106.stdout:(75/146): python3-requests-oauthlib-1.0.0-1.el8 366 kB/s | 43 kB 00:00 2024-05-08T21:07:10.231 INFO:teuthology.orchestra.run.smithi106.stdout:(76/146): python3-pycparser-2.14-14.el8.noarch. 544 kB/s | 109 kB 00:00 2024-05-08T21:07:10.267 INFO:teuthology.orchestra.run.smithi080.stdout:(33/146): ceph-prometheus-alerts-18.2.2-1322.gd 245 kB/s | 16 kB 00:00 2024-05-08T21:07:10.340 INFO:teuthology.orchestra.run.smithi106.stdout:(77/146): libaio-devel-0.3.112-1.el8.x86_64.rpm 140 kB/s | 19 kB 00:00 2024-05-08T21:07:10.375 INFO:teuthology.orchestra.run.smithi080.stdout:(34/146): ceph-mgr-diskprediction-local-18.2.2- 6.4 MB/s | 7.4 MB 00:01 2024-05-08T21:07:10.407 INFO:teuthology.orchestra.run.smithi106.stdout:(78/146): libzstd-devel-1.4.4-1.el8.x86_64.rpm 250 kB/s | 44 kB 00:00 2024-05-08T21:07:10.409 INFO:teuthology.orchestra.run.smithi080.stdout:(35/146): ceph-volume-18.2.2-1322.gd21e4f96.el8 1.8 MB/s | 263 kB 00:00 2024-05-08T21:07:10.459 INFO:teuthology.orchestra.run.smithi080.stdout:(36/146): cephadm-18.2.2-1322.gd21e4f96.el8.noa 2.0 MB/s | 170 kB 00:00 2024-05-08T21:07:10.466 INFO:teuthology.orchestra.run.smithi106.stdout:(79/146): pcre2-devel-10.32-2.el8.x86_64.rpm 4.7 MB/s | 605 kB 00:00 2024-05-08T21:07:10.476 INFO:teuthology.orchestra.run.smithi080.stdout:(37/146): cephfs-top-18.2.2-1322.gd21e4f96.el8. 270 kB/s | 18 kB 00:00 2024-05-08T21:07:10.591 INFO:teuthology.orchestra.run.smithi106.stdout:(80/146): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.2 MB/s | 229 kB 00:00 2024-05-08T21:07:10.625 INFO:teuthology.orchestra.run.smithi106.stdout:(81/146): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.4 MB/s | 220 kB 00:00 2024-05-08T21:07:10.725 INFO:teuthology.orchestra.run.smithi106.stdout:(82/146): libselinux-devel-2.9-5.el8.x86_64.rpm 1.5 MB/s | 200 kB 00:00 2024-05-08T21:07:10.792 INFO:teuthology.orchestra.run.smithi106.stdout:(83/146): keyutils-libs-devel-1.5.10-9.el8.x86_ 288 kB/s | 48 kB 00:00 2024-05-08T21:07:10.868 INFO:teuthology.orchestra.run.smithi080.stdout:(38/146): liboath-2.6.2-3.el8.x86_64.rpm 150 kB/s | 59 kB 00:00 2024-05-08T21:07:10.875 INFO:teuthology.orchestra.run.smithi106.stdout:(84/146): libsepol-devel-2.9-3.el8.x86_64.rpm 579 kB/s | 87 kB 00:00 2024-05-08T21:07:10.901 INFO:teuthology.orchestra.run.smithi106.stdout:(85/146): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 531 kB/s | 58 kB 00:00 2024-05-08T21:07:11.010 INFO:teuthology.orchestra.run.smithi080.stdout:(39/146): libunwind-1.3.1-3.el8.x86_64.rpm 531 kB/s | 75 kB 00:00 2024-05-08T21:07:11.018 INFO:teuthology.orchestra.run.smithi106.stdout:(86/146): libcom_err-devel-1.45.6-4.el8.x86_64. 271 kB/s | 39 kB 00:00 2024-05-08T21:07:11.060 INFO:teuthology.orchestra.run.smithi106.stdout:(87/146): fuse-2.9.7-17.el8.x86_64.rpm 522 kB/s | 83 kB 00:00 2024-05-08T21:07:11.069 INFO:teuthology.orchestra.run.smithi080.stdout:(40/146): gperftools-libs-2.7-9.el8.x86_64.rpm 503 kB/s | 306 kB 00:00 2024-05-08T21:07:11.135 INFO:teuthology.orchestra.run.smithi106.stdout:(88/146): libgfortran-8.5.0-20.el8.x86_64.rpm 5.4 MB/s | 645 kB 00:00 2024-05-08T21:07:11.177 INFO:teuthology.orchestra.run.smithi080.stdout:(41/146): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 403 kB/s | 44 kB 00:00 2024-05-08T21:07:11.177 INFO:teuthology.orchestra.run.smithi106.stdout:(89/146): libquadmath-8.5.0-20.el8.x86_64.rpm 1.4 MB/s | 172 kB 00:00 2024-05-08T21:07:11.286 INFO:teuthology.orchestra.run.smithi106.stdout:(90/146): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.5 MB/s | 238 kB 00:00 2024-05-08T21:07:11.302 INFO:teuthology.orchestra.run.smithi080.stdout:(42/146): python3-asyncssh-2.7.0-2.el8.noarch.r 1.6 MB/s | 476 kB 00:00 2024-05-08T21:07:11.311 INFO:teuthology.orchestra.run.smithi106.stdout:(91/146): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 544 kB/s | 73 kB 00:00 2024-05-08T21:07:11.327 INFO:teuthology.orchestra.run.smithi080.stdout:(43/146): python3-beautifulsoup4-4.6.3-2.el8.1. 1.2 MB/s | 185 kB 00:00 2024-05-08T21:07:11.403 INFO:teuthology.orchestra.run.smithi080.stdout:(44/146): python3-cachetools-3.1.1-4.el8.noarch 329 kB/s | 33 kB 00:00 2024-05-08T21:07:11.428 INFO:teuthology.orchestra.run.smithi080.stdout:(45/146): python3-certifi-2018.10.15-7.el8.noar 162 kB/s | 16 kB 00:00 2024-05-08T21:07:11.445 INFO:teuthology.orchestra.run.smithi106.stdout:(92/146): elfutils-libelf-devel-0.189-3.el8.x86 389 kB/s | 62 kB 00:00 2024-05-08T21:07:11.478 INFO:teuthology.orchestra.run.smithi106.stdout:(93/146): krb5-devel-1.18.2-26.el8_9.x86_64.rpm 3.3 MB/s | 562 kB 00:00 2024-05-08T21:07:11.520 INFO:teuthology.orchestra.run.smithi080.stdout:(46/146): python3-cheroot-8.5.2-1.el8.noarch.rp 1.4 MB/s | 173 kB 00:00 2024-05-08T21:07:11.596 INFO:teuthology.orchestra.run.smithi080.stdout:(47/146): python3-cherrypy-18.4.0-1.el8.noarch. 2.2 MB/s | 384 kB 00:00 2024-05-08T21:07:11.596 INFO:teuthology.orchestra.run.smithi106.stdout:(94/146): openssl-devel-1.1.1k-12.el8_9.x86_64. 15 MB/s | 2.3 MB 00:00 2024-05-08T21:07:11.621 INFO:teuthology.orchestra.run.smithi106.stdout:(95/146): librabbitmq-0.9.0-5.el8_9.x86_64.rpm 332 kB/s | 47 kB 00:00 2024-05-08T21:07:11.621 INFO:teuthology.orchestra.run.smithi080.stdout:(48/146): python3-google-auth-1.1.1-10.el8.noar 810 kB/s | 81 kB 00:00 2024-05-08T21:07:11.705 INFO:teuthology.orchestra.run.smithi080.stdout:(49/146): python3-jaraco-6.2-6.el8.noarch.rpm 102 kB/s | 11 kB 00:00 2024-05-08T21:07:11.729 INFO:teuthology.orchestra.run.smithi106.stdout:(96/146): NetworkManager-initscripts-updown-1.4 1.3 MB/s | 144 kB 00:00 2024-05-08T21:07:11.763 INFO:teuthology.orchestra.run.smithi080.stdout:(50/146): python3-jaraco-functools-2.0-4.el8.no 123 kB/s | 18 kB 00:00 2024-05-08T21:07:11.771 INFO:teuthology.orchestra.run.smithi106.stdout:(97/146): python3-cryptography-3.2.1-7.el8_9.x8 3.1 MB/s | 559 kB 00:00 2024-05-08T21:07:11.872 INFO:teuthology.orchestra.run.smithi080.stdout:(51/146): python3-logutils-0.3.5-11.el8.noarch. 452 kB/s | 49 kB 00:00 2024-05-08T21:07:11.879 INFO:teuthology.orchestra.run.smithi106.stdout:(98/146): libuuid-devel-2.32.1-44.el8_9.1.x86_6 666 kB/s | 100 kB 00:00 2024-05-08T21:07:11.905 INFO:teuthology.orchestra.run.smithi106.stdout:(99/146): python3-jsonpointer-1.10-11.el8.noarc 149 kB/s | 20 kB 00:00 2024-05-08T21:07:11.955 INFO:teuthology.orchestra.run.smithi080.stdout:(52/146): python3-kubernetes-11.0.0-6.el8.noarc 4.7 MB/s | 1.2 MB 00:00 2024-05-08T21:07:11.981 INFO:teuthology.orchestra.run.smithi080.stdout:(53/146): python3-more-itertools-7.2.0-3.el8.no 541 kB/s | 59 kB 00:00 2024-05-08T21:07:12.022 INFO:teuthology.orchestra.run.smithi106.stdout:(100/146): python3-prettytable-0.7.2-14.el8.noa 310 kB/s | 44 kB 00:00 2024-05-08T21:07:12.056 INFO:teuthology.orchestra.run.smithi080.stdout:(54/146): python3-natsort-7.1.1-2.el8.noarch.rp 601 kB/s | 60 kB 00:00 2024-05-08T21:07:12.072 INFO:teuthology.orchestra.run.smithi106.stdout:(101/146): python3-pyasn1-modules-0.3.7-6.el8.n 660 kB/s | 110 kB 00:00 2024-05-08T21:07:12.106 INFO:teuthology.orchestra.run.smithi080.stdout:(55/146): python3-pecan-1.3.2-9.el8.noarch.rpm 2.2 MB/s | 283 kB 00:00 2024-05-08T21:07:12.157 INFO:teuthology.orchestra.run.smithi080.stdout:(56/146): python3-portend-2.6-1.el8.noarch.rpm 155 kB/s | 16 kB 00:00 2024-05-08T21:07:12.164 INFO:teuthology.orchestra.run.smithi106.stdout:(102/146): python3-jsonpatch-1.21-2.el8.noarch. 187 kB/s | 27 kB 00:00 2024-05-08T21:07:12.207 INFO:teuthology.orchestra.run.smithi080.stdout:(57/146): python3-repoze-lru-0.7-6.el8.noarch.r 335 kB/s | 34 kB 00:00 2024-05-08T21:07:12.214 INFO:teuthology.orchestra.run.smithi106.stdout:(103/146): python3-pyasn1-0.3.7-6.el8.noarch.rp 890 kB/s | 126 kB 00:00 2024-05-08T21:07:12.257 INFO:teuthology.orchestra.run.smithi080.stdout:(58/146): python3-routes-2.4.1-12.el8.noarch.rp 1.9 MB/s | 196 kB 00:00 2024-05-08T21:07:12.306 INFO:teuthology.orchestra.run.smithi106.stdout:(104/146): python3-werkzeug-0.12.2-4.el8.noarch 3.1 MB/s | 457 kB 00:00 2024-05-08T21:07:12.307 INFO:teuthology.orchestra.run.smithi080.stdout:(59/146): python3-rsa-4.9-2.el8.noarch.rpm 641 kB/s | 64 kB 00:00 2024-05-08T21:07:12.358 INFO:teuthology.orchestra.run.smithi080.stdout:(60/146): python3-simplegeneric-0.8.1-17.el8.no 186 kB/s | 19 kB 00:00 2024-05-08T21:07:12.365 INFO:teuthology.orchestra.run.smithi106.stdout:(105/146): bison-3.0.4-10.el8.x86_64.rpm 4.5 MB/s | 688 kB 00:00 2024-05-08T21:07:12.408 INFO:teuthology.orchestra.run.smithi080.stdout:(61/146): python3-singledispatch-3.4.0.3-18.el8 239 kB/s | 24 kB 00:00 2024-05-08T21:07:12.483 INFO:teuthology.orchestra.run.smithi080.stdout:(62/146): python3-tempora-1.14.1-5.el8.noarch.r 233 kB/s | 29 kB 00:00 2024-05-08T21:07:12.507 INFO:teuthology.orchestra.run.smithi106.stdout:(106/146): libtool-2.4.6-25.el8.x86_64.rpm 4.9 MB/s | 709 kB 00:00 2024-05-08T21:07:12.508 INFO:teuthology.orchestra.run.smithi080.stdout:(63/146): python3-trustme-0.6.0-4.el8.noarch.rp 274 kB/s | 27 kB 00:00 2024-05-08T21:07:12.540 INFO:teuthology.orchestra.run.smithi106.stdout:(107/146): flex-2.6.1-9.el8.x86_64.rpm 1.3 MB/s | 320 kB 00:00 2024-05-08T21:07:12.592 INFO:teuthology.orchestra.run.smithi080.stdout:(64/146): python3-waitress-1.4.3-1.el8.noarch.r 2.3 MB/s | 255 kB 00:00 2024-05-08T21:07:12.634 INFO:teuthology.orchestra.run.smithi080.stdout:(65/146): python3-webob-1.8.5-1.el8.1.noarch.rp 2.0 MB/s | 251 kB 00:00 2024-05-08T21:07:12.649 INFO:teuthology.orchestra.run.smithi106.stdout:(108/146): python3-markupsafe-0.23-19.el8.x86_6 277 kB/s | 39 kB 00:00 2024-05-08T21:07:12.684 INFO:teuthology.orchestra.run.smithi080.stdout:(66/146): python3-websocket-client-0.56.0-5.el8 667 kB/s | 61 kB 00:00 2024-05-08T21:07:12.691 INFO:teuthology.orchestra.run.smithi106.stdout:(109/146): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.7 MB/s | 259 kB 00:00 2024-05-08T21:07:12.743 INFO:teuthology.orchestra.run.smithi080.stdout:(67/146): python3-webtest-2.0.33-1.el8.noarch.r 785 kB/s | 85 kB 00:00 2024-05-08T21:07:12.777 INFO:teuthology.orchestra.run.smithi080.stdout:(68/146): python3-zc-lockfile-2.0-2.el8.noarch. 249 kB/s | 23 kB 00:00 2024-05-08T21:07:12.802 INFO:teuthology.orchestra.run.smithi080.stdout:(69/146): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2024-05-08T21:07:12.850 INFO:teuthology.orchestra.run.smithi106.stdout:(110/146): python3-pyOpenSSL-19.0.0-1.el8.noarc 654 kB/s | 103 kB 00:00 2024-05-08T21:07:12.875 INFO:teuthology.orchestra.run.smithi106.stdout:(111/146): uuid-1.6.2-43.el8.x86_64.rpm 284 kB/s | 64 kB 00:00 2024-05-08T21:07:13.011 INFO:teuthology.orchestra.run.smithi080.stdout:(70/146): thrift-0.13.0-2.el8.x86_64.rpm 6.5 MB/s | 1.7 MB 00:00 2024-05-08T21:07:13.027 INFO:teuthology.orchestra.run.smithi080.stdout:(71/146): libverto-devel-0.3.0-5.el8.x86_64.rpm 79 kB/s | 18 kB 00:00 2024-05-08T21:07:13.034 INFO:teuthology.orchestra.run.smithi106.stdout:(112/146): python3-babel-2.5.1-7.el8.noarch.rpm 26 MB/s | 4.8 MB 00:00 2024-05-08T21:07:13.067 INFO:teuthology.orchestra.run.smithi106.stdout:(113/146): python3-jinja2-2.10.1-3.el8.noarch.r 2.7 MB/s | 538 kB 00:00 2024-05-08T21:07:13.168 INFO:teuthology.orchestra.run.smithi080.stdout:(72/146): python3-oauthlib-2.1.0-1.el8.noarch.r 1.1 MB/s | 155 kB 00:00 2024-05-08T21:07:13.195 INFO:teuthology.orchestra.run.smithi080.stdout:(73/146): python3-jwt-1.6.1-2.el8.noarch.rpm 232 kB/s | 43 kB 00:00 2024-05-08T21:07:13.201 INFO:teuthology.orchestra.run.smithi106.stdout:(114/146): socat-1.7.4.1-1.el8.x86_64.rpm 2.4 MB/s | 323 kB 00:00 2024-05-08T21:07:13.293 INFO:teuthology.orchestra.run.smithi106.stdout:(115/146): python3-numpy-1.14.3-10.el8.x86_64.r 14 MB/s | 3.7 MB 00:00 2024-05-08T21:07:13.303 INFO:teuthology.orchestra.run.smithi080.stdout:(74/146): python3-pycparser-2.14-14.el8.noarch. 809 kB/s | 109 kB 00:00 2024-05-08T21:07:13.310 INFO:teuthology.orchestra.run.smithi106.stdout:(116/146): python3-numpy-f2py-1.14.3-10.el8.x86 2.0 MB/s | 225 kB 00:00 2024-05-08T21:07:13.345 INFO:teuthology.orchestra.run.smithi080.stdout:(75/146): python3-requests-oauthlib-1.0.0-1.el8 284 kB/s | 43 kB 00:00 2024-05-08T21:07:13.479 INFO:teuthology.orchestra.run.smithi080.stdout:(76/146): libzstd-devel-1.4.4-1.el8.x86_64.rpm 329 kB/s | 44 kB 00:00 2024-05-08T21:07:13.510 INFO:teuthology.orchestra.run.smithi106.stdout:(117/146): librdkafka-0.11.4-3.el8.x86_64.rpm 1.6 MB/s | 354 kB 00:00 2024-05-08T21:07:13.602 INFO:teuthology.orchestra.run.smithi106.stdout:(118/146): openblas-threads-0.3.15-6.el8.x86_64 18 MB/s | 5.2 MB 00:00 2024-05-08T21:07:13.604 INFO:teuthology.orchestra.run.smithi080.stdout:(77/146): libaio-devel-0.3.112-1.el8.x86_64.rpm 62 kB/s | 19 kB 00:00 2024-05-08T21:07:13.627 INFO:teuthology.orchestra.run.smithi106.stdout:(119/146): python3-mako-1.0.6-14.el8.noarch.rpm 1.3 MB/s | 157 kB 00:00 2024-05-08T21:07:13.638 INFO:teuthology.orchestra.run.smithi080.stdout:(78/146): pcre2-devel-10.32-2.el8.x86_64.rpm 3.7 MB/s | 605 kB 00:00 2024-05-08T21:07:13.778 INFO:teuthology.orchestra.run.smithi106.stdout:(120/146): automake-1.16.1-8.el8.noarch.rpm 4.7 MB/s | 714 kB 00:00 2024-05-08T21:07:13.895 INFO:teuthology.orchestra.run.smithi106.stdout:(121/146): openblas-0.3.15-6.el8.x86_64.rpm 17 MB/s | 5.0 MB 00:00 2024-05-08T21:07:13.911 INFO:teuthology.orchestra.run.smithi106.stdout:(122/146): libpq-13.11-1.el8.x86_64.rpm 1.4 MB/s | 198 kB 00:00 2024-05-08T21:07:13.988 INFO:teuthology.orchestra.run.smithi080.stdout:(79/146): pcre2-utf16-10.32-2.el8.x86_64.rpm 597 kB/s | 229 kB 00:00 2024-05-08T21:07:14.037 INFO:teuthology.orchestra.run.smithi106.stdout:(123/146): jq-1.6-7.el8.x86_64.rpm 1.4 MB/s | 202 kB 00:00 2024-05-08T21:07:14.062 INFO:teuthology.orchestra.run.smithi106.stdout:(124/146): python3-pytz-2017.2-11.el8.noarch.rp 360 kB/s | 54 kB 00:00 2024-05-08T21:07:14.072 INFO:teuthology.orchestra.run.smithi080.stdout:(80/146): pcre2-utf32-10.32-2.el8.x86_64.rpm 508 kB/s | 220 kB 00:00 2024-05-08T21:07:14.097 INFO:teuthology.orchestra.run.smithi080.stdout:(81/146): libselinux-devel-2.9-5.el8.x86_64.rpm 1.8 MB/s | 200 kB 00:00 2024-05-08T21:07:14.172 INFO:teuthology.orchestra.run.smithi080.stdout:(82/146): keyutils-libs-devel-1.5.10-9.el8.x86_ 481 kB/s | 48 kB 00:00 2024-05-08T21:07:14.179 INFO:teuthology.orchestra.run.smithi106.stdout:(125/146): oniguruma-6.8.2-2.1.el8_9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-05-08T21:07:14.298 INFO:teuthology.orchestra.run.smithi080.stdout:(83/146): libsepol-devel-2.9-3.el8.x86_64.rpm 434 kB/s | 87 kB 00:00 2024-05-08T21:07:14.323 INFO:teuthology.orchestra.run.smithi080.stdout:(84/146): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 383 kB/s | 58 kB 00:00 2024-05-08T21:07:14.396 INFO:teuthology.orchestra.run.smithi106.stdout:(126/146): postgresql-10.23-4.module+el8.9.0+21 6.9 MB/s | 1.5 MB 00:00 2024-05-08T21:07:14.457 INFO:teuthology.orchestra.run.smithi080.stdout:(85/146): libcom_err-devel-1.45.6-4.el8.x86_64. 243 kB/s | 39 kB 00:00 2024-05-08T21:07:14.482 INFO:teuthology.orchestra.run.smithi080.stdout:(86/146): fuse-2.9.7-17.el8.x86_64.rpm 523 kB/s | 83 kB 00:00 2024-05-08T21:07:14.582 INFO:teuthology.orchestra.run.smithi080.stdout:(87/146): libgfortran-8.5.0-20.el8.x86_64.rpm 5.0 MB/s | 645 kB 00:00 2024-05-08T21:07:14.646 INFO:teuthology.orchestra.run.smithi106.stdout:(127/146): python3-scipy-1.0.0-21.module+el8.9. 23 MB/s | 14 MB 00:00 2024-05-08T21:07:14.666 INFO:teuthology.orchestra.run.smithi080.stdout:(88/146): libquadmath-8.5.0-20.el8.x86_64.rpm 939 kB/s | 172 kB 00:00 2024-05-08T21:07:14.688 INFO:teuthology.orchestra.run.smithi106.stdout:(128/146): postgresql-contrib-10.23-4.module+el 2.7 MB/s | 812 kB 00:00 2024-05-08T21:07:14.699 INFO:teuthology.orchestra.run.smithi080.stdout:(89/146): python3-cffi-1.11.5-6.el8.x86_64.rpm 2.0 MB/s | 238 kB 00:00 2024-05-08T21:07:14.791 INFO:teuthology.orchestra.run.smithi080.stdout:(90/146): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 580 kB/s | 73 kB 00:00 2024-05-08T21:07:15.155 INFO:teuthology.orchestra.run.smithi106.stdout:(129/146): postgresql-server-10.23-4.module+el8 9.9 MB/s | 5.1 MB 00:00 2024-05-08T21:07:15.217 INFO:teuthology.orchestra.run.smithi080.stdout:(91/146): ceph-test-18.2.2-1322.gd21e4f96.el8.x 3.7 MB/s | 47 MB 00:12 2024-05-08T21:07:15.242 INFO:teuthology.orchestra.run.smithi080.stdout:(92/146): elfutils-libelf-devel-0.189-3.el8.x86 114 kB/s | 62 kB 00:00 2024-05-08T21:07:15.276 INFO:teuthology.orchestra.run.smithi080.stdout:(93/146): krb5-devel-1.18.2-26.el8_9.x86_64.rpm 1.1 MB/s | 562 kB 00:00 2024-05-08T21:07:15.392 INFO:teuthology.orchestra.run.smithi080.stdout:(94/146): librabbitmq-0.9.0-5.el8_9.x86_64.rpm 325 kB/s | 47 kB 00:00 2024-05-08T21:07:15.432 INFO:teuthology.orchestra.run.smithi080.stdout:(95/146): python3-cryptography-3.2.1-7.el8_9.x8 3.6 MB/s | 559 kB 00:00 2024-05-08T21:07:15.485 INFO:teuthology.orchestra.run.smithi080.stdout:(96/146): openssl-devel-1.1.1k-12.el8_9.x86_64. 8.7 MB/s | 2.3 MB 00:00 2024-05-08T21:07:15.510 INFO:teuthology.orchestra.run.smithi080.stdout:(97/146): NetworkManager-initscripts-updown-1.4 1.2 MB/s | 144 kB 00:00 2024-05-08T21:07:15.535 INFO:teuthology.orchestra.run.smithi080.stdout:(98/146): libuuid-devel-2.32.1-44.el8_9.1.x86_6 919 kB/s | 100 kB 00:00 2024-05-08T21:07:15.610 INFO:teuthology.orchestra.run.smithi080.stdout:(99/146): python3-packaging-16.8-9.el8.noarch.r 384 kB/s | 48 kB 00:00 2024-05-08T21:07:15.653 INFO:teuthology.orchestra.run.smithi080.stdout:(100/146): python3-jsonpointer-1.10-11.el8.noar 140 kB/s | 20 kB 00:00 2024-05-08T21:07:15.677 INFO:teuthology.orchestra.run.smithi080.stdout:(101/146): python3-prettytable-0.7.2-14.el8.noa 309 kB/s | 44 kB 00:00 2024-05-08T21:07:15.753 INFO:teuthology.orchestra.run.smithi080.stdout:(102/146): python3-jsonpatch-1.21-2.el8.noarch. 265 kB/s | 27 kB 00:00 2024-05-08T21:07:15.795 INFO:teuthology.orchestra.run.smithi080.stdout:(103/146): python3-pyasn1-modules-0.3.7-6.el8.n 597 kB/s | 110 kB 00:00 2024-05-08T21:07:15.820 INFO:teuthology.orchestra.run.smithi080.stdout:(104/146): python3-pyasn1-0.3.7-6.el8.noarch.rp 889 kB/s | 126 kB 00:00 2024-05-08T21:07:15.879 INFO:teuthology.orchestra.run.smithi080.stdout:(105/146): python3-werkzeug-0.12.2-4.el8.noarch 3.6 MB/s | 457 kB 00:00 2024-05-08T21:07:15.954 INFO:teuthology.orchestra.run.smithi080.stdout:(106/146): bison-3.0.4-10.el8.x86_64.rpm 4.2 MB/s | 688 kB 00:00 2024-05-08T21:07:15.979 INFO:teuthology.orchestra.run.smithi080.stdout:(107/146): flex-2.6.1-9.el8.x86_64.rpm 2.0 MB/s | 320 kB 00:00 2024-05-08T21:07:16.005 INFO:teuthology.orchestra.run.smithi080.stdout:(108/146): python3-markupsafe-0.23-19.el8.x86_6 773 kB/s | 39 kB 00:00 2024-05-08T21:07:16.057 INFO:teuthology.orchestra.run.smithi080.stdout:(109/146): libtool-2.4.6-25.el8.x86_64.rpm 3.9 MB/s | 709 kB 00:00 2024-05-08T21:07:16.089 INFO:teuthology.orchestra.run.smithi080.stdout:(110/146): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.3 MB/s | 259 kB 00:00 2024-05-08T21:07:16.147 INFO:teuthology.orchestra.run.smithi080.stdout:(111/146): uuid-1.6.2-43.el8.x86_64.rpm 450 kB/s | 64 kB 00:00 2024-05-08T21:07:16.173 INFO:teuthology.orchestra.run.smithi080.stdout:(112/146): python3-pyOpenSSL-19.0.0-1.el8.noarc 901 kB/s | 103 kB 00:00 2024-05-08T21:07:16.290 INFO:teuthology.orchestra.run.smithi080.stdout:(113/146): python3-babel-2.5.1-7.el8.noarch.rpm 24 MB/s | 4.8 MB 00:00 2024-05-08T21:07:16.323 INFO:teuthology.orchestra.run.smithi080.stdout:(114/146): python3-jinja2-2.10.1-3.el8.noarch.r 3.0 MB/s | 538 kB 00:00 2024-05-08T21:07:16.432 INFO:teuthology.orchestra.run.smithi080.stdout:(115/146): python3-numpy-1.14.3-10.el8.x86_64.r 14 MB/s | 3.7 MB 00:00 2024-05-08T21:07:16.465 INFO:teuthology.orchestra.run.smithi080.stdout:(116/146): python3-numpy-f2py-1.14.3-10.el8.x86 1.5 MB/s | 225 kB 00:00 2024-05-08T21:07:16.490 INFO:teuthology.orchestra.run.smithi080.stdout:(117/146): socat-1.7.4.1-1.el8.x86_64.rpm 1.6 MB/s | 323 kB 00:00 2024-05-08T21:07:16.516 INFO:teuthology.orchestra.run.smithi080.stdout:(118/146): librdkafka-0.11.4-3.el8.x86_64.rpm 4.1 MB/s | 354 kB 00:00 2024-05-08T21:07:16.591 INFO:teuthology.orchestra.run.smithi080.stdout:(119/146): python3-mako-1.0.6-14.el8.noarch.rpm 1.5 MB/s | 157 kB 00:00 2024-05-08T21:07:16.626 INFO:teuthology.orchestra.run.smithi106.stdout:(130/146): ceph-test-18.2.2-1322.gd21e4f96.el8. 2.6 MB/s | 47 MB 00:18 2024-05-08T21:07:16.689 INFO:teuthology.orchestra.run.smithi106.stdout:(131/146): librados2-18.2.2-1322.gd21e4f96.el8. 1.8 MB/s | 3.7 MB 00:02 2024-05-08T21:07:16.700 INFO:teuthology.orchestra.run.smithi080.stdout:(120/146): openblas-threads-0.3.15-6.el8.x86_64 22 MB/s | 5.2 MB 00:00 2024-05-08T21:07:16.733 INFO:teuthology.orchestra.run.smithi080.stdout:(121/146): automake-1.16.1-8.el8.noarch.rpm 4.9 MB/s | 714 kB 00:00 2024-05-08T21:07:16.781 INFO:teuthology.orchestra.run.smithi106.stdout:(132/146): librbd1-18.2.2-1322.gd21e4f96.el8.x8 2.2 MB/s | 3.6 MB 00:01 2024-05-08T21:07:16.806 INFO:teuthology.orchestra.run.smithi106.stdout:(133/146): elfutils-libelf-0.189-3.el8.x86_64.r 1.2 MB/s | 232 kB 00:00 2024-05-08T21:07:16.848 INFO:teuthology.orchestra.run.smithi106.stdout:(134/146): elfutils-libs-0.189-3.el8.x86_64.rpm 1.9 MB/s | 303 kB 00:00 2024-05-08T21:07:16.867 INFO:teuthology.orchestra.run.smithi080.stdout:(122/146): openblas-0.3.15-6.el8.x86_64.rpm 14 MB/s | 5.0 MB 00:00 2024-05-08T21:07:16.892 INFO:teuthology.orchestra.run.smithi080.stdout:(123/146): libpq-13.11-1.el8.x86_64.rpm 1.0 MB/s | 198 kB 00:00 2024-05-08T21:07:16.917 INFO:teuthology.orchestra.run.smithi080.stdout:(124/146): jq-1.6-7.el8.x86_64.rpm 1.1 MB/s | 202 kB 00:00 2024-05-08T21:07:16.940 INFO:teuthology.orchestra.run.smithi106.stdout:(135/146): openssl-libs-1.1.1k-12.el8_9.x86_64. 16 MB/s | 1.5 MB 00:00 2024-05-08T21:07:16.951 INFO:teuthology.orchestra.run.smithi080.stdout:(125/146): python3-pytz-2017.2-11.el8.noarch.rp 648 kB/s | 54 kB 00:00 2024-05-08T21:07:16.982 INFO:teuthology.orchestra.run.smithi106.stdout:(136/146): openssl-1.1.1k-12.el8_9.x86_64.rpm 4.1 MB/s | 711 kB 00:00 2024-05-08T21:07:17.016 INFO:teuthology.orchestra.run.smithi106.stdout:(137/146): iproute-6.2.0-5.el8_9.x86_64.rpm 3.6 MB/s | 854 kB 00:00 2024-05-08T21:07:17.051 INFO:teuthology.orchestra.run.smithi080.stdout:(126/146): postgresql-10.23-4.module+el8.9.0+21 15 MB/s | 1.5 MB 00:00 2024-05-08T21:07:17.076 INFO:teuthology.orchestra.run.smithi080.stdout:(127/146): oniguruma-6.8.2-2.1.el8_9.x86_64.rpm 1.2 MB/s | 188 kB 00:00 2024-05-08T21:07:17.149 INFO:teuthology.orchestra.run.smithi106.stdout:(138/146): xfsdump-3.1.8-7.el8_9.x86_64.rpm 1.6 MB/s | 333 kB 00:00 2024-05-08T21:07:17.174 INFO:teuthology.orchestra.run.smithi106.stdout:(139/146): libblkid-2.32.1-44.el8_9.1.x86_64.rp 1.4 MB/s | 221 kB 00:00 2024-05-08T21:07:17.202 INFO:teuthology.orchestra.run.smithi080.stdout:(128/146): postgresql-contrib-10.23-4.module+el 5.3 MB/s | 812 kB 00:00 2024-05-08T21:07:17.216 INFO:teuthology.orchestra.run.smithi106.stdout:(140/146): xfsprogs-5.0.0-12.el8.x86_64.rpm 4.6 MB/s | 1.1 MB 00:00 2024-05-08T21:07:17.283 INFO:teuthology.orchestra.run.smithi106.stdout:(141/146): libfdisk-2.32.1-44.el8_9.1.x86_64.rp 1.9 MB/s | 254 kB 00:00 2024-05-08T21:07:17.308 INFO:teuthology.orchestra.run.smithi106.stdout:(142/146): libmount-2.32.1-44.el8_9.1.x86_64.rp 1.7 MB/s | 237 kB 00:00 2024-05-08T21:07:17.367 INFO:teuthology.orchestra.run.smithi106.stdout:(143/146): libsmartcols-2.32.1-44.el8_9.1.x86_6 1.2 MB/s | 180 kB 00:00 2024-05-08T21:07:17.385 INFO:teuthology.orchestra.run.smithi080.stdout:(129/146): python3-scipy-1.0.0-21.module+el8.9. 28 MB/s | 14 MB 00:00 2024-05-08T21:07:17.426 INFO:teuthology.orchestra.run.smithi106.stdout:(144/146): libuuid-2.32.1-44.el8_9.1.x86_64.rpm 696 kB/s | 99 kB 00:00 2024-05-08T21:07:17.518 INFO:teuthology.orchestra.run.smithi106.stdout:(145/146): util-linux-2.32.1-44.el8_9.1.x86_64. 12 MB/s | 2.5 MB 00:00 2024-05-08T21:07:17.527 INFO:teuthology.orchestra.run.smithi080.stdout:(130/146): postgresql-server-10.23-4.module+el8 11 MB/s | 5.1 MB 00:00 2024-05-08T21:07:17.543 INFO:teuthology.orchestra.run.smithi106.stdout:(146/146): util-linux-user-2.32.1-44.el8_9.1.x8 585 kB/s | 103 kB 00:00 2024-05-08T21:07:17.546 INFO:teuthology.orchestra.run.smithi106.stdout:-------------------------------------------------------------------------------- 2024-05-08T21:07:17.546 INFO:teuthology.orchestra.run.smithi106.stdout:Total 7.4 MB/s | 215 MB 00:29 2024-05-08T21:07:17.694 INFO:teuthology.orchestra.run.smithi080.stdout:(131/146): elfutils-libelf-0.189-3.el8.x86_64.r 1.4 MB/s | 232 kB 00:00 2024-05-08T21:07:17.803 INFO:teuthology.orchestra.run.smithi080.stdout:(132/146): librbd1-18.2.2-1322.gd21e4f96.el8.x8 8.6 MB/s | 3.6 MB 00:00 2024-05-08T21:07:17.828 INFO:teuthology.orchestra.run.smithi080.stdout:(133/146): elfutils-libs-0.189-3.el8.x86_64.rpm 2.2 MB/s | 303 kB 00:00 2024-05-08T21:07:17.895 INFO:teuthology.orchestra.run.smithi080.stdout:(134/146): iproute-6.2.0-5.el8_9.x86_64.rpm 9.1 MB/s | 854 kB 00:00 2024-05-08T21:07:17.928 INFO:teuthology.orchestra.run.smithi080.stdout:(135/146): openssl-1.1.1k-12.el8_9.x86_64.rpm 6.9 MB/s | 711 kB 00:00 2024-05-08T21:07:18.004 INFO:teuthology.orchestra.run.smithi080.stdout:(136/146): librados2-18.2.2-1322.gd21e4f96.el8. 4.6 MB/s | 3.7 MB 00:00 2024-05-08T21:07:18.029 INFO:teuthology.orchestra.run.smithi080.stdout:(137/146): xfsdump-3.1.8-7.el8_9.x86_64.rpm 3.2 MB/s | 333 kB 00:00 2024-05-08T21:07:18.079 INFO:teuthology.orchestra.run.smithi080.stdout:(138/146): openssl-libs-1.1.1k-12.el8_9.x86_64. 8.0 MB/s | 1.5 MB 00:00 2024-05-08T21:07:18.204 INFO:teuthology.orchestra.run.smithi080.stdout:(139/146): xfsprogs-5.0.0-12.el8.x86_64.rpm 5.3 MB/s | 1.1 MB 00:00 2024-05-08T21:07:18.230 INFO:teuthology.orchestra.run.smithi080.stdout:(140/146): libblkid-2.32.1-44.el8_9.1.x86_64.rp 1.1 MB/s | 221 kB 00:00 2024-05-08T21:07:18.255 INFO:teuthology.orchestra.run.smithi080.stdout:(141/146): libfdisk-2.32.1-44.el8_9.1.x86_64.rp 1.4 MB/s | 254 kB 00:00 2024-05-08T21:07:18.372 INFO:teuthology.orchestra.run.smithi080.stdout:(142/146): libsmartcols-2.32.1-44.el8_9.1.x86_6 1.2 MB/s | 180 kB 00:00 2024-05-08T21:07:18.389 INFO:teuthology.orchestra.run.smithi080.stdout:(143/146): libmount-2.32.1-44.el8_9.1.x86_64.rp 1.3 MB/s | 237 kB 00:00 2024-05-08T21:07:18.548 INFO:teuthology.orchestra.run.smithi080.stdout:(144/146): util-linux-2.32.1-44.el8_9.1.x86_64. 14 MB/s | 2.5 MB 00:00 2024-05-08T21:07:18.573 INFO:teuthology.orchestra.run.smithi080.stdout:(145/146): libuuid-2.32.1-44.el8_9.1.x86_64.rpm 312 kB/s | 99 kB 00:00 2024-05-08T21:07:18.590 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction check 2024-05-08T21:07:18.640 INFO:teuthology.orchestra.run.smithi080.stdout:(146/146): util-linux-user-2.32.1-44.el8_9.1.x8 410 kB/s | 103 kB 00:00 2024-05-08T21:07:18.642 INFO:teuthology.orchestra.run.smithi080.stdout:-------------------------------------------------------------------------------- 2024-05-08T21:07:18.643 INFO:teuthology.orchestra.run.smithi080.stdout:Total 7.5 MB/s | 215 MB 00:28 2024-05-08T21:07:18.984 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction check succeeded. 2024-05-08T21:07:18.984 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction test 2024-05-08T21:07:19.680 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction check 2024-05-08T21:07:20.073 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction check succeeded. 2024-05-08T21:07:20.073 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction test 2024-05-08T21:07:20.194 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction test succeeded. 2024-05-08T21:07:20.204 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction 2024-05-08T21:07:21.273 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction test succeeded. 2024-05-08T21:07:21.283 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction 2024-05-08T21:07:25.697 INFO:teuthology.orchestra.run.smithi106.stdout: Preparing : 1/1 2024-05-08T21:07:25.833 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/1 2024-05-08T21:07:26.071 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/162 2024-05-08T21:07:26.283 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/162 2024-05-08T21:07:26.498 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/162 2024-05-08T21:07:26.670 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : libuuid-2.32.1-44.el8_9.1.x86_64 3/162 2024-05-08T21:07:26.718 INFO:teuthology.orchestra.run.smithi080.stdout: Preparing : 1/1 2024-05-08T21:07:26.744 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libuuid-2.32.1-44.el8_9.1.x86_64 3/162 2024-05-08T21:07:26.852 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/1 2024-05-08T21:07:26.903 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : libblkid-2.32.1-44.el8_9.1.x86_64 4/162 2024-05-08T21:07:26.972 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libblkid-2.32.1-44.el8_9.1.x86_64 4/162 2024-05-08T21:07:27.132 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/162 2024-05-08T21:07:27.149 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/162 2024-05-08T21:07:27.327 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : librabbitmq-0.9.0-5.el8_9.x86_64 6/162 2024-05-08T21:07:27.346 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/162 2024-05-08T21:07:27.503 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 7/162 2024-05-08T21:07:27.527 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/162 2024-05-08T21:07:27.596 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 7/162 2024-05-08T21:07:27.698 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : libuuid-2.32.1-44.el8_9.1.x86_64 3/162 2024-05-08T21:07:27.757 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libuuid-2.32.1-44.el8_9.1.x86_64 3/162 2024-05-08T21:07:27.777 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/162 2024-05-08T21:07:27.923 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : libblkid-2.32.1-44.el8_9.1.x86_64 4/162 2024-05-08T21:07:27.976 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libblkid-2.32.1-44.el8_9.1.x86_64 4/162 2024-05-08T21:07:28.144 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/162 2024-05-08T21:07:28.171 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/162 2024-05-08T21:07:28.321 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : librabbitmq-0.9.0-5.el8_9.x86_64 6/162 2024-05-08T21:07:28.378 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : librados2-2:18.2.2-1322.gd21e4f96.el8.x86_64 9/162 2024-05-08T21:07:28.515 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 7/162 2024-05-08T21:07:28.615 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 7/162 2024-05-08T21:07:28.760 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: librados2-2:18.2.2-1322.gd21e4f96.el8.x86_64 9/162 2024-05-08T21:07:28.806 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/162 2024-05-08T21:07:28.936 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : librbd1-2:18.2.2-1322.gd21e4f96.el8.x86_64 10/162 2024-05-08T21:07:29.054 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: librbd1-2:18.2.2-1322.gd21e4f96.el8.x86_64 10/162 2024-05-08T21:07:29.191 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/162 2024-05-08T21:07:29.230 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libcephfs2-2:18.2.2-1322.gd21e4f96.el8.x86_64 11/162 2024-05-08T21:07:29.325 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libcephfs2-2:18.2.2-1322.gd21e4f96.el8.x86_64 11/162 2024-05-08T21:07:29.390 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : librados2-2:18.2.2-1322.gd21e4f96.el8.x86_64 9/162 2024-05-08T21:07:29.589 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-rados-2:18.2.2-1322.gd21e4f96.el8.x86_64 12/162 2024-05-08T21:07:29.780 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: librados2-2:18.2.2-1322.gd21e4f96.el8.x86_64 9/162 2024-05-08T21:07:29.811 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 13/162 2024-05-08T21:07:29.915 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 13/162 2024-05-08T21:07:29.948 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : librbd1-2:18.2.2-1322.gd21e4f96.el8.x86_64 10/162 2024-05-08T21:07:30.059 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: librbd1-2:18.2.2-1322.gd21e4f96.el8.x86_64 10/162 2024-05-08T21:07:30.083 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libpq-13.11-1.el8.x86_64 14/162 2024-05-08T21:07:30.243 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libcephfs2-2:18.2.2-1322.gd21e4f96.el8.x86_64 11/162 2024-05-08T21:07:30.297 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 15/162 2024-05-08T21:07:30.322 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libcephfs2-2:18.2.2-1322.gd21e4f96.el8.x86_64 11/162 2024-05-08T21:07:30.481 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 16/162 2024-05-08T21:07:30.624 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-rados-2:18.2.2-1322.gd21e4f96.el8.x86_64 12/162 2024-05-08T21:07:30.839 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 17/162 2024-05-08T21:07:30.864 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 13/162 2024-05-08T21:07:30.962 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 13/162 2024-05-08T21:07:31.048 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a 18/162 2024-05-08T21:07:31.120 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libpq-13.11-1.el8.x86_64 14/162 2024-05-08T21:07:31.178 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libcephsqlite-2:18.2.2-1322.gd21e4f96.el8.x86_64 19/162 2024-05-08T21:07:31.266 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1322.gd21e4f96.el8.x86_64 19/162 2024-05-08T21:07:31.368 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 15/162 2024-05-08T21:07:31.402 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libradosstriper1-2:18.2.2-1322.gd21e4f96.el8.x86 20/162 2024-05-08T21:07:31.480 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1322.gd21e4f96.el8.x86 20/162 2024-05-08T21:07:31.542 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 16/162 2024-05-08T21:07:31.689 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 21/162 2024-05-08T21:07:31.912 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 17/162 2024-05-08T21:07:31.936 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 22/162 2024-05-08T21:07:32.143 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a 18/162 2024-05-08T21:07:32.166 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 23/162 2024-05-08T21:07:32.256 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libcephsqlite-2:18.2.2-1322.gd21e4f96.el8.x86_64 19/162 2024-05-08T21:07:32.327 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 24/162 2024-05-08T21:07:32.362 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1322.gd21e4f96.el8.x86_64 19/162 2024-05-08T21:07:32.491 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 24/162 2024-05-08T21:07:32.505 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libradosstriper1-2:18.2.2-1322.gd21e4f96.el8.x86 20/162 2024-05-08T21:07:32.585 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1322.gd21e4f96.el8.x86 20/162 2024-05-08T21:07:32.652 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 25/162 2024-05-08T21:07:32.784 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 21/162 2024-05-08T21:07:33.050 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 22/162 2024-05-08T21:07:33.275 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 25/162 2024-05-08T21:07:33.294 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 23/162 2024-05-08T21:07:33.461 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : openblas-threads-0.3.15-6.el8.x86_64 26/162 2024-05-08T21:07:33.497 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 24/162 2024-05-08T21:07:33.627 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 24/162 2024-05-08T21:07:33.772 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 25/162 2024-05-08T21:07:34.065 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: openblas-threads-0.3.15-6.el8.x86_64 26/162 2024-05-08T21:07:34.252 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : openblas-0.3.15-6.el8.x86_64 27/162 2024-05-08T21:07:34.381 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 25/162 2024-05-08T21:07:34.563 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : openblas-threads-0.3.15-6.el8.x86_64 26/162 2024-05-08T21:07:34.923 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: openblas-0.3.15-6.el8.x86_64 27/162 2024-05-08T21:07:35.172 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: openblas-threads-0.3.15-6.el8.x86_64 26/162 2024-05-08T21:07:35.175 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 28/162 2024-05-08T21:07:35.355 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : openblas-0.3.15-6.el8.x86_64 27/162 2024-05-08T21:07:35.357 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 29/162 2024-05-08T21:07:35.629 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 30/162 2024-05-08T21:07:35.816 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-ceph-common-2:18.2.2-1322.gd21e4f96.el8. 31/162 2024-05-08T21:07:35.954 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-ceph-argparse-2:18.2.2-1322.gd21e4f96.el 32/162 2024-05-08T21:07:36.038 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: openblas-0.3.15-6.el8.x86_64 27/162 2024-05-08T21:07:36.205 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-cephfs-2:18.2.2-1322.gd21e4f96.el8.x86_6 33/162 2024-05-08T21:07:36.328 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 28/162 2024-05-08T21:07:36.401 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 34/162 2024-05-08T21:07:36.518 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 29/162 2024-05-08T21:07:36.748 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 30/162 2024-05-08T21:07:36.894 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-ceph-common-2:18.2.2-1322.gd21e4f96.el8. 31/162 2024-05-08T21:07:37.032 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-ceph-argparse-2:18.2.2-1322.gd21e4f96.el 32/162 2024-05-08T21:07:37.308 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cephfs-2:18.2.2-1322.gd21e4f96.el8.x86_6 33/162 2024-05-08T21:07:37.496 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 34/162 2024-05-08T21:07:38.149 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 34/162 2024-05-08T21:07:38.495 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 35/162 2024-05-08T21:07:39.242 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 34/162 2024-05-08T21:07:39.464 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 36/162 2024-05-08T21:07:39.573 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 35/162 2024-05-08T21:07:39.780 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 37/162 2024-05-08T21:07:40.037 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 38/162 2024-05-08T21:07:40.246 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-rsa-4.9-2.el8.noarch 39/162 2024-05-08T21:07:40.429 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 40/162 2024-05-08T21:07:40.518 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 36/162 2024-05-08T21:07:40.644 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-rbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 41/162 2024-05-08T21:07:40.867 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : librados-devel-2:18.2.2-1322.gd21e4f96.el8.x86_6 42/162 2024-05-08T21:07:40.876 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 37/162 2024-05-08T21:07:41.060 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : libfdisk-2.32.1-44.el8_9.1.x86_64 43/162 2024-05-08T21:07:41.123 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libfdisk-2.32.1-44.el8_9.1.x86_64 43/162 2024-05-08T21:07:41.146 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 38/162 2024-05-08T21:07:41.335 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : libmount-2.32.1-44.el8_9.1.x86_64 44/162 2024-05-08T21:07:41.383 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-rsa-4.9-2.el8.noarch 39/162 2024-05-08T21:07:41.391 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libmount-2.32.1-44.el8_9.1.x86_64 44/162 2024-05-08T21:07:41.556 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 40/162 2024-05-08T21:07:41.639 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libuuid-devel-2.32.1-44.el8_9.1.x86_64 45/162 2024-05-08T21:07:41.778 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-rbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 41/162 2024-05-08T21:07:41.870 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 46/162 2024-05-08T21:07:41.978 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : librados-devel-2:18.2.2-1322.gd21e4f96.el8.x86_6 42/162 2024-05-08T21:07:42.068 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : libsmartcols-2.32.1-44.el8_9.1.x86_64 47/162 2024-05-08T21:07:42.187 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : libfdisk-2.32.1-44.el8_9.1.x86_64 43/162 2024-05-08T21:07:42.250 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libfdisk-2.32.1-44.el8_9.1.x86_64 43/162 2024-05-08T21:07:42.438 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : libmount-2.32.1-44.el8_9.1.x86_64 44/162 2024-05-08T21:07:42.493 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libmount-2.32.1-44.el8_9.1.x86_64 44/162 2024-05-08T21:07:42.518 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libsmartcols-2.32.1-44.el8_9.1.x86_64 47/162 2024-05-08T21:07:42.709 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libuuid-devel-2.32.1-44.el8_9.1.x86_64 45/162 2024-05-08T21:07:42.826 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : util-linux-2.32.1-44.el8_9.1.x86_64 48/162 2024-05-08T21:07:42.854 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: util-linux-2.32.1-44.el8_9.1.x86_64 48/162 2024-05-08T21:07:42.956 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 46/162 2024-05-08T21:07:43.026 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : oniguruma-6.8.2-2.1.el8_9.x86_64 49/162 2024-05-08T21:07:43.106 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: oniguruma-6.8.2-2.1.el8_9.x86_64 49/162 2024-05-08T21:07:43.170 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : libsmartcols-2.32.1-44.el8_9.1.x86_64 47/162 2024-05-08T21:07:43.403 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : jq-1.6-7.el8.x86_64 50/162 2024-05-08T21:07:43.584 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : automake-1.16.1-8.el8.noarch 51/162 2024-05-08T21:07:43.598 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libsmartcols-2.32.1-44.el8_9.1.x86_64 47/162 2024-05-08T21:07:43.734 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : uuid-1.6.2-43.el8.x86_64 52/162 2024-05-08T21:07:43.808 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 52/162 2024-05-08T21:07:43.929 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : util-linux-2.32.1-44.el8_9.1.x86_64 48/162 2024-05-08T21:07:43.932 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 53/162 2024-05-08T21:07:43.957 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: util-linux-2.32.1-44.el8_9.1.x86_64 48/162 2024-05-08T21:07:44.149 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 54/162 2024-05-08T21:07:44.153 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : oniguruma-6.8.2-2.1.el8_9.x86_64 49/162 2024-05-08T21:07:44.233 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: oniguruma-6.8.2-2.1.el8_9.x86_64 49/162 2024-05-08T21:07:44.310 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 55/162 2024-05-08T21:07:44.488 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : fuse-2.9.7-17.el8.x86_64 56/162 2024-05-08T21:07:44.517 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : jq-1.6-7.el8.x86_64 50/162 2024-05-08T21:07:44.672 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 57/162 2024-05-08T21:07:44.704 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : automake-1.16.1-8.el8.noarch 51/162 2024-05-08T21:07:44.880 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 58/162 2024-05-08T21:07:44.886 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : uuid-1.6.2-43.el8.x86_64 52/162 2024-05-08T21:07:44.961 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 52/162 2024-05-08T21:07:45.053 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 59/162 2024-05-08T21:07:45.143 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 53/162 2024-05-08T21:07:45.238 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 60/162 2024-05-08T21:07:45.335 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 54/162 2024-05-08T21:07:45.505 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 55/162 2024-05-08T21:07:45.526 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 61/162 2024-05-08T21:07:45.688 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-packaging-16.8-9.el8.noarch 56/162 2024-05-08T21:07:45.804 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 62/162 2024-05-08T21:07:45.932 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : fuse-2.9.7-17.el8.x86_64 57/162 2024-05-08T21:07:46.022 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 63/162 2024-05-08T21:07:46.109 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 58/162 2024-05-08T21:07:46.181 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 64/162 2024-05-08T21:07:46.299 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 59/162 2024-05-08T21:07:46.361 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 65/162 2024-05-08T21:07:46.456 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 60/162 2024-05-08T21:07:46.690 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 61/162 2024-05-08T21:07:46.760 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 66/162 2024-05-08T21:07:46.996 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 62/162 2024-05-08T21:07:47.028 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-cryptography-3.2.1-7.el8_9.x86_64 67/162 2024-05-08T21:07:47.249 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 63/162 2024-05-08T21:07:47.308 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 68/162 2024-05-08T21:07:47.457 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 64/162 2024-05-08T21:07:47.525 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 69/162 2024-05-08T21:07:47.607 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 65/162 2024-05-08T21:07:47.693 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 70/162 2024-05-08T21:07:47.821 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 66/162 2024-05-08T21:07:47.904 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 71/162 2024-05-08T21:07:48.130 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 72/162 2024-05-08T21:07:48.230 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 67/162 2024-05-08T21:07:48.368 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 73/162 2024-05-08T21:07:48.539 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cryptography-3.2.1-7.el8_9.x86_64 68/162 2024-05-08T21:07:48.561 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 74/162 2024-05-08T21:07:48.748 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 75/162 2024-05-08T21:07:48.843 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 69/162 2024-05-08T21:07:49.041 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : krb5-devel-1.18.2-26.el8_9.x86_64 76/162 2024-05-08T21:07:49.043 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 70/162 2024-05-08T21:07:49.212 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 71/162 2024-05-08T21:07:49.218 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-packaging-16.8-9.el8.noarch 77/162 2024-05-08T21:07:49.391 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 78/162 2024-05-08T21:07:49.464 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 72/162 2024-05-08T21:07:49.559 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 79/162 2024-05-08T21:07:49.698 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 73/162 2024-05-08T21:07:49.802 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 80/162 2024-05-08T21:07:49.903 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 74/162 2024-05-08T21:07:50.015 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 81/162 2024-05-08T21:07:50.171 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 75/162 2024-05-08T21:07:50.212 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 82/162 2024-05-08T21:07:50.351 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 76/162 2024-05-08T21:07:50.369 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 83/162 2024-05-08T21:07:50.558 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 84/162 2024-05-08T21:07:50.638 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : krb5-devel-1.18.2-26.el8_9.x86_64 77/162 2024-05-08T21:07:50.777 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 78/162 2024-05-08T21:07:50.779 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 85/162 2024-05-08T21:07:50.980 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 86/162 2024-05-08T21:07:50.990 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 79/162 2024-05-08T21:07:51.128 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 87/162 2024-05-08T21:07:51.240 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 80/162 2024-05-08T21:07:51.458 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 81/162 2024-05-08T21:07:51.690 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 82/162 2024-05-08T21:07:51.715 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 88/162 2024-05-08T21:07:51.838 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 83/162 2024-05-08T21:07:51.921 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 89/162 2024-05-08T21:07:52.018 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 84/162 2024-05-08T21:07:52.103 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 90/162 2024-05-08T21:07:52.238 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 85/162 2024-05-08T21:07:52.280 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 91/162 2024-05-08T21:07:52.477 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 86/162 2024-05-08T21:07:52.578 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-portend-2.6-1.el8.noarch 92/162 2024-05-08T21:07:52.646 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 87/162 2024-05-08T21:07:52.790 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 88/162 2024-05-08T21:07:52.815 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 93/162 2024-05-08T21:07:52.997 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 94/162 2024-05-08T21:07:53.023 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 89/162 2024-05-08T21:07:53.212 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 95/162 2024-05-08T21:07:53.262 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 90/162 2024-05-08T21:07:53.450 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 91/162 2024-05-08T21:07:53.695 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-portend-2.6-1.el8.noarch 92/162 2024-05-08T21:07:53.942 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 93/162 2024-05-08T21:07:54.124 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 94/162 2024-05-08T21:07:54.284 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 96/162 2024-05-08T21:07:54.324 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 95/162 2024-05-08T21:07:54.587 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 97/162 2024-05-08T21:07:54.815 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 98/162 2024-05-08T21:07:55.183 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 99/162 2024-05-08T21:07:55.435 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 96/162 2024-05-08T21:07:55.467 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 100/162 2024-05-08T21:07:55.666 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 101/162 2024-05-08T21:07:55.863 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 97/162 2024-05-08T21:07:56.075 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 98/162 2024-05-08T21:07:56.386 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 99/162 2024-05-08T21:07:56.446 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 102/162 2024-05-08T21:07:56.624 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : librgw2-2:18.2.2-1322.gd21e4f96.el8.x86_64 103/162 2024-05-08T21:07:56.682 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: librgw2-2:18.2.2-1322.gd21e4f96.el8.x86_64 103/162 2024-05-08T21:07:56.701 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 100/162 2024-05-08T21:07:56.901 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 101/162 2024-05-08T21:07:56.933 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-rgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 104/162 2024-05-08T21:07:57.665 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 102/162 2024-05-08T21:07:57.809 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : librgw2-2:18.2.2-1322.gd21e4f96.el8.x86_64 103/162 2024-05-08T21:07:57.880 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: librgw2-2:18.2.2-1322.gd21e4f96.el8.x86_64 103/162 2024-05-08T21:07:58.084 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-rgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 104/162 2024-05-08T21:08:00.594 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 105/162 2024-05-08T21:08:00.849 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 105/162 2024-05-08T21:08:01.437 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 105/162 2024-05-08T21:08:01.750 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 105/162 2024-05-08T21:08:01.774 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-base-2:18.2.2-1322.gd21e4f96.el8.x86_64 106/162 2024-05-08T21:08:01.859 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-base-2:18.2.2-1322.gd21e4f96.el8.x86_64 106/162 2024-05-08T21:08:01.999 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 105/162 2024-05-08T21:08:02.549 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-selinux-2:18.2.2-1322.gd21e4f96.el8.x86_64 107/162 2024-05-08T21:08:02.589 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 105/162 2024-05-08T21:08:02.891 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-base-2:18.2.2-1322.gd21e4f96.el8.x86_64 106/162 2024-05-08T21:08:02.975 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-base-2:18.2.2-1322.gd21e4f96.el8.x86_64 106/162 2024-05-08T21:08:03.132 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-selinux-2:18.2.2-1322.gd21e4f96.el8.x86_64 107/162 2024-05-08T21:08:22.119 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1322.gd21e4f96.el8.x86_64 107/162 2024-05-08T21:08:22.119 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /sys 2024-05-08T21:08:22.119 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /proc 2024-05-08T21:08:22.119 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /dev 2024-05-08T21:08:22.119 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /run 2024-05-08T21:08:22.119 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /mnt 2024-05-08T21:08:22.120 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /var/tmp 2024-05-08T21:08:22.120 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /home 2024-05-08T21:08:22.120 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /tmp 2024-05-08T21:08:22.120 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /dev 2024-05-08T21:08:22.120 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-08T21:08:22.472 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-volume-2:18.2.2-1322.gd21e4f96.el8.noarch 108/162 2024-05-08T21:08:22.650 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1322.gd21e4f96.el8.x86_64 107/162 2024-05-08T21:08:22.650 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /sys 2024-05-08T21:08:22.650 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /proc 2024-05-08T21:08:22.650 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /dev 2024-05-08T21:08:22.650 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /run 2024-05-08T21:08:22.651 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /mnt 2024-05-08T21:08:22.651 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /var/tmp 2024-05-08T21:08:22.651 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /home 2024-05-08T21:08:22.651 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /tmp 2024-05-08T21:08:22.651 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /dev 2024-05-08T21:08:22.651 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:08:23.045 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-volume-2:18.2.2-1322.gd21e4f96.el8.noarch 108/162 2024-05-08T21:08:24.106 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-volume-2:18.2.2-1322.gd21e4f96.el8.noarch 108/162 2024-05-08T21:08:24.330 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-osd-2:18.2.2-1322.gd21e4f96.el8.x86_64 109/162 2024-05-08T21:08:24.548 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-osd-2:18.2.2-1322.gd21e4f96.el8.x86_64 109/162 2024-05-08T21:08:24.681 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-volume-2:18.2.2-1322.gd21e4f96.el8.noarch 108/162 2024-05-08T21:08:24.712 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mds-2:18.2.2-1322.gd21e4f96.el8.x86_64 110/162 2024-05-08T21:08:24.895 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-osd-2:18.2.2-1322.gd21e4f96.el8.x86_64 109/162 2024-05-08T21:08:25.112 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-osd-2:18.2.2-1322.gd21e4f96.el8.x86_64 109/162 2024-05-08T21:08:25.185 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-mds-2:18.2.2-1322.gd21e4f96.el8.x86_64 110/162 2024-05-08T21:08:25.269 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mds-2:18.2.2-1322.gd21e4f96.el8.x86_64 110/162 2024-05-08T21:08:25.338 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mon-2:18.2.2-1322.gd21e4f96.el8.x86_64 111/162 2024-05-08T21:08:25.355 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-mon-2:18.2.2-1322.gd21e4f96.el8.x86_64 111/162 2024-05-08T21:08:25.743 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mds-2:18.2.2-1322.gd21e4f96.el8.x86_64 110/162 2024-05-08T21:08:25.944 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mon-2:18.2.2-1322.gd21e4f96.el8.x86_64 111/162 2024-05-08T21:08:25.961 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mon-2:18.2.2-1322.gd21e4f96.el8.x86_64 111/162 2024-05-08T21:08:27.197 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 112/162 2024-05-08T21:08:27.422 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 112/162 2024-05-08T21:08:27.485 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1322.gd21e4f96.e 113/162 2024-05-08T21:08:27.722 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1322.gd21e4f96. 114/162 2024-05-08T21:08:27.774 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 112/162 2024-05-08T21:08:27.922 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 112/162 2024-05-08T21:08:27.974 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1322.gd21e4f96.el8.noa 115/162 2024-05-08T21:08:28.067 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1322.gd21e4f96.e 113/162 2024-05-08T21:08:28.294 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1322.gd21e4f96. 114/162 2024-05-08T21:08:28.526 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1322.gd21e4f96.el8.noa 115/162 2024-05-08T21:08:29.004 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1322.gd21e4f96.el8.noa 115/162 2024-05-08T21:08:29.277 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1322.gd21e4f96.el8.n 116/162 2024-05-08T21:08:29.554 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1322.gd21e4f96.el8.noa 115/162 2024-05-08T21:08:29.777 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1322.gd21e4f96.el8.n 116/162 2024-05-08T21:08:30.240 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1322.gd21e4f96.el8.n 116/162 2024-05-08T21:08:30.420 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1322.gd21 117/162 2024-05-08T21:08:30.512 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1322.gd21 117/162 2024-05-08T21:08:30.740 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1322.gd21e4f96.el8.n 116/162 2024-05-08T21:08:30.883 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1322.gd21e4f96.el 118/162 2024-05-08T21:08:30.934 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1322.gd21 117/162 2024-05-08T21:08:31.027 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1322.gd21 117/162 2024-05-08T21:08:31.096 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mgr-2:18.2.2-1322.gd21e4f96.el8.x86_64 119/162 2024-05-08T21:08:31.133 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1322.gd21e4f96.el8.x86_64 119/162 2024-05-08T21:08:31.278 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mgr-rook-2:18.2.2-1322.gd21e4f96.el8.noarch 120/162 2024-05-08T21:08:31.290 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1322.gd21e4f96.el8.noarch 120/162 2024-05-08T21:08:31.398 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1322.gd21e4f96.el 118/162 2024-05-08T21:08:31.602 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mgr-2:18.2.2-1322.gd21e4f96.el8.x86_64 119/162 2024-05-08T21:08:31.640 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1322.gd21e4f96.el8.x86_64 119/162 2024-05-08T21:08:31.809 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mgr-rook-2:18.2.2-1322.gd21e4f96.el8.noarch 120/162 2024-05-08T21:08:31.821 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1322.gd21e4f96.el8.noarch 120/162 2024-05-08T21:08:32.543 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-2:18.2.2-1322.gd21e4f96.el8.x86_64 121/162 2024-05-08T21:08:32.762 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-radosgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 122/162 2024-05-08T21:08:32.797 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 122/162 2024-05-08T21:08:32.962 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1322.gd21e4 123/162 2024-05-08T21:08:33.004 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1322.gd21e4 123/162 2024-05-08T21:08:33.079 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-2:18.2.2-1322.gd21e4f96.el8.x86_64 121/162 2024-05-08T21:08:33.178 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : cephfs-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 124/162 2024-05-08T21:08:33.268 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-radosgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 122/162 2024-05-08T21:08:33.304 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 122/162 2024-05-08T21:08:33.484 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1322.gd21e4 123/162 2024-05-08T21:08:33.525 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: cephfs-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 124/162 2024-05-08T21:08:33.527 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1322.gd21e4 123/162 2024-05-08T21:08:33.678 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : rbd-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 125/162 2024-05-08T21:08:33.718 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : cephfs-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 124/162 2024-05-08T21:08:34.063 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: cephfs-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 124/162 2024-05-08T21:08:34.209 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : rbd-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 125/162 2024-05-08T21:08:38.123 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 125/162 2024-05-08T21:08:38.657 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 125/162 2024-05-08T21:08:39.051 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-test-2:18.2.2-1322.gd21e4f96.el8.x86_64 126/162 2024-05-08T21:08:39.349 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : openssl-devel-1:1.1.1k-12.el8_9.x86_64 127/162 2024-05-08T21:08:39.619 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 128/162 2024-05-08T21:08:39.627 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-test-2:18.2.2-1322.gd21e4f96.el8.x86_64 126/162 2024-05-08T21:08:39.895 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : openssl-devel-1:1.1.1k-12.el8_9.x86_64 127/162 2024-05-08T21:08:40.013 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 129/162 2024-05-08T21:08:40.157 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 128/162 2024-05-08T21:08:40.363 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : postgresql-contrib-10.23-4.module+el8.9.0+21317+ 130/162 2024-05-08T21:08:40.557 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 129/162 2024-05-08T21:08:40.560 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libtool-2.4.6-25.el8.x86_64 131/162 2024-05-08T21:08:40.573 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 131/162 2024-05-08T21:08:40.771 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : util-linux-user-2.32.1-44.el8_9.1.x86_64 132/162 2024-05-08T21:08:40.893 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : postgresql-contrib-10.23-4.module+el8.9.0+21317+ 130/162 2024-05-08T21:08:40.986 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 133/162 2024-05-08T21:08:41.116 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libtool-2.4.6-25.el8.x86_64 131/162 2024-05-08T21:08:41.128 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 131/162 2024-05-08T21:08:41.170 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libcephfs-devel-2:18.2.2-1322.gd21e4f96.el8.x86_ 134/162 2024-05-08T21:08:41.360 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : util-linux-user-2.32.1-44.el8_9.1.x86_64 132/162 2024-05-08T21:08:41.532 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 133/162 2024-05-08T21:08:41.717 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libcephfs-devel-2:18.2.2-1322.gd21e4f96.el8.x86_ 134/162 2024-05-08T21:08:43.448 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-05-08T21:08:43.710 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-05-08T21:08:43.748 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-05-08T21:08:43.990 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-05-08T21:08:44.090 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 136/162 2024-05-08T21:08:44.249 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-05-08T21:08:44.287 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-05-08T21:08:44.467 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : iproute-6.2.0-5.el8_9.x86_64 137/162 2024-05-08T21:08:44.638 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 136/162 2024-05-08T21:08:44.697 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : xfsdump-3.1.8-7.el8_9.x86_64 138/162 2024-05-08T21:08:44.885 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : cephfs-top-2:18.2.2-1322.gd21e4f96.el8.noarch 139/162 2024-05-08T21:08:45.022 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : iproute-6.2.0-5.el8_9.x86_64 137/162 2024-05-08T21:08:45.106 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : rbd-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 140/162 2024-05-08T21:08:45.272 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : xfsdump-3.1.8-7.el8_9.x86_64 138/162 2024-05-08T21:08:45.389 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : rbd-nbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 141/162 2024-05-08T21:08:45.481 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : cephfs-top-2:18.2.2-1322.gd21e4f96.el8.noarch 139/162 2024-05-08T21:08:45.654 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : openssl-1:1.1.1k-12.el8_9.x86_64 142/162 2024-05-08T21:08:45.689 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : rbd-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 140/162 2024-05-08T21:08:45.859 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : flex-2.6.1-9.el8.x86_64 143/162 2024-05-08T21:08:45.936 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 143/162 2024-05-08T21:08:45.969 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : rbd-nbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 141/162 2024-05-08T21:08:46.143 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : bison-3.0.4-10.el8.x86_64 144/162 2024-05-08T21:08:46.156 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 144/162 2024-05-08T21:08:46.259 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : openssl-1:1.1.1k-12.el8_9.x86_64 142/162 2024-05-08T21:08:46.318 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : NetworkManager-initscripts-updown-1:1.40.16-15.e 145/162 2024-05-08T21:08:46.327 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-15.e 145/162 2024-05-08T21:08:46.472 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : flex-2.6.1-9.el8.x86_64 143/162 2024-05-08T21:08:46.478 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 146/162 2024-05-08T21:08:46.549 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 143/162 2024-05-08T21:08:46.639 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : elfutils-libs-0.186-1.el8.x86_64 147/162 2024-05-08T21:08:46.790 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : bison-3.0.4-10.el8.x86_64 144/162 2024-05-08T21:08:46.803 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 144/162 2024-05-08T21:08:46.844 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : openssl-1:1.1.1k-6.el8_5.x86_64 148/162 2024-05-08T21:08:46.965 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : NetworkManager-initscripts-updown-1:1.40.16-15.e 145/162 2024-05-08T21:08:46.973 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-15.e 145/162 2024-05-08T21:08:46.996 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 149/162 2024-05-08T21:08:46.996 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 150/162 2024-05-08T21:08:47.125 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 146/162 2024-05-08T21:08:47.263 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 150/162 2024-05-08T21:08:47.263 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 151/162 2024-05-08T21:08:47.277 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : elfutils-libs-0.186-1.el8.x86_64 147/162 2024-05-08T21:08:47.455 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 151/162 2024-05-08T21:08:47.455 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 152/162 2024-05-08T21:08:47.500 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : openssl-1:1.1.1k-6.el8_5.x86_64 148/162 2024-05-08T21:08:47.660 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 149/162 2024-05-08T21:08:47.660 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 150/162 2024-05-08T21:08:47.699 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 152/162 2024-05-08T21:08:47.894 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 153/162 2024-05-08T21:08:47.909 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 150/162 2024-05-08T21:08:47.909 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 151/162 2024-05-08T21:08:48.059 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : util-linux-user-2.32.1-35.el8.x86_64 154/162 2024-05-08T21:08:48.101 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 151/162 2024-05-08T21:08:48.101 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 152/162 2024-05-08T21:08:48.286 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : util-linux-2.32.1-35.el8.x86_64 155/162 2024-05-08T21:08:48.286 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : libfdisk-2.32.1-35.el8.x86_64 156/162 2024-05-08T21:08:48.353 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 152/162 2024-05-08T21:08:48.537 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libfdisk-2.32.1-35.el8.x86_64 156/162 2024-05-08T21:08:48.537 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : libmount-2.32.1-35.el8.x86_64 157/162 2024-05-08T21:08:48.574 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 153/162 2024-05-08T21:08:48.740 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : util-linux-user-2.32.1-35.el8.x86_64 154/162 2024-05-08T21:08:48.770 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libmount-2.32.1-35.el8.x86_64 157/162 2024-05-08T21:08:48.770 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : libblkid-2.32.1-35.el8.x86_64 158/162 2024-05-08T21:08:48.995 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libblkid-2.32.1-35.el8.x86_64 158/162 2024-05-08T21:08:48.995 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : libuuid-2.32.1-35.el8.x86_64 159/162 2024-05-08T21:08:48.999 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : util-linux-2.32.1-35.el8.x86_64 155/162 2024-05-08T21:08:48.999 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : libfdisk-2.32.1-35.el8.x86_64 156/162 2024-05-08T21:08:49.211 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libuuid-2.32.1-35.el8.x86_64 159/162 2024-05-08T21:08:49.211 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : libsmartcols-2.32.1-35.el8.x86_64 160/162 2024-05-08T21:08:49.233 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libfdisk-2.32.1-35.el8.x86_64 156/162 2024-05-08T21:08:49.233 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : libmount-2.32.1-35.el8.x86_64 157/162 2024-05-08T21:08:49.419 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libsmartcols-2.32.1-35.el8.x86_64 160/162 2024-05-08T21:08:49.458 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libmount-2.32.1-35.el8.x86_64 157/162 2024-05-08T21:08:49.458 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : libblkid-2.32.1-35.el8.x86_64 158/162 2024-05-08T21:08:49.586 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : elfutils-libelf-0.186-1.el8.x86_64 161/162 2024-05-08T21:08:49.587 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : openssl-libs-1:1.1.1k-6.el8_5.x86_64 162/162 2024-05-08T21:08:49.725 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libblkid-2.32.1-35.el8.x86_64 158/162 2024-05-08T21:08:49.725 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : libuuid-2.32.1-35.el8.x86_64 159/162 2024-05-08T21:08:49.958 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libuuid-2.32.1-35.el8.x86_64 159/162 2024-05-08T21:08:49.958 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : libsmartcols-2.32.1-35.el8.x86_64 160/162 2024-05-08T21:08:50.191 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libsmartcols-2.32.1-35.el8.x86_64 160/162 2024-05-08T21:08:50.358 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : elfutils-libelf-0.186-1.el8.x86_64 161/162 2024-05-08T21:08:50.358 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : openssl-libs-1:1.1.1k-6.el8_5.x86_64 162/162 2024-05-08T21:08:50.508 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 162/162 2024-05-08T21:08:50.509 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-2:18.2.2-1322.gd21e4f96.el8.x86_64 1/162 2024-05-08T21:08:50.509 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-base-2:18.2.2-1322.gd21e4f96.el8.x86_64 2/162 2024-05-08T21:08:50.509 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 3/162 2024-05-08T21:08:50.509 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 4/162 2024-05-08T21:08:50.509 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1322.gd21e4 5/162 2024-05-08T21:08:50.509 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mds-2:18.2.2-1322.gd21e4f96.el8.x86_64 6/162 2024-05-08T21:08:50.509 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mgr-2:18.2.2-1322.gd21e4f96.el8.x86_64 7/162 2024-05-08T21:08:50.509 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mon-2:18.2.2-1322.gd21e4f96.el8.x86_64 8/162 2024-05-08T21:08:50.509 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-osd-2:18.2.2-1322.gd21e4f96.el8.x86_64 9/162 2024-05-08T21:08:50.509 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-radosgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 10/162 2024-05-08T21:08:50.509 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-selinux-2:18.2.2-1322.gd21e4f96.el8.x86_64 11/162 2024-05-08T21:08:50.509 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-test-2:18.2.2-1322.gd21e4f96.el8.x86_64 12/162 2024-05-08T21:08:50.510 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : cephfs-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 13/162 2024-05-08T21:08:50.510 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libcephfs-devel-2:18.2.2-1322.gd21e4f96.el8.x86_ 14/162 2024-05-08T21:08:50.510 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libcephfs2-2:18.2.2-1322.gd21e4f96.el8.x86_64 15/162 2024-05-08T21:08:50.510 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libcephsqlite-2:18.2.2-1322.gd21e4f96.el8.x86_64 16/162 2024-05-08T21:08:50.510 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librados-devel-2:18.2.2-1322.gd21e4f96.el8.x86_6 17/162 2024-05-08T21:08:50.510 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libradosstriper1-2:18.2.2-1322.gd21e4f96.el8.x86 18/162 2024-05-08T21:08:50.510 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librgw2-2:18.2.2-1322.gd21e4f96.el8.x86_64 19/162 2024-05-08T21:08:50.510 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1322.gd21e4f96.el 20/162 2024-05-08T21:08:50.510 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-ceph-common-2:18.2.2-1322.gd21e4f96.el8. 21/162 2024-05-08T21:08:50.510 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-cephfs-2:18.2.2-1322.gd21e4f96.el8.x86_6 22/162 2024-05-08T21:08:50.510 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-rados-2:18.2.2-1322.gd21e4f96.el8.x86_64 23/162 2024-05-08T21:08:50.510 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-rbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 24/162 2024-05-08T21:08:50.510 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-rgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 25/162 2024-05-08T21:08:50.511 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : rbd-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 26/162 2024-05-08T21:08:50.511 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : rbd-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 27/162 2024-05-08T21:08:50.511 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : rbd-nbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 28/162 2024-05-08T21:08:50.511 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1322.gd21e4f96. 29/162 2024-05-08T21:08:50.511 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1322.gd21e4f96.el8.noa 30/162 2024-05-08T21:08:50.522 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1322.gd21e4f96.el8.n 31/162 2024-05-08T21:08:50.522 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1322.gd21 32/162 2024-05-08T21:08:50.522 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1322.gd21e4f96.el 33/162 2024-05-08T21:08:50.523 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1322.gd21e4f96.el8.noarch 34/162 2024-05-08T21:08:50.523 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1322.gd21e4f96.e 35/162 2024-05-08T21:08:50.523 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-volume-2:18.2.2-1322.gd21e4f96.el8.noarch 36/162 2024-05-08T21:08:50.523 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 37/162 2024-05-08T21:08:50.523 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : cephfs-top-2:18.2.2-1322.gd21e4f96.el8.noarch 38/162 2024-05-08T21:08:50.523 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/162 2024-05-08T21:08:50.523 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/162 2024-05-08T21:08:50.523 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/162 2024-05-08T21:08:50.523 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/162 2024-05-08T21:08:50.523 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/162 2024-05-08T21:08:50.523 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/162 2024-05-08T21:08:50.523 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/162 2024-05-08T21:08:50.523 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/162 2024-05-08T21:08:50.524 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/162 2024-05-08T21:08:50.524 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/162 2024-05-08T21:08:50.524 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/162 2024-05-08T21:08:50.524 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/162 2024-05-08T21:08:50.524 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/162 2024-05-08T21:08:50.524 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/162 2024-05-08T21:08:50.524 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/162 2024-05-08T21:08:50.524 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/162 2024-05-08T21:08:50.524 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/162 2024-05-08T21:08:50.524 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/162 2024-05-08T21:08:50.524 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/162 2024-05-08T21:08:50.524 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/162 2024-05-08T21:08:50.524 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/162 2024-05-08T21:08:50.524 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/162 2024-05-08T21:08:50.524 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/162 2024-05-08T21:08:50.525 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/162 2024-05-08T21:08:50.525 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/162 2024-05-08T21:08:50.525 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/162 2024-05-08T21:08:50.525 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/162 2024-05-08T21:08:50.525 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/162 2024-05-08T21:08:50.525 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/162 2024-05-08T21:08:50.525 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/162 2024-05-08T21:08:50.525 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/162 2024-05-08T21:08:50.525 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/162 2024-05-08T21:08:50.525 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/162 2024-05-08T21:08:50.525 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-packaging-16.8-9.el8.noarch 72/162 2024-05-08T21:08:50.525 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 73/162 2024-05-08T21:08:50.525 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/162 2024-05-08T21:08:50.525 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 75/162 2024-05-08T21:08:50.525 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 76/162 2024-05-08T21:08:50.526 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 77/162 2024-05-08T21:08:50.526 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 78/162 2024-05-08T21:08:50.526 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 79/162 2024-05-08T21:08:50.526 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 80/162 2024-05-08T21:08:50.526 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 81/162 2024-05-08T21:08:50.526 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 82/162 2024-05-08T21:08:50.526 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 83/162 2024-05-08T21:08:50.526 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 84/162 2024-05-08T21:08:50.526 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 85/162 2024-05-08T21:08:50.526 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 86/162 2024-05-08T21:08:50.526 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 87/162 2024-05-08T21:08:50.526 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 88/162 2024-05-08T21:08:50.526 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 89/162 2024-05-08T21:08:50.526 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 90/162 2024-05-08T21:08:50.527 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 91/162 2024-05-08T21:08:50.527 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 92/162 2024-05-08T21:08:50.527 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 93/162 2024-05-08T21:08:50.527 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : krb5-devel-1.18.2-26.el8_9.x86_64 94/162 2024-05-08T21:08:50.527 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8_9.x86_64 95/162 2024-05-08T21:08:50.527 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librabbitmq-0.9.0-5.el8_9.x86_64 96/162 2024-05-08T21:08:50.527 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-cryptography-3.2.1-7.el8_9.x86_64 97/162 2024-05-08T21:08:50.527 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-15.e 98/162 2024-05-08T21:08:50.527 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libuuid-devel-2.32.1-44.el8_9.1.x86_64 99/162 2024-05-08T21:08:50.527 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 100/162 2024-05-08T21:08:50.527 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 101/162 2024-05-08T21:08:50.527 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 102/162 2024-05-08T21:08:50.527 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 103/162 2024-05-08T21:08:50.527 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 104/162 2024-05-08T21:08:50.527 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 105/162 2024-05-08T21:08:50.527 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : bison-3.0.4-10.el8.x86_64 106/162 2024-05-08T21:08:50.528 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : flex-2.6.1-9.el8.x86_64 107/162 2024-05-08T21:08:50.528 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 108/162 2024-05-08T21:08:50.528 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 109/162 2024-05-08T21:08:50.528 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 110/162 2024-05-08T21:08:50.528 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 111/162 2024-05-08T21:08:50.528 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 112/162 2024-05-08T21:08:50.528 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 113/162 2024-05-08T21:08:50.528 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 114/162 2024-05-08T21:08:50.528 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 115/162 2024-05-08T21:08:50.528 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 116/162 2024-05-08T21:08:50.528 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 117/162 2024-05-08T21:08:50.528 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 118/162 2024-05-08T21:08:50.528 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : openblas-threads-0.3.15-6.el8.x86_64 119/162 2024-05-08T21:08:50.528 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 120/162 2024-05-08T21:08:50.528 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : openblas-0.3.15-6.el8.x86_64 121/162 2024-05-08T21:08:50.529 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : automake-1.16.1-8.el8.noarch 122/162 2024-05-08T21:08:50.529 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libpq-13.11-1.el8.x86_64 123/162 2024-05-08T21:08:50.529 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : jq-1.6-7.el8.x86_64 124/162 2024-05-08T21:08:50.529 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 125/162 2024-05-08T21:08:50.529 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 126/162 2024-05-08T21:08:50.529 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : oniguruma-6.8.2-2.1.el8_9.x86_64 127/162 2024-05-08T21:08:50.529 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a 128/162 2024-05-08T21:08:50.529 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : postgresql-contrib-10.23-4.module+el8.9.0+21317+ 129/162 2024-05-08T21:08:50.529 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : postgresql-server-10.23-4.module+el8.9.0+21317+d 130/162 2024-05-08T21:08:50.529 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librados2-2:18.2.2-1322.gd21e4f96.el8.x86_64 131/162 2024-05-08T21:08:50.529 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 132/162 2024-05-08T21:08:50.529 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librbd1-2:18.2.2-1322.gd21e4f96.el8.x86_64 133/162 2024-05-08T21:08:50.529 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 134/162 2024-05-08T21:08:50.529 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 135/162 2024-05-08T21:08:50.530 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : elfutils-libelf-0.186-1.el8.x86_64 136/162 2024-05-08T21:08:50.530 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 137/162 2024-05-08T21:08:50.530 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : elfutils-libs-0.186-1.el8.x86_64 138/162 2024-05-08T21:08:50.530 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : iproute-6.2.0-5.el8_9.x86_64 139/162 2024-05-08T21:08:50.530 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 140/162 2024-05-08T21:08:50.530 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : openssl-1:1.1.1k-12.el8_9.x86_64 141/162 2024-05-08T21:08:50.530 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 142/162 2024-05-08T21:08:50.530 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8_9.x86_64 143/162 2024-05-08T21:08:50.530 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 144/162 2024-05-08T21:08:50.530 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : xfsdump-3.1.8-7.el8_9.x86_64 145/162 2024-05-08T21:08:50.530 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 146/162 2024-05-08T21:08:50.530 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 147/162 2024-05-08T21:08:50.530 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 148/162 2024-05-08T21:08:50.531 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libblkid-2.32.1-44.el8_9.1.x86_64 149/162 2024-05-08T21:08:50.531 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libblkid-2.32.1-35.el8.x86_64 150/162 2024-05-08T21:08:50.531 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libfdisk-2.32.1-44.el8_9.1.x86_64 151/162 2024-05-08T21:08:50.531 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libfdisk-2.32.1-35.el8.x86_64 152/162 2024-05-08T21:08:50.531 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libmount-2.32.1-44.el8_9.1.x86_64 153/162 2024-05-08T21:08:50.531 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libmount-2.32.1-35.el8.x86_64 154/162 2024-05-08T21:08:50.531 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libsmartcols-2.32.1-44.el8_9.1.x86_64 155/162 2024-05-08T21:08:50.531 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libsmartcols-2.32.1-35.el8.x86_64 156/162 2024-05-08T21:08:50.531 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libuuid-2.32.1-44.el8_9.1.x86_64 157/162 2024-05-08T21:08:50.531 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libuuid-2.32.1-35.el8.x86_64 158/162 2024-05-08T21:08:50.531 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : util-linux-2.32.1-44.el8_9.1.x86_64 159/162 2024-05-08T21:08:50.531 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : util-linux-2.32.1-35.el8.x86_64 160/162 2024-05-08T21:08:50.531 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : util-linux-user-2.32.1-44.el8_9.1.x86_64 161/162 2024-05-08T21:08:51.259 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 162/162 2024-05-08T21:08:51.259 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-2:18.2.2-1322.gd21e4f96.el8.x86_64 1/162 2024-05-08T21:08:51.259 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-base-2:18.2.2-1322.gd21e4f96.el8.x86_64 2/162 2024-05-08T21:08:51.259 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 3/162 2024-05-08T21:08:51.259 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 4/162 2024-05-08T21:08:51.259 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1322.gd21e4 5/162 2024-05-08T21:08:51.259 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mds-2:18.2.2-1322.gd21e4f96.el8.x86_64 6/162 2024-05-08T21:08:51.259 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mgr-2:18.2.2-1322.gd21e4f96.el8.x86_64 7/162 2024-05-08T21:08:51.260 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mon-2:18.2.2-1322.gd21e4f96.el8.x86_64 8/162 2024-05-08T21:08:51.260 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-osd-2:18.2.2-1322.gd21e4f96.el8.x86_64 9/162 2024-05-08T21:08:51.260 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-radosgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 10/162 2024-05-08T21:08:51.260 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-selinux-2:18.2.2-1322.gd21e4f96.el8.x86_64 11/162 2024-05-08T21:08:51.260 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-test-2:18.2.2-1322.gd21e4f96.el8.x86_64 12/162 2024-05-08T21:08:51.260 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : cephfs-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 13/162 2024-05-08T21:08:51.260 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libcephfs-devel-2:18.2.2-1322.gd21e4f96.el8.x86_ 14/162 2024-05-08T21:08:51.260 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libcephfs2-2:18.2.2-1322.gd21e4f96.el8.x86_64 15/162 2024-05-08T21:08:51.260 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libcephsqlite-2:18.2.2-1322.gd21e4f96.el8.x86_64 16/162 2024-05-08T21:08:51.260 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librados-devel-2:18.2.2-1322.gd21e4f96.el8.x86_6 17/162 2024-05-08T21:08:51.260 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libradosstriper1-2:18.2.2-1322.gd21e4f96.el8.x86 18/162 2024-05-08T21:08:51.260 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librgw2-2:18.2.2-1322.gd21e4f96.el8.x86_64 19/162 2024-05-08T21:08:51.260 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1322.gd21e4f96.el 20/162 2024-05-08T21:08:51.261 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-ceph-common-2:18.2.2-1322.gd21e4f96.el8. 21/162 2024-05-08T21:08:51.261 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cephfs-2:18.2.2-1322.gd21e4f96.el8.x86_6 22/162 2024-05-08T21:08:51.261 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-rados-2:18.2.2-1322.gd21e4f96.el8.x86_64 23/162 2024-05-08T21:08:51.261 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-rbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 24/162 2024-05-08T21:08:51.261 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-rgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 25/162 2024-05-08T21:08:51.261 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : rbd-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 26/162 2024-05-08T21:08:51.261 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : rbd-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 27/162 2024-05-08T21:08:51.261 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : rbd-nbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 28/162 2024-05-08T21:08:51.261 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1322.gd21e4f96. 29/162 2024-05-08T21:08:51.261 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1322.gd21e4f96.el8.noa 30/162 2024-05-08T21:08:51.273 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1322.gd21e4f96.el8.n 31/162 2024-05-08T21:08:51.273 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1322.gd21 32/162 2024-05-08T21:08:51.273 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1322.gd21e4f96.el 33/162 2024-05-08T21:08:51.273 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1322.gd21e4f96.el8.noarch 34/162 2024-05-08T21:08:51.273 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1322.gd21e4f96.e 35/162 2024-05-08T21:08:51.274 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-volume-2:18.2.2-1322.gd21e4f96.el8.noarch 36/162 2024-05-08T21:08:51.274 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 37/162 2024-05-08T21:08:51.274 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : cephfs-top-2:18.2.2-1322.gd21e4f96.el8.noarch 38/162 2024-05-08T21:08:51.274 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/162 2024-05-08T21:08:51.274 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/162 2024-05-08T21:08:51.274 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/162 2024-05-08T21:08:51.274 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/162 2024-05-08T21:08:51.274 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/162 2024-05-08T21:08:51.274 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/162 2024-05-08T21:08:51.274 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/162 2024-05-08T21:08:51.274 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/162 2024-05-08T21:08:51.274 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/162 2024-05-08T21:08:51.274 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/162 2024-05-08T21:08:51.275 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/162 2024-05-08T21:08:51.275 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/162 2024-05-08T21:08:51.275 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/162 2024-05-08T21:08:51.275 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/162 2024-05-08T21:08:51.275 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/162 2024-05-08T21:08:51.275 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/162 2024-05-08T21:08:51.275 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/162 2024-05-08T21:08:51.275 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/162 2024-05-08T21:08:51.275 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/162 2024-05-08T21:08:51.275 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/162 2024-05-08T21:08:51.275 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/162 2024-05-08T21:08:51.275 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/162 2024-05-08T21:08:51.275 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/162 2024-05-08T21:08:51.276 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/162 2024-05-08T21:08:51.276 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/162 2024-05-08T21:08:51.276 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/162 2024-05-08T21:08:51.276 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/162 2024-05-08T21:08:51.276 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/162 2024-05-08T21:08:51.276 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/162 2024-05-08T21:08:51.276 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/162 2024-05-08T21:08:51.276 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/162 2024-05-08T21:08:51.276 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/162 2024-05-08T21:08:51.276 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/162 2024-05-08T21:08:51.276 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 72/162 2024-05-08T21:08:51.276 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 73/162 2024-05-08T21:08:51.276 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 74/162 2024-05-08T21:08:51.276 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 75/162 2024-05-08T21:08:51.277 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 76/162 2024-05-08T21:08:51.277 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 77/162 2024-05-08T21:08:51.277 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 78/162 2024-05-08T21:08:51.277 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 79/162 2024-05-08T21:08:51.277 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/162 2024-05-08T21:08:51.277 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 81/162 2024-05-08T21:08:51.277 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 82/162 2024-05-08T21:08:51.277 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 83/162 2024-05-08T21:08:51.277 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 84/162 2024-05-08T21:08:51.277 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 85/162 2024-05-08T21:08:51.277 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 86/162 2024-05-08T21:08:51.277 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 87/162 2024-05-08T21:08:51.277 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 88/162 2024-05-08T21:08:51.277 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 89/162 2024-05-08T21:08:51.278 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 90/162 2024-05-08T21:08:51.278 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 91/162 2024-05-08T21:08:51.278 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 92/162 2024-05-08T21:08:51.278 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : krb5-devel-1.18.2-26.el8_9.x86_64 93/162 2024-05-08T21:08:51.278 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8_9.x86_64 94/162 2024-05-08T21:08:51.278 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librabbitmq-0.9.0-5.el8_9.x86_64 95/162 2024-05-08T21:08:51.278 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cryptography-3.2.1-7.el8_9.x86_64 96/162 2024-05-08T21:08:51.278 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-15.e 97/162 2024-05-08T21:08:51.278 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libuuid-devel-2.32.1-44.el8_9.1.x86_64 98/162 2024-05-08T21:08:51.278 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-packaging-16.8-9.el8.noarch 99/162 2024-05-08T21:08:51.278 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 100/162 2024-05-08T21:08:51.278 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 101/162 2024-05-08T21:08:51.279 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 102/162 2024-05-08T21:08:51.279 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 103/162 2024-05-08T21:08:51.279 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 104/162 2024-05-08T21:08:51.279 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 105/162 2024-05-08T21:08:51.279 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : bison-3.0.4-10.el8.x86_64 106/162 2024-05-08T21:08:51.279 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : flex-2.6.1-9.el8.x86_64 107/162 2024-05-08T21:08:51.279 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 108/162 2024-05-08T21:08:51.279 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 109/162 2024-05-08T21:08:51.279 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 110/162 2024-05-08T21:08:51.279 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 111/162 2024-05-08T21:08:51.279 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 112/162 2024-05-08T21:08:51.279 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 113/162 2024-05-08T21:08:51.279 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 114/162 2024-05-08T21:08:51.279 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 115/162 2024-05-08T21:08:51.279 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 116/162 2024-05-08T21:08:51.280 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 117/162 2024-05-08T21:08:51.280 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 118/162 2024-05-08T21:08:51.280 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : openblas-threads-0.3.15-6.el8.x86_64 119/162 2024-05-08T21:08:51.280 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 120/162 2024-05-08T21:08:51.280 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : openblas-0.3.15-6.el8.x86_64 121/162 2024-05-08T21:08:51.280 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : automake-1.16.1-8.el8.noarch 122/162 2024-05-08T21:08:51.280 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libpq-13.11-1.el8.x86_64 123/162 2024-05-08T21:08:51.280 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : jq-1.6-7.el8.x86_64 124/162 2024-05-08T21:08:51.280 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 125/162 2024-05-08T21:08:51.280 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 126/162 2024-05-08T21:08:51.280 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : oniguruma-6.8.2-2.1.el8_9.x86_64 127/162 2024-05-08T21:08:51.280 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a 128/162 2024-05-08T21:08:51.280 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : postgresql-contrib-10.23-4.module+el8.9.0+21317+ 129/162 2024-05-08T21:08:51.280 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : postgresql-server-10.23-4.module+el8.9.0+21317+d 130/162 2024-05-08T21:08:51.281 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librados2-2:18.2.2-1322.gd21e4f96.el8.x86_64 131/162 2024-05-08T21:08:51.281 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 132/162 2024-05-08T21:08:51.281 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librbd1-2:18.2.2-1322.gd21e4f96.el8.x86_64 133/162 2024-05-08T21:08:51.281 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 134/162 2024-05-08T21:08:51.281 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 135/162 2024-05-08T21:08:51.281 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : elfutils-libelf-0.186-1.el8.x86_64 136/162 2024-05-08T21:08:51.281 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 137/162 2024-05-08T21:08:51.281 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : elfutils-libs-0.186-1.el8.x86_64 138/162 2024-05-08T21:08:51.281 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : iproute-6.2.0-5.el8_9.x86_64 139/162 2024-05-08T21:08:51.281 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 140/162 2024-05-08T21:08:51.281 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : openssl-1:1.1.1k-12.el8_9.x86_64 141/162 2024-05-08T21:08:51.281 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 142/162 2024-05-08T21:08:51.281 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8_9.x86_64 143/162 2024-05-08T21:08:51.281 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 144/162 2024-05-08T21:08:51.282 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : xfsdump-3.1.8-7.el8_9.x86_64 145/162 2024-05-08T21:08:51.282 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 146/162 2024-05-08T21:08:51.282 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 147/162 2024-05-08T21:08:51.282 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 148/162 2024-05-08T21:08:51.282 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libblkid-2.32.1-44.el8_9.1.x86_64 149/162 2024-05-08T21:08:51.282 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libblkid-2.32.1-35.el8.x86_64 150/162 2024-05-08T21:08:51.282 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libfdisk-2.32.1-44.el8_9.1.x86_64 151/162 2024-05-08T21:08:51.282 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libfdisk-2.32.1-35.el8.x86_64 152/162 2024-05-08T21:08:51.282 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libmount-2.32.1-44.el8_9.1.x86_64 153/162 2024-05-08T21:08:51.282 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libmount-2.32.1-35.el8.x86_64 154/162 2024-05-08T21:08:51.282 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libsmartcols-2.32.1-44.el8_9.1.x86_64 155/162 2024-05-08T21:08:51.282 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libsmartcols-2.32.1-35.el8.x86_64 156/162 2024-05-08T21:08:51.282 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libuuid-2.32.1-44.el8_9.1.x86_64 157/162 2024-05-08T21:08:51.282 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libuuid-2.32.1-35.el8.x86_64 158/162 2024-05-08T21:08:51.283 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : util-linux-2.32.1-44.el8_9.1.x86_64 159/162 2024-05-08T21:08:51.283 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : util-linux-2.32.1-35.el8.x86_64 160/162 2024-05-08T21:08:51.283 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : util-linux-user-2.32.1-44.el8_9.1.x86_64 161/162 2024-05-08T21:09:06.543 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : util-linux-user-2.32.1-35.el8.x86_64 162/162 2024-05-08T21:09:06.544 INFO:teuthology.orchestra.run.smithi106.stdout:Installed products updated. 2024-05-08T21:09:06.694 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : util-linux-user-2.32.1-35.el8.x86_64 162/162 2024-05-08T21:09:06.694 INFO:teuthology.orchestra.run.smithi080.stdout:Installed products updated. 2024-05-08T21:09:07.803 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-08T21:09:07.803 INFO:teuthology.orchestra.run.smithi106.stdout:Upgraded: 2024-05-08T21:09:07.803 INFO:teuthology.orchestra.run.smithi106.stdout: elfutils-libelf-0.189-3.el8.x86_64 2024-05-08T21:09:07.803 INFO:teuthology.orchestra.run.smithi106.stdout: elfutils-libs-0.189-3.el8.x86_64 2024-05-08T21:09:07.803 INFO:teuthology.orchestra.run.smithi106.stdout: iproute-6.2.0-5.el8_9.x86_64 2024-05-08T21:09:07.803 INFO:teuthology.orchestra.run.smithi106.stdout: libblkid-2.32.1-44.el8_9.1.x86_64 2024-05-08T21:09:07.803 INFO:teuthology.orchestra.run.smithi106.stdout: libfdisk-2.32.1-44.el8_9.1.x86_64 2024-05-08T21:09:07.804 INFO:teuthology.orchestra.run.smithi106.stdout: libmount-2.32.1-44.el8_9.1.x86_64 2024-05-08T21:09:07.804 INFO:teuthology.orchestra.run.smithi106.stdout: librados2-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:09:07.804 INFO:teuthology.orchestra.run.smithi106.stdout: librbd1-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:09:07.804 INFO:teuthology.orchestra.run.smithi106.stdout: libsmartcols-2.32.1-44.el8_9.1.x86_64 2024-05-08T21:09:07.804 INFO:teuthology.orchestra.run.smithi106.stdout: libuuid-2.32.1-44.el8_9.1.x86_64 2024-05-08T21:09:07.804 INFO:teuthology.orchestra.run.smithi106.stdout: openssl-1:1.1.1k-12.el8_9.x86_64 2024-05-08T21:09:07.804 INFO:teuthology.orchestra.run.smithi106.stdout: openssl-libs-1:1.1.1k-12.el8_9.x86_64 2024-05-08T21:09:07.804 INFO:teuthology.orchestra.run.smithi106.stdout: util-linux-2.32.1-44.el8_9.1.x86_64 2024-05-08T21:09:07.804 INFO:teuthology.orchestra.run.smithi106.stdout: util-linux-user-2.32.1-44.el8_9.1.x86_64 2024-05-08T21:09:07.804 INFO:teuthology.orchestra.run.smithi106.stdout: xfsdump-3.1.8-7.el8_9.x86_64 2024-05-08T21:09:07.804 INFO:teuthology.orchestra.run.smithi106.stdout: xfsprogs-5.0.0-12.el8.x86_64 2024-05-08T21:09:07.804 INFO:teuthology.orchestra.run.smithi106.stdout:Installed: 2024-05-08T21:09:07.804 INFO:teuthology.orchestra.run.smithi106.stdout: NetworkManager-initscripts-updown-1:1.40.16-15.el8_9.noarch 2024-05-08T21:09:07.804 INFO:teuthology.orchestra.run.smithi106.stdout: automake-1.16.1-8.el8.noarch 2024-05-08T21:09:07.805 INFO:teuthology.orchestra.run.smithi106.stdout: bison-3.0.4-10.el8.x86_64 2024-05-08T21:09:07.805 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:09:07.805 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-base-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:09:07.805 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:09:07.805 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:09:07.805 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-grafana-dashboards-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T21:09:07.805 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-immutable-object-cache-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:09:07.805 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mds-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:09:07.805 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:09:07.805 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T21:09:07.805 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-dashboard-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T21:09:07.805 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T21:09:07.805 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-modules-core-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T21:09:07.805 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-rook-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T21:09:07.806 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mon-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:09:07.806 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-osd-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:09:07.806 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-prometheus-alerts-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T21:09:07.806 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-radosgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:09:07.806 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-selinux-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:09:07.806 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-test-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:09:07.806 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-volume-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T21:09:07.806 INFO:teuthology.orchestra.run.smithi106.stdout: cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T21:09:07.806 INFO:teuthology.orchestra.run.smithi106.stdout: cephfs-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:09:07.806 INFO:teuthology.orchestra.run.smithi106.stdout: cephfs-top-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T21:09:07.806 INFO:teuthology.orchestra.run.smithi106.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2024-05-08T21:09:07.807 INFO:teuthology.orchestra.run.smithi106.stdout: flex-2.6.1-9.el8.x86_64 2024-05-08T21:09:07.807 INFO:teuthology.orchestra.run.smithi106.stdout: fuse-2.9.7-17.el8.x86_64 2024-05-08T21:09:07.807 INFO:teuthology.orchestra.run.smithi106.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-05-08T21:09:07.807 INFO:teuthology.orchestra.run.smithi106.stdout: jq-1.6-7.el8.x86_64 2024-05-08T21:09:07.807 INFO:teuthology.orchestra.run.smithi106.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-05-08T21:09:07.807 INFO:teuthology.orchestra.run.smithi106.stdout: krb5-devel-1.18.2-26.el8_9.x86_64 2024-05-08T21:09:07.807 INFO:teuthology.orchestra.run.smithi106.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-05-08T21:09:07.807 INFO:teuthology.orchestra.run.smithi106.stdout: libcephfs-devel-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:09:07.807 INFO:teuthology.orchestra.run.smithi106.stdout: libcephfs2-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:09:07.807 INFO:teuthology.orchestra.run.smithi106.stdout: libcephsqlite-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:09:07.807 INFO:teuthology.orchestra.run.smithi106.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2024-05-08T21:09:07.807 INFO:teuthology.orchestra.run.smithi106.stdout: libgfortran-8.5.0-20.el8.x86_64 2024-05-08T21:09:07.807 INFO:teuthology.orchestra.run.smithi106.stdout: liboath-2.6.2-3.el8.x86_64 2024-05-08T21:09:07.808 INFO:teuthology.orchestra.run.smithi106.stdout: libpq-13.11-1.el8.x86_64 2024-05-08T21:09:07.808 INFO:teuthology.orchestra.run.smithi106.stdout: libquadmath-8.5.0-20.el8.x86_64 2024-05-08T21:09:07.808 INFO:teuthology.orchestra.run.smithi106.stdout: librabbitmq-0.9.0-5.el8_9.x86_64 2024-05-08T21:09:07.808 INFO:teuthology.orchestra.run.smithi106.stdout: librados-devel-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:09:07.808 INFO:teuthology.orchestra.run.smithi106.stdout: libradosstriper1-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:09:07.808 INFO:teuthology.orchestra.run.smithi106.stdout: librdkafka-0.11.4-3.el8.x86_64 2024-05-08T21:09:07.808 INFO:teuthology.orchestra.run.smithi106.stdout: librgw2-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:09:07.808 INFO:teuthology.orchestra.run.smithi106.stdout: libselinux-devel-2.9-5.el8.x86_64 2024-05-08T21:09:07.808 INFO:teuthology.orchestra.run.smithi106.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-05-08T21:09:07.808 INFO:teuthology.orchestra.run.smithi106.stdout: libtool-2.4.6-25.el8.x86_64 2024-05-08T21:09:07.808 INFO:teuthology.orchestra.run.smithi106.stdout: libunwind-1.3.1-3.el8.x86_64 2024-05-08T21:09:07.808 INFO:teuthology.orchestra.run.smithi106.stdout: libuuid-devel-2.32.1-44.el8_9.1.x86_64 2024-05-08T21:09:07.808 INFO:teuthology.orchestra.run.smithi106.stdout: libverto-devel-0.3.0-5.el8.x86_64 2024-05-08T21:09:07.809 INFO:teuthology.orchestra.run.smithi106.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-05-08T21:09:07.809 INFO:teuthology.orchestra.run.smithi106.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-05-08T21:09:07.809 INFO:teuthology.orchestra.run.smithi106.stdout: oniguruma-6.8.2-2.1.el8_9.x86_64 2024-05-08T21:09:07.809 INFO:teuthology.orchestra.run.smithi106.stdout: openblas-0.3.15-6.el8.x86_64 2024-05-08T21:09:07.809 INFO:teuthology.orchestra.run.smithi106.stdout: openblas-threads-0.3.15-6.el8.x86_64 2024-05-08T21:09:07.809 INFO:teuthology.orchestra.run.smithi106.stdout: openssl-devel-1:1.1.1k-12.el8_9.x86_64 2024-05-08T21:09:07.809 INFO:teuthology.orchestra.run.smithi106.stdout: pcre2-devel-10.32-2.el8.x86_64 2024-05-08T21:09:07.809 INFO:teuthology.orchestra.run.smithi106.stdout: pcre2-utf16-10.32-2.el8.x86_64 2024-05-08T21:09:07.809 INFO:teuthology.orchestra.run.smithi106.stdout: pcre2-utf32-10.32-2.el8.x86_64 2024-05-08T21:09:07.809 INFO:teuthology.orchestra.run.smithi106.stdout: postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-05-08T21:09:07.809 INFO:teuthology.orchestra.run.smithi106.stdout: postgresql-contrib-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-05-08T21:09:07.809 INFO:teuthology.orchestra.run.smithi106.stdout: postgresql-server-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-05-08T21:09:07.809 INFO:teuthology.orchestra.run.smithi106.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-05-08T21:09:07.810 INFO:teuthology.orchestra.run.smithi106.stdout: python3-babel-2.5.1-7.el8.noarch 2024-05-08T21:09:07.810 INFO:teuthology.orchestra.run.smithi106.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-05-08T21:09:07.810 INFO:teuthology.orchestra.run.smithi106.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-05-08T21:09:07.810 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-05-08T21:09:07.810 INFO:teuthology.orchestra.run.smithi106.stdout: python3-ceph-argparse-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:09:07.810 INFO:teuthology.orchestra.run.smithi106.stdout: python3-ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:09:07.810 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cephfs-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:09:07.810 INFO:teuthology.orchestra.run.smithi106.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-05-08T21:09:07.810 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-05-08T21:09:07.810 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-05-08T21:09:07.810 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-05-08T21:09:07.810 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cryptography-3.2.1-7.el8_9.x86_64 2024-05-08T21:09:07.811 INFO:teuthology.orchestra.run.smithi106.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-05-08T21:09:07.811 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco-6.2-6.el8.noarch 2024-05-08T21:09:07.811 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-05-08T21:09:07.811 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jinja2-2.10.1-3.el8.noarch 2024-05-08T21:09:07.811 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-05-08T21:09:07.811 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-05-08T21:09:07.811 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-05-08T21:09:07.811 INFO:teuthology.orchestra.run.smithi106.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-05-08T21:09:07.811 INFO:teuthology.orchestra.run.smithi106.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-05-08T21:09:07.811 INFO:teuthology.orchestra.run.smithi106.stdout: python3-mako-1.0.6-14.el8.noarch 2024-05-08T21:09:07.811 INFO:teuthology.orchestra.run.smithi106.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-05-08T21:09:07.812 INFO:teuthology.orchestra.run.smithi106.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-05-08T21:09:07.812 INFO:teuthology.orchestra.run.smithi106.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-05-08T21:09:07.812 INFO:teuthology.orchestra.run.smithi106.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-05-08T21:09:07.812 INFO:teuthology.orchestra.run.smithi106.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-05-08T21:09:07.812 INFO:teuthology.orchestra.run.smithi106.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-05-08T21:09:07.812 INFO:teuthology.orchestra.run.smithi106.stdout: python3-packaging-16.8-9.el8.noarch 2024-05-08T21:09:07.812 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-05-08T21:09:07.812 INFO:teuthology.orchestra.run.smithi106.stdout: python3-portend-2.6-1.el8.noarch 2024-05-08T21:09:07.812 INFO:teuthology.orchestra.run.smithi106.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-05-08T21:09:07.812 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-05-08T21:09:07.812 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-05-08T21:09:07.812 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-05-08T21:09:07.812 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pycparser-2.14-14.el8.noarch 2024-05-08T21:09:07.812 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pytz-2017.2-11.el8.noarch 2024-05-08T21:09:07.812 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rados-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:09:07.813 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:09:07.813 INFO:teuthology.orchestra.run.smithi106.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-05-08T21:09:07.813 INFO:teuthology.orchestra.run.smithi106.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-05-08T21:09:07.813 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:09:07.813 INFO:teuthology.orchestra.run.smithi106.stdout: python3-routes-2.4.1-12.el8.noarch 2024-05-08T21:09:07.813 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rsa-4.9-2.el8.noarch 2024-05-08T21:09:07.813 INFO:teuthology.orchestra.run.smithi106.stdout: python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c38525.x86_64 2024-05-08T21:09:07.813 INFO:teuthology.orchestra.run.smithi106.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-05-08T21:09:07.813 INFO:teuthology.orchestra.run.smithi106.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-05-08T21:09:07.813 INFO:teuthology.orchestra.run.smithi106.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-05-08T21:09:07.813 INFO:teuthology.orchestra.run.smithi106.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-05-08T21:09:07.813 INFO:teuthology.orchestra.run.smithi106.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-05-08T21:09:07.813 INFO:teuthology.orchestra.run.smithi106.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-05-08T21:09:07.813 INFO:teuthology.orchestra.run.smithi106.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-05-08T21:09:07.814 INFO:teuthology.orchestra.run.smithi106.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-05-08T21:09:07.814 INFO:teuthology.orchestra.run.smithi106.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-05-08T21:09:07.814 INFO:teuthology.orchestra.run.smithi106.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-05-08T21:09:07.814 INFO:teuthology.orchestra.run.smithi106.stdout: rbd-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:09:07.814 INFO:teuthology.orchestra.run.smithi106.stdout: rbd-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:09:07.814 INFO:teuthology.orchestra.run.smithi106.stdout: rbd-nbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:09:07.814 INFO:teuthology.orchestra.run.smithi106.stdout: socat-1.7.4.1-1.el8.x86_64 2024-05-08T21:09:07.814 INFO:teuthology.orchestra.run.smithi106.stdout: thrift-0.13.0-2.el8.x86_64 2024-05-08T21:09:07.814 INFO:teuthology.orchestra.run.smithi106.stdout: uuid-1.6.2-43.el8.x86_64 2024-05-08T21:09:07.814 INFO:teuthology.orchestra.run.smithi106.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2024-05-08T21:09:07.814 INFO:teuthology.orchestra.run.smithi106.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-05-08T21:09:07.815 INFO:teuthology.orchestra.run.smithi106.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2024-05-08T21:09:07.815 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-08T21:09:07.815 INFO:teuthology.orchestra.run.smithi106.stdout:Complete! 2024-05-08T21:09:08.013 DEBUG:teuthology.parallel:result is None 2024-05-08T21:09:08.041 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:09:08.041 INFO:teuthology.orchestra.run.smithi080.stdout:Upgraded: 2024-05-08T21:09:08.041 INFO:teuthology.orchestra.run.smithi080.stdout: elfutils-libelf-0.189-3.el8.x86_64 2024-05-08T21:09:08.041 INFO:teuthology.orchestra.run.smithi080.stdout: elfutils-libs-0.189-3.el8.x86_64 2024-05-08T21:09:08.041 INFO:teuthology.orchestra.run.smithi080.stdout: iproute-6.2.0-5.el8_9.x86_64 2024-05-08T21:09:08.041 INFO:teuthology.orchestra.run.smithi080.stdout: libblkid-2.32.1-44.el8_9.1.x86_64 2024-05-08T21:09:08.042 INFO:teuthology.orchestra.run.smithi080.stdout: libfdisk-2.32.1-44.el8_9.1.x86_64 2024-05-08T21:09:08.042 INFO:teuthology.orchestra.run.smithi080.stdout: libmount-2.32.1-44.el8_9.1.x86_64 2024-05-08T21:09:08.042 INFO:teuthology.orchestra.run.smithi080.stdout: librados2-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:09:08.042 INFO:teuthology.orchestra.run.smithi080.stdout: librbd1-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:09:08.042 INFO:teuthology.orchestra.run.smithi080.stdout: libsmartcols-2.32.1-44.el8_9.1.x86_64 2024-05-08T21:09:08.042 INFO:teuthology.orchestra.run.smithi080.stdout: libuuid-2.32.1-44.el8_9.1.x86_64 2024-05-08T21:09:08.042 INFO:teuthology.orchestra.run.smithi080.stdout: openssl-1:1.1.1k-12.el8_9.x86_64 2024-05-08T21:09:08.042 INFO:teuthology.orchestra.run.smithi080.stdout: openssl-libs-1:1.1.1k-12.el8_9.x86_64 2024-05-08T21:09:08.042 INFO:teuthology.orchestra.run.smithi080.stdout: util-linux-2.32.1-44.el8_9.1.x86_64 2024-05-08T21:09:08.042 INFO:teuthology.orchestra.run.smithi080.stdout: util-linux-user-2.32.1-44.el8_9.1.x86_64 2024-05-08T21:09:08.042 INFO:teuthology.orchestra.run.smithi080.stdout: xfsdump-3.1.8-7.el8_9.x86_64 2024-05-08T21:09:08.043 INFO:teuthology.orchestra.run.smithi080.stdout: xfsprogs-5.0.0-12.el8.x86_64 2024-05-08T21:09:08.043 INFO:teuthology.orchestra.run.smithi080.stdout:Installed: 2024-05-08T21:09:08.043 INFO:teuthology.orchestra.run.smithi080.stdout: NetworkManager-initscripts-updown-1:1.40.16-15.el8_9.noarch 2024-05-08T21:09:08.043 INFO:teuthology.orchestra.run.smithi080.stdout: automake-1.16.1-8.el8.noarch 2024-05-08T21:09:08.043 INFO:teuthology.orchestra.run.smithi080.stdout: bison-3.0.4-10.el8.x86_64 2024-05-08T21:09:08.043 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:09:08.043 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-base-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:09:08.043 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:09:08.043 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:09:08.043 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-grafana-dashboards-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T21:09:08.043 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-immutable-object-cache-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:09:08.043 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mds-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:09:08.043 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:09:08.043 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T21:09:08.044 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-dashboard-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T21:09:08.044 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T21:09:08.044 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-modules-core-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T21:09:08.044 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-rook-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T21:09:08.044 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mon-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:09:08.044 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-osd-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:09:08.044 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-prometheus-alerts-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T21:09:08.044 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-radosgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:09:08.044 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-selinux-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:09:08.044 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-test-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:09:08.044 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-volume-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T21:09:08.044 INFO:teuthology.orchestra.run.smithi080.stdout: cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T21:09:08.044 INFO:teuthology.orchestra.run.smithi080.stdout: cephfs-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:09:08.044 INFO:teuthology.orchestra.run.smithi080.stdout: cephfs-top-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T21:09:08.044 INFO:teuthology.orchestra.run.smithi080.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2024-05-08T21:09:08.045 INFO:teuthology.orchestra.run.smithi080.stdout: flex-2.6.1-9.el8.x86_64 2024-05-08T21:09:08.045 INFO:teuthology.orchestra.run.smithi080.stdout: fuse-2.9.7-17.el8.x86_64 2024-05-08T21:09:08.045 INFO:teuthology.orchestra.run.smithi080.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-05-08T21:09:08.045 INFO:teuthology.orchestra.run.smithi080.stdout: jq-1.6-7.el8.x86_64 2024-05-08T21:09:08.045 INFO:teuthology.orchestra.run.smithi080.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-05-08T21:09:08.045 INFO:teuthology.orchestra.run.smithi080.stdout: krb5-devel-1.18.2-26.el8_9.x86_64 2024-05-08T21:09:08.045 INFO:teuthology.orchestra.run.smithi080.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-05-08T21:09:08.045 INFO:teuthology.orchestra.run.smithi080.stdout: libcephfs-devel-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:09:08.045 INFO:teuthology.orchestra.run.smithi080.stdout: libcephfs2-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:09:08.045 INFO:teuthology.orchestra.run.smithi080.stdout: libcephsqlite-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:09:08.045 INFO:teuthology.orchestra.run.smithi080.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2024-05-08T21:09:08.045 INFO:teuthology.orchestra.run.smithi080.stdout: libgfortran-8.5.0-20.el8.x86_64 2024-05-08T21:09:08.045 INFO:teuthology.orchestra.run.smithi080.stdout: liboath-2.6.2-3.el8.x86_64 2024-05-08T21:09:08.045 INFO:teuthology.orchestra.run.smithi080.stdout: libpq-13.11-1.el8.x86_64 2024-05-08T21:09:08.046 INFO:teuthology.orchestra.run.smithi080.stdout: libquadmath-8.5.0-20.el8.x86_64 2024-05-08T21:09:08.046 INFO:teuthology.orchestra.run.smithi080.stdout: librabbitmq-0.9.0-5.el8_9.x86_64 2024-05-08T21:09:08.046 INFO:teuthology.orchestra.run.smithi080.stdout: librados-devel-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:09:08.046 INFO:teuthology.orchestra.run.smithi080.stdout: libradosstriper1-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:09:08.046 INFO:teuthology.orchestra.run.smithi080.stdout: librdkafka-0.11.4-3.el8.x86_64 2024-05-08T21:09:08.046 INFO:teuthology.orchestra.run.smithi080.stdout: librgw2-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:09:08.046 INFO:teuthology.orchestra.run.smithi080.stdout: libselinux-devel-2.9-5.el8.x86_64 2024-05-08T21:09:08.046 INFO:teuthology.orchestra.run.smithi080.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-05-08T21:09:08.046 INFO:teuthology.orchestra.run.smithi080.stdout: libtool-2.4.6-25.el8.x86_64 2024-05-08T21:09:08.046 INFO:teuthology.orchestra.run.smithi080.stdout: libunwind-1.3.1-3.el8.x86_64 2024-05-08T21:09:08.046 INFO:teuthology.orchestra.run.smithi080.stdout: libuuid-devel-2.32.1-44.el8_9.1.x86_64 2024-05-08T21:09:08.046 INFO:teuthology.orchestra.run.smithi080.stdout: libverto-devel-0.3.0-5.el8.x86_64 2024-05-08T21:09:08.046 INFO:teuthology.orchestra.run.smithi080.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-05-08T21:09:08.047 INFO:teuthology.orchestra.run.smithi080.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-05-08T21:09:08.047 INFO:teuthology.orchestra.run.smithi080.stdout: oniguruma-6.8.2-2.1.el8_9.x86_64 2024-05-08T21:09:08.047 INFO:teuthology.orchestra.run.smithi080.stdout: openblas-0.3.15-6.el8.x86_64 2024-05-08T21:09:08.047 INFO:teuthology.orchestra.run.smithi080.stdout: openblas-threads-0.3.15-6.el8.x86_64 2024-05-08T21:09:08.047 INFO:teuthology.orchestra.run.smithi080.stdout: openssl-devel-1:1.1.1k-12.el8_9.x86_64 2024-05-08T21:09:08.047 INFO:teuthology.orchestra.run.smithi080.stdout: pcre2-devel-10.32-2.el8.x86_64 2024-05-08T21:09:08.047 INFO:teuthology.orchestra.run.smithi080.stdout: pcre2-utf16-10.32-2.el8.x86_64 2024-05-08T21:09:08.047 INFO:teuthology.orchestra.run.smithi080.stdout: pcre2-utf32-10.32-2.el8.x86_64 2024-05-08T21:09:08.047 INFO:teuthology.orchestra.run.smithi080.stdout: postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-05-08T21:09:08.047 INFO:teuthology.orchestra.run.smithi080.stdout: postgresql-contrib-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-05-08T21:09:08.047 INFO:teuthology.orchestra.run.smithi080.stdout: postgresql-server-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-05-08T21:09:08.047 INFO:teuthology.orchestra.run.smithi080.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-05-08T21:09:08.047 INFO:teuthology.orchestra.run.smithi080.stdout: python3-babel-2.5.1-7.el8.noarch 2024-05-08T21:09:08.047 INFO:teuthology.orchestra.run.smithi080.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-05-08T21:09:08.048 INFO:teuthology.orchestra.run.smithi080.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-05-08T21:09:08.048 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-05-08T21:09:08.048 INFO:teuthology.orchestra.run.smithi080.stdout: python3-ceph-argparse-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:09:08.048 INFO:teuthology.orchestra.run.smithi080.stdout: python3-ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:09:08.048 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cephfs-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:09:08.048 INFO:teuthology.orchestra.run.smithi080.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-05-08T21:09:08.048 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-05-08T21:09:08.048 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-05-08T21:09:08.048 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-05-08T21:09:08.048 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cryptography-3.2.1-7.el8_9.x86_64 2024-05-08T21:09:08.048 INFO:teuthology.orchestra.run.smithi080.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-05-08T21:09:08.048 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-6.2-6.el8.noarch 2024-05-08T21:09:08.048 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-05-08T21:09:08.048 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jinja2-2.10.1-3.el8.noarch 2024-05-08T21:09:08.048 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-05-08T21:09:08.049 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-05-08T21:09:08.049 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-05-08T21:09:08.049 INFO:teuthology.orchestra.run.smithi080.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-05-08T21:09:08.049 INFO:teuthology.orchestra.run.smithi080.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-05-08T21:09:08.049 INFO:teuthology.orchestra.run.smithi080.stdout: python3-mako-1.0.6-14.el8.noarch 2024-05-08T21:09:08.049 INFO:teuthology.orchestra.run.smithi080.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-05-08T21:09:08.049 INFO:teuthology.orchestra.run.smithi080.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-05-08T21:09:08.049 INFO:teuthology.orchestra.run.smithi080.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-05-08T21:09:08.049 INFO:teuthology.orchestra.run.smithi080.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-05-08T21:09:08.049 INFO:teuthology.orchestra.run.smithi080.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-05-08T21:09:08.049 INFO:teuthology.orchestra.run.smithi080.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-05-08T21:09:08.049 INFO:teuthology.orchestra.run.smithi080.stdout: python3-packaging-16.8-9.el8.noarch 2024-05-08T21:09:08.049 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-05-08T21:09:08.049 INFO:teuthology.orchestra.run.smithi080.stdout: python3-portend-2.6-1.el8.noarch 2024-05-08T21:09:08.050 INFO:teuthology.orchestra.run.smithi080.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-05-08T21:09:08.050 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-05-08T21:09:08.050 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-05-08T21:09:08.050 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-05-08T21:09:08.050 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pycparser-2.14-14.el8.noarch 2024-05-08T21:09:08.050 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pytz-2017.2-11.el8.noarch 2024-05-08T21:09:08.050 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rados-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:09:08.050 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:09:08.050 INFO:teuthology.orchestra.run.smithi080.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-05-08T21:09:08.050 INFO:teuthology.orchestra.run.smithi080.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-05-08T21:09:08.050 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:09:08.050 INFO:teuthology.orchestra.run.smithi080.stdout: python3-routes-2.4.1-12.el8.noarch 2024-05-08T21:09:08.050 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rsa-4.9-2.el8.noarch 2024-05-08T21:09:08.051 INFO:teuthology.orchestra.run.smithi080.stdout: python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c38525.x86_64 2024-05-08T21:09:08.051 INFO:teuthology.orchestra.run.smithi080.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-05-08T21:09:08.051 INFO:teuthology.orchestra.run.smithi080.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-05-08T21:09:08.051 INFO:teuthology.orchestra.run.smithi080.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-05-08T21:09:08.051 INFO:teuthology.orchestra.run.smithi080.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-05-08T21:09:08.051 INFO:teuthology.orchestra.run.smithi080.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-05-08T21:09:08.051 INFO:teuthology.orchestra.run.smithi080.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-05-08T21:09:08.051 INFO:teuthology.orchestra.run.smithi080.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-05-08T21:09:08.051 INFO:teuthology.orchestra.run.smithi080.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-05-08T21:09:08.051 INFO:teuthology.orchestra.run.smithi080.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-05-08T21:09:08.051 INFO:teuthology.orchestra.run.smithi080.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-05-08T21:09:08.051 INFO:teuthology.orchestra.run.smithi080.stdout: rbd-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:09:08.052 INFO:teuthology.orchestra.run.smithi080.stdout: rbd-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:09:08.052 INFO:teuthology.orchestra.run.smithi080.stdout: rbd-nbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T21:09:08.052 INFO:teuthology.orchestra.run.smithi080.stdout: socat-1.7.4.1-1.el8.x86_64 2024-05-08T21:09:08.052 INFO:teuthology.orchestra.run.smithi080.stdout: thrift-0.13.0-2.el8.x86_64 2024-05-08T21:09:08.052 INFO:teuthology.orchestra.run.smithi080.stdout: uuid-1.6.2-43.el8.x86_64 2024-05-08T21:09:08.052 INFO:teuthology.orchestra.run.smithi080.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2024-05-08T21:09:08.052 INFO:teuthology.orchestra.run.smithi080.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-05-08T21:09:08.052 INFO:teuthology.orchestra.run.smithi080.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2024-05-08T21:09:08.053 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:09:08.053 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-05-08T21:09:08.281 DEBUG:teuthology.parallel:result is None 2024-05-08T21:09:08.282 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T21:09:08.497 DEBUG:teuthology.orchestra.run.smithi080:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-08T21:09:08.521 INFO:teuthology.orchestra.run.smithi080.stdout:18.2.2-1322.gd21e4f96.el8 2024-05-08T21:09:08.521 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1322.gd21e4f96.el8 2024-05-08T21:09:08.521 INFO:teuthology.task.install:The correct ceph version 18.2.2-1322.gd21e4f96 is installed. 2024-05-08T21:09:08.523 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T21:09:08.735 DEBUG:teuthology.orchestra.run.smithi106:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-08T21:09:08.761 INFO:teuthology.orchestra.run.smithi106.stdout:18.2.2-1322.gd21e4f96.el8 2024-05-08T21:09:08.762 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1322.gd21e4f96.el8 2024-05-08T21:09:08.762 INFO:teuthology.task.install:The correct ceph version 18.2.2-1322.gd21e4f96 is installed. 2024-05-08T21:09:08.764 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-08T21:09:08.764 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T21:09:08.764 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-08T21:09:08.807 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-08T21:09:08.807 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-08T21:09:08.852 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-08T21:09:08.852 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T21:09:08.853 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/usr/bin/daemon-helper 2024-05-08T21:09:08.881 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-08T21:09:08.948 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-08T21:09:08.948 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/usr/bin/daemon-helper 2024-05-08T21:09:08.976 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-08T21:09:09.046 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-08T21:09:09.046 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T21:09:09.047 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-08T21:09:09.073 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-08T21:09:09.140 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-08T21:09:09.140 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-08T21:09:09.168 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-08T21:09:09.237 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-08T21:09:09.238 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T21:09:09.238 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/usr/bin/stdin-killer 2024-05-08T21:09:09.265 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-08T21:09:09.332 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-08T21:09:09.332 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/usr/bin/stdin-killer 2024-05-08T21:09:09.361 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-08T21:09:09.428 INFO:teuthology.run_tasks:Running task ceph... 2024-05-08T21:09:09.522 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-05-08T21:09:09.522 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 777 /var/log/ceph 2024-05-08T21:09:09.525 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 777 /var/log/ceph 2024-05-08T21:09:09.552 INFO:tasks.ceph:Disabling ceph logrotate... 2024-05-08T21:09:09.553 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-08T21:09:09.592 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-08T21:09:09.619 INFO:tasks.ceph:Creating extra log directories... 2024-05-08T21:09:09.620 DEBUG:teuthology.orchestra.run.smithi080:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-08T21:09:09.659 DEBUG:teuthology.orchestra.run.smithi106:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-08T21:09:09.694 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-05-08T21:09:09.695 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-05-08T21:09:09.695 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-05-08T21:09:09.695 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T21:09:09.695 DEBUG:teuthology.orchestra.run.smithi080:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-08T21:09:09.739 DEBUG:teuthology.orchestra.run.smithi080:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-08T21:09:09.852 DEBUG:teuthology.orchestra.run.smithi080:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-08T21:09:09.880 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-08T21:09:09.880 DEBUG:teuthology.orchestra.run.smithi106:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-08T21:09:09.896 DEBUG:teuthology.orchestra.run.smithi106:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-08T21:09:10.011 DEBUG:teuthology.orchestra.run.smithi106:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-08T21:09:10.044 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-05-08T21:09:10.044 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': False, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': False, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'filestore flush min': 0, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'Replacing daemon mds', 'SLOW_OPS', 'slow request'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-05-08T21:09:10.044 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698040', 'branch': 'wip-pdonnell-testing-20240508.150423-reef', 'description': 'fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mds 2-workunit/suites/ffsb}}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7698040', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.6', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20240508.150423-reef'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': False, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': False, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'filestore flush min': 0, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'Replacing daemon mds', 'SLOW_OPS', 'slow request'], 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20240508.150423-reef', 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 65, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 2738, 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34', 'sleep_before_teardown': 0, 'subset': '17/512', 'suite': 'fs', 'suite_branch': 'wip-pdonnell-testing-20240508.150423-reef', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_d21e4f961318b56f0d915caa2490c3711bf13c34/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi080.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBALjNiYXrENSLdJzNeatoU+OZ+wcWUhRkop+vWtzVltIN4h4ub1O16LVNnSPsLemTMBwtfRd27qiq4FsPm4nqe8=', 'smithi106.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLdzLzRBvC8gnMmcZLNLn+UGt/CF9RvwErwx33Yy7VZuhsxUSF0rNqzawjqImDrk5gUQR6IdoPURsvCSl5pYtEc='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': False, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': False, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'filestore flush min': 0, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'Replacing daemon mds', 'SLOW_OPS', 'slow request'], 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'mds_thrash': None}, {'workunit': {'clients': {'all': ['suites/ffsb.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '1ae7ad82388e92a475afff437d49054826c019a1', 'timestamp': '2024-05-08_19:22:21', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-05-08T21:09:10.045 DEBUG:teuthology.orchestra.run.smithi080:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-08T21:09:10.047 DEBUG:teuthology.orchestra.run.smithi106:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-08T21:09:10.095 DEBUG:teuthology.orchestra.run.smithi080:> sudo install -d -m0777 -- /var/run/ceph 2024-05-08T21:09:10.104 DEBUG:teuthology.orchestra.run.smithi106:> sudo install -d -m0777 -- /var/run/ceph 2024-05-08T21:09:10.162 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T21:09:10.162 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/scratch_devs of=/dev/stdout 2024-05-08T21:09:10.187 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-08T21:09:10.187 DEBUG:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_1 2024-05-08T21:09:10.244 INFO:teuthology.orchestra.run.smithi080.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-08T21:09:10.244 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T21:09:10.244 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 6h/6d Inode: 180590 Links: 1 2024-05-08T21:09:10.244 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T21:09:10.244 INFO:teuthology.orchestra.run.smithi080.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T21:09:10.244 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2024-05-08 21:08:50.890701840 +0000 2024-05-08T21:09:10.244 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2024-05-08 21:05:19.909433562 +0000 2024-05-08T21:09:10.244 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2024-05-08 21:05:19.909433562 +0000 2024-05-08T21:09:10.245 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: - 2024-05-08T21:09:10.245 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-08T21:09:10.309 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2024-05-08T21:09:10.310 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2024-05-08T21:09:10.310 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes copied, 0.00017884 s, 2.9 MB/s 2024-05-08T21:09:10.311 DEBUG:teuthology.orchestra.run.smithi080:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-08T21:09:10.370 DEBUG:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_2 2024-05-08T21:09:10.427 INFO:teuthology.orchestra.run.smithi080.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-08T21:09:10.427 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T21:09:10.428 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 6h/6d Inode: 180647 Links: 1 2024-05-08T21:09:10.428 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T21:09:10.428 INFO:teuthology.orchestra.run.smithi080.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T21:09:10.428 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2024-05-08 21:08:50.890701840 +0000 2024-05-08T21:09:10.428 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2024-05-08 21:05:20.260425732 +0000 2024-05-08T21:09:10.428 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2024-05-08 21:05:20.260425732 +0000 2024-05-08T21:09:10.428 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: - 2024-05-08T21:09:10.428 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-08T21:09:10.493 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2024-05-08T21:09:10.493 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2024-05-08T21:09:10.493 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes copied, 0.000198654 s, 2.6 MB/s 2024-05-08T21:09:10.494 DEBUG:teuthology.orchestra.run.smithi080:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-08T21:09:10.552 DEBUG:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_3 2024-05-08T21:09:10.609 INFO:teuthology.orchestra.run.smithi080.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-08T21:09:10.609 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T21:09:10.609 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 6h/6d Inode: 181602 Links: 1 2024-05-08T21:09:10.609 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T21:09:10.610 INFO:teuthology.orchestra.run.smithi080.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T21:09:10.610 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2024-05-08 21:08:50.890701840 +0000 2024-05-08T21:09:10.610 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2024-05-08 21:05:20.616417790 +0000 2024-05-08T21:09:10.610 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2024-05-08 21:05:20.616417790 +0000 2024-05-08T21:09:10.610 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: - 2024-05-08T21:09:10.610 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-08T21:09:10.674 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2024-05-08T21:09:10.674 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2024-05-08T21:09:10.674 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes copied, 0.000168057 s, 3.0 MB/s 2024-05-08T21:09:10.675 DEBUG:teuthology.orchestra.run.smithi080:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-08T21:09:10.732 DEBUG:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_4 2024-05-08T21:09:10.789 INFO:teuthology.orchestra.run.smithi080.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-08T21:09:10.790 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T21:09:10.790 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 6h/6d Inode: 178078 Links: 1 2024-05-08T21:09:10.790 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T21:09:10.790 INFO:teuthology.orchestra.run.smithi080.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T21:09:10.790 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2024-05-08 21:08:50.890701840 +0000 2024-05-08T21:09:10.790 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2024-05-08 21:05:20.961410094 +0000 2024-05-08T21:09:10.790 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2024-05-08 21:05:20.961410094 +0000 2024-05-08T21:09:10.790 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: - 2024-05-08T21:09:10.790 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-08T21:09:10.855 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2024-05-08T21:09:10.855 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2024-05-08T21:09:10.855 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes copied, 0.000207635 s, 2.5 MB/s 2024-05-08T21:09:10.856 DEBUG:teuthology.orchestra.run.smithi080:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-08T21:09:10.913 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-08T21:09:10.914 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-08T21:09:10.914 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/scratch_devs of=/dev/stdout 2024-05-08T21:09:10.932 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-08T21:09:10.933 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_1 2024-05-08T21:09:10.991 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-08T21:09:10.991 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T21:09:10.991 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 6h/6d Inode: 179770 Links: 1 2024-05-08T21:09:10.991 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T21:09:10.991 INFO:teuthology.orchestra.run.smithi106.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T21:09:10.991 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2024-05-08 21:08:50.137018396 +0000 2024-05-08T21:09:10.991 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2024-05-08 21:05:15.329820513 +0000 2024-05-08T21:09:10.991 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2024-05-08 21:05:15.329820513 +0000 2024-05-08T21:09:10.991 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: - 2024-05-08T21:09:10.992 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-08T21:09:11.057 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2024-05-08T21:09:11.057 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2024-05-08T21:09:11.057 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000228848 s, 2.2 MB/s 2024-05-08T21:09:11.058 DEBUG:teuthology.orchestra.run.smithi106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-08T21:09:11.117 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_2 2024-05-08T21:09:11.175 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-08T21:09:11.175 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T21:09:11.175 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 6h/6d Inode: 181827 Links: 1 2024-05-08T21:09:11.176 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T21:09:11.176 INFO:teuthology.orchestra.run.smithi106.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T21:09:11.176 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2024-05-08 21:08:50.137018396 +0000 2024-05-08T21:09:11.176 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2024-05-08 21:05:15.677811919 +0000 2024-05-08T21:09:11.176 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2024-05-08 21:05:15.677811919 +0000 2024-05-08T21:09:11.176 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: - 2024-05-08T21:09:11.176 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-08T21:09:11.241 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2024-05-08T21:09:11.242 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2024-05-08T21:09:11.242 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000222193 s, 2.3 MB/s 2024-05-08T21:09:11.243 DEBUG:teuthology.orchestra.run.smithi106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-08T21:09:11.301 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_3 2024-05-08T21:09:11.359 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-08T21:09:11.359 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T21:09:11.359 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 6h/6d Inode: 179811 Links: 1 2024-05-08T21:09:11.359 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T21:09:11.360 INFO:teuthology.orchestra.run.smithi106.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T21:09:11.360 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2024-05-08 21:08:50.137018396 +0000 2024-05-08T21:09:11.360 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2024-05-08 21:05:16.001803918 +0000 2024-05-08T21:09:11.360 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2024-05-08 21:05:16.001803918 +0000 2024-05-08T21:09:11.360 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: - 2024-05-08T21:09:11.360 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-08T21:09:11.425 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2024-05-08T21:09:11.425 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2024-05-08T21:09:11.425 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000181947 s, 2.8 MB/s 2024-05-08T21:09:11.426 DEBUG:teuthology.orchestra.run.smithi106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-08T21:09:11.483 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_4 2024-05-08T21:09:11.540 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-08T21:09:11.540 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T21:09:11.541 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 6h/6d Inode: 179875 Links: 1 2024-05-08T21:09:11.541 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T21:09:11.541 INFO:teuthology.orchestra.run.smithi106.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T21:09:11.541 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2024-05-08 21:08:50.137018396 +0000 2024-05-08T21:09:11.541 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2024-05-08 21:05:16.338795595 +0000 2024-05-08T21:09:11.541 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2024-05-08 21:05:16.338795595 +0000 2024-05-08T21:09:11.541 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: - 2024-05-08T21:09:11.541 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-08T21:09:11.606 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2024-05-08T21:09:11.606 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2024-05-08T21:09:11.606 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000227396 s, 2.3 MB/s 2024-05-08T21:09:11.607 DEBUG:teuthology.orchestra.run.smithi106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-08T21:09:11.667 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-08T21:09:11.667 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi080.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi106.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-08T21:09:11.667 INFO:tasks.ceph:Generating config... 2024-05-08T21:09:11.668 INFO:tasks.ceph:[client] client mount timeout = 600 2024-05-08T21:09:11.668 INFO:tasks.ceph:[client] client_shutdown_timeout = 120 2024-05-08T21:09:11.668 INFO:tasks.ceph:[client] debug client = 20 2024-05-08T21:09:11.669 INFO:tasks.ceph:[client] debug ms = 1 2024-05-08T21:09:11.669 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-05-08T21:09:11.669 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-05-08T21:09:11.669 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-05-08T21:09:11.669 INFO:tasks.ceph:[mds] debug mds = 20 2024-05-08T21:09:11.669 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-05-08T21:09:11.669 INFO:tasks.ceph:[mds] debug ms = 1 2024-05-08T21:09:11.669 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2024-05-08T21:09:11.669 INFO:tasks.ceph:[mds] mds bal merge size = 5 2024-05-08T21:09:11.669 INFO:tasks.ceph:[mds] mds bal split bits = 3 2024-05-08T21:09:11.669 INFO:tasks.ceph:[mds] mds bal split size = 100 2024-05-08T21:09:11.669 INFO:tasks.ceph:[mds] mds debug frag = True 2024-05-08T21:09:11.669 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-05-08T21:09:11.670 INFO:tasks.ceph:[mds] mds oft prefetch dirfrags = False 2024-05-08T21:09:11.670 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-05-08T21:09:11.670 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-05-08T21:09:11.670 INFO:tasks.ceph:[mds] mds_dir_prefetch = False 2024-05-08T21:09:11.670 INFO:tasks.ceph:[mds] mds_sleep_rank_change = 5000000.0 2024-05-08T21:09:11.670 INFO:tasks.ceph:[mds] mon client directed command retry = 5 2024-05-08T21:09:11.670 INFO:tasks.ceph:[mds] ms inject delay max = 1 2024-05-08T21:09:11.670 INFO:tasks.ceph:[mds] ms inject delay probability = 0.005 2024-05-08T21:09:11.670 INFO:tasks.ceph:[mds] ms inject delay type = client mds osd 2024-05-08T21:09:11.670 INFO:tasks.ceph:[mds] ms inject socket failures = 2500 2024-05-08T21:09:11.671 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-05-08T21:09:11.671 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-05-08T21:09:11.671 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-05-08T21:09:11.671 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-05-08T21:09:11.671 INFO:tasks.ceph:[mgr] debug ms = 1 2024-05-08T21:09:11.671 INFO:tasks.ceph:[mon] debug mon = 20 2024-05-08T21:09:11.671 INFO:tasks.ceph:[mon] debug ms = 1 2024-05-08T21:09:11.671 INFO:tasks.ceph:[mon] debug paxos = 20 2024-05-08T21:09:11.671 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-05-08T21:09:11.671 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-05-08T21:09:11.672 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-05-08T21:09:11.672 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-05-08T21:09:11.672 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-05-08T21:09:11.672 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-05-08T21:09:11.672 INFO:tasks.ceph:[osd] debug ms = 1 2024-05-08T21:09:11.672 INFO:tasks.ceph:[osd] debug osd = 20 2024-05-08T21:09:11.672 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-05-08T21:09:11.672 INFO:tasks.ceph:[osd] filestore flush min = 0 2024-05-08T21:09:11.672 INFO:tasks.ceph:[osd] mon client directed command retry = 5 2024-05-08T21:09:11.672 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-05-08T21:09:11.672 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-05-08T21:09:11.672 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-05-08T21:09:11.673 INFO:tasks.ceph:[osd] ms inject delay max = 1 2024-05-08T21:09:11.673 INFO:tasks.ceph:[osd] ms inject delay probability = 0.005 2024-05-08T21:09:11.673 INFO:tasks.ceph:[osd] ms inject delay type = client mds 2024-05-08T21:09:11.673 INFO:tasks.ceph:[osd] ms inject socket failures = 2500 2024-05-08T21:09:11.673 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-05-08T21:09:11.673 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-05-08T21:09:11.673 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-05-08T21:09:11.673 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-05-08T21:09:11.673 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-05-08T21:09:11.674 INFO:tasks.ceph:Setting up mon.a... 2024-05-08T21:09:11.674 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-05-08T21:09:11.731 INFO:teuthology.orchestra.run.smithi080.stdout:creating /etc/ceph/ceph.keyring 2024-05-08T21:09:11.734 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-05-08T21:09:11.788 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-08T21:09:11.819 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.80'), ('mon.b', '172.21.15.106'), ('mon.c', '[v2:172.21.15.106:3301,v1:172.21.15.106:6790]')] 2024-05-08T21:09:11.820 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.80,172.21.15.106,[v2:172.21.15.106:3301,v1:172.21.15.106:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'filestore flush min': 0, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': False, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': False, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-05-08T21:09:11.821 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T21:09:11.821 DEBUG:teuthology.orchestra.run.smithi080:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-05-08T21:09:11.879 DEBUG:teuthology.orchestra.run.smithi080:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.80 --add b 172.21.15.106 --addv c '[v2:172.21.15.106:3301,v1:172.21.15.106:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-05-08T21:09:11.974 INFO:teuthology.orchestra.run.smithi080.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-05-08T21:09:11.974 INFO:teuthology.orchestra.run.smithi080.stdout:monmaptool: generated fsid 44d31c1e-aad3-47ca-a4fa-85a63d4a60aa 2024-05-08T21:09:11.974 INFO:teuthology.orchestra.run.smithi080.stdout:setting min_mon_release = pacific 2024-05-08T21:09:11.974 INFO:teuthology.orchestra.run.smithi080.stdout:epoch 0 2024-05-08T21:09:11.974 INFO:teuthology.orchestra.run.smithi080.stdout:fsid 44d31c1e-aad3-47ca-a4fa-85a63d4a60aa 2024-05-08T21:09:11.974 INFO:teuthology.orchestra.run.smithi080.stdout:last_changed 2024-05-08T21:09:11.972128+0000 2024-05-08T21:09:11.974 INFO:teuthology.orchestra.run.smithi080.stdout:created 2024-05-08T21:09:11.972128+0000 2024-05-08T21:09:11.975 INFO:teuthology.orchestra.run.smithi080.stdout:min_mon_release 16 (pacific) 2024-05-08T21:09:11.975 INFO:teuthology.orchestra.run.smithi080.stdout:election_strategy: 1 2024-05-08T21:09:11.975 INFO:teuthology.orchestra.run.smithi080.stdout:0: [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] mon.a 2024-05-08T21:09:11.975 INFO:teuthology.orchestra.run.smithi080.stdout:1: [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] mon.b 2024-05-08T21:09:11.975 INFO:teuthology.orchestra.run.smithi080.stdout:2: [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] mon.c 2024-05-08T21:09:11.975 INFO:teuthology.orchestra.run.smithi080.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-05-08T21:09:11.976 DEBUG:teuthology.orchestra.run.smithi080:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-05-08T21:09:11.994 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 44d31c1e-aad3-47ca-a4fa-85a63d4a60aa... 2024-05-08T21:09:11.995 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-08T21:09:12.037 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-08T21:09:12.083 INFO:teuthology.orchestra.run.smithi080.stdout:[global] 2024-05-08T21:09:12.083 INFO:teuthology.orchestra.run.smithi080.stdout: chdir = "" 2024-05-08T21:09:12.083 INFO:teuthology.orchestra.run.smithi080.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-08T21:09:12.083 INFO:teuthology.orchestra.run.smithi080.stdout: auth supported = cephx 2024-05-08T21:09:12.083 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:09:12.083 INFO:teuthology.orchestra.run.smithi080.stdout: filestore xattr use omap = true 2024-05-08T21:09:12.083 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:09:12.084 INFO:teuthology.orchestra.run.smithi080.stdout: mon clock drift allowed = 1.000 2024-05-08T21:09:12.084 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:09:12.084 INFO:teuthology.orchestra.run.smithi080.stdout: osd crush chooseleaf type = 0 2024-05-08T21:09:12.084 INFO:teuthology.orchestra.run.smithi080.stdout: auth debug = true 2024-05-08T21:09:12.084 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:09:12.084 INFO:teuthology.orchestra.run.smithi080.stdout: ms die on old message = true 2024-05-08T21:09:12.084 INFO:teuthology.orchestra.run.smithi080.stdout: ms die on bug = true 2024-05-08T21:09:12.084 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:09:12.084 INFO:teuthology.orchestra.run.smithi080.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-08T21:09:12.084 INFO:teuthology.orchestra.run.smithi080.stdout: mon pg warn max object skew = 0 2024-05-08T21:09:12.084 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:09:12.084 INFO:teuthology.orchestra.run.smithi080.stdout: # disable pg_autoscaler by default for new pools 2024-05-08T21:09:12.084 INFO:teuthology.orchestra.run.smithi080.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-08T21:09:12.084 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:09:12.084 INFO:teuthology.orchestra.run.smithi080.stdout: osd pool default size = 2 2024-05-08T21:09:12.084 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:09:12.085 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd allow primary affinity = true 2024-05-08T21:09:12.085 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd allow pg remap = true 2024-05-08T21:09:12.085 INFO:teuthology.orchestra.run.smithi080.stdout: mon warn on legacy crush tunables = false 2024-05-08T21:09:12.085 INFO:teuthology.orchestra.run.smithi080.stdout: mon warn on crush straw calc version zero = false 2024-05-08T21:09:12.085 INFO:teuthology.orchestra.run.smithi080.stdout: mon warn on no sortbitwise = false 2024-05-08T21:09:12.085 INFO:teuthology.orchestra.run.smithi080.stdout: mon warn on osd down out interval zero = false 2024-05-08T21:09:12.085 INFO:teuthology.orchestra.run.smithi080.stdout: mon warn on too few osds = false 2024-05-08T21:09:12.085 INFO:teuthology.orchestra.run.smithi080.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-08T21:09:12.085 INFO:teuthology.orchestra.run.smithi080.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-08T21:09:12.085 INFO:teuthology.orchestra.run.smithi080.stdout: mon_allow_pool_size_one = true 2024-05-08T21:09:12.085 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:09:12.085 INFO:teuthology.orchestra.run.smithi080.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-08T21:09:12.085 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:09:12.085 INFO:teuthology.orchestra.run.smithi080.stdout: osd default data pool replay window = 5 2024-05-08T21:09:12.085 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:09:12.086 INFO:teuthology.orchestra.run.smithi080.stdout: mon allow pool delete = true 2024-05-08T21:09:12.086 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:09:12.086 INFO:teuthology.orchestra.run.smithi080.stdout: mon cluster log file level = debug 2024-05-08T21:09:12.086 INFO:teuthology.orchestra.run.smithi080.stdout: debug asserts on shutdown = true 2024-05-08T21:09:12.086 INFO:teuthology.orchestra.run.smithi080.stdout: mon health detail to clog = false 2024-05-08T21:09:12.086 INFO:teuthology.orchestra.run.smithi080.stdout: mon host = "172.21.15.80,172.21.15.106,[v2:172.21.15.106:3301,v1:172.21.15.106:6790]" 2024-05-08T21:09:12.086 INFO:teuthology.orchestra.run.smithi080.stdout: ms die on skipped message = False 2024-05-08T21:09:12.086 INFO:teuthology.orchestra.run.smithi080.stdout: fsid = 44d31c1e-aad3-47ca-a4fa-85a63d4a60aa 2024-05-08T21:09:12.086 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:09:12.086 INFO:teuthology.orchestra.run.smithi080.stdout:[osd] 2024-05-08T21:09:12.086 INFO:teuthology.orchestra.run.smithi080.stdout: osd journal size = 100 2024-05-08T21:09:12.087 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:09:12.087 INFO:teuthology.orchestra.run.smithi080.stdout: osd scrub load threshold = 5.0 2024-05-08T21:09:12.087 INFO:teuthology.orchestra.run.smithi080.stdout: osd scrub max interval = 600 2024-05-08T21:09:12.087 INFO:teuthology.orchestra.run.smithi080.stdout: osd mclock profile = high_recovery_ops 2024-05-08T21:09:12.087 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:09:12.087 INFO:teuthology.orchestra.run.smithi080.stdout: osd recover clone overlap = true 2024-05-08T21:09:12.087 INFO:teuthology.orchestra.run.smithi080.stdout: osd recovery max chunk = 1048576 2024-05-08T21:09:12.087 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:09:12.087 INFO:teuthology.orchestra.run.smithi080.stdout: osd debug shutdown = true 2024-05-08T21:09:12.087 INFO:teuthology.orchestra.run.smithi080.stdout: osd debug op order = true 2024-05-08T21:09:12.088 INFO:teuthology.orchestra.run.smithi080.stdout: osd debug verify stray on activate = true 2024-05-08T21:09:12.088 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:09:12.088 INFO:teuthology.orchestra.run.smithi080.stdout: osd open classes on start = true 2024-05-08T21:09:12.088 INFO:teuthology.orchestra.run.smithi080.stdout: osd debug pg log writeout = true 2024-05-08T21:09:12.089 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:09:12.089 INFO:teuthology.orchestra.run.smithi080.stdout: osd deep scrub update digest min age = 30 2024-05-08T21:09:12.089 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:09:12.089 INFO:teuthology.orchestra.run.smithi080.stdout: osd map max advance = 10 2024-05-08T21:09:12.089 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:09:12.089 INFO:teuthology.orchestra.run.smithi080.stdout: journal zero on create = true 2024-05-08T21:09:12.089 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:09:12.089 INFO:teuthology.orchestra.run.smithi080.stdout: filestore ondisk finisher threads = 3 2024-05-08T21:09:12.089 INFO:teuthology.orchestra.run.smithi080.stdout: filestore apply finisher threads = 3 2024-05-08T21:09:12.089 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:09:12.089 INFO:teuthology.orchestra.run.smithi080.stdout: bdev debug aio = true 2024-05-08T21:09:12.090 INFO:teuthology.orchestra.run.smithi080.stdout: osd debug misdirected ops = true 2024-05-08T21:09:12.090 INFO:teuthology.orchestra.run.smithi080.stdout: bluestore block size = 96636764160 2024-05-08T21:09:12.090 INFO:teuthology.orchestra.run.smithi080.stdout: bluestore compression mode = aggressive 2024-05-08T21:09:12.090 INFO:teuthology.orchestra.run.smithi080.stdout: bluestore fsck on mount = True 2024-05-08T21:09:12.090 INFO:teuthology.orchestra.run.smithi080.stdout: debug bluefs = 20 2024-05-08T21:09:12.090 INFO:teuthology.orchestra.run.smithi080.stdout: debug bluestore = 20 2024-05-08T21:09:12.090 INFO:teuthology.orchestra.run.smithi080.stdout: debug ms = 1 2024-05-08T21:09:12.090 INFO:teuthology.orchestra.run.smithi080.stdout: debug osd = 20 2024-05-08T21:09:12.090 INFO:teuthology.orchestra.run.smithi080.stdout: debug rocksdb = 10 2024-05-08T21:09:12.090 INFO:teuthology.orchestra.run.smithi080.stdout: filestore flush min = 0 2024-05-08T21:09:12.090 INFO:teuthology.orchestra.run.smithi080.stdout: mon client directed command retry = 5 2024-05-08T21:09:12.090 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd backfillfull_ratio = 0.85 2024-05-08T21:09:12.091 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd full ratio = 0.9 2024-05-08T21:09:12.091 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd nearfull ratio = 0.8 2024-05-08T21:09:12.091 INFO:teuthology.orchestra.run.smithi080.stdout: ms inject delay max = 1 2024-05-08T21:09:12.091 INFO:teuthology.orchestra.run.smithi080.stdout: ms inject delay probability = 0.005 2024-05-08T21:09:12.091 INFO:teuthology.orchestra.run.smithi080.stdout: ms inject delay type = client mds 2024-05-08T21:09:12.091 INFO:teuthology.orchestra.run.smithi080.stdout: ms inject socket failures = 2500 2024-05-08T21:09:12.091 INFO:teuthology.orchestra.run.smithi080.stdout: osd blocked scrub grace period = 3600 2024-05-08T21:09:12.091 INFO:teuthology.orchestra.run.smithi080.stdout: osd failsafe full ratio = 0.95 2024-05-08T21:09:12.091 INFO:teuthology.orchestra.run.smithi080.stdout: osd max markdown count = 1000 2024-05-08T21:09:12.091 INFO:teuthology.orchestra.run.smithi080.stdout: osd objectstore = bluestore 2024-05-08T21:09:12.091 INFO:teuthology.orchestra.run.smithi080.stdout: osd op complaint time = 180 2024-05-08T21:09:12.092 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:09:12.092 INFO:teuthology.orchestra.run.smithi080.stdout:[mgr] 2024-05-08T21:09:12.092 INFO:teuthology.orchestra.run.smithi080.stdout: debug ms = 1 2024-05-08T21:09:12.092 INFO:teuthology.orchestra.run.smithi080.stdout: debug mgr = 20 2024-05-08T21:09:12.092 INFO:teuthology.orchestra.run.smithi080.stdout: debug mon = 20 2024-05-08T21:09:12.092 INFO:teuthology.orchestra.run.smithi080.stdout: debug auth = 20 2024-05-08T21:09:12.092 INFO:teuthology.orchestra.run.smithi080.stdout: mon reweight min pgs per osd = 4 2024-05-08T21:09:12.092 INFO:teuthology.orchestra.run.smithi080.stdout: mon reweight min bytes per osd = 10 2024-05-08T21:09:12.092 INFO:teuthology.orchestra.run.smithi080.stdout: mgr/telemetry/nag = false 2024-05-08T21:09:12.092 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:09:12.092 INFO:teuthology.orchestra.run.smithi080.stdout:[mon] 2024-05-08T21:09:12.092 INFO:teuthology.orchestra.run.smithi080.stdout: debug ms = 1 2024-05-08T21:09:12.092 INFO:teuthology.orchestra.run.smithi080.stdout: debug mon = 20 2024-05-08T21:09:12.092 INFO:teuthology.orchestra.run.smithi080.stdout: debug paxos = 20 2024-05-08T21:09:12.093 INFO:teuthology.orchestra.run.smithi080.stdout: debug auth = 20 2024-05-08T21:09:12.093 INFO:teuthology.orchestra.run.smithi080.stdout: mon data avail warn = 5 2024-05-08T21:09:12.093 INFO:teuthology.orchestra.run.smithi080.stdout: mon mgr mkfs grace = 240 2024-05-08T21:09:12.093 INFO:teuthology.orchestra.run.smithi080.stdout: mon reweight min pgs per osd = 4 2024-05-08T21:09:12.093 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd reporter subtree level = osd 2024-05-08T21:09:12.093 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd prime pg temp = true 2024-05-08T21:09:12.093 INFO:teuthology.orchestra.run.smithi080.stdout: mon reweight min bytes per osd = 10 2024-05-08T21:09:12.093 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:09:12.093 INFO:teuthology.orchestra.run.smithi080.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-08T21:09:12.094 INFO:teuthology.orchestra.run.smithi080.stdout: auth mon ticket ttl = 660 # 11m 2024-05-08T21:09:12.094 INFO:teuthology.orchestra.run.smithi080.stdout: auth service ticket ttl = 240 # 4m 2024-05-08T21:09:12.094 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:09:12.094 INFO:teuthology.orchestra.run.smithi080.stdout: # don't complain about insecure global_id in the test suite 2024-05-08T21:09:12.094 INFO:teuthology.orchestra.run.smithi080.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-08T21:09:12.094 INFO:teuthology.orchestra.run.smithi080.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-08T21:09:12.094 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:09:12.094 INFO:teuthology.orchestra.run.smithi080.stdout: # 1m isn't quite enough 2024-05-08T21:09:12.094 INFO:teuthology.orchestra.run.smithi080.stdout: mon_down_mkfs_grace = 2m 2024-05-08T21:09:12.094 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:09:12.095 INFO:teuthology.orchestra.run.smithi080.stdout: mon_warn_on_filestore_osds = false 2024-05-08T21:09:12.095 INFO:teuthology.orchestra.run.smithi080.stdout: mon op complaint time = 120 2024-05-08T21:09:12.095 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:09:12.095 INFO:teuthology.orchestra.run.smithi080.stdout:[client] 2024-05-08T21:09:12.095 INFO:teuthology.orchestra.run.smithi080.stdout: rgw cache enabled = true 2024-05-08T21:09:12.095 INFO:teuthology.orchestra.run.smithi080.stdout: rgw enable ops log = true 2024-05-08T21:09:12.095 INFO:teuthology.orchestra.run.smithi080.stdout: rgw enable usage log = true 2024-05-08T21:09:12.095 INFO:teuthology.orchestra.run.smithi080.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-08T21:09:12.095 INFO:teuthology.orchestra.run.smithi080.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-08T21:09:12.095 INFO:teuthology.orchestra.run.smithi080.stdout: client mount timeout = 600 2024-05-08T21:09:12.095 INFO:teuthology.orchestra.run.smithi080.stdout: client_shutdown_timeout = 120 2024-05-08T21:09:12.095 INFO:teuthology.orchestra.run.smithi080.stdout: debug client = 20 2024-05-08T21:09:12.095 INFO:teuthology.orchestra.run.smithi080.stdout: debug ms = 1 2024-05-08T21:09:12.096 INFO:teuthology.orchestra.run.smithi080.stdout: rados mon op timeout = 900 2024-05-08T21:09:12.096 INFO:teuthology.orchestra.run.smithi080.stdout: rados osd op timeout = 900 2024-05-08T21:09:12.096 INFO:teuthology.orchestra.run.smithi080.stdout:[mon.a] 2024-05-08T21:09:12.096 INFO:teuthology.orchestra.run.smithi080.stdout:[mon.b] 2024-05-08T21:09:12.096 INFO:teuthology.orchestra.run.smithi080.stdout:[mon.c] 2024-05-08T21:09:12.096 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.a] 2024-05-08T21:09:12.096 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.c] 2024-05-08T21:09:12.096 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.e] 2024-05-08T21:09:12.096 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.b] 2024-05-08T21:09:12.096 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.d] 2024-05-08T21:09:12.096 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.f] 2024-05-08T21:09:12.096 INFO:teuthology.orchestra.run.smithi080.stdout:[mds] 2024-05-08T21:09:12.096 INFO:teuthology.orchestra.run.smithi080.stdout: debug mds = 20 2024-05-08T21:09:12.096 INFO:teuthology.orchestra.run.smithi080.stdout: debug mds balancer = 20 2024-05-08T21:09:12.096 INFO:teuthology.orchestra.run.smithi080.stdout: debug ms = 1 2024-05-08T21:09:12.097 INFO:teuthology.orchestra.run.smithi080.stdout: mds bal fragment size max = 10000 2024-05-08T21:09:12.097 INFO:teuthology.orchestra.run.smithi080.stdout: mds bal merge size = 5 2024-05-08T21:09:12.097 INFO:teuthology.orchestra.run.smithi080.stdout: mds bal split bits = 3 2024-05-08T21:09:12.097 INFO:teuthology.orchestra.run.smithi080.stdout: mds bal split size = 100 2024-05-08T21:09:12.097 INFO:teuthology.orchestra.run.smithi080.stdout: mds debug frag = True 2024-05-08T21:09:12.097 INFO:teuthology.orchestra.run.smithi080.stdout: mds debug scatterstat = True 2024-05-08T21:09:12.097 INFO:teuthology.orchestra.run.smithi080.stdout: mds oft prefetch dirfrags = False 2024-05-08T21:09:12.097 INFO:teuthology.orchestra.run.smithi080.stdout: mds op complaint time = 180 2024-05-08T21:09:12.097 INFO:teuthology.orchestra.run.smithi080.stdout: mds verify scatter = True 2024-05-08T21:09:12.097 INFO:teuthology.orchestra.run.smithi080.stdout: mds_dir_prefetch = False 2024-05-08T21:09:12.097 INFO:teuthology.orchestra.run.smithi080.stdout: mds_sleep_rank_change = 5000000.0 2024-05-08T21:09:12.097 INFO:teuthology.orchestra.run.smithi080.stdout: mon client directed command retry = 5 2024-05-08T21:09:12.097 INFO:teuthology.orchestra.run.smithi080.stdout: ms inject delay max = 1 2024-05-08T21:09:12.097 INFO:teuthology.orchestra.run.smithi080.stdout: ms inject delay probability = 0.005 2024-05-08T21:09:12.098 INFO:teuthology.orchestra.run.smithi080.stdout: ms inject delay type = client mds osd 2024-05-08T21:09:12.098 INFO:teuthology.orchestra.run.smithi080.stdout: ms inject socket failures = 2500 2024-05-08T21:09:12.098 INFO:teuthology.orchestra.run.smithi080.stdout: osd op complaint time = 180 2024-05-08T21:09:12.098 INFO:teuthology.orchestra.run.smithi080.stdout: rados mon op timeout = 900 2024-05-08T21:09:12.098 INFO:teuthology.orchestra.run.smithi080.stdout: rados osd op timeout = 900 2024-05-08T21:09:12.099 INFO:teuthology.orchestra.run.smithi106.stdout:[global] 2024-05-08T21:09:12.100 INFO:teuthology.orchestra.run.smithi106.stdout: chdir = "" 2024-05-08T21:09:12.100 INFO:teuthology.orchestra.run.smithi106.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-08T21:09:12.100 INFO:teuthology.orchestra.run.smithi106.stdout: auth supported = cephx 2024-05-08T21:09:12.100 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-08T21:09:12.100 INFO:teuthology.orchestra.run.smithi106.stdout: filestore xattr use omap = true 2024-05-08T21:09:12.100 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-08T21:09:12.100 INFO:teuthology.orchestra.run.smithi106.stdout: mon clock drift allowed = 1.000 2024-05-08T21:09:12.100 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-08T21:09:12.100 INFO:teuthology.orchestra.run.smithi106.stdout: osd crush chooseleaf type = 0 2024-05-08T21:09:12.100 INFO:teuthology.orchestra.run.smithi106.stdout: auth debug = true 2024-05-08T21:09:12.100 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-08T21:09:12.100 INFO:teuthology.orchestra.run.smithi106.stdout: ms die on old message = true 2024-05-08T21:09:12.101 INFO:teuthology.orchestra.run.smithi106.stdout: ms die on bug = true 2024-05-08T21:09:12.101 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-08T21:09:12.101 INFO:teuthology.orchestra.run.smithi106.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-08T21:09:12.101 INFO:teuthology.orchestra.run.smithi106.stdout: mon pg warn max object skew = 0 2024-05-08T21:09:12.101 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-08T21:09:12.101 INFO:teuthology.orchestra.run.smithi106.stdout: # disable pg_autoscaler by default for new pools 2024-05-08T21:09:12.101 INFO:teuthology.orchestra.run.smithi106.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-08T21:09:12.101 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-08T21:09:12.101 INFO:teuthology.orchestra.run.smithi106.stdout: osd pool default size = 2 2024-05-08T21:09:12.101 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-08T21:09:12.101 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd allow primary affinity = true 2024-05-08T21:09:12.101 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd allow pg remap = true 2024-05-08T21:09:12.101 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on legacy crush tunables = false 2024-05-08T21:09:12.101 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on crush straw calc version zero = false 2024-05-08T21:09:12.101 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on no sortbitwise = false 2024-05-08T21:09:12.102 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on osd down out interval zero = false 2024-05-08T21:09:12.102 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on too few osds = false 2024-05-08T21:09:12.102 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-08T21:09:12.102 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-08T21:09:12.102 INFO:teuthology.orchestra.run.smithi106.stdout: mon_allow_pool_size_one = true 2024-05-08T21:09:12.102 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-08T21:09:12.102 INFO:teuthology.orchestra.run.smithi106.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-08T21:09:12.102 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-08T21:09:12.102 INFO:teuthology.orchestra.run.smithi106.stdout: osd default data pool replay window = 5 2024-05-08T21:09:12.102 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-08T21:09:12.102 INFO:teuthology.orchestra.run.smithi106.stdout: mon allow pool delete = true 2024-05-08T21:09:12.102 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-08T21:09:12.102 INFO:teuthology.orchestra.run.smithi106.stdout: mon cluster log file level = debug 2024-05-08T21:09:12.103 INFO:teuthology.orchestra.run.smithi106.stdout: debug asserts on shutdown = true 2024-05-08T21:09:12.103 INFO:teuthology.orchestra.run.smithi106.stdout: mon health detail to clog = false 2024-05-08T21:09:12.103 INFO:teuthology.orchestra.run.smithi106.stdout: mon host = "172.21.15.80,172.21.15.106,[v2:172.21.15.106:3301,v1:172.21.15.106:6790]" 2024-05-08T21:09:12.103 INFO:teuthology.orchestra.run.smithi106.stdout: ms die on skipped message = False 2024-05-08T21:09:12.103 INFO:teuthology.orchestra.run.smithi106.stdout: fsid = 44d31c1e-aad3-47ca-a4fa-85a63d4a60aa 2024-05-08T21:09:12.103 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-08T21:09:12.103 INFO:teuthology.orchestra.run.smithi106.stdout:[osd] 2024-05-08T21:09:12.103 INFO:teuthology.orchestra.run.smithi106.stdout: osd journal size = 100 2024-05-08T21:09:12.103 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-08T21:09:12.103 INFO:teuthology.orchestra.run.smithi106.stdout: osd scrub load threshold = 5.0 2024-05-08T21:09:12.103 INFO:teuthology.orchestra.run.smithi106.stdout: osd scrub max interval = 600 2024-05-08T21:09:12.103 INFO:teuthology.orchestra.run.smithi106.stdout: osd mclock profile = high_recovery_ops 2024-05-08T21:09:12.103 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-08T21:09:12.103 INFO:teuthology.orchestra.run.smithi106.stdout: osd recover clone overlap = true 2024-05-08T21:09:12.103 INFO:teuthology.orchestra.run.smithi106.stdout: osd recovery max chunk = 1048576 2024-05-08T21:09:12.104 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-08T21:09:12.104 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug shutdown = true 2024-05-08T21:09:12.104 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug op order = true 2024-05-08T21:09:12.104 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug verify stray on activate = true 2024-05-08T21:09:12.104 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-08T21:09:12.104 INFO:teuthology.orchestra.run.smithi106.stdout: osd open classes on start = true 2024-05-08T21:09:12.104 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug pg log writeout = true 2024-05-08T21:09:12.104 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-08T21:09:12.104 INFO:teuthology.orchestra.run.smithi106.stdout: osd deep scrub update digest min age = 30 2024-05-08T21:09:12.104 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-08T21:09:12.104 INFO:teuthology.orchestra.run.smithi106.stdout: osd map max advance = 10 2024-05-08T21:09:12.104 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-08T21:09:12.104 INFO:teuthology.orchestra.run.smithi106.stdout: journal zero on create = true 2024-05-08T21:09:12.105 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-08T21:09:12.105 INFO:teuthology.orchestra.run.smithi106.stdout: filestore ondisk finisher threads = 3 2024-05-08T21:09:12.105 INFO:teuthology.orchestra.run.smithi106.stdout: filestore apply finisher threads = 3 2024-05-08T21:09:12.105 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-08T21:09:12.105 INFO:teuthology.orchestra.run.smithi106.stdout: bdev debug aio = true 2024-05-08T21:09:12.105 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug misdirected ops = true 2024-05-08T21:09:12.105 INFO:teuthology.orchestra.run.smithi106.stdout: bluestore block size = 96636764160 2024-05-08T21:09:12.105 INFO:teuthology.orchestra.run.smithi106.stdout: bluestore compression mode = aggressive 2024-05-08T21:09:12.105 INFO:teuthology.orchestra.run.smithi106.stdout: bluestore fsck on mount = True 2024-05-08T21:09:12.105 INFO:teuthology.orchestra.run.smithi106.stdout: debug bluefs = 20 2024-05-08T21:09:12.105 INFO:teuthology.orchestra.run.smithi106.stdout: debug bluestore = 20 2024-05-08T21:09:12.105 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2024-05-08T21:09:12.105 INFO:teuthology.orchestra.run.smithi106.stdout: debug osd = 20 2024-05-08T21:09:12.105 INFO:teuthology.orchestra.run.smithi106.stdout: debug rocksdb = 10 2024-05-08T21:09:12.105 INFO:teuthology.orchestra.run.smithi106.stdout: filestore flush min = 0 2024-05-08T21:09:12.106 INFO:teuthology.orchestra.run.smithi106.stdout: mon client directed command retry = 5 2024-05-08T21:09:12.106 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd backfillfull_ratio = 0.85 2024-05-08T21:09:12.106 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd full ratio = 0.9 2024-05-08T21:09:12.106 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd nearfull ratio = 0.8 2024-05-08T21:09:12.106 INFO:teuthology.orchestra.run.smithi106.stdout: ms inject delay max = 1 2024-05-08T21:09:12.106 INFO:teuthology.orchestra.run.smithi106.stdout: ms inject delay probability = 0.005 2024-05-08T21:09:12.106 INFO:teuthology.orchestra.run.smithi106.stdout: ms inject delay type = client mds 2024-05-08T21:09:12.106 INFO:teuthology.orchestra.run.smithi106.stdout: ms inject socket failures = 2500 2024-05-08T21:09:12.106 INFO:teuthology.orchestra.run.smithi106.stdout: osd blocked scrub grace period = 3600 2024-05-08T21:09:12.106 INFO:teuthology.orchestra.run.smithi106.stdout: osd failsafe full ratio = 0.95 2024-05-08T21:09:12.106 INFO:teuthology.orchestra.run.smithi106.stdout: osd max markdown count = 1000 2024-05-08T21:09:12.106 INFO:teuthology.orchestra.run.smithi106.stdout: osd objectstore = bluestore 2024-05-08T21:09:12.106 INFO:teuthology.orchestra.run.smithi106.stdout: osd op complaint time = 180 2024-05-08T21:09:12.106 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-08T21:09:12.107 INFO:teuthology.orchestra.run.smithi106.stdout:[mgr] 2024-05-08T21:09:12.107 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2024-05-08T21:09:12.107 INFO:teuthology.orchestra.run.smithi106.stdout: debug mgr = 20 2024-05-08T21:09:12.107 INFO:teuthology.orchestra.run.smithi106.stdout: debug mon = 20 2024-05-08T21:09:12.107 INFO:teuthology.orchestra.run.smithi106.stdout: debug auth = 20 2024-05-08T21:09:12.107 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min pgs per osd = 4 2024-05-08T21:09:12.107 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min bytes per osd = 10 2024-05-08T21:09:12.107 INFO:teuthology.orchestra.run.smithi106.stdout: mgr/telemetry/nag = false 2024-05-08T21:09:12.107 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-08T21:09:12.107 INFO:teuthology.orchestra.run.smithi106.stdout:[mon] 2024-05-08T21:09:12.107 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2024-05-08T21:09:12.107 INFO:teuthology.orchestra.run.smithi106.stdout: debug mon = 20 2024-05-08T21:09:12.107 INFO:teuthology.orchestra.run.smithi106.stdout: debug paxos = 20 2024-05-08T21:09:12.107 INFO:teuthology.orchestra.run.smithi106.stdout: debug auth = 20 2024-05-08T21:09:12.107 INFO:teuthology.orchestra.run.smithi106.stdout: mon data avail warn = 5 2024-05-08T21:09:12.108 INFO:teuthology.orchestra.run.smithi106.stdout: mon mgr mkfs grace = 240 2024-05-08T21:09:12.108 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min pgs per osd = 4 2024-05-08T21:09:12.108 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd reporter subtree level = osd 2024-05-08T21:09:12.108 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd prime pg temp = true 2024-05-08T21:09:12.108 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min bytes per osd = 10 2024-05-08T21:09:12.108 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-08T21:09:12.108 INFO:teuthology.orchestra.run.smithi106.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-08T21:09:12.108 INFO:teuthology.orchestra.run.smithi106.stdout: auth mon ticket ttl = 660 # 11m 2024-05-08T21:09:12.108 INFO:teuthology.orchestra.run.smithi106.stdout: auth service ticket ttl = 240 # 4m 2024-05-08T21:09:12.108 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-08T21:09:12.108 INFO:teuthology.orchestra.run.smithi106.stdout: # don't complain about insecure global_id in the test suite 2024-05-08T21:09:12.109 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-08T21:09:12.109 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-08T21:09:12.109 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-08T21:09:12.109 INFO:teuthology.orchestra.run.smithi106.stdout: # 1m isn't quite enough 2024-05-08T21:09:12.109 INFO:teuthology.orchestra.run.smithi106.stdout: mon_down_mkfs_grace = 2m 2024-05-08T21:09:12.109 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-08T21:09:12.109 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_filestore_osds = false 2024-05-08T21:09:12.109 INFO:teuthology.orchestra.run.smithi106.stdout: mon op complaint time = 120 2024-05-08T21:09:12.109 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-08T21:09:12.109 INFO:teuthology.orchestra.run.smithi106.stdout:[client] 2024-05-08T21:09:12.109 INFO:teuthology.orchestra.run.smithi106.stdout: rgw cache enabled = true 2024-05-08T21:09:12.109 INFO:teuthology.orchestra.run.smithi106.stdout: rgw enable ops log = true 2024-05-08T21:09:12.109 INFO:teuthology.orchestra.run.smithi106.stdout: rgw enable usage log = true 2024-05-08T21:09:12.109 INFO:teuthology.orchestra.run.smithi106.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-08T21:09:12.109 INFO:teuthology.orchestra.run.smithi106.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-08T21:09:12.110 INFO:teuthology.orchestra.run.smithi106.stdout: client mount timeout = 600 2024-05-08T21:09:12.110 INFO:teuthology.orchestra.run.smithi106.stdout: client_shutdown_timeout = 120 2024-05-08T21:09:12.110 INFO:teuthology.orchestra.run.smithi106.stdout: debug client = 20 2024-05-08T21:09:12.110 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2024-05-08T21:09:12.110 INFO:teuthology.orchestra.run.smithi106.stdout: rados mon op timeout = 900 2024-05-08T21:09:12.110 INFO:teuthology.orchestra.run.smithi106.stdout: rados osd op timeout = 900 2024-05-08T21:09:12.110 INFO:teuthology.orchestra.run.smithi106.stdout:[mon.a] 2024-05-08T21:09:12.110 INFO:teuthology.orchestra.run.smithi106.stdout:[mon.b] 2024-05-08T21:09:12.110 INFO:teuthology.orchestra.run.smithi106.stdout:[mon.c] 2024-05-08T21:09:12.110 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.a] 2024-05-08T21:09:12.110 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.c] 2024-05-08T21:09:12.110 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.e] 2024-05-08T21:09:12.110 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.b] 2024-05-08T21:09:12.110 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.d] 2024-05-08T21:09:12.111 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.f] 2024-05-08T21:09:12.111 INFO:teuthology.orchestra.run.smithi106.stdout:[mds] 2024-05-08T21:09:12.111 INFO:teuthology.orchestra.run.smithi106.stdout: debug mds = 20 2024-05-08T21:09:12.111 INFO:teuthology.orchestra.run.smithi106.stdout: debug mds balancer = 20 2024-05-08T21:09:12.111 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2024-05-08T21:09:12.111 INFO:teuthology.orchestra.run.smithi106.stdout: mds bal fragment size max = 10000 2024-05-08T21:09:12.111 INFO:teuthology.orchestra.run.smithi106.stdout: mds bal merge size = 5 2024-05-08T21:09:12.111 INFO:teuthology.orchestra.run.smithi106.stdout: mds bal split bits = 3 2024-05-08T21:09:12.111 INFO:teuthology.orchestra.run.smithi106.stdout: mds bal split size = 100 2024-05-08T21:09:12.111 INFO:teuthology.orchestra.run.smithi106.stdout: mds debug frag = True 2024-05-08T21:09:12.111 INFO:teuthology.orchestra.run.smithi106.stdout: mds debug scatterstat = True 2024-05-08T21:09:12.111 INFO:teuthology.orchestra.run.smithi106.stdout: mds oft prefetch dirfrags = False 2024-05-08T21:09:12.112 INFO:teuthology.orchestra.run.smithi106.stdout: mds op complaint time = 180 2024-05-08T21:09:12.112 INFO:teuthology.orchestra.run.smithi106.stdout: mds verify scatter = True 2024-05-08T21:09:12.112 INFO:teuthology.orchestra.run.smithi106.stdout: mds_dir_prefetch = False 2024-05-08T21:09:12.112 INFO:teuthology.orchestra.run.smithi106.stdout: mds_sleep_rank_change = 5000000.0 2024-05-08T21:09:12.112 INFO:teuthology.orchestra.run.smithi106.stdout: mon client directed command retry = 5 2024-05-08T21:09:12.112 INFO:teuthology.orchestra.run.smithi106.stdout: ms inject delay max = 1 2024-05-08T21:09:12.112 INFO:teuthology.orchestra.run.smithi106.stdout: ms inject delay probability = 0.005 2024-05-08T21:09:12.112 INFO:teuthology.orchestra.run.smithi106.stdout: ms inject delay type = client mds osd 2024-05-08T21:09:12.112 INFO:teuthology.orchestra.run.smithi106.stdout: ms inject socket failures = 2500 2024-05-08T21:09:12.112 INFO:teuthology.orchestra.run.smithi106.stdout: osd op complaint time = 180 2024-05-08T21:09:12.112 INFO:teuthology.orchestra.run.smithi106.stdout: rados mon op timeout = 900 2024-05-08T21:09:12.112 INFO:teuthology.orchestra.run.smithi106.stdout: rados osd op timeout = 900 2024-05-08T21:09:12.113 INFO:tasks.ceph:Creating admin key on mon.a... 2024-05-08T21:09:12.113 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-05-08T21:09:12.170 INFO:tasks.ceph:Copying monmap to all nodes... 2024-05-08T21:09:12.170 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T21:09:12.171 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-05-08T21:09:12.187 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T21:09:12.187 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-05-08T21:09:12.243 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi080.front.sepia.ceph.com 2024-05-08T21:09:12.243 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T21:09:12.244 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-08T21:09:12.244 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-08T21:09:12.321 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T21:09:12.321 DEBUG:teuthology.orchestra.run.smithi080:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-08T21:09:12.378 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi106.front.sepia.ceph.com 2024-05-08T21:09:12.378 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-08T21:09:12.378 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-08T21:09:12.378 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-08T21:09:12.416 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-08T21:09:12.416 DEBUG:teuthology.orchestra.run.smithi106:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-08T21:09:12.473 INFO:tasks.ceph:Setting up mon nodes... 2024-05-08T21:09:12.473 INFO:tasks.ceph:Setting up mgr nodes... 2024-05-08T21:09:12.473 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-05-08T21:09:12.527 INFO:teuthology.orchestra.run.smithi080.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-05-08T21:09:12.529 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-05-08T21:09:12.596 INFO:teuthology.orchestra.run.smithi106.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-05-08T21:09:12.599 INFO:tasks.ceph:Setting up mds nodes... 2024-05-08T21:09:12.599 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-05-08T21:09:12.652 INFO:teuthology.orchestra.run.smithi080.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-05-08T21:09:12.655 DEBUG:teuthology.orchestra.run.smithi080:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-05-08T21:09:12.682 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-05-08T21:09:12.776 INFO:teuthology.orchestra.run.smithi080.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-05-08T21:09:12.779 DEBUG:teuthology.orchestra.run.smithi080:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-05-08T21:09:12.805 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-05-08T21:09:12.899 INFO:teuthology.orchestra.run.smithi080.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-05-08T21:09:12.902 DEBUG:teuthology.orchestra.run.smithi080:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-05-08T21:09:12.928 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-05-08T21:09:12.986 INFO:teuthology.orchestra.run.smithi106.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-05-08T21:09:12.989 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-05-08T21:09:13.017 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-05-08T21:09:13.110 INFO:teuthology.orchestra.run.smithi106.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-05-08T21:09:13.113 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-05-08T21:09:13.139 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-05-08T21:09:13.234 INFO:teuthology.orchestra.run.smithi106.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-05-08T21:09:13.236 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-05-08T21:09:13.263 INFO:tasks.ceph_client:Setting up client nodes... 2024-05-08T21:09:13.263 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-08T21:09:13.314 INFO:teuthology.orchestra.run.smithi080.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-05-08T21:09:13.329 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-05-08T21:09:13.329 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi080.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi106.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-08T21:09:13.329 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-05-08T21:09:13.358 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-08T21:09:13.358 INFO:tasks.ceph:role: osd.0 2024-05-08T21:09:13.358 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi080.front.sepia.ceph.com 2024-05-08T21:09:13.358 DEBUG:teuthology.orchestra.run.smithi080:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-08T21:09:13.434 INFO:teuthology.orchestra.run.smithi080.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T21:09:13.434 INFO:teuthology.orchestra.run.smithi080.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T21:09:13.434 INFO:teuthology.orchestra.run.smithi080.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T21:09:13.434 INFO:teuthology.orchestra.run.smithi080.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-08T21:09:13.434 INFO:teuthology.orchestra.run.smithi080.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T21:09:13.434 INFO:teuthology.orchestra.run.smithi080.stdout: = sunit=0 swidth=0 blks 2024-05-08T21:09:13.434 INFO:teuthology.orchestra.run.smithi080.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T21:09:13.434 INFO:teuthology.orchestra.run.smithi080.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-08T21:09:13.434 INFO:teuthology.orchestra.run.smithi080.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T21:09:13.434 INFO:teuthology.orchestra.run.smithi080.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T21:09:13.870 INFO:teuthology.orchestra.run.smithi080.stdout:Discarding blocks...Done. 2024-05-08T21:09:13.873 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi080.front.sepia.ceph.com -o noatime 2024-05-08T21:09:13.873 DEBUG:teuthology.orchestra.run.smithi080:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-05-08T21:09:14.055 DEBUG:teuthology.orchestra.run.smithi080:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-05-08T21:09:14.090 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-05-08T21:09:14.159 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-08T21:09:14.159 INFO:tasks.ceph:role: osd.1 2024-05-08T21:09:14.159 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi080.front.sepia.ceph.com 2024-05-08T21:09:14.159 DEBUG:teuthology.orchestra.run.smithi080:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-08T21:09:14.234 INFO:teuthology.orchestra.run.smithi080.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T21:09:14.234 INFO:teuthology.orchestra.run.smithi080.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T21:09:14.234 INFO:teuthology.orchestra.run.smithi080.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T21:09:14.234 INFO:teuthology.orchestra.run.smithi080.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-08T21:09:14.234 INFO:teuthology.orchestra.run.smithi080.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T21:09:14.234 INFO:teuthology.orchestra.run.smithi080.stdout: = sunit=0 swidth=0 blks 2024-05-08T21:09:14.234 INFO:teuthology.orchestra.run.smithi080.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T21:09:14.234 INFO:teuthology.orchestra.run.smithi080.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-08T21:09:14.235 INFO:teuthology.orchestra.run.smithi080.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T21:09:14.235 INFO:teuthology.orchestra.run.smithi080.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T21:09:14.649 INFO:teuthology.orchestra.run.smithi080.stdout:Discarding blocks...Done. 2024-05-08T21:09:14.651 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi080.front.sepia.ceph.com -o noatime 2024-05-08T21:09:14.651 DEBUG:teuthology.orchestra.run.smithi080:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-05-08T21:09:14.762 DEBUG:teuthology.orchestra.run.smithi080:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-05-08T21:09:14.793 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-05-08T21:09:14.860 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-08T21:09:14.860 INFO:tasks.ceph:role: osd.2 2024-05-08T21:09:14.860 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi080.front.sepia.ceph.com 2024-05-08T21:09:14.860 DEBUG:teuthology.orchestra.run.smithi080:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-08T21:09:14.934 INFO:teuthology.orchestra.run.smithi080.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T21:09:14.934 INFO:teuthology.orchestra.run.smithi080.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T21:09:14.934 INFO:teuthology.orchestra.run.smithi080.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T21:09:14.934 INFO:teuthology.orchestra.run.smithi080.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-08T21:09:14.934 INFO:teuthology.orchestra.run.smithi080.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T21:09:14.935 INFO:teuthology.orchestra.run.smithi080.stdout: = sunit=0 swidth=0 blks 2024-05-08T21:09:14.935 INFO:teuthology.orchestra.run.smithi080.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T21:09:14.935 INFO:teuthology.orchestra.run.smithi080.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-08T21:09:14.935 INFO:teuthology.orchestra.run.smithi080.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T21:09:14.935 INFO:teuthology.orchestra.run.smithi080.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T21:09:15.395 INFO:teuthology.orchestra.run.smithi080.stdout:Discarding blocks...Done. 2024-05-08T21:09:15.396 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi080.front.sepia.ceph.com -o noatime 2024-05-08T21:09:15.397 DEBUG:teuthology.orchestra.run.smithi080:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-05-08T21:09:15.570 DEBUG:teuthology.orchestra.run.smithi080:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-05-08T21:09:15.601 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-05-08T21:09:15.668 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-08T21:09:15.669 INFO:tasks.ceph:role: osd.3 2024-05-08T21:09:15.669 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi080.front.sepia.ceph.com 2024-05-08T21:09:15.669 DEBUG:teuthology.orchestra.run.smithi080:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-08T21:09:15.743 INFO:teuthology.orchestra.run.smithi080.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T21:09:15.743 INFO:teuthology.orchestra.run.smithi080.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T21:09:15.743 INFO:teuthology.orchestra.run.smithi080.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T21:09:15.743 INFO:teuthology.orchestra.run.smithi080.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-08T21:09:15.744 INFO:teuthology.orchestra.run.smithi080.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T21:09:15.744 INFO:teuthology.orchestra.run.smithi080.stdout: = sunit=0 swidth=0 blks 2024-05-08T21:09:15.744 INFO:teuthology.orchestra.run.smithi080.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T21:09:15.744 INFO:teuthology.orchestra.run.smithi080.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-08T21:09:15.744 INFO:teuthology.orchestra.run.smithi080.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T21:09:15.744 INFO:teuthology.orchestra.run.smithi080.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T21:09:16.190 INFO:teuthology.orchestra.run.smithi080.stdout:Discarding blocks...Done. 2024-05-08T21:09:16.191 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi080.front.sepia.ceph.com -o noatime 2024-05-08T21:09:16.192 DEBUG:teuthology.orchestra.run.smithi080:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-05-08T21:09:16.337 DEBUG:teuthology.orchestra.run.smithi080:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-05-08T21:09:16.369 DEBUG:teuthology.orchestra.run.smithi080:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T21:09:16.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:16.453+0000 7f6c3fde87c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-05-08T21:09:16.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:16.453+0000 7f6c3fde87c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-05-08T21:09:16.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:16.453+0000 7f6c3fde87c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-08T21:09:16.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:16.453+0000 7f6c3fde87c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-08T21:09:16.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:16.453+0000 7f6c3fde87c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-08T21:09:16.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:16.454+0000 7f6c3fde87c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-05-08T21:09:19.326 DEBUG:teuthology.orchestra.run.smithi080:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-08T21:09:19.358 DEBUG:teuthology.orchestra.run.smithi080:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T21:09:19.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:19.450+0000 7fc775cbd7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-05-08T21:09:19.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:19.450+0000 7fc775cbd7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-05-08T21:09:19.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:19.450+0000 7fc775cbd7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-08T21:09:19.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:19.450+0000 7fc775cbd7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-08T21:09:19.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:19.450+0000 7fc775cbd7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-08T21:09:19.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:19.450+0000 7fc775cbd7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-05-08T21:09:22.315 DEBUG:teuthology.orchestra.run.smithi080:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-08T21:09:22.347 DEBUG:teuthology.orchestra.run.smithi080:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T21:09:22.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:22.440+0000 7fefffed97c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-05-08T21:09:22.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:22.441+0000 7fefffed97c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-05-08T21:09:22.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:22.441+0000 7fefffed97c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-08T21:09:22.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:22.441+0000 7fefffed97c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-08T21:09:22.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:22.441+0000 7fefffed97c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-08T21:09:22.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:22.441+0000 7fefffed97c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-05-08T21:09:25.290 DEBUG:teuthology.orchestra.run.smithi080:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-08T21:09:25.322 DEBUG:teuthology.orchestra.run.smithi080:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T21:09:25.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:25.414+0000 7f94f4ddd7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-05-08T21:09:25.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:25.415+0000 7f94f4ddd7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-05-08T21:09:25.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:25.415+0000 7f94f4ddd7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-08T21:09:25.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:25.415+0000 7f94f4ddd7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-08T21:09:25.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:25.415+0000 7f94f4ddd7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-08T21:09:25.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:25.415+0000 7f94f4ddd7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-05-08T21:09:28.266 DEBUG:teuthology.orchestra.run.smithi080:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-08T21:09:28.299 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-05-08T21:09:28.333 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-08T21:09:28.333 INFO:tasks.ceph:role: osd.4 2024-05-08T21:09:28.333 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi106.front.sepia.ceph.com 2024-05-08T21:09:28.333 DEBUG:teuthology.orchestra.run.smithi106:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-08T21:09:28.411 INFO:teuthology.orchestra.run.smithi106.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T21:09:28.411 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T21:09:28.411 INFO:teuthology.orchestra.run.smithi106.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T21:09:28.411 INFO:teuthology.orchestra.run.smithi106.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-08T21:09:28.412 INFO:teuthology.orchestra.run.smithi106.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T21:09:28.412 INFO:teuthology.orchestra.run.smithi106.stdout: = sunit=0 swidth=0 blks 2024-05-08T21:09:28.412 INFO:teuthology.orchestra.run.smithi106.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T21:09:28.412 INFO:teuthology.orchestra.run.smithi106.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-08T21:09:28.412 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T21:09:28.412 INFO:teuthology.orchestra.run.smithi106.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T21:09:28.837 INFO:teuthology.orchestra.run.smithi106.stdout:Discarding blocks...Done. 2024-05-08T21:09:28.839 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi106.front.sepia.ceph.com -o noatime 2024-05-08T21:09:28.839 DEBUG:teuthology.orchestra.run.smithi106:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-05-08T21:09:29.023 DEBUG:teuthology.orchestra.run.smithi106:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-05-08T21:09:29.063 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-05-08T21:09:29.138 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-08T21:09:29.138 INFO:tasks.ceph:role: osd.5 2024-05-08T21:09:29.138 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi106.front.sepia.ceph.com 2024-05-08T21:09:29.139 DEBUG:teuthology.orchestra.run.smithi106:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-08T21:09:29.219 INFO:teuthology.orchestra.run.smithi106.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T21:09:29.219 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T21:09:29.220 INFO:teuthology.orchestra.run.smithi106.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T21:09:29.220 INFO:teuthology.orchestra.run.smithi106.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-08T21:09:29.220 INFO:teuthology.orchestra.run.smithi106.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T21:09:29.220 INFO:teuthology.orchestra.run.smithi106.stdout: = sunit=0 swidth=0 blks 2024-05-08T21:09:29.220 INFO:teuthology.orchestra.run.smithi106.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T21:09:29.220 INFO:teuthology.orchestra.run.smithi106.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-08T21:09:29.221 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T21:09:29.221 INFO:teuthology.orchestra.run.smithi106.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T21:09:29.638 INFO:teuthology.orchestra.run.smithi106.stdout:Discarding blocks...Done. 2024-05-08T21:09:29.640 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi106.front.sepia.ceph.com -o noatime 2024-05-08T21:09:29.641 DEBUG:teuthology.orchestra.run.smithi106:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-05-08T21:09:29.754 DEBUG:teuthology.orchestra.run.smithi106:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-05-08T21:09:29.792 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-05-08T21:09:29.865 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-08T21:09:29.865 INFO:tasks.ceph:role: osd.6 2024-05-08T21:09:29.865 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi106.front.sepia.ceph.com 2024-05-08T21:09:29.866 DEBUG:teuthology.orchestra.run.smithi106:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-08T21:09:29.947 INFO:teuthology.orchestra.run.smithi106.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T21:09:29.947 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T21:09:29.947 INFO:teuthology.orchestra.run.smithi106.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T21:09:29.947 INFO:teuthology.orchestra.run.smithi106.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-08T21:09:29.947 INFO:teuthology.orchestra.run.smithi106.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T21:09:29.947 INFO:teuthology.orchestra.run.smithi106.stdout: = sunit=0 swidth=0 blks 2024-05-08T21:09:29.947 INFO:teuthology.orchestra.run.smithi106.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T21:09:29.947 INFO:teuthology.orchestra.run.smithi106.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-08T21:09:29.947 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T21:09:29.947 INFO:teuthology.orchestra.run.smithi106.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T21:09:30.397 INFO:teuthology.orchestra.run.smithi106.stdout:Discarding blocks...Done. 2024-05-08T21:09:30.399 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi106.front.sepia.ceph.com -o noatime 2024-05-08T21:09:30.399 DEBUG:teuthology.orchestra.run.smithi106:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-05-08T21:09:30.577 DEBUG:teuthology.orchestra.run.smithi106:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-05-08T21:09:30.617 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-05-08T21:09:30.689 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-08T21:09:30.690 INFO:tasks.ceph:role: osd.7 2024-05-08T21:09:30.690 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi106.front.sepia.ceph.com 2024-05-08T21:09:30.690 DEBUG:teuthology.orchestra.run.smithi106:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-08T21:09:30.770 INFO:teuthology.orchestra.run.smithi106.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T21:09:30.771 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T21:09:30.771 INFO:teuthology.orchestra.run.smithi106.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T21:09:30.771 INFO:teuthology.orchestra.run.smithi106.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-08T21:09:30.771 INFO:teuthology.orchestra.run.smithi106.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T21:09:30.771 INFO:teuthology.orchestra.run.smithi106.stdout: = sunit=0 swidth=0 blks 2024-05-08T21:09:30.771 INFO:teuthology.orchestra.run.smithi106.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T21:09:30.771 INFO:teuthology.orchestra.run.smithi106.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-08T21:09:30.771 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T21:09:30.771 INFO:teuthology.orchestra.run.smithi106.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T21:09:31.212 INFO:teuthology.orchestra.run.smithi106.stdout:Discarding blocks...Done. 2024-05-08T21:09:31.214 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi106.front.sepia.ceph.com -o noatime 2024-05-08T21:09:31.214 DEBUG:teuthology.orchestra.run.smithi106:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-05-08T21:09:31.369 DEBUG:teuthology.orchestra.run.smithi106:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-05-08T21:09:31.407 DEBUG:teuthology.orchestra.run.smithi106:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T21:09:31.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:31.502+0000 7fe7d79b97c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-05-08T21:09:31.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:31.502+0000 7fe7d79b97c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-05-08T21:09:31.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:31.502+0000 7fe7d79b97c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-08T21:09:31.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:31.502+0000 7fe7d79b97c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-08T21:09:31.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:31.502+0000 7fe7d79b97c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-08T21:09:31.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:31.502+0000 7fe7d79b97c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-05-08T21:09:34.366 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-08T21:09:34.399 DEBUG:teuthology.orchestra.run.smithi106:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T21:09:34.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:34.492+0000 7fc4744787c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-05-08T21:09:34.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:34.492+0000 7fc4744787c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-05-08T21:09:34.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:34.492+0000 7fc4744787c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-08T21:09:34.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:34.492+0000 7fc4744787c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-08T21:09:34.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:34.492+0000 7fc4744787c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-08T21:09:34.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:34.493+0000 7fc4744787c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-05-08T21:09:37.343 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-08T21:09:37.376 DEBUG:teuthology.orchestra.run.smithi106:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T21:09:37.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:37.470+0000 7f48e31a97c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-05-08T21:09:37.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:37.471+0000 7f48e31a97c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-05-08T21:09:37.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:37.471+0000 7f48e31a97c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-08T21:09:37.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:37.471+0000 7f48e31a97c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-08T21:09:37.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:37.471+0000 7f48e31a97c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-08T21:09:37.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:37.471+0000 7f48e31a97c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-05-08T21:09:40.046 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:09:40.050 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:09:40.339 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-05-08T21:09:40.373 DEBUG:teuthology.orchestra.run.smithi106:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T21:09:40.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:40.467+0000 7f3ff3e887c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-05-08T21:09:40.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:40.467+0000 7f3ff3e887c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-05-08T21:09:40.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:40.467+0000 7f3ff3e887c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-08T21:09:40.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:40.467+0000 7f3ff3e887c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-08T21:09:40.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:40.467+0000 7f3ff3e887c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-08T21:09:40.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:40.468+0000 7f3ff3e887c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-05-08T21:09:43.328 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-05-08T21:09:43.362 INFO:tasks.ceph:Reading keys from all nodes... 2024-05-08T21:09:43.362 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T21:09:43.362 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-05-08T21:09:43.395 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T21:09:43.395 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-05-08T21:09:43.468 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T21:09:43.468 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-05-08T21:09:43.541 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T21:09:43.541 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-05-08T21:09:43.614 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T21:09:43.614 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-05-08T21:09:43.689 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T21:09:43.690 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-05-08T21:09:43.759 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T21:09:43.759 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-05-08T21:09:43.831 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T21:09:43.831 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-05-08T21:09:43.903 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-08T21:09:43.903 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-05-08T21:09:43.936 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-08T21:09:43.937 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-05-08T21:09:44.009 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-08T21:09:44.010 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-05-08T21:09:44.083 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-08T21:09:44.083 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-05-08T21:09:44.156 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-08T21:09:44.156 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-05-08T21:09:44.229 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-08T21:09:44.229 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-05-08T21:09:44.304 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-08T21:09:44.304 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-05-08T21:09:44.376 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-08T21:09:44.377 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-05-08T21:09:44.449 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T21:09:44.449 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-05-08T21:09:44.470 INFO:tasks.ceph:Adding keys to all mons... 2024-05-08T21:09:44.470 DEBUG:teuthology.orchestra.run.smithi080:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-08T21:09:44.513 DEBUG:teuthology.orchestra.run.smithi106:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-08T21:09:44.541 INFO:teuthology.orchestra.run.smithi080.stdout:[mgr.y] 2024-05-08T21:09:44.541 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQD46TtmJBVNHxAAfkcLVvU5AhxCRv7H4X0xHw== 2024-05-08T21:09:44.541 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.a] 2024-05-08T21:09:44.541 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQD46Ttmz6fOJhAA1waxphdC05y19F/KwNqnhQ== 2024-05-08T21:09:44.541 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.c] 2024-05-08T21:09:44.541 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQD46TtmraojLhAAcApwd7AHm/d6mU7iy9h2xg== 2024-05-08T21:09:44.541 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.e] 2024-05-08T21:09:44.541 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQD46TtmpliINRAAQpH6wVQvPYdueqop2PaoTw== 2024-05-08T21:09:44.541 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.0] 2024-05-08T21:09:44.541 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQD86TtmKDgNGxAA2NGXTsE2ujXhI4v2/iB8/Q== 2024-05-08T21:09:44.542 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.1] 2024-05-08T21:09:44.542 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQD/6TtmqIrXGhAApdI4I8yR0cfQuspWTZ7swA== 2024-05-08T21:09:44.542 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.2] 2024-05-08T21:09:44.542 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQAC6jtmDl9KGhAARhJasn6eQ2SSoh2eqz4TKw== 2024-05-08T21:09:44.542 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.3] 2024-05-08T21:09:44.542 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQAF6jtmCFXLGBAA30Kb74eZI4UDFYi+komeaA== 2024-05-08T21:09:44.542 INFO:teuthology.orchestra.run.smithi080.stdout:[mgr.x] 2024-05-08T21:09:44.542 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQD46Ttmgh1yIxAAahUpa2ylimhU9x6iOML0SA== 2024-05-08T21:09:44.542 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.b] 2024-05-08T21:09:44.542 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQD46Ttmg3mxOhAAnzVu7RrQODcpRVJYhggbMA== 2024-05-08T21:09:44.542 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.d] 2024-05-08T21:09:44.543 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQD56Ttm39V6BhAAs2t3vNnCayacg2g9ciYobg== 2024-05-08T21:09:44.543 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.f] 2024-05-08T21:09:44.543 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQD56TtmCb3aDRAA9L8qQWHfFN8iLwtk9KbqVQ== 2024-05-08T21:09:44.543 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.4] 2024-05-08T21:09:44.543 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQAL6jtm9CD8HRAAXa0Ag7TClwU+mGiGtZ5ofg== 2024-05-08T21:09:44.543 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.5] 2024-05-08T21:09:44.543 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQAO6jtmxM55HRAAltyc8Tgow+RCZlzmXcJhuA== 2024-05-08T21:09:44.543 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.6] 2024-05-08T21:09:44.543 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQAR6jtmw4wfHBAA7Gh0D8aDyrOVCLtolo6AKA== 2024-05-08T21:09:44.543 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.7] 2024-05-08T21:09:44.543 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQAU6jtm/APtGxAAfYHEOafXu7DnhhMNivNCmw== 2024-05-08T21:09:44.543 INFO:teuthology.orchestra.run.smithi080.stdout:[client.0] 2024-05-08T21:09:44.544 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQD56Ttm7uuoEhAAcyYvu95szRDztdWDFMDWTA== 2024-05-08T21:09:44.545 INFO:teuthology.orchestra.run.smithi106.stdout:[mgr.y] 2024-05-08T21:09:44.545 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQD46TtmJBVNHxAAfkcLVvU5AhxCRv7H4X0xHw== 2024-05-08T21:09:44.545 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.a] 2024-05-08T21:09:44.545 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQD46Ttmz6fOJhAA1waxphdC05y19F/KwNqnhQ== 2024-05-08T21:09:44.545 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.c] 2024-05-08T21:09:44.545 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQD46TtmraojLhAAcApwd7AHm/d6mU7iy9h2xg== 2024-05-08T21:09:44.545 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.e] 2024-05-08T21:09:44.545 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQD46TtmpliINRAAQpH6wVQvPYdueqop2PaoTw== 2024-05-08T21:09:44.545 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.0] 2024-05-08T21:09:44.545 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQD86TtmKDgNGxAA2NGXTsE2ujXhI4v2/iB8/Q== 2024-05-08T21:09:44.546 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.1] 2024-05-08T21:09:44.546 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQD/6TtmqIrXGhAApdI4I8yR0cfQuspWTZ7swA== 2024-05-08T21:09:44.546 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.2] 2024-05-08T21:09:44.546 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQAC6jtmDl9KGhAARhJasn6eQ2SSoh2eqz4TKw== 2024-05-08T21:09:44.546 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.3] 2024-05-08T21:09:44.546 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQAF6jtmCFXLGBAA30Kb74eZI4UDFYi+komeaA== 2024-05-08T21:09:44.546 INFO:teuthology.orchestra.run.smithi106.stdout:[mgr.x] 2024-05-08T21:09:44.546 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQD46Ttmgh1yIxAAahUpa2ylimhU9x6iOML0SA== 2024-05-08T21:09:44.546 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.b] 2024-05-08T21:09:44.546 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQD46Ttmg3mxOhAAnzVu7RrQODcpRVJYhggbMA== 2024-05-08T21:09:44.546 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.d] 2024-05-08T21:09:44.546 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQD56Ttm39V6BhAAs2t3vNnCayacg2g9ciYobg== 2024-05-08T21:09:44.547 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.f] 2024-05-08T21:09:44.547 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQD56TtmCb3aDRAA9L8qQWHfFN8iLwtk9KbqVQ== 2024-05-08T21:09:44.547 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.4] 2024-05-08T21:09:44.547 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQAL6jtm9CD8HRAAXa0Ag7TClwU+mGiGtZ5ofg== 2024-05-08T21:09:44.547 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.5] 2024-05-08T21:09:44.547 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQAO6jtmxM55HRAAltyc8Tgow+RCZlzmXcJhuA== 2024-05-08T21:09:44.547 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.6] 2024-05-08T21:09:44.547 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQAR6jtmw4wfHBAA7Gh0D8aDyrOVCLtolo6AKA== 2024-05-08T21:09:44.547 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.7] 2024-05-08T21:09:44.547 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQAU6jtm/APtGxAAfYHEOafXu7DnhhMNivNCmw== 2024-05-08T21:09:44.547 INFO:teuthology.orchestra.run.smithi106.stdout:[client.0] 2024-05-08T21:09:44.548 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQD56Ttm7uuoEhAAcyYvu95szRDztdWDFMDWTA== 2024-05-08T21:09:44.548 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-08T21:09:44.588 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-08T21:09:44.648 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T21:09:44.650 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T21:09:44.709 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T21:09:44.712 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T21:09:44.768 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T21:09:44.771 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T21:09:44.828 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T21:09:44.830 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T21:09:44.883 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T21:09:44.885 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T21:09:44.938 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T21:09:44.940 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T21:09:44.993 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T21:09:44.995 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T21:09:45.048 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-08T21:09:45.051 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-08T21:09:45.104 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T21:09:45.107 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T21:09:45.164 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T21:09:45.167 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T21:09:45.223 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T21:09:45.225 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T21:09:45.283 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T21:09:45.286 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T21:09:45.339 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T21:09:45.341 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T21:09:45.396 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T21:09:45.398 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T21:09:45.451 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T21:09:45.454 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T21:09:45.507 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-08T21:09:45.509 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-08T21:09:45.565 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-05-08T21:09:45.565 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-05-08T21:09:45.592 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-08T21:09:45.689 DEBUG:teuthology.orchestra.run.smithi080:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-05-08T21:09:45.716 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-05-08T21:09:45.744 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-08T21:09:45.843 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-05-08T21:09:45.869 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-05-08T21:09:45.936 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-08T21:09:46.036 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-05-08T21:09:46.062 DEBUG:teuthology.orchestra.run.smithi080:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-08T21:09:46.064 DEBUG:teuthology.orchestra.run.smithi106:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-08T21:09:46.119 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-05-08T21:09:46.120 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-08T21:09:46.120 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-05-08T21:09:46.122 INFO:tasks.ceph.mon.a:Started 2024-05-08T21:09:46.122 INFO:tasks.ceph.mon.b:Restarting daemon 2024-05-08T21:09:46.122 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-05-08T21:09:46.163 INFO:tasks.ceph.mon.b:Started 2024-05-08T21:09:46.163 INFO:tasks.ceph.mon.c:Restarting daemon 2024-05-08T21:09:46.163 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-05-08T21:09:46.165 INFO:tasks.ceph.mon.c:Started 2024-05-08T21:09:46.165 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-05-08T21:09:46.166 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-05-08T21:09:46.166 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-05-08T21:09:46.168 INFO:tasks.ceph.mgr.y:Started 2024-05-08T21:09:46.168 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-05-08T21:09:46.168 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-05-08T21:09:46.170 INFO:tasks.ceph.mgr.x:Started 2024-05-08T21:09:46.171 INFO:tasks.ceph:Setting crush tunables to default 2024-05-08T21:09:46.171 DEBUG:teuthology.orchestra.run.smithi080:> sudo ceph --cluster ceph osd crush tunables default 2024-05-08T21:09:46.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.291+0000 7f2c34fea700 1 Processor -- start 2024-05-08T21:09:46.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.291+0000 7f2c34fea700 1 -- start start 2024-05-08T21:09:46.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.292+0000 7f2c34fea700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2c30152420 0x7f2c300c7c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:46.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.292+0000 7f2c34fea700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2c30158ac0 0x7f2c300c81d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:46.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.292+0000 7f2c34fea700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c30152800 con 0x7f2c300b1c80 2024-05-08T21:09:46.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.292+0000 7f2c34fea700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c300729b0 con 0x7f2c30158ac0 2024-05-08T21:09:46.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.292+0000 7f2c34fea700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c30159020 con 0x7f2c30152420 2024-05-08T21:09:46.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.292+0000 7f2c2dd9b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2c30158ac0 0x7f2c300c81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:46.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.292+0000 7f2c2ed9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f2c300b1c80 0x7f2c300711f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40370/0 (socket says 172.21.15.80:40370) 2024-05-08T21:09:46.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.292+0000 7f2c2ed9d700 1 -- 172.21.15.80:0/546251897 learned_addr learned my addr 172.21.15.80:0/546251897 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:09:46.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.292+0000 7f2c2dd9b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2c30158ac0 0x7f2c300c81d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35118/0 (socket says 172.21.15.80:35118) 2024-05-08T21:09:46.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.292+0000 7f2c2dd9b700 1 -- 172.21.15.80:0/546251897 >> v2:172.21.15.80:3300/0 conn(0x7f2c30158ac0 msgr2=0x7f2c300c81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T21:09:46.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.292+0000 7f2c2dd9b700 1 -- 172.21.15.80:0/546251897 >> v2:172.21.15.80:3300/0 conn(0x7f2c30158ac0 msgr2=0x7f2c300c81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T21:09:46.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.292+0000 7f2c2dd9b700 1 --2- 172.21.15.80:0/546251897 >> v2:172.21.15.80:3300/0 conn(0x7f2c30158ac0 0x7f2c300c81d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T21:09:46.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.292+0000 7f2c2e59c700 1 --2- 172.21.15.80:0/546251897 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2c30152420 0x7f2c300c7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:46.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.292+0000 7f2c2dd9b700 1 --2- 172.21.15.80:0/546251897 >> v2:172.21.15.80:3300/0 conn(0x7f2c30158ac0 0x7f2c300c81d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T21:09:46.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.292+0000 7f2c2e59c700 1 -- 172.21.15.80:0/546251897 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2c30152420 msgr2=0x7f2c300c7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T21:09:46.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.292+0000 7f2c2e59c700 1 -- 172.21.15.80:0/546251897 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2c30152420 msgr2=0x7f2c300c7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T21:09:46.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.292+0000 7f2c2e59c700 1 --2- 172.21.15.80:0/546251897 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2c30152420 0x7f2c300c7c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T21:09:46.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.292+0000 7f2c2e59c700 1 --2- 172.21.15.80:0/546251897 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2c30152420 0x7f2c300c7c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T21:09:46.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.488+0000 7f2c2d59a700 1 -- 172.21.15.80:0/546251897 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2116498927 0 0) 0x7f2c30152800 con 0x7f2c300b1c80 2024-05-08T21:09:46.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.488+0000 7f2c2d59a700 1 -- 172.21.15.80:0/546251897 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c180035b0 con 0x7f2c300b1c80 2024-05-08T21:09:46.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.489+0000 7f2c2d59a700 1 -- 172.21.15.80:0/546251897 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 683983624 0 0) 0x7f2c180035b0 con 0x7f2c300b1c80 2024-05-08T21:09:46.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.489+0000 7f2c2d59a700 1 -- 172.21.15.80:0/546251897 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2c30152420 msgr2=0x7f2c300c7c90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T21:09:46.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.489+0000 7f2c2d59a700 1 --2- 172.21.15.80:0/546251897 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2c30152420 0x7f2c300c7c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:46.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.489+0000 7f2c2d59a700 1 -- 172.21.15.80:0/546251897 >> v2:172.21.15.80:3300/0 conn(0x7f2c30158ac0 msgr2=0x7f2c300c81d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T21:09:46.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.489+0000 7f2c2d59a700 1 --2- 172.21.15.80:0/546251897 >> v2:172.21.15.80:3300/0 conn(0x7f2c30158ac0 0x7f2c300c81d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:46.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.489+0000 7f2c2d59a700 1 -- 172.21.15.80:0/546251897 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c300c7800 con 0x7f2c300b1c80 2024-05-08T21:09:46.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.489+0000 7f2c2d59a700 1 -- 172.21.15.80:0/546251897 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3520646302 0 0) 0x7f2c280019f0 con 0x7f2c300b1c80 2024-05-08T21:09:46.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.489+0000 7f2c2d59a700 1 -- 172.21.15.80:0/546251897 >> v1:172.21.15.80:6789/0 conn(0x7f2c300b1c80 legacy=0x7f2c300711f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:46.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.489+0000 7f2c2d59a700 1 --2- 172.21.15.80:0/546251897 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c18003a30 0x7f2c18003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:46.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.489+0000 7f2c2d59a700 1 --2- 172.21.15.80:0/546251897 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2c30152420 0x7f2c18004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:46.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.489+0000 7f2c2d59a700 1 --2- 172.21.15.80:0/546251897 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c18004d90 0x7f2c18005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:46.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.489+0000 7f2c2d59a700 1 -- 172.21.15.80:0/546251897 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c30159020 con 0x7f2c18003a30 2024-05-08T21:09:46.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.489+0000 7f2c2d59a700 1 -- 172.21.15.80:0/546251897 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1800bb50 con 0x7f2c18004d90 2024-05-08T21:09:46.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.489+0000 7f2c2d59a700 1 -- 172.21.15.80:0/546251897 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1800bcc0 con 0x7f2c30152420 2024-05-08T21:09:46.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.489+0000 7f2c2e59c700 1 --2- 172.21.15.80:0/546251897 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c18003a30 0x7f2c18003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:46.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.489+0000 7f2c2dd9b700 1 --2- 172.21.15.80:0/546251897 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2c30152420 0x7f2c18004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:46.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.489+0000 7f2c2ed9d700 1 --2- 172.21.15.80:0/546251897 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c18004d90 0x7f2c18005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:46.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.489+0000 7f2c2e59c700 1 -- 172.21.15.80:0/546251897 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2c30152420 msgr2=0x7f2c18004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:09:46.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.489+0000 7f2c2e59c700 1 --2- 172.21.15.80:0/546251897 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2c30152420 0x7f2c18004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:46.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.489+0000 7f2c2e59c700 1 -- 172.21.15.80:0/546251897 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c18004d90 msgr2=0x7f2c18005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:09:46.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.489+0000 7f2c2e59c700 1 --2- 172.21.15.80:0/546251897 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c18004d90 0x7f2c18005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:46.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.489+0000 7f2c2e59c700 1 -- 172.21.15.80:0/546251897 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c180035b0 con 0x7f2c18003a30 2024-05-08T21:09:46.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.489+0000 7f2c2ed9d700 1 --2- 172.21.15.80:0/546251897 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c18004d90 0x7f2c18005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:09:46.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.489+0000 7f2c2dd9b700 1 --2- 172.21.15.80:0/546251897 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2c30152420 0x7f2c18004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:09:46.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.489+0000 7f2c2e59c700 1 --2- 172.21.15.80:0/546251897 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c18003a30 0x7f2c18003e50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2c20009890 tx=0x7f2c18005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6692e700d2d84ac server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:09:46.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.490+0000 7f2c2d59a700 1 -- 172.21.15.80:0/546251897 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c2000c070 con 0x7f2c18003a30 2024-05-08T21:09:46.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.490+0000 7f2c2d59a700 1 -- 172.21.15.80:0/546251897 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c20004020 con 0x7f2c18003a30 2024-05-08T21:09:46.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.490+0000 7f2c2d59a700 1 -- 172.21.15.80:0/546251897 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c200043d0 con 0x7f2c18003a30 2024-05-08T21:09:46.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.490+0000 7f2c34fea700 1 -- 172.21.15.80:0/546251897 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c18003a30 msgr2=0x7f2c18003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:46.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.490+0000 7f2c34fea700 1 --2- 172.21.15.80:0/546251897 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c18003a30 0x7f2c18003e50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2c20009890 tx=0x7f2c18005880 comp rx=0 tx=0).stop 2024-05-08T21:09:46.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.490+0000 7f2c2ed9d700 1 -- 172.21.15.80:0/546251897 reap_dead start 2024-05-08T21:09:46.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.491+0000 7f2c34fea700 1 -- 172.21.15.80:0/546251897 shutdown_connections 2024-05-08T21:09:46.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.491+0000 7f2c34fea700 1 -- 172.21.15.80:0/546251897 >> 172.21.15.80:0/546251897 conn(0x7f2c300c8980 msgr2=0x7f2c300c8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:09:46.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.491+0000 7f2c34fea700 1 -- 172.21.15.80:0/546251897 shutdown_connections 2024-05-08T21:09:46.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.491+0000 7f2c34fea700 1 -- 172.21.15.80:0/546251897 wait complete. 2024-05-08T21:09:46.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.492+0000 7f2c34fea700 1 Processor -- start 2024-05-08T21:09:46.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.493+0000 7f2c34fea700 1 -- start start 2024-05-08T21:09:46.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.493+0000 7f2c34fea700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c18003a30 0x7f2c3006b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:46.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.493+0000 7f2c34fea700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c3014f590 0x7f2c300c36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:46.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.493+0000 7f2c34fea700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2c300c3bf0 0x7f2c301469b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:46.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.493+0000 7f2c34fea700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c300c3260 con 0x7f2c18003a30 2024-05-08T21:09:46.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.493+0000 7f2c34fea700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c301f0aa0 con 0x7f2c3014f590 2024-05-08T21:09:46.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.493+0000 7f2c34fea700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c30152d10 con 0x7f2c300c3bf0 2024-05-08T21:09:46.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.493+0000 7f2c2dd9b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c3014f590 0x7f2c300c36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:46.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.493+0000 7f2c2ed9d700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2c300c3bf0 0x7f2c301469b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:46.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.493+0000 7f2c2dd9b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c3014f590 0x7f2c300c36b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.80:60704/0 (socket says 172.21.15.80:60704) 2024-05-08T21:09:46.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.493+0000 7f2c2dd9b700 1 -- 172.21.15.80:0/3885794180 learned_addr learned my addr 172.21.15.80:0/3885794180 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:09:46.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.494+0000 7f2c2dd9b700 1 -- 172.21.15.80:0/3885794180 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2c300c3bf0 msgr2=0x7f2c301469b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:46.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.494+0000 7f2c2dd9b700 1 --2- 172.21.15.80:0/3885794180 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2c300c3bf0 0x7f2c301469b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:46.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.494+0000 7f2c2dd9b700 1 -- 172.21.15.80:0/3885794180 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c18003a30 msgr2=0x7f2c3006b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:46.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.494+0000 7f2c2dd9b700 1 --2- 172.21.15.80:0/3885794180 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c18003a30 0x7f2c3006b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:46.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.494+0000 7f2c2dd9b700 1 -- 172.21.15.80:0/3885794180 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c30152ff0 con 0x7f2c3014f590 2024-05-08T21:09:46.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.494+0000 7f2c2ed9d700 1 --2- 172.21.15.80:0/3885794180 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2c300c3bf0 0x7f2c301469b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:09:46.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.494+0000 7f2c2dd9b700 1 --2- 172.21.15.80:0/3885794180 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c3014f590 0x7f2c300c36b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2c2400f680 tx=0x7f2c2400f990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:09:46.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.494+0000 7f2c1effd700 1 -- 172.21.15.80:0/3885794180 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c24014890 con 0x7f2c3014f590 2024-05-08T21:09:46.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.494+0000 7f2c1effd700 1 -- 172.21.15.80:0/3885794180 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c2400c030 con 0x7f2c3014f590 2024-05-08T21:09:46.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.494+0000 7f2c1effd700 1 -- 172.21.15.80:0/3885794180 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c24014c10 con 0x7f2c3014f590 2024-05-08T21:09:46.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.494+0000 7f2c34fea700 1 -- 172.21.15.80:0/3885794180 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c300c5a20 con 0x7f2c3014f590 2024-05-08T21:09:46.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.494+0000 7f2c34fea700 1 -- 172.21.15.80:0/3885794180 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c300c5fe0 con 0x7f2c3014f590 2024-05-08T21:09:46.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.494+0000 7f2c1effd700 1 -- 172.21.15.80:0/3885794180 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f2c2401d700 con 0x7f2c3014f590 2024-05-08T21:09:46.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.494+0000 7f2c1effd700 1 -- 172.21.15.80:0/3885794180 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f2c240134f0 con 0x7f2c3014f590 2024-05-08T21:09:46.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.495+0000 7f2c34fea700 1 -- 172.21.15.80:0/3885794180 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c3004ec60 con 0x7f2c3014f590 2024-05-08T21:09:46.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.498+0000 7f2c1effd700 1 -- 172.21.15.80:0/3885794180 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f2c24018020 con 0x7f2c3014f590 2024-05-08T21:09:46.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.592+0000 7f2c34fea700 1 -- 172.21.15.80:0/3885794180 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f2c30151f90 con 0x7f2c3014f590 2024-05-08T21:09:46.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.600+0000 7f2c1effd700 1 -- 172.21.15.80:0/3885794180 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f2c2402b020 con 0x7f2c3014f590 2024-05-08T21:09:46.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.601+0000 7f2c34fea700 1 -- 172.21.15.80:0/3885794180 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c3014f590 msgr2=0x7f2c300c36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:46.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.601+0000 7f2c34fea700 1 --2- 172.21.15.80:0/3885794180 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c3014f590 0x7f2c300c36b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2c2400f680 tx=0x7f2c2400f990 comp rx=0 tx=0).stop 2024-05-08T21:09:46.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.601+0000 7f2c34fea700 1 -- 172.21.15.80:0/3885794180 shutdown_connections 2024-05-08T21:09:46.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.601+0000 7f2c34fea700 1 --2- 172.21.15.80:0/3885794180 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c18003a30 0x7f2c3006b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:46.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.601+0000 7f2c34fea700 1 --2- 172.21.15.80:0/3885794180 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2c300c3bf0 0x7f2c301469b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:46.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.601+0000 7f2c34fea700 1 --2- 172.21.15.80:0/3885794180 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c3014f590 0x7f2c300c36b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:46.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.601+0000 7f2c34fea700 1 -- 172.21.15.80:0/3885794180 >> 172.21.15.80:0/3885794180 conn(0x7f2c300c8980 msgr2=0x7f2c30158390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:09:46.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.601+0000 7f2c34fea700 1 -- 172.21.15.80:0/3885794180 shutdown_connections 2024-05-08T21:09:46.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:46.601+0000 7f2c34fea700 1 -- 172.21.15.80:0/3885794180 wait complete. 2024-05-08T21:09:46.606 INFO:teuthology.orchestra.run.smithi080.stderr:adjusted tunables profile to default 2024-05-08T21:09:46.616 INFO:tasks.ceph:check_enable_crimson: False 2024-05-08T21:09:46.616 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-05-08T21:09:46.617 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T21:09:46.617 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-05-08T21:09:46.643 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T21:09:46.643 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-05-08T21:09:46.710 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T21:09:46.710 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-05-08T21:09:46.777 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T21:09:46.777 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-05-08T21:09:46.843 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-08T21:09:46.843 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-05-08T21:09:46.871 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-08T21:09:46.871 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-05-08T21:09:46.929 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-08T21:09:46.926+0000 7fdcd819f200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-08T21:09:46.941 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-08T21:09:46.941 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-05-08T21:09:47.007 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-08T21:09:47.007 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-05-08T21:09:47.009 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-08T21:09:47.005+0000 7fdcd819f200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-08T21:09:47.076 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph osd new c3f9d93e-ed6d-4a0c-b5c0-0e8d44c65fdd 0 2024-05-08T21:09:47.081 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-08T21:09:47.078+0000 7fdcd819f200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-08T21:09:47.152 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-08T21:09:47.149+0000 7fdcd819f200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-08T21:09:47.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.255+0000 7f89d5e38700 1 Processor -- start 2024-05-08T21:09:47.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.255+0000 7f89d5e38700 1 -- start start 2024-05-08T21:09:47.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.256+0000 7f89d5e38700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f89d0150900 0x7f89d00c6c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:47.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.256+0000 7f89d5e38700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f89d0159be0 0x7f89d015a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:47.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.256+0000 7f89d5e38700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89d00c5ab0 con 0x7f89d00ccd80 2024-05-08T21:09:47.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.256+0000 7f89d5e38700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89d00c6790 con 0x7f89d0150900 2024-05-08T21:09:47.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.256+0000 7f89d5e38700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89d006b470 con 0x7f89d0159be0 2024-05-08T21:09:47.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.257+0000 7f89cffff700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f89d0159be0 0x7f89d015a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:47.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.257+0000 7f89ceffd700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f89d00ccd80 0x7f89d00c75d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:58308/0 (socket says 172.21.15.106:58308) 2024-05-08T21:09:47.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.257+0000 7f89ceffd700 1 -- 172.21.15.106:0/3248326958 learned_addr learned my addr 172.21.15.106:0/3248326958 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-05-08T21:09:47.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.257+0000 7f89cf7fe700 1 --2- 172.21.15.106:0/3248326958 >> v2:172.21.15.80:3300/0 conn(0x7f89d0150900 0x7f89d00c6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:47.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.257+0000 7f89cffff700 1 -- 172.21.15.106:0/3248326958 >> v2:172.21.15.80:3300/0 conn(0x7f89d0150900 msgr2=0x7f89d00c6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:09:47.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.257+0000 7f89cffff700 1 --2- 172.21.15.106:0/3248326958 >> v2:172.21.15.80:3300/0 conn(0x7f89d0150900 0x7f89d00c6c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:47.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.257+0000 7f89ce7fc700 1 -- 172.21.15.106:0/3248326958 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3297073700 0 0) 0x7f89d00c5ab0 con 0x7f89d00ccd80 2024-05-08T21:09:47.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.257+0000 7f89cffff700 1 -- 172.21.15.106:0/3248326958 >> v1:172.21.15.106:6789/0 conn(0x7f89d00ccd80 legacy=0x7f89d00c75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:47.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.257+0000 7f89cffff700 1 -- 172.21.15.106:0/3248326958 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d015a590 con 0x7f89d0159be0 2024-05-08T21:09:47.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.257+0000 7f89cffff700 1 --2- 172.21.15.106:0/3248326958 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f89d0159be0 0x7f89d015a050 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f89d00736d0 tx=0x7f89c000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=acabd216d62f3df5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:09:47.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.257+0000 7f89ce7fc700 1 -- 172.21.15.106:0/3248326958 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c000e070 con 0x7f89d0159be0 2024-05-08T21:09:47.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.257+0000 7f89ce7fc700 1 -- 172.21.15.106:0/3248326958 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89c000bb20 con 0x7f89d0159be0 2024-05-08T21:09:47.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.257+0000 7f89ce7fc700 1 -- 172.21.15.106:0/3248326958 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c0012430 con 0x7f89d0159be0 2024-05-08T21:09:47.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.258+0000 7f89d5e38700 1 -- 172.21.15.106:0/3248326958 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f89d0159be0 msgr2=0x7f89d015a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:47.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.258+0000 7f89d5e38700 1 --2- 172.21.15.106:0/3248326958 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f89d0159be0 0x7f89d015a050 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f89d00736d0 tx=0x7f89c000b330 comp rx=0 tx=0).stop 2024-05-08T21:09:47.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.258+0000 7f89d5e38700 1 -- 172.21.15.106:0/3248326958 shutdown_connections 2024-05-08T21:09:47.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.258+0000 7f89d5e38700 1 --2- 172.21.15.106:0/3248326958 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f89d0159be0 0x7f89d015a050 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:47.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.258+0000 7f89d5e38700 1 --2- 172.21.15.106:0/3248326958 >> v2:172.21.15.80:3300/0 conn(0x7f89d0150900 0x7f89d00c6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:47.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.258+0000 7f89d5e38700 1 -- 172.21.15.106:0/3248326958 >> 172.21.15.106:0/3248326958 conn(0x7f89d00cc260 msgr2=0x7f89d00cc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:09:47.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.258+0000 7f89d5e38700 1 -- 172.21.15.106:0/3248326958 shutdown_connections 2024-05-08T21:09:47.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.258+0000 7f89d5e38700 1 -- 172.21.15.106:0/3248326958 wait complete. 2024-05-08T21:09:47.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.259+0000 7f89d5e38700 1 Processor -- start 2024-05-08T21:09:47.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.259+0000 7f89d5e38700 1 -- start start 2024-05-08T21:09:47.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.260+0000 7f89d5e38700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f89d00ccd80 0x7f89d0148110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:47.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.260+0000 7f89d5e38700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f89d0150900 0x7f89d0156ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:47.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.260+0000 7f89d5e38700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f89d0159be0 0x7f89d00ca700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:47.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.260+0000 7f89d5e38700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89d0152860 con 0x7f89d0150900 2024-05-08T21:09:47.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.260+0000 7f89d5e38700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89d01ef740 con 0x7f89d00ccd80 2024-05-08T21:09:47.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.260+0000 7f89d5e38700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89d0153120 con 0x7f89d0159be0 2024-05-08T21:09:47.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.260+0000 7f89cf7fe700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f89d00ccd80 0x7f89d0148110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:47.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.260+0000 7f89cf7fe700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f89d00ccd80 0x7f89d0148110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:38086/0 (socket says 172.21.15.106:38086) 2024-05-08T21:09:47.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.260+0000 7f89cffff700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f89d0159be0 0x7f89d00ca700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:47.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.260+0000 7f89cf7fe700 1 -- 172.21.15.106:0/297102100 learned_addr learned my addr 172.21.15.106:0/297102100 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-05-08T21:09:47.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.260+0000 7f89ceffd700 1 --2- 172.21.15.106:0/297102100 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f89d0150900 0x7f89d0156ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:47.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.261+0000 7f89cf7fe700 1 -- 172.21.15.106:0/297102100 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f89d0159be0 msgr2=0x7f89d00ca700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:47.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.261+0000 7f89cf7fe700 1 --2- 172.21.15.106:0/297102100 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f89d0159be0 0x7f89d00ca700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:47.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.261+0000 7f89cf7fe700 1 -- 172.21.15.106:0/297102100 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f89d0150900 msgr2=0x7f89d0156ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:47.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.261+0000 7f89cf7fe700 1 --2- 172.21.15.106:0/297102100 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f89d0150900 0x7f89d0156ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:47.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.261+0000 7f89cf7fe700 1 -- 172.21.15.106:0/297102100 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89c0009a70 con 0x7f89d00ccd80 2024-05-08T21:09:47.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.261+0000 7f89cffff700 1 --2- 172.21.15.106:0/297102100 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f89d0159be0 0x7f89d00ca700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:09:47.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.261+0000 7f89cf7fe700 1 --2- 172.21.15.106:0/297102100 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f89d00ccd80 0x7f89d0148110 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f89c800ea00 tx=0x7f89c800ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:09:47.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.261+0000 7f89c7fff700 1 -- 172.21.15.106:0/297102100 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c8009730 con 0x7f89d00ccd80 2024-05-08T21:09:47.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.261+0000 7f89c7fff700 1 -- 172.21.15.106:0/297102100 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89c800eea0 con 0x7f89d00ccd80 2024-05-08T21:09:47.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.261+0000 7f89d5e38700 1 -- 172.21.15.106:0/297102100 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89d00c3850 con 0x7f89d00ccd80 2024-05-08T21:09:47.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.261+0000 7f89c7fff700 1 -- 172.21.15.106:0/297102100 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c800ca70 con 0x7f89d00ccd80 2024-05-08T21:09:47.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.261+0000 7f89d5e38700 1 -- 172.21.15.106:0/297102100 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89d0153650 con 0x7f89d00ccd80 2024-05-08T21:09:47.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.261+0000 7f89c7fff700 1 -- 172.21.15.106:0/297102100 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f89c8013470 con 0x7f89d00ccd80 2024-05-08T21:09:47.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.261+0000 7f89c7fff700 1 -- 172.21.15.106:0/297102100 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f89c801ca00 con 0x7f89d00ccd80 2024-05-08T21:09:47.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.262+0000 7f89d5e38700 1 -- 172.21.15.106:0/297102100 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89d004ec60 con 0x7f89d00ccd80 2024-05-08T21:09:47.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.264+0000 7f89c7fff700 1 -- 172.21.15.106:0/297102100 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f89c8021060 con 0x7f89d00ccd80 2024-05-08T21:09:47.324 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-08T21:09:47.320+0000 7fdcd819f200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-08T21:09:47.328 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-05-08T21:09:47.325+0000 7f8d54405200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-08T21:09:47.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.350+0000 7f89d5e38700 1 -- 172.21.15.106:0/297102100 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c3f9d93e-ed6d-4a0c-b5c0-0e8d44c65fdd", "id": 0} v 0) v1 -- 0x7f89d0157ae0 con 0x7f89d00ccd80 2024-05-08T21:09:47.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.358+0000 7f89c7fff700 1 -- 172.21.15.106:0/297102100 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c3f9d93e-ed6d-4a0c-b5c0-0e8d44c65fdd", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f89c8017070 con 0x7f89d00ccd80 2024-05-08T21:09:47.361 INFO:teuthology.orchestra.run.smithi106.stdout:0 2024-05-08T21:09:47.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.359+0000 7f89d5e38700 1 -- 172.21.15.106:0/297102100 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f89d00ccd80 msgr2=0x7f89d0148110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:47.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.359+0000 7f89d5e38700 1 --2- 172.21.15.106:0/297102100 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f89d00ccd80 0x7f89d0148110 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f89c800ea00 tx=0x7f89c800ed10 comp rx=0 tx=0).stop 2024-05-08T21:09:47.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.359+0000 7f89d5e38700 1 -- 172.21.15.106:0/297102100 shutdown_connections 2024-05-08T21:09:47.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.359+0000 7f89d5e38700 1 --2- 172.21.15.106:0/297102100 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f89d0159be0 0x7f89d00ca700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:47.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.359+0000 7f89d5e38700 1 --2- 172.21.15.106:0/297102100 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f89d00ccd80 0x7f89d0148110 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:47.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.359+0000 7f89d5e38700 1 --2- 172.21.15.106:0/297102100 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f89d0150900 0x7f89d0156ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:47.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.359+0000 7f89d5e38700 1 -- 172.21.15.106:0/297102100 >> 172.21.15.106:0/297102100 conn(0x7f89d00cc260 msgr2=0x7f89d0071c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:09:47.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.359+0000 7f89d5e38700 1 -- 172.21.15.106:0/297102100 shutdown_connections 2024-05-08T21:09:47.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.359+0000 7f89d5e38700 1 -- 172.21.15.106:0/297102100 wait complete. 2024-05-08T21:09:47.375 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph osd new 4ce2b4d6-6c40-43aa-8dd1-743fef8915df 1 2024-05-08T21:09:47.413 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-05-08T21:09:47.410+0000 7f8d54405200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-08T21:09:47.489 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-08T21:09:47.486+0000 7fdcd819f200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-08T21:09:47.490 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-05-08T21:09:47.487+0000 7f8d54405200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-08T21:09:47.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.495+0000 7f771e2c6700 1 Processor -- start 2024-05-08T21:09:47.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.495+0000 7f771e2c6700 1 -- start start 2024-05-08T21:09:47.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.495+0000 7f771e2c6700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7718151110 0x7f771806c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:47.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.495+0000 7f771e2c6700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f77181514f0 0x7f77180ccdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:47.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.495+0000 7f771e2c6700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7718066900 con 0x7f77181579e0 2024-05-08T21:09:47.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.495+0000 7f771e2c6700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7718066ec0 con 0x7f7718151110 2024-05-08T21:09:47.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.495+0000 7f771e2c6700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7718066be0 con 0x7f77181514f0 2024-05-08T21:09:47.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.496+0000 7f77177fe700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f77181514f0 0x7f77180ccdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:47.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.496+0000 7f7717fff700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7718151110 0x7f771806c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:47.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.496+0000 7f77177fe700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f77181514f0 0x7f77180ccdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.106:45794/0 (socket says 172.21.15.106:45794) 2024-05-08T21:09:47.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.496+0000 7f77177fe700 1 -- 172.21.15.106:0/2068565352 learned_addr learned my addr 172.21.15.106:0/2068565352 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-05-08T21:09:47.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.496+0000 7f77177fe700 1 -- 172.21.15.106:0/2068565352 >> v2:172.21.15.106:3300/0 conn(0x7f7718151110 msgr2=0x7f771806c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:09:47.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.496+0000 7f77177fe700 1 --2- 172.21.15.106:0/2068565352 >> v2:172.21.15.106:3300/0 conn(0x7f7718151110 0x7f771806c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:47.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.496+0000 7f77177fe700 1 -- 172.21.15.106:0/2068565352 >> v1:172.21.15.80:6789/0 conn(0x7f77181579e0 legacy=0x7f771806b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:47.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.496+0000 7f77177fe700 1 -- 172.21.15.106:0/2068565352 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f771806ab60 con 0x7f77181514f0 2024-05-08T21:09:47.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.496+0000 7f77177fe700 1 --2- 172.21.15.106:0/2068565352 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f77181514f0 0x7f77180ccdc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f770c0098f0 tx=0x7f770c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5790c709e5b5074f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:09:47.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.496+0000 7f7716ffd700 1 -- 172.21.15.106:0/2068565352 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770c011830 con 0x7f77181514f0 2024-05-08T21:09:47.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.496+0000 7f7716ffd700 1 -- 172.21.15.106:0/2068565352 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f770c011990 con 0x7f77181514f0 2024-05-08T21:09:47.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.496+0000 7f7716ffd700 1 -- 172.21.15.106:0/2068565352 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770c011d20 con 0x7f77181514f0 2024-05-08T21:09:47.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.497+0000 7f771e2c6700 1 -- 172.21.15.106:0/2068565352 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f77181514f0 msgr2=0x7f77180ccdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:47.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.497+0000 7f771e2c6700 1 --2- 172.21.15.106:0/2068565352 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f77181514f0 0x7f77180ccdc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f770c0098f0 tx=0x7f770c009c00 comp rx=0 tx=0).stop 2024-05-08T21:09:47.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.497+0000 7f771e2c6700 1 -- 172.21.15.106:0/2068565352 shutdown_connections 2024-05-08T21:09:47.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.497+0000 7f771e2c6700 1 --2- 172.21.15.106:0/2068565352 >> v2:172.21.15.106:3300/0 conn(0x7f7718151110 0x7f771806c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:47.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.497+0000 7f771e2c6700 1 --2- 172.21.15.106:0/2068565352 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f77181514f0 0x7f77180ccdc0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:47.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.497+0000 7f771e2c6700 1 -- 172.21.15.106:0/2068565352 >> 172.21.15.106:0/2068565352 conn(0x7f77180cc260 msgr2=0x7f77180cc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:09:47.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.497+0000 7f771e2c6700 1 -- 172.21.15.106:0/2068565352 shutdown_connections 2024-05-08T21:09:47.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.497+0000 7f771e2c6700 1 -- 172.21.15.106:0/2068565352 wait complete. 2024-05-08T21:09:47.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.498+0000 7f771e2c6700 1 Processor -- start 2024-05-08T21:09:47.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.498+0000 7f771e2c6700 1 -- start start 2024-05-08T21:09:47.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.499+0000 7f771e2c6700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7718151110 0x7f771814fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:47.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.499+0000 7f771e2c6700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f77181514f0 0x7f77181e19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:47.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.499+0000 7f771e2c6700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f77181579e0 0x7f77181dded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:47.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.499+0000 7f771e2c6700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77181f0650 con 0x7f77181579e0 2024-05-08T21:09:47.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.499+0000 7f771e2c6700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77181f3cf0 con 0x7f7718151110 2024-05-08T21:09:47.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.499+0000 7f771e2c6700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77181f3f90 con 0x7f77181514f0 2024-05-08T21:09:47.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.499+0000 7f77177fe700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f77181514f0 0x7f77181e19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:47.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.499+0000 7f7717fff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7718151110 0x7f771814fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:47.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.499+0000 7f77177fe700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f77181514f0 0x7f77181e19a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.106:45802/0 (socket says 172.21.15.106:45802) 2024-05-08T21:09:47.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.499+0000 7f77177fe700 1 -- 172.21.15.106:0/2126449191 learned_addr learned my addr 172.21.15.106:0/2126449191 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-05-08T21:09:47.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.499+0000 7f771c863700 1 --2- 172.21.15.106:0/2126449191 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f77181579e0 0x7f77181dded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:47.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.499+0000 7f77177fe700 1 -- 172.21.15.106:0/2126449191 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7718151110 msgr2=0x7f771814fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:47.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.499+0000 7f77177fe700 1 --2- 172.21.15.106:0/2126449191 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7718151110 0x7f771814fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:47.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.499+0000 7f77177fe700 1 -- 172.21.15.106:0/2126449191 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f77181579e0 msgr2=0x7f77181dded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:47.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.499+0000 7f77177fe700 1 --2- 172.21.15.106:0/2126449191 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f77181579e0 0x7f77181dded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:47.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.499+0000 7f77177fe700 1 -- 172.21.15.106:0/2126449191 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f770c009550 con 0x7f77181514f0 2024-05-08T21:09:47.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.499+0000 7f7717fff700 1 --2- 172.21.15.106:0/2126449191 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7718151110 0x7f771814fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:09:47.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.500+0000 7f77177fe700 1 --2- 172.21.15.106:0/2126449191 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f77181514f0 0x7f77181e19a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f770c000c00 tx=0x7f770c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:09:47.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.500+0000 7f7714ff9700 1 -- 172.21.15.106:0/2126449191 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770c004400 con 0x7f77181514f0 2024-05-08T21:09:47.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.500+0000 7f7714ff9700 1 -- 172.21.15.106:0/2126449191 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f770c01f070 con 0x7f77181514f0 2024-05-08T21:09:47.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.500+0000 7f771e2c6700 1 -- 172.21.15.106:0/2126449191 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77181eff90 con 0x7f77181514f0 2024-05-08T21:09:47.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.500+0000 7f7714ff9700 1 -- 172.21.15.106:0/2126449191 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770c0038e0 con 0x7f77181514f0 2024-05-08T21:09:47.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.500+0000 7f771e2c6700 1 -- 172.21.15.106:0/2126449191 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77181efc40 con 0x7f77181514f0 2024-05-08T21:09:47.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.500+0000 7f7714ff9700 1 -- 172.21.15.106:0/2126449191 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f770c021030 con 0x7f77181514f0 2024-05-08T21:09:47.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.500+0000 7f7714ff9700 1 -- 172.21.15.106:0/2126449191 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f770c01a990 con 0x7f77181514f0 2024-05-08T21:09:47.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.501+0000 7f771e2c6700 1 -- 172.21.15.106:0/2126449191 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77181efdd0 con 0x7f77181514f0 2024-05-08T21:09:47.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.503+0000 7f7714ff9700 1 -- 172.21.15.106:0/2126449191 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f770c015020 con 0x7f77181514f0 2024-05-08T21:09:47.591 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-05-08T21:09:47.588+0000 7f8d54405200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-08T21:09:47.599 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-08T21:09:47.596+0000 7fdcd819f200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-08T21:09:47.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.622+0000 7f771e2c6700 1 -- 172.21.15.106:0/2126449191 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "osd new", "uuid": "4ce2b4d6-6c40-43aa-8dd1-743fef8915df", "id": 1} v 0) v1 -- 0x7f771804ec60 con 0x7f77181514f0 2024-05-08T21:09:47.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.630+0000 7f7714ff9700 1 -- 172.21.15.106:0/2126449191 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4ce2b4d6-6c40-43aa-8dd1-743fef8915df", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f770c01a450 con 0x7f77181514f0 2024-05-08T21:09:47.633 INFO:teuthology.orchestra.run.smithi106.stdout:1 2024-05-08T21:09:47.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.631+0000 7f771e2c6700 1 -- 172.21.15.106:0/2126449191 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f77181514f0 msgr2=0x7f77181e19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:47.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.631+0000 7f771e2c6700 1 --2- 172.21.15.106:0/2126449191 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f77181514f0 0x7f77181e19a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f770c000c00 tx=0x7f770c004750 comp rx=0 tx=0).stop 2024-05-08T21:09:47.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.631+0000 7f771e2c6700 1 -- 172.21.15.106:0/2126449191 shutdown_connections 2024-05-08T21:09:47.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.631+0000 7f771e2c6700 1 --2- 172.21.15.106:0/2126449191 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f77181579e0 0x7f77181dded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:47.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.631+0000 7f771e2c6700 1 --2- 172.21.15.106:0/2126449191 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7718151110 0x7f771814fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:47.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.631+0000 7f771e2c6700 1 --2- 172.21.15.106:0/2126449191 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f77181514f0 0x7f77181e19a0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:47.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.631+0000 7f771e2c6700 1 -- 172.21.15.106:0/2126449191 >> 172.21.15.106:0/2126449191 conn(0x7f77180cc260 msgr2=0x7f771806b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:09:47.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.631+0000 7f771e2c6700 1 -- 172.21.15.106:0/2126449191 shutdown_connections 2024-05-08T21:09:47.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.631+0000 7f771e2c6700 1 -- 172.21.15.106:0/2126449191 wait complete. 2024-05-08T21:09:47.646 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph osd new e30cc3bc-6461-4fac-960a-de00c9488d6d 2 2024-05-08T21:09:47.693 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-08T21:09:47.690+0000 7fdcd819f200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-08T21:09:47.769 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-08T21:09:47.766+0000 7fdcd819f200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-08T21:09:47.773 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-05-08T21:09:47.770+0000 7f8d54405200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-08T21:09:47.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.806+0000 7f270fc6b700 1 Processor -- start 2024-05-08T21:09:47.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.807+0000 7f270fc6b700 1 -- start start 2024-05-08T21:09:47.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.807+0000 7f270fc6b700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f2708152350 0x7f270815b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:47.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.807+0000 7f270fc6b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f27080c5d40 0x7f27080c61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:47.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.807+0000 7f270fc6b700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f270806f3d0 con 0x7f270806f860 2024-05-08T21:09:47.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.807+0000 7f270fc6b700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2708152730 con 0x7f27080c5d40 2024-05-08T21:09:47.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.807+0000 7f270fc6b700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f270806ac80 con 0x7f2708152350 2024-05-08T21:09:47.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.807+0000 7f270da07700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f2708152350 0x7f270815b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:47.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.807+0000 7f270da07700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f2708152350 0x7f270815b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:38112/0 (socket says 172.21.15.106:38112) 2024-05-08T21:09:47.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.807+0000 7f270d206700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f270806f860 0x7f27080c8770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:58318/0 (socket says 172.21.15.106:58318) 2024-05-08T21:09:47.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.807+0000 7f270da07700 1 -- 172.21.15.106:0/1229387657 learned_addr learned my addr 172.21.15.106:0/1229387657 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-05-08T21:09:47.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.808+0000 7f270e208700 1 --2- 172.21.15.106:0/1229387657 >> v2:172.21.15.80:3300/0 conn(0x7f27080c5d40 0x7f27080c61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:47.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.808+0000 7f270da07700 1 -- 172.21.15.106:0/1229387657 >> v2:172.21.15.80:3300/0 conn(0x7f27080c5d40 msgr2=0x7f27080c61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:09:47.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.808+0000 7f270da07700 1 --2- 172.21.15.106:0/1229387657 >> v2:172.21.15.80:3300/0 conn(0x7f27080c5d40 0x7f27080c61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:47.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.808+0000 7f270da07700 1 -- 172.21.15.106:0/1229387657 >> v1:172.21.15.106:6789/0 conn(0x7f270806f860 legacy=0x7f27080c8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:47.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.808+0000 7f270da07700 1 -- 172.21.15.106:0/1229387657 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27080c8e80 con 0x7f2708152350 2024-05-08T21:09:47.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.808+0000 7f270e208700 1 --2- 172.21.15.106:0/1229387657 >> v2:172.21.15.80:3300/0 conn(0x7f27080c5d40 0x7f27080c61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:09:47.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.808+0000 7f270da07700 1 --2- 172.21.15.106:0/1229387657 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2708152350 0x7f270815b4e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f27080c7710 tx=0x7f2704009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74aa139f41360a85 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:09:47.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.808+0000 7f270ca05700 1 -- 172.21.15.106:0/1229387657 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270400b870 con 0x7f2708152350 2024-05-08T21:09:47.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.808+0000 7f270ca05700 1 -- 172.21.15.106:0/1229387657 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f270400b9d0 con 0x7f2708152350 2024-05-08T21:09:47.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.808+0000 7f270ca05700 1 -- 172.21.15.106:0/1229387657 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270400bd60 con 0x7f2708152350 2024-05-08T21:09:47.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.809+0000 7f270fc6b700 1 -- 172.21.15.106:0/1229387657 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2708152350 msgr2=0x7f270815b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:47.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.809+0000 7f270fc6b700 1 --2- 172.21.15.106:0/1229387657 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2708152350 0x7f270815b4e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f27080c7710 tx=0x7f2704009bd0 comp rx=0 tx=0).stop 2024-05-08T21:09:47.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.809+0000 7f270fc6b700 1 -- 172.21.15.106:0/1229387657 shutdown_connections 2024-05-08T21:09:47.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.809+0000 7f270fc6b700 1 --2- 172.21.15.106:0/1229387657 >> v2:172.21.15.80:3300/0 conn(0x7f27080c5d40 0x7f27080c61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:47.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.809+0000 7f270fc6b700 1 --2- 172.21.15.106:0/1229387657 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2708152350 0x7f270815b4e0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:47.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.809+0000 7f270fc6b700 1 -- 172.21.15.106:0/1229387657 >> 172.21.15.106:0/1229387657 conn(0x7f27080c9310 msgr2=0x7f27080c9720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:09:47.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.809+0000 7f270fc6b700 1 -- 172.21.15.106:0/1229387657 shutdown_connections 2024-05-08T21:09:47.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.809+0000 7f270fc6b700 1 -- 172.21.15.106:0/1229387657 wait complete. 2024-05-08T21:09:47.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.810+0000 7f270fc6b700 1 Processor -- start 2024-05-08T21:09:47.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.810+0000 7f270fc6b700 1 -- start start 2024-05-08T21:09:47.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.811+0000 7f270fc6b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f270806f860 0x7f2708072d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:47.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.811+0000 7f270fc6b700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f27080c5d40 0x7f27080cb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:47.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.811+0000 7f270fc6b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2708152350 0x7f27080cba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:47.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.811+0000 7f270fc6b700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27080cc420 con 0x7f270806f860 2024-05-08T21:09:47.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.811+0000 7f270fc6b700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2708145d30 con 0x7f2708152350 2024-05-08T21:09:47.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.811+0000 7f270fc6b700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27080732d0 con 0x7f27080c5d40 2024-05-08T21:09:47.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.811+0000 7f270e208700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2708152350 0x7f27080cba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:47.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.811+0000 7f270d206700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f27080c5d40 0x7f27080cb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:47.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.811+0000 7f270e208700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2708152350 0x7f27080cba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:38124/0 (socket says 172.21.15.106:38124) 2024-05-08T21:09:47.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.811+0000 7f270e208700 1 -- 172.21.15.106:0/769708515 learned_addr learned my addr 172.21.15.106:0/769708515 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-05-08T21:09:47.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.811+0000 7f270da07700 1 --2- 172.21.15.106:0/769708515 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f270806f860 0x7f2708072d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:47.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.811+0000 7f270d206700 1 -- 172.21.15.106:0/769708515 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2708152350 msgr2=0x7f27080cba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:47.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.811+0000 7f270d206700 1 --2- 172.21.15.106:0/769708515 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2708152350 0x7f27080cba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:47.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.811+0000 7f270d206700 1 -- 172.21.15.106:0/769708515 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f270806f860 msgr2=0x7f2708072d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:47.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.811+0000 7f270d206700 1 --2- 172.21.15.106:0/769708515 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f270806f860 0x7f2708072d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:47.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.811+0000 7f270d206700 1 -- 172.21.15.106:0/769708515 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2704009550 con 0x7f27080c5d40 2024-05-08T21:09:47.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.811+0000 7f270d206700 1 --2- 172.21.15.106:0/769708515 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f27080c5d40 0x7f27080cb4c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f26f800c450 tx=0x7f26f800c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:09:47.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.811+0000 7f26fe7fc700 1 -- 172.21.15.106:0/769708515 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f8005cb0 con 0x7f27080c5d40 2024-05-08T21:09:47.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.811+0000 7f26fe7fc700 1 -- 172.21.15.106:0/769708515 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26f8005e10 con 0x7f27080c5d40 2024-05-08T21:09:47.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.811+0000 7f26fe7fc700 1 -- 172.21.15.106:0/769708515 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f80072d0 con 0x7f27080c5d40 2024-05-08T21:09:47.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.811+0000 7f270fc6b700 1 -- 172.21.15.106:0/769708515 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2708145750 con 0x7f27080c5d40 2024-05-08T21:09:47.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.811+0000 7f270fc6b700 1 -- 172.21.15.106:0/769708515 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27081591c0 con 0x7f27080c5d40 2024-05-08T21:09:47.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.812+0000 7f26fe7fc700 1 -- 172.21.15.106:0/769708515 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f26f801c440 con 0x7f27080c5d40 2024-05-08T21:09:47.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.812+0000 7f26fe7fc700 1 -- 172.21.15.106:0/769708515 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f26f8012820 con 0x7f27080c5d40 2024-05-08T21:09:47.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.812+0000 7f270fc6b700 1 -- 172.21.15.106:0/769708515 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2708072ab0 con 0x7f27080c5d40 2024-05-08T21:09:47.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.814+0000 7f26fe7fc700 1 -- 172.21.15.106:0/769708515 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f26f8021060 con 0x7f27080c5d40 2024-05-08T21:09:47.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.913+0000 7f270fc6b700 1 -- 172.21.15.106:0/769708515 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e30cc3bc-6461-4fac-960a-de00c9488d6d", "id": 2} v 0) v1 -- 0x7f270804ec60 con 0x7f27080c5d40 2024-05-08T21:09:47.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.922+0000 7f26fe7fc700 1 -- 172.21.15.106:0/769708515 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e30cc3bc-6461-4fac-960a-de00c9488d6d", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f26f8017070 con 0x7f27080c5d40 2024-05-08T21:09:47.926 INFO:teuthology.orchestra.run.smithi106.stdout:2 2024-05-08T21:09:47.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.923+0000 7f270fc6b700 1 -- 172.21.15.106:0/769708515 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f27080c5d40 msgr2=0x7f27080cb4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:47.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.923+0000 7f270fc6b700 1 --2- 172.21.15.106:0/769708515 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f27080c5d40 0x7f27080cb4c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f26f800c450 tx=0x7f26f800c760 comp rx=0 tx=0).stop 2024-05-08T21:09:47.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.923+0000 7f270fc6b700 1 -- 172.21.15.106:0/769708515 shutdown_connections 2024-05-08T21:09:47.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.923+0000 7f270fc6b700 1 --2- 172.21.15.106:0/769708515 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f270806f860 0x7f2708072d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:47.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.923+0000 7f270fc6b700 1 --2- 172.21.15.106:0/769708515 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2708152350 0x7f27080cba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:47.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.923+0000 7f270fc6b700 1 --2- 172.21.15.106:0/769708515 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f27080c5d40 0x7f27080cb4c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:47.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.923+0000 7f270fc6b700 1 -- 172.21.15.106:0/769708515 >> 172.21.15.106:0/769708515 conn(0x7f27080c9310 msgr2=0x7f27080c96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:09:47.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.923+0000 7f270fc6b700 1 -- 172.21.15.106:0/769708515 shutdown_connections 2024-05-08T21:09:47.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:47.923+0000 7f270fc6b700 1 -- 172.21.15.106:0/769708515 wait complete. 2024-05-08T21:09:47.939 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph osd new a415c099-9ea6-40be-98ed-f2932f98dfd9 3 2024-05-08T21:09:47.961 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-05-08T21:09:47.958+0000 7f8d54405200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-08T21:09:47.991 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-08T21:09:47.988+0000 7fdcd819f200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-08T21:09:48.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.058+0000 7f4ef6f5d700 1 Processor -- start 2024-05-08T21:09:48.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.058+0000 7f4ef6f5d700 1 -- start start 2024-05-08T21:09:48.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.059+0000 7f4ef6f5d700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4ef00c9860 0x7f4ef015a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:48.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.059+0000 7f4ef6f5d700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ef00c8cc0 con 0x7f4ef0072600 2024-05-08T21:09:48.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.059+0000 7f4ef6f5d700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ef015e710 con 0x7f4ef01541a0 2024-05-08T21:09:48.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.059+0000 7f4ef6f5d700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ef006c5a0 con 0x7f4ef00c9860 2024-05-08T21:09:48.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.059+0000 7f4eeffff700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4ef00c9860 0x7f4ef015a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:48.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.059+0000 7f4ef4cf9700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f4ef01541a0 0x7f4ef00c9150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:58328/0 (socket says 172.21.15.106:58328) 2024-05-08T21:09:48.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.059+0000 7f4ef4cf9700 1 -- 172.21.15.106:0/2158010758 learned_addr learned my addr 172.21.15.106:0/2158010758 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-05-08T21:09:48.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.059+0000 7f4eeffff700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4ef00c9860 0x7f4ef015a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:38130/0 (socket says 172.21.15.106:38130) 2024-05-08T21:09:48.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.059+0000 7f4eeffff700 1 -- 172.21.15.106:0/2158010758 >> v1:172.21.15.106:6789/0 conn(0x7f4ef01541a0 legacy=0x7f4ef00c9150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:48.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.059+0000 7f4eeffff700 1 -- 172.21.15.106:0/2158010758 >> v1:172.21.15.80:6789/0 conn(0x7f4ef0072600 legacy=0x7f4ef0072a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:48.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.059+0000 7f4eeffff700 1 -- 172.21.15.106:0/2158010758 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef015dbb0 con 0x7f4ef00c9860 2024-05-08T21:09:48.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.059+0000 7f4eef7fe700 1 -- 172.21.15.106:0/2158010758 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4276474206 0 0) 0x7f4ef015e710 con 0x7f4ef01541a0 2024-05-08T21:09:48.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.060+0000 7f4eeffff700 1 --2- 172.21.15.106:0/2158010758 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ef00c9860 0x7f4ef015a1a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4edc009840 tx=0x7f4edc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a077d661b5671f4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:09:48.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.060+0000 7f4eef7fe700 1 -- 172.21.15.106:0/2158010758 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4edc011830 con 0x7f4ef00c9860 2024-05-08T21:09:48.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.060+0000 7f4eef7fe700 1 -- 172.21.15.106:0/2158010758 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4edc011990 con 0x7f4ef00c9860 2024-05-08T21:09:48.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.060+0000 7f4eef7fe700 1 -- 172.21.15.106:0/2158010758 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4edc011d20 con 0x7f4ef00c9860 2024-05-08T21:09:48.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.060+0000 7f4ef6f5d700 1 -- 172.21.15.106:0/2158010758 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ef00c9860 msgr2=0x7f4ef015a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:48.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.060+0000 7f4ef6f5d700 1 --2- 172.21.15.106:0/2158010758 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ef00c9860 0x7f4ef015a1a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4edc009840 tx=0x7f4edc009b50 comp rx=0 tx=0).stop 2024-05-08T21:09:48.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.060+0000 7f4ef6f5d700 1 -- 172.21.15.106:0/2158010758 shutdown_connections 2024-05-08T21:09:48.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.060+0000 7f4ef6f5d700 1 --2- 172.21.15.106:0/2158010758 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ef00c9860 0x7f4ef015a1a0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:48.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.060+0000 7f4ef6f5d700 1 -- 172.21.15.106:0/2158010758 >> 172.21.15.106:0/2158010758 conn(0x7f4ef006ef80 msgr2=0x7f4ef006f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:09:48.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.060+0000 7f4ef6f5d700 1 -- 172.21.15.106:0/2158010758 shutdown_connections 2024-05-08T21:09:48.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.060+0000 7f4ef6f5d700 1 -- 172.21.15.106:0/2158010758 wait complete. 2024-05-08T21:09:48.066 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-08T21:09:48.059+0000 7fdcd819f200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-08T21:09:48.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.062+0000 7f4ef6f5d700 1 Processor -- start 2024-05-08T21:09:48.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.062+0000 7f4ef6f5d700 1 -- start start 2024-05-08T21:09:48.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.062+0000 7f4ef6f5d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ef0072600 0x7f4ef00c6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:48.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.062+0000 7f4ef6f5d700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4ef00c9860 0x7f4ef01550a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:48.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.062+0000 7f4ef6f5d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ef01541a0 0x7f4ef0146be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:48.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.062+0000 7f4ef6f5d700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef01efa30 con 0x7f4ef01541a0 2024-05-08T21:09:48.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.062+0000 7f4ef6f5d700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef0145fc0 con 0x7f4ef0072600 2024-05-08T21:09:48.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.062+0000 7f4ef6f5d700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef01efc40 con 0x7f4ef00c9860 2024-05-08T21:09:48.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.063+0000 7f4eeffff700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4ef00c9860 0x7f4ef01550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:48.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.063+0000 7f4ef4cf9700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ef0072600 0x7f4ef00c6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:48.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.063+0000 7f4eeffff700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4ef00c9860 0x7f4ef01550a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.106:45816/0 (socket says 172.21.15.106:45816) 2024-05-08T21:09:48.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.063+0000 7f4eeffff700 1 -- 172.21.15.106:0/1833720605 learned_addr learned my addr 172.21.15.106:0/1833720605 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-05-08T21:09:48.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.063+0000 7f4ef54fa700 1 --2- 172.21.15.106:0/1833720605 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ef01541a0 0x7f4ef0146be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:48.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.063+0000 7f4ef4cf9700 1 -- 172.21.15.106:0/1833720605 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4ef00c9860 msgr2=0x7f4ef01550a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:48.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.063+0000 7f4ef4cf9700 1 --2- 172.21.15.106:0/1833720605 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4ef00c9860 0x7f4ef01550a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:48.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.063+0000 7f4ef4cf9700 1 -- 172.21.15.106:0/1833720605 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ef01541a0 msgr2=0x7f4ef0146be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:48.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.063+0000 7f4ef4cf9700 1 --2- 172.21.15.106:0/1833720605 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ef01541a0 0x7f4ef0146be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:48.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.063+0000 7f4ef4cf9700 1 -- 172.21.15.106:0/1833720605 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4edc0094a0 con 0x7f4ef0072600 2024-05-08T21:09:48.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.063+0000 7f4eeffff700 1 --2- 172.21.15.106:0/1833720605 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4ef00c9860 0x7f4ef01550a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:09:48.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.063+0000 7f4ef4cf9700 1 --2- 172.21.15.106:0/1833720605 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ef0072600 0x7f4ef00c6410 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4ee400c3c0 tx=0x7f4ee400c6d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:09:48.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.063+0000 7f4eed7fa700 1 -- 172.21.15.106:0/1833720605 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee4004a70 con 0x7f4ef0072600 2024-05-08T21:09:48.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.063+0000 7f4eed7fa700 1 -- 172.21.15.106:0/1833720605 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ee4004bf0 con 0x7f4ef0072600 2024-05-08T21:09:48.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.063+0000 7f4ef6f5d700 1 -- 172.21.15.106:0/1833720605 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ef01efee0 con 0x7f4ef0072600 2024-05-08T21:09:48.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.063+0000 7f4eed7fa700 1 -- 172.21.15.106:0/1833720605 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee40070d0 con 0x7f4ef0072600 2024-05-08T21:09:48.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.063+0000 7f4ef6f5d700 1 -- 172.21.15.106:0/1833720605 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ef01f04a0 con 0x7f4ef0072600 2024-05-08T21:09:48.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.064+0000 7f4eed7fa700 1 -- 172.21.15.106:0/1833720605 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f4ee4007530 con 0x7f4ef0072600 2024-05-08T21:09:48.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.064+0000 7f4ef6f5d700 1 -- 172.21.15.106:0/1833720605 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ef004ec60 con 0x7f4ef0072600 2024-05-08T21:09:48.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.064+0000 7f4eed7fa700 1 -- 172.21.15.106:0/1833720605 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f4ee401d880 con 0x7f4ef0072600 2024-05-08T21:09:48.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.068+0000 7f4eed7fa700 1 -- 172.21.15.106:0/1833720605 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f4ee401d3f0 con 0x7f4ef0072600 2024-05-08T21:09:48.078 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-05-08T21:09:48.075+0000 7f8d54405200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-08T21:09:48.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.152+0000 7f4ef6f5d700 1 -- 172.21.15.106:0/1833720605 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a415c099-9ea6-40be-98ed-f2932f98dfd9", "id": 3} v 0) v1 -- 0x7f4ef00718a0 con 0x7f4ef0072600 2024-05-08T21:09:48.163 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.160+0000 7f4eed7fa700 1 -- 172.21.15.106:0/1833720605 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a415c099-9ea6-40be-98ed-f2932f98dfd9", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4ee401d650 con 0x7f4ef0072600 2024-05-08T21:09:48.163 INFO:teuthology.orchestra.run.smithi106.stdout:3 2024-05-08T21:09:48.164 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.161+0000 7f4ef6f5d700 1 -- 172.21.15.106:0/1833720605 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ef0072600 msgr2=0x7f4ef00c6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:48.164 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.161+0000 7f4ef6f5d700 1 --2- 172.21.15.106:0/1833720605 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ef0072600 0x7f4ef00c6410 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4ee400c3c0 tx=0x7f4ee400c6d0 comp rx=0 tx=0).stop 2024-05-08T21:09:48.165 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.161+0000 7f4ef6f5d700 1 -- 172.21.15.106:0/1833720605 shutdown_connections 2024-05-08T21:09:48.165 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.161+0000 7f4ef6f5d700 1 --2- 172.21.15.106:0/1833720605 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ef01541a0 0x7f4ef0146be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:48.165 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.161+0000 7f4ef6f5d700 1 --2- 172.21.15.106:0/1833720605 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ef0072600 0x7f4ef00c6410 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:48.165 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.161+0000 7f4ef6f5d700 1 --2- 172.21.15.106:0/1833720605 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4ef00c9860 0x7f4ef01550a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:48.165 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.161+0000 7f4ef6f5d700 1 -- 172.21.15.106:0/1833720605 >> 172.21.15.106:0/1833720605 conn(0x7f4ef006ef80 msgr2=0x7f4ef0153380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:09:48.165 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.161+0000 7f4ef6f5d700 1 -- 172.21.15.106:0/1833720605 shutdown_connections 2024-05-08T21:09:48.165 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.161+0000 7f4ef6f5d700 1 -- 172.21.15.106:0/1833720605 wait complete. 2024-05-08T21:09:48.176 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph osd new 5ae1d51f-0918-4571-b79b-154308d46a11 4 2024-05-08T21:09:48.176 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-05-08T21:09:48.174+0000 7f8d54405200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-08T21:09:48.257 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-05-08T21:09:48.254+0000 7f8d54405200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-08T21:09:48.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.294+0000 7f1970dd8700 1 Processor -- start 2024-05-08T21:09:48.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.294+0000 7f1970dd8700 1 -- start start 2024-05-08T21:09:48.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.295+0000 7f1970dd8700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f196c06ef50 0x7f196c072cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:48.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.295+0000 7f1970dd8700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f196c153f60 0x7f196c154410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:48.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.295+0000 7f1970dd8700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f196c071390 con 0x7f196c06f330 2024-05-08T21:09:48.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.295+0000 7f1970dd8700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f196c0c7030 con 0x7f196c06ef50 2024-05-08T21:09:48.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.295+0000 7f1970dd8700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f196c0c8aa0 con 0x7f196c153f60 2024-05-08T21:09:48.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.295+0000 7f196a59c700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f196c06ef50 0x7f196c072cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:48.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.295+0000 7f196a59c700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f196c06ef50 0x7f196c072cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:38160/0 (socket says 172.21.15.106:38160) 2024-05-08T21:09:48.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.295+0000 7f196ad9d700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f196c153f60 0x7f196c154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:48.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.295+0000 7f196a59c700 1 -- 172.21.15.106:0/4140136013 learned_addr learned my addr 172.21.15.106:0/4140136013 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-05-08T21:09:48.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.295+0000 7f196a59c700 1 -- 172.21.15.106:0/4140136013 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f196c153f60 msgr2=0x7f196c154410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:09:48.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.295+0000 7f196a59c700 1 --2- 172.21.15.106:0/4140136013 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f196c153f60 0x7f196c154410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:48.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.295+0000 7f196a59c700 1 -- 172.21.15.106:0/4140136013 >> v1:172.21.15.80:6789/0 conn(0x7f196c06f330 legacy=0x7f196c15ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:09:48.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.295+0000 7f196a59c700 1 -- 172.21.15.106:0/4140136013 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f196c0c8d60 con 0x7f196c06ef50 2024-05-08T21:09:48.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.296+0000 7f196a59c700 1 --2- 172.21.15.106:0/4140136013 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f196c06ef50 0x7f196c072cd0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f195c0098f0 tx=0x7f195c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3358f6fade1a8d86 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:09:48.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.296+0000 7f196959a700 1 -- 172.21.15.106:0/4140136013 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195c011830 con 0x7f196c06ef50 2024-05-08T21:09:48.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.296+0000 7f196959a700 1 -- 172.21.15.106:0/4140136013 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f195c011990 con 0x7f196c06ef50 2024-05-08T21:09:48.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.296+0000 7f196959a700 1 -- 172.21.15.106:0/4140136013 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195c011d20 con 0x7f196c06ef50 2024-05-08T21:09:48.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.296+0000 7f1970dd8700 1 -- 172.21.15.106:0/4140136013 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f196c06ef50 msgr2=0x7f196c072cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:48.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.296+0000 7f1970dd8700 1 --2- 172.21.15.106:0/4140136013 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f196c06ef50 0x7f196c072cd0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f195c0098f0 tx=0x7f195c009c00 comp rx=0 tx=0).stop 2024-05-08T21:09:48.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.296+0000 7f1970dd8700 1 -- 172.21.15.106:0/4140136013 shutdown_connections 2024-05-08T21:09:48.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.296+0000 7f1970dd8700 1 --2- 172.21.15.106:0/4140136013 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f196c153f60 0x7f196c154410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:48.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.296+0000 7f1970dd8700 1 --2- 172.21.15.106:0/4140136013 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f196c06ef50 0x7f196c072cd0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:48.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.296+0000 7f1970dd8700 1 -- 172.21.15.106:0/4140136013 >> 172.21.15.106:0/4140136013 conn(0x7f196c0c9310 msgr2=0x7f196c0c9720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:09:48.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.297+0000 7f1970dd8700 1 -- 172.21.15.106:0/4140136013 shutdown_connections 2024-05-08T21:09:48.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.297+0000 7f1970dd8700 1 -- 172.21.15.106:0/4140136013 wait complete. 2024-05-08T21:09:48.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.298+0000 7f1970dd8700 1 Processor -- start 2024-05-08T21:09:48.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.298+0000 7f1970dd8700 1 -- start start 2024-05-08T21:09:48.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.298+0000 7f1970dd8700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f196c06ef50 0x7f196c1f38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:48.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.298+0000 7f1970dd8700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f196c06f330 0x7f196c150700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:48.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.299+0000 7f1970dd8700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f196c153f60 0x7f196c150c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:48.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.299+0000 7f1970dd8700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f196c1518f0 con 0x7f196c153f60 2024-05-08T21:09:48.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.299+0000 7f1970dd8700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f196c15afe0 con 0x7f196c06f330 2024-05-08T21:09:48.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.299+0000 7f1970dd8700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f196c15a4a0 con 0x7f196c06ef50 2024-05-08T21:09:48.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.299+0000 7f1969d9b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f196c06f330 0x7f196c150700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:48.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.299+0000 7f1969d9b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f196c06f330 0x7f196c150700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:38164/0 (socket says 172.21.15.106:38164) 2024-05-08T21:09:48.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.299+0000 7f196a59c700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f196c06ef50 0x7f196c1f38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:48.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.299+0000 7f1969d9b700 1 -- 172.21.15.106:0/3698969142 learned_addr learned my addr 172.21.15.106:0/3698969142 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-05-08T21:09:48.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.299+0000 7f196ad9d700 1 --2- 172.21.15.106:0/3698969142 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f196c153f60 0x7f196c150c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:48.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.299+0000 7f1969d9b700 1 -- 172.21.15.106:0/3698969142 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f196c06ef50 msgr2=0x7f196c1f38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:48.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.299+0000 7f1969d9b700 1 --2- 172.21.15.106:0/3698969142 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f196c06ef50 0x7f196c1f38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:48.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.299+0000 7f1969d9b700 1 -- 172.21.15.106:0/3698969142 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f196c153f60 msgr2=0x7f196c150c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:48.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.299+0000 7f1969d9b700 1 --2- 172.21.15.106:0/3698969142 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f196c153f60 0x7f196c150c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:48.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.299+0000 7f1969d9b700 1 -- 172.21.15.106:0/3698969142 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f195c009550 con 0x7f196c06f330 2024-05-08T21:09:48.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.299+0000 7f196a59c700 1 --2- 172.21.15.106:0/3698969142 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f196c06ef50 0x7f196c1f38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:09:48.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.299+0000 7f1969d9b700 1 --2- 172.21.15.106:0/3698969142 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f196c06f330 0x7f196c150700 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f196000c480 tx=0x7f196000c790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:09:48.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.299+0000 7f195affd700 1 -- 172.21.15.106:0/3698969142 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19600052d0 con 0x7f196c06f330 2024-05-08T21:09:48.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.299+0000 7f195affd700 1 -- 172.21.15.106:0/3698969142 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f196000ce90 con 0x7f196c06f330 2024-05-08T21:09:48.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.299+0000 7f1970dd8700 1 -- 172.21.15.106:0/3698969142 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f196c1f3e30 con 0x7f196c06f330 2024-05-08T21:09:48.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.299+0000 7f195affd700 1 -- 172.21.15.106:0/3698969142 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1960003680 con 0x7f196c06f330 2024-05-08T21:09:48.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.299+0000 7f1970dd8700 1 -- 172.21.15.106:0/3698969142 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f196c15aa20 con 0x7f196c06f330 2024-05-08T21:09:48.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.300+0000 7f195affd700 1 -- 172.21.15.106:0/3698969142 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f1960003ae0 con 0x7f196c06f330 2024-05-08T21:09:48.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.300+0000 7f195affd700 1 -- 172.21.15.106:0/3698969142 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f1960011d60 con 0x7f196c06f330 2024-05-08T21:09:48.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.300+0000 7f1970dd8700 1 -- 172.21.15.106:0/3698969142 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f196c072370 con 0x7f196c06f330 2024-05-08T21:09:48.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.304+0000 7f195affd700 1 -- 172.21.15.106:0/3698969142 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f1960017070 con 0x7f196c06f330 2024-05-08T21:09:48.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.389+0000 7f1970dd8700 1 -- 172.21.15.106:0/3698969142 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5ae1d51f-0918-4571-b79b-154308d46a11", "id": 4} v 0) v1 -- 0x7f196c06e900 con 0x7f196c06f330 2024-05-08T21:09:48.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.397+0000 7f195affd700 1 -- 172.21.15.106:0/3698969142 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5ae1d51f-0918-4571-b79b-154308d46a11", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f196c06e900 con 0x7f196c06f330 2024-05-08T21:09:48.400 INFO:teuthology.orchestra.run.smithi106.stdout:4 2024-05-08T21:09:48.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.398+0000 7f1970dd8700 1 -- 172.21.15.106:0/3698969142 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f196c06f330 msgr2=0x7f196c150700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:48.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.398+0000 7f1970dd8700 1 --2- 172.21.15.106:0/3698969142 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f196c06f330 0x7f196c150700 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f196000c480 tx=0x7f196000c790 comp rx=0 tx=0).stop 2024-05-08T21:09:48.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.398+0000 7f1970dd8700 1 -- 172.21.15.106:0/3698969142 shutdown_connections 2024-05-08T21:09:48.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.398+0000 7f1970dd8700 1 --2- 172.21.15.106:0/3698969142 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f196c153f60 0x7f196c150c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:48.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.398+0000 7f1970dd8700 1 --2- 172.21.15.106:0/3698969142 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f196c06ef50 0x7f196c1f38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:48.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.398+0000 7f1970dd8700 1 --2- 172.21.15.106:0/3698969142 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f196c06f330 0x7f196c150700 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:48.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.398+0000 7f1970dd8700 1 -- 172.21.15.106:0/3698969142 >> 172.21.15.106:0/3698969142 conn(0x7f196c0c9310 msgr2=0x7f196c14e470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:09:48.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.398+0000 7f1970dd8700 1 -- 172.21.15.106:0/3698969142 shutdown_connections 2024-05-08T21:09:48.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.398+0000 7f1970dd8700 1 -- 172.21.15.106:0/3698969142 wait complete. 2024-05-08T21:09:48.413 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph osd new a19ac74e-4282-4428-b167-26ba6b92f732 5 2024-05-08T21:09:48.431 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-08T21:09:48.428+0000 7fdcd819f200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-08T21:09:48.505 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-05-08T21:09:48.502+0000 7f8d54405200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-08T21:09:48.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.556+0000 7fa8671b6700 1 Processor -- start 2024-05-08T21:09:48.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.556+0000 7fa8671b6700 1 -- start start 2024-05-08T21:09:48.564 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.557+0000 7fa8671b6700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa860071390 0x7fa8600c97f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:48.564 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.557+0000 7fa8671b6700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8600c7950 con 0x7fa860150dd0 2024-05-08T21:09:48.564 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.557+0000 7fa8671b6700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8600c8a30 con 0x7fa86006bad0 2024-05-08T21:09:48.564 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.557+0000 7fa8671b6700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8600c93d0 con 0x7fa860071390 2024-05-08T21:09:48.564 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.557+0000 7fa865753700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fa86006bad0 0x7fa86006bf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:58330/0 (socket says 172.21.15.106:58330) 2024-05-08T21:09:48.564 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.557+0000 7fa865753700 1 -- 172.21.15.106:0/1483955308 learned_addr learned my addr 172.21.15.106:0/1483955308 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-05-08T21:09:48.564 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.558+0000 7fa85ffff700 1 --2- 172.21.15.106:0/1483955308 >> v2:172.21.15.80:3300/0 conn(0x7fa860071390 0x7fa8600c97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:48.564 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.558+0000 7fa85f7fe700 1 -- 172.21.15.106:0/1483955308 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1522221502 0 0) 0x7fa8600c8a30 con 0x7fa86006bad0 2024-05-08T21:09:48.564 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.558+0000 7fa85f7fe700 1 -- 172.21.15.106:0/1483955308 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8500035b0 con 0x7fa86006bad0 2024-05-08T21:09:48.564 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.558+0000 7fa85f7fe700 1 -- 172.21.15.106:0/1483955308 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3958055385 0 0) 0x7fa8600c7950 con 0x7fa860150dd0 2024-05-08T21:09:48.564 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.558+0000 7fa85f7fe700 1 -- 172.21.15.106:0/1483955308 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8600c8a30 con 0x7fa860150dd0 2024-05-08T21:09:48.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.558+0000 7fa85f7fe700 1 -- 172.21.15.106:0/1483955308 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3813412251 0 0) 0x7fa8500035b0 con 0x7fa86006bad0 2024-05-08T21:09:48.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.558+0000 7fa85f7fe700 1 -- 172.21.15.106:0/1483955308 >> v2:172.21.15.80:3300/0 conn(0x7fa860071390 msgr2=0x7fa8600c97f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:09:48.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.558+0000 7fa85f7fe700 1 --2- 172.21.15.106:0/1483955308 >> v2:172.21.15.80:3300/0 conn(0x7fa860071390 0x7fa8600c97f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:48.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.558+0000 7fa85f7fe700 1 -- 172.21.15.106:0/1483955308 >> v1:172.21.15.80:6789/0 conn(0x7fa860150dd0 legacy=0x7fa860157940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:48.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.558+0000 7fa85f7fe700 1 -- 172.21.15.106:0/1483955308 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8600c8d10 con 0x7fa86006bad0 2024-05-08T21:09:48.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.558+0000 7fa85f7fe700 1 -- 172.21.15.106:0/1483955308 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3520646302 0 0) 0x7fa8580019f0 con 0x7fa86006bad0 2024-05-08T21:09:48.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.558+0000 7fa85ffff700 1 --2- 172.21.15.106:0/1483955308 >> v2:172.21.15.80:3300/0 conn(0x7fa860071390 0x7fa8600c97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:09:48.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.558+0000 7fa85f7fe700 1 -- 172.21.15.106:0/1483955308 >> v1:172.21.15.106:6789/0 conn(0x7fa86006bad0 legacy=0x7fa86006bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:48.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.558+0000 7fa85f7fe700 1 --2- 172.21.15.106:0/1483955308 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa850003be0 0x7fa850003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:48.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.558+0000 7fa85f7fe700 1 --2- 172.21.15.106:0/1483955308 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa850004850 0x7fa850004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:48.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.558+0000 7fa85f7fe700 1 --2- 172.21.15.106:0/1483955308 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa850005210 0x7fa85000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:48.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.558+0000 7fa85f7fe700 1 -- 172.21.15.106:0/1483955308 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8600c93d0 con 0x7fa850003be0 2024-05-08T21:09:48.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.558+0000 7fa85f7fe700 1 -- 172.21.15.106:0/1483955308 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa85000c0e0 con 0x7fa850005210 2024-05-08T21:09:48.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.558+0000 7fa85f7fe700 1 -- 172.21.15.106:0/1483955308 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa85000c2a0 con 0x7fa850004850 2024-05-08T21:09:48.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.558+0000 7fa865753700 1 --2- 172.21.15.106:0/1483955308 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa850005210 0x7fa85000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:48.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.558+0000 7fa85ffff700 1 --2- 172.21.15.106:0/1483955308 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa850004850 0x7fa850004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:48.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.558+0000 7fa864f52700 1 --2- 172.21.15.106:0/1483955308 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa850003be0 0x7fa850003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:48.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.558+0000 7fa865753700 1 -- 172.21.15.106:0/1483955308 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa850004850 msgr2=0x7fa850004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:09:48.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.558+0000 7fa865753700 1 --2- 172.21.15.106:0/1483955308 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa850004850 0x7fa850004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:48.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.558+0000 7fa865753700 1 -- 172.21.15.106:0/1483955308 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa850003be0 msgr2=0x7fa850003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:09:48.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.558+0000 7fa865753700 1 --2- 172.21.15.106:0/1483955308 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa850003be0 0x7fa850003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:48.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.558+0000 7fa865753700 1 -- 172.21.15.106:0/1483955308 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8500035b0 con 0x7fa850005210 2024-05-08T21:09:48.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.559+0000 7fa865753700 1 -- 172.21.15.106:0/1483955308 reap_dead start 2024-05-08T21:09:48.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.559+0000 7fa865753700 1 --2- 172.21.15.106:0/1483955308 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa850005210 0x7fa85000ba10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa85800a710 tx=0x7fa850005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f75b379d2ddb130 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:09:48.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.559+0000 7fa85f7fe700 1 -- 172.21.15.106:0/1483955308 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8580072d0 con 0x7fa850005210 2024-05-08T21:09:48.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.559+0000 7fa85f7fe700 1 -- 172.21.15.106:0/1483955308 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa858007430 con 0x7fa850005210 2024-05-08T21:09:48.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.559+0000 7fa85f7fe700 1 -- 172.21.15.106:0/1483955308 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8580077e0 con 0x7fa850005210 2024-05-08T21:09:48.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.559+0000 7fa8671b6700 1 -- 172.21.15.106:0/1483955308 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa850005210 msgr2=0x7fa85000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:48.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.559+0000 7fa8671b6700 1 --2- 172.21.15.106:0/1483955308 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa850005210 0x7fa85000ba10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa85800a710 tx=0x7fa850005880 comp rx=0 tx=0).stop 2024-05-08T21:09:48.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.559+0000 7fa8671b6700 1 -- 172.21.15.106:0/1483955308 shutdown_connections 2024-05-08T21:09:48.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.559+0000 7fa8671b6700 1 --2- 172.21.15.106:0/1483955308 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa850005210 0x7fa85000ba10 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:48.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.559+0000 7fa8671b6700 1 -- 172.21.15.106:0/1483955308 >> 172.21.15.106:0/1483955308 conn(0x7fa86006ef80 msgr2=0x7fa86006f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:09:48.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.559+0000 7fa8671b6700 1 -- 172.21.15.106:0/1483955308 shutdown_connections 2024-05-08T21:09:48.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.559+0000 7fa8671b6700 1 -- 172.21.15.106:0/1483955308 wait complete. 2024-05-08T21:09:48.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.561+0000 7fa8671b6700 1 Processor -- start 2024-05-08T21:09:48.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.561+0000 7fa8671b6700 1 -- start start 2024-05-08T21:09:48.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.561+0000 7fa8671b6700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa850005210 0x7fa8600cb940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:48.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.562+0000 7fa8671b6700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa8600cd330 0x7fa86014bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:48.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.562+0000 7fa8671b6700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8601e15c0 0x7fa8601e1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:48.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.562+0000 7fa8671b6700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa860071820 con 0x7fa8601e15c0 2024-05-08T21:09:48.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.562+0000 7fa8671b6700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8600cd070 con 0x7fa850005210 2024-05-08T21:09:48.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.562+0000 7fa8671b6700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8601f0100 con 0x7fa8600cd330 2024-05-08T21:09:48.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.562+0000 7fa85ffff700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa8600cd330 0x7fa86014bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:48.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.562+0000 7fa85ffff700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa8600cd330 0x7fa86014bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.106:45840/0 (socket says 172.21.15.106:45840) 2024-05-08T21:09:48.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.562+0000 7fa85ffff700 1 -- 172.21.15.106:0/2390491023 learned_addr learned my addr 172.21.15.106:0/2390491023 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-05-08T21:09:48.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.562+0000 7fa864f52700 1 --2- 172.21.15.106:0/2390491023 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa850005210 0x7fa8600cb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:48.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.562+0000 7fa865753700 1 --2- 172.21.15.106:0/2390491023 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8601e15c0 0x7fa8601e1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:48.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.562+0000 7fa85ffff700 1 -- 172.21.15.106:0/2390491023 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa850005210 msgr2=0x7fa8600cb940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:48.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.562+0000 7fa85ffff700 1 --2- 172.21.15.106:0/2390491023 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa850005210 0x7fa8600cb940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:48.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.562+0000 7fa85ffff700 1 -- 172.21.15.106:0/2390491023 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8601e15c0 msgr2=0x7fa8601e1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:48.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.562+0000 7fa85ffff700 1 --2- 172.21.15.106:0/2390491023 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8601e15c0 0x7fa8601e1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:48.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.562+0000 7fa85ffff700 1 -- 172.21.15.106:0/2390491023 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8600cab90 con 0x7fa8600cd330 2024-05-08T21:09:48.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.562+0000 7fa85ffff700 1 --2- 172.21.15.106:0/2390491023 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa8600cd330 0x7fa86014bdb0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa84c011db0 tx=0x7fa84c00e510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:09:48.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.562+0000 7fa85d7fa700 1 -- 172.21.15.106:0/2390491023 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa84c016070 con 0x7fa8600cd330 2024-05-08T21:09:48.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.562+0000 7fa85d7fa700 1 -- 172.21.15.106:0/2390491023 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa84c00ed30 con 0x7fa8600cd330 2024-05-08T21:09:48.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.562+0000 7fa8671b6700 1 -- 172.21.15.106:0/2390491023 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8601f0350 con 0x7fa8600cd330 2024-05-08T21:09:48.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.562+0000 7fa85d7fa700 1 -- 172.21.15.106:0/2390491023 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa84c004020 con 0x7fa8600cd330 2024-05-08T21:09:48.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.562+0000 7fa8671b6700 1 -- 172.21.15.106:0/2390491023 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8601f0910 con 0x7fa8600cd330 2024-05-08T21:09:48.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.562+0000 7fa85d7fa700 1 -- 172.21.15.106:0/2390491023 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fa84c0036a0 con 0x7fa8600cd330 2024-05-08T21:09:48.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.563+0000 7fa85d7fa700 1 -- 172.21.15.106:0/2390491023 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fa84c01a410 con 0x7fa8600cd330 2024-05-08T21:09:48.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.563+0000 7fa8671b6700 1 -- 172.21.15.106:0/2390491023 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa86004ec60 con 0x7fa8600cd330 2024-05-08T21:09:48.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.565+0000 7fa85d7fa700 1 -- 172.21.15.106:0/2390491023 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7fa84c028060 con 0x7fa8600cd330 2024-05-08T21:09:48.581 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-05-08T21:09:48.578+0000 7f8d54405200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-08T21:09:48.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.652+0000 7fa8671b6700 1 -- 172.21.15.106:0/2390491023 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a19ac74e-4282-4428-b167-26ba6b92f732", "id": 5} v 0) v1 -- 0x7fa8600c8460 con 0x7fa8600cd330 2024-05-08T21:09:48.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.660+0000 7fa85d7fa700 1 -- 172.21.15.106:0/2390491023 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a19ac74e-4282-4428-b167-26ba6b92f732", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa84c005a20 con 0x7fa8600cd330 2024-05-08T21:09:48.663 INFO:teuthology.orchestra.run.smithi106.stdout:5 2024-05-08T21:09:48.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.660+0000 7fa8671b6700 1 -- 172.21.15.106:0/2390491023 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa8600cd330 msgr2=0x7fa86014bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:48.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.660+0000 7fa8671b6700 1 --2- 172.21.15.106:0/2390491023 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa8600cd330 0x7fa86014bdb0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa84c011db0 tx=0x7fa84c00e510 comp rx=0 tx=0).stop 2024-05-08T21:09:48.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.661+0000 7fa8671b6700 1 -- 172.21.15.106:0/2390491023 shutdown_connections 2024-05-08T21:09:48.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.661+0000 7fa8671b6700 1 --2- 172.21.15.106:0/2390491023 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8601e15c0 0x7fa8601e1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:48.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.661+0000 7fa8671b6700 1 --2- 172.21.15.106:0/2390491023 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa850005210 0x7fa8600cb940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:48.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.661+0000 7fa8671b6700 1 --2- 172.21.15.106:0/2390491023 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa8600cd330 0x7fa86014bdb0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:48.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.661+0000 7fa8671b6700 1 -- 172.21.15.106:0/2390491023 >> 172.21.15.106:0/2390491023 conn(0x7fa86006ef80 msgr2=0x7fa860157840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:09:48.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.661+0000 7fa8671b6700 1 -- 172.21.15.106:0/2390491023 shutdown_connections 2024-05-08T21:09:48.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.661+0000 7fa8671b6700 1 -- 172.21.15.106:0/2390491023 wait complete. 2024-05-08T21:09:48.675 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph osd new bfe72edd-7acc-4805-807d-2000e76f2feb 6 2024-05-08T21:09:48.752 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-08T21:09:48.749+0000 7fdcd819f200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-08T21:09:48.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.793+0000 7fcf435d4700 1 Processor -- start 2024-05-08T21:09:48.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.793+0000 7fcf435d4700 1 -- start start 2024-05-08T21:09:48.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.794+0000 7fcf435d4700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fcf3c0c2b60 0x7fcf3c158af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:48.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.794+0000 7fcf435d4700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcf3c0c8600 0x7fcf3c15b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:48.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.794+0000 7fcf435d4700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf3c072b20 con 0x7fcf3c152180 2024-05-08T21:09:48.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.794+0000 7fcf435d4700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf3c072560 con 0x7fcf3c0c8600 2024-05-08T21:09:48.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.794+0000 7fcf435d4700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf3c072840 con 0x7fcf3c0c2b60 2024-05-08T21:09:48.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.794+0000 7fcf40b6f700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fcf3c0c2b60 0x7fcf3c158af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:48.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.794+0000 7fcf40b6f700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fcf3c0c2b60 0x7fcf3c158af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:38208/0 (socket says 172.21.15.106:38208) 2024-05-08T21:09:48.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.794+0000 7fcf40b6f700 1 -- 172.21.15.106:0/1552276317 learned_addr learned my addr 172.21.15.106:0/1552276317 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-05-08T21:09:48.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.795+0000 7fcf41b71700 1 --2- 172.21.15.106:0/1552276317 >> v2:172.21.15.80:3300/0 conn(0x7fcf3c0c8600 0x7fcf3c15b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:48.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.795+0000 7fcf40b6f700 1 -- 172.21.15.106:0/1552276317 >> v2:172.21.15.80:3300/0 conn(0x7fcf3c0c8600 msgr2=0x7fcf3c15b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:09:48.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.795+0000 7fcf40b6f700 1 --2- 172.21.15.106:0/1552276317 >> v2:172.21.15.80:3300/0 conn(0x7fcf3c0c8600 0x7fcf3c15b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:48.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.795+0000 7fcf40b6f700 1 -- 172.21.15.106:0/1552276317 >> v1:172.21.15.80:6789/0 conn(0x7fcf3c152180 legacy=0x7fcf3c072f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:48.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.795+0000 7fcf40b6f700 1 -- 172.21.15.106:0/1552276317 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf3c158010 con 0x7fcf3c0c2b60 2024-05-08T21:09:48.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.795+0000 7fcf40b6f700 1 --2- 172.21.15.106:0/1552276317 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf3c0c2b60 0x7fcf3c158af0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c0cec10 tx=0x7fcf2c009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=204599a8f1c0489b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:09:48.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.795+0000 7fcf33fff700 1 -- 172.21.15.106:0/1552276317 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c00b870 con 0x7fcf3c0c2b60 2024-05-08T21:09:48.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.795+0000 7fcf33fff700 1 -- 172.21.15.106:0/1552276317 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf2c00b9d0 con 0x7fcf3c0c2b60 2024-05-08T21:09:48.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.795+0000 7fcf33fff700 1 -- 172.21.15.106:0/1552276317 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c00bd60 con 0x7fcf3c0c2b60 2024-05-08T21:09:48.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.796+0000 7fcf435d4700 1 -- 172.21.15.106:0/1552276317 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf3c0c2b60 msgr2=0x7fcf3c158af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:48.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.796+0000 7fcf435d4700 1 --2- 172.21.15.106:0/1552276317 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf3c0c2b60 0x7fcf3c158af0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c0cec10 tx=0x7fcf2c009bd0 comp rx=0 tx=0).stop 2024-05-08T21:09:48.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.796+0000 7fcf435d4700 1 -- 172.21.15.106:0/1552276317 shutdown_connections 2024-05-08T21:09:48.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.796+0000 7fcf435d4700 1 --2- 172.21.15.106:0/1552276317 >> v2:172.21.15.80:3300/0 conn(0x7fcf3c0c8600 0x7fcf3c15b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:48.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.796+0000 7fcf435d4700 1 --2- 172.21.15.106:0/1552276317 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf3c0c2b60 0x7fcf3c158af0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:48.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.796+0000 7fcf435d4700 1 -- 172.21.15.106:0/1552276317 >> 172.21.15.106:0/1552276317 conn(0x7fcf3c06a9c0 msgr2=0x7fcf3c06add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:09:48.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.796+0000 7fcf435d4700 1 -- 172.21.15.106:0/1552276317 shutdown_connections 2024-05-08T21:09:48.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.796+0000 7fcf435d4700 1 -- 172.21.15.106:0/1552276317 wait complete. 2024-05-08T21:09:48.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.797+0000 7fcf435d4700 1 Processor -- start 2024-05-08T21:09:48.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.797+0000 7fcf435d4700 1 -- start start 2024-05-08T21:09:48.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.798+0000 7fcf435d4700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf3c0c2b60 0x7fcf3c1e2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:48.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.798+0000 7fcf435d4700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf3c0c8600 0x7fcf3c1e3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:48.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.798+0000 7fcf435d4700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf3c152180 0x7fcf3c149640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:48.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.798+0000 7fcf435d4700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3c14e780 con 0x7fcf3c152180 2024-05-08T21:09:48.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.798+0000 7fcf435d4700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3c06d440 con 0x7fcf3c0c2b60 2024-05-08T21:09:48.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.798+0000 7fcf435d4700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3c06d720 con 0x7fcf3c0c8600 2024-05-08T21:09:48.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.798+0000 7fcf41370700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf3c0c2b60 0x7fcf3c1e2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:48.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.798+0000 7fcf40b6f700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf3c0c8600 0x7fcf3c1e3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:48.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.799+0000 7fcf41370700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf3c0c2b60 0x7fcf3c1e2f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:38216/0 (socket says 172.21.15.106:38216) 2024-05-08T21:09:48.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.799+0000 7fcf40b6f700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf3c0c8600 0x7fcf3c1e3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.106:45842/0 (socket says 172.21.15.106:45842) 2024-05-08T21:09:48.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.799+0000 7fcf41370700 1 -- 172.21.15.106:0/1395188621 learned_addr learned my addr 172.21.15.106:0/1395188621 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-05-08T21:09:48.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.799+0000 7fcf41b71700 1 --2- 172.21.15.106:0/1395188621 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf3c152180 0x7fcf3c149640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:48.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.799+0000 7fcf41370700 1 -- 172.21.15.106:0/1395188621 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf3c0c8600 msgr2=0x7fcf3c1e3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:48.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.799+0000 7fcf41370700 1 --2- 172.21.15.106:0/1395188621 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf3c0c8600 0x7fcf3c1e3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:48.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.799+0000 7fcf41370700 1 -- 172.21.15.106:0/1395188621 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf3c152180 msgr2=0x7fcf3c149640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:48.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.799+0000 7fcf41370700 1 --2- 172.21.15.106:0/1395188621 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf3c152180 0x7fcf3c149640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:48.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.799+0000 7fcf41370700 1 -- 172.21.15.106:0/1395188621 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf2c009550 con 0x7fcf3c0c2b60 2024-05-08T21:09:48.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.799+0000 7fcf40b6f700 1 --2- 172.21.15.106:0/1395188621 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf3c0c8600 0x7fcf3c1e3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:09:48.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.799+0000 7fcf41370700 1 --2- 172.21.15.106:0/1395188621 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf3c0c2b60 0x7fcf3c1e2f00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fcf3800c450 tx=0x7fcf3800c760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:09:48.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.799+0000 7fcf31ffb700 1 -- 172.21.15.106:0/1395188621 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf380052d0 con 0x7fcf3c0c2b60 2024-05-08T21:09:48.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.799+0000 7fcf31ffb700 1 -- 172.21.15.106:0/1395188621 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf38005430 con 0x7fcf3c0c2b60 2024-05-08T21:09:48.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.799+0000 7fcf435d4700 1 -- 172.21.15.106:0/1395188621 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf3c06da00 con 0x7fcf3c0c2b60 2024-05-08T21:09:48.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.799+0000 7fcf31ffb700 1 -- 172.21.15.106:0/1395188621 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf380038c0 con 0x7fcf3c0c2b60 2024-05-08T21:09:48.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.799+0000 7fcf435d4700 1 -- 172.21.15.106:0/1395188621 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf3c06ca80 con 0x7fcf3c0c2b60 2024-05-08T21:09:48.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.800+0000 7fcf31ffb700 1 -- 172.21.15.106:0/1395188621 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fcf38003d20 con 0x7fcf3c0c2b60 2024-05-08T21:09:48.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.800+0000 7fcf31ffb700 1 -- 172.21.15.106:0/1395188621 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fcf38011d90 con 0x7fcf3c0c2b60 2024-05-08T21:09:48.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.800+0000 7fcf435d4700 1 -- 172.21.15.106:0/1395188621 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf3c04ec60 con 0x7fcf3c0c2b60 2024-05-08T21:09:48.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.802+0000 7fcf31ffb700 1 -- 172.21.15.106:0/1395188621 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7fcf38017070 con 0x7fcf3c0c2b60 2024-05-08T21:09:48.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.887+0000 7fcf435d4700 1 -- 172.21.15.106:0/1395188621 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd new", "uuid": "bfe72edd-7acc-4805-807d-2000e76f2feb", "id": 6} v 0) v1 -- 0x7fcf3c072d30 con 0x7fcf3c0c2b60 2024-05-08T21:09:48.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.895+0000 7fcf31ffb700 1 -- 172.21.15.106:0/1395188621 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bfe72edd-7acc-4805-807d-2000e76f2feb", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fcf38011590 con 0x7fcf3c0c2b60 2024-05-08T21:09:48.898 INFO:teuthology.orchestra.run.smithi106.stdout:6 2024-05-08T21:09:48.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.896+0000 7fcf435d4700 1 -- 172.21.15.106:0/1395188621 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf3c0c2b60 msgr2=0x7fcf3c1e2f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:48.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.896+0000 7fcf435d4700 1 --2- 172.21.15.106:0/1395188621 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf3c0c2b60 0x7fcf3c1e2f00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fcf3800c450 tx=0x7fcf3800c760 comp rx=0 tx=0).stop 2024-05-08T21:09:48.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.896+0000 7fcf435d4700 1 -- 172.21.15.106:0/1395188621 shutdown_connections 2024-05-08T21:09:48.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.896+0000 7fcf435d4700 1 --2- 172.21.15.106:0/1395188621 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcf3c152180 0x7fcf3c149640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:48.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.896+0000 7fcf435d4700 1 --2- 172.21.15.106:0/1395188621 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf3c0c2b60 0x7fcf3c1e2f00 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:48.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.896+0000 7fcf435d4700 1 --2- 172.21.15.106:0/1395188621 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf3c0c8600 0x7fcf3c1e3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:48.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.896+0000 7fcf435d4700 1 -- 172.21.15.106:0/1395188621 >> 172.21.15.106:0/1395188621 conn(0x7fcf3c06a9c0 msgr2=0x7fcf3c1475e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:09:48.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.896+0000 7fcf435d4700 1 -- 172.21.15.106:0/1395188621 shutdown_connections 2024-05-08T21:09:48.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:48.896+0000 7fcf435d4700 1 -- 172.21.15.106:0/1395188621 wait complete. 2024-05-08T21:09:48.911 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph osd new 99897f22-ed17-4c7c-9088-cc0c4a51f786 7 2024-05-08T21:09:48.911 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-08T21:09:48.908+0000 7fdcd819f200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-08T21:09:48.968 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-05-08T21:09:48.965+0000 7f8d54405200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-08T21:09:48.989 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-08T21:09:48.986+0000 7fdcd819f200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-08T21:09:49.033 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:49.030+0000 7f7a10529700 1 Processor -- start 2024-05-08T21:09:49.033 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:49.030+0000 7f7a10529700 1 -- start start 2024-05-08T21:09:49.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:49.031+0000 7f7a10529700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7a08151010 0x7f7a0815aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:49.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:49.031+0000 7f7a10529700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7a0815aff0 0x7f7a080c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:49.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:49.031+0000 7f7a10529700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a081572b0 con 0x7f7a08156dc0 2024-05-08T21:09:49.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:49.031+0000 7f7a10529700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a0815a3b0 con 0x7f7a0815aff0 2024-05-08T21:09:49.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:49.031+0000 7f7a10529700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a0815a690 con 0x7f7a08151010 2024-05-08T21:09:49.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:49.031+0000 7f7a0e2c5700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7a08151010 0x7f7a0815aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:49.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:49.031+0000 7f7a0dac4700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f7a08156dc0 0x7f7a080c8150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:58338/0 (socket says 172.21.15.106:58338) 2024-05-08T21:09:49.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:49.031+0000 7f7a0dac4700 1 -- 172.21.15.106:0/816845732 learned_addr learned my addr 172.21.15.106:0/816845732 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-05-08T21:09:49.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:49.031+0000 7f7a0eac6700 1 --2- 172.21.15.106:0/816845732 >> v2:172.21.15.80:3300/0 conn(0x7f7a0815aff0 0x7f7a080c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:49.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:49.031+0000 7f7a0e2c5700 1 -- 172.21.15.106:0/816845732 >> v2:172.21.15.80:3300/0 conn(0x7f7a0815aff0 msgr2=0x7f7a080c73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:09:49.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:49.031+0000 7f7a0e2c5700 1 --2- 172.21.15.106:0/816845732 >> v2:172.21.15.80:3300/0 conn(0x7f7a0815aff0 0x7f7a080c73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:49.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:49.031+0000 7f7a0e2c5700 1 -- 172.21.15.106:0/816845732 >> v1:172.21.15.106:6789/0 conn(0x7f7a08156dc0 legacy=0x7f7a080c8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:49.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:49.031+0000 7f7a0d2c3700 1 -- 172.21.15.106:0/816845732 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2931860891 0 0) 0x7f7a081572b0 con 0x7f7a08156dc0 2024-05-08T21:09:49.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:49.031+0000 7f7a0e2c5700 1 -- 172.21.15.106:0/816845732 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a08157590 con 0x7f7a08151010 2024-05-08T21:09:49.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:49.032+0000 7f7a0e2c5700 1 --2- 172.21.15.106:0/816845732 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a08151010 0x7f7a0815aab0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7a0806cb90 tx=0x7f7a04009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=705adfdb7ad3c371 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:09:49.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:49.032+0000 7f7a0d2c3700 1 -- 172.21.15.106:0/816845732 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a04011830 con 0x7f7a08151010 2024-05-08T21:09:49.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:49.032+0000 7f7a0d2c3700 1 -- 172.21.15.106:0/816845732 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a04011990 con 0x7f7a08151010 2024-05-08T21:09:49.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:49.032+0000 7f7a0d2c3700 1 -- 172.21.15.106:0/816845732 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a04011d20 con 0x7f7a08151010 2024-05-08T21:09:49.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:49.032+0000 7f7a10529700 1 -- 172.21.15.106:0/816845732 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a08151010 msgr2=0x7f7a0815aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:49.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:49.032+0000 7f7a10529700 1 --2- 172.21.15.106:0/816845732 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a08151010 0x7f7a0815aab0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7a0806cb90 tx=0x7f7a04009b20 comp rx=0 tx=0).stop 2024-05-08T21:09:49.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:49.032+0000 7f7a10529700 1 -- 172.21.15.106:0/816845732 shutdown_connections 2024-05-08T21:09:49.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:49.032+0000 7f7a10529700 1 --2- 172.21.15.106:0/816845732 >> v2:172.21.15.80:3300/0 conn(0x7f7a0815aff0 0x7f7a080c73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:49.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:49.032+0000 7f7a10529700 1 --2- 172.21.15.106:0/816845732 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a08151010 0x7f7a0815aab0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:49.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:49.032+0000 7f7a10529700 1 -- 172.21.15.106:0/816845732 >> 172.21.15.106:0/816845732 conn(0x7f7a080c9310 msgr2=0x7f7a080c9720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:09:49.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:49.032+0000 7f7a10529700 1 -- 172.21.15.106:0/816845732 shutdown_connections 2024-05-08T21:09:49.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:49.032+0000 7f7a10529700 1 -- 172.21.15.106:0/816845732 wait complete. 2024-05-08T21:09:49.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:49.034+0000 7f7a10529700 1 Processor -- start 2024-05-08T21:09:49.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:49.034+0000 7f7a10529700 1 -- start start 2024-05-08T21:09:49.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:49.034+0000 7f7a10529700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a08151010 0x7f7a080cc020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:49.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:49.034+0000 7f7a10529700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a08156dc0 0x7f7a08146a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:49.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:49.034+0000 7f7a10529700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7a0815aff0 0x7f7a08143770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:49.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:49.034+0000 7f7a10529700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a08146fb0 con 0x7f7a08156dc0 2024-05-08T21:09:49.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:49.034+0000 7f7a10529700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a08146010 con 0x7f7a08151010 2024-05-08T21:09:49.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:49.034+0000 7f7a10529700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0806c9a0 con 0x7f7a0815aff0 2024-05-08T21:09:49.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:49.034+0000 7f7a0e2c5700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a08151010 0x7f7a080cc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:49.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:49.034+0000 7f7a0eac6700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7a0815aff0 0x7f7a08143770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:49.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:49.034+0000 7f7a0e2c5700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a08151010 0x7f7a080cc020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:38232/0 (socket says 172.21.15.106:38232) 2024-05-08T21:09:49.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:49.034+0000 7f7a0e2c5700 1 -- 172.21.15.106:0/3674451612 learned_addr learned my addr 172.21.15.106:0/3674451612 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-05-08T21:09:49.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:49.034+0000 7f7a0dac4700 1 --2- 172.21.15.106:0/3674451612 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a08156dc0 0x7f7a08146a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:49.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:49.035+0000 7f7a0e2c5700 1 -- 172.21.15.106:0/3674451612 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7a0815aff0 msgr2=0x7f7a08143770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:49.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:49.035+0000 7f7a0e2c5700 1 --2- 172.21.15.106:0/3674451612 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7a0815aff0 0x7f7a08143770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:49.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:49.035+0000 7f7a0e2c5700 1 -- 172.21.15.106:0/3674451612 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a08156dc0 msgr2=0x7f7a08146a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:49.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:49.035+0000 7f7a0e2c5700 1 --2- 172.21.15.106:0/3674451612 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a08156dc0 0x7f7a08146a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:49.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:49.035+0000 7f7a0e2c5700 1 -- 172.21.15.106:0/3674451612 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a040094a0 con 0x7f7a08151010 2024-05-08T21:09:49.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:49.035+0000 7f7a0eac6700 1 --2- 172.21.15.106:0/3674451612 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7a0815aff0 0x7f7a08143770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:09:49.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:49.035+0000 7f7a0e2c5700 1 --2- 172.21.15.106:0/3674451612 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a08151010 0x7f7a080cc020 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7a040090b0 tx=0x7f7a04004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:09:49.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:49.035+0000 7f79feffd700 1 -- 172.21.15.106:0/3674451612 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0401a7e0 con 0x7f7a08151010 2024-05-08T21:09:49.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:49.035+0000 7f79feffd700 1 -- 172.21.15.106:0/3674451612 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a0401a940 con 0x7f7a08151010 2024-05-08T21:09:49.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:49.035+0000 7f7a10529700 1 -- 172.21.15.106:0/3674451612 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a08145a90 con 0x7f7a08151010 2024-05-08T21:09:49.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:49.035+0000 7f79feffd700 1 -- 172.21.15.106:0/3674451612 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0401acd0 con 0x7f7a08151010 2024-05-08T21:09:49.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:49.035+0000 7f7a10529700 1 -- 172.21.15.106:0/3674451612 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a0806c350 con 0x7f7a08151010 2024-05-08T21:09:49.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:49.035+0000 7f79feffd700 1 -- 172.21.15.106:0/3674451612 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f7a04022070 con 0x7f7a08151010 2024-05-08T21:09:49.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:49.035+0000 7f79feffd700 1 -- 172.21.15.106:0/3674451612 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f7a04024a80 con 0x7f7a08151010 2024-05-08T21:09:49.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:49.036+0000 7f7a10529700 1 -- 172.21.15.106:0/3674451612 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a0804ec60 con 0x7f7a08151010 2024-05-08T21:09:49.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:49.038+0000 7f79feffd700 1 -- 172.21.15.106:0/3674451612 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f7a04029070 con 0x7f7a08151010 2024-05-08T21:09:49.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:49.123+0000 7f7a10529700 1 -- 172.21.15.106:0/3674451612 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd new", "uuid": "99897f22-ed17-4c7c-9088-cc0c4a51f786", "id": 7} v 0) v1 -- 0x7f7a080c7f30 con 0x7f7a08151010 2024-05-08T21:09:49.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:49.132+0000 7f79feffd700 1 -- 172.21.15.106:0/3674451612 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "99897f22-ed17-4c7c-9088-cc0c4a51f786", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7a04015020 con 0x7f7a08151010 2024-05-08T21:09:49.135 INFO:teuthology.orchestra.run.smithi106.stdout:7 2024-05-08T21:09:49.136 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:49.133+0000 7f7a10529700 1 -- 172.21.15.106:0/3674451612 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a08151010 msgr2=0x7f7a080cc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:49.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:49.133+0000 7f7a10529700 1 --2- 172.21.15.106:0/3674451612 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a08151010 0x7f7a080cc020 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7a040090b0 tx=0x7f7a04004750 comp rx=0 tx=0).stop 2024-05-08T21:09:49.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:49.133+0000 7f7a10529700 1 -- 172.21.15.106:0/3674451612 shutdown_connections 2024-05-08T21:09:49.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:49.133+0000 7f7a10529700 1 --2- 172.21.15.106:0/3674451612 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7a0815aff0 0x7f7a08143770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:49.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:49.133+0000 7f7a10529700 1 --2- 172.21.15.106:0/3674451612 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a08151010 0x7f7a080cc020 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:49.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:49.133+0000 7f7a10529700 1 --2- 172.21.15.106:0/3674451612 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a08156dc0 0x7f7a08146a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:49.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:49.133+0000 7f7a10529700 1 -- 172.21.15.106:0/3674451612 >> 172.21.15.106:0/3674451612 conn(0x7f7a080c9310 msgr2=0x7f7a080c32e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:09:49.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:49.133+0000 7f7a10529700 1 -- 172.21.15.106:0/3674451612 shutdown_connections 2024-05-08T21:09:49.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-08T21:09:49.133+0000 7f7a10529700 1 -- 172.21.15.106:0/3674451612 wait complete. 2024-05-08T21:09:49.148 INFO:tasks.ceph.osd.0:Restarting daemon 2024-05-08T21:09:49.148 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-05-08T21:09:49.150 INFO:tasks.ceph.osd.0:Started 2024-05-08T21:09:49.150 INFO:tasks.ceph.osd.1:Restarting daemon 2024-05-08T21:09:49.150 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-05-08T21:09:49.154 INFO:tasks.ceph.osd.1:Started 2024-05-08T21:09:49.154 INFO:tasks.ceph.osd.2:Restarting daemon 2024-05-08T21:09:49.154 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-05-08T21:09:49.156 INFO:tasks.ceph.osd.2:Started 2024-05-08T21:09:49.156 INFO:tasks.ceph.osd.3:Restarting daemon 2024-05-08T21:09:49.156 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-05-08T21:09:49.158 INFO:tasks.ceph.osd.3:Started 2024-05-08T21:09:49.158 INFO:tasks.ceph.osd.4:Restarting daemon 2024-05-08T21:09:49.158 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-05-08T21:09:49.160 INFO:tasks.ceph.osd.4:Started 2024-05-08T21:09:49.160 INFO:tasks.ceph.osd.5:Restarting daemon 2024-05-08T21:09:49.160 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-05-08T21:09:49.162 INFO:tasks.ceph.osd.5:Started 2024-05-08T21:09:49.163 INFO:tasks.ceph.osd.6:Restarting daemon 2024-05-08T21:09:49.163 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-05-08T21:09:49.165 INFO:tasks.ceph.osd.6:Started 2024-05-08T21:09:49.165 INFO:tasks.ceph.osd.7:Restarting daemon 2024-05-08T21:09:49.165 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-05-08T21:09:49.167 INFO:tasks.ceph.osd.7:Started 2024-05-08T21:09:49.167 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T21:09:49.329 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-05-08T21:09:49.326+0000 7f8d54405200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-08T21:09:49.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:49.345+0000 7f67ea2dd700 1 Processor -- start 2024-05-08T21:09:49.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:49.345+0000 7f67ea2dd700 1 -- start start 2024-05-08T21:09:49.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:49.345+0000 7f67ea2dd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f67e4151010 0x7f67e415aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:49.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:49.345+0000 7f67ea2dd700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f67e4156dc0 0x7f67e40c8150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:49.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:49.345+0000 7f67ea2dd700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67e41572b0 con 0x7f67e415aff0 2024-05-08T21:09:49.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:49.345+0000 7f67ea2dd700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67e415a3b0 con 0x7f67e4151010 2024-05-08T21:09:49.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:49.345+0000 7f67ea2dd700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67e415a690 con 0x7f67e4156dc0 2024-05-08T21:09:49.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:49.346+0000 7f67e3fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f67e4151010 0x7f67e415aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:49.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:49.346+0000 7f67e3fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f67e4151010 0x7f67e415aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35214/0 (socket says 172.21.15.80:35214) 2024-05-08T21:09:49.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:49.346+0000 7f67e3fff700 1 -- 172.21.15.80:0/1379038892 learned_addr learned my addr 172.21.15.80:0/1379038892 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:09:49.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:49.346+0000 7f67e37fe700 1 --2- 172.21.15.80:0/1379038892 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f67e4156dc0 0x7f67e40c8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:49.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:49.346+0000 7f67e3fff700 1 -- 172.21.15.80:0/1379038892 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f67e4156dc0 msgr2=0x7f67e40c8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:09:49.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:49.346+0000 7f67e3fff700 1 --2- 172.21.15.80:0/1379038892 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f67e4156dc0 0x7f67e40c8150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:49.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:49.346+0000 7f67e3fff700 1 -- 172.21.15.80:0/1379038892 >> v1:172.21.15.106:6789/0 conn(0x7f67e415aff0 legacy=0x7f67e40c73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:49.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:49.346+0000 7f67e3fff700 1 -- 172.21.15.80:0/1379038892 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67e4157590 con 0x7f67e4151010 2024-05-08T21:09:49.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:49.346+0000 7f67e3fff700 1 --2- 172.21.15.80:0/1379038892 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67e4151010 0x7f67e415aab0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f67d40098f0 tx=0x7f67d4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a37ea61b11a42e0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:09:49.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:49.346+0000 7f67e2ffd700 1 -- 172.21.15.80:0/1379038892 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d4011830 con 0x7f67e4151010 2024-05-08T21:09:49.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:49.346+0000 7f67e2ffd700 1 -- 172.21.15.80:0/1379038892 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67d4011990 con 0x7f67e4151010 2024-05-08T21:09:49.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:49.346+0000 7f67e2ffd700 1 -- 172.21.15.80:0/1379038892 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d4011d20 con 0x7f67e4151010 2024-05-08T21:09:49.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:49.347+0000 7f67ea2dd700 1 -- 172.21.15.80:0/1379038892 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67e4151010 msgr2=0x7f67e415aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:49.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:49.347+0000 7f67ea2dd700 1 --2- 172.21.15.80:0/1379038892 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67e4151010 0x7f67e415aab0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f67d40098f0 tx=0x7f67d4009c00 comp rx=0 tx=0).stop 2024-05-08T21:09:49.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:49.347+0000 7f67ea2dd700 1 -- 172.21.15.80:0/1379038892 shutdown_connections 2024-05-08T21:09:49.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:49.347+0000 7f67ea2dd700 1 --2- 172.21.15.80:0/1379038892 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67e4151010 0x7f67e415aab0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:49.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:49.347+0000 7f67ea2dd700 1 --2- 172.21.15.80:0/1379038892 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f67e4156dc0 0x7f67e40c8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:49.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:49.347+0000 7f67ea2dd700 1 -- 172.21.15.80:0/1379038892 >> 172.21.15.80:0/1379038892 conn(0x7f67e40c9310 msgr2=0x7f67e40c9720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:09:49.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:49.347+0000 7f67ea2dd700 1 -- 172.21.15.80:0/1379038892 shutdown_connections 2024-05-08T21:09:49.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:49.347+0000 7f67ea2dd700 1 -- 172.21.15.80:0/1379038892 wait complete. 2024-05-08T21:09:49.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:49.348+0000 7f67ea2dd700 1 Processor -- start 2024-05-08T21:09:49.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:49.348+0000 7f67ea2dd700 1 -- start start 2024-05-08T21:09:49.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:49.349+0000 7f67ea2dd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67e4151010 0x7f67e4140470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:49.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:49.349+0000 7f67ea2dd700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67e4156dc0 0x7f67e406ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:49.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:49.349+0000 7f67ea2dd700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f67e415aff0 0x7f67e406b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:49.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:49.349+0000 7f67ea2dd700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67e406bb40 con 0x7f67e4151010 2024-05-08T21:09:49.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:49.349+0000 7f67ea2dd700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67e4151730 con 0x7f67e4156dc0 2024-05-08T21:09:49.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:49.349+0000 7f67ea2dd700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67e406bd90 con 0x7f67e415aff0 2024-05-08T21:09:49.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:49.349+0000 7f67e3fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67e4151010 0x7f67e4140470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:49.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:49.349+0000 7f67e3fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67e4151010 0x7f67e4140470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35228/0 (socket says 172.21.15.80:35228) 2024-05-08T21:09:49.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:49.349+0000 7f67e3fff700 1 -- 172.21.15.80:0/1713543745 learned_addr learned my addr 172.21.15.80:0/1713543745 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:09:49.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:49.349+0000 7f67e37fe700 1 --2- 172.21.15.80:0/1713543745 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67e4156dc0 0x7f67e406ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:49.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:49.349+0000 7f67e887a700 1 --2- 172.21.15.80:0/1713543745 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f67e415aff0 0x7f67e406b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:49.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:49.349+0000 7f67e3fff700 1 -- 172.21.15.80:0/1713543745 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f67e415aff0 msgr2=0x7f67e406b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:49.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:49.349+0000 7f67e3fff700 1 --2- 172.21.15.80:0/1713543745 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f67e415aff0 0x7f67e406b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:49.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:49.349+0000 7f67e3fff700 1 -- 172.21.15.80:0/1713543745 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67e4156dc0 msgr2=0x7f67e406ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:49.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:49.349+0000 7f67e3fff700 1 --2- 172.21.15.80:0/1713543745 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67e4156dc0 0x7f67e406ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:49.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:49.349+0000 7f67e3fff700 1 -- 172.21.15.80:0/1713543745 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67d4009550 con 0x7f67e4151010 2024-05-08T21:09:49.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:49.349+0000 7f67e3fff700 1 --2- 172.21.15.80:0/1713543745 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67e4151010 0x7f67e4140470 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f67d4000c00 tx=0x7f67d4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:09:49.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:49.349+0000 7f67e0ff9700 1 -- 172.21.15.80:0/1713543745 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d4004400 con 0x7f67e4151010 2024-05-08T21:09:49.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:49.349+0000 7f67e0ff9700 1 -- 172.21.15.80:0/1713543745 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67d401f070 con 0x7f67e4151010 2024-05-08T21:09:49.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:49.349+0000 7f67ea2dd700 1 -- 172.21.15.80:0/1713543745 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67e41ec220 con 0x7f67e4151010 2024-05-08T21:09:49.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:49.349+0000 7f67e0ff9700 1 -- 172.21.15.80:0/1713543745 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d40038e0 con 0x7f67e4151010 2024-05-08T21:09:49.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:49.350+0000 7f67ea2dd700 1 -- 172.21.15.80:0/1713543745 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67e41ec500 con 0x7f67e4151010 2024-05-08T21:09:49.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:49.350+0000 7f67e0ff9700 1 -- 172.21.15.80:0/1713543745 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f67d4021030 con 0x7f67e4151010 2024-05-08T21:09:49.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:49.350+0000 7f67e0ff9700 1 -- 172.21.15.80:0/1713543745 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f67d4024430 con 0x7f67e4151010 2024-05-08T21:09:49.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:49.350+0000 7f67ea2dd700 1 -- 172.21.15.80:0/1713543745 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67e41ec080 con 0x7f67e4151010 2024-05-08T21:09:49.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:49.353+0000 7f67e0ff9700 1 -- 172.21.15.80:0/1713543745 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f67e41ec080 con 0x7f67e4151010 2024-05-08T21:09:49.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:49.424+0000 7f67ea2dd700 1 -- 172.21.15.80:0/1713543745 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f67e404ec60 con 0x7f67e4151010 2024-05-08T21:09:49.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:49.425+0000 7f67e0ff9700 1 -- 172.21.15.80:0/1713543745 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f67d4015020 con 0x7f67e4151010 2024-05-08T21:09:49.428 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:09:49.429 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":10,"fsid":"44d31c1e-aad3-47ca-a4fa-85a63d4a60aa","created":"2024-05-08T21:09:46.467038+0000","modified":"2024-05-08T21:09:49.125444+0000","last_up_change":"0.000000","last_in_change":"2024-05-08T21:09:49.125444+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c3f9d93e-ed6d-4a0c-b5c0-0e8d44c65fdd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"4ce2b4d6-6c40-43aa-8dd1-743fef8915df","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e30cc3bc-6461-4fac-960a-de00c9488d6d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a415c099-9ea6-40be-98ed-f2932f98dfd9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"5ae1d51f-0918-4571-b79b-154308d46a11","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"a19ac74e-4282-4428-b167-26ba6b92f732","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"bfe72edd-7acc-4805-807d-2000e76f2feb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"99897f22-ed17-4c7c-9088-cc0c4a51f786","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T21:09:49.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:49.426+0000 7f67ea2dd700 1 -- 172.21.15.80:0/1713543745 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67e4151010 msgr2=0x7f67e4140470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:49.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:49.426+0000 7f67ea2dd700 1 --2- 172.21.15.80:0/1713543745 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67e4151010 0x7f67e4140470 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f67d4000c00 tx=0x7f67d4004750 comp rx=0 tx=0).stop 2024-05-08T21:09:49.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:49.426+0000 7f67ea2dd700 1 -- 172.21.15.80:0/1713543745 shutdown_connections 2024-05-08T21:09:49.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:49.426+0000 7f67ea2dd700 1 --2- 172.21.15.80:0/1713543745 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67e4151010 0x7f67e4140470 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:49.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:49.426+0000 7f67ea2dd700 1 --2- 172.21.15.80:0/1713543745 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f67e415aff0 0x7f67e406b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:49.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:49.426+0000 7f67ea2dd700 1 --2- 172.21.15.80:0/1713543745 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67e4156dc0 0x7f67e406ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:49.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:49.426+0000 7f67ea2dd700 1 -- 172.21.15.80:0/1713543745 >> 172.21.15.80:0/1713543745 conn(0x7f67e40c9310 msgr2=0x7f67e40c8150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:09:49.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:49.426+0000 7f67ea2dd700 1 -- 172.21.15.80:0/1713543745 shutdown_connections 2024-05-08T21:09:49.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:49.426+0000 7f67ea2dd700 1 -- 172.21.15.80:0/1713543745 wait complete. 2024-05-08T21:09:49.442 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-05-08T21:09:49.442 INFO:tasks.ceph:Waiting for OSDs to come up 2024-05-08T21:09:49.489 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-05-08T21:09:49.486+0000 7f8d54405200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-08T21:09:49.517 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T21:09:49.514+0000 7f6783f207c0 -1 Falling back to public interface 2024-05-08T21:09:49.570 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-05-08T21:09:49.567+0000 7f8d54405200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-08T21:09:49.762 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-08T21:09:49.759+0000 7fdcd819f200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-08T21:09:49.772 INFO:tasks.ceph.osd.7.smithi106.stderr:2024-05-08T21:09:49.770+0000 7feb1205b7c0 -1 Falling back to public interface 2024-05-08T21:09:49.773 INFO:tasks.ceph.osd.5.smithi106.stderr:2024-05-08T21:09:49.770+0000 7f4ce4e4d7c0 -1 Falling back to public interface 2024-05-08T21:09:49.775 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T21:09:49.772+0000 7fb325fe27c0 -1 Falling back to public interface 2024-05-08T21:09:49.779 INFO:tasks.ceph.osd.6.smithi106.stderr:2024-05-08T21:09:49.776+0000 7f02a94d87c0 -1 Falling back to public interface 2024-05-08T21:09:49.779 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T21:09:49.776+0000 7f800de3a7c0 -1 Falling back to public interface 2024-05-08T21:09:49.781 INFO:tasks.ceph.osd.4.smithi106.stderr:2024-05-08T21:09:49.778+0000 7f4485fb47c0 -1 Falling back to public interface 2024-05-08T21:09:49.783 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T21:09:49.780+0000 7fbce26af7c0 -1 Falling back to public interface 2024-05-08T21:09:49.850 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-08T21:09:49.847+0000 7fdcd819f200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-08T21:09:49.982 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-08T21:09:49.978+0000 7fdcd819f200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-08T21:09:50.247 DEBUG:teuthology.orchestra.run.smithi080:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-08T21:09:50.275 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-05-08T21:09:50.272+0000 7f8d54405200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-08T21:09:50.358 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-05-08T21:09:50.355+0000 7f8d54405200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-08T21:09:50.362 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:50.358+0000 7fa8371ba700 1 Processor -- start 2024-05-08T21:09:50.362 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:50.358+0000 7fa8371ba700 1 -- start start 2024-05-08T21:09:50.364 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:50.359+0000 7fa8371ba700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa830159fe0 0x7fa83015a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:50.365 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:50.359+0000 7fa8371ba700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa83015dfa0 con 0x7fa83006b4e0 2024-05-08T21:09:50.365 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:50.359+0000 7fa8371ba700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8300c8730 con 0x7fa8301541b0 2024-05-08T21:09:50.365 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:50.359+0000 7fa8371ba700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa83015ac70 con 0x7fa830159fe0 2024-05-08T21:09:50.365 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:50.359+0000 7fa82ffff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fa83006b4e0 0x7fa83006a9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:40410/0 (socket says 172.21.15.80:40410) 2024-05-08T21:09:50.365 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:50.359+0000 7fa82ffff700 1 -- 172.21.15.80:0/3953381657 learned_addr learned my addr 172.21.15.80:0/3953381657 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:09:50.365 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:50.359+0000 7fa835757700 1 --2- 172.21.15.80:0/3953381657 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa830159fe0 0x7fa83015a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:50.365 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:50.360+0000 7fa82f7fe700 1 -- 172.21.15.80:0/3953381657 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1315385636 0 0) 0x7fa83015dfa0 con 0x7fa83006b4e0 2024-05-08T21:09:50.365 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:50.360+0000 7fa82f7fe700 1 -- 172.21.15.80:0/3953381657 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8200035b0 con 0x7fa83006b4e0 2024-05-08T21:09:50.365 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:50.360+0000 7fa82f7fe700 1 -- 172.21.15.80:0/3953381657 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4108321802 0 0) 0x7fa8300c8730 con 0x7fa8301541b0 2024-05-08T21:09:50.365 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:50.360+0000 7fa82f7fe700 1 -- 172.21.15.80:0/3953381657 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa83015dfa0 con 0x7fa8301541b0 2024-05-08T21:09:50.365 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:50.360+0000 7fa835757700 1 -- 172.21.15.80:0/3953381657 >> v1:172.21.15.106:6789/0 conn(0x7fa8301541b0 legacy=0x7fa8300c8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:50.365 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:50.360+0000 7fa835757700 1 -- 172.21.15.80:0/3953381657 >> v1:172.21.15.80:6789/0 conn(0x7fa83006b4e0 legacy=0x7fa83006a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:50.365 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:50.360+0000 7fa835757700 1 -- 172.21.15.80:0/3953381657 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa83015af30 con 0x7fa830159fe0 2024-05-08T21:09:50.365 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:50.360+0000 7fa835757700 1 --2- 172.21.15.80:0/3953381657 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa830159fe0 0x7fa83015a430 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa828009dc0 tx=0x7fa82800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53caa14ee91f6a62 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:09:50.365 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:50.360+0000 7fa82f7fe700 1 -- 172.21.15.80:0/3953381657 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82800e070 con 0x7fa830159fe0 2024-05-08T21:09:50.365 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:50.360+0000 7fa82f7fe700 1 -- 172.21.15.80:0/3953381657 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa82800bb20 con 0x7fa830159fe0 2024-05-08T21:09:50.366 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:50.360+0000 7fa82f7fe700 1 -- 172.21.15.80:0/3953381657 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa828012430 con 0x7fa830159fe0 2024-05-08T21:09:50.366 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:50.361+0000 7fa8371ba700 1 -- 172.21.15.80:0/3953381657 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa830159fe0 msgr2=0x7fa83015a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:50.366 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:50.361+0000 7fa8371ba700 1 --2- 172.21.15.80:0/3953381657 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa830159fe0 0x7fa83015a430 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa828009dc0 tx=0x7fa82800b330 comp rx=0 tx=0).stop 2024-05-08T21:09:50.366 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:50.361+0000 7fa8371ba700 1 -- 172.21.15.80:0/3953381657 shutdown_connections 2024-05-08T21:09:50.366 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:50.361+0000 7fa8371ba700 1 --2- 172.21.15.80:0/3953381657 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa830159fe0 0x7fa83015a430 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:50.366 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:50.361+0000 7fa8371ba700 1 -- 172.21.15.80:0/3953381657 >> 172.21.15.80:0/3953381657 conn(0x7fa83006bad0 msgr2=0x7fa83006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:09:50.366 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:50.361+0000 7fa8371ba700 1 -- 172.21.15.80:0/3953381657 shutdown_connections 2024-05-08T21:09:50.366 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:50.361+0000 7fa8371ba700 1 -- 172.21.15.80:0/3953381657 wait complete. 2024-05-08T21:09:50.369 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:50.362+0000 7fa8371ba700 1 Processor -- start 2024-05-08T21:09:50.369 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:50.362+0000 7fa8371ba700 1 -- start start 2024-05-08T21:09:50.369 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:50.363+0000 7fa8371ba700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa83006b4e0 0x7fa8301f2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:50.369 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:50.363+0000 7fa8371ba700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa8301541b0 0x7fa830157130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:50.369 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:50.363+0000 7fa8371ba700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa830159fe0 0x7fa830154b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:50.369 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:50.364+0000 7fa8371ba700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8300cb750 con 0x7fa830159fe0 2024-05-08T21:09:50.369 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:50.364+0000 7fa8371ba700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8300c6e50 con 0x7fa83006b4e0 2024-05-08T21:09:50.369 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:50.364+0000 7fa8371ba700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8301f2f80 con 0x7fa8301541b0 2024-05-08T21:09:50.369 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:50.364+0000 7fa835757700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa830159fe0 0x7fa830154b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:50.369 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:50.364+0000 7fa835757700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa830159fe0 0x7fa830154b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35232/0 (socket says 172.21.15.80:35232) 2024-05-08T21:09:50.369 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:50.364+0000 7fa835757700 1 -- 172.21.15.80:0/2547363775 learned_addr learned my addr 172.21.15.80:0/2547363775 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:09:50.369 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:50.364+0000 7fa834f56700 1 --2- 172.21.15.80:0/2547363775 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa83006b4e0 0x7fa8301f2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:50.369 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:50.364+0000 7fa82ffff700 1 --2- 172.21.15.80:0/2547363775 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa8301541b0 0x7fa830157130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:50.370 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:50.364+0000 7fa835757700 1 -- 172.21.15.80:0/2547363775 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa8301541b0 msgr2=0x7fa830157130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:50.370 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:50.364+0000 7fa835757700 1 --2- 172.21.15.80:0/2547363775 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa8301541b0 0x7fa830157130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:50.370 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:50.364+0000 7fa835757700 1 -- 172.21.15.80:0/2547363775 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa83006b4e0 msgr2=0x7fa8301f2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:50.370 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:50.364+0000 7fa835757700 1 --2- 172.21.15.80:0/2547363775 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa83006b4e0 0x7fa8301f2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:50.370 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:50.364+0000 7fa835757700 1 -- 172.21.15.80:0/2547363775 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa828009a70 con 0x7fa830159fe0 2024-05-08T21:09:50.370 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:50.364+0000 7fa834f56700 1 --2- 172.21.15.80:0/2547363775 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa83006b4e0 0x7fa8301f2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:09:50.370 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:50.364+0000 7fa835757700 1 --2- 172.21.15.80:0/2547363775 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa830159fe0 0x7fa830154b80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa828014040 tx=0x7fa828004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:09:50.370 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:50.364+0000 7fa82d7fa700 1 -- 172.21.15.80:0/2547363775 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82801c810 con 0x7fa830159fe0 2024-05-08T21:09:50.370 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:50.364+0000 7fa82d7fa700 1 -- 172.21.15.80:0/2547363775 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa828020070 con 0x7fa830159fe0 2024-05-08T21:09:50.370 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:50.364+0000 7fa8371ba700 1 -- 172.21.15.80:0/2547363775 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8300ca9e0 con 0x7fa830159fe0 2024-05-08T21:09:50.370 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:50.364+0000 7fa82d7fa700 1 -- 172.21.15.80:0/2547363775 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82801cbb0 con 0x7fa830159fe0 2024-05-08T21:09:50.370 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:50.364+0000 7fa8371ba700 1 -- 172.21.15.80:0/2547363775 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8300cc680 con 0x7fa830159fe0 2024-05-08T21:09:50.370 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:50.365+0000 7fa82d7fa700 1 -- 172.21.15.80:0/2547363775 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fa828027780 con 0x7fa830159fe0 2024-05-08T21:09:50.371 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:50.365+0000 7fa82d7fa700 1 -- 172.21.15.80:0/2547363775 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fa828022070 con 0x7fa830159fe0 2024-05-08T21:09:50.371 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:50.366+0000 7fa8371ba700 1 -- 172.21.15.80:0/2547363775 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa83004ec60 con 0x7fa830159fe0 2024-05-08T21:09:50.371 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:50.368+0000 7fa82d7fa700 1 -- 172.21.15.80:0/2547363775 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7fa82802c060 con 0x7fa830159fe0 2024-05-08T21:09:50.443 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:50.439+0000 7fa8371ba700 1 -- 172.21.15.80:0/2547363775 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa8300c7480 con 0x7fa830159fe0 2024-05-08T21:09:50.443 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:50.440+0000 7fa82d7fa700 1 -- 172.21.15.80:0/2547363775 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fa828031430 con 0x7fa830159fe0 2024-05-08T21:09:50.443 INFO:teuthology.misc.health.smithi080.stdout: 2024-05-08T21:09:50.443 INFO:teuthology.misc.health.smithi080.stdout:{"epoch":10,"fsid":"44d31c1e-aad3-47ca-a4fa-85a63d4a60aa","created":"2024-05-08T21:09:46.467038+0000","modified":"2024-05-08T21:09:49.125444+0000","last_up_change":"0.000000","last_in_change":"2024-05-08T21:09:49.125444+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c3f9d93e-ed6d-4a0c-b5c0-0e8d44c65fdd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"4ce2b4d6-6c40-43aa-8dd1-743fef8915df","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e30cc3bc-6461-4fac-960a-de00c9488d6d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a415c099-9ea6-40be-98ed-f2932f98dfd9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"5ae1d51f-0918-4571-b79b-154308d46a11","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"a19ac74e-4282-4428-b167-26ba6b92f732","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"bfe72edd-7acc-4805-807d-2000e76f2feb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"99897f22-ed17-4c7c-9088-cc0c4a51f786","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T21:09:50.445 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:50.441+0000 7fa8371ba700 1 -- 172.21.15.80:0/2547363775 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa830159fe0 msgr2=0x7fa830154b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:50.445 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:50.441+0000 7fa8371ba700 1 --2- 172.21.15.80:0/2547363775 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa830159fe0 0x7fa830154b80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa828014040 tx=0x7fa828004ad0 comp rx=0 tx=0).stop 2024-05-08T21:09:50.445 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:50.441+0000 7fa8371ba700 1 -- 172.21.15.80:0/2547363775 shutdown_connections 2024-05-08T21:09:50.445 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:50.441+0000 7fa8371ba700 1 --2- 172.21.15.80:0/2547363775 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa830159fe0 0x7fa830154b80 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:50.445 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:50.441+0000 7fa8371ba700 1 --2- 172.21.15.80:0/2547363775 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa83006b4e0 0x7fa8301f2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:50.445 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:50.441+0000 7fa8371ba700 1 --2- 172.21.15.80:0/2547363775 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa8301541b0 0x7fa830157130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:50.445 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:50.441+0000 7fa8371ba700 1 -- 172.21.15.80:0/2547363775 >> 172.21.15.80:0/2547363775 conn(0x7fa83006bad0 msgr2=0x7fa83006ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:09:50.445 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:50.441+0000 7fa8371ba700 1 -- 172.21.15.80:0/2547363775 shutdown_connections 2024-05-08T21:09:50.445 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:50.441+0000 7fa8371ba700 1 -- 172.21.15.80:0/2547363775 wait complete. 2024-05-08T21:09:50.455 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-08T21:09:50.493 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-05-08T21:09:50.490+0000 7f8d54405200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-08T21:09:50.543 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-08T21:09:50.539+0000 7fdcd819f200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-08T21:09:50.699 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-08T21:09:50.695+0000 7fdcd819f200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-08T21:09:50.865 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-08T21:09:50.861+0000 7fdcd819f200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-08T21:09:51.043 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-05-08T21:09:51.040+0000 7f8d54405200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-08T21:09:51.214 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-05-08T21:09:51.211+0000 7f8d54405200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-08T21:09:51.376 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-05-08T21:09:51.373+0000 7f8d54405200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-08T21:09:51.695 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-08T21:09:51.692+0000 7fdcd819f200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-08T21:09:51.934 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-08T21:09:51.930+0000 7fdcd819f200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-08T21:09:52.017 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-08T21:09:52.014+0000 7fdcd819f200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-08T21:09:52.178 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-08T21:09:52.175+0000 7fdcd819f200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-08T21:09:52.193 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-05-08T21:09:52.190+0000 7f8d54405200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-08T21:09:52.444 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-05-08T21:09:52.441+0000 7f8d54405200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-08T21:09:52.519 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-05-08T21:09:52.516+0000 7f8d54405200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-08T21:09:52.749 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-05-08T21:09:52.746+0000 7f8d54405200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-08T21:09:53.041 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T21:09:53.037+0000 7f6783f207c0 -1 osd.2 0 log_to_monitors true 2024-05-08T21:09:53.202 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-08T21:09:53.199+0000 7fdc9343b700 -1 mgr.server handle_report got status from non-daemon mon.c 2024-05-08T21:09:53.203 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-05-08T21:09:53.200+0000 7fdc9343b700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-05-08T21:09:53.262 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T21:09:53.259+0000 7f800de3a7c0 -1 osd.0 0 log_to_monitors true 2024-05-08T21:09:53.283 INFO:tasks.ceph.osd.7.smithi106.stderr:2024-05-08T21:09:53.280+0000 7feb1205b7c0 -1 osd.7 0 log_to_monitors true 2024-05-08T21:09:53.283 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T21:09:53.280+0000 7fb325fe27c0 -1 osd.1 0 log_to_monitors true 2024-05-08T21:09:53.301 INFO:tasks.ceph.osd.5.smithi106.stderr:2024-05-08T21:09:53.298+0000 7f4ce4e4d7c0 -1 osd.5 0 log_to_monitors true 2024-05-08T21:09:53.302 INFO:tasks.ceph.osd.6.smithi106.stderr:2024-05-08T21:09:53.300+0000 7f02a94d87c0 -1 osd.6 0 log_to_monitors true 2024-05-08T21:09:53.305 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T21:09:53.302+0000 7fbce26af7c0 -1 osd.3 0 log_to_monitors true 2024-05-08T21:09:53.317 INFO:tasks.ceph.osd.4.smithi106.stderr:2024-05-08T21:09:53.314+0000 7f4485fb47c0 -1 osd.4 0 log_to_monitors true 2024-05-08T21:09:54.845 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T21:09:54.842+0000 7f67782d6700 -1 osd.2 0 waiting for initial osdmap 2024-05-08T21:09:54.855 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T21:09:54.852+0000 7f676feb0700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T21:09:56.101 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T21:09:56.097+0000 7fbcd6a65700 -1 osd.3 0 waiting for initial osdmap 2024-05-08T21:09:56.110 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T21:09:56.107+0000 7f80021f0700 -1 osd.0 0 waiting for initial osdmap 2024-05-08T21:09:56.133 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T21:09:56.130+0000 7fbcce63f700 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T21:09:56.146 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T21:09:56.143+0000 7f7ff9dca700 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T21:09:56.179 INFO:tasks.ceph.osd.7.smithi106.stderr:2024-05-08T21:09:56.176+0000 7feb06411700 -1 osd.7 0 waiting for initial osdmap 2024-05-08T21:09:56.199 INFO:tasks.ceph.osd.7.smithi106.stderr:2024-05-08T21:09:56.196+0000 7feafdfeb700 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T21:09:56.254 INFO:tasks.ceph.osd.6.smithi106.stderr:2024-05-08T21:09:56.250+0000 7f029d88e700 -1 osd.6 0 waiting for initial osdmap 2024-05-08T21:09:56.270 INFO:tasks.ceph.osd.5.smithi106.stderr:2024-05-08T21:09:56.267+0000 7f4cd9203700 -1 osd.5 0 waiting for initial osdmap 2024-05-08T21:09:56.274 INFO:tasks.ceph.osd.6.smithi106.stderr:2024-05-08T21:09:56.271+0000 7f0295468700 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T21:09:56.276 INFO:tasks.ceph.osd.4.smithi106.stderr:2024-05-08T21:09:56.273+0000 7f447a36a700 -1 osd.4 0 waiting for initial osdmap 2024-05-08T21:09:56.287 INFO:tasks.ceph.osd.5.smithi106.stderr:2024-05-08T21:09:56.284+0000 7f4cd0ddd700 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T21:09:56.289 INFO:tasks.ceph.osd.4.smithi106.stderr:2024-05-08T21:09:56.287+0000 7f4471f44700 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T21:09:56.519 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T21:09:56.515+0000 7fb31a398700 -1 osd.1 0 waiting for initial osdmap 2024-05-08T21:09:56.528 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T21:09:56.525+0000 7fb311f72700 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T21:09:57.263 DEBUG:teuthology.orchestra.run.smithi080:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-08T21:09:57.393 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.390+0000 7f1e649a7700 1 Processor -- start 2024-05-08T21:09:57.393 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.390+0000 7f1e649a7700 1 -- start start 2024-05-08T21:09:57.396 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.391+0000 7f1e649a7700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1e60151380 0x7f1e60071810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:57.396 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.391+0000 7f1e649a7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1e600c3680 0x7f1e60071d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:57.396 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.391+0000 7f1e649a7700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e60157910 con 0x7f1e6006e000 2024-05-08T21:09:57.396 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.391+0000 7f1e649a7700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e60157e50 con 0x7f1e600c3680 2024-05-08T21:09:57.396 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.391+0000 7f1e649a7700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e600c7260 con 0x7f1e60151380 2024-05-08T21:09:57.396 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.391+0000 7f1e5ed9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1e600c3680 0x7f1e60071d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:57.396 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.391+0000 7f1e5dd9b700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f1e6006e000 0x7f1e6006ec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:38458/0 (socket says 172.21.15.80:38458) 2024-05-08T21:09:57.396 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.391+0000 7f1e5ed9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1e600c3680 0x7f1e60071d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57674/0 (socket says 172.21.15.80:57674) 2024-05-08T21:09:57.396 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.391+0000 7f1e5dd9b700 1 -- 172.21.15.80:0/2523585960 learned_addr learned my addr 172.21.15.80:0/2523585960 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:09:57.396 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.391+0000 7f1e5e59c700 1 --2- 172.21.15.80:0/2523585960 >> v2:172.21.15.106:3300/0 conn(0x7f1e60151380 0x7f1e60071810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:57.397 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.391+0000 7f1e5ed9d700 1 -- 172.21.15.80:0/2523585960 >> v2:172.21.15.106:3300/0 conn(0x7f1e60151380 msgr2=0x7f1e60071810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:09:57.397 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.391+0000 7f1e5ed9d700 1 --2- 172.21.15.80:0/2523585960 >> v2:172.21.15.106:3300/0 conn(0x7f1e60151380 0x7f1e60071810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:57.397 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.391+0000 7f1e5ed9d700 1 -- 172.21.15.80:0/2523585960 >> v1:172.21.15.80:6789/0 conn(0x7f1e6006e000 legacy=0x7f1e6006ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:57.397 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.391+0000 7f1e5d59a700 1 -- 172.21.15.80:0/2523585960 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2499610730 0 0) 0x7f1e60157910 con 0x7f1e6006e000 2024-05-08T21:09:57.397 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.391+0000 7f1e5ed9d700 1 -- 172.21.15.80:0/2523585960 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e60157b70 con 0x7f1e600c3680 2024-05-08T21:09:57.397 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.391+0000 7f1e5ed9d700 1 --2- 172.21.15.80:0/2523585960 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e600c3680 0x7f1e60071d50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1e58009d90 tx=0x7f1e5800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31f9270670fe51f0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:09:57.397 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.392+0000 7f1e5d59a700 1 -- 172.21.15.80:0/2523585960 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e5800e070 con 0x7f1e600c3680 2024-05-08T21:09:57.397 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.392+0000 7f1e5d59a700 1 -- 172.21.15.80:0/2523585960 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e5800bb90 con 0x7f1e600c3680 2024-05-08T21:09:57.397 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.392+0000 7f1e5d59a700 1 -- 172.21.15.80:0/2523585960 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e58012430 con 0x7f1e600c3680 2024-05-08T21:09:57.397 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.392+0000 7f1e649a7700 1 -- 172.21.15.80:0/2523585960 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e600c3680 msgr2=0x7f1e60071d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:57.397 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.392+0000 7f1e649a7700 1 --2- 172.21.15.80:0/2523585960 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e600c3680 0x7f1e60071d50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1e58009d90 tx=0x7f1e5800b330 comp rx=0 tx=0).stop 2024-05-08T21:09:57.397 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.392+0000 7f1e649a7700 1 -- 172.21.15.80:0/2523585960 shutdown_connections 2024-05-08T21:09:57.397 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.392+0000 7f1e649a7700 1 --2- 172.21.15.80:0/2523585960 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e600c3680 0x7f1e60071d50 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:57.397 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.392+0000 7f1e649a7700 1 --2- 172.21.15.80:0/2523585960 >> v2:172.21.15.106:3300/0 conn(0x7f1e60151380 0x7f1e60071810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:57.398 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.392+0000 7f1e649a7700 1 -- 172.21.15.80:0/2523585960 >> 172.21.15.80:0/2523585960 conn(0x7f1e600c9230 msgr2=0x7f1e600c9640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:09:57.398 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.392+0000 7f1e649a7700 1 -- 172.21.15.80:0/2523585960 shutdown_connections 2024-05-08T21:09:57.398 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.392+0000 7f1e649a7700 1 -- 172.21.15.80:0/2523585960 wait complete. 2024-05-08T21:09:57.401 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.394+0000 7f1e649a7700 1 Processor -- start 2024-05-08T21:09:57.401 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.394+0000 7f1e649a7700 1 -- start start 2024-05-08T21:09:57.401 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.394+0000 7f1e649a7700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1e6006e000 0x7f1e601eb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:57.401 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.394+0000 7f1e649a7700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1e600c3680 0x7f1e601e2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:57.401 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.394+0000 7f1e649a7700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e60151380 0x7f1e601e29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:57.401 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.394+0000 7f1e649a7700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e60151fd0 con 0x7f1e60151380 2024-05-08T21:09:57.401 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.394+0000 7f1e649a7700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e60153850 con 0x7f1e6006e000 2024-05-08T21:09:57.401 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.394+0000 7f1e649a7700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e60152270 con 0x7f1e600c3680 2024-05-08T21:09:57.401 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.394+0000 7f1e5ed9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e60151380 0x7f1e601e29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:57.401 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.395+0000 7f1e5ed9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e60151380 0x7f1e601e29b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57688/0 (socket says 172.21.15.80:57688) 2024-05-08T21:09:57.401 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.395+0000 7f1e5ed9d700 1 -- 172.21.15.80:0/746937039 learned_addr learned my addr 172.21.15.80:0/746937039 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:09:57.401 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.395+0000 7f1e5e59c700 1 --2- 172.21.15.80:0/746937039 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1e6006e000 0x7f1e601eb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:57.401 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.395+0000 7f1e5dd9b700 1 --2- 172.21.15.80:0/746937039 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1e600c3680 0x7f1e601e2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:57.402 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.395+0000 7f1e5ed9d700 1 -- 172.21.15.80:0/746937039 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1e600c3680 msgr2=0x7f1e601e2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:57.402 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.395+0000 7f1e5ed9d700 1 --2- 172.21.15.80:0/746937039 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1e600c3680 0x7f1e601e2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:57.402 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.395+0000 7f1e5ed9d700 1 -- 172.21.15.80:0/746937039 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1e6006e000 msgr2=0x7f1e601eb6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:57.402 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.395+0000 7f1e5ed9d700 1 --2- 172.21.15.80:0/746937039 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1e6006e000 0x7f1e601eb6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:57.402 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.395+0000 7f1e5ed9d700 1 -- 172.21.15.80:0/746937039 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e58009a70 con 0x7f1e60151380 2024-05-08T21:09:57.402 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.395+0000 7f1e5ed9d700 1 --2- 172.21.15.80:0/746937039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e60151380 0x7f1e601e29b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1e58013000 tx=0x7f1e58004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:09:57.402 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.395+0000 7f1e4effd700 1 -- 172.21.15.80:0/746937039 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e5801b810 con 0x7f1e60151380 2024-05-08T21:09:57.402 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.395+0000 7f1e4effd700 1 -- 172.21.15.80:0/746937039 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e58020070 con 0x7f1e60151380 2024-05-08T21:09:57.402 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.395+0000 7f1e649a7700 1 -- 172.21.15.80:0/746937039 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e60152550 con 0x7f1e60151380 2024-05-08T21:09:57.402 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.395+0000 7f1e4effd700 1 -- 172.21.15.80:0/746937039 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e5801bbd0 con 0x7f1e60151380 2024-05-08T21:09:57.402 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.395+0000 7f1e649a7700 1 -- 172.21.15.80:0/746937039 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e60152b10 con 0x7f1e60151380 2024-05-08T21:09:57.402 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.396+0000 7f1e649a7700 1 -- 172.21.15.80:0/746937039 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e6004ec60 con 0x7f1e60151380 2024-05-08T21:09:57.402 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.397+0000 7f1e4effd700 1 -- 172.21.15.80:0/746937039 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 4) v1 ==== 89089+0+0 (secure 0 0 0) 0x7f1e5801bd30 con 0x7f1e60151380 2024-05-08T21:09:57.403 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.397+0000 7f1e4effd700 1 --2- 172.21.15.80:0/746937039 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f1e4006ac00 0x7f1e4006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:57.403 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.397+0000 7f1e5e59c700 1 --2- 172.21.15.80:0/746937039 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f1e4006ac00 0x7f1e4006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:57.403 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.397+0000 7f1e4effd700 1 -- 172.21.15.80:0/746937039 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f1e58022070 con 0x7f1e60151380 2024-05-08T21:09:57.403 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.397+0000 7f1e5e59c700 1 --2- 172.21.15.80:0/746937039 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f1e4006ac00 0x7f1e4006d0c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1e50007a30 tx=0x7f1e50008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:09:57.405 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.402+0000 7f1e4effd700 1 -- 172.21.15.80:0/746937039 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f1e58056490 con 0x7f1e60151380 2024-05-08T21:09:57.600 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.597+0000 7f1e649a7700 1 -- 172.21.15.80:0/746937039 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1e6006fbf0 con 0x7f1e60151380 2024-05-08T21:09:57.601 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.598+0000 7f1e4effd700 1 -- 172.21.15.80:0/746937039 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+10509 (secure 0 0 0) 0x7f1e5802c090 con 0x7f1e60151380 2024-05-08T21:09:57.601 INFO:teuthology.misc.health.smithi080.stdout: 2024-05-08T21:09:57.601 INFO:teuthology.misc.health.smithi080.stdout:{"epoch":15,"fsid":"44d31c1e-aad3-47ca-a4fa-85a63d4a60aa","created":"2024-05-08T21:09:46.467038+0000","modified":"2024-05-08T21:09:57.284675+0000","last_up_change":"2024-05-08T21:09:57.284675+0000","last_in_change":"2024-05-08T21:09:49.125444+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c3f9d93e-ed6d-4a0c-b5c0-0e8d44c65fdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":47011},{"type":"v1","addr":"172.21.15.80:6817","nonce":47011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":47011},{"type":"v1","addr":"172.21.15.80:6819","nonce":47011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":47011},{"type":"v1","addr":"172.21.15.80:6823","nonce":47011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":47011},{"type":"v1","addr":"172.21.15.80:6821","nonce":47011}]},"public_addr":"172.21.15.80:6817/47011","cluster_addr":"172.21.15.80:6819/47011","heartbeat_back_addr":"172.21.15.80:6823/47011","heartbeat_front_addr":"172.21.15.80:6821/47011","state":["exists","up"]},{"osd":1,"uuid":"4ce2b4d6-6c40-43aa-8dd1-743fef8915df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":47010},{"type":"v1","addr":"172.21.15.80:6809","nonce":47010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":47010},{"type":"v1","addr":"172.21.15.80:6811","nonce":47010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":47010},{"type":"v1","addr":"172.21.15.80:6815","nonce":47010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":47010},{"type":"v1","addr":"172.21.15.80:6813","nonce":47010}]},"public_addr":"172.21.15.80:6809/47010","cluster_addr":"172.21.15.80:6811/47010","heartbeat_back_addr":"172.21.15.80:6815/47010","heartbeat_front_addr":"172.21.15.80:6813/47010","state":["exists","up"]},{"osd":2,"uuid":"e30cc3bc-6461-4fac-960a-de00c9488d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":47009},{"type":"v1","addr":"172.21.15.80:6801","nonce":47009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":47009},{"type":"v1","addr":"172.21.15.80:6803","nonce":47009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":47009},{"type":"v1","addr":"172.21.15.80:6807","nonce":47009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":47009},{"type":"v1","addr":"172.21.15.80:6805","nonce":47009}]},"public_addr":"172.21.15.80:6801/47009","cluster_addr":"172.21.15.80:6803/47009","heartbeat_back_addr":"172.21.15.80:6807/47009","heartbeat_front_addr":"172.21.15.80:6805/47009","state":["exists","up"]},{"osd":3,"uuid":"a415c099-9ea6-40be-98ed-f2932f98dfd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":47012},{"type":"v1","addr":"172.21.15.80:6825","nonce":47012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":47012},{"type":"v1","addr":"172.21.15.80:6827","nonce":47012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":47012},{"type":"v1","addr":"172.21.15.80:6831","nonce":47012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":47012},{"type":"v1","addr":"172.21.15.80:6829","nonce":47012}]},"public_addr":"172.21.15.80:6825/47012","cluster_addr":"172.21.15.80:6827/47012","heartbeat_back_addr":"172.21.15.80:6831/47012","heartbeat_front_addr":"172.21.15.80:6829/47012","state":["exists","up"]},{"osd":4,"uuid":"5ae1d51f-0918-4571-b79b-154308d46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6823","nonce":47114},{"type":"v1","addr":"172.21.15.106:6825","nonce":47114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":47114},{"type":"v1","addr":"172.21.15.106:6827","nonce":47114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":47114},{"type":"v1","addr":"172.21.15.106:6831","nonce":47114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":47114},{"type":"v1","addr":"172.21.15.106:6829","nonce":47114}]},"public_addr":"172.21.15.106:6825/47114","cluster_addr":"172.21.15.106:6827/47114","heartbeat_back_addr":"172.21.15.106:6831/47114","heartbeat_front_addr":"172.21.15.106:6829/47114","state":["exists","up"]},{"osd":5,"uuid":"a19ac74e-4282-4428-b167-26ba6b92f732","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6807","nonce":47111},{"type":"v1","addr":"172.21.15.106:6809","nonce":47111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":47111},{"type":"v1","addr":"172.21.15.106:6811","nonce":47111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":47111},{"type":"v1","addr":"172.21.15.106:6815","nonce":47111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":47111},{"type":"v1","addr":"172.21.15.106:6813","nonce":47111}]},"public_addr":"172.21.15.106:6809/47111","cluster_addr":"172.21.15.106:6811/47111","heartbeat_back_addr":"172.21.15.106:6815/47111","heartbeat_front_addr":"172.21.15.106:6813/47111","state":["exists","up"]},{"osd":6,"uuid":"bfe72edd-7acc-4805-807d-2000e76f2feb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":47112},{"type":"v1","addr":"172.21.15.106:6817","nonce":47112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":47112},{"type":"v1","addr":"172.21.15.106:6819","nonce":47112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":47112},{"type":"v1","addr":"172.21.15.106:6824","nonce":47112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":47112},{"type":"v1","addr":"172.21.15.106:6821","nonce":47112}]},"public_addr":"172.21.15.106:6817/47112","cluster_addr":"172.21.15.106:6819/47112","heartbeat_back_addr":"172.21.15.106:6824/47112","heartbeat_front_addr":"172.21.15.106:6821/47112","state":["exists","up"]},{"osd":7,"uuid":"99897f22-ed17-4c7c-9088-cc0c4a51f786","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":47113},{"type":"v1","addr":"172.21.15.106:6801","nonce":47113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":47113},{"type":"v1","addr":"172.21.15.106:6803","nonce":47113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":47113},{"type":"v1","addr":"172.21.15.106:6808","nonce":47113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":47113},{"type":"v1","addr":"172.21.15.106:6805","nonce":47113}]},"public_addr":"172.21.15.106:6801/47113","cluster_addr":"172.21.15.106:6803/47113","heartbeat_back_addr":"172.21.15.106:6808/47113","heartbeat_front_addr":"172.21.15.106:6805/47113","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.050087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.349312+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.275013+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T21:09:57.603 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.600+0000 7f1e649a7700 1 -- 172.21.15.80:0/746937039 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f1e4006ac00 msgr2=0x7f1e4006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:57.603 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.600+0000 7f1e649a7700 1 --2- 172.21.15.80:0/746937039 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f1e4006ac00 0x7f1e4006d0c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1e50007a30 tx=0x7f1e50008040 comp rx=0 tx=0).stop 2024-05-08T21:09:57.603 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.600+0000 7f1e649a7700 1 -- 172.21.15.80:0/746937039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e60151380 msgr2=0x7f1e601e29b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:57.603 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.600+0000 7f1e649a7700 1 --2- 172.21.15.80:0/746937039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e60151380 0x7f1e601e29b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1e58013000 tx=0x7f1e58004ad0 comp rx=0 tx=0).stop 2024-05-08T21:09:57.604 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.600+0000 7f1e649a7700 1 -- 172.21.15.80:0/746937039 shutdown_connections 2024-05-08T21:09:57.604 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.600+0000 7f1e649a7700 1 --2- 172.21.15.80:0/746937039 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f1e4006ac00 0x7f1e4006d0c0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:57.604 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.600+0000 7f1e649a7700 1 --2- 172.21.15.80:0/746937039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e60151380 0x7f1e601e29b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:57.604 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.600+0000 7f1e649a7700 1 --2- 172.21.15.80:0/746937039 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1e6006e000 0x7f1e601eb6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:57.604 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.600+0000 7f1e649a7700 1 --2- 172.21.15.80:0/746937039 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1e600c3680 0x7f1e601e2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:57.604 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.600+0000 7f1e649a7700 1 -- 172.21.15.80:0/746937039 >> 172.21.15.80:0/746937039 conn(0x7f1e600c9230 msgr2=0x7f1e600c5910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:09:57.604 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.600+0000 7f1e649a7700 1 -- 172.21.15.80:0/746937039 shutdown_connections 2024-05-08T21:09:57.604 INFO:teuthology.misc.health.smithi080.stderr:2024-05-08T21:09:57.600+0000 7f1e649a7700 1 -- 172.21.15.80:0/746937039 wait complete. 2024-05-08T21:09:57.614 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-05-08T21:09:57.614 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-05-08T21:09:57.615 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-08T21:09:57.615 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-08T21:09:57.617 INFO:tasks.ceph.mds.a:Started 2024-05-08T21:09:57.617 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-08T21:09:57.617 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-08T21:09:57.619 INFO:tasks.ceph.mds.c:Started 2024-05-08T21:09:57.619 INFO:tasks.ceph.mds.e:Restarting daemon 2024-05-08T21:09:57.619 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2024-05-08T21:09:57.621 INFO:tasks.ceph.mds.e:Started 2024-05-08T21:09:57.621 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-08T21:09:57.621 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-08T21:09:57.624 INFO:tasks.ceph.mds.b:Started 2024-05-08T21:09:57.624 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-08T21:09:57.624 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-08T21:09:57.626 INFO:tasks.ceph.mds.d:Started 2024-05-08T21:09:57.626 INFO:tasks.ceph.mds.f:Restarting daemon 2024-05-08T21:09:57.626 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i f 2024-05-08T21:09:57.631 INFO:tasks.ceph.mds.f:Started 2024-05-08T21:09:57.632 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-05-08T21:09:57.632 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T21:09:57.700 INFO:tasks.ceph.mds.a.smithi080.stdout:starting mds.a at 2024-05-08T21:09:57.700 INFO:tasks.ceph.mds.c.smithi080.stdout:starting mds.c at 2024-05-08T21:09:57.702 INFO:tasks.ceph.mds.e.smithi080.stdout:starting mds.e at 2024-05-08T21:09:57.721 INFO:tasks.ceph.mds.b.smithi106.stdout:starting mds.b at 2024-05-08T21:09:57.723 INFO:tasks.ceph.mds.d.smithi106.stdout:starting mds.d at 2024-05-08T21:09:57.724 INFO:tasks.ceph.mds.f.smithi106.stdout:starting mds.f at 2024-05-08T21:09:57.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.764+0000 7fee5cf67700 1 Processor -- start 2024-05-08T21:09:57.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.764+0000 7fee5cf67700 1 -- start start 2024-05-08T21:09:57.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.765+0000 7fee5cf67700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fee58154580 0x7fee5815abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:57.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.765+0000 7fee5cf67700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fee580cc3d0 0x7fee580cc800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:57.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.765+0000 7fee5cf67700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee580cad60 con 0x7fee580cbe40 2024-05-08T21:09:57.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.765+0000 7fee5cf67700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee580b2c60 con 0x7fee580cc3d0 2024-05-08T21:09:57.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.765+0000 7fee5cf67700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee5815d750 con 0x7fee58154580 2024-05-08T21:09:57.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.765+0000 7fee56d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fee580cc3d0 0x7fee580cc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:57.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.765+0000 7fee56d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fee580cc3d0 0x7fee580cc800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57730/0 (socket says 172.21.15.80:57730) 2024-05-08T21:09:57.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.765+0000 7fee56d9d700 1 -- 172.21.15.80:0/4267083114 learned_addr learned my addr 172.21.15.80:0/4267083114 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:09:57.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.765+0000 7fee5659c700 1 --2- 172.21.15.80:0/4267083114 >> v2:172.21.15.106:3300/0 conn(0x7fee58154580 0x7fee5815abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:57.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.765+0000 7fee56d9d700 1 -- 172.21.15.80:0/4267083114 >> v2:172.21.15.106:3300/0 conn(0x7fee58154580 msgr2=0x7fee5815abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:09:57.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.765+0000 7fee56d9d700 1 --2- 172.21.15.80:0/4267083114 >> v2:172.21.15.106:3300/0 conn(0x7fee58154580 0x7fee5815abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:57.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.765+0000 7fee56d9d700 1 -- 172.21.15.80:0/4267083114 >> v1:172.21.15.106:6789/0 conn(0x7fee580cbe40 legacy=0x7fee580c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:09:57.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.765+0000 7fee56d9d700 1 -- 172.21.15.80:0/4267083114 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee5815d930 con 0x7fee580cc3d0 2024-05-08T21:09:57.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.765+0000 7fee56d9d700 1 --2- 172.21.15.80:0/4267083114 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fee580cc3d0 0x7fee580cc800 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fee580cd360 tx=0x7fee5000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7155f761c0cf7c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:09:57.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.766+0000 7fee5559a700 1 -- 172.21.15.80:0/4267083114 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5000e070 con 0x7fee580cc3d0 2024-05-08T21:09:57.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.766+0000 7fee5559a700 1 -- 172.21.15.80:0/4267083114 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee50003a20 con 0x7fee580cc3d0 2024-05-08T21:09:57.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.766+0000 7fee5559a700 1 -- 172.21.15.80:0/4267083114 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee50003dd0 con 0x7fee580cc3d0 2024-05-08T21:09:57.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.766+0000 7fee5cf67700 1 -- 172.21.15.80:0/4267083114 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fee580cc3d0 msgr2=0x7fee580cc800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:57.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.766+0000 7fee5cf67700 1 --2- 172.21.15.80:0/4267083114 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fee580cc3d0 0x7fee580cc800 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fee580cd360 tx=0x7fee5000b330 comp rx=0 tx=0).stop 2024-05-08T21:09:57.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.766+0000 7fee5cf67700 1 -- 172.21.15.80:0/4267083114 shutdown_connections 2024-05-08T21:09:57.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.766+0000 7fee5cf67700 1 --2- 172.21.15.80:0/4267083114 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fee580cc3d0 0x7fee580cc800 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:57.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.766+0000 7fee5cf67700 1 --2- 172.21.15.80:0/4267083114 >> v2:172.21.15.106:3300/0 conn(0x7fee58154580 0x7fee5815abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:57.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.766+0000 7fee5cf67700 1 -- 172.21.15.80:0/4267083114 >> 172.21.15.80:0/4267083114 conn(0x7fee5806c6a0 msgr2=0x7fee5806cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:09:57.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.766+0000 7fee5cf67700 1 -- 172.21.15.80:0/4267083114 shutdown_connections 2024-05-08T21:09:57.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.766+0000 7fee5cf67700 1 -- 172.21.15.80:0/4267083114 wait complete. 2024-05-08T21:09:57.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.768+0000 7fee5cf67700 1 Processor -- start 2024-05-08T21:09:57.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.768+0000 7fee5cf67700 1 -- start start 2024-05-08T21:09:57.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.768+0000 7fee5cf67700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fee580cbe40 0x7fee5814a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:57.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.768+0000 7fee5cf67700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fee580cc3d0 0x7fee5814a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:57.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.768+0000 7fee5cf67700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fee58154580 0x7fee580b5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:57.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.768+0000 7fee5cf67700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee58159b00 con 0x7fee580cbe40 2024-05-08T21:09:57.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.768+0000 7fee5cf67700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee581592f0 con 0x7fee58154580 2024-05-08T21:09:57.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.768+0000 7fee5cf67700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee580b48e0 con 0x7fee580cc3d0 2024-05-08T21:09:57.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.768+0000 7fee5659c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fee580cbe40 0x7fee5814a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:57.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.768+0000 7fee5659c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fee580cbe40 0x7fee5814a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57746/0 (socket says 172.21.15.80:57746) 2024-05-08T21:09:57.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.768+0000 7fee5659c700 1 -- 172.21.15.80:0/353334960 learned_addr learned my addr 172.21.15.80:0/353334960 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:09:57.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.768+0000 7fee56d9d700 1 --2- 172.21.15.80:0/353334960 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fee58154580 0x7fee580b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:57.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.768+0000 7fee55d9b700 1 --2- 172.21.15.80:0/353334960 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fee580cc3d0 0x7fee5814a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:57.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.769+0000 7fee5659c700 1 -- 172.21.15.80:0/353334960 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fee580cc3d0 msgr2=0x7fee5814a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:57.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.769+0000 7fee5659c700 1 --2- 172.21.15.80:0/353334960 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fee580cc3d0 0x7fee5814a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:57.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.769+0000 7fee5659c700 1 -- 172.21.15.80:0/353334960 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fee58154580 msgr2=0x7fee580b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:57.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.769+0000 7fee5659c700 1 --2- 172.21.15.80:0/353334960 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fee58154580 0x7fee580b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:57.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.769+0000 7fee5659c700 1 -- 172.21.15.80:0/353334960 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee50009b30 con 0x7fee580cbe40 2024-05-08T21:09:57.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.769+0000 7fee5659c700 1 --2- 172.21.15.80:0/353334960 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fee580cbe40 0x7fee5814a300 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fee4c00c7f0 tx=0x7fee4c00cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:09:57.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.769+0000 7fee46ffd700 1 -- 172.21.15.80:0/353334960 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4c011800 con 0x7fee580cbe40 2024-05-08T21:09:57.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.769+0000 7fee46ffd700 1 -- 172.21.15.80:0/353334960 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee4c011960 con 0x7fee580cbe40 2024-05-08T21:09:57.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.769+0000 7fee5cf67700 1 -- 172.21.15.80:0/353334960 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee58158210 con 0x7fee580cbe40 2024-05-08T21:09:57.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.769+0000 7fee46ffd700 1 -- 172.21.15.80:0/353334960 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4c011cd0 con 0x7fee580cbe40 2024-05-08T21:09:57.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.769+0000 7fee5cf67700 1 -- 172.21.15.80:0/353334960 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee58159820 con 0x7fee580cbe40 2024-05-08T21:09:57.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.770+0000 7fee5cf67700 1 -- 172.21.15.80:0/353334960 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee580b36f0 con 0x7fee580cbe40 2024-05-08T21:09:57.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.770+0000 7fee46ffd700 1 -- 172.21.15.80:0/353334960 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 4) v1 ==== 89089+0+0 (secure 0 0 0) 0x7fee4c004020 con 0x7fee580cbe40 2024-05-08T21:09:57.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.771+0000 7fee46ffd700 1 --2- 172.21.15.80:0/353334960 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fee3806ac00 0x7fee3806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:57.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.771+0000 7fee46ffd700 1 -- 172.21.15.80:0/353334960 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4471+0+0 (secure 0 0 0) 0x7fee4c088770 con 0x7fee580cbe40 2024-05-08T21:09:57.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.771+0000 7fee55d9b700 1 --2- 172.21.15.80:0/353334960 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fee3806ac00 0x7fee3806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:57.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.771+0000 7fee55d9b700 1 --2- 172.21.15.80:0/353334960 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fee3806ac00 0x7fee3806d0c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fee5815d5f0 tx=0x7fee48009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:09:57.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.775+0000 7fee46ffd700 1 -- 172.21.15.80:0/353334960 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fee4c053f90 con 0x7fee580cbe40 2024-05-08T21:09:57.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.971+0000 7fee5cf67700 1 -- 172.21.15.80:0/353334960 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fee5804ec60 con 0x7fee580cbe40 2024-05-08T21:09:57.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.972+0000 7fee46ffd700 1 -- 172.21.15.80:0/353334960 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+10509 (secure 0 0 0) 0x7fee4c01f090 con 0x7fee580cbe40 2024-05-08T21:09:57.976 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:09:57.976 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":15,"fsid":"44d31c1e-aad3-47ca-a4fa-85a63d4a60aa","created":"2024-05-08T21:09:46.467038+0000","modified":"2024-05-08T21:09:57.284675+0000","last_up_change":"2024-05-08T21:09:57.284675+0000","last_in_change":"2024-05-08T21:09:49.125444+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c3f9d93e-ed6d-4a0c-b5c0-0e8d44c65fdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":47011},{"type":"v1","addr":"172.21.15.80:6817","nonce":47011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":47011},{"type":"v1","addr":"172.21.15.80:6819","nonce":47011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":47011},{"type":"v1","addr":"172.21.15.80:6823","nonce":47011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":47011},{"type":"v1","addr":"172.21.15.80:6821","nonce":47011}]},"public_addr":"172.21.15.80:6817/47011","cluster_addr":"172.21.15.80:6819/47011","heartbeat_back_addr":"172.21.15.80:6823/47011","heartbeat_front_addr":"172.21.15.80:6821/47011","state":["exists","up"]},{"osd":1,"uuid":"4ce2b4d6-6c40-43aa-8dd1-743fef8915df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":47010},{"type":"v1","addr":"172.21.15.80:6809","nonce":47010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":47010},{"type":"v1","addr":"172.21.15.80:6811","nonce":47010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":47010},{"type":"v1","addr":"172.21.15.80:6815","nonce":47010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":47010},{"type":"v1","addr":"172.21.15.80:6813","nonce":47010}]},"public_addr":"172.21.15.80:6809/47010","cluster_addr":"172.21.15.80:6811/47010","heartbeat_back_addr":"172.21.15.80:6815/47010","heartbeat_front_addr":"172.21.15.80:6813/47010","state":["exists","up"]},{"osd":2,"uuid":"e30cc3bc-6461-4fac-960a-de00c9488d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":47009},{"type":"v1","addr":"172.21.15.80:6801","nonce":47009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":47009},{"type":"v1","addr":"172.21.15.80:6803","nonce":47009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":47009},{"type":"v1","addr":"172.21.15.80:6807","nonce":47009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":47009},{"type":"v1","addr":"172.21.15.80:6805","nonce":47009}]},"public_addr":"172.21.15.80:6801/47009","cluster_addr":"172.21.15.80:6803/47009","heartbeat_back_addr":"172.21.15.80:6807/47009","heartbeat_front_addr":"172.21.15.80:6805/47009","state":["exists","up"]},{"osd":3,"uuid":"a415c099-9ea6-40be-98ed-f2932f98dfd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":47012},{"type":"v1","addr":"172.21.15.80:6825","nonce":47012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":47012},{"type":"v1","addr":"172.21.15.80:6827","nonce":47012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":47012},{"type":"v1","addr":"172.21.15.80:6831","nonce":47012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":47012},{"type":"v1","addr":"172.21.15.80:6829","nonce":47012}]},"public_addr":"172.21.15.80:6825/47012","cluster_addr":"172.21.15.80:6827/47012","heartbeat_back_addr":"172.21.15.80:6831/47012","heartbeat_front_addr":"172.21.15.80:6829/47012","state":["exists","up"]},{"osd":4,"uuid":"5ae1d51f-0918-4571-b79b-154308d46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6823","nonce":47114},{"type":"v1","addr":"172.21.15.106:6825","nonce":47114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":47114},{"type":"v1","addr":"172.21.15.106:6827","nonce":47114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":47114},{"type":"v1","addr":"172.21.15.106:6831","nonce":47114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":47114},{"type":"v1","addr":"172.21.15.106:6829","nonce":47114}]},"public_addr":"172.21.15.106:6825/47114","cluster_addr":"172.21.15.106:6827/47114","heartbeat_back_addr":"172.21.15.106:6831/47114","heartbeat_front_addr":"172.21.15.106:6829/47114","state":["exists","up"]},{"osd":5,"uuid":"a19ac74e-4282-4428-b167-26ba6b92f732","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6807","nonce":47111},{"type":"v1","addr":"172.21.15.106:6809","nonce":47111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":47111},{"type":"v1","addr":"172.21.15.106:6811","nonce":47111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":47111},{"type":"v1","addr":"172.21.15.106:6815","nonce":47111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":47111},{"type":"v1","addr":"172.21.15.106:6813","nonce":47111}]},"public_addr":"172.21.15.106:6809/47111","cluster_addr":"172.21.15.106:6811/47111","heartbeat_back_addr":"172.21.15.106:6815/47111","heartbeat_front_addr":"172.21.15.106:6813/47111","state":["exists","up"]},{"osd":6,"uuid":"bfe72edd-7acc-4805-807d-2000e76f2feb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":47112},{"type":"v1","addr":"172.21.15.106:6817","nonce":47112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":47112},{"type":"v1","addr":"172.21.15.106:6819","nonce":47112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":47112},{"type":"v1","addr":"172.21.15.106:6824","nonce":47112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":47112},{"type":"v1","addr":"172.21.15.106:6821","nonce":47112}]},"public_addr":"172.21.15.106:6817/47112","cluster_addr":"172.21.15.106:6819/47112","heartbeat_back_addr":"172.21.15.106:6824/47112","heartbeat_front_addr":"172.21.15.106:6821/47112","state":["exists","up"]},{"osd":7,"uuid":"99897f22-ed17-4c7c-9088-cc0c4a51f786","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":47113},{"type":"v1","addr":"172.21.15.106:6801","nonce":47113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":47113},{"type":"v1","addr":"172.21.15.106:6803","nonce":47113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":47113},{"type":"v1","addr":"172.21.15.106:6808","nonce":47113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":47113},{"type":"v1","addr":"172.21.15.106:6805","nonce":47113}]},"public_addr":"172.21.15.106:6801/47113","cluster_addr":"172.21.15.106:6803/47113","heartbeat_back_addr":"172.21.15.106:6808/47113","heartbeat_front_addr":"172.21.15.106:6805/47113","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.050087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.349312+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.275013+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T21:09:57.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.974+0000 7fee5cf67700 1 -- 172.21.15.80:0/353334960 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fee3806ac00 msgr2=0x7fee3806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:57.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.974+0000 7fee5cf67700 1 --2- 172.21.15.80:0/353334960 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fee3806ac00 0x7fee3806d0c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fee5815d5f0 tx=0x7fee48009040 comp rx=0 tx=0).stop 2024-05-08T21:09:57.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.974+0000 7fee5cf67700 1 -- 172.21.15.80:0/353334960 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fee580cbe40 msgr2=0x7fee5814a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:57.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.974+0000 7fee5cf67700 1 --2- 172.21.15.80:0/353334960 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fee580cbe40 0x7fee5814a300 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fee4c00c7f0 tx=0x7fee4c00cb00 comp rx=0 tx=0).stop 2024-05-08T21:09:57.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.974+0000 7fee5cf67700 1 -- 172.21.15.80:0/353334960 shutdown_connections 2024-05-08T21:09:57.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.974+0000 7fee5cf67700 1 --2- 172.21.15.80:0/353334960 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fee3806ac00 0x7fee3806d0c0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:57.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.974+0000 7fee5cf67700 1 --2- 172.21.15.80:0/353334960 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fee580cbe40 0x7fee5814a300 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:57.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.974+0000 7fee5cf67700 1 --2- 172.21.15.80:0/353334960 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fee58154580 0x7fee580b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:57.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.974+0000 7fee5cf67700 1 --2- 172.21.15.80:0/353334960 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fee580cc3d0 0x7fee5814a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:57.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.974+0000 7fee5cf67700 1 -- 172.21.15.80:0/353334960 >> 172.21.15.80:0/353334960 conn(0x7fee5806c6a0 msgr2=0x7fee581e3580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:09:57.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.974+0000 7fee5cf67700 1 -- 172.21.15.80:0/353334960 shutdown_connections 2024-05-08T21:09:57.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:57.974+0000 7fee5cf67700 1 -- 172.21.15.80:0/353334960 wait complete. 2024-05-08T21:09:57.990 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2024-05-08T21:09:57.990 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:09:58.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.107+0000 7faf339a0700 1 Processor -- start 2024-05-08T21:09:58.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.107+0000 7faf339a0700 1 -- start start 2024-05-08T21:09:58.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.108+0000 7faf339a0700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7faf2c1541a0 0x7faf2c15a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:58.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.108+0000 7faf339a0700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7faf2c0c9150 0x7faf2c0c95b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:58.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.108+0000 7faf339a0700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf2c0c8cc0 con 0x7faf2c072600 2024-05-08T21:09:58.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.108+0000 7faf339a0700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf2c06c5a0 con 0x7faf2c0c9150 2024-05-08T21:09:58.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.108+0000 7faf339a0700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf2c06ce60 con 0x7faf2c1541a0 2024-05-08T21:09:58.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.108+0000 7faf30f3b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7faf2c0c9150 0x7faf2c0c95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:58.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.108+0000 7faf30f3b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7faf2c0c9150 0x7faf2c0c95b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57754/0 (socket says 172.21.15.80:57754) 2024-05-08T21:09:58.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.108+0000 7faf31f3d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7faf2c072600 0x7faf2c072a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:38490/0 (socket says 172.21.15.80:38490) 2024-05-08T21:09:58.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.108+0000 7faf30f3b700 1 -- 172.21.15.80:0/1554101917 learned_addr learned my addr 172.21.15.80:0/1554101917 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:09:58.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.108+0000 7faf3173c700 1 --2- 172.21.15.80:0/1554101917 >> v2:172.21.15.106:3300/0 conn(0x7faf2c1541a0 0x7faf2c15a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:58.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.108+0000 7faf30f3b700 1 -- 172.21.15.80:0/1554101917 >> v2:172.21.15.106:3300/0 conn(0x7faf2c1541a0 msgr2=0x7faf2c15a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:09:58.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.108+0000 7faf30f3b700 1 --2- 172.21.15.80:0/1554101917 >> v2:172.21.15.106:3300/0 conn(0x7faf2c1541a0 0x7faf2c15a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:58.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.108+0000 7faf30f3b700 1 -- 172.21.15.80:0/1554101917 >> v1:172.21.15.80:6789/0 conn(0x7faf2c072600 legacy=0x7faf2c072a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:58.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.108+0000 7faf30f3b700 1 -- 172.21.15.80:0/1554101917 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf2c15e710 con 0x7faf2c0c9150 2024-05-08T21:09:58.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.108+0000 7faf23fff700 1 -- 172.21.15.80:0/1554101917 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1612523249 0 0) 0x7faf2c0c8cc0 con 0x7faf2c072600 2024-05-08T21:09:58.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.108+0000 7faf30f3b700 1 --2- 172.21.15.80:0/1554101917 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf2c0c9150 0x7faf2c0c95b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7faf2c0c8210 tx=0x7faf1c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93b46b1804f8eee server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:09:58.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.108+0000 7faf23fff700 1 -- 172.21.15.80:0/1554101917 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1c00b870 con 0x7faf2c0c9150 2024-05-08T21:09:58.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.108+0000 7faf23fff700 1 -- 172.21.15.80:0/1554101917 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf1c00b9d0 con 0x7faf2c0c9150 2024-05-08T21:09:58.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.108+0000 7faf23fff700 1 -- 172.21.15.80:0/1554101917 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1c00bd60 con 0x7faf2c0c9150 2024-05-08T21:09:58.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.109+0000 7faf339a0700 1 -- 172.21.15.80:0/1554101917 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf2c0c9150 msgr2=0x7faf2c0c95b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:58.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.109+0000 7faf339a0700 1 --2- 172.21.15.80:0/1554101917 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf2c0c9150 0x7faf2c0c95b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7faf2c0c8210 tx=0x7faf1c009bd0 comp rx=0 tx=0).stop 2024-05-08T21:09:58.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.109+0000 7faf339a0700 1 -- 172.21.15.80:0/1554101917 shutdown_connections 2024-05-08T21:09:58.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.109+0000 7faf339a0700 1 --2- 172.21.15.80:0/1554101917 >> v2:172.21.15.106:3300/0 conn(0x7faf2c1541a0 0x7faf2c15a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:58.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.109+0000 7faf339a0700 1 --2- 172.21.15.80:0/1554101917 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf2c0c9150 0x7faf2c0c95b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:58.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.109+0000 7faf339a0700 1 -- 172.21.15.80:0/1554101917 >> 172.21.15.80:0/1554101917 conn(0x7faf2c06ef80 msgr2=0x7faf2c06f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:09:58.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.109+0000 7faf339a0700 1 -- 172.21.15.80:0/1554101917 shutdown_connections 2024-05-08T21:09:58.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.109+0000 7faf339a0700 1 -- 172.21.15.80:0/1554101917 wait complete. 2024-05-08T21:09:58.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.111+0000 7faf339a0700 1 Processor -- start 2024-05-08T21:09:58.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.111+0000 7faf339a0700 1 -- start start 2024-05-08T21:09:58.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.111+0000 7faf339a0700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf2c072600 0x7faf2c0cd200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:58.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.111+0000 7faf339a0700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf2c0c9150 0x7faf2c150d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:58.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.111+0000 7faf339a0700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faf2c1541a0 0x7faf2c1550e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:58.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.112+0000 7faf339a0700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf2c157210 con 0x7faf2c0c9150 2024-05-08T21:09:58.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.112+0000 7faf339a0700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf2c157740 con 0x7faf2c072600 2024-05-08T21:09:58.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.112+0000 7faf339a0700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf2c156700 con 0x7faf2c1541a0 2024-05-08T21:09:58.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.112+0000 7faf30f3b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf2c0c9150 0x7faf2c150d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:58.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.112+0000 7faf30f3b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf2c0c9150 0x7faf2c150d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57768/0 (socket says 172.21.15.80:57768) 2024-05-08T21:09:58.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.112+0000 7faf30f3b700 1 -- 172.21.15.80:0/922272358 learned_addr learned my addr 172.21.15.80:0/922272358 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:09:58.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.112+0000 7faf31f3d700 1 --2- 172.21.15.80:0/922272358 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faf2c1541a0 0x7faf2c1550e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:58.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.112+0000 7faf3173c700 1 --2- 172.21.15.80:0/922272358 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf2c072600 0x7faf2c0cd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:58.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.112+0000 7faf30f3b700 1 -- 172.21.15.80:0/922272358 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faf2c1541a0 msgr2=0x7faf2c1550e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:58.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.112+0000 7faf30f3b700 1 --2- 172.21.15.80:0/922272358 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faf2c1541a0 0x7faf2c1550e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:58.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.112+0000 7faf30f3b700 1 -- 172.21.15.80:0/922272358 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf2c072600 msgr2=0x7faf2c0cd200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:58.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.112+0000 7faf30f3b700 1 --2- 172.21.15.80:0/922272358 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf2c072600 0x7faf2c0cd200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:58.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.112+0000 7faf30f3b700 1 -- 172.21.15.80:0/922272358 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf1c009550 con 0x7faf2c0c9150 2024-05-08T21:09:58.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.112+0000 7faf30f3b700 1 --2- 172.21.15.80:0/922272358 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf2c0c9150 0x7faf2c150d60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7faf1c009c10 tx=0x7faf1c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:09:58.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.112+0000 7faf21ffb700 1 -- 172.21.15.80:0/922272358 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1c004250 con 0x7faf2c0c9150 2024-05-08T21:09:58.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.112+0000 7faf21ffb700 1 -- 172.21.15.80:0/922272358 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf1c01f070 con 0x7faf2c0c9150 2024-05-08T21:09:58.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.112+0000 7faf339a0700 1 -- 172.21.15.80:0/922272358 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf2c1569a0 con 0x7faf2c0c9150 2024-05-08T21:09:58.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.112+0000 7faf21ffb700 1 -- 172.21.15.80:0/922272358 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1c0045b0 con 0x7faf2c0c9150 2024-05-08T21:09:58.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.112+0000 7faf339a0700 1 -- 172.21.15.80:0/922272358 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf2c154bc0 con 0x7faf2c0c9150 2024-05-08T21:09:58.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.113+0000 7faf339a0700 1 -- 172.21.15.80:0/922272358 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf2c154db0 con 0x7faf2c0c9150 2024-05-08T21:09:58.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.114+0000 7faf21ffb700 1 -- 172.21.15.80:0/922272358 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 4) v1 ==== 89089+0+0 (secure 0 0 0) 0x7faf1c021030 con 0x7faf2c0c9150 2024-05-08T21:09:58.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.114+0000 7faf21ffb700 1 --2- 172.21.15.80:0/922272358 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7faf1006ac00 0x7faf1006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:09:58.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.114+0000 7faf21ffb700 1 -- 172.21.15.80:0/922272358 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4471+0+0 (secure 0 0 0) 0x7faf1c089f10 con 0x7faf2c0c9150 2024-05-08T21:09:58.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.114+0000 7faf3173c700 1 --2- 172.21.15.80:0/922272358 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7faf1006ac00 0x7faf1006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:09:58.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.115+0000 7faf3173c700 1 --2- 172.21.15.80:0/922272358 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7faf1006ac00 0x7faf1006d0c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7faf28006b20 tx=0x7faf28008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:09:58.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.119+0000 7faf21ffb700 1 -- 172.21.15.80:0/922272358 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7faf1c0556b0 con 0x7faf2c0c9150 2024-05-08T21:09:58.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.364+0000 7faf339a0700 1 -- 172.21.15.80:0/922272358 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faf2c04ec60 con 0x7faf2c0c9150 2024-05-08T21:09:58.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.365+0000 7faf21ffb700 1 -- 172.21.15.80:0/922272358 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1256 (secure 0 0 0) 0x7faf1c015090 con 0x7faf2c0c9150 2024-05-08T21:09:58.368 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:09:58.368 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-05-08T21:09:58.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.367+0000 7faf339a0700 1 -- 172.21.15.80:0/922272358 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7faf1006ac00 msgr2=0x7faf1006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:58.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.367+0000 7faf339a0700 1 --2- 172.21.15.80:0/922272358 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7faf1006ac00 0x7faf1006d0c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7faf28006b20 tx=0x7faf28008040 comp rx=0 tx=0).stop 2024-05-08T21:09:58.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.367+0000 7faf339a0700 1 -- 172.21.15.80:0/922272358 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf2c0c9150 msgr2=0x7faf2c150d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:09:58.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.367+0000 7faf339a0700 1 --2- 172.21.15.80:0/922272358 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf2c0c9150 0x7faf2c150d60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7faf1c009c10 tx=0x7faf1c004750 comp rx=0 tx=0).stop 2024-05-08T21:09:58.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.367+0000 7faf339a0700 1 -- 172.21.15.80:0/922272358 shutdown_connections 2024-05-08T21:09:58.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.367+0000 7faf339a0700 1 --2- 172.21.15.80:0/922272358 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7faf1006ac00 0x7faf1006d0c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:58.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.367+0000 7faf339a0700 1 --2- 172.21.15.80:0/922272358 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faf2c1541a0 0x7faf2c1550e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:58.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.367+0000 7faf339a0700 1 --2- 172.21.15.80:0/922272358 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf2c072600 0x7faf2c0cd200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:58.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.367+0000 7faf339a0700 1 --2- 172.21.15.80:0/922272358 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf2c0c9150 0x7faf2c150d60 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:09:58.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.367+0000 7faf339a0700 1 -- 172.21.15.80:0/922272358 >> 172.21.15.80:0/922272358 conn(0x7faf2c06ef80 msgr2=0x7faf2c14e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:09:58.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.367+0000 7faf339a0700 1 -- 172.21.15.80:0/922272358 shutdown_connections 2024-05-08T21:09:58.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:09:58.367+0000 7faf339a0700 1 -- 172.21.15.80:0/922272358 wait complete. 2024-05-08T21:09:58.371 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 2 2024-05-08T21:10:00.382 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:10:00.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.508+0000 7f225d665700 1 Processor -- start 2024-05-08T21:10:00.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.508+0000 7f225d665700 1 -- start start 2024-05-08T21:10:00.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.508+0000 7f225d665700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2258150760 0x7f2258072320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:00.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.508+0000 7f225d665700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f2258072d00 0x7f2258073170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:00.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.508+0000 7f225d665700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2258070fe0 con 0x7f225815a620 2024-05-08T21:10:00.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.508+0000 7f225d665700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22580736b0 con 0x7f2258072d00 2024-05-08T21:10:00.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.508+0000 7f225d665700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2258072860 con 0x7f2258150760 2024-05-08T21:10:00.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.509+0000 7f2256ffd700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2258150760 0x7f2258072320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:00.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.509+0000 7f2256ffd700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2258150760 0x7f2258072320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:35942/0 (socket says 172.21.15.80:35942) 2024-05-08T21:10:00.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.509+0000 7f2256ffd700 1 -- 172.21.15.80:0/3535585669 learned_addr learned my addr 172.21.15.80:0/3535585669 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:00.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.509+0000 7f22577fe700 1 --2- 172.21.15.80:0/3535585669 >> v2:172.21.15.106:3300/0 conn(0x7f2258072d00 0x7f2258073170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:00.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.509+0000 7f2256ffd700 1 -- 172.21.15.80:0/3535585669 >> v2:172.21.15.106:3300/0 conn(0x7f2258072d00 msgr2=0x7f2258073170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:00.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.509+0000 7f2256ffd700 1 --2- 172.21.15.80:0/3535585669 >> v2:172.21.15.106:3300/0 conn(0x7f2258072d00 0x7f2258073170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:00.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.509+0000 7f2256ffd700 1 -- 172.21.15.80:0/3535585669 >> v1:172.21.15.106:6789/0 conn(0x7f225815a620 legacy=0x7f225806b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:00.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.509+0000 7f2256ffd700 1 -- 172.21.15.80:0/3535585669 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2258071280 con 0x7f2258150760 2024-05-08T21:10:00.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.509+0000 7f2256ffd700 1 --2- 172.21.15.80:0/3535585669 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2258150760 0x7f2258072320 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f22480098f0 tx=0x7f2248009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=821a11ef72b8cd14 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:00.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.509+0000 7f2255ffb700 1 -- 172.21.15.80:0/3535585669 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224800b8a0 con 0x7f2258150760 2024-05-08T21:10:00.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.509+0000 7f2255ffb700 1 -- 172.21.15.80:0/3535585669 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f224800ba00 con 0x7f2258150760 2024-05-08T21:10:00.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.509+0000 7f2255ffb700 1 -- 172.21.15.80:0/3535585669 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224800bd90 con 0x7f2258150760 2024-05-08T21:10:00.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.510+0000 7f225d665700 1 -- 172.21.15.80:0/3535585669 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2258150760 msgr2=0x7f2258072320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:00.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.510+0000 7f225d665700 1 --2- 172.21.15.80:0/3535585669 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2258150760 0x7f2258072320 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f22480098f0 tx=0x7f2248009c00 comp rx=0 tx=0).stop 2024-05-08T21:10:00.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.510+0000 7f225d665700 1 -- 172.21.15.80:0/3535585669 shutdown_connections 2024-05-08T21:10:00.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.510+0000 7f225d665700 1 --2- 172.21.15.80:0/3535585669 >> v2:172.21.15.106:3300/0 conn(0x7f2258072d00 0x7f2258073170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:00.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.510+0000 7f225d665700 1 --2- 172.21.15.80:0/3535585669 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2258150760 0x7f2258072320 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:00.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.510+0000 7f225d665700 1 -- 172.21.15.80:0/3535585669 >> 172.21.15.80:0/3535585669 conn(0x7f22580c8120 msgr2=0x7f22580c8500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:00.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.510+0000 7f225d665700 1 -- 172.21.15.80:0/3535585669 shutdown_connections 2024-05-08T21:10:00.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.510+0000 7f225d665700 1 -- 172.21.15.80:0/3535585669 wait complete. 2024-05-08T21:10:00.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.511+0000 7f225d665700 1 Processor -- start 2024-05-08T21:10:00.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.511+0000 7f225d665700 1 -- start start 2024-05-08T21:10:00.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.512+0000 7f225d665700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2258072d00 0x7f225814f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:00.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.512+0000 7f225d665700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2258150760 0x7f22581f0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:00.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.512+0000 7f225d665700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f225815a620 0x7f22581f0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:00.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.512+0000 7f225d665700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2258153590 con 0x7f225815a620 2024-05-08T21:10:00.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.512+0000 7f225d665700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22581f3d10 con 0x7f2258072d00 2024-05-08T21:10:00.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.512+0000 7f225d665700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22581f4220 con 0x7f2258150760 2024-05-08T21:10:00.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.512+0000 7f22577fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f225815a620 0x7f22581f0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:00.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.512+0000 7f22577fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f225815a620 0x7f22581f0990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57798/0 (socket says 172.21.15.80:57798) 2024-05-08T21:10:00.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.512+0000 7f22577fe700 1 -- 172.21.15.80:0/3329599980 learned_addr learned my addr 172.21.15.80:0/3329599980 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:00.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.512+0000 7f22567fc700 1 --2- 172.21.15.80:0/3329599980 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2258150760 0x7f22581f0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:00.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.512+0000 7f2256ffd700 1 --2- 172.21.15.80:0/3329599980 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2258072d00 0x7f225814f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:00.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.512+0000 7f22567fc700 1 -- 172.21.15.80:0/3329599980 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2258072d00 msgr2=0x7f225814f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:00.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.512+0000 7f22567fc700 1 --2- 172.21.15.80:0/3329599980 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2258072d00 0x7f225814f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:00.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.512+0000 7f22567fc700 1 -- 172.21.15.80:0/3329599980 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f225815a620 msgr2=0x7f22581f0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:00.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.512+0000 7f22567fc700 1 --2- 172.21.15.80:0/3329599980 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f225815a620 0x7f22581f0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:00.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.512+0000 7f22567fc700 1 -- 172.21.15.80:0/3329599980 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2248009550 con 0x7f2258150760 2024-05-08T21:10:00.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.512+0000 7f22577fe700 1 --2- 172.21.15.80:0/3329599980 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f225815a620 0x7f22581f0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:10:00.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.513+0000 7f22567fc700 1 --2- 172.21.15.80:0/3329599980 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2258150760 0x7f22581f0450 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f224c00c450 tx=0x7f224c00c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:00.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.513+0000 7f223f7fe700 1 -- 172.21.15.80:0/3329599980 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224c0052d0 con 0x7f2258150760 2024-05-08T21:10:00.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.513+0000 7f223f7fe700 1 -- 172.21.15.80:0/3329599980 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f224c005430 con 0x7f2258150760 2024-05-08T21:10:00.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.513+0000 7f225d665700 1 -- 172.21.15.80:0/3329599980 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f225814cab0 con 0x7f2258150760 2024-05-08T21:10:00.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.513+0000 7f223f7fe700 1 -- 172.21.15.80:0/3329599980 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224c0038c0 con 0x7f2258150760 2024-05-08T21:10:00.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.513+0000 7f225d665700 1 -- 172.21.15.80:0/3329599980 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f225814c4f0 con 0x7f2258150760 2024-05-08T21:10:00.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.514+0000 7f225d665700 1 -- 172.21.15.80:0/3329599980 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2258068d40 con 0x7f2258150760 2024-05-08T21:10:00.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.514+0000 7f223f7fe700 1 -- 172.21.15.80:0/3329599980 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 4) v1 ==== 89089+0+0 (secure 0 0 0) 0x7f224c003a20 con 0x7f2258150760 2024-05-08T21:10:00.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.515+0000 7f223f7fe700 1 --2- 172.21.15.80:0/3329599980 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f224406ac00 0x7f224406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:00.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.515+0000 7f2256ffd700 1 --2- 172.21.15.80:0/3329599980 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f224406ac00 0x7f224406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:00.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.515+0000 7f223f7fe700 1 -- 172.21.15.80:0/3329599980 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f224c088220 con 0x7f2258150760 2024-05-08T21:10:00.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.515+0000 7f2256ffd700 1 --2- 172.21.15.80:0/3329599980 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f224406ac00 0x7f224406d0c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2248009c40 tx=0x7f2248008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:00.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.520+0000 7f223f7fe700 1 -- 172.21.15.80:0/3329599980 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f224c053790 con 0x7f2258150760 2024-05-08T21:10:00.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.770+0000 7f225d665700 1 -- 172.21.15.80:0/3329599980 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f225806e0d0 con 0x7f2258150760 2024-05-08T21:10:00.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.771+0000 7f223f7fe700 1 -- 172.21.15.80:0/3329599980 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+5045 (secure 0 0 0) 0x7f224c056db0 con 0x7f2258150760 2024-05-08T21:10:00.774 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:10:00.774 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/2289230272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":2289230272},{"type":"v1","addr":"172.21.15.106:6833","nonce":2289230272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/1949999190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1949999190},{"type":"v1","addr":"172.21.15.106:6836","nonce":1949999190}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-05-08T21:10:00.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.773+0000 7f225d665700 1 -- 172.21.15.80:0/3329599980 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f224406ac00 msgr2=0x7f224406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:00.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.773+0000 7f225d665700 1 --2- 172.21.15.80:0/3329599980 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f224406ac00 0x7f224406d0c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2248009c40 tx=0x7f2248008030 comp rx=0 tx=0).stop 2024-05-08T21:10:00.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.773+0000 7f225d665700 1 -- 172.21.15.80:0/3329599980 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2258150760 msgr2=0x7f22581f0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:00.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.773+0000 7f225d665700 1 --2- 172.21.15.80:0/3329599980 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2258150760 0x7f22581f0450 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f224c00c450 tx=0x7f224c00c760 comp rx=0 tx=0).stop 2024-05-08T21:10:00.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.773+0000 7f225d665700 1 -- 172.21.15.80:0/3329599980 shutdown_connections 2024-05-08T21:10:00.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.774+0000 7f225d665700 1 --2- 172.21.15.80:0/3329599980 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f224406ac00 0x7f224406d0c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:00.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.774+0000 7f225d665700 1 --2- 172.21.15.80:0/3329599980 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f225815a620 0x7f22581f0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:00.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.774+0000 7f225d665700 1 --2- 172.21.15.80:0/3329599980 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2258072d00 0x7f225814f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:00.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.774+0000 7f225d665700 1 --2- 172.21.15.80:0/3329599980 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2258150760 0x7f22581f0450 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:00.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.774+0000 7f225d665700 1 -- 172.21.15.80:0/3329599980 >> 172.21.15.80:0/3329599980 conn(0x7f22580c8120 msgr2=0x7f2258159ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:00.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.774+0000 7f225d665700 1 -- 172.21.15.80:0/3329599980 shutdown_connections 2024-05-08T21:10:00.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.774+0000 7f225d665700 1 -- 172.21.15.80:0/3329599980 wait complete. 2024-05-08T21:10:00.777 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 3 2024-05-08T21:10:00.788 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T21:10:00.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.906+0000 7ff826138700 1 Processor -- start 2024-05-08T21:10:00.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.906+0000 7ff826138700 1 -- start start 2024-05-08T21:10:00.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.906+0000 7ff826138700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff8200ccc00 0x7ff820071be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:00.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.906+0000 7ff826138700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff8200ccfe0 0x7ff8200c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:00.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.906+0000 7ff826138700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff8200c8380 0x7ff820156ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:00.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.906+0000 7ff826138700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8200c9150 con 0x7ff8200c8380 2024-05-08T21:10:00.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.906+0000 7ff826138700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8200c99f0 con 0x7ff8200ccc00 2024-05-08T21:10:00.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.906+0000 7ff826138700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8201579c0 con 0x7ff8200ccfe0 2024-05-08T21:10:00.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.907+0000 7ff81ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff8200c8380 0x7ff820156ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:00.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.907+0000 7ff81ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff8200c8380 0x7ff820156ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57810/0 (socket says 172.21.15.80:57810) 2024-05-08T21:10:00.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.907+0000 7ff81ffff700 1 -- 172.21.15.80:0/4063447544 learned_addr learned my addr 172.21.15.80:0/4063447544 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:00.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.907+0000 7ff81f7fe700 1 --2- 172.21.15.80:0/4063447544 >> v2:172.21.15.106:3300/0 conn(0x7ff8200ccc00 0x7ff820071be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:00.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.907+0000 7ff81effd700 1 --2- 172.21.15.80:0/4063447544 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff8200ccfe0 0x7ff8200c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:00.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.907+0000 7ff81ffff700 1 -- 172.21.15.80:0/4063447544 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff8200ccfe0 msgr2=0x7ff8200c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:00.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.907+0000 7ff81ffff700 1 --2- 172.21.15.80:0/4063447544 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff8200ccfe0 0x7ff8200c9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:00.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.907+0000 7ff81ffff700 1 -- 172.21.15.80:0/4063447544 >> v2:172.21.15.106:3300/0 conn(0x7ff8200ccc00 msgr2=0x7ff820071be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:00.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.907+0000 7ff81ffff700 1 --2- 172.21.15.80:0/4063447544 >> v2:172.21.15.106:3300/0 conn(0x7ff8200ccc00 0x7ff820071be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:00.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.907+0000 7ff81ffff700 1 -- 172.21.15.80:0/4063447544 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff820157ca0 con 0x7ff8200c8380 2024-05-08T21:10:00.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.907+0000 7ff81ffff700 1 --2- 172.21.15.80:0/4063447544 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8200c8380 0x7ff820156ea0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff8200c7860 tx=0x7ff81800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=474bca136451b3de server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:00.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.907+0000 7ff81e7fc700 1 -- 172.21.15.80:0/4063447544 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff81800e070 con 0x7ff8200c8380 2024-05-08T21:10:00.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.907+0000 7ff81e7fc700 1 -- 172.21.15.80:0/4063447544 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff81800b9c0 con 0x7ff8200c8380 2024-05-08T21:10:00.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.907+0000 7ff81e7fc700 1 -- 172.21.15.80:0/4063447544 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff81800bd70 con 0x7ff8200c8380 2024-05-08T21:10:00.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.908+0000 7ff826138700 1 -- 172.21.15.80:0/4063447544 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8200c8380 msgr2=0x7ff820156ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:00.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.908+0000 7ff826138700 1 --2- 172.21.15.80:0/4063447544 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8200c8380 0x7ff820156ea0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff8200c7860 tx=0x7ff81800b330 comp rx=0 tx=0).stop 2024-05-08T21:10:00.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.908+0000 7ff826138700 1 -- 172.21.15.80:0/4063447544 shutdown_connections 2024-05-08T21:10:00.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.908+0000 7ff826138700 1 --2- 172.21.15.80:0/4063447544 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8200c8380 0x7ff820156ea0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:00.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.908+0000 7ff826138700 1 --2- 172.21.15.80:0/4063447544 >> v2:172.21.15.106:3300/0 conn(0x7ff8200ccc00 0x7ff820071be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:00.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.908+0000 7ff826138700 1 --2- 172.21.15.80:0/4063447544 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff8200ccfe0 0x7ff8200c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:00.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.908+0000 7ff826138700 1 -- 172.21.15.80:0/4063447544 >> 172.21.15.80:0/4063447544 conn(0x7ff82006f140 msgr2=0x7ff82006f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:00.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.908+0000 7ff826138700 1 -- 172.21.15.80:0/4063447544 shutdown_connections 2024-05-08T21:10:00.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.908+0000 7ff826138700 1 -- 172.21.15.80:0/4063447544 wait complete. 2024-05-08T21:10:00.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.909+0000 7ff826138700 1 Processor -- start 2024-05-08T21:10:00.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.909+0000 7ff826138700 1 -- start start 2024-05-08T21:10:00.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.910+0000 7ff826138700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff8200c8380 0x7ff8200cbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:00.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.910+0000 7ff826138700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff8200ccc00 0x7ff82006b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:00.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.910+0000 7ff826138700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8200ccfe0 0x7ff82006b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:00.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.910+0000 7ff826138700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff82006a9c0 con 0x7ff8200ccfe0 2024-05-08T21:10:00.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.910+0000 7ff826138700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff82006aca0 con 0x7ff8200c8380 2024-05-08T21:10:00.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.910+0000 7ff826138700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8201eba40 con 0x7ff8200ccc00 2024-05-08T21:10:00.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.910+0000 7ff81ffff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8200ccfe0 0x7ff82006b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:00.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.910+0000 7ff81ffff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8200ccfe0 0x7ff82006b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57820/0 (socket says 172.21.15.80:57820) 2024-05-08T21:10:00.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.910+0000 7ff81ffff700 1 -- 172.21.15.80:0/266300936 learned_addr learned my addr 172.21.15.80:0/266300936 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:00.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.911+0000 7ff81f7fe700 1 --2- 172.21.15.80:0/266300936 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff8200c8380 0x7ff8200cbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:00.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.911+0000 7ff81effd700 1 --2- 172.21.15.80:0/266300936 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff8200ccc00 0x7ff82006b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:00.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.911+0000 7ff81ffff700 1 -- 172.21.15.80:0/266300936 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff8200ccc00 msgr2=0x7ff82006b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:00.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.911+0000 7ff81ffff700 1 --2- 172.21.15.80:0/266300936 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff8200ccc00 0x7ff82006b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:00.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.911+0000 7ff81ffff700 1 -- 172.21.15.80:0/266300936 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff8200c8380 msgr2=0x7ff8200cbbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:00.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.911+0000 7ff81ffff700 1 --2- 172.21.15.80:0/266300936 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff8200c8380 0x7ff8200cbbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:00.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.911+0000 7ff81ffff700 1 -- 172.21.15.80:0/266300936 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff818009b30 con 0x7ff8200ccfe0 2024-05-08T21:10:00.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.911+0000 7ff81ffff700 1 --2- 172.21.15.80:0/266300936 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8200ccfe0 0x7ff82006b600 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff81800b730 tx=0x7ff818004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:00.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.911+0000 7ff807fff700 1 -- 172.21.15.80:0/266300936 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8180092e0 con 0x7ff8200ccfe0 2024-05-08T21:10:00.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.911+0000 7ff807fff700 1 -- 172.21.15.80:0/266300936 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff818004250 con 0x7ff8200ccfe0 2024-05-08T21:10:00.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.911+0000 7ff826138700 1 -- 172.21.15.80:0/266300936 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8201ebd20 con 0x7ff8200ccfe0 2024-05-08T21:10:00.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.911+0000 7ff807fff700 1 -- 172.21.15.80:0/266300936 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff818004620 con 0x7ff8200ccfe0 2024-05-08T21:10:00.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.911+0000 7ff826138700 1 -- 172.21.15.80:0/266300936 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8201ec2e0 con 0x7ff8200ccfe0 2024-05-08T21:10:00.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.912+0000 7ff826138700 1 -- 172.21.15.80:0/266300936 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8200cd960 con 0x7ff8200ccfe0 2024-05-08T21:10:00.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.913+0000 7ff807fff700 1 -- 172.21.15.80:0/266300936 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 4) v1 ==== 89089+0+0 (secure 0 0 0) 0x7ff818004780 con 0x7ff8200ccfe0 2024-05-08T21:10:00.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.913+0000 7ff807fff700 1 --2- 172.21.15.80:0/266300936 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7ff80c06ac30 0x7ff80c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:00.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.913+0000 7ff807fff700 1 -- 172.21.15.80:0/266300936 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff81808a380 con 0x7ff8200ccfe0 2024-05-08T21:10:00.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.913+0000 7ff81f7fe700 1 --2- 172.21.15.80:0/266300936 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7ff80c06ac30 0x7ff80c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:00.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.913+0000 7ff81f7fe700 1 --2- 172.21.15.80:0/266300936 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7ff80c06ac30 0x7ff80c06d0f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff810009950 tx=0x7ff810008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:00.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:00.918+0000 7ff807fff700 1 -- 172.21.15.80:0/266300936 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7ff818055ad0 con 0x7ff8200ccfe0 2024-05-08T21:10:01.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.117+0000 7ff826138700 1 -- 172.21.15.80:0/266300936 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff82006ade0 con 0x7ff8200ccfe0 2024-05-08T21:10:01.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.118+0000 7ff807fff700 1 -- 172.21.15.80:0/266300936 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12382 (secure 0 0 0) 0x7ff82006ade0 con 0x7ff8200ccfe0 2024-05-08T21:10:01.120 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:10:01.120 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":18,"fsid":"44d31c1e-aad3-47ca-a4fa-85a63d4a60aa","created":"2024-05-08T21:09:46.467038+0000","modified":"2024-05-08T21:10:00.296990+0000","last_up_change":"2024-05-08T21:09:57.284675+0000","last_in_change":"2024-05-08T21:09:49.125444+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T21:09:58.238951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c3f9d93e-ed6d-4a0c-b5c0-0e8d44c65fdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":47011},{"type":"v1","addr":"172.21.15.80:6817","nonce":47011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":47011},{"type":"v1","addr":"172.21.15.80:6819","nonce":47011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":47011},{"type":"v1","addr":"172.21.15.80:6823","nonce":47011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":47011},{"type":"v1","addr":"172.21.15.80:6821","nonce":47011}]},"public_addr":"172.21.15.80:6817/47011","cluster_addr":"172.21.15.80:6819/47011","heartbeat_back_addr":"172.21.15.80:6823/47011","heartbeat_front_addr":"172.21.15.80:6821/47011","state":["exists","up"]},{"osd":1,"uuid":"4ce2b4d6-6c40-43aa-8dd1-743fef8915df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":47010},{"type":"v1","addr":"172.21.15.80:6809","nonce":47010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":47010},{"type":"v1","addr":"172.21.15.80:6811","nonce":47010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":47010},{"type":"v1","addr":"172.21.15.80:6815","nonce":47010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":47010},{"type":"v1","addr":"172.21.15.80:6813","nonce":47010}]},"public_addr":"172.21.15.80:6809/47010","cluster_addr":"172.21.15.80:6811/47010","heartbeat_back_addr":"172.21.15.80:6815/47010","heartbeat_front_addr":"172.21.15.80:6813/47010","state":["exists","up"]},{"osd":2,"uuid":"e30cc3bc-6461-4fac-960a-de00c9488d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":47009},{"type":"v1","addr":"172.21.15.80:6801","nonce":47009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":47009},{"type":"v1","addr":"172.21.15.80:6803","nonce":47009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":47009},{"type":"v1","addr":"172.21.15.80:6807","nonce":47009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":47009},{"type":"v1","addr":"172.21.15.80:6805","nonce":47009}]},"public_addr":"172.21.15.80:6801/47009","cluster_addr":"172.21.15.80:6803/47009","heartbeat_back_addr":"172.21.15.80:6807/47009","heartbeat_front_addr":"172.21.15.80:6805/47009","state":["exists","up"]},{"osd":3,"uuid":"a415c099-9ea6-40be-98ed-f2932f98dfd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":47012},{"type":"v1","addr":"172.21.15.80:6825","nonce":47012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":47012},{"type":"v1","addr":"172.21.15.80:6827","nonce":47012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":47012},{"type":"v1","addr":"172.21.15.80:6831","nonce":47012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":47012},{"type":"v1","addr":"172.21.15.80:6829","nonce":47012}]},"public_addr":"172.21.15.80:6825/47012","cluster_addr":"172.21.15.80:6827/47012","heartbeat_back_addr":"172.21.15.80:6831/47012","heartbeat_front_addr":"172.21.15.80:6829/47012","state":["exists","up"]},{"osd":4,"uuid":"5ae1d51f-0918-4571-b79b-154308d46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6823","nonce":47114},{"type":"v1","addr":"172.21.15.106:6825","nonce":47114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":47114},{"type":"v1","addr":"172.21.15.106:6827","nonce":47114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":47114},{"type":"v1","addr":"172.21.15.106:6831","nonce":47114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":47114},{"type":"v1","addr":"172.21.15.106:6829","nonce":47114}]},"public_addr":"172.21.15.106:6825/47114","cluster_addr":"172.21.15.106:6827/47114","heartbeat_back_addr":"172.21.15.106:6831/47114","heartbeat_front_addr":"172.21.15.106:6829/47114","state":["exists","up"]},{"osd":5,"uuid":"a19ac74e-4282-4428-b167-26ba6b92f732","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6807","nonce":47111},{"type":"v1","addr":"172.21.15.106:6809","nonce":47111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":47111},{"type":"v1","addr":"172.21.15.106:6811","nonce":47111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":47111},{"type":"v1","addr":"172.21.15.106:6815","nonce":47111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":47111},{"type":"v1","addr":"172.21.15.106:6813","nonce":47111}]},"public_addr":"172.21.15.106:6809/47111","cluster_addr":"172.21.15.106:6811/47111","heartbeat_back_addr":"172.21.15.106:6815/47111","heartbeat_front_addr":"172.21.15.106:6813/47111","state":["exists","up"]},{"osd":6,"uuid":"bfe72edd-7acc-4805-807d-2000e76f2feb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":47112},{"type":"v1","addr":"172.21.15.106:6817","nonce":47112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":47112},{"type":"v1","addr":"172.21.15.106:6819","nonce":47112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":47112},{"type":"v1","addr":"172.21.15.106:6824","nonce":47112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":47112},{"type":"v1","addr":"172.21.15.106:6821","nonce":47112}]},"public_addr":"172.21.15.106:6817/47112","cluster_addr":"172.21.15.106:6819/47112","heartbeat_back_addr":"172.21.15.106:6824/47112","heartbeat_front_addr":"172.21.15.106:6821/47112","state":["exists","up"]},{"osd":7,"uuid":"99897f22-ed17-4c7c-9088-cc0c4a51f786","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":47113},{"type":"v1","addr":"172.21.15.106:6801","nonce":47113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":47113},{"type":"v1","addr":"172.21.15.106:6803","nonce":47113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":47113},{"type":"v1","addr":"172.21.15.106:6808","nonce":47113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":47113},{"type":"v1","addr":"172.21.15.106:6805","nonce":47113}]},"public_addr":"172.21.15.106:6801/47113","cluster_addr":"172.21.15.106:6803/47113","heartbeat_back_addr":"172.21.15.106:6808/47113","heartbeat_front_addr":"172.21.15.106:6805/47113","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.232670+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.277753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.050087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.349312+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.344080+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.348781+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.352539+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.275013+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T21:10:01.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.120+0000 7ff826138700 1 -- 172.21.15.80:0/266300936 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7ff80c06ac30 msgr2=0x7ff80c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:01.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.120+0000 7ff826138700 1 --2- 172.21.15.80:0/266300936 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7ff80c06ac30 0x7ff80c06d0f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff810009950 tx=0x7ff810008040 comp rx=0 tx=0).stop 2024-05-08T21:10:01.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.120+0000 7ff826138700 1 -- 172.21.15.80:0/266300936 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8200ccfe0 msgr2=0x7ff82006b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:01.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.120+0000 7ff826138700 1 --2- 172.21.15.80:0/266300936 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8200ccfe0 0x7ff82006b600 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff81800b730 tx=0x7ff818004ad0 comp rx=0 tx=0).stop 2024-05-08T21:10:01.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.120+0000 7ff826138700 1 -- 172.21.15.80:0/266300936 shutdown_connections 2024-05-08T21:10:01.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.120+0000 7ff826138700 1 --2- 172.21.15.80:0/266300936 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7ff80c06ac30 0x7ff80c06d0f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:01.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.120+0000 7ff826138700 1 --2- 172.21.15.80:0/266300936 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8200ccfe0 0x7ff82006b600 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:01.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.120+0000 7ff826138700 1 --2- 172.21.15.80:0/266300936 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff8200c8380 0x7ff8200cbbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:01.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.120+0000 7ff826138700 1 --2- 172.21.15.80:0/266300936 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff8200ccc00 0x7ff82006b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:01.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.120+0000 7ff826138700 1 -- 172.21.15.80:0/266300936 >> 172.21.15.80:0/266300936 conn(0x7ff82006f140 msgr2=0x7ff8201458a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:01.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.120+0000 7ff826138700 1 -- 172.21.15.80:0/266300936 shutdown_connections 2024-05-08T21:10:01.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.120+0000 7ff826138700 1 -- 172.21.15.80:0/266300936 wait complete. 2024-05-08T21:10:01.135 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T21:09:58.238951+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T21:10:01.135 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T21:10:01.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.259+0000 7fc377cee700 1 Processor -- start 2024-05-08T21:10:01.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.259+0000 7fc377cee700 1 -- start start 2024-05-08T21:10:01.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.260+0000 7fc377cee700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc3700ccfe0 0x7fc370071be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:01.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.260+0000 7fc377cee700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3700c9150 con 0x7fc3700c8380 2024-05-08T21:10:01.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.260+0000 7fc377cee700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3700c99f0 con 0x7fc3700ccc00 2024-05-08T21:10:01.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.260+0000 7fc377cee700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3701579c0 con 0x7fc3700ccfe0 2024-05-08T21:10:01.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.260+0000 7fc37628b700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc3700c8380 0x7fc37014d840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:38502/0 (socket says 172.21.15.80:38502) 2024-05-08T21:10:01.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.260+0000 7fc37628b700 1 -- 172.21.15.80:0/2844600068 learned_addr learned my addr 172.21.15.80:0/2844600068 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:10:01.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.260+0000 7fc374a88700 1 -- 172.21.15.80:0/2844600068 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2428307053 0 0) 0x7fc3700c9150 con 0x7fc3700c8380 2024-05-08T21:10:01.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.260+0000 7fc374a88700 1 -- 172.21.15.80:0/2844600068 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc35c0035b0 con 0x7fc3700c8380 2024-05-08T21:10:01.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.260+0000 7fc375289700 1 --2- 172.21.15.80:0/2844600068 >> v2:172.21.15.106:3300/0 conn(0x7fc3700ccfe0 0x7fc370071be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:01.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.260+0000 7fc374a88700 1 -- 172.21.15.80:0/2844600068 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1320585371 0 0) 0x7fc35c0035b0 con 0x7fc3700c8380 2024-05-08T21:10:01.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.261+0000 7fc374a88700 1 -- 172.21.15.80:0/2844600068 >> v2:172.21.15.106:3300/0 conn(0x7fc3700ccfe0 msgr2=0x7fc370071be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:01.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.261+0000 7fc374a88700 1 --2- 172.21.15.80:0/2844600068 >> v2:172.21.15.106:3300/0 conn(0x7fc3700ccfe0 0x7fc370071be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:01.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.261+0000 7fc374a88700 1 -- 172.21.15.80:0/2844600068 >> v1:172.21.15.106:6789/0 conn(0x7fc3700ccc00 legacy=0x7fc370156ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:01.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.261+0000 7fc374a88700 1 -- 172.21.15.80:0/2844600068 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc370157ca0 con 0x7fc3700c8380 2024-05-08T21:10:01.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.261+0000 7fc374a88700 1 -- 172.21.15.80:0/2844600068 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3520646302 0 0) 0x7fc3680019f0 con 0x7fc3700c8380 2024-05-08T21:10:01.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.261+0000 7fc374a88700 1 -- 172.21.15.80:0/2844600068 >> v1:172.21.15.80:6789/0 conn(0x7fc3700c8380 legacy=0x7fc37014d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:01.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.261+0000 7fc374a88700 1 --2- 172.21.15.80:0/2844600068 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc35c003a00 0x7fc35c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:01.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.261+0000 7fc374a88700 1 --2- 172.21.15.80:0/2844600068 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc35c004850 0x7fc35c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:01.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.261+0000 7fc374a88700 1 --2- 172.21.15.80:0/2844600068 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc35c005210 0x7fc35c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:01.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.261+0000 7fc374a88700 1 -- 172.21.15.80:0/2844600068 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3701579c0 con 0x7fc35c003a00 2024-05-08T21:10:01.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.261+0000 7fc374a88700 1 -- 172.21.15.80:0/2844600068 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc35c00c0b0 con 0x7fc35c005210 2024-05-08T21:10:01.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.261+0000 7fc374a88700 1 -- 172.21.15.80:0/2844600068 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc35c00e480 con 0x7fc35c004850 2024-05-08T21:10:01.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.261+0000 7fc375a8a700 1 --2- 172.21.15.80:0/2844600068 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc35c003a00 0x7fc35c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:01.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.261+0000 7fc37628b700 1 --2- 172.21.15.80:0/2844600068 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc35c005210 0x7fc35c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:01.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.261+0000 7fc375289700 1 --2- 172.21.15.80:0/2844600068 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc35c004850 0x7fc35c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:01.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.261+0000 7fc375a8a700 1 -- 172.21.15.80:0/2844600068 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc35c004850 msgr2=0x7fc35c004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:01.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.261+0000 7fc375a8a700 1 --2- 172.21.15.80:0/2844600068 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc35c004850 0x7fc35c004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:01.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.261+0000 7fc375a8a700 1 -- 172.21.15.80:0/2844600068 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc35c005210 msgr2=0x7fc35c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:01.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.261+0000 7fc375a8a700 1 --2- 172.21.15.80:0/2844600068 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc35c005210 0x7fc35c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:01.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.261+0000 7fc375a8a700 1 -- 172.21.15.80:0/2844600068 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc35c0035b0 con 0x7fc35c003a00 2024-05-08T21:10:01.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.261+0000 7fc37628b700 1 -- 172.21.15.80:0/2844600068 reap_dead start 2024-05-08T21:10:01.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.261+0000 7fc375a8a700 1 --2- 172.21.15.80:0/2844600068 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc35c003a00 0x7fc35c003e20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc3600017c0 tx=0x7fc35c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d389f7fcbfef767 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:01.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.261+0000 7fc374a88700 1 -- 172.21.15.80:0/2844600068 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3600052d0 con 0x7fc35c003a00 2024-05-08T21:10:01.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.261+0000 7fc374a88700 1 -- 172.21.15.80:0/2844600068 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc360005450 con 0x7fc35c003a00 2024-05-08T21:10:01.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.261+0000 7fc374a88700 1 -- 172.21.15.80:0/2844600068 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3600038c0 con 0x7fc35c003a00 2024-05-08T21:10:01.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.262+0000 7fc377cee700 1 -- 172.21.15.80:0/2844600068 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc35c003a00 msgr2=0x7fc35c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:01.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.262+0000 7fc377cee700 1 --2- 172.21.15.80:0/2844600068 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc35c003a00 0x7fc35c003e20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc3600017c0 tx=0x7fc35c005880 comp rx=0 tx=0).stop 2024-05-08T21:10:01.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.262+0000 7fc377cee700 1 -- 172.21.15.80:0/2844600068 shutdown_connections 2024-05-08T21:10:01.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.262+0000 7fc377cee700 1 --2- 172.21.15.80:0/2844600068 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc35c003a00 0x7fc35c003e20 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:01.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.262+0000 7fc377cee700 1 -- 172.21.15.80:0/2844600068 >> 172.21.15.80:0/2844600068 conn(0x7fc37006f140 msgr2=0x7fc37006f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:01.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.262+0000 7fc377cee700 1 -- 172.21.15.80:0/2844600068 shutdown_connections 2024-05-08T21:10:01.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.262+0000 7fc377cee700 1 -- 172.21.15.80:0/2844600068 wait complete. 2024-05-08T21:10:01.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.263+0000 7fc377cee700 1 Processor -- start 2024-05-08T21:10:01.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.263+0000 7fc377cee700 1 -- start start 2024-05-08T21:10:01.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.264+0000 7fc377cee700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc35c003a00 0x7fc3701ef0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:01.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.264+0000 7fc377cee700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc370149cc0 0x7fc37006bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:01.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.264+0000 7fc377cee700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc370159ac0 0x7fc370159f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:01.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.264+0000 7fc377cee700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3701ec5b0 con 0x7fc35c003a00 2024-05-08T21:10:01.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.264+0000 7fc377cee700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc370159630 con 0x7fc370149cc0 2024-05-08T21:10:01.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.264+0000 7fc377cee700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc37015a930 con 0x7fc370159ac0 2024-05-08T21:10:01.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.264+0000 7fc375a8a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc35c003a00 0x7fc3701ef0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:01.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.264+0000 7fc375a8a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc35c003a00 0x7fc3701ef0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57844/0 (socket says 172.21.15.80:57844) 2024-05-08T21:10:01.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.264+0000 7fc375a8a700 1 -- 172.21.15.80:0/2976289476 learned_addr learned my addr 172.21.15.80:0/2976289476 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:01.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.265+0000 7fc375289700 1 --2- 172.21.15.80:0/2976289476 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc370149cc0 0x7fc37006bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:01.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.265+0000 7fc37628b700 1 --2- 172.21.15.80:0/2976289476 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc370159ac0 0x7fc370159f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:01.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.265+0000 7fc375a8a700 1 -- 172.21.15.80:0/2976289476 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc370159ac0 msgr2=0x7fc370159f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:01.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.265+0000 7fc375a8a700 1 --2- 172.21.15.80:0/2976289476 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc370159ac0 0x7fc370159f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:01.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.265+0000 7fc375a8a700 1 -- 172.21.15.80:0/2976289476 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc370149cc0 msgr2=0x7fc37006bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:01.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.265+0000 7fc375a8a700 1 --2- 172.21.15.80:0/2976289476 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc370149cc0 0x7fc37006bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:01.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.265+0000 7fc375a8a700 1 -- 172.21.15.80:0/2976289476 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc37015ac10 con 0x7fc35c003a00 2024-05-08T21:10:01.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.265+0000 7fc375a8a700 1 --2- 172.21.15.80:0/2976289476 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc35c003a00 0x7fc3701ef0c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc360000c00 tx=0x7fc360001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:01.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.265+0000 7fc3667fc700 1 -- 172.21.15.80:0/2976289476 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc360001290 con 0x7fc35c003a00 2024-05-08T21:10:01.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.265+0000 7fc3667fc700 1 -- 172.21.15.80:0/2976289476 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc360007040 con 0x7fc35c003a00 2024-05-08T21:10:01.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.265+0000 7fc377cee700 1 -- 172.21.15.80:0/2976289476 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc37015aef0 con 0x7fc35c003a00 2024-05-08T21:10:01.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.265+0000 7fc3667fc700 1 -- 172.21.15.80:0/2976289476 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3600073d0 con 0x7fc35c003a00 2024-05-08T21:10:01.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.265+0000 7fc377cee700 1 -- 172.21.15.80:0/2976289476 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3701592c0 con 0x7fc35c003a00 2024-05-08T21:10:01.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.266+0000 7fc377cee700 1 -- 172.21.15.80:0/2976289476 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc370159450 con 0x7fc35c003a00 2024-05-08T21:10:01.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.266+0000 7fc3667fc700 1 -- 172.21.15.80:0/2976289476 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc360007530 con 0x7fc35c003a00 2024-05-08T21:10:01.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.267+0000 7fc3667fc700 1 --2- 172.21.15.80:0/2976289476 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fc35406acc0 0x7fc35406d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:01.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.267+0000 7fc3667fc700 1 -- 172.21.15.80:0/2976289476 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc360089960 con 0x7fc35c003a00 2024-05-08T21:10:01.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.267+0000 7fc375289700 1 --2- 172.21.15.80:0/2976289476 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fc35406acc0 0x7fc35406d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:01.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.267+0000 7fc375289700 1 --2- 172.21.15.80:0/2976289476 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fc35406acc0 0x7fc35406d180 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc37014d4c0 tx=0x7fc36c009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:01.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.271+0000 7fc3667fc700 1 -- 172.21.15.80:0/2976289476 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fc360055040 con 0x7fc35c003a00 2024-05-08T21:10:01.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.470+0000 7fc377cee700 1 -- 172.21.15.80:0/2976289476 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc3700c9b80 con 0x7fc35c003a00 2024-05-08T21:10:01.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.471+0000 7fc3667fc700 1 -- 172.21.15.80:0/2976289476 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc360017020 con 0x7fc35c003a00 2024-05-08T21:10:01.473 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-05-08T21:10:01.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.473+0000 7fc377cee700 1 -- 172.21.15.80:0/2976289476 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fc35406acc0 msgr2=0x7fc35406d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:01.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.473+0000 7fc377cee700 1 --2- 172.21.15.80:0/2976289476 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fc35406acc0 0x7fc35406d180 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc37014d4c0 tx=0x7fc36c009210 comp rx=0 tx=0).stop 2024-05-08T21:10:01.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.473+0000 7fc377cee700 1 -- 172.21.15.80:0/2976289476 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc35c003a00 msgr2=0x7fc3701ef0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:01.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.473+0000 7fc377cee700 1 --2- 172.21.15.80:0/2976289476 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc35c003a00 0x7fc3701ef0c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc360000c00 tx=0x7fc360001120 comp rx=0 tx=0).stop 2024-05-08T21:10:01.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.473+0000 7fc377cee700 1 -- 172.21.15.80:0/2976289476 shutdown_connections 2024-05-08T21:10:01.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.473+0000 7fc377cee700 1 --2- 172.21.15.80:0/2976289476 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fc35406acc0 0x7fc35406d180 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:01.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.473+0000 7fc377cee700 1 --2- 172.21.15.80:0/2976289476 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc35c003a00 0x7fc3701ef0c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:01.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.473+0000 7fc377cee700 1 --2- 172.21.15.80:0/2976289476 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc370159ac0 0x7fc370159f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:01.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.473+0000 7fc377cee700 1 --2- 172.21.15.80:0/2976289476 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc370149cc0 0x7fc37006bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:01.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.473+0000 7fc377cee700 1 -- 172.21.15.80:0/2976289476 >> 172.21.15.80:0/2976289476 conn(0x7fc37006f140 msgr2=0x7fc37006f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:01.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.473+0000 7fc377cee700 1 -- 172.21.15.80:0/2976289476 shutdown_connections 2024-05-08T21:10:01.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.473+0000 7fc377cee700 1 -- 172.21.15.80:0/2976289476 wait complete. 2024-05-08T21:10:01.487 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-08T21:10:01.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.604+0000 7f8e2d22b700 1 Processor -- start 2024-05-08T21:10:01.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.605+0000 7f8e2d22b700 1 -- start start 2024-05-08T21:10:01.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.605+0000 7f8e2d22b700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8e2806dce0 0x7f8e28158ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:01.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.605+0000 7f8e2d22b700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e280c57f0 con 0x7f8e2806eff0 2024-05-08T21:10:01.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.605+0000 7f8e2d22b700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e280c5a40 con 0x7f8e28141450 2024-05-08T21:10:01.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.605+0000 7f8e2d22b700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e280cae60 con 0x7f8e2806dce0 2024-05-08T21:10:01.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.605+0000 7f8e2659c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f8e2806eff0 0x7f8e281608d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:38508/0 (socket says 172.21.15.80:38508) 2024-05-08T21:10:01.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.605+0000 7f8e2659c700 1 -- 172.21.15.80:0/3979590256 learned_addr learned my addr 172.21.15.80:0/3979590256 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:10:01.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.606+0000 7f8e2759e700 1 --2- 172.21.15.80:0/3979590256 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8e2806dce0 0x7f8e28158ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:01.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.606+0000 7f8e25d9b700 1 -- 172.21.15.80:0/3979590256 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 730916261 0 0) 0x7f8e280c57f0 con 0x7f8e2806eff0 2024-05-08T21:10:01.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.606+0000 7f8e25d9b700 1 -- 172.21.15.80:0/3979590256 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e140035b0 con 0x7f8e2806eff0 2024-05-08T21:10:01.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.606+0000 7f8e25d9b700 1 -- 172.21.15.80:0/3979590256 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 471448736 0 0) 0x7f8e280c5a40 con 0x7f8e28141450 2024-05-08T21:10:01.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.606+0000 7f8e2759e700 1 -- 172.21.15.80:0/3979590256 >> v1:172.21.15.106:6789/0 conn(0x7f8e28141450 legacy=0x7f8e280c7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:01.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.606+0000 7f8e2759e700 1 -- 172.21.15.80:0/3979590256 >> v1:172.21.15.80:6789/0 conn(0x7f8e2806eff0 legacy=0x7f8e281608d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:01.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.606+0000 7f8e2759e700 1 -- 172.21.15.80:0/3979590256 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e280cb140 con 0x7f8e2806dce0 2024-05-08T21:10:01.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.606+0000 7f8e2759e700 1 --2- 172.21.15.80:0/3979590256 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8e2806dce0 0x7f8e28158ab0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8e18009dc0 tx=0x7f8e1800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f6341469d19fe70 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:01.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.606+0000 7f8e25d9b700 1 -- 172.21.15.80:0/3979590256 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1800e070 con 0x7f8e2806dce0 2024-05-08T21:10:01.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.606+0000 7f8e25d9b700 1 -- 172.21.15.80:0/3979590256 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e18003a20 con 0x7f8e2806dce0 2024-05-08T21:10:01.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.606+0000 7f8e25d9b700 1 -- 172.21.15.80:0/3979590256 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e10001670 con 0x7f8e2806dce0 2024-05-08T21:10:01.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.607+0000 7f8e2d22b700 1 -- 172.21.15.80:0/3979590256 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8e2806dce0 msgr2=0x7f8e28158ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:01.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.607+0000 7f8e2d22b700 1 --2- 172.21.15.80:0/3979590256 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8e2806dce0 0x7f8e28158ab0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8e18009dc0 tx=0x7f8e1800b330 comp rx=0 tx=0).stop 2024-05-08T21:10:01.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.607+0000 7f8e2d22b700 1 -- 172.21.15.80:0/3979590256 shutdown_connections 2024-05-08T21:10:01.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.607+0000 7f8e2d22b700 1 --2- 172.21.15.80:0/3979590256 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8e2806dce0 0x7f8e28158ab0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:01.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.607+0000 7f8e2d22b700 1 -- 172.21.15.80:0/3979590256 >> 172.21.15.80:0/3979590256 conn(0x7f8e280ca340 msgr2=0x7f8e280ca750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:01.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.607+0000 7f8e2d22b700 1 -- 172.21.15.80:0/3979590256 shutdown_connections 2024-05-08T21:10:01.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.607+0000 7f8e2d22b700 1 -- 172.21.15.80:0/3979590256 wait complete. 2024-05-08T21:10:01.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.608+0000 7f8e2d22b700 1 Processor -- start 2024-05-08T21:10:01.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.608+0000 7f8e2d22b700 1 -- start start 2024-05-08T21:10:01.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.609+0000 7f8e2d22b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8e2806dce0 0x7f8e2813b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:01.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.609+0000 7f8e2d22b700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8e2806eff0 0x7f8e2813b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:01.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.609+0000 7f8e2d22b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e28141450 0x7f8e281ed8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:01.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.609+0000 7f8e2d22b700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e281f1a20 con 0x7f8e28141450 2024-05-08T21:10:01.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.609+0000 7f8e2d22b700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e281f0bb0 con 0x7f8e2806dce0 2024-05-08T21:10:01.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.609+0000 7f8e2d22b700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e281f0e10 con 0x7f8e2806eff0 2024-05-08T21:10:01.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.609+0000 7f8e2759e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e28141450 0x7f8e281ed8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:01.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.609+0000 7f8e2759e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e28141450 0x7f8e281ed8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57846/0 (socket says 172.21.15.80:57846) 2024-05-08T21:10:01.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.609+0000 7f8e2759e700 1 -- 172.21.15.80:0/2695124045 learned_addr learned my addr 172.21.15.80:0/2695124045 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:01.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.609+0000 7f8e2659c700 1 --2- 172.21.15.80:0/2695124045 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8e2806eff0 0x7f8e2813b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:01.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.609+0000 7f8e26d9d700 1 --2- 172.21.15.80:0/2695124045 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8e2806dce0 0x7f8e2813b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:01.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.609+0000 7f8e2759e700 1 -- 172.21.15.80:0/2695124045 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8e2806eff0 msgr2=0x7f8e2813b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:01.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.609+0000 7f8e2759e700 1 --2- 172.21.15.80:0/2695124045 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8e2806eff0 0x7f8e2813b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:01.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.609+0000 7f8e2759e700 1 -- 172.21.15.80:0/2695124045 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8e2806dce0 msgr2=0x7f8e2813b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:01.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.610+0000 7f8e2759e700 1 --2- 172.21.15.80:0/2695124045 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8e2806dce0 0x7f8e2813b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:01.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.610+0000 7f8e2759e700 1 -- 172.21.15.80:0/2695124045 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e18009a70 con 0x7f8e28141450 2024-05-08T21:10:01.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.610+0000 7f8e2759e700 1 --2- 172.21.15.80:0/2695124045 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e28141450 0x7f8e281ed8f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8e18015040 tx=0x7f8e18004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:01.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.610+0000 7f8e1f7fe700 1 -- 172.21.15.80:0/2695124045 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e18004670 con 0x7f8e28141450 2024-05-08T21:10:01.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.610+0000 7f8e1f7fe700 1 -- 172.21.15.80:0/2695124045 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e180047d0 con 0x7f8e28141450 2024-05-08T21:10:01.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.610+0000 7f8e1f7fe700 1 -- 172.21.15.80:0/2695124045 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e18012690 con 0x7f8e28141450 2024-05-08T21:10:01.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.610+0000 7f8e2d22b700 1 -- 172.21.15.80:0/2695124045 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e281f10f0 con 0x7f8e28141450 2024-05-08T21:10:01.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.610+0000 7f8e2d22b700 1 -- 172.21.15.80:0/2695124045 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e281f16b0 con 0x7f8e28141450 2024-05-08T21:10:01.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.611+0000 7f8e2d22b700 1 -- 172.21.15.80:0/2695124045 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e281f1870 con 0x7f8e28141450 2024-05-08T21:10:01.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.611+0000 7f8e1f7fe700 1 -- 172.21.15.80:0/2695124045 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8e180127f0 con 0x7f8e28141450 2024-05-08T21:10:01.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.612+0000 7f8e1f7fe700 1 --2- 172.21.15.80:0/2695124045 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f8e0806ac90 0x7f8e0806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:01.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.612+0000 7f8e26d9d700 1 --2- 172.21.15.80:0/2695124045 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f8e0806ac90 0x7f8e0806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:01.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.612+0000 7f8e1f7fe700 1 -- 172.21.15.80:0/2695124045 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8e1808a6e0 con 0x7f8e28141450 2024-05-08T21:10:01.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.612+0000 7f8e26d9d700 1 --2- 172.21.15.80:0/2695124045 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f8e0806ac90 0x7f8e0806d150 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8e20000f60 tx=0x7f8e20009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:01.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.616+0000 7f8e1f7fe700 1 -- 172.21.15.80:0/2695124045 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f8e18055c00 con 0x7f8e28141450 2024-05-08T21:10:01.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.814+0000 7f8e2d22b700 1 -- 172.21.15.80:0/2695124045 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f8e281ed640 con 0x7f8e28141450 2024-05-08T21:10:01.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.814+0000 7f8e1f7fe700 1 -- 172.21.15.80:0/2695124045 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+65 (secure 0 0 0) 0x7f8e18059220 con 0x7f8e28141450 2024-05-08T21:10:01.817 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:10:01.817 INFO:teuthology.orchestra.run.smithi080.stdout:[ 2024-05-08T21:10:01.817 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-08T21:10:01.817 INFO:teuthology.orchestra.run.smithi080.stdout: "poolnum": 1, 2024-05-08T21:10:01.817 INFO:teuthology.orchestra.run.smithi080.stdout: "poolname": ".mgr" 2024-05-08T21:10:01.817 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T21:10:01.817 INFO:teuthology.orchestra.run.smithi080.stdout:] 2024-05-08T21:10:01.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.816+0000 7f8e2d22b700 1 -- 172.21.15.80:0/2695124045 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f8e0806ac90 msgr2=0x7f8e0806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:01.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.816+0000 7f8e2d22b700 1 --2- 172.21.15.80:0/2695124045 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f8e0806ac90 0x7f8e0806d150 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8e20000f60 tx=0x7f8e20009040 comp rx=0 tx=0).stop 2024-05-08T21:10:01.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.816+0000 7f8e2d22b700 1 -- 172.21.15.80:0/2695124045 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e28141450 msgr2=0x7f8e281ed8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:01.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.816+0000 7f8e2d22b700 1 --2- 172.21.15.80:0/2695124045 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e28141450 0x7f8e281ed8f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8e18015040 tx=0x7f8e18004ad0 comp rx=0 tx=0).stop 2024-05-08T21:10:01.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.816+0000 7f8e2d22b700 1 -- 172.21.15.80:0/2695124045 shutdown_connections 2024-05-08T21:10:01.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.816+0000 7f8e2d22b700 1 --2- 172.21.15.80:0/2695124045 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f8e0806ac90 0x7f8e0806d150 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:01.819 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.816+0000 7f8e2d22b700 1 --2- 172.21.15.80:0/2695124045 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e28141450 0x7f8e281ed8f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:01.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.816+0000 7f8e2d22b700 1 --2- 172.21.15.80:0/2695124045 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8e2806dce0 0x7f8e2813b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:01.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.816+0000 7f8e2d22b700 1 --2- 172.21.15.80:0/2695124045 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8e2806eff0 0x7f8e2813b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:01.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.816+0000 7f8e2d22b700 1 -- 172.21.15.80:0/2695124045 >> 172.21.15.80:0/2695124045 conn(0x7f8e280ca340 msgr2=0x7f8e280ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:01.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.816+0000 7f8e2d22b700 1 -- 172.21.15.80:0/2695124045 shutdown_connections 2024-05-08T21:10:01.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.816+0000 7f8e2d22b700 1 -- 172.21.15.80:0/2695124045 wait complete. 2024-05-08T21:10:01.831 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-08T21:10:01.831 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-08T21:10:01.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.953+0000 7efd76d0f700 1 Processor -- start 2024-05-08T21:10:01.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.953+0000 7efd76d0f700 1 -- start start 2024-05-08T21:10:01.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.954+0000 7efd76d0f700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7efd701511b0 0x7efd700c7890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:01.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.954+0000 7efd76d0f700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efd70071400 0x7efd70071840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:01.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.954+0000 7efd76d0f700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd70151590 con 0x7efd7006eb30 2024-05-08T21:10:01.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.954+0000 7efd76d0f700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd70071d80 con 0x7efd701511b0 2024-05-08T21:10:01.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.954+0000 7efd76d0f700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd700c96b0 con 0x7efd70071400 2024-05-08T21:10:01.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.954+0000 7efd752ac700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7efd7006eb30 0x7efd7006ef60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:38522/0 (socket says 172.21.15.80:38522) 2024-05-08T21:10:01.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.954+0000 7efd752ac700 1 -- 172.21.15.80:0/605205583 learned_addr learned my addr 172.21.15.80:0/605205583 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:10:01.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.954+0000 7efd74aab700 1 --2- 172.21.15.80:0/605205583 >> v2:172.21.15.106:3300/0 conn(0x7efd701511b0 0x7efd700c7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:01.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.954+0000 7efd6ffff700 1 --2- 172.21.15.80:0/605205583 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efd70071400 0x7efd70071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:01.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.954+0000 7efd6f7fe700 1 -- 172.21.15.80:0/605205583 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3834671259 0 0) 0x7efd68001490 con 0x7efd7006eb30 2024-05-08T21:10:01.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.954+0000 7efd6f7fe700 1 -- 172.21.15.80:0/605205583 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd600035b0 con 0x7efd7006eb30 2024-05-08T21:10:01.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.954+0000 7efd6f7fe700 1 -- 172.21.15.80:0/605205583 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3003815290 0 0) 0x7efd600035b0 con 0x7efd7006eb30 2024-05-08T21:10:01.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.954+0000 7efd6f7fe700 1 -- 172.21.15.80:0/605205583 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efd70071400 msgr2=0x7efd70071840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:01.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.954+0000 7efd6f7fe700 1 --2- 172.21.15.80:0/605205583 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efd70071400 0x7efd70071840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:01.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.954+0000 7efd6f7fe700 1 -- 172.21.15.80:0/605205583 >> v2:172.21.15.106:3300/0 conn(0x7efd701511b0 msgr2=0x7efd700c7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:01.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.954+0000 7efd6f7fe700 1 --2- 172.21.15.80:0/605205583 >> v2:172.21.15.106:3300/0 conn(0x7efd701511b0 0x7efd700c7890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:01.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.954+0000 7efd6f7fe700 1 -- 172.21.15.80:0/605205583 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd700c7f80 con 0x7efd7006eb30 2024-05-08T21:10:01.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.954+0000 7efd6f7fe700 1 -- 172.21.15.80:0/605205583 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3520646302 0 0) 0x7efd68001b80 con 0x7efd7006eb30 2024-05-08T21:10:01.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.954+0000 7efd6ffff700 1 --2- 172.21.15.80:0/605205583 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efd70071400 0x7efd70071840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:10:01.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.954+0000 7efd6f7fe700 1 -- 172.21.15.80:0/605205583 >> v1:172.21.15.80:6789/0 conn(0x7efd7006eb30 legacy=0x7efd7006ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:01.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.954+0000 7efd6f7fe700 1 --2- 172.21.15.80:0/605205583 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd60003a00 0x7efd60003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:01.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.954+0000 7efd6f7fe700 1 --2- 172.21.15.80:0/605205583 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efd70071400 0x7efd60004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:01.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.954+0000 7efd6f7fe700 1 --2- 172.21.15.80:0/605205583 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd60004d90 0x7efd60005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:01.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.954+0000 7efd6f7fe700 1 -- 172.21.15.80:0/605205583 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd70071d80 con 0x7efd60003a00 2024-05-08T21:10:01.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.954+0000 7efd6f7fe700 1 -- 172.21.15.80:0/605205583 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd700c96b0 con 0x7efd60004d90 2024-05-08T21:10:01.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.954+0000 7efd6f7fe700 1 -- 172.21.15.80:0/605205583 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd6000ba10 con 0x7efd70071400 2024-05-08T21:10:01.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.954+0000 7efd74aab700 1 --2- 172.21.15.80:0/605205583 >> v2:172.21.15.106:3300/0 conn(0x7efd701511b0 0x7efd700c7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:10:01.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.955+0000 7efd6ffff700 1 --2- 172.21.15.80:0/605205583 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efd70071400 0x7efd60004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:01.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.955+0000 7efd74aab700 1 --2- 172.21.15.80:0/605205583 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd60003a00 0x7efd60003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:01.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.955+0000 7efd752ac700 1 --2- 172.21.15.80:0/605205583 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd60004d90 0x7efd60005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:01.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.955+0000 7efd74aab700 1 -- 172.21.15.80:0/605205583 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efd70071400 msgr2=0x7efd60004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:01.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.955+0000 7efd74aab700 1 --2- 172.21.15.80:0/605205583 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efd70071400 0x7efd60004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:01.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.955+0000 7efd74aab700 1 -- 172.21.15.80:0/605205583 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd60004d90 msgr2=0x7efd60005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:01.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.955+0000 7efd74aab700 1 --2- 172.21.15.80:0/605205583 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd60004d90 0x7efd60005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:01.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.955+0000 7efd74aab700 1 -- 172.21.15.80:0/605205583 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd5c0094a0 con 0x7efd60003a00 2024-05-08T21:10:01.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.955+0000 7efd6ffff700 1 --2- 172.21.15.80:0/605205583 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efd70071400 0x7efd60004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:10:01.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.955+0000 7efd74aab700 1 --2- 172.21.15.80:0/605205583 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd60003a00 0x7efd60003e20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7efd64009d10 tx=0x7efd60005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7cba11ad451331e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:01.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.955+0000 7efd6f7fe700 1 -- 172.21.15.80:0/605205583 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd64009e60 con 0x7efd60003a00 2024-05-08T21:10:01.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.955+0000 7efd6f7fe700 1 -- 172.21.15.80:0/605205583 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd6400e9a0 con 0x7efd60003a00 2024-05-08T21:10:01.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.955+0000 7efd6f7fe700 1 -- 172.21.15.80:0/605205583 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6400ed10 con 0x7efd60003a00 2024-05-08T21:10:01.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.956+0000 7efd76d0f700 1 -- 172.21.15.80:0/605205583 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd60003a00 msgr2=0x7efd60003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:01.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.956+0000 7efd76d0f700 1 --2- 172.21.15.80:0/605205583 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd60003a00 0x7efd60003e20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7efd64009d10 tx=0x7efd60005880 comp rx=0 tx=0).stop 2024-05-08T21:10:01.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.956+0000 7efd752ac700 1 -- 172.21.15.80:0/605205583 reap_dead start 2024-05-08T21:10:01.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.956+0000 7efd76d0f700 1 -- 172.21.15.80:0/605205583 shutdown_connections 2024-05-08T21:10:01.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.956+0000 7efd76d0f700 1 -- 172.21.15.80:0/605205583 >> 172.21.15.80:0/605205583 conn(0x7efd7006bad0 msgr2=0x7efd7006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:01.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.956+0000 7efd76d0f700 1 -- 172.21.15.80:0/605205583 shutdown_connections 2024-05-08T21:10:01.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.956+0000 7efd76d0f700 1 -- 172.21.15.80:0/605205583 wait complete. 2024-05-08T21:10:01.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.957+0000 7efd76d0f700 1 Processor -- start 2024-05-08T21:10:01.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.957+0000 7efd76d0f700 1 -- start start 2024-05-08T21:10:01.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.958+0000 7efd76d0f700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd60003a00 0x7efd700c5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:01.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.958+0000 7efd76d0f700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efd701ebb40 0x7efd7014ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:01.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.958+0000 7efd76d0f700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd70152140 0x7efd70150470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:01.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.958+0000 7efd76d0f700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd7014faa0 con 0x7efd70152140 2024-05-08T21:10:01.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.958+0000 7efd76d0f700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd701ebfd0 con 0x7efd60003a00 2024-05-08T21:10:01.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.958+0000 7efd76d0f700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd701ec2b0 con 0x7efd701ebb40 2024-05-08T21:10:01.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.958+0000 7efd752ac700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd70152140 0x7efd70150470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:01.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.958+0000 7efd752ac700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd70152140 0x7efd70150470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57860/0 (socket says 172.21.15.80:57860) 2024-05-08T21:10:01.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.958+0000 7efd752ac700 1 -- 172.21.15.80:0/7121046 learned_addr learned my addr 172.21.15.80:0/7121046 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:01.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.958+0000 7efd6ffff700 1 --2- 172.21.15.80:0/7121046 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efd701ebb40 0x7efd7014ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:01.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.958+0000 7efd74aab700 1 --2- 172.21.15.80:0/7121046 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd60003a00 0x7efd700c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:01.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.958+0000 7efd752ac700 1 -- 172.21.15.80:0/7121046 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efd701ebb40 msgr2=0x7efd7014ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:01.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.958+0000 7efd752ac700 1 --2- 172.21.15.80:0/7121046 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efd701ebb40 0x7efd7014ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:01.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.958+0000 7efd752ac700 1 -- 172.21.15.80:0/7121046 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd60003a00 msgr2=0x7efd700c5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:01.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.958+0000 7efd752ac700 1 --2- 172.21.15.80:0/7121046 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd60003a00 0x7efd700c5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:01.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.958+0000 7efd752ac700 1 -- 172.21.15.80:0/7121046 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd701ec590 con 0x7efd70152140 2024-05-08T21:10:01.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.958+0000 7efd752ac700 1 --2- 172.21.15.80:0/7121046 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd70152140 0x7efd70150470 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7efd700c7600 tx=0x7efd68007340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:01.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.958+0000 7efd6d7fa700 1 -- 172.21.15.80:0/7121046 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd68001b70 con 0x7efd70152140 2024-05-08T21:10:01.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.958+0000 7efd6d7fa700 1 -- 172.21.15.80:0/7121046 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd68007a00 con 0x7efd70152140 2024-05-08T21:10:01.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.958+0000 7efd76d0f700 1 -- 172.21.15.80:0/7121046 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd701ec870 con 0x7efd70152140 2024-05-08T21:10:01.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.958+0000 7efd6d7fa700 1 -- 172.21.15.80:0/7121046 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd68013630 con 0x7efd70152140 2024-05-08T21:10:01.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.958+0000 7efd76d0f700 1 -- 172.21.15.80:0/7121046 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd700c5940 con 0x7efd70152140 2024-05-08T21:10:01.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.959+0000 7efd76d0f700 1 -- 172.21.15.80:0/7121046 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd700c43f0 con 0x7efd70152140 2024-05-08T21:10:01.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.960+0000 7efd6d7fa700 1 -- 172.21.15.80:0/7121046 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7efd68013790 con 0x7efd70152140 2024-05-08T21:10:01.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.960+0000 7efd6d7fa700 1 --2- 172.21.15.80:0/7121046 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7efd5406ac90 0x7efd5406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:01.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.960+0000 7efd6d7fa700 1 -- 172.21.15.80:0/7121046 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7efd68089710 con 0x7efd70152140 2024-05-08T21:10:01.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.960+0000 7efd74aab700 1 --2- 172.21.15.80:0/7121046 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7efd5406ac90 0x7efd5406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:01.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.960+0000 7efd74aab700 1 --2- 172.21.15.80:0/7121046 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7efd5406ac90 0x7efd5406d150 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7efd640090b0 tx=0x7efd64015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:01.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:01.964+0000 7efd6d7fa700 1 -- 172.21.15.80:0/7121046 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7efd68054c40 con 0x7efd70152140 2024-05-08T21:10:02.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.160+0000 7efd76d0f700 1 -- 172.21.15.80:0/7121046 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7efd70151590 con 0x7efd70152140 2024-05-08T21:10:02.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.312+0000 7efd6d7fa700 1 -- 172.21.15.80:0/7121046 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) v1 ==== 138+0+0 (secure 0 0 0) 0x7efd70151590 con 0x7efd70152140 2024-05-08T21:10:02.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.315+0000 7efd76d0f700 1 -- 172.21.15.80:0/7121046 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7efd5406ac90 msgr2=0x7efd5406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:02.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.315+0000 7efd76d0f700 1 --2- 172.21.15.80:0/7121046 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7efd5406ac90 0x7efd5406d150 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7efd640090b0 tx=0x7efd64015000 comp rx=0 tx=0).stop 2024-05-08T21:10:02.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.315+0000 7efd76d0f700 1 -- 172.21.15.80:0/7121046 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd70152140 msgr2=0x7efd70150470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:02.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.315+0000 7efd76d0f700 1 --2- 172.21.15.80:0/7121046 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd70152140 0x7efd70150470 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7efd700c7600 tx=0x7efd68007340 comp rx=0 tx=0).stop 2024-05-08T21:10:02.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.315+0000 7efd76d0f700 1 -- 172.21.15.80:0/7121046 shutdown_connections 2024-05-08T21:10:02.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.315+0000 7efd76d0f700 1 --2- 172.21.15.80:0/7121046 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7efd5406ac90 0x7efd5406d150 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:02.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.315+0000 7efd76d0f700 1 --2- 172.21.15.80:0/7121046 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efd70152140 0x7efd70150470 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:02.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.315+0000 7efd76d0f700 1 --2- 172.21.15.80:0/7121046 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd60003a00 0x7efd700c5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:02.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.315+0000 7efd76d0f700 1 --2- 172.21.15.80:0/7121046 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efd701ebb40 0x7efd7014ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:02.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.315+0000 7efd76d0f700 1 -- 172.21.15.80:0/7121046 >> 172.21.15.80:0/7121046 conn(0x7efd7006bad0 msgr2=0x7efd700cced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:02.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.315+0000 7efd76d0f700 1 -- 172.21.15.80:0/7121046 shutdown_connections 2024-05-08T21:10:02.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.315+0000 7efd76d0f700 1 -- 172.21.15.80:0/7121046 wait complete. 2024-05-08T21:10:02.318 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_metadata' created 2024-05-08T21:10:02.332 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-05-08T21:10:02.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.457+0000 7f7a74e2c700 1 Processor -- start 2024-05-08T21:10:02.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.457+0000 7f7a74e2c700 1 -- start start 2024-05-08T21:10:02.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.458+0000 7f7a74e2c700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7a7015dd90 0x7f7a7015e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:02.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.458+0000 7f7a74e2c700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a7015e720 con 0x7f7a70071fb0 2024-05-08T21:10:02.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.458+0000 7f7a74e2c700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a70143b40 con 0x7f7a70143760 2024-05-08T21:10:02.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.458+0000 7f7a74e2c700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a70072440 con 0x7f7a7015dd90 2024-05-08T21:10:02.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.458+0000 7f7a6dd9b700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f7a70071fb0 0x7f7a7006a9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:51916/0 (socket says 172.21.15.80:51916) 2024-05-08T21:10:02.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.458+0000 7f7a6dd9b700 1 -- 172.21.15.80:0/3751540986 learned_addr learned my addr 172.21.15.80:0/3751540986 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:10:02.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.458+0000 7f7a6d59a700 1 -- 172.21.15.80:0/3751540986 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2188310330 0 0) 0x7f7a64001110 con 0x7f7a70071fb0 2024-05-08T21:10:02.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.458+0000 7f7a6ed9d700 1 --2- 172.21.15.80:0/3751540986 >> v2:172.21.15.106:3300/0 conn(0x7f7a7015dd90 0x7f7a7015e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:02.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.458+0000 7f7a6d59a700 1 -- 172.21.15.80:0/3751540986 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a580035b0 con 0x7f7a70071fb0 2024-05-08T21:10:02.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.458+0000 7f7a6d59a700 1 -- 172.21.15.80:0/3751540986 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1622695293 0 0) 0x7f7a580035b0 con 0x7f7a70071fb0 2024-05-08T21:10:02.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.458+0000 7f7a6d59a700 1 -- 172.21.15.80:0/3751540986 >> v2:172.21.15.106:3300/0 conn(0x7f7a7015dd90 msgr2=0x7f7a7015e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:02.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.458+0000 7f7a6d59a700 1 --2- 172.21.15.80:0/3751540986 >> v2:172.21.15.106:3300/0 conn(0x7f7a7015dd90 0x7f7a7015e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:02.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.458+0000 7f7a6d59a700 1 -- 172.21.15.80:0/3751540986 >> v1:172.21.15.106:6789/0 conn(0x7f7a70143760 legacy=0x7f7a700c9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:02.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.458+0000 7f7a6d59a700 1 -- 172.21.15.80:0/3751540986 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a700ca150 con 0x7f7a70071fb0 2024-05-08T21:10:02.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.458+0000 7f7a6d59a700 1 -- 172.21.15.80:0/3751540986 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3520646302 0 0) 0x7f7a64001800 con 0x7f7a70071fb0 2024-05-08T21:10:02.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.458+0000 7f7a6d59a700 1 -- 172.21.15.80:0/3751540986 >> v1:172.21.15.80:6789/0 conn(0x7f7a70071fb0 legacy=0x7f7a7006a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:02.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.458+0000 7f7a6d59a700 1 --2- 172.21.15.80:0/3751540986 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7a58003a00 0x7f7a58003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:02.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.458+0000 7f7a6d59a700 1 --2- 172.21.15.80:0/3751540986 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a58004850 0x7f7a58004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:02.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.458+0000 7f7a6d59a700 1 --2- 172.21.15.80:0/3751540986 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a58005210 0x7f7a5800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:02.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.459+0000 7f7a6d59a700 1 -- 172.21.15.80:0/3751540986 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5800c090 con 0x7f7a58005210 2024-05-08T21:10:02.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.459+0000 7f7a6d59a700 1 -- 172.21.15.80:0/3751540986 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5800c200 con 0x7f7a58004850 2024-05-08T21:10:02.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.459+0000 7f7a6d59a700 1 -- 172.21.15.80:0/3751540986 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5800c3c0 con 0x7f7a58003a00 2024-05-08T21:10:02.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.459+0000 7f7a6ed9d700 1 --2- 172.21.15.80:0/3751540986 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a58005210 0x7f7a5800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:02.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.459+0000 7f7a6dd9b700 1 --2- 172.21.15.80:0/3751540986 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a58004850 0x7f7a58004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:02.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.459+0000 7f7a6e59c700 1 --2- 172.21.15.80:0/3751540986 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7a58003a00 0x7f7a58003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:02.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.459+0000 7f7a6ed9d700 1 -- 172.21.15.80:0/3751540986 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7a58003a00 msgr2=0x7f7a58003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:02.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.459+0000 7f7a6ed9d700 1 --2- 172.21.15.80:0/3751540986 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7a58003a00 0x7f7a58003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:02.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.459+0000 7f7a6ed9d700 1 -- 172.21.15.80:0/3751540986 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a58004850 msgr2=0x7f7a58004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:02.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.459+0000 7f7a6ed9d700 1 --2- 172.21.15.80:0/3751540986 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a58004850 0x7f7a58004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:02.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.459+0000 7f7a6ed9d700 1 -- 172.21.15.80:0/3751540986 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a580035b0 con 0x7f7a58005210 2024-05-08T21:10:02.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.459+0000 7f7a6ed9d700 1 -- 172.21.15.80:0/3751540986 reap_dead start 2024-05-08T21:10:02.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.459+0000 7f7a6ed9d700 1 --2- 172.21.15.80:0/3751540986 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a58005210 0x7f7a5800ba10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7a68009fc0 tx=0x7f7a58005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a30d3c85e7ce8387 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:02.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.459+0000 7f7a6d59a700 1 -- 172.21.15.80:0/3751540986 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a68003a20 con 0x7f7a58005210 2024-05-08T21:10:02.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.459+0000 7f7a6d59a700 1 -- 172.21.15.80:0/3751540986 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a6800f040 con 0x7f7a58005210 2024-05-08T21:10:02.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.459+0000 7f7a6d59a700 1 -- 172.21.15.80:0/3751540986 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a68003da0 con 0x7f7a58005210 2024-05-08T21:10:02.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.460+0000 7f7a74e2c700 1 -- 172.21.15.80:0/3751540986 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a58005210 msgr2=0x7f7a5800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:02.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.460+0000 7f7a74e2c700 1 --2- 172.21.15.80:0/3751540986 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a58005210 0x7f7a5800ba10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7a68009fc0 tx=0x7f7a58005880 comp rx=0 tx=0).stop 2024-05-08T21:10:02.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.460+0000 7f7a74e2c700 1 -- 172.21.15.80:0/3751540986 shutdown_connections 2024-05-08T21:10:02.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.460+0000 7f7a74e2c700 1 --2- 172.21.15.80:0/3751540986 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a58005210 0x7f7a5800ba10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:02.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.460+0000 7f7a74e2c700 1 -- 172.21.15.80:0/3751540986 >> 172.21.15.80:0/3751540986 conn(0x7f7a7006f140 msgr2=0x7f7a7006f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:02.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.460+0000 7f7a74e2c700 1 -- 172.21.15.80:0/3751540986 shutdown_connections 2024-05-08T21:10:02.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.460+0000 7f7a74e2c700 1 -- 172.21.15.80:0/3751540986 wait complete. 2024-05-08T21:10:02.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.461+0000 7f7a74e2c700 1 Processor -- start 2024-05-08T21:10:02.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.461+0000 7f7a74e2c700 1 -- start start 2024-05-08T21:10:02.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.462+0000 7f7a74e2c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a58005210 0x7f7a700cc490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:02.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.462+0000 7f7a74e2c700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7a700cbcb0 0x7f7a70159390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:02.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.462+0000 7f7a74e2c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a700c6670 0x7f7a701598d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:02.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.462+0000 7f7a74e2c700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a700cd650 con 0x7f7a700c6670 2024-05-08T21:10:02.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.462+0000 7f7a74e2c700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a700cc1f0 con 0x7f7a58005210 2024-05-08T21:10:02.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.462+0000 7f7a74e2c700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a700cb450 con 0x7f7a700cbcb0 2024-05-08T21:10:02.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.462+0000 7f7a6ed9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a700c6670 0x7f7a701598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:02.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.462+0000 7f7a6ed9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a700c6670 0x7f7a701598d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42754/0 (socket says 172.21.15.80:42754) 2024-05-08T21:10:02.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.462+0000 7f7a6ed9d700 1 -- 172.21.15.80:0/4172973044 learned_addr learned my addr 172.21.15.80:0/4172973044 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:02.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.462+0000 7f7a6e59c700 1 --2- 172.21.15.80:0/4172973044 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a58005210 0x7f7a700cc490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:02.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.462+0000 7f7a6dd9b700 1 --2- 172.21.15.80:0/4172973044 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7a700cbcb0 0x7f7a70159390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:02.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.462+0000 7f7a6ed9d700 1 -- 172.21.15.80:0/4172973044 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7a700cbcb0 msgr2=0x7f7a70159390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:02.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.462+0000 7f7a6ed9d700 1 --2- 172.21.15.80:0/4172973044 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7a700cbcb0 0x7f7a70159390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:02.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.462+0000 7f7a6ed9d700 1 -- 172.21.15.80:0/4172973044 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a58005210 msgr2=0x7f7a700cc490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:02.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.462+0000 7f7a6ed9d700 1 --2- 172.21.15.80:0/4172973044 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a58005210 0x7f7a700cc490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:02.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.462+0000 7f7a6ed9d700 1 -- 172.21.15.80:0/4172973044 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a700cb730 con 0x7f7a700c6670 2024-05-08T21:10:02.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.462+0000 7f7a6ed9d700 1 --2- 172.21.15.80:0/4172973044 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a700c6670 0x7f7a701598d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7a7006b690 tx=0x7f7a68009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:02.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.462+0000 7f7a5effd700 1 -- 172.21.15.80:0/4172973044 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a68003e90 con 0x7f7a700c6670 2024-05-08T21:10:02.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.462+0000 7f7a5effd700 1 -- 172.21.15.80:0/4172973044 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a68004250 con 0x7f7a700c6670 2024-05-08T21:10:02.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.462+0000 7f7a5effd700 1 -- 172.21.15.80:0/4172973044 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a68004620 con 0x7f7a700c6670 2024-05-08T21:10:02.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.462+0000 7f7a74e2c700 1 -- 172.21.15.80:0/4172973044 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a700cd000 con 0x7f7a700c6670 2024-05-08T21:10:02.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.463+0000 7f7a74e2c700 1 -- 172.21.15.80:0/4172973044 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a700c3f90 con 0x7f7a700c6670 2024-05-08T21:10:02.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.464+0000 7f7a74e2c700 1 -- 172.21.15.80:0/4172973044 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a7004ec60 con 0x7f7a700c6670 2024-05-08T21:10:02.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.464+0000 7f7a5effd700 1 -- 172.21.15.80:0/4172973044 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7a68004780 con 0x7f7a700c6670 2024-05-08T21:10:02.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.464+0000 7f7a5effd700 1 --2- 172.21.15.80:0/4172973044 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f7a5006acc0 0x7f7a5006d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:02.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.464+0000 7f7a5effd700 1 -- 172.21.15.80:0/4172973044 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f7a6808a370 con 0x7f7a700c6670 2024-05-08T21:10:02.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.464+0000 7f7a6e59c700 1 --2- 172.21.15.80:0/4172973044 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f7a5006acc0 0x7f7a5006d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:02.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.465+0000 7f7a6e59c700 1 --2- 172.21.15.80:0/4172973044 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f7a5006acc0 0x7f7a5006d180 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7a60000c00 tx=0x7f7a60009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:02.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.469+0000 7f7a5effd700 1 -- 172.21.15.80:0/4172973044 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f7a680557c0 con 0x7f7a700c6670 2024-05-08T21:10:02.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:02.668+0000 7f7a74e2c700 1 -- 172.21.15.80:0/4172973044 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f7a7015d780 con 0x7f7a700c6670 2024-05-08T21:10:03.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.315+0000 7f7a5effd700 1 -- 172.21.15.80:0/4172973044 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v20) v1 ==== 171+0+0 (secure 0 0 0) 0x7f7a68058de0 con 0x7f7a700c6670 2024-05-08T21:10:03.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.320+0000 7f7a74e2c700 1 -- 172.21.15.80:0/4172973044 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f7a5006acc0 msgr2=0x7f7a5006d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:03.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.320+0000 7f7a74e2c700 1 --2- 172.21.15.80:0/4172973044 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f7a5006acc0 0x7f7a5006d180 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7a60000c00 tx=0x7f7a60009040 comp rx=0 tx=0).stop 2024-05-08T21:10:03.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.320+0000 7f7a74e2c700 1 -- 172.21.15.80:0/4172973044 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a700c6670 msgr2=0x7f7a701598d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:03.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.320+0000 7f7a74e2c700 1 --2- 172.21.15.80:0/4172973044 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a700c6670 0x7f7a701598d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7a7006b690 tx=0x7f7a68009750 comp rx=0 tx=0).stop 2024-05-08T21:10:03.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.321+0000 7f7a74e2c700 1 -- 172.21.15.80:0/4172973044 shutdown_connections 2024-05-08T21:10:03.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.321+0000 7f7a74e2c700 1 --2- 172.21.15.80:0/4172973044 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f7a5006acc0 0x7f7a5006d180 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:03.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.321+0000 7f7a74e2c700 1 --2- 172.21.15.80:0/4172973044 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a700c6670 0x7f7a701598d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:03.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.321+0000 7f7a74e2c700 1 --2- 172.21.15.80:0/4172973044 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a58005210 0x7f7a700cc490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:03.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.321+0000 7f7a74e2c700 1 --2- 172.21.15.80:0/4172973044 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7a700cbcb0 0x7f7a70159390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:03.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.321+0000 7f7a74e2c700 1 -- 172.21.15.80:0/4172973044 >> 172.21.15.80:0/4172973044 conn(0x7f7a7006f140 msgr2=0x7f7a70142980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:03.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.322+0000 7f7a74e2c700 1 -- 172.21.15.80:0/4172973044 shutdown_connections 2024-05-08T21:10:03.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.324+0000 7f7a74e2c700 1 -- 172.21.15.80:0/4172973044 wait complete. 2024-05-08T21:10:03.332 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data' created 2024-05-08T21:10:03.347 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-08T21:10:03.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.473+0000 7f60532da700 1 Processor -- start 2024-05-08T21:10:03.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.474+0000 7f60532da700 1 -- start start 2024-05-08T21:10:03.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.474+0000 7f60532da700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f604c0ccfe0 0x7f604c071be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:03.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.474+0000 7f60532da700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f604c0c8380 0x7f604c0c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:03.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.474+0000 7f60532da700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f604c0c9150 con 0x7f604c0ccc00 2024-05-08T21:10:03.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.474+0000 7f60532da700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f604c0c99f0 con 0x7f604c0c8380 2024-05-08T21:10:03.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.474+0000 7f60532da700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f604c1579c0 con 0x7f604c0ccfe0 2024-05-08T21:10:03.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.474+0000 7f6051076700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f604c0ccc00 0x7f604c156ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:51920/0 (socket says 172.21.15.80:51920) 2024-05-08T21:10:03.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.474+0000 7f6051076700 1 -- 172.21.15.80:0/4198097597 learned_addr learned my addr 172.21.15.80:0/4198097597 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:10:03.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.475+0000 7f6051877700 1 --2- 172.21.15.80:0/4198097597 >> v2:172.21.15.106:3300/0 conn(0x7f604c0c8380 0x7f604c0c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:03.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.475+0000 7f6050875700 1 --2- 172.21.15.80:0/4198097597 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f604c0ccfe0 0x7f604c071be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:03.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.475+0000 7f6043fff700 1 -- 172.21.15.80:0/4198097597 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1626395449 0 0) 0x7f604c0c9150 con 0x7f604c0ccc00 2024-05-08T21:10:03.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.475+0000 7f6043fff700 1 -- 172.21.15.80:0/4198097597 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60380035b0 con 0x7f604c0ccc00 2024-05-08T21:10:03.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.475+0000 7f6043fff700 1 -- 172.21.15.80:0/4198097597 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 688159306 0 0) 0x7f60380035b0 con 0x7f604c0ccc00 2024-05-08T21:10:03.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.475+0000 7f6043fff700 1 -- 172.21.15.80:0/4198097597 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f604c0ccfe0 msgr2=0x7f604c071be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:03.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.475+0000 7f6043fff700 1 --2- 172.21.15.80:0/4198097597 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f604c0ccfe0 0x7f604c071be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:03.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.475+0000 7f6043fff700 1 -- 172.21.15.80:0/4198097597 >> v2:172.21.15.106:3300/0 conn(0x7f604c0c8380 msgr2=0x7f604c0c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:03.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.475+0000 7f6043fff700 1 --2- 172.21.15.80:0/4198097597 >> v2:172.21.15.106:3300/0 conn(0x7f604c0c8380 0x7f604c0c9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:03.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.475+0000 7f6043fff700 1 -- 172.21.15.80:0/4198097597 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f604c157ca0 con 0x7f604c0ccc00 2024-05-08T21:10:03.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.475+0000 7f6043fff700 1 -- 172.21.15.80:0/4198097597 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3520646302 0 0) 0x7f603c001670 con 0x7f604c0ccc00 2024-05-08T21:10:03.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.475+0000 7f6050875700 1 --2- 172.21.15.80:0/4198097597 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f604c0ccfe0 0x7f604c071be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:10:03.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.475+0000 7f6043fff700 1 -- 172.21.15.80:0/4198097597 >> v1:172.21.15.80:6789/0 conn(0x7f604c0ccc00 legacy=0x7f604c156ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:03.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.475+0000 7f6043fff700 1 --2- 172.21.15.80:0/4198097597 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6038003a00 0x7f6038003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:03.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.475+0000 7f6043fff700 1 --2- 172.21.15.80:0/4198097597 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f604c0ccfe0 0x7f6038004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:03.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.475+0000 7f6043fff700 1 --2- 172.21.15.80:0/4198097597 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6038004d90 0x7f6038005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:03.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.475+0000 7f6043fff700 1 -- 172.21.15.80:0/4198097597 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f604c0c99f0 con 0x7f6038004d90 2024-05-08T21:10:03.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.475+0000 7f6043fff700 1 -- 172.21.15.80:0/4198097597 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f604c1579c0 con 0x7f6038003a00 2024-05-08T21:10:03.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.475+0000 7f6043fff700 1 -- 172.21.15.80:0/4198097597 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f603800ba10 con 0x7f604c0ccfe0 2024-05-08T21:10:03.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.475+0000 7f6051877700 1 --2- 172.21.15.80:0/4198097597 >> v2:172.21.15.106:3300/0 conn(0x7f604c0c8380 0x7f604c0c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:10:03.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.475+0000 7f6051076700 1 --2- 172.21.15.80:0/4198097597 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6038003a00 0x7f6038003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:03.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.475+0000 7f6051877700 1 --2- 172.21.15.80:0/4198097597 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6038004d90 0x7f6038005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:03.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.475+0000 7f6050875700 1 --2- 172.21.15.80:0/4198097597 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f604c0ccfe0 0x7f6038004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:03.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.475+0000 7f6051877700 1 -- 172.21.15.80:0/4198097597 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f604c0ccfe0 msgr2=0x7f6038004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:03.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.475+0000 7f6051877700 1 --2- 172.21.15.80:0/4198097597 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f604c0ccfe0 0x7f6038004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:03.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.475+0000 7f6051877700 1 -- 172.21.15.80:0/4198097597 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6038003a00 msgr2=0x7f6038003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:03.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.475+0000 7f6051877700 1 --2- 172.21.15.80:0/4198097597 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6038003a00 0x7f6038003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:03.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.475+0000 7f6051877700 1 -- 172.21.15.80:0/4198097597 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60480094a0 con 0x7f6038004d90 2024-05-08T21:10:03.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.476+0000 7f6051877700 1 --2- 172.21.15.80:0/4198097597 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6038004d90 0x7f6038005210 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f604400e350 tx=0x7f6038005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e89020a8fa6a991 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:03.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.476+0000 7f6043fff700 1 -- 172.21.15.80:0/4198097597 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604400ee10 con 0x7f6038004d90 2024-05-08T21:10:03.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.476+0000 7f6043fff700 1 -- 172.21.15.80:0/4198097597 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f604400f040 con 0x7f6038004d90 2024-05-08T21:10:03.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.476+0000 7f6043fff700 1 -- 172.21.15.80:0/4198097597 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6044003c40 con 0x7f6038004d90 2024-05-08T21:10:03.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.476+0000 7f60532da700 1 -- 172.21.15.80:0/4198097597 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6038004d90 msgr2=0x7f6038005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:03.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.476+0000 7f60532da700 1 --2- 172.21.15.80:0/4198097597 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6038004d90 0x7f6038005210 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f604400e350 tx=0x7f6038005880 comp rx=0 tx=0).stop 2024-05-08T21:10:03.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.476+0000 7f6051877700 1 -- 172.21.15.80:0/4198097597 reap_dead start 2024-05-08T21:10:03.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.476+0000 7f60532da700 1 -- 172.21.15.80:0/4198097597 shutdown_connections 2024-05-08T21:10:03.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.476+0000 7f60532da700 1 -- 172.21.15.80:0/4198097597 >> 172.21.15.80:0/4198097597 conn(0x7f604c06f140 msgr2=0x7f604c06f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:03.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.476+0000 7f60532da700 1 -- 172.21.15.80:0/4198097597 shutdown_connections 2024-05-08T21:10:03.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.476+0000 7f60532da700 1 -- 172.21.15.80:0/4198097597 wait complete. 2024-05-08T21:10:03.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.478+0000 7f60532da700 1 Processor -- start 2024-05-08T21:10:03.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.478+0000 7f60532da700 1 -- start start 2024-05-08T21:10:03.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.478+0000 7f60532da700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f604c1461d0 0x7f604c1499a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:03.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.478+0000 7f60532da700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f604c1465b0 0x7f604c1f1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:03.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.478+0000 7f60532da700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f604c1ed960 0x7f604c1eddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:03.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.478+0000 7f60532da700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f604c1ed510 con 0x7f604c1465b0 2024-05-08T21:10:03.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.478+0000 7f60532da700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f604c15abd0 con 0x7f604c1ed960 2024-05-08T21:10:03.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.478+0000 7f60532da700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f604c1ee330 con 0x7f604c1461d0 2024-05-08T21:10:03.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.478+0000 7f6050875700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f604c1465b0 0x7f604c1f1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:03.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.478+0000 7f6050875700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f604c1465b0 0x7f604c1f1490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42760/0 (socket says 172.21.15.80:42760) 2024-05-08T21:10:03.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.478+0000 7f6050875700 1 -- 172.21.15.80:0/210759430 learned_addr learned my addr 172.21.15.80:0/210759430 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:03.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.478+0000 7f6051076700 1 --2- 172.21.15.80:0/210759430 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f604c1461d0 0x7f604c1499a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:03.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.478+0000 7f6051877700 1 --2- 172.21.15.80:0/210759430 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f604c1ed960 0x7f604c1eddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:03.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.479+0000 7f6050875700 1 -- 172.21.15.80:0/210759430 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f604c1461d0 msgr2=0x7f604c1499a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:03.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.479+0000 7f6050875700 1 --2- 172.21.15.80:0/210759430 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f604c1461d0 0x7f604c1499a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:03.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.479+0000 7f6050875700 1 -- 172.21.15.80:0/210759430 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f604c1ed960 msgr2=0x7f604c1eddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:03.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.479+0000 7f6050875700 1 --2- 172.21.15.80:0/210759430 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f604c1ed960 0x7f604c1eddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:03.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.479+0000 7f6050875700 1 -- 172.21.15.80:0/210759430 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f604c15ae40 con 0x7f604c1465b0 2024-05-08T21:10:03.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.479+0000 7f6050875700 1 --2- 172.21.15.80:0/210759430 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f604c1465b0 0x7f604c1f1490 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6048011cd0 tx=0x7f6048009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:03.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.479+0000 7f6041ffb700 1 -- 172.21.15.80:0/210759430 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604800fa00 con 0x7f604c1465b0 2024-05-08T21:10:03.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.479+0000 7f6041ffb700 1 -- 172.21.15.80:0/210759430 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f604800fb60 con 0x7f604c1465b0 2024-05-08T21:10:03.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.479+0000 7f60532da700 1 -- 172.21.15.80:0/210759430 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f604c15b120 con 0x7f604c1465b0 2024-05-08T21:10:03.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.479+0000 7f6041ffb700 1 -- 172.21.15.80:0/210759430 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6048004020 con 0x7f604c1465b0 2024-05-08T21:10:03.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.479+0000 7f60532da700 1 -- 172.21.15.80:0/210759430 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f604c1492b0 con 0x7f604c1465b0 2024-05-08T21:10:03.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.480+0000 7f60532da700 1 -- 172.21.15.80:0/210759430 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f604c1ed680 con 0x7f604c1465b0 2024-05-08T21:10:03.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.481+0000 7f6041ffb700 1 -- 172.21.15.80:0/210759430 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6048004180 con 0x7f604c1465b0 2024-05-08T21:10:03.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.481+0000 7f6041ffb700 1 --2- 172.21.15.80:0/210759430 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f603006acc0 0x7f603006d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:03.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.481+0000 7f6041ffb700 1 -- 172.21.15.80:0/210759430 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f6048089740 con 0x7f604c1465b0 2024-05-08T21:10:03.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.481+0000 7f6051076700 1 --2- 172.21.15.80:0/210759430 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f603006acc0 0x7f603006d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:03.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.481+0000 7f6051076700 1 --2- 172.21.15.80:0/210759430 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f603006acc0 0x7f603006d180 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f603c0048d0 tx=0x7f603c007980 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:03.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.485+0000 7f6041ffb700 1 -- 172.21.15.80:0/210759430 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f604c1ed680 con 0x7f604c1465b0 2024-05-08T21:10:03.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.724+0000 7f60532da700 1 -- 172.21.15.80:0/210759430 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f604c1ed650 con 0x7f604c1465b0 2024-05-08T21:10:03.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.730+0000 7f6041ffb700 1 -- 172.21.15.80:0/210759430 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f6048054990 con 0x7f604c1465b0 2024-05-08T21:10:03.738 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.736+0000 7f60532da700 1 -- 172.21.15.80:0/210759430 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f603006acc0 msgr2=0x7f603006d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:03.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.736+0000 7f60532da700 1 --2- 172.21.15.80:0/210759430 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f603006acc0 0x7f603006d180 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f603c0048d0 tx=0x7f603c007980 comp rx=0 tx=0).stop 2024-05-08T21:10:03.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.736+0000 7f60532da700 1 -- 172.21.15.80:0/210759430 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f604c1465b0 msgr2=0x7f604c1f1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:03.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.736+0000 7f60532da700 1 --2- 172.21.15.80:0/210759430 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f604c1465b0 0x7f604c1f1490 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6048011cd0 tx=0x7f6048009ed0 comp rx=0 tx=0).stop 2024-05-08T21:10:03.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.739+0000 7f60532da700 1 -- 172.21.15.80:0/210759430 shutdown_connections 2024-05-08T21:10:03.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.739+0000 7f60532da700 1 --2- 172.21.15.80:0/210759430 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f603006acc0 0x7f603006d180 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:03.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.739+0000 7f60532da700 1 --2- 172.21.15.80:0/210759430 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f604c1ed960 0x7f604c1eddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:03.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.739+0000 7f60532da700 1 --2- 172.21.15.80:0/210759430 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f604c1461d0 0x7f604c1499a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:03.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.739+0000 7f60532da700 1 --2- 172.21.15.80:0/210759430 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f604c1465b0 0x7f604c1f1490 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:03.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.739+0000 7f60532da700 1 -- 172.21.15.80:0/210759430 >> 172.21.15.80:0/210759430 conn(0x7f604c06f140 msgr2=0x7f604c144e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:03.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.740+0000 7f60532da700 1 -- 172.21.15.80:0/210759430 shutdown_connections 2024-05-08T21:10:03.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.740+0000 7f60532da700 1 -- 172.21.15.80:0/210759430 wait complete. 2024-05-08T21:10:03.745 INFO:teuthology.orchestra.run.smithi080.stderr:new fs with metadata pool 2 and data pool 3 2024-05-08T21:10:03.760 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-05-08T21:10:03.761 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-05-08T21:10:03.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.884+0000 7f2cf2c2c700 1 Processor -- start 2024-05-08T21:10:03.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.884+0000 7f2cf2c2c700 1 -- start start 2024-05-08T21:10:03.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.885+0000 7f2cf2c2c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2cec154460 0x7f2cec15a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:03.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.885+0000 7f2cf2c2c700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f2cec15e400 0x7f2cec072dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:03.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.885+0000 7f2cf2c2c700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2cec06bad0 0x7f2cec0c8600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:03.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.885+0000 7f2cf2c2c700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cec06c940 con 0x7f2cec154460 2024-05-08T21:10:03.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.885+0000 7f2cf2c2c700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cec15df70 con 0x7f2cec15e400 2024-05-08T21:10:03.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.885+0000 7f2cf2c2c700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cec15a6d0 con 0x7f2cec06bad0 2024-05-08T21:10:03.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.885+0000 7f2cf09c8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2cec154460 0x7f2cec15a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:03.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.885+0000 7f2cf09c8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2cec154460 0x7f2cec15a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42770/0 (socket says 172.21.15.80:42770) 2024-05-08T21:10:03.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.885+0000 7f2cf09c8700 1 -- 172.21.15.80:0/971362425 learned_addr learned my addr 172.21.15.80:0/971362425 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:03.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.885+0000 7f2cebfff700 1 --2- 172.21.15.80:0/971362425 >> v2:172.21.15.106:3300/0 conn(0x7f2cec15e400 0x7f2cec072dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:03.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.885+0000 7f2cf11c9700 1 --2- 172.21.15.80:0/971362425 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2cec06bad0 0x7f2cec0c8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:03.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.885+0000 7f2cf09c8700 1 -- 172.21.15.80:0/971362425 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2cec06bad0 msgr2=0x7f2cec0c8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:03.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.885+0000 7f2cf09c8700 1 --2- 172.21.15.80:0/971362425 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2cec06bad0 0x7f2cec0c8600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:03.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.885+0000 7f2cf09c8700 1 -- 172.21.15.80:0/971362425 >> v2:172.21.15.106:3300/0 conn(0x7f2cec15e400 msgr2=0x7f2cec072dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:03.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.885+0000 7f2cf09c8700 1 --2- 172.21.15.80:0/971362425 >> v2:172.21.15.106:3300/0 conn(0x7f2cec15e400 0x7f2cec072dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:03.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.885+0000 7f2cf09c8700 1 -- 172.21.15.80:0/971362425 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cec154840 con 0x7f2cec154460 2024-05-08T21:10:03.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.885+0000 7f2cebfff700 1 --2- 172.21.15.80:0/971362425 >> v2:172.21.15.106:3300/0 conn(0x7f2cec15e400 0x7f2cec072dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:10:03.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.886+0000 7f2cf09c8700 1 --2- 172.21.15.80:0/971362425 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2cec154460 0x7f2cec15a190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2cec0ce660 tx=0x7f2ce0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7e07eab87b929e0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:03.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.886+0000 7f2ceb7fe700 1 -- 172.21.15.80:0/971362425 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce000b870 con 0x7f2cec154460 2024-05-08T21:10:03.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.886+0000 7f2ceb7fe700 1 -- 172.21.15.80:0/971362425 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ce000b9d0 con 0x7f2cec154460 2024-05-08T21:10:03.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.886+0000 7f2ceb7fe700 1 -- 172.21.15.80:0/971362425 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce000bd60 con 0x7f2cec154460 2024-05-08T21:10:03.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.886+0000 7f2cf2c2c700 1 -- 172.21.15.80:0/971362425 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2cec154460 msgr2=0x7f2cec15a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:03.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.886+0000 7f2cf2c2c700 1 --2- 172.21.15.80:0/971362425 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2cec154460 0x7f2cec15a190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2cec0ce660 tx=0x7f2ce0009bd0 comp rx=0 tx=0).stop 2024-05-08T21:10:03.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.886+0000 7f2cf2c2c700 1 -- 172.21.15.80:0/971362425 shutdown_connections 2024-05-08T21:10:03.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.886+0000 7f2cf2c2c700 1 --2- 172.21.15.80:0/971362425 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2cec154460 0x7f2cec15a190 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:03.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.886+0000 7f2cf2c2c700 1 --2- 172.21.15.80:0/971362425 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2cec06bad0 0x7f2cec0c8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:03.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.886+0000 7f2cf2c2c700 1 --2- 172.21.15.80:0/971362425 >> v2:172.21.15.106:3300/0 conn(0x7f2cec15e400 0x7f2cec072dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:03.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.886+0000 7f2cf2c2c700 1 -- 172.21.15.80:0/971362425 >> 172.21.15.80:0/971362425 conn(0x7f2cec06ec90 msgr2=0x7f2cec066780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:03.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.886+0000 7f2cf2c2c700 1 -- 172.21.15.80:0/971362425 shutdown_connections 2024-05-08T21:10:03.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.886+0000 7f2cf2c2c700 1 -- 172.21.15.80:0/971362425 wait complete. 2024-05-08T21:10:03.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.887+0000 7f2cf2c2c700 1 Processor -- start 2024-05-08T21:10:03.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.887+0000 7f2cf2c2c700 1 -- start start 2024-05-08T21:10:03.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.888+0000 7f2cf2c2c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2cec06bad0 0x7f2cec14d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:03.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.888+0000 7f2cf2c2c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2cec154460 0x7f2cec14fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:03.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.888+0000 7f2cf2c2c700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2cec15e400 0x7f2cec1503d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:03.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.888+0000 7f2cf2c2c700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cec14d630 con 0x7f2cec06bad0 2024-05-08T21:10:03.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.888+0000 7f2cf2c2c700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cec15a520 con 0x7f2cec154460 2024-05-08T21:10:03.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.888+0000 7f2cf2c2c700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cec0c8020 con 0x7f2cec15e400 2024-05-08T21:10:03.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.888+0000 7f2cf09c8700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2cec06bad0 0x7f2cec14d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:03.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.888+0000 7f2cf09c8700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2cec06bad0 0x7f2cec14d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42772/0 (socket says 172.21.15.80:42772) 2024-05-08T21:10:03.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.888+0000 7f2cf09c8700 1 -- 172.21.15.80:0/1929149592 learned_addr learned my addr 172.21.15.80:0/1929149592 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:03.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.889+0000 7f2cf11c9700 1 --2- 172.21.15.80:0/1929149592 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2cec15e400 0x7f2cec1503d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:03.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.889+0000 7f2cebfff700 1 --2- 172.21.15.80:0/1929149592 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2cec154460 0x7f2cec14fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:03.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.889+0000 7f2cf09c8700 1 -- 172.21.15.80:0/1929149592 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2cec15e400 msgr2=0x7f2cec1503d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:03.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.889+0000 7f2cf09c8700 1 --2- 172.21.15.80:0/1929149592 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2cec15e400 0x7f2cec1503d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:03.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.889+0000 7f2cf09c8700 1 -- 172.21.15.80:0/1929149592 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2cec154460 msgr2=0x7f2cec14fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:03.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.889+0000 7f2cf09c8700 1 --2- 172.21.15.80:0/1929149592 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2cec154460 0x7f2cec14fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:03.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.889+0000 7f2cf09c8700 1 -- 172.21.15.80:0/1929149592 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce0009550 con 0x7f2cec06bad0 2024-05-08T21:10:03.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.889+0000 7f2cf09c8700 1 --2- 172.21.15.80:0/1929149592 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2cec06bad0 0x7f2cec14d0f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2cec067760 tx=0x7f2ce0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:03.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.889+0000 7f2ce97fa700 1 -- 172.21.15.80:0/1929149592 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce0004310 con 0x7f2cec06bad0 2024-05-08T21:10:03.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.889+0000 7f2ce97fa700 1 -- 172.21.15.80:0/1929149592 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ce001f070 con 0x7f2cec06bad0 2024-05-08T21:10:03.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.889+0000 7f2cf2c2c700 1 -- 172.21.15.80:0/1929149592 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cec15a240 con 0x7f2cec06bad0 2024-05-08T21:10:03.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.889+0000 7f2ce97fa700 1 -- 172.21.15.80:0/1929149592 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce00036a0 con 0x7f2cec06bad0 2024-05-08T21:10:03.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.889+0000 7f2cf2c2c700 1 -- 172.21.15.80:0/1929149592 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cec0c79d0 con 0x7f2cec06bad0 2024-05-08T21:10:03.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.890+0000 7f2cf2c2c700 1 -- 172.21.15.80:0/1929149592 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cec0c8300 con 0x7f2cec06bad0 2024-05-08T21:10:03.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.890+0000 7f2ce97fa700 1 -- 172.21.15.80:0/1929149592 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2ce0021030 con 0x7f2cec06bad0 2024-05-08T21:10:03.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.891+0000 7f2ce97fa700 1 --2- 172.21.15.80:0/1929149592 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f2cd006acc0 0x7f2cd006d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:03.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.891+0000 7f2ce97fa700 1 -- 172.21.15.80:0/1929149592 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2ce008a5f0 con 0x7f2cec06bad0 2024-05-08T21:10:03.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.891+0000 7f2cebfff700 1 --2- 172.21.15.80:0/1929149592 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f2cd006acc0 0x7f2cd006d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:03.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.891+0000 7f2cebfff700 1 --2- 172.21.15.80:0/1929149592 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f2cd006acc0 0x7f2cd006d180 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2cec0c4560 tx=0x7f2cd8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:03.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:03.895+0000 7f2ce97fa700 1 -- 172.21.15.80:0/1929149592 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f2ce00558f0 con 0x7f2cec06bad0 2024-05-08T21:10:04.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.101+0000 7f2cf2c2c700 1 -- 172.21.15.80:0/1929149592 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f2cec04ed00 con 0x7f2cec06bad0 2024-05-08T21:10:04.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.735+0000 7f2ce97fa700 1 -- 172.21.15.80:0/1929149592 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v22) v1 ==== 157+0+0 (secure 0 0 0) 0x7f2ce0058f10 con 0x7f2cec06bad0 2024-05-08T21:10:04.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.737+0000 7f2cf2c2c700 1 -- 172.21.15.80:0/1929149592 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f2cd006acc0 msgr2=0x7f2cd006d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:04.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.737+0000 7f2cf2c2c700 1 --2- 172.21.15.80:0/1929149592 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f2cd006acc0 0x7f2cd006d180 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2cec0c4560 tx=0x7f2cd8008040 comp rx=0 tx=0).stop 2024-05-08T21:10:04.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.737+0000 7f2cf2c2c700 1 -- 172.21.15.80:0/1929149592 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2cec06bad0 msgr2=0x7f2cec14d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:04.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.737+0000 7f2cf2c2c700 1 --2- 172.21.15.80:0/1929149592 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2cec06bad0 0x7f2cec14d0f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2cec067760 tx=0x7f2ce0004750 comp rx=0 tx=0).stop 2024-05-08T21:10:04.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.738+0000 7f2cf2c2c700 1 -- 172.21.15.80:0/1929149592 shutdown_connections 2024-05-08T21:10:04.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.738+0000 7f2cf2c2c700 1 --2- 172.21.15.80:0/1929149592 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f2cd006acc0 0x7f2cd006d180 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:04.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.738+0000 7f2cf2c2c700 1 --2- 172.21.15.80:0/1929149592 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2cec06bad0 0x7f2cec14d0f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:04.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.738+0000 7f2cf2c2c700 1 --2- 172.21.15.80:0/1929149592 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2cec15e400 0x7f2cec1503d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:04.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.738+0000 7f2cf2c2c700 1 --2- 172.21.15.80:0/1929149592 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2cec154460 0x7f2cec14fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:04.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.738+0000 7f2cf2c2c700 1 -- 172.21.15.80:0/1929149592 >> 172.21.15.80:0/1929149592 conn(0x7f2cec06ec90 msgr2=0x7f2cec0c9360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:04.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.738+0000 7f2cf2c2c700 1 -- 172.21.15.80:0/1929149592 shutdown_connections 2024-05-08T21:10:04.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.738+0000 7f2cf2c2c700 1 -- 172.21.15.80:0/1929149592 wait complete. 2024-05-08T21:10:04.753 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-05-08T21:10:04.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.881+0000 7fc994640700 1 Processor -- start 2024-05-08T21:10:04.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.881+0000 7fc994640700 1 -- start start 2024-05-08T21:10:04.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.882+0000 7fc994640700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc98c154230 0x7fc98c0715b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:04.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.882+0000 7fc994640700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc98c154610 0x7fc98c0c9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:04.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.882+0000 7fc994640700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc98c072ff0 0x7fc98c0c9670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:04.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.882+0000 7fc994640700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc98c071af0 con 0x7fc98c154610 2024-05-08T21:10:04.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.882+0000 7fc994640700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc98c15b050 con 0x7fc98c154230 2024-05-08T21:10:04.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.882+0000 7fc994640700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc98c15a440 con 0x7fc98c072ff0 2024-05-08T21:10:04.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.882+0000 7fc991bdb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc98c154610 0x7fc98c0c9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:04.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.882+0000 7fc991bdb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc98c154610 0x7fc98c0c9130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42786/0 (socket says 172.21.15.80:42786) 2024-05-08T21:10:04.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.882+0000 7fc991bdb700 1 -- 172.21.15.80:0/3801904504 learned_addr learned my addr 172.21.15.80:0/3801904504 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:04.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.882+0000 7fc9923dc700 1 --2- 172.21.15.80:0/3801904504 >> v2:172.21.15.106:3300/0 conn(0x7fc98c154230 0x7fc98c0715b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:04.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.882+0000 7fc992bdd700 1 --2- 172.21.15.80:0/3801904504 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc98c072ff0 0x7fc98c0c9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:04.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.882+0000 7fc991bdb700 1 -- 172.21.15.80:0/3801904504 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc98c072ff0 msgr2=0x7fc98c0c9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:04.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.882+0000 7fc991bdb700 1 --2- 172.21.15.80:0/3801904504 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc98c072ff0 0x7fc98c0c9670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:04.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.882+0000 7fc991bdb700 1 -- 172.21.15.80:0/3801904504 >> v2:172.21.15.106:3300/0 conn(0x7fc98c154230 msgr2=0x7fc98c0715b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:04.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.882+0000 7fc991bdb700 1 --2- 172.21.15.80:0/3801904504 >> v2:172.21.15.106:3300/0 conn(0x7fc98c154230 0x7fc98c0715b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:04.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.882+0000 7fc991bdb700 1 -- 172.21.15.80:0/3801904504 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc98c15a720 con 0x7fc98c154610 2024-05-08T21:10:04.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.882+0000 7fc991bdb700 1 --2- 172.21.15.80:0/3801904504 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc98c154610 0x7fc98c0c9130 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc98c0c8860 tx=0x7fc97c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d4f00f0a6536172 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:04.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.883+0000 7fc9913da700 1 -- 172.21.15.80:0/3801904504 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97c00b870 con 0x7fc98c154610 2024-05-08T21:10:04.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.883+0000 7fc9913da700 1 -- 172.21.15.80:0/3801904504 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc97c00b9d0 con 0x7fc98c154610 2024-05-08T21:10:04.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.883+0000 7fc9913da700 1 -- 172.21.15.80:0/3801904504 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97c00bd60 con 0x7fc98c154610 2024-05-08T21:10:04.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.883+0000 7fc994640700 1 -- 172.21.15.80:0/3801904504 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc98c154610 msgr2=0x7fc98c0c9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:04.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.883+0000 7fc994640700 1 --2- 172.21.15.80:0/3801904504 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc98c154610 0x7fc98c0c9130 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc98c0c8860 tx=0x7fc97c009bd0 comp rx=0 tx=0).stop 2024-05-08T21:10:04.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.883+0000 7fc994640700 1 -- 172.21.15.80:0/3801904504 shutdown_connections 2024-05-08T21:10:04.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.883+0000 7fc994640700 1 --2- 172.21.15.80:0/3801904504 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc98c072ff0 0x7fc98c0c9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:04.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.883+0000 7fc994640700 1 --2- 172.21.15.80:0/3801904504 >> v2:172.21.15.106:3300/0 conn(0x7fc98c154230 0x7fc98c0715b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:04.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.883+0000 7fc994640700 1 --2- 172.21.15.80:0/3801904504 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc98c154610 0x7fc98c0c9130 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:04.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.883+0000 7fc994640700 1 -- 172.21.15.80:0/3801904504 >> 172.21.15.80:0/3801904504 conn(0x7fc98c06ef80 msgr2=0x7fc98c06f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:04.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.883+0000 7fc994640700 1 -- 172.21.15.80:0/3801904504 shutdown_connections 2024-05-08T21:10:04.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.883+0000 7fc994640700 1 -- 172.21.15.80:0/3801904504 wait complete. 2024-05-08T21:10:04.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.885+0000 7fc994640700 1 Processor -- start 2024-05-08T21:10:04.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.885+0000 7fc994640700 1 -- start start 2024-05-08T21:10:04.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.885+0000 7fc994640700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc98c072ff0 0x7fc98c15d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:04.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.885+0000 7fc994640700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc98c154230 0x7fc98c06ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:04.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.885+0000 7fc994640700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc98c149df0 0x7fc98c143e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:04.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.885+0000 7fc994640700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc98c15ce80 con 0x7fc98c154230 2024-05-08T21:10:04.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.885+0000 7fc994640700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc98c1f2fb0 con 0x7fc98c149df0 2024-05-08T21:10:04.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.885+0000 7fc994640700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc98c153560 con 0x7fc98c072ff0 2024-05-08T21:10:04.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.885+0000 7fc991bdb700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc98c154230 0x7fc98c06ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:04.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.885+0000 7fc991bdb700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc98c154230 0x7fc98c06ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42800/0 (socket says 172.21.15.80:42800) 2024-05-08T21:10:04.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.885+0000 7fc991bdb700 1 -- 172.21.15.80:0/1309928176 learned_addr learned my addr 172.21.15.80:0/1309928176 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:04.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.885+0000 7fc9923dc700 1 --2- 172.21.15.80:0/1309928176 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc98c072ff0 0x7fc98c15d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:04.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.885+0000 7fc992bdd700 1 --2- 172.21.15.80:0/1309928176 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc98c149df0 0x7fc98c143e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:04.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.886+0000 7fc991bdb700 1 -- 172.21.15.80:0/1309928176 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc98c072ff0 msgr2=0x7fc98c15d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:04.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.886+0000 7fc991bdb700 1 --2- 172.21.15.80:0/1309928176 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc98c072ff0 0x7fc98c15d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:04.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.886+0000 7fc991bdb700 1 -- 172.21.15.80:0/1309928176 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc98c149df0 msgr2=0x7fc98c143e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:04.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.886+0000 7fc991bdb700 1 --2- 172.21.15.80:0/1309928176 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc98c149df0 0x7fc98c143e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:04.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.886+0000 7fc991bdb700 1 -- 172.21.15.80:0/1309928176 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc97c009550 con 0x7fc98c154230 2024-05-08T21:10:04.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.886+0000 7fc9923dc700 1 --2- 172.21.15.80:0/1309928176 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc98c072ff0 0x7fc98c15d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:10:04.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.886+0000 7fc992bdd700 1 --2- 172.21.15.80:0/1309928176 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc98c149df0 0x7fc98c143e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:10:04.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.886+0000 7fc991bdb700 1 --2- 172.21.15.80:0/1309928176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc98c154230 0x7fc98c06ac30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc97c000c00 tx=0x7fc97c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:04.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.886+0000 7fc982ffd700 1 -- 172.21.15.80:0/1309928176 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97c004520 con 0x7fc98c154230 2024-05-08T21:10:04.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.886+0000 7fc982ffd700 1 -- 172.21.15.80:0/1309928176 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc97c01e070 con 0x7fc98c154230 2024-05-08T21:10:04.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.886+0000 7fc994640700 1 -- 172.21.15.80:0/1309928176 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc98c153840 con 0x7fc98c154230 2024-05-08T21:10:04.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.886+0000 7fc982ffd700 1 -- 172.21.15.80:0/1309928176 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97c0038c0 con 0x7fc98c154230 2024-05-08T21:10:04.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.886+0000 7fc994640700 1 -- 172.21.15.80:0/1309928176 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc98c0cd230 con 0x7fc98c154230 2024-05-08T21:10:04.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.887+0000 7fc994640700 1 -- 172.21.15.80:0/1309928176 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc98c0ccdb0 con 0x7fc98c154230 2024-05-08T21:10:04.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.887+0000 7fc982ffd700 1 -- 172.21.15.80:0/1309928176 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc97c003a20 con 0x7fc98c154230 2024-05-08T21:10:04.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.888+0000 7fc982ffd700 1 --2- 172.21.15.80:0/1309928176 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fc97006ac90 0x7fc97006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:04.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.888+0000 7fc982ffd700 1 -- 172.21.15.80:0/1309928176 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7fc97c020070 con 0x7fc98c154230 2024-05-08T21:10:04.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.888+0000 7fc9923dc700 1 --2- 172.21.15.80:0/1309928176 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fc97006ac90 0x7fc97006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:04.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.888+0000 7fc9923dc700 1 --2- 172.21.15.80:0/1309928176 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fc97006ac90 0x7fc97006d150 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc9880099f0 tx=0x7fc988008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:04.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:04.892+0000 7fc982ffd700 1 -- 172.21.15.80:0/1309928176 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fc98c0ccdb0 con 0x7fc98c154230 2024-05-08T21:10:05.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:05.092+0000 7fc994640700 1 -- 172.21.15.80:0/1309928176 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fc98c0ccdb0 con 0x7fc98c154230 2024-05-08T21:10:06.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.741+0000 7fc982ffd700 1 -- 172.21.15.80:0/1309928176 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v24) v1 ==== 228+0+0 (secure 0 0 0) 0x7fc98c0ccdb0 con 0x7fc98c154230 2024-05-08T21:10:06.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.747+0000 7fc994640700 1 -- 172.21.15.80:0/1309928176 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fc97006ac90 msgr2=0x7fc97006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:06.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.747+0000 7fc994640700 1 --2- 172.21.15.80:0/1309928176 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fc97006ac90 0x7fc97006d150 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc9880099f0 tx=0x7fc988008040 comp rx=0 tx=0).stop 2024-05-08T21:10:06.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.747+0000 7fc994640700 1 -- 172.21.15.80:0/1309928176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc98c154230 msgr2=0x7fc98c06ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:06.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.747+0000 7fc994640700 1 --2- 172.21.15.80:0/1309928176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc98c154230 0x7fc98c06ac30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc97c000c00 tx=0x7fc97c004750 comp rx=0 tx=0).stop 2024-05-08T21:10:06.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.748+0000 7fc994640700 1 -- 172.21.15.80:0/1309928176 shutdown_connections 2024-05-08T21:10:06.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.748+0000 7fc994640700 1 --2- 172.21.15.80:0/1309928176 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fc97006ac90 0x7fc97006d150 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:06.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.748+0000 7fc994640700 1 --2- 172.21.15.80:0/1309928176 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc98c149df0 0x7fc98c143e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:06.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.748+0000 7fc994640700 1 --2- 172.21.15.80:0/1309928176 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc98c072ff0 0x7fc98c15d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:06.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.748+0000 7fc994640700 1 --2- 172.21.15.80:0/1309928176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc98c154230 0x7fc98c06ac30 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:06.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.748+0000 7fc994640700 1 -- 172.21.15.80:0/1309928176 >> 172.21.15.80:0/1309928176 conn(0x7fc98c06ef80 msgr2=0x7fc98c0c7870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:06.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.748+0000 7fc994640700 1 -- 172.21.15.80:0/1309928176 shutdown_connections 2024-05-08T21:10:06.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.748+0000 7fc994640700 1 -- 172.21.15.80:0/1309928176 wait complete. 2024-05-08T21:10:06.758 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data_ec' created 2024-05-08T21:10:06.768 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-05-08T21:10:06.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.895+0000 7f07ca989700 1 Processor -- start 2024-05-08T21:10:06.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.895+0000 7f07ca989700 1 -- start start 2024-05-08T21:10:06.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.896+0000 7f07ca989700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f07c40c1160 0x7f07c4066aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:06.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.896+0000 7f07ca989700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07c415a9b0 con 0x7f07c415ae40 2024-05-08T21:10:06.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.896+0000 7f07ca989700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07c415e560 con 0x7f07c40c8770 2024-05-08T21:10:06.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.896+0000 7f07ca989700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07c40c7100 con 0x7f07c40c1160 2024-05-08T21:10:06.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.896+0000 7f07c37fe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f07c415ae40 0x7f07c415d740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:51924/0 (socket says 172.21.15.80:51924) 2024-05-08T21:10:06.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.896+0000 7f07c37fe700 1 -- 172.21.15.80:0/2900057314 learned_addr learned my addr 172.21.15.80:0/2900057314 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:10:06.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.897+0000 7f07c3fff700 1 --2- 172.21.15.80:0/2900057314 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f07c40c1160 0x7f07c4066aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:06.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.897+0000 7f07c2ffd700 1 -- 172.21.15.80:0/2900057314 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3110369485 0 0) 0x7f07c415a9b0 con 0x7f07c415ae40 2024-05-08T21:10:06.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.897+0000 7f07c2ffd700 1 -- 172.21.15.80:0/2900057314 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07b00035b0 con 0x7f07c415ae40 2024-05-08T21:10:06.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.897+0000 7f07c2ffd700 1 -- 172.21.15.80:0/2900057314 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4033300247 0 0) 0x7f07b00035b0 con 0x7f07c415ae40 2024-05-08T21:10:06.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.897+0000 7f07c2ffd700 1 -- 172.21.15.80:0/2900057314 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f07c40c1160 msgr2=0x7f07c4066aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:06.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.897+0000 7f07c2ffd700 1 --2- 172.21.15.80:0/2900057314 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f07c40c1160 0x7f07c4066aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:06.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.897+0000 7f07c2ffd700 1 -- 172.21.15.80:0/2900057314 >> v1:172.21.15.106:6789/0 conn(0x7f07c40c8770 legacy=0x7f07c415de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:06.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.897+0000 7f07c2ffd700 1 -- 172.21.15.80:0/2900057314 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07c40c6b40 con 0x7f07c415ae40 2024-05-08T21:10:06.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.897+0000 7f07c2ffd700 1 -- 172.21.15.80:0/2900057314 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3520646302 0 0) 0x7f07b4001670 con 0x7f07c415ae40 2024-05-08T21:10:06.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.897+0000 7f07c2ffd700 1 -- 172.21.15.80:0/2900057314 >> v1:172.21.15.80:6789/0 conn(0x7f07c415ae40 legacy=0x7f07c415d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:06.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.897+0000 7f07c2ffd700 1 --2- 172.21.15.80:0/2900057314 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f07c40c1160 0x7f07b0003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:06.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.897+0000 7f07c2ffd700 1 --2- 172.21.15.80:0/2900057314 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07b0003fb0 0x7f07b0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:06.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.897+0000 7f07c2ffd700 1 --2- 172.21.15.80:0/2900057314 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f07b0004d90 0x7f07b0005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:06.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.897+0000 7f07c2ffd700 1 -- 172.21.15.80:0/2900057314 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c40c7100 con 0x7f07b0003fb0 2024-05-08T21:10:06.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.897+0000 7f07c2ffd700 1 -- 172.21.15.80:0/2900057314 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b000baf0 con 0x7f07b0004d90 2024-05-08T21:10:06.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.897+0000 7f07c2ffd700 1 -- 172.21.15.80:0/2900057314 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07b000bcb0 con 0x7f07c40c1160 2024-05-08T21:10:06.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.897+0000 7f07c37fe700 1 --2- 172.21.15.80:0/2900057314 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07b0003fb0 0x7f07b0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:06.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.897+0000 7f07c3fff700 1 --2- 172.21.15.80:0/2900057314 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f07c40c1160 0x7f07b0003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:06.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.897+0000 7f07c8f26700 1 --2- 172.21.15.80:0/2900057314 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f07b0004d90 0x7f07b0005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:06.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.897+0000 7f07c37fe700 1 -- 172.21.15.80:0/2900057314 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f07c40c1160 msgr2=0x7f07b0003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:06.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.897+0000 7f07c37fe700 1 --2- 172.21.15.80:0/2900057314 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f07c40c1160 0x7f07b0003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:06.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.897+0000 7f07c37fe700 1 -- 172.21.15.80:0/2900057314 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f07b0004d90 msgr2=0x7f07b0005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:06.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.897+0000 7f07c37fe700 1 --2- 172.21.15.80:0/2900057314 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f07b0004d90 0x7f07b0005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:06.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.897+0000 7f07c37fe700 1 -- 172.21.15.80:0/2900057314 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b00035b0 con 0x7f07b0003fb0 2024-05-08T21:10:06.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.897+0000 7f07c8f26700 1 --2- 172.21.15.80:0/2900057314 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f07b0004d90 0x7f07b0005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:10:06.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.897+0000 7f07c37fe700 1 --2- 172.21.15.80:0/2900057314 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07b0003fb0 0x7f07b0004850 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f07b400c240 tx=0x7f07b0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5f6f237f7577407 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:06.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.898+0000 7f07c2ffd700 1 -- 172.21.15.80:0/2900057314 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b4007c10 con 0x7f07b0003fb0 2024-05-08T21:10:06.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.898+0000 7f07c2ffd700 1 -- 172.21.15.80:0/2900057314 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07b400cde0 con 0x7f07b0003fb0 2024-05-08T21:10:06.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.898+0000 7f07c2ffd700 1 -- 172.21.15.80:0/2900057314 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b4005ba0 con 0x7f07b0003fb0 2024-05-08T21:10:06.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.898+0000 7f07ca989700 1 -- 172.21.15.80:0/2900057314 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07b0003fb0 msgr2=0x7f07b0004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:06.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.898+0000 7f07ca989700 1 --2- 172.21.15.80:0/2900057314 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07b0003fb0 0x7f07b0004850 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f07b400c240 tx=0x7f07b0005880 comp rx=0 tx=0).stop 2024-05-08T21:10:06.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.898+0000 7f07c8f26700 1 -- 172.21.15.80:0/2900057314 reap_dead start 2024-05-08T21:10:06.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.898+0000 7f07ca989700 1 -- 172.21.15.80:0/2900057314 shutdown_connections 2024-05-08T21:10:06.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.898+0000 7f07ca989700 1 -- 172.21.15.80:0/2900057314 >> 172.21.15.80:0/2900057314 conn(0x7f07c40cc140 msgr2=0x7f07c40cc550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:06.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.898+0000 7f07ca989700 1 -- 172.21.15.80:0/2900057314 shutdown_connections 2024-05-08T21:10:06.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.898+0000 7f07ca989700 1 -- 172.21.15.80:0/2900057314 wait complete. 2024-05-08T21:10:06.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.900+0000 7f07ca989700 1 Processor -- start 2024-05-08T21:10:06.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.900+0000 7f07ca989700 1 -- start start 2024-05-08T21:10:06.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.901+0000 7f07ca989700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07b0003fb0 0x7f07c415d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:06.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.901+0000 7f07ca989700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f07c415c780 0x7f07c415cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:06.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.901+0000 7f07ca989700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f07c40c44e0 0x7f07c40c4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:06.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.901+0000 7f07ca989700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c4152010 con 0x7f07b0003fb0 2024-05-08T21:10:06.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.901+0000 7f07ca989700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c415e380 con 0x7f07c415c780 2024-05-08T21:10:06.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.901+0000 7f07ca989700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07c40c4ea0 con 0x7f07c40c44e0 2024-05-08T21:10:06.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.901+0000 7f07c3fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07b0003fb0 0x7f07c415d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:06.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.901+0000 7f07c3fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07b0003fb0 0x7f07c415d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42820/0 (socket says 172.21.15.80:42820) 2024-05-08T21:10:06.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.901+0000 7f07c3fff700 1 -- 172.21.15.80:0/2280131096 learned_addr learned my addr 172.21.15.80:0/2280131096 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:06.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.901+0000 7f07c37fe700 1 --2- 172.21.15.80:0/2280131096 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f07c415c780 0x7f07c415cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:06.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.901+0000 7f07c8f26700 1 --2- 172.21.15.80:0/2280131096 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f07c40c44e0 0x7f07c40c4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:06.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.901+0000 7f07c3fff700 1 -- 172.21.15.80:0/2280131096 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f07c40c44e0 msgr2=0x7f07c40c4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:06.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.901+0000 7f07c3fff700 1 --2- 172.21.15.80:0/2280131096 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f07c40c44e0 0x7f07c40c4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:06.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.901+0000 7f07c3fff700 1 -- 172.21.15.80:0/2280131096 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f07c415c780 msgr2=0x7f07c415cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:06.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.901+0000 7f07c3fff700 1 --2- 172.21.15.80:0/2280131096 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f07c415c780 0x7f07c415cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:06.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.901+0000 7f07c3fff700 1 -- 172.21.15.80:0/2280131096 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07c40c3eb0 con 0x7f07b0003fb0 2024-05-08T21:10:06.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.901+0000 7f07c3fff700 1 --2- 172.21.15.80:0/2280131096 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07b0003fb0 0x7f07c415d4e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f07ac011aa0 tx=0x7f07ac011db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:06.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.901+0000 7f07c0ff9700 1 -- 172.21.15.80:0/2280131096 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ac011ed0 con 0x7f07b0003fb0 2024-05-08T21:10:06.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.901+0000 7f07c0ff9700 1 -- 172.21.15.80:0/2280131096 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07ac00f940 con 0x7f07b0003fb0 2024-05-08T21:10:06.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.901+0000 7f07ca989700 1 -- 172.21.15.80:0/2280131096 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07c4152260 con 0x7f07b0003fb0 2024-05-08T21:10:06.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.901+0000 7f07c0ff9700 1 -- 172.21.15.80:0/2280131096 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ac00fcf0 con 0x7f07b0003fb0 2024-05-08T21:10:06.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.901+0000 7f07ca989700 1 -- 172.21.15.80:0/2280131096 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07c415dd30 con 0x7f07b0003fb0 2024-05-08T21:10:06.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.902+0000 7f07ca989700 1 -- 172.21.15.80:0/2280131096 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07c40c4330 con 0x7f07b0003fb0 2024-05-08T21:10:06.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.903+0000 7f07c0ff9700 1 -- 172.21.15.80:0/2280131096 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f07ac01d400 con 0x7f07b0003fb0 2024-05-08T21:10:06.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.903+0000 7f07c0ff9700 1 --2- 172.21.15.80:0/2280131096 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f07a406ac90 0x7f07a406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:06.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.903+0000 7f07c0ff9700 1 -- 172.21.15.80:0/2280131096 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f07ac089be0 con 0x7f07b0003fb0 2024-05-08T21:10:06.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.903+0000 7f07c37fe700 1 --2- 172.21.15.80:0/2280131096 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f07a406ac90 0x7f07a406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:06.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.904+0000 7f07c37fe700 1 --2- 172.21.15.80:0/2280131096 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f07a406ac90 0x7f07a406d150 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f07b4000c00 tx=0x7f07b4007000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:06.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:06.908+0000 7f07c0ff9700 1 -- 172.21.15.80:0/2280131096 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f07ac054c40 con 0x7f07b0003fb0 2024-05-08T21:10:07.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.105+0000 7f07ca989700 1 -- 172.21.15.80:0/2280131096 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f07c415a310 con 0x7f07b0003fb0 2024-05-08T21:10:07.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.744+0000 7f07c0ff9700 1 -- 172.21.15.80:0/2280131096 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7f07ac058260 con 0x7f07b0003fb0 2024-05-08T21:10:07.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.748+0000 7f07ca989700 1 -- 172.21.15.80:0/2280131096 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f07a406ac90 msgr2=0x7f07a406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:07.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.748+0000 7f07ca989700 1 --2- 172.21.15.80:0/2280131096 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f07a406ac90 0x7f07a406d150 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f07b4000c00 tx=0x7f07b4007000 comp rx=0 tx=0).stop 2024-05-08T21:10:07.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.748+0000 7f07ca989700 1 -- 172.21.15.80:0/2280131096 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07b0003fb0 msgr2=0x7f07c415d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:07.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.748+0000 7f07ca989700 1 --2- 172.21.15.80:0/2280131096 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07b0003fb0 0x7f07c415d4e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f07ac011aa0 tx=0x7f07ac011db0 comp rx=0 tx=0).stop 2024-05-08T21:10:07.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.748+0000 7f07ca989700 1 -- 172.21.15.80:0/2280131096 shutdown_connections 2024-05-08T21:10:07.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.748+0000 7f07ca989700 1 --2- 172.21.15.80:0/2280131096 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f07a406ac90 0x7f07a406d150 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:07.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.748+0000 7f07ca989700 1 --2- 172.21.15.80:0/2280131096 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07b0003fb0 0x7f07c415d4e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:07.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.748+0000 7f07ca989700 1 --2- 172.21.15.80:0/2280131096 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f07c40c44e0 0x7f07c40c4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:07.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.748+0000 7f07ca989700 1 --2- 172.21.15.80:0/2280131096 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f07c415c780 0x7f07c415cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:07.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.748+0000 7f07ca989700 1 -- 172.21.15.80:0/2280131096 >> 172.21.15.80:0/2280131096 conn(0x7f07c40cc140 msgr2=0x7f07c406b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:07.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.749+0000 7f07ca989700 1 -- 172.21.15.80:0/2280131096 shutdown_connections 2024-05-08T21:10:07.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.750+0000 7f07ca989700 1 -- 172.21.15.80:0/2280131096 wait complete. 2024-05-08T21:10:07.754 INFO:teuthology.orchestra.run.smithi080.stderr:set pool 4 allow_ec_overwrites to true 2024-05-08T21:10:07.777 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-05-08T21:10:07.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.903+0000 7fc65154a700 1 Processor -- start 2024-05-08T21:10:07.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.903+0000 7fc65154a700 1 -- start start 2024-05-08T21:10:07.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.904+0000 7fc65154a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc64c154580 0x7fc64c15abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:07.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.904+0000 7fc65154a700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc64c0cbe40 0x7fc64c0c48c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:07.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.904+0000 7fc65154a700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc64c0cad60 con 0x7fc64c0c4e00 2024-05-08T21:10:07.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.904+0000 7fc65154a700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc64c0b2c60 con 0x7fc64c154580 2024-05-08T21:10:07.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.904+0000 7fc65154a700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc64c15d750 con 0x7fc64c0cbe40 2024-05-08T21:10:07.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.904+0000 7fc64affd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc64c154580 0x7fc64c15abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:07.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.904+0000 7fc64affd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc64c154580 0x7fc64c15abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42828/0 (socket says 172.21.15.80:42828) 2024-05-08T21:10:07.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.904+0000 7fc64b7fe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc64c0c4e00 0x7fc64c0cc3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:51926/0 (socket says 172.21.15.80:51926) 2024-05-08T21:10:07.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.904+0000 7fc64affd700 1 -- 172.21.15.80:0/2721726333 learned_addr learned my addr 172.21.15.80:0/2721726333 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:07.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.904+0000 7fc64a7fc700 1 --2- 172.21.15.80:0/2721726333 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc64c0cbe40 0x7fc64c0c48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:07.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.904+0000 7fc64affd700 1 -- 172.21.15.80:0/2721726333 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc64c0cbe40 msgr2=0x7fc64c0c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:07.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.904+0000 7fc64affd700 1 --2- 172.21.15.80:0/2721726333 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc64c0cbe40 0x7fc64c0c48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:07.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.904+0000 7fc64affd700 1 -- 172.21.15.80:0/2721726333 >> v1:172.21.15.80:6789/0 conn(0x7fc64c0c4e00 legacy=0x7fc64c0cc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:07.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.904+0000 7fc64affd700 1 -- 172.21.15.80:0/2721726333 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc64c15d930 con 0x7fc64c154580 2024-05-08T21:10:07.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.904+0000 7fc649ffb700 1 -- 172.21.15.80:0/2721726333 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4217177300 0 0) 0x7fc64c0cad60 con 0x7fc64c0c4e00 2024-05-08T21:10:07.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.904+0000 7fc64affd700 1 --2- 172.21.15.80:0/2721726333 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc64c154580 0x7fc64c15abe0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc63c0098f0 tx=0x7fc63c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63788e7071be2aa6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:07.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.904+0000 7fc649ffb700 1 -- 172.21.15.80:0/2721726333 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63c00b8a0 con 0x7fc64c154580 2024-05-08T21:10:07.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.904+0000 7fc649ffb700 1 -- 172.21.15.80:0/2721726333 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc63c00ba00 con 0x7fc64c154580 2024-05-08T21:10:07.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.904+0000 7fc649ffb700 1 -- 172.21.15.80:0/2721726333 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63c00bd90 con 0x7fc64c154580 2024-05-08T21:10:07.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.905+0000 7fc65154a700 1 -- 172.21.15.80:0/2721726333 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc64c154580 msgr2=0x7fc64c15abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:07.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.905+0000 7fc65154a700 1 --2- 172.21.15.80:0/2721726333 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc64c154580 0x7fc64c15abe0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc63c0098f0 tx=0x7fc63c009c00 comp rx=0 tx=0).stop 2024-05-08T21:10:07.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.905+0000 7fc65154a700 1 -- 172.21.15.80:0/2721726333 shutdown_connections 2024-05-08T21:10:07.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.905+0000 7fc65154a700 1 --2- 172.21.15.80:0/2721726333 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc64c154580 0x7fc64c15abe0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:07.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.905+0000 7fc65154a700 1 --2- 172.21.15.80:0/2721726333 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc64c0cbe40 0x7fc64c0c48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:07.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.905+0000 7fc65154a700 1 -- 172.21.15.80:0/2721726333 >> 172.21.15.80:0/2721726333 conn(0x7fc64c06c6a0 msgr2=0x7fc64c06cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:07.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.905+0000 7fc65154a700 1 -- 172.21.15.80:0/2721726333 shutdown_connections 2024-05-08T21:10:07.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.905+0000 7fc65154a700 1 -- 172.21.15.80:0/2721726333 wait complete. 2024-05-08T21:10:07.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.907+0000 7fc65154a700 1 Processor -- start 2024-05-08T21:10:07.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.907+0000 7fc65154a700 1 -- start start 2024-05-08T21:10:07.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.907+0000 7fc65154a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc64c0c4e00 0x7fc64c154ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:07.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.908+0000 7fc65154a700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc64c0cbe40 0x7fc64c155220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:07.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.908+0000 7fc65154a700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc64c154580 0x7fc64c15b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:07.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.908+0000 7fc65154a700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc64c15b550 con 0x7fc64c0c4e00 2024-05-08T21:10:07.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.908+0000 7fc65154a700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc64c1f0240 con 0x7fc64c0cbe40 2024-05-08T21:10:07.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.908+0000 7fc65154a700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc64c1f0520 con 0x7fc64c154580 2024-05-08T21:10:07.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.908+0000 7fc64affd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc64c0c4e00 0x7fc64c154ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:07.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.908+0000 7fc64affd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc64c0c4e00 0x7fc64c154ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42838/0 (socket says 172.21.15.80:42838) 2024-05-08T21:10:07.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.908+0000 7fc64affd700 1 -- 172.21.15.80:0/770579989 learned_addr learned my addr 172.21.15.80:0/770579989 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:07.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.908+0000 7fc64b7fe700 1 --2- 172.21.15.80:0/770579989 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc64c154580 0x7fc64c15b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:07.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.908+0000 7fc64a7fc700 1 --2- 172.21.15.80:0/770579989 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc64c0cbe40 0x7fc64c155220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:07.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.908+0000 7fc64affd700 1 -- 172.21.15.80:0/770579989 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc64c154580 msgr2=0x7fc64c15b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:07.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.908+0000 7fc64affd700 1 --2- 172.21.15.80:0/770579989 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc64c154580 0x7fc64c15b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:07.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.908+0000 7fc64affd700 1 -- 172.21.15.80:0/770579989 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc64c0cbe40 msgr2=0x7fc64c155220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:07.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.908+0000 7fc64affd700 1 --2- 172.21.15.80:0/770579989 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc64c0cbe40 0x7fc64c155220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:07.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.908+0000 7fc64affd700 1 -- 172.21.15.80:0/770579989 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc63c009550 con 0x7fc64c0c4e00 2024-05-08T21:10:07.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.908+0000 7fc64a7fc700 1 --2- 172.21.15.80:0/770579989 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc64c0cbe40 0x7fc64c155220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:10:07.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.908+0000 7fc64affd700 1 --2- 172.21.15.80:0/770579989 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc64c0c4e00 0x7fc64c154ce0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc63c009c40 tx=0x7fc63c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:07.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.908+0000 7fc6337fe700 1 -- 172.21.15.80:0/770579989 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63c004590 con 0x7fc64c0c4e00 2024-05-08T21:10:07.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.908+0000 7fc6337fe700 1 -- 172.21.15.80:0/770579989 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc63c01e070 con 0x7fc64c0c4e00 2024-05-08T21:10:07.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.908+0000 7fc65154a700 1 -- 172.21.15.80:0/770579989 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc64c1f0800 con 0x7fc64c0c4e00 2024-05-08T21:10:07.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.908+0000 7fc6337fe700 1 -- 172.21.15.80:0/770579989 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63c0038e0 con 0x7fc64c0c4e00 2024-05-08T21:10:07.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.908+0000 7fc65154a700 1 -- 172.21.15.80:0/770579989 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc64c14e4c0 con 0x7fc64c0c4e00 2024-05-08T21:10:07.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.909+0000 7fc65154a700 1 -- 172.21.15.80:0/770579989 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc64c1f0d20 con 0x7fc64c0c4e00 2024-05-08T21:10:07.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.910+0000 7fc6337fe700 1 -- 172.21.15.80:0/770579989 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc63c003a40 con 0x7fc64c0c4e00 2024-05-08T21:10:07.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.910+0000 7fc6337fe700 1 --2- 172.21.15.80:0/770579989 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fc63806ac90 0x7fc63806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:07.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.910+0000 7fc6337fe700 1 -- 172.21.15.80:0/770579989 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6428+0+0 (secure 0 0 0) 0x7fc63c020070 con 0x7fc64c0c4e00 2024-05-08T21:10:07.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.910+0000 7fc64a7fc700 1 --2- 172.21.15.80:0/770579989 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fc63806ac90 0x7fc63806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:07.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.910+0000 7fc64a7fc700 1 --2- 172.21.15.80:0/770579989 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fc63806ac90 0x7fc63806d150 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc64c0cba10 tx=0x7fc640008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:07.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:07.915+0000 7fc6337fe700 1 -- 172.21.15.80:0/770579989 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fc64c1f0d20 con 0x7fc64c0c4e00 2024-05-08T21:10:08.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.163+0000 7fc65154a700 1 -- 172.21.15.80:0/770579989 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7fc64c1f0d20 con 0x7fc64c0c4e00 2024-05-08T21:10:08.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.167+0000 7fc6337fe700 1 -- 172.21.15.80:0/770579989 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v5) v1 ==== 137+0+0 (secure 0 0 0) 0x7fc64c1f0d20 con 0x7fc64c0c4e00 2024-05-08T21:10:08.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.169+0000 7fc65154a700 1 -- 172.21.15.80:0/770579989 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fc63806ac90 msgr2=0x7fc63806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:08.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.169+0000 7fc65154a700 1 --2- 172.21.15.80:0/770579989 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fc63806ac90 0x7fc63806d150 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc64c0cba10 tx=0x7fc640008040 comp rx=0 tx=0).stop 2024-05-08T21:10:08.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.169+0000 7fc65154a700 1 -- 172.21.15.80:0/770579989 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc64c0c4e00 msgr2=0x7fc64c154ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:08.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.169+0000 7fc65154a700 1 --2- 172.21.15.80:0/770579989 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc64c0c4e00 0x7fc64c154ce0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc63c009c40 tx=0x7fc63c004750 comp rx=0 tx=0).stop 2024-05-08T21:10:08.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.169+0000 7fc65154a700 1 -- 172.21.15.80:0/770579989 shutdown_connections 2024-05-08T21:10:08.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.169+0000 7fc65154a700 1 --2- 172.21.15.80:0/770579989 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fc63806ac90 0x7fc63806d150 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:08.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.169+0000 7fc65154a700 1 --2- 172.21.15.80:0/770579989 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc64c0c4e00 0x7fc64c154ce0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:08.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.169+0000 7fc65154a700 1 --2- 172.21.15.80:0/770579989 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc64c154580 0x7fc64c15b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:08.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.169+0000 7fc65154a700 1 --2- 172.21.15.80:0/770579989 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc64c0cbe40 0x7fc64c155220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:08.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.169+0000 7fc65154a700 1 -- 172.21.15.80:0/770579989 >> 172.21.15.80:0/770579989 conn(0x7fc64c06c6a0 msgr2=0x7fc64c153730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:08.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.169+0000 7fc65154a700 1 -- 172.21.15.80:0/770579989 shutdown_connections 2024-05-08T21:10:08.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.169+0000 7fc65154a700 1 -- 172.21.15.80:0/770579989 wait complete. 2024-05-08T21:10:08.173 INFO:teuthology.orchestra.run.smithi080.stderr:added data pool 4 to fsmap 2024-05-08T21:10:08.183 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:10:08.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.303+0000 7f48c496d700 1 Processor -- start 2024-05-08T21:10:08.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.303+0000 7f48c496d700 1 -- start start 2024-05-08T21:10:08.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.304+0000 7f48c496d700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f48c006bad0 0x7f48c015d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:08.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.304+0000 7f48c496d700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48c00724c0 con 0x7f48c01544f0 2024-05-08T21:10:08.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.304+0000 7f48c496d700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48c006d300 con 0x7f48c00b3150 2024-05-08T21:10:08.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.304+0000 7f48c496d700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48c00ca4c0 con 0x7f48c006bad0 2024-05-08T21:10:08.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.304+0000 7f48be59c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f48c01544f0 0x7f48c0070210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:51940/0 (socket says 172.21.15.80:51940) 2024-05-08T21:10:08.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.304+0000 7f48be59c700 1 -- 172.21.15.80:0/149228122 learned_addr learned my addr 172.21.15.80:0/149228122 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:10:08.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.304+0000 7f48bdd9b700 1 --2- 172.21.15.80:0/149228122 >> v2:172.21.15.106:3300/0 conn(0x7f48c006bad0 0x7f48c015d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:08.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.304+0000 7f48bd59a700 1 -- 172.21.15.80:0/149228122 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2314890693 0 0) 0x7f48c00724c0 con 0x7f48c01544f0 2024-05-08T21:10:08.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.305+0000 7f48bd59a700 1 -- 172.21.15.80:0/149228122 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48a80035b0 con 0x7f48c01544f0 2024-05-08T21:10:08.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.305+0000 7f48bd59a700 1 -- 172.21.15.80:0/149228122 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3342650204 0 0) 0x7f48a80035b0 con 0x7f48c01544f0 2024-05-08T21:10:08.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.305+0000 7f48bd59a700 1 -- 172.21.15.80:0/149228122 >> v2:172.21.15.106:3300/0 conn(0x7f48c006bad0 msgr2=0x7f48c015d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:08.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.305+0000 7f48bd59a700 1 --2- 172.21.15.80:0/149228122 >> v2:172.21.15.106:3300/0 conn(0x7f48c006bad0 0x7f48c015d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:08.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.305+0000 7f48bd59a700 1 -- 172.21.15.80:0/149228122 >> v1:172.21.15.106:6789/0 conn(0x7f48c00b3150 legacy=0x7f48c0164a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:08.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.305+0000 7f48bd59a700 1 -- 172.21.15.80:0/149228122 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48c00cb5a0 con 0x7f48c01544f0 2024-05-08T21:10:08.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.305+0000 7f48bd59a700 1 -- 172.21.15.80:0/149228122 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3520646302 0 0) 0x7f48b0001670 con 0x7f48c01544f0 2024-05-08T21:10:08.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.305+0000 7f48bd59a700 1 -- 172.21.15.80:0/149228122 >> v1:172.21.15.80:6789/0 conn(0x7f48c01544f0 legacy=0x7f48c0070210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:08.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.305+0000 7f48bd59a700 1 --2- 172.21.15.80:0/149228122 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f48a8003a00 0x7f48a8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:08.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.305+0000 7f48bd59a700 1 --2- 172.21.15.80:0/149228122 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f48a8004850 0x7f48a8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:08.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.305+0000 7f48bd59a700 1 --2- 172.21.15.80:0/149228122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48a8005210 0x7f48a800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:08.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.305+0000 7f48bd59a700 1 -- 172.21.15.80:0/149228122 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a800c180 con 0x7f48a8005210 2024-05-08T21:10:08.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.305+0000 7f48bd59a700 1 -- 172.21.15.80:0/149228122 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a800c2f0 con 0x7f48a8003a00 2024-05-08T21:10:08.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.305+0000 7f48bd59a700 1 -- 172.21.15.80:0/149228122 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48a800c4b0 con 0x7f48a8004850 2024-05-08T21:10:08.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.305+0000 7f48bed9d700 1 --2- 172.21.15.80:0/149228122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48a8005210 0x7f48a800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:08.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.305+0000 7f48be59c700 1 --2- 172.21.15.80:0/149228122 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f48a8003a00 0x7f48a8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:08.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.305+0000 7f48bdd9b700 1 --2- 172.21.15.80:0/149228122 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f48a8004850 0x7f48a8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:08.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.305+0000 7f48bed9d700 1 -- 172.21.15.80:0/149228122 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f48a8004850 msgr2=0x7f48a8004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:08.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.305+0000 7f48bed9d700 1 --2- 172.21.15.80:0/149228122 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f48a8004850 0x7f48a8004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:08.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.305+0000 7f48bed9d700 1 -- 172.21.15.80:0/149228122 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f48a8003a00 msgr2=0x7f48a8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:08.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.305+0000 7f48bed9d700 1 --2- 172.21.15.80:0/149228122 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f48a8003a00 0x7f48a8003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:08.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.305+0000 7f48bed9d700 1 -- 172.21.15.80:0/149228122 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a80035b0 con 0x7f48a8005210 2024-05-08T21:10:08.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.305+0000 7f48bdd9b700 1 --2- 172.21.15.80:0/149228122 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f48a8004850 0x7f48a8004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:10:08.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.305+0000 7f48bed9d700 1 -- 172.21.15.80:0/149228122 reap_dead start 2024-05-08T21:10:08.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.305+0000 7f48bed9d700 1 --2- 172.21.15.80:0/149228122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48a8005210 0x7f48a800ba10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f48b800c190 tx=0x7f48a8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4e91eb2761bf40a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:08.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.305+0000 7f48bd59a700 1 -- 172.21.15.80:0/149228122 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b8001db0 con 0x7f48a8005210 2024-05-08T21:10:08.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.305+0000 7f48bd59a700 1 -- 172.21.15.80:0/149228122 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48b800ccf0 con 0x7f48a8005210 2024-05-08T21:10:08.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.305+0000 7f48bd59a700 1 -- 172.21.15.80:0/149228122 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b8003c40 con 0x7f48a8005210 2024-05-08T21:10:08.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.306+0000 7f48c496d700 1 -- 172.21.15.80:0/149228122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48a8005210 msgr2=0x7f48a800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:08.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.306+0000 7f48c496d700 1 --2- 172.21.15.80:0/149228122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48a8005210 0x7f48a800ba10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f48b800c190 tx=0x7f48a8005880 comp rx=0 tx=0).stop 2024-05-08T21:10:08.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.306+0000 7f48c496d700 1 -- 172.21.15.80:0/149228122 shutdown_connections 2024-05-08T21:10:08.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.306+0000 7f48c496d700 1 --2- 172.21.15.80:0/149228122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48a8005210 0x7f48a800ba10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:08.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.306+0000 7f48c496d700 1 -- 172.21.15.80:0/149228122 >> 172.21.15.80:0/149228122 conn(0x7f48c006a9c0 msgr2=0x7f48c006add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:08.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.306+0000 7f48c496d700 1 -- 172.21.15.80:0/149228122 shutdown_connections 2024-05-08T21:10:08.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.306+0000 7f48c496d700 1 -- 172.21.15.80:0/149228122 wait complete. 2024-05-08T21:10:08.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.307+0000 7f48c496d700 1 Processor -- start 2024-05-08T21:10:08.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.307+0000 7f48c496d700 1 -- start start 2024-05-08T21:10:08.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.308+0000 7f48c496d700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f48a8005210 0x7f48c01568c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:08.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.308+0000 7f48c496d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f48c014c640 0x7f48c014d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:08.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.308+0000 7f48c496d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48c014cac0 0x7f48c014de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:08.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.308+0000 7f48c496d700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c014a5a0 con 0x7f48c014cac0 2024-05-08T21:10:08.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.308+0000 7f48c496d700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c014b620 con 0x7f48c014c640 2024-05-08T21:10:08.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.308+0000 7f48c496d700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48c014b900 con 0x7f48a8005210 2024-05-08T21:10:08.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.308+0000 7f48bed9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48c014cac0 0x7f48c014de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:08.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.308+0000 7f48bed9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48c014cac0 0x7f48c014de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42846/0 (socket says 172.21.15.80:42846) 2024-05-08T21:10:08.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.308+0000 7f48bed9d700 1 -- 172.21.15.80:0/3063048518 learned_addr learned my addr 172.21.15.80:0/3063048518 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:08.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.308+0000 7f48be59c700 1 --2- 172.21.15.80:0/3063048518 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f48a8005210 0x7f48c01568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:08.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.308+0000 7f48bdd9b700 1 --2- 172.21.15.80:0/3063048518 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f48c014c640 0x7f48c014d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:08.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.308+0000 7f48bed9d700 1 -- 172.21.15.80:0/3063048518 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f48a8005210 msgr2=0x7f48c01568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:08.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.308+0000 7f48bed9d700 1 --2- 172.21.15.80:0/3063048518 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f48a8005210 0x7f48c01568c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:08.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.308+0000 7f48bed9d700 1 -- 172.21.15.80:0/3063048518 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f48c014c640 msgr2=0x7f48c014d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:08.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.308+0000 7f48bed9d700 1 --2- 172.21.15.80:0/3063048518 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f48c014c640 0x7f48c014d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:08.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.308+0000 7f48bed9d700 1 -- 172.21.15.80:0/3063048518 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48c014bbe0 con 0x7f48c014cac0 2024-05-08T21:10:08.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.308+0000 7f48be59c700 1 --2- 172.21.15.80:0/3063048518 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f48a8005210 0x7f48c01568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:10:08.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.308+0000 7f48bdd9b700 1 --2- 172.21.15.80:0/3063048518 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f48c014c640 0x7f48c014d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:10:08.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.309+0000 7f48bed9d700 1 --2- 172.21.15.80:0/3063048518 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48c014cac0 0x7f48c014de20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f48b8005040 tx=0x7f48b80014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:08.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.309+0000 7f48aeffd700 1 -- 172.21.15.80:0/3063048518 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b80052d0 con 0x7f48c014cac0 2024-05-08T21:10:08.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.309+0000 7f48aeffd700 1 -- 172.21.15.80:0/3063048518 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48b8005430 con 0x7f48c014cac0 2024-05-08T21:10:08.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.309+0000 7f48c496d700 1 -- 172.21.15.80:0/3063048518 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48c014bec0 con 0x7f48c014cac0 2024-05-08T21:10:08.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.309+0000 7f48aeffd700 1 -- 172.21.15.80:0/3063048518 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b80057a0 con 0x7f48c014cac0 2024-05-08T21:10:08.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.309+0000 7f48c496d700 1 -- 172.21.15.80:0/3063048518 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48c014c1a0 con 0x7f48c014cac0 2024-05-08T21:10:08.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.310+0000 7f48c496d700 1 -- 172.21.15.80:0/3063048518 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48c014d600 con 0x7f48c014cac0 2024-05-08T21:10:08.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.310+0000 7f48aeffd700 1 -- 172.21.15.80:0/3063048518 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f48b801d480 con 0x7f48c014cac0 2024-05-08T21:10:08.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.311+0000 7f48aeffd700 1 --2- 172.21.15.80:0/3063048518 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f48a006ac90 0x7f48a006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:08.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.311+0000 7f48aeffd700 1 -- 172.21.15.80:0/3063048518 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f48b808a1b0 con 0x7f48c014cac0 2024-05-08T21:10:08.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.311+0000 7f48be59c700 1 --2- 172.21.15.80:0/3063048518 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f48a006ac90 0x7f48a006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:08.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.311+0000 7f48be59c700 1 --2- 172.21.15.80:0/3063048518 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f48a006ac90 0x7f48a006d150 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f48b0000c00 tx=0x7f48b0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:08.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.315+0000 7f48aeffd700 1 -- 172.21.15.80:0/3063048518 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f48c014d600 con 0x7f48c014cac0 2024-05-08T21:10:08.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.556+0000 7f48c496d700 1 -- 172.21.15.80:0/3063048518 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f48c014d600 con 0x7f48c014cac0 2024-05-08T21:10:08.559 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.556+0000 7f48aeffd700 1 -- 172.21.15.80:0/3063048518 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+6253 (secure 0 0 0) 0x7f48c014d600 con 0x7f48c014cac0 2024-05-08T21:10:08.559 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:10:08.559 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/2289230272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":2289230272},{"type":"v1","addr":"172.21.15.106:6833","nonce":2289230272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:10:08.163962+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:creating","state_seq":1,"addr":"172.21.15.106:6836/1949999190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1949999190},{"type":"v1","addr":"172.21.15.106:6836","nonce":1949999190}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:10:08.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.558+0000 7f48c496d700 1 -- 172.21.15.80:0/3063048518 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f48a006ac90 msgr2=0x7f48a006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:08.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.558+0000 7f48c496d700 1 --2- 172.21.15.80:0/3063048518 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f48a006ac90 0x7f48a006d150 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f48b0000c00 tx=0x7f48b0009040 comp rx=0 tx=0).stop 2024-05-08T21:10:08.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.558+0000 7f48c496d700 1 -- 172.21.15.80:0/3063048518 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48c014cac0 msgr2=0x7f48c014de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:08.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.558+0000 7f48c496d700 1 --2- 172.21.15.80:0/3063048518 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48c014cac0 0x7f48c014de20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f48b8005040 tx=0x7f48b80014a0 comp rx=0 tx=0).stop 2024-05-08T21:10:08.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.558+0000 7f48c496d700 1 -- 172.21.15.80:0/3063048518 shutdown_connections 2024-05-08T21:10:08.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.558+0000 7f48c496d700 1 --2- 172.21.15.80:0/3063048518 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f48a006ac90 0x7f48a006d150 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:08.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.558+0000 7f48c496d700 1 --2- 172.21.15.80:0/3063048518 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48c014cac0 0x7f48c014de20 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:08.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.558+0000 7f48c496d700 1 --2- 172.21.15.80:0/3063048518 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f48a8005210 0x7f48c01568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:08.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.558+0000 7f48c496d700 1 --2- 172.21.15.80:0/3063048518 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f48c014c640 0x7f48c014d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:08.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.558+0000 7f48c496d700 1 -- 172.21.15.80:0/3063048518 >> 172.21.15.80:0/3063048518 conn(0x7f48c006a9c0 msgr2=0x7f48c0159f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:08.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.559+0000 7f48c496d700 1 -- 172.21.15.80:0/3063048518 shutdown_connections 2024-05-08T21:10:08.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.559+0000 7f48c496d700 1 -- 172.21.15.80:0/3063048518 wait complete. 2024-05-08T21:10:08.562 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 5 2024-05-08T21:10:08.573 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T21:10:08.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.692+0000 7f18fbd41700 1 Processor -- start 2024-05-08T21:10:08.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.692+0000 7f18fbd41700 1 -- start start 2024-05-08T21:10:08.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.693+0000 7f18fbd41700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f18f40ccfe0 0x7f18f4071be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:08.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.693+0000 7f18fbd41700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f18f40c8380 0x7f18f40c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:08.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.693+0000 7f18fbd41700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18f40c9150 con 0x7f18f40ccc00 2024-05-08T21:10:08.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.693+0000 7f18fbd41700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18f40c99f0 con 0x7f18f40ccfe0 2024-05-08T21:10:08.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.693+0000 7f18fbd41700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18f41579c0 con 0x7f18f40c8380 2024-05-08T21:10:08.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.693+0000 7f18f92dc700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f18f40ccfe0 0x7f18f4071be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:08.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.693+0000 7f18f9add700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f18f40ccc00 0x7f18f4156ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:51946/0 (socket says 172.21.15.80:51946) 2024-05-08T21:10:08.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.693+0000 7f18f9add700 1 -- 172.21.15.80:0/1817733962 learned_addr learned my addr 172.21.15.80:0/1817733962 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:10:08.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.693+0000 7f18fa2de700 1 --2- 172.21.15.80:0/1817733962 >> v2:172.21.15.106:3300/0 conn(0x7f18f40c8380 0x7f18f40c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:08.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.693+0000 7f18f92dc700 1 -- 172.21.15.80:0/1817733962 >> v2:172.21.15.106:3300/0 conn(0x7f18f40c8380 msgr2=0x7f18f40c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:08.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.694+0000 7f18f92dc700 1 --2- 172.21.15.80:0/1817733962 >> v2:172.21.15.106:3300/0 conn(0x7f18f40c8380 0x7f18f40c9e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:08.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.694+0000 7f18f92dc700 1 -- 172.21.15.80:0/1817733962 >> v1:172.21.15.80:6789/0 conn(0x7f18f40ccc00 legacy=0x7f18f4156ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:08.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.694+0000 7f18f92dc700 1 -- 172.21.15.80:0/1817733962 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f4157ca0 con 0x7f18f40ccfe0 2024-05-08T21:10:08.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.694+0000 7f18f8adb700 1 -- 172.21.15.80:0/1817733962 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2680846804 0 0) 0x7f18f40c9150 con 0x7f18f40ccc00 2024-05-08T21:10:08.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.694+0000 7f18f92dc700 1 --2- 172.21.15.80:0/1817733962 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f18f40ccfe0 0x7f18f4071be0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f18f4070060 tx=0x7f18f0009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8c505bafae5c7e5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:08.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.694+0000 7f18f8adb700 1 -- 172.21.15.80:0/1817733962 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f0011830 con 0x7f18f40ccfe0 2024-05-08T21:10:08.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.694+0000 7f18f8adb700 1 -- 172.21.15.80:0/1817733962 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18f0011990 con 0x7f18f40ccfe0 2024-05-08T21:10:08.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.694+0000 7f18f8adb700 1 -- 172.21.15.80:0/1817733962 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f0011d20 con 0x7f18f40ccfe0 2024-05-08T21:10:08.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.694+0000 7f18fbd41700 1 -- 172.21.15.80:0/1817733962 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f18f40ccfe0 msgr2=0x7f18f4071be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:08.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.694+0000 7f18fbd41700 1 --2- 172.21.15.80:0/1817733962 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f18f40ccfe0 0x7f18f4071be0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f18f4070060 tx=0x7f18f0009b20 comp rx=0 tx=0).stop 2024-05-08T21:10:08.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.694+0000 7f18fbd41700 1 -- 172.21.15.80:0/1817733962 shutdown_connections 2024-05-08T21:10:08.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.694+0000 7f18fbd41700 1 --2- 172.21.15.80:0/1817733962 >> v2:172.21.15.106:3300/0 conn(0x7f18f40c8380 0x7f18f40c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:08.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.694+0000 7f18fbd41700 1 --2- 172.21.15.80:0/1817733962 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f18f40ccfe0 0x7f18f4071be0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:08.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.694+0000 7f18fbd41700 1 -- 172.21.15.80:0/1817733962 >> 172.21.15.80:0/1817733962 conn(0x7f18f406f140 msgr2=0x7f18f406f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:08.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.694+0000 7f18fbd41700 1 -- 172.21.15.80:0/1817733962 shutdown_connections 2024-05-08T21:10:08.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.694+0000 7f18fbd41700 1 -- 172.21.15.80:0/1817733962 wait complete. 2024-05-08T21:10:08.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.696+0000 7f18fbd41700 1 Processor -- start 2024-05-08T21:10:08.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.696+0000 7f18fbd41700 1 -- start start 2024-05-08T21:10:08.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.696+0000 7f18fbd41700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f18f40c8380 0x7f18f4151710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:08.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.696+0000 7f18fbd41700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f18f40ccc00 0x7f18f406ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:08.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.696+0000 7f18fbd41700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f18f40ccfe0 0x7f18f41ed510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:08.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.696+0000 7f18fbd41700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f4152c40 con 0x7f18f40ccfe0 2024-05-08T21:10:08.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.696+0000 7f18fbd41700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f41f19e0 con 0x7f18f40c8380 2024-05-08T21:10:08.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.696+0000 7f18fbd41700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18f4152280 con 0x7f18f40ccc00 2024-05-08T21:10:08.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.696+0000 7f18fa2de700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f18f40ccfe0 0x7f18f41ed510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:08.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.696+0000 7f18fa2de700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f18f40ccfe0 0x7f18f41ed510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42864/0 (socket says 172.21.15.80:42864) 2024-05-08T21:10:08.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.696+0000 7f18fa2de700 1 -- 172.21.15.80:0/2622971717 learned_addr learned my addr 172.21.15.80:0/2622971717 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:08.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.696+0000 7f18f9add700 1 --2- 172.21.15.80:0/2622971717 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f18f40c8380 0x7f18f4151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:08.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.696+0000 7f18f92dc700 1 --2- 172.21.15.80:0/2622971717 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f18f40ccc00 0x7f18f406ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:08.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.697+0000 7f18fa2de700 1 -- 172.21.15.80:0/2622971717 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f18f40ccc00 msgr2=0x7f18f406ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:08.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.697+0000 7f18fa2de700 1 --2- 172.21.15.80:0/2622971717 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f18f40ccc00 0x7f18f406ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:08.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.697+0000 7f18fa2de700 1 -- 172.21.15.80:0/2622971717 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f18f40c8380 msgr2=0x7f18f4151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:08.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.697+0000 7f18fa2de700 1 --2- 172.21.15.80:0/2622971717 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f18f40c8380 0x7f18f4151710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:08.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.697+0000 7f18fa2de700 1 -- 172.21.15.80:0/2622971717 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f00094a0 con 0x7f18f40ccfe0 2024-05-08T21:10:08.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.697+0000 7f18fa2de700 1 --2- 172.21.15.80:0/2622971717 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f18f40ccfe0 0x7f18f41ed510 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f18ec00cda0 tx=0x7f18ec00a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:08.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.697+0000 7f18ea7fc700 1 -- 172.21.15.80:0/2622971717 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ec003a20 con 0x7f18f40ccfe0 2024-05-08T21:10:08.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.697+0000 7f18ea7fc700 1 -- 172.21.15.80:0/2622971717 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18ec003b80 con 0x7f18f40ccfe0 2024-05-08T21:10:08.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.697+0000 7f18fbd41700 1 -- 172.21.15.80:0/2622971717 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18f4151fa0 con 0x7f18f40ccfe0 2024-05-08T21:10:08.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.697+0000 7f18ea7fc700 1 -- 172.21.15.80:0/2622971717 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ec004020 con 0x7f18f40ccfe0 2024-05-08T21:10:08.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.697+0000 7f18fbd41700 1 -- 172.21.15.80:0/2622971717 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18f41f0f00 con 0x7f18f40ccfe0 2024-05-08T21:10:08.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.698+0000 7f18fbd41700 1 -- 172.21.15.80:0/2622971717 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18f4067d70 con 0x7f18f40ccfe0 2024-05-08T21:10:08.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.698+0000 7f18ea7fc700 1 -- 172.21.15.80:0/2622971717 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f18ec004180 con 0x7f18f40ccfe0 2024-05-08T21:10:08.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.699+0000 7f18ea7fc700 1 --2- 172.21.15.80:0/2622971717 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f18d806acc0 0x7f18d806d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:08.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.699+0000 7f18ea7fc700 1 -- 172.21.15.80:0/2622971717 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f18ec012070 con 0x7f18f40ccfe0 2024-05-08T21:10:08.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.699+0000 7f18f9add700 1 --2- 172.21.15.80:0/2622971717 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f18d806acc0 0x7f18d806d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:08.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.699+0000 7f18f9add700 1 --2- 172.21.15.80:0/2622971717 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f18d806acc0 0x7f18d806d180 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f18e4007fd0 tx=0x7f18e4007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:08.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.703+0000 7f18ea7fc700 1 -- 172.21.15.80:0/2622971717 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f18ec054be0 con 0x7f18f40ccfe0 2024-05-08T21:10:08.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.906+0000 7f18fbd41700 1 -- 172.21.15.80:0/2622971717 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f18f404ec60 con 0x7f18f40ccfe0 2024-05-08T21:10:08.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.907+0000 7f18ea7fc700 1 -- 172.21.15.80:0/2622971717 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+17878 (secure 0 0 0) 0x7f18ec058200 con 0x7f18f40ccfe0 2024-05-08T21:10:08.909 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:10:08.910 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":26,"fsid":"44d31c1e-aad3-47ca-a4fa-85a63d4a60aa","created":"2024-05-08T21:09:46.467038+0000","modified":"2024-05-08T21:10:08.163735+0000","last_up_change":"2024-05-08T21:09:57.284675+0000","last_in_change":"2024-05-08T21:09:49.125444+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T21:09:58.238951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T21:10:02.177476+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T21:10:02.685535+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-08T21:10:05.753779+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c3f9d93e-ed6d-4a0c-b5c0-0e8d44c65fdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":47011},{"type":"v1","addr":"172.21.15.80:6817","nonce":47011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":47011},{"type":"v1","addr":"172.21.15.80:6819","nonce":47011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":47011},{"type":"v1","addr":"172.21.15.80:6823","nonce":47011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":47011},{"type":"v1","addr":"172.21.15.80:6821","nonce":47011}]},"public_addr":"172.21.15.80:6817/47011","cluster_addr":"172.21.15.80:6819/47011","heartbeat_back_addr":"172.21.15.80:6823/47011","heartbeat_front_addr":"172.21.15.80:6821/47011","state":["exists","up"]},{"osd":1,"uuid":"4ce2b4d6-6c40-43aa-8dd1-743fef8915df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":47010},{"type":"v1","addr":"172.21.15.80:6809","nonce":47010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":47010},{"type":"v1","addr":"172.21.15.80:6811","nonce":47010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":47010},{"type":"v1","addr":"172.21.15.80:6815","nonce":47010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":47010},{"type":"v1","addr":"172.21.15.80:6813","nonce":47010}]},"public_addr":"172.21.15.80:6809/47010","cluster_addr":"172.21.15.80:6811/47010","heartbeat_back_addr":"172.21.15.80:6815/47010","heartbeat_front_addr":"172.21.15.80:6813/47010","state":["exists","up"]},{"osd":2,"uuid":"e30cc3bc-6461-4fac-960a-de00c9488d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":47009},{"type":"v1","addr":"172.21.15.80:6801","nonce":47009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":47009},{"type":"v1","addr":"172.21.15.80:6803","nonce":47009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":47009},{"type":"v1","addr":"172.21.15.80:6807","nonce":47009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":47009},{"type":"v1","addr":"172.21.15.80:6805","nonce":47009}]},"public_addr":"172.21.15.80:6801/47009","cluster_addr":"172.21.15.80:6803/47009","heartbeat_back_addr":"172.21.15.80:6807/47009","heartbeat_front_addr":"172.21.15.80:6805/47009","state":["exists","up"]},{"osd":3,"uuid":"a415c099-9ea6-40be-98ed-f2932f98dfd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":47012},{"type":"v1","addr":"172.21.15.80:6825","nonce":47012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":47012},{"type":"v1","addr":"172.21.15.80:6827","nonce":47012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":47012},{"type":"v1","addr":"172.21.15.80:6831","nonce":47012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":47012},{"type":"v1","addr":"172.21.15.80:6829","nonce":47012}]},"public_addr":"172.21.15.80:6825/47012","cluster_addr":"172.21.15.80:6827/47012","heartbeat_back_addr":"172.21.15.80:6831/47012","heartbeat_front_addr":"172.21.15.80:6829/47012","state":["exists","up"]},{"osd":4,"uuid":"5ae1d51f-0918-4571-b79b-154308d46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6823","nonce":47114},{"type":"v1","addr":"172.21.15.106:6825","nonce":47114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":47114},{"type":"v1","addr":"172.21.15.106:6827","nonce":47114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":47114},{"type":"v1","addr":"172.21.15.106:6831","nonce":47114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":47114},{"type":"v1","addr":"172.21.15.106:6829","nonce":47114}]},"public_addr":"172.21.15.106:6825/47114","cluster_addr":"172.21.15.106:6827/47114","heartbeat_back_addr":"172.21.15.106:6831/47114","heartbeat_front_addr":"172.21.15.106:6829/47114","state":["exists","up"]},{"osd":5,"uuid":"a19ac74e-4282-4428-b167-26ba6b92f732","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6807","nonce":47111},{"type":"v1","addr":"172.21.15.106:6809","nonce":47111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":47111},{"type":"v1","addr":"172.21.15.106:6811","nonce":47111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":47111},{"type":"v1","addr":"172.21.15.106:6815","nonce":47111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":47111},{"type":"v1","addr":"172.21.15.106:6813","nonce":47111}]},"public_addr":"172.21.15.106:6809/47111","cluster_addr":"172.21.15.106:6811/47111","heartbeat_back_addr":"172.21.15.106:6815/47111","heartbeat_front_addr":"172.21.15.106:6813/47111","state":["exists","up"]},{"osd":6,"uuid":"bfe72edd-7acc-4805-807d-2000e76f2feb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":47112},{"type":"v1","addr":"172.21.15.106:6817","nonce":47112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":47112},{"type":"v1","addr":"172.21.15.106:6819","nonce":47112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":47112},{"type":"v1","addr":"172.21.15.106:6824","nonce":47112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":47112},{"type":"v1","addr":"172.21.15.106:6821","nonce":47112}]},"public_addr":"172.21.15.106:6817/47112","cluster_addr":"172.21.15.106:6819/47112","heartbeat_back_addr":"172.21.15.106:6824/47112","heartbeat_front_addr":"172.21.15.106:6821/47112","state":["exists","up"]},{"osd":7,"uuid":"99897f22-ed17-4c7c-9088-cc0c4a51f786","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":47113},{"type":"v1","addr":"172.21.15.106:6801","nonce":47113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":47113},{"type":"v1","addr":"172.21.15.106:6803","nonce":47113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":47113},{"type":"v1","addr":"172.21.15.106:6808","nonce":47113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":47113},{"type":"v1","addr":"172.21.15.106:6805","nonce":47113}]},"public_addr":"172.21.15.106:6801/47113","cluster_addr":"172.21.15.106:6803/47113","heartbeat_back_addr":"172.21.15.106:6808/47113","heartbeat_front_addr":"172.21.15.106:6805/47113","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.232670+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.277753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.050087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.349312+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.344080+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.348781+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.352539+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.275013+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T21:10:08.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.909+0000 7f18fbd41700 1 -- 172.21.15.80:0/2622971717 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f18d806acc0 msgr2=0x7f18d806d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:08.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.909+0000 7f18fbd41700 1 --2- 172.21.15.80:0/2622971717 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f18d806acc0 0x7f18d806d180 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f18e4007fd0 tx=0x7f18e4007de0 comp rx=0 tx=0).stop 2024-05-08T21:10:08.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.909+0000 7f18fbd41700 1 -- 172.21.15.80:0/2622971717 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f18f40ccfe0 msgr2=0x7f18f41ed510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:08.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.909+0000 7f18fbd41700 1 --2- 172.21.15.80:0/2622971717 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f18f40ccfe0 0x7f18f41ed510 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f18ec00cda0 tx=0x7f18ec00a570 comp rx=0 tx=0).stop 2024-05-08T21:10:08.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.909+0000 7f18fbd41700 1 -- 172.21.15.80:0/2622971717 shutdown_connections 2024-05-08T21:10:08.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.909+0000 7f18fbd41700 1 --2- 172.21.15.80:0/2622971717 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f18d806acc0 0x7f18d806d180 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:08.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.909+0000 7f18fbd41700 1 --2- 172.21.15.80:0/2622971717 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f18f40ccfe0 0x7f18f41ed510 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:08.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.909+0000 7f18fbd41700 1 --2- 172.21.15.80:0/2622971717 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f18f40c8380 0x7f18f4151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:08.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.909+0000 7f18fbd41700 1 --2- 172.21.15.80:0/2622971717 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f18f40ccc00 0x7f18f406ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:08.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.909+0000 7f18fbd41700 1 -- 172.21.15.80:0/2622971717 >> 172.21.15.80:0/2622971717 conn(0x7f18f406f140 msgr2=0x7f18f40723b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:08.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.909+0000 7f18fbd41700 1 -- 172.21.15.80:0/2622971717 shutdown_connections 2024-05-08T21:10:08.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:08.909+0000 7f18fbd41700 1 -- 172.21.15.80:0/2622971717 wait complete. 2024-05-08T21:10:08.924 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T21:10:09.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.042+0000 7f447b441700 1 Processor -- start 2024-05-08T21:10:09.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.042+0000 7f447b441700 1 -- start start 2024-05-08T21:10:09.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.043+0000 7f447b441700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f44741544f0 0x7f44740c8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:09.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.043+0000 7f447b441700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f44740c6db0 0x7f447415a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:09.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.043+0000 7f447b441700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f44740c5890 0x7f447415a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:09.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.043+0000 7f447b441700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44740c4ae0 con 0x7f44741544f0 2024-05-08T21:10:09.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.043+0000 7f447b441700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44740c56d0 con 0x7f44740c6db0 2024-05-08T21:10:09.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.043+0000 7f447b441700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44740c6920 con 0x7f44740c5890 2024-05-08T21:10:09.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.043+0000 7f44791dd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f44741544f0 0x7f44740c8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:09.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.043+0000 7f44791dd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f44741544f0 0x7f44740c8240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42876/0 (socket says 172.21.15.80:42876) 2024-05-08T21:10:09.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.043+0000 7f44791dd700 1 -- 172.21.15.80:0/784097976 learned_addr learned my addr 172.21.15.80:0/784097976 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:09.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.043+0000 7f44789dc700 1 --2- 172.21.15.80:0/784097976 >> v2:172.21.15.106:3300/0 conn(0x7f44740c6db0 0x7f447415a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:09.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.043+0000 7f44799de700 1 --2- 172.21.15.80:0/784097976 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f44740c5890 0x7f447415a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:09.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.043+0000 7f44791dd700 1 -- 172.21.15.80:0/784097976 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f44740c5890 msgr2=0x7f447415a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:09.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.043+0000 7f44791dd700 1 --2- 172.21.15.80:0/784097976 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f44740c5890 0x7f447415a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:09.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.043+0000 7f44791dd700 1 -- 172.21.15.80:0/784097976 >> v2:172.21.15.106:3300/0 conn(0x7f44740c6db0 msgr2=0x7f447415a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:09.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.043+0000 7f44791dd700 1 --2- 172.21.15.80:0/784097976 >> v2:172.21.15.106:3300/0 conn(0x7f44740c6db0 0x7f447415a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:09.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.043+0000 7f44791dd700 1 -- 172.21.15.80:0/784097976 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44740cb270 con 0x7f44741544f0 2024-05-08T21:10:09.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.043+0000 7f44799de700 1 --2- 172.21.15.80:0/784097976 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f44740c5890 0x7f447415a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:10:09.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.043+0000 7f44791dd700 1 --2- 172.21.15.80:0/784097976 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44741544f0 0x7f44740c8240 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f447404f3a0 tx=0x7f4470009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfbcd6540e4603cb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:09.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.043+0000 7f446bfff700 1 -- 172.21.15.80:0/784097976 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447000b870 con 0x7f44741544f0 2024-05-08T21:10:09.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.043+0000 7f446bfff700 1 -- 172.21.15.80:0/784097976 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f447000b9d0 con 0x7f44741544f0 2024-05-08T21:10:09.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.043+0000 7f446bfff700 1 -- 172.21.15.80:0/784097976 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447000bd60 con 0x7f44741544f0 2024-05-08T21:10:09.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.044+0000 7f447b441700 1 -- 172.21.15.80:0/784097976 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44741544f0 msgr2=0x7f44740c8240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:09.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.044+0000 7f447b441700 1 --2- 172.21.15.80:0/784097976 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44741544f0 0x7f44740c8240 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f447404f3a0 tx=0x7f4470009bd0 comp rx=0 tx=0).stop 2024-05-08T21:10:09.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.044+0000 7f447b441700 1 -- 172.21.15.80:0/784097976 shutdown_connections 2024-05-08T21:10:09.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.044+0000 7f447b441700 1 --2- 172.21.15.80:0/784097976 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44741544f0 0x7f44740c8240 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:09.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.044+0000 7f447b441700 1 --2- 172.21.15.80:0/784097976 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f44740c5890 0x7f447415a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:09.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.044+0000 7f447b441700 1 --2- 172.21.15.80:0/784097976 >> v2:172.21.15.106:3300/0 conn(0x7f44740c6db0 0x7f447415a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:09.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.044+0000 7f447b441700 1 -- 172.21.15.80:0/784097976 >> 172.21.15.80:0/784097976 conn(0x7f44740ca340 msgr2=0x7f44740ca750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:09.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.044+0000 7f447b441700 1 -- 172.21.15.80:0/784097976 shutdown_connections 2024-05-08T21:10:09.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.044+0000 7f447b441700 1 -- 172.21.15.80:0/784097976 wait complete. 2024-05-08T21:10:09.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.046+0000 7f447b441700 1 Processor -- start 2024-05-08T21:10:09.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.046+0000 7f447b441700 1 -- start start 2024-05-08T21:10:09.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.046+0000 7f447b441700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f44740c5890 0x7f44741ef8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:09.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.046+0000 7f447b441700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f44740c6db0 0x7f44740c9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:09.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.046+0000 7f447b441700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44741544f0 0x7f447415bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:09.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.046+0000 7f447b441700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44741efde0 con 0x7f44741544f0 2024-05-08T21:10:09.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.046+0000 7f447b441700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44741f0860 con 0x7f44740c5890 2024-05-08T21:10:09.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.046+0000 7f447b441700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f447415b830 con 0x7f44740c6db0 2024-05-08T21:10:09.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.047+0000 7f44799de700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44741544f0 0x7f447415bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:09.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.047+0000 7f44799de700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44741544f0 0x7f447415bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42886/0 (socket says 172.21.15.80:42886) 2024-05-08T21:10:09.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.047+0000 7f44799de700 1 -- 172.21.15.80:0/21317693 learned_addr learned my addr 172.21.15.80:0/21317693 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:09.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.047+0000 7f44789dc700 1 --2- 172.21.15.80:0/21317693 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f44740c6db0 0x7f44740c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:09.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.047+0000 7f44791dd700 1 --2- 172.21.15.80:0/21317693 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f44740c5890 0x7f44741ef8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:09.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.047+0000 7f44799de700 1 -- 172.21.15.80:0/21317693 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f44740c6db0 msgr2=0x7f44740c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:09.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.047+0000 7f44799de700 1 --2- 172.21.15.80:0/21317693 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f44740c6db0 0x7f44740c9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:09.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.047+0000 7f44799de700 1 -- 172.21.15.80:0/21317693 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f44740c5890 msgr2=0x7f44741ef8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:09.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.047+0000 7f44799de700 1 --2- 172.21.15.80:0/21317693 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f44740c5890 0x7f44741ef8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:09.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.047+0000 7f44799de700 1 -- 172.21.15.80:0/21317693 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4470009550 con 0x7f44741544f0 2024-05-08T21:10:09.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.047+0000 7f44799de700 1 --2- 172.21.15.80:0/21317693 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44741544f0 0x7f447415bcc0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f446c00cef0 tx=0x7f446c00cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:09.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.047+0000 7f4469ffb700 1 -- 172.21.15.80:0/21317693 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f446c00ac80 con 0x7f44741544f0 2024-05-08T21:10:09.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.047+0000 7f4469ffb700 1 -- 172.21.15.80:0/21317693 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f446c00ade0 con 0x7f44741544f0 2024-05-08T21:10:09.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.047+0000 7f447b441700 1 -- 172.21.15.80:0/21317693 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44741effc0 con 0x7f44741544f0 2024-05-08T21:10:09.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.047+0000 7f4469ffb700 1 -- 172.21.15.80:0/21317693 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f446c015680 con 0x7f44741544f0 2024-05-08T21:10:09.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.047+0000 7f447b441700 1 -- 172.21.15.80:0/21317693 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44741f0580 con 0x7f44741544f0 2024-05-08T21:10:09.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.048+0000 7f447b441700 1 -- 172.21.15.80:0/21317693 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44740c7b10 con 0x7f44741544f0 2024-05-08T21:10:09.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.049+0000 7f4469ffb700 1 -- 172.21.15.80:0/21317693 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f446c00d430 con 0x7f44741544f0 2024-05-08T21:10:09.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.049+0000 7f4469ffb700 1 --2- 172.21.15.80:0/21317693 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f445806acc0 0x7f445806d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:09.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.049+0000 7f4469ffb700 1 -- 172.21.15.80:0/21317693 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f446c089990 con 0x7f44741544f0 2024-05-08T21:10:09.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.049+0000 7f44791dd700 1 --2- 172.21.15.80:0/21317693 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f445806acc0 0x7f445806d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:09.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.049+0000 7f44791dd700 1 --2- 172.21.15.80:0/21317693 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f445806acc0 0x7f445806d180 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4470014040 tx=0x7f4470008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:09.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.053+0000 7f4469ffb700 1 -- 172.21.15.80:0/21317693 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f446c054910 con 0x7f44741544f0 2024-05-08T21:10:09.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.252+0000 7f447b441700 1 -- 172.21.15.80:0/21317693 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f447404ec60 con 0x7f44741544f0 2024-05-08T21:10:09.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.253+0000 7f4469ffb700 1 -- 172.21.15.80:0/21317693 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+17878 (secure 0 0 0) 0x7f446c057f30 con 0x7f44741544f0 2024-05-08T21:10:09.255 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:10:09.255 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":26,"fsid":"44d31c1e-aad3-47ca-a4fa-85a63d4a60aa","created":"2024-05-08T21:09:46.467038+0000","modified":"2024-05-08T21:10:08.163735+0000","last_up_change":"2024-05-08T21:09:57.284675+0000","last_in_change":"2024-05-08T21:09:49.125444+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T21:09:58.238951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T21:10:02.177476+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T21:10:02.685535+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-08T21:10:05.753779+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c3f9d93e-ed6d-4a0c-b5c0-0e8d44c65fdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":47011},{"type":"v1","addr":"172.21.15.80:6817","nonce":47011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":47011},{"type":"v1","addr":"172.21.15.80:6819","nonce":47011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":47011},{"type":"v1","addr":"172.21.15.80:6823","nonce":47011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":47011},{"type":"v1","addr":"172.21.15.80:6821","nonce":47011}]},"public_addr":"172.21.15.80:6817/47011","cluster_addr":"172.21.15.80:6819/47011","heartbeat_back_addr":"172.21.15.80:6823/47011","heartbeat_front_addr":"172.21.15.80:6821/47011","state":["exists","up"]},{"osd":1,"uuid":"4ce2b4d6-6c40-43aa-8dd1-743fef8915df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":47010},{"type":"v1","addr":"172.21.15.80:6809","nonce":47010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":47010},{"type":"v1","addr":"172.21.15.80:6811","nonce":47010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":47010},{"type":"v1","addr":"172.21.15.80:6815","nonce":47010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":47010},{"type":"v1","addr":"172.21.15.80:6813","nonce":47010}]},"public_addr":"172.21.15.80:6809/47010","cluster_addr":"172.21.15.80:6811/47010","heartbeat_back_addr":"172.21.15.80:6815/47010","heartbeat_front_addr":"172.21.15.80:6813/47010","state":["exists","up"]},{"osd":2,"uuid":"e30cc3bc-6461-4fac-960a-de00c9488d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":47009},{"type":"v1","addr":"172.21.15.80:6801","nonce":47009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":47009},{"type":"v1","addr":"172.21.15.80:6803","nonce":47009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":47009},{"type":"v1","addr":"172.21.15.80:6807","nonce":47009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":47009},{"type":"v1","addr":"172.21.15.80:6805","nonce":47009}]},"public_addr":"172.21.15.80:6801/47009","cluster_addr":"172.21.15.80:6803/47009","heartbeat_back_addr":"172.21.15.80:6807/47009","heartbeat_front_addr":"172.21.15.80:6805/47009","state":["exists","up"]},{"osd":3,"uuid":"a415c099-9ea6-40be-98ed-f2932f98dfd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":47012},{"type":"v1","addr":"172.21.15.80:6825","nonce":47012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":47012},{"type":"v1","addr":"172.21.15.80:6827","nonce":47012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":47012},{"type":"v1","addr":"172.21.15.80:6831","nonce":47012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":47012},{"type":"v1","addr":"172.21.15.80:6829","nonce":47012}]},"public_addr":"172.21.15.80:6825/47012","cluster_addr":"172.21.15.80:6827/47012","heartbeat_back_addr":"172.21.15.80:6831/47012","heartbeat_front_addr":"172.21.15.80:6829/47012","state":["exists","up"]},{"osd":4,"uuid":"5ae1d51f-0918-4571-b79b-154308d46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6823","nonce":47114},{"type":"v1","addr":"172.21.15.106:6825","nonce":47114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":47114},{"type":"v1","addr":"172.21.15.106:6827","nonce":47114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":47114},{"type":"v1","addr":"172.21.15.106:6831","nonce":47114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":47114},{"type":"v1","addr":"172.21.15.106:6829","nonce":47114}]},"public_addr":"172.21.15.106:6825/47114","cluster_addr":"172.21.15.106:6827/47114","heartbeat_back_addr":"172.21.15.106:6831/47114","heartbeat_front_addr":"172.21.15.106:6829/47114","state":["exists","up"]},{"osd":5,"uuid":"a19ac74e-4282-4428-b167-26ba6b92f732","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6807","nonce":47111},{"type":"v1","addr":"172.21.15.106:6809","nonce":47111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":47111},{"type":"v1","addr":"172.21.15.106:6811","nonce":47111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":47111},{"type":"v1","addr":"172.21.15.106:6815","nonce":47111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":47111},{"type":"v1","addr":"172.21.15.106:6813","nonce":47111}]},"public_addr":"172.21.15.106:6809/47111","cluster_addr":"172.21.15.106:6811/47111","heartbeat_back_addr":"172.21.15.106:6815/47111","heartbeat_front_addr":"172.21.15.106:6813/47111","state":["exists","up"]},{"osd":6,"uuid":"bfe72edd-7acc-4805-807d-2000e76f2feb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":47112},{"type":"v1","addr":"172.21.15.106:6817","nonce":47112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":47112},{"type":"v1","addr":"172.21.15.106:6819","nonce":47112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":47112},{"type":"v1","addr":"172.21.15.106:6824","nonce":47112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":47112},{"type":"v1","addr":"172.21.15.106:6821","nonce":47112}]},"public_addr":"172.21.15.106:6817/47112","cluster_addr":"172.21.15.106:6819/47112","heartbeat_back_addr":"172.21.15.106:6824/47112","heartbeat_front_addr":"172.21.15.106:6821/47112","state":["exists","up"]},{"osd":7,"uuid":"99897f22-ed17-4c7c-9088-cc0c4a51f786","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":47113},{"type":"v1","addr":"172.21.15.106:6801","nonce":47113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":47113},{"type":"v1","addr":"172.21.15.106:6803","nonce":47113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":47113},{"type":"v1","addr":"172.21.15.106:6808","nonce":47113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":47113},{"type":"v1","addr":"172.21.15.106:6805","nonce":47113}]},"public_addr":"172.21.15.106:6801/47113","cluster_addr":"172.21.15.106:6803/47113","heartbeat_back_addr":"172.21.15.106:6808/47113","heartbeat_front_addr":"172.21.15.106:6805/47113","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.232670+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.277753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.050087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.349312+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.344080+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.348781+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.352539+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.275013+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T21:10:09.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.255+0000 7f447b441700 1 -- 172.21.15.80:0/21317693 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f445806acc0 msgr2=0x7f445806d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:09.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.255+0000 7f447b441700 1 --2- 172.21.15.80:0/21317693 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f445806acc0 0x7f445806d180 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4470014040 tx=0x7f4470008030 comp rx=0 tx=0).stop 2024-05-08T21:10:09.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.255+0000 7f447b441700 1 -- 172.21.15.80:0/21317693 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44741544f0 msgr2=0x7f447415bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:09.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.255+0000 7f447b441700 1 --2- 172.21.15.80:0/21317693 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44741544f0 0x7f447415bcc0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f446c00cef0 tx=0x7f446c00cf20 comp rx=0 tx=0).stop 2024-05-08T21:10:09.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.255+0000 7f447b441700 1 -- 172.21.15.80:0/21317693 shutdown_connections 2024-05-08T21:10:09.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.255+0000 7f447b441700 1 --2- 172.21.15.80:0/21317693 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f445806acc0 0x7f445806d180 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:09.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.255+0000 7f447b441700 1 --2- 172.21.15.80:0/21317693 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44741544f0 0x7f447415bcc0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:09.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.255+0000 7f447b441700 1 --2- 172.21.15.80:0/21317693 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f44740c5890 0x7f44741ef8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:09.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.255+0000 7f447b441700 1 --2- 172.21.15.80:0/21317693 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f44740c6db0 0x7f44740c9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:09.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.255+0000 7f447b441700 1 -- 172.21.15.80:0/21317693 >> 172.21.15.80:0/21317693 conn(0x7f44740ca340 msgr2=0x7f44740ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:09.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.255+0000 7f447b441700 1 -- 172.21.15.80:0/21317693 shutdown_connections 2024-05-08T21:10:09.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.255+0000 7f447b441700 1 -- 172.21.15.80:0/21317693 wait complete. 2024-05-08T21:10:09.284 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:10:09.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.402+0000 7f69678c6700 1 Processor -- start 2024-05-08T21:10:09.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.402+0000 7f69678c6700 1 -- start start 2024-05-08T21:10:09.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.403+0000 7f69678c6700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f69600ccc00 0x7f6960071be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:09.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.403+0000 7f69678c6700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f69600c8380 0x7f69600c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:09.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.403+0000 7f69678c6700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69600c9150 con 0x7f69600ccfe0 2024-05-08T21:10:09.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.403+0000 7f69678c6700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69600c99f0 con 0x7f69600ccc00 2024-05-08T21:10:09.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.403+0000 7f69678c6700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69601579c0 con 0x7f69600c8380 2024-05-08T21:10:09.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.403+0000 7f6965662700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f69600ccc00 0x7f6960071be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:09.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.403+0000 7f6965662700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f69600ccc00 0x7f6960071be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42894/0 (socket says 172.21.15.80:42894) 2024-05-08T21:10:09.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.403+0000 7f6965662700 1 -- 172.21.15.80:0/2404246152 learned_addr learned my addr 172.21.15.80:0/2404246152 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:09.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.404+0000 7f6965e63700 1 --2- 172.21.15.80:0/2404246152 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f69600c8380 0x7f69600c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:09.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.404+0000 7f6965662700 1 -- 172.21.15.80:0/2404246152 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f69600c8380 msgr2=0x7f69600c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:09.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.404+0000 7f6965662700 1 --2- 172.21.15.80:0/2404246152 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f69600c8380 0x7f69600c9e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:09.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.404+0000 7f6965662700 1 -- 172.21.15.80:0/2404246152 >> v1:172.21.15.106:6789/0 conn(0x7f69600ccfe0 legacy=0x7f6960156ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:09.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.404+0000 7f6965662700 1 -- 172.21.15.80:0/2404246152 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6960157ca0 con 0x7f69600ccc00 2024-05-08T21:10:09.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.404+0000 7f6965662700 1 --2- 172.21.15.80:0/2404246152 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f69600ccc00 0x7f6960071be0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f695000bb90 tx=0x7f695000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca17b0b50a49131b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:09.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.404+0000 7f6957fff700 1 -- 172.21.15.80:0/2404246152 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695000dd10 con 0x7f69600ccc00 2024-05-08T21:10:09.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.404+0000 7f6957fff700 1 -- 172.21.15.80:0/2404246152 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f695000de70 con 0x7f69600ccc00 2024-05-08T21:10:09.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.404+0000 7f6957fff700 1 -- 172.21.15.80:0/2404246152 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6950004230 con 0x7f69600ccc00 2024-05-08T21:10:09.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.404+0000 7f69678c6700 1 -- 172.21.15.80:0/2404246152 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f69600ccc00 msgr2=0x7f6960071be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:09.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.404+0000 7f69678c6700 1 --2- 172.21.15.80:0/2404246152 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f69600ccc00 0x7f6960071be0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f695000bb90 tx=0x7f695000bea0 comp rx=0 tx=0).stop 2024-05-08T21:10:09.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.404+0000 7f69678c6700 1 -- 172.21.15.80:0/2404246152 shutdown_connections 2024-05-08T21:10:09.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.404+0000 7f69678c6700 1 --2- 172.21.15.80:0/2404246152 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f69600c8380 0x7f69600c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:09.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.404+0000 7f69678c6700 1 --2- 172.21.15.80:0/2404246152 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f69600ccc00 0x7f6960071be0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:09.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.404+0000 7f69678c6700 1 -- 172.21.15.80:0/2404246152 >> 172.21.15.80:0/2404246152 conn(0x7f696006f140 msgr2=0x7f696006f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:09.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.405+0000 7f69678c6700 1 -- 172.21.15.80:0/2404246152 shutdown_connections 2024-05-08T21:10:09.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.405+0000 7f69678c6700 1 -- 172.21.15.80:0/2404246152 wait complete. 2024-05-08T21:10:09.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.406+0000 7f69678c6700 1 Processor -- start 2024-05-08T21:10:09.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.406+0000 7f69678c6700 1 -- start start 2024-05-08T21:10:09.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.406+0000 7f69678c6700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f69600c8380 0x7f6960147d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:09.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.406+0000 7f69678c6700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69600ccc00 0x7f696015af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:09.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.406+0000 7f69678c6700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f69600ccfe0 0x7f696014cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:09.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.406+0000 7f69678c6700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f696014de20 con 0x7f69600c8380 2024-05-08T21:10:09.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.406+0000 7f69678c6700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69601597a0 con 0x7f69600ccc00 2024-05-08T21:10:09.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.406+0000 7f69678c6700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f696014c7a0 con 0x7f69600ccfe0 2024-05-08T21:10:09.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.406+0000 7f6965662700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f69600c8380 0x7f6960147d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:09.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.406+0000 7f6965662700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f69600c8380 0x7f6960147d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42908/0 (socket says 172.21.15.80:42908) 2024-05-08T21:10:09.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.406+0000 7f6965662700 1 -- 172.21.15.80:0/3832177915 learned_addr learned my addr 172.21.15.80:0/3832177915 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:09.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.407+0000 7f6965e63700 1 --2- 172.21.15.80:0/3832177915 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f69600ccfe0 0x7f696014cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:09.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.407+0000 7f6964e61700 1 --2- 172.21.15.80:0/3832177915 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69600ccc00 0x7f696015af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:09.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.407+0000 7f6965662700 1 -- 172.21.15.80:0/3832177915 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f69600ccfe0 msgr2=0x7f696014cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:09.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.407+0000 7f6965662700 1 --2- 172.21.15.80:0/3832177915 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f69600ccfe0 0x7f696014cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:09.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.407+0000 7f6965662700 1 -- 172.21.15.80:0/3832177915 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69600ccc00 msgr2=0x7f696015af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:09.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.407+0000 7f6965662700 1 --2- 172.21.15.80:0/3832177915 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69600ccc00 0x7f696015af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:09.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.407+0000 7f6965662700 1 -- 172.21.15.80:0/3832177915 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f695000b7f0 con 0x7f69600c8380 2024-05-08T21:10:09.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.407+0000 7f6965662700 1 --2- 172.21.15.80:0/3832177915 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f69600c8380 0x7f6960147d60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f695000b340 tx=0x7f6950004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:09.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.407+0000 7f6955ffb700 1 -- 172.21.15.80:0/3832177915 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6950020070 con 0x7f69600c8380 2024-05-08T21:10:09.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.407+0000 7f6955ffb700 1 -- 172.21.15.80:0/3832177915 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6950003a70 con 0x7f69600c8380 2024-05-08T21:10:09.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.407+0000 7f69678c6700 1 -- 172.21.15.80:0/3832177915 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6960158f00 con 0x7f69600c8380 2024-05-08T21:10:09.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.407+0000 7f6955ffb700 1 -- 172.21.15.80:0/3832177915 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6950003e00 con 0x7f69600c8380 2024-05-08T21:10:09.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.407+0000 7f69678c6700 1 -- 172.21.15.80:0/3832177915 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69601594c0 con 0x7f69600c8380 2024-05-08T21:10:09.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.408+0000 7f69678c6700 1 -- 172.21.15.80:0/3832177915 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f696004ec60 con 0x7f69600c8380 2024-05-08T21:10:09.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.409+0000 7f6955ffb700 1 -- 172.21.15.80:0/3832177915 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f69500193f0 con 0x7f69600c8380 2024-05-08T21:10:09.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.409+0000 7f6955ffb700 1 --2- 172.21.15.80:0/3832177915 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f694406acc0 0x7f694406d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:09.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.409+0000 7f6964e61700 1 --2- 172.21.15.80:0/3832177915 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f694406acc0 0x7f694406d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:09.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.409+0000 7f6955ffb700 1 -- 172.21.15.80:0/3832177915 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f695008ca80 con 0x7f69600c8380 2024-05-08T21:10:09.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.410+0000 7f6964e61700 1 --2- 172.21.15.80:0/3832177915 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f694406acc0 0x7f694406d180 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f696006fed0 tx=0x7f695c0090e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:09.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.414+0000 7f6955ffb700 1 -- 172.21.15.80:0/3832177915 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f6950057a00 con 0x7f69600c8380 2024-05-08T21:10:09.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.653+0000 7f69678c6700 1 -- 172.21.15.80:0/3832177915 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f69600c3630 con 0x7f69600c8380 2024-05-08T21:10:09.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.653+0000 7f6955ffb700 1 -- 172.21.15.80:0/3832177915 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+6253 (secure 0 0 0) 0x7f695005b020 con 0x7f69600c8380 2024-05-08T21:10:09.656 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:10:09.656 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/2289230272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":2289230272},{"type":"v1","addr":"172.21.15.106:6833","nonce":2289230272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:10:08.163962+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:creating","state_seq":1,"addr":"172.21.15.106:6836/1949999190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1949999190},{"type":"v1","addr":"172.21.15.106:6836","nonce":1949999190}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:10:09.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.655+0000 7f69678c6700 1 -- 172.21.15.80:0/3832177915 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f694406acc0 msgr2=0x7f694406d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:09.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.655+0000 7f69678c6700 1 --2- 172.21.15.80:0/3832177915 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f694406acc0 0x7f694406d180 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f696006fed0 tx=0x7f695c0090e0 comp rx=0 tx=0).stop 2024-05-08T21:10:09.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.656+0000 7f69678c6700 1 -- 172.21.15.80:0/3832177915 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f69600c8380 msgr2=0x7f6960147d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:09.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.656+0000 7f69678c6700 1 --2- 172.21.15.80:0/3832177915 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f69600c8380 0x7f6960147d60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f695000b340 tx=0x7f6950004750 comp rx=0 tx=0).stop 2024-05-08T21:10:09.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.656+0000 7f69678c6700 1 -- 172.21.15.80:0/3832177915 shutdown_connections 2024-05-08T21:10:09.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.656+0000 7f69678c6700 1 --2- 172.21.15.80:0/3832177915 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f694406acc0 0x7f694406d180 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:09.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.656+0000 7f69678c6700 1 --2- 172.21.15.80:0/3832177915 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f69600c8380 0x7f6960147d60 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:09.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.656+0000 7f69678c6700 1 --2- 172.21.15.80:0/3832177915 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f69600ccfe0 0x7f696014cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:09.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.656+0000 7f69678c6700 1 --2- 172.21.15.80:0/3832177915 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69600ccc00 0x7f696015af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:09.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.656+0000 7f69678c6700 1 -- 172.21.15.80:0/3832177915 >> 172.21.15.80:0/3832177915 conn(0x7f696006f140 msgr2=0x7f69600c7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:09.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.656+0000 7f69678c6700 1 -- 172.21.15.80:0/3832177915 shutdown_connections 2024-05-08T21:10:09.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.656+0000 7f69678c6700 1 -- 172.21.15.80:0/3832177915 wait complete. 2024-05-08T21:10:09.659 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 5 2024-05-08T21:10:09.670 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T21:10:09.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.791+0000 7f47f96b7700 1 Processor -- start 2024-05-08T21:10:09.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.791+0000 7f47f96b7700 1 -- start start 2024-05-08T21:10:09.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.791+0000 7f47f96b7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f47f40cbe40 0x7f47f415abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:09.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.791+0000 7f47f96b7700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47f40cad60 con 0x7f47f40cc3d0 2024-05-08T21:10:09.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.791+0000 7f47f96b7700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47f415d930 con 0x7f47f4154580 2024-05-08T21:10:09.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.791+0000 7f47f96b7700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47f40b2c60 con 0x7f47f40cbe40 2024-05-08T21:10:09.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.792+0000 7f47f27fc700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f47f40cbe40 0x7f47f415abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:09.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.792+0000 7f47f37fe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f47f40cc3d0 0x7f47f4164ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:51948/0 (socket says 172.21.15.80:51948) 2024-05-08T21:10:09.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.792+0000 7f47f27fc700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f47f40cbe40 0x7f47f415abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42916/0 (socket says 172.21.15.80:42916) 2024-05-08T21:10:09.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.792+0000 7f47f37fe700 1 -- 172.21.15.80:0/636580748 learned_addr learned my addr 172.21.15.80:0/636580748 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:10:09.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.792+0000 7f47f27fc700 1 -- 172.21.15.80:0/636580748 >> v1:172.21.15.106:6789/0 conn(0x7f47f4154580 legacy=0x7f47f40c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:09.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.792+0000 7f47f27fc700 1 -- 172.21.15.80:0/636580748 >> v1:172.21.15.80:6789/0 conn(0x7f47f40cc3d0 legacy=0x7f47f4164ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:09.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.792+0000 7f47f27fc700 1 -- 172.21.15.80:0/636580748 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47f415dc10 con 0x7f47f40cbe40 2024-05-08T21:10:09.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.792+0000 7f47f1ffb700 1 -- 172.21.15.80:0/636580748 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4173030672 0 0) 0x7f47f40cad60 con 0x7f47f40cc3d0 2024-05-08T21:10:09.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.792+0000 7f47f27fc700 1 --2- 172.21.15.80:0/636580748 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47f40cbe40 0x7f47f415abe0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f47e8009840 tx=0x7f47e8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d5fdfe74d4af1ac server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:09.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.792+0000 7f47f1ffb700 1 -- 172.21.15.80:0/636580748 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e8011830 con 0x7f47f40cbe40 2024-05-08T21:10:09.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.792+0000 7f47f1ffb700 1 -- 172.21.15.80:0/636580748 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47e8011990 con 0x7f47f40cbe40 2024-05-08T21:10:09.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.792+0000 7f47f1ffb700 1 -- 172.21.15.80:0/636580748 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e8011d20 con 0x7f47f40cbe40 2024-05-08T21:10:09.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.793+0000 7f47f96b7700 1 -- 172.21.15.80:0/636580748 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47f40cbe40 msgr2=0x7f47f415abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:09.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.793+0000 7f47f96b7700 1 --2- 172.21.15.80:0/636580748 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47f40cbe40 0x7f47f415abe0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f47e8009840 tx=0x7f47e8009b50 comp rx=0 tx=0).stop 2024-05-08T21:10:09.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.793+0000 7f47f96b7700 1 -- 172.21.15.80:0/636580748 shutdown_connections 2024-05-08T21:10:09.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.793+0000 7f47f96b7700 1 --2- 172.21.15.80:0/636580748 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47f40cbe40 0x7f47f415abe0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:09.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.793+0000 7f47f96b7700 1 -- 172.21.15.80:0/636580748 >> 172.21.15.80:0/636580748 conn(0x7f47f406c6a0 msgr2=0x7f47f406cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:09.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.793+0000 7f47f96b7700 1 -- 172.21.15.80:0/636580748 shutdown_connections 2024-05-08T21:10:09.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.793+0000 7f47f96b7700 1 -- 172.21.15.80:0/636580748 wait complete. 2024-05-08T21:10:09.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.794+0000 7f47f96b7700 1 Processor -- start 2024-05-08T21:10:09.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.794+0000 7f47f96b7700 1 -- start start 2024-05-08T21:10:09.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.795+0000 7f47f96b7700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47f40cbe40 0x7f47f414cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:09.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.795+0000 7f47f96b7700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f47f40cc3d0 0x7f47f40b4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:09.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.795+0000 7f47f96b7700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47f4154580 0x7f47f40b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:09.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.795+0000 7f47f96b7700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f415d750 con 0x7f47f4154580 2024-05-08T21:10:09.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.795+0000 7f47f96b7700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f41f0b20 con 0x7f47f40cbe40 2024-05-08T21:10:09.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.795+0000 7f47f96b7700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47f40b42a0 con 0x7f47f40cc3d0 2024-05-08T21:10:09.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.795+0000 7f47f37fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47f4154580 0x7f47f40b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:09.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.795+0000 7f47f37fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47f4154580 0x7f47f40b4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42930/0 (socket says 172.21.15.80:42930) 2024-05-08T21:10:09.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.795+0000 7f47f37fe700 1 -- 172.21.15.80:0/896936586 learned_addr learned my addr 172.21.15.80:0/896936586 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:09.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.795+0000 7f47f27fc700 1 --2- 172.21.15.80:0/896936586 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f47f40cc3d0 0x7f47f40b4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:09.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.795+0000 7f47f37fe700 1 -- 172.21.15.80:0/896936586 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f47f40cc3d0 msgr2=0x7f47f40b4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:09.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.795+0000 7f47f2ffd700 1 --2- 172.21.15.80:0/896936586 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47f40cbe40 0x7f47f414cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:09.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.795+0000 7f47f37fe700 1 --2- 172.21.15.80:0/896936586 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f47f40cc3d0 0x7f47f40b4730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:09.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.795+0000 7f47f37fe700 1 -- 172.21.15.80:0/896936586 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47f40cbe40 msgr2=0x7f47f414cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:09.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.795+0000 7f47f37fe700 1 --2- 172.21.15.80:0/896936586 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47f40cbe40 0x7f47f414cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:09.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.795+0000 7f47f37fe700 1 -- 172.21.15.80:0/896936586 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e80094a0 con 0x7f47f4154580 2024-05-08T21:10:09.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.795+0000 7f47f2ffd700 1 --2- 172.21.15.80:0/896936586 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47f40cbe40 0x7f47f414cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:10:09.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.795+0000 7f47f37fe700 1 --2- 172.21.15.80:0/896936586 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47f4154580 0x7f47f40b4c70 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f47ec002230 tx=0x7f47ec00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:09.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.795+0000 7f47db7fe700 1 -- 172.21.15.80:0/896936586 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ec00ac20 con 0x7f47f4154580 2024-05-08T21:10:09.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.795+0000 7f47db7fe700 1 -- 172.21.15.80:0/896936586 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47ec00ada0 con 0x7f47f4154580 2024-05-08T21:10:09.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.795+0000 7f47f96b7700 1 -- 172.21.15.80:0/896936586 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47f41f1010 con 0x7f47f4154580 2024-05-08T21:10:09.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.795+0000 7f47db7fe700 1 -- 172.21.15.80:0/896936586 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ec007310 con 0x7f47f4154580 2024-05-08T21:10:09.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.795+0000 7f47f96b7700 1 -- 172.21.15.80:0/896936586 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47f41f0d30 con 0x7f47f4154580 2024-05-08T21:10:09.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.796+0000 7f47f96b7700 1 -- 172.21.15.80:0/896936586 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47f40b36f0 con 0x7f47f4154580 2024-05-08T21:10:09.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.797+0000 7f47db7fe700 1 -- 172.21.15.80:0/896936586 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f47ec007470 con 0x7f47f4154580 2024-05-08T21:10:09.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.797+0000 7f47db7fe700 1 --2- 172.21.15.80:0/896936586 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f47e006ac90 0x7f47e006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:09.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.797+0000 7f47f2ffd700 1 --2- 172.21.15.80:0/896936586 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f47e006ac90 0x7f47e006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:09.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.797+0000 7f47db7fe700 1 -- 172.21.15.80:0/896936586 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f47ec089540 con 0x7f47f4154580 2024-05-08T21:10:09.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.798+0000 7f47f2ffd700 1 --2- 172.21.15.80:0/896936586 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f47e006ac90 0x7f47e006d150 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f47e4000f60 tx=0x7f47e4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:09.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.802+0000 7f47db7fe700 1 -- 172.21.15.80:0/896936586 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f47ec054430 con 0x7f47f4154580 2024-05-08T21:10:09.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.996+0000 7f47f96b7700 1 -- 172.21.15.80:0/896936586 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f47f40c4f50 con 0x7f47f4154580 2024-05-08T21:10:10.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:09.998+0000 7f47db7fe700 1 -- 172.21.15.80:0/896936586 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+17878 (secure 0 0 0) 0x7f47ec057a50 con 0x7f47f4154580 2024-05-08T21:10:10.000 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:10:10.000 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":26,"fsid":"44d31c1e-aad3-47ca-a4fa-85a63d4a60aa","created":"2024-05-08T21:09:46.467038+0000","modified":"2024-05-08T21:10:08.163735+0000","last_up_change":"2024-05-08T21:09:57.284675+0000","last_in_change":"2024-05-08T21:09:49.125444+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T21:09:58.238951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T21:10:02.177476+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T21:10:02.685535+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-08T21:10:05.753779+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c3f9d93e-ed6d-4a0c-b5c0-0e8d44c65fdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":47011},{"type":"v1","addr":"172.21.15.80:6817","nonce":47011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":47011},{"type":"v1","addr":"172.21.15.80:6819","nonce":47011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":47011},{"type":"v1","addr":"172.21.15.80:6823","nonce":47011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":47011},{"type":"v1","addr":"172.21.15.80:6821","nonce":47011}]},"public_addr":"172.21.15.80:6817/47011","cluster_addr":"172.21.15.80:6819/47011","heartbeat_back_addr":"172.21.15.80:6823/47011","heartbeat_front_addr":"172.21.15.80:6821/47011","state":["exists","up"]},{"osd":1,"uuid":"4ce2b4d6-6c40-43aa-8dd1-743fef8915df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":47010},{"type":"v1","addr":"172.21.15.80:6809","nonce":47010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":47010},{"type":"v1","addr":"172.21.15.80:6811","nonce":47010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":47010},{"type":"v1","addr":"172.21.15.80:6815","nonce":47010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":47010},{"type":"v1","addr":"172.21.15.80:6813","nonce":47010}]},"public_addr":"172.21.15.80:6809/47010","cluster_addr":"172.21.15.80:6811/47010","heartbeat_back_addr":"172.21.15.80:6815/47010","heartbeat_front_addr":"172.21.15.80:6813/47010","state":["exists","up"]},{"osd":2,"uuid":"e30cc3bc-6461-4fac-960a-de00c9488d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":47009},{"type":"v1","addr":"172.21.15.80:6801","nonce":47009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":47009},{"type":"v1","addr":"172.21.15.80:6803","nonce":47009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":47009},{"type":"v1","addr":"172.21.15.80:6807","nonce":47009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":47009},{"type":"v1","addr":"172.21.15.80:6805","nonce":47009}]},"public_addr":"172.21.15.80:6801/47009","cluster_addr":"172.21.15.80:6803/47009","heartbeat_back_addr":"172.21.15.80:6807/47009","heartbeat_front_addr":"172.21.15.80:6805/47009","state":["exists","up"]},{"osd":3,"uuid":"a415c099-9ea6-40be-98ed-f2932f98dfd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":47012},{"type":"v1","addr":"172.21.15.80:6825","nonce":47012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":47012},{"type":"v1","addr":"172.21.15.80:6827","nonce":47012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":47012},{"type":"v1","addr":"172.21.15.80:6831","nonce":47012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":47012},{"type":"v1","addr":"172.21.15.80:6829","nonce":47012}]},"public_addr":"172.21.15.80:6825/47012","cluster_addr":"172.21.15.80:6827/47012","heartbeat_back_addr":"172.21.15.80:6831/47012","heartbeat_front_addr":"172.21.15.80:6829/47012","state":["exists","up"]},{"osd":4,"uuid":"5ae1d51f-0918-4571-b79b-154308d46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6823","nonce":47114},{"type":"v1","addr":"172.21.15.106:6825","nonce":47114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":47114},{"type":"v1","addr":"172.21.15.106:6827","nonce":47114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":47114},{"type":"v1","addr":"172.21.15.106:6831","nonce":47114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":47114},{"type":"v1","addr":"172.21.15.106:6829","nonce":47114}]},"public_addr":"172.21.15.106:6825/47114","cluster_addr":"172.21.15.106:6827/47114","heartbeat_back_addr":"172.21.15.106:6831/47114","heartbeat_front_addr":"172.21.15.106:6829/47114","state":["exists","up"]},{"osd":5,"uuid":"a19ac74e-4282-4428-b167-26ba6b92f732","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6807","nonce":47111},{"type":"v1","addr":"172.21.15.106:6809","nonce":47111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":47111},{"type":"v1","addr":"172.21.15.106:6811","nonce":47111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":47111},{"type":"v1","addr":"172.21.15.106:6815","nonce":47111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":47111},{"type":"v1","addr":"172.21.15.106:6813","nonce":47111}]},"public_addr":"172.21.15.106:6809/47111","cluster_addr":"172.21.15.106:6811/47111","heartbeat_back_addr":"172.21.15.106:6815/47111","heartbeat_front_addr":"172.21.15.106:6813/47111","state":["exists","up"]},{"osd":6,"uuid":"bfe72edd-7acc-4805-807d-2000e76f2feb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":47112},{"type":"v1","addr":"172.21.15.106:6817","nonce":47112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":47112},{"type":"v1","addr":"172.21.15.106:6819","nonce":47112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":47112},{"type":"v1","addr":"172.21.15.106:6824","nonce":47112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":47112},{"type":"v1","addr":"172.21.15.106:6821","nonce":47112}]},"public_addr":"172.21.15.106:6817/47112","cluster_addr":"172.21.15.106:6819/47112","heartbeat_back_addr":"172.21.15.106:6824/47112","heartbeat_front_addr":"172.21.15.106:6821/47112","state":["exists","up"]},{"osd":7,"uuid":"99897f22-ed17-4c7c-9088-cc0c4a51f786","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":47113},{"type":"v1","addr":"172.21.15.106:6801","nonce":47113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":47113},{"type":"v1","addr":"172.21.15.106:6803","nonce":47113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":47113},{"type":"v1","addr":"172.21.15.106:6808","nonce":47113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":47113},{"type":"v1","addr":"172.21.15.106:6805","nonce":47113}]},"public_addr":"172.21.15.106:6801/47113","cluster_addr":"172.21.15.106:6803/47113","heartbeat_back_addr":"172.21.15.106:6808/47113","heartbeat_front_addr":"172.21.15.106:6805/47113","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.232670+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.277753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.050087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.349312+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.344080+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.348781+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.352539+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.275013+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T21:10:10.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:10.000+0000 7f47f96b7700 1 -- 172.21.15.80:0/896936586 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f47e006ac90 msgr2=0x7f47e006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:10.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:10.000+0000 7f47f96b7700 1 --2- 172.21.15.80:0/896936586 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f47e006ac90 0x7f47e006d150 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f47e4000f60 tx=0x7f47e4009040 comp rx=0 tx=0).stop 2024-05-08T21:10:10.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:10.000+0000 7f47f96b7700 1 -- 172.21.15.80:0/896936586 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47f4154580 msgr2=0x7f47f40b4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:10.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:10.000+0000 7f47f96b7700 1 --2- 172.21.15.80:0/896936586 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47f4154580 0x7f47f40b4c70 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f47ec002230 tx=0x7f47ec00a060 comp rx=0 tx=0).stop 2024-05-08T21:10:10.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:10.000+0000 7f47f96b7700 1 -- 172.21.15.80:0/896936586 shutdown_connections 2024-05-08T21:10:10.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:10.000+0000 7f47f96b7700 1 --2- 172.21.15.80:0/896936586 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f47e006ac90 0x7f47e006d150 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:10.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:10.000+0000 7f47f96b7700 1 --2- 172.21.15.80:0/896936586 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f47f4154580 0x7f47f40b4c70 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:10.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:10.000+0000 7f47f96b7700 1 --2- 172.21.15.80:0/896936586 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47f40cbe40 0x7f47f414cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:10.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:10.000+0000 7f47f96b7700 1 --2- 172.21.15.80:0/896936586 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f47f40cc3d0 0x7f47f40b4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:10.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:10.000+0000 7f47f96b7700 1 -- 172.21.15.80:0/896936586 >> 172.21.15.80:0/896936586 conn(0x7f47f406c6a0 msgr2=0x7f47f406ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:10.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:10.000+0000 7f47f96b7700 1 -- 172.21.15.80:0/896936586 shutdown_connections 2024-05-08T21:10:10.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:10.000+0000 7f47f96b7700 1 -- 172.21.15.80:0/896936586 wait complete. 2024-05-08T21:10:10.150 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:10:10.153 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:10:10.618 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-08T21:10:03.725481+0000', 'modified': '2024-05-08T21:10:08.163962+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4291}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4291': {'gid': 4291, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.106:6836/1949999190', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.106:6834', 'nonce': 1949999190}, {'type': 'v1', 'addr': '172.21.15.106:6836', 'nonce': 1949999190}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-05-08T21:10:10.619 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4291:up:creating 2024-05-08T21:10:11.620 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:10:11.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:11.751+0000 7fe4bf849700 1 Processor -- start 2024-05-08T21:10:11.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:11.752+0000 7fe4bf849700 1 -- start start 2024-05-08T21:10:11.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:11.752+0000 7fe4bf849700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe4b8154390 0x7fe4b815ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:11.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:11.752+0000 7fe4bf849700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe4b80ca400 0x7fe4b80cff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:11.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:11.752+0000 7fe4bf849700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe4b80ca840 0x7fe4b80d0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:11.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:11.752+0000 7fe4bf849700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4b815b1b0 con 0x7fe4b80ca400 2024-05-08T21:10:11.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:11.752+0000 7fe4bf849700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4b80c5d20 con 0x7fe4b80ca840 2024-05-08T21:10:11.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:11.752+0000 7fe4bf849700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b80732b0 con 0x7fe4b8154390 2024-05-08T21:10:11.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:11.753+0000 7fe4bcde4700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe4b80ca400 0x7fe4b80cff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:11.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:11.753+0000 7fe4bcde4700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe4b80ca400 0x7fe4b80cff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42940/0 (socket says 172.21.15.80:42940) 2024-05-08T21:10:11.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:11.753+0000 7fe4bcde4700 1 -- 172.21.15.80:0/878374989 learned_addr learned my addr 172.21.15.80:0/878374989 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:11.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:11.753+0000 7fe4bdde6700 1 --2- 172.21.15.80:0/878374989 >> v2:172.21.15.106:3300/0 conn(0x7fe4b80ca840 0x7fe4b80d0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:11.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:11.753+0000 7fe4bd5e5700 1 --2- 172.21.15.80:0/878374989 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe4b8154390 0x7fe4b815ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:11.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:11.753+0000 7fe4bcde4700 1 -- 172.21.15.80:0/878374989 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe4b8154390 msgr2=0x7fe4b815ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:11.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:11.753+0000 7fe4bcde4700 1 --2- 172.21.15.80:0/878374989 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe4b8154390 0x7fe4b815ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:11.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:11.753+0000 7fe4bcde4700 1 -- 172.21.15.80:0/878374989 >> v2:172.21.15.106:3300/0 conn(0x7fe4b80ca840 msgr2=0x7fe4b80d0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:11.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:11.753+0000 7fe4bcde4700 1 --2- 172.21.15.80:0/878374989 >> v2:172.21.15.106:3300/0 conn(0x7fe4b80ca840 0x7fe4b80d0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:11.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:11.753+0000 7fe4bcde4700 1 -- 172.21.15.80:0/878374989 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4b80c49a0 con 0x7fe4b80ca400 2024-05-08T21:10:11.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:11.753+0000 7fe4bcde4700 1 --2- 172.21.15.80:0/878374989 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4b80ca400 0x7fe4b80cff30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe4b80b2500 tx=0x7fe4a8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9993a4baf22db9a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:11.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:11.753+0000 7fe4affff700 1 -- 172.21.15.80:0/878374989 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a8005e30 con 0x7fe4b80ca400 2024-05-08T21:10:11.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:11.753+0000 7fe4affff700 1 -- 172.21.15.80:0/878374989 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4a8004030 con 0x7fe4b80ca400 2024-05-08T21:10:11.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:11.753+0000 7fe4affff700 1 -- 172.21.15.80:0/878374989 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a80043e0 con 0x7fe4b80ca400 2024-05-08T21:10:11.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:11.754+0000 7fe4bf849700 1 -- 172.21.15.80:0/878374989 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4b80ca400 msgr2=0x7fe4b80cff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:11.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:11.754+0000 7fe4bf849700 1 --2- 172.21.15.80:0/878374989 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4b80ca400 0x7fe4b80cff30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe4b80b2500 tx=0x7fe4a8009bd0 comp rx=0 tx=0).stop 2024-05-08T21:10:11.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:11.754+0000 7fe4bf849700 1 -- 172.21.15.80:0/878374989 shutdown_connections 2024-05-08T21:10:11.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:11.754+0000 7fe4bf849700 1 --2- 172.21.15.80:0/878374989 >> v2:172.21.15.106:3300/0 conn(0x7fe4b80ca840 0x7fe4b80d0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:11.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:11.754+0000 7fe4bf849700 1 --2- 172.21.15.80:0/878374989 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe4b8154390 0x7fe4b815ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:11.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:11.754+0000 7fe4bf849700 1 --2- 172.21.15.80:0/878374989 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4b80ca400 0x7fe4b80cff30 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:11.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:11.754+0000 7fe4bf849700 1 -- 172.21.15.80:0/878374989 >> 172.21.15.80:0/878374989 conn(0x7fe4b806ab90 msgr2=0x7fe4b806afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:11.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:11.754+0000 7fe4bf849700 1 -- 172.21.15.80:0/878374989 shutdown_connections 2024-05-08T21:10:11.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:11.754+0000 7fe4bf849700 1 -- 172.21.15.80:0/878374989 wait complete. 2024-05-08T21:10:11.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:11.755+0000 7fe4bf849700 1 Processor -- start 2024-05-08T21:10:11.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:11.755+0000 7fe4bf849700 1 -- start start 2024-05-08T21:10:11.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:11.756+0000 7fe4bf849700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe4b80ca400 0x7fe4b81f0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:11.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:11.756+0000 7fe4bf849700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4b80ca840 0x7fe4b815c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:11.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:11.756+0000 7fe4bf849700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe4b8154390 0x7fe4b80cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:11.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:11.756+0000 7fe4bf849700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b80cc210 con 0x7fe4b80ca840 2024-05-08T21:10:11.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:11.756+0000 7fe4bf849700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b81f0270 con 0x7fe4b8154390 2024-05-08T21:10:11.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:11.756+0000 7fe4bf849700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b81f07d0 con 0x7fe4b80ca400 2024-05-08T21:10:11.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:11.756+0000 7fe4bcde4700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4b80ca840 0x7fe4b815c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:11.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:11.756+0000 7fe4bcde4700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4b80ca840 0x7fe4b815c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42952/0 (socket says 172.21.15.80:42952) 2024-05-08T21:10:11.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:11.756+0000 7fe4bcde4700 1 -- 172.21.15.80:0/2132299342 learned_addr learned my addr 172.21.15.80:0/2132299342 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:11.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:11.756+0000 7fe4bd5e5700 1 --2- 172.21.15.80:0/2132299342 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe4b80ca400 0x7fe4b81f0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:11.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:11.756+0000 7fe4bdde6700 1 --2- 172.21.15.80:0/2132299342 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe4b8154390 0x7fe4b80cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:11.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:11.756+0000 7fe4bcde4700 1 -- 172.21.15.80:0/2132299342 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe4b80ca400 msgr2=0x7fe4b81f0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:11.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:11.756+0000 7fe4bcde4700 1 --2- 172.21.15.80:0/2132299342 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe4b80ca400 0x7fe4b81f0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:11.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:11.756+0000 7fe4bcde4700 1 -- 172.21.15.80:0/2132299342 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe4b8154390 msgr2=0x7fe4b80cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:11.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:11.756+0000 7fe4bcde4700 1 --2- 172.21.15.80:0/2132299342 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe4b8154390 0x7fe4b80cdea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:11.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:11.756+0000 7fe4bcde4700 1 -- 172.21.15.80:0/2132299342 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a8009500 con 0x7fe4b80ca840 2024-05-08T21:10:11.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:11.756+0000 7fe4bd5e5700 1 --2- 172.21.15.80:0/2132299342 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe4b80ca400 0x7fe4b81f0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:10:11.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:11.756+0000 7fe4bdde6700 1 --2- 172.21.15.80:0/2132299342 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe4b8154390 0x7fe4b80cdea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:10:11.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:11.756+0000 7fe4bcde4700 1 --2- 172.21.15.80:0/2132299342 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4b80ca840 0x7fe4b815c7f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe4b8072280 tx=0x7fe4a8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:11.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:11.756+0000 7fe4adffb700 1 -- 172.21.15.80:0/2132299342 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a8003d90 con 0x7fe4b80ca840 2024-05-08T21:10:11.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:11.756+0000 7fe4adffb700 1 -- 172.21.15.80:0/2132299342 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4a8011420 con 0x7fe4b80ca840 2024-05-08T21:10:11.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:11.756+0000 7fe4adffb700 1 -- 172.21.15.80:0/2132299342 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a80117d0 con 0x7fe4b80ca840 2024-05-08T21:10:11.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:11.756+0000 7fe4bf849700 1 -- 172.21.15.80:0/2132299342 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4b81f11a0 con 0x7fe4b80ca840 2024-05-08T21:10:11.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:11.757+0000 7fe4bf849700 1 -- 172.21.15.80:0/2132299342 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4b80ccdf0 con 0x7fe4b80ca840 2024-05-08T21:10:11.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:11.758+0000 7fe4bf849700 1 -- 172.21.15.80:0/2132299342 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4b814e5f0 con 0x7fe4b80ca840 2024-05-08T21:10:11.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:11.758+0000 7fe4adffb700 1 -- 172.21.15.80:0/2132299342 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe4a8018070 con 0x7fe4b80ca840 2024-05-08T21:10:11.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:11.758+0000 7fe4adffb700 1 --2- 172.21.15.80:0/2132299342 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe49c06ac90 0x7fe49c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:11.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:11.759+0000 7fe4bd5e5700 1 --2- 172.21.15.80:0/2132299342 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe49c06ac90 0x7fe49c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:11.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:11.759+0000 7fe4adffb700 1 -- 172.21.15.80:0/2132299342 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe4a8089fd0 con 0x7fe4b80ca840 2024-05-08T21:10:11.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:11.759+0000 7fe4bd5e5700 1 --2- 172.21.15.80:0/2132299342 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe49c06ac90 0x7fe49c06d150 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4009ae0 tx=0x7fe4b4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:11.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:11.763+0000 7fe4adffb700 1 -- 172.21.15.80:0/2132299342 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fe4a8054f50 con 0x7fe4b80ca840 2024-05-08T21:10:12.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.003+0000 7fe4bf849700 1 -- 172.21.15.80:0/2132299342 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe4b81515f0 con 0x7fe4b80ca840 2024-05-08T21:10:12.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.004+0000 7fe4adffb700 1 -- 172.21.15.80:0/2132299342 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+6251 (secure 0 0 0) 0x7fe4a8029090 con 0x7fe4b80ca840 2024-05-08T21:10:12.007 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:10:12.008 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/2289230272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":2289230272},{"type":"v1","addr":"172.21.15.106:6833","nonce":2289230272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:10:09.756612+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.106:6836/1949999190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1949999190},{"type":"v1","addr":"172.21.15.106:6836","nonce":1949999190}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-05-08T21:10:12.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.006+0000 7fe4bf849700 1 -- 172.21.15.80:0/2132299342 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe49c06ac90 msgr2=0x7fe49c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:12.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.006+0000 7fe4bf849700 1 --2- 172.21.15.80:0/2132299342 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe49c06ac90 0x7fe49c06d150 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4009ae0 tx=0x7fe4b4008040 comp rx=0 tx=0).stop 2024-05-08T21:10:12.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.006+0000 7fe4bf849700 1 -- 172.21.15.80:0/2132299342 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4b80ca840 msgr2=0x7fe4b815c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:12.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.006+0000 7fe4bf849700 1 --2- 172.21.15.80:0/2132299342 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4b80ca840 0x7fe4b815c7f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe4b8072280 tx=0x7fe4a8004750 comp rx=0 tx=0).stop 2024-05-08T21:10:12.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.007+0000 7fe4bf849700 1 -- 172.21.15.80:0/2132299342 shutdown_connections 2024-05-08T21:10:12.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.007+0000 7fe4bf849700 1 --2- 172.21.15.80:0/2132299342 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe49c06ac90 0x7fe49c06d150 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:12.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.007+0000 7fe4bf849700 1 --2- 172.21.15.80:0/2132299342 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe4b8154390 0x7fe4b80cdea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:12.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.007+0000 7fe4bf849700 1 --2- 172.21.15.80:0/2132299342 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe4b80ca400 0x7fe4b81f0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:12.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.007+0000 7fe4bf849700 1 --2- 172.21.15.80:0/2132299342 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4b80ca840 0x7fe4b815c7f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:12.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.007+0000 7fe4bf849700 1 -- 172.21.15.80:0/2132299342 >> 172.21.15.80:0/2132299342 conn(0x7fe4b806ab90 msgr2=0x7fe4b80cff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:12.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.007+0000 7fe4bf849700 1 -- 172.21.15.80:0/2132299342 shutdown_connections 2024-05-08T21:10:12.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.007+0000 7fe4bf849700 1 -- 172.21.15.80:0/2132299342 wait complete. 2024-05-08T21:10:12.011 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 7 2024-05-08T21:10:12.625 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-08T21:10:03.725481+0000', 'modified': '2024-05-08T21:10:09.756612+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4291}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4291': {'gid': 4291, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.106:6836/1949999190', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.106:6834', 'nonce': 1949999190}, {'type': 'v1', 'addr': '172.21.15.106:6836', 'nonce': 1949999190}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2024-05-08T21:10:12.625 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-08T21:10:12.626 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-05-08T21:10:12.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.750+0000 7f5a2b8d5700 1 Processor -- start 2024-05-08T21:10:12.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.751+0000 7f5a2b8d5700 1 -- start start 2024-05-08T21:10:12.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.751+0000 7f5a2b8d5700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5a240c9860 0x7f5a2415a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:12.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.751+0000 7f5a2b8d5700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f5a24072600 0x7f5a24072a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:12.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.751+0000 7f5a2b8d5700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a240c8cc0 con 0x7f5a241541a0 2024-05-08T21:10:12.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.751+0000 7f5a2b8d5700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a2406c5a0 con 0x7f5a24072600 2024-05-08T21:10:12.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.751+0000 7f5a2b8d5700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2406ce60 con 0x7f5a240c9860 2024-05-08T21:10:12.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.752+0000 7f5a28e70700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5a240c9860 0x7f5a2415a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:12.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.752+0000 7f5a29e72700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f5a24072600 0x7f5a24072a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:12.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.752+0000 7f5a29e72700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f5a24072600 0x7f5a24072a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.80:53192/0 (socket says 172.21.15.80:53192) 2024-05-08T21:10:12.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.752+0000 7f5a29e72700 1 -- 172.21.15.80:0/2721120937 learned_addr learned my addr 172.21.15.80:0/2721120937 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:12.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.752+0000 7f5a1bfff700 1 -- 172.21.15.80:0/2721120937 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 606140765 0 0) 0x7f5a240c8cc0 con 0x7f5a241541a0 2024-05-08T21:10:12.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.752+0000 7f5a1bfff700 1 -- 172.21.15.80:0/2721120937 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a100035b0 con 0x7f5a241541a0 2024-05-08T21:10:12.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.752+0000 7f5a28e70700 1 -- 172.21.15.80:0/2721120937 >> v2:172.21.15.106:3300/0 conn(0x7f5a24072600 msgr2=0x7f5a24072a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:12.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.752+0000 7f5a28e70700 1 --2- 172.21.15.80:0/2721120937 >> v2:172.21.15.106:3300/0 conn(0x7f5a24072600 0x7f5a24072a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:12.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.752+0000 7f5a28e70700 1 -- 172.21.15.80:0/2721120937 >> v1:172.21.15.106:6789/0 conn(0x7f5a241541a0 legacy=0x7f5a240c9150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:12.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.752+0000 7f5a28e70700 1 -- 172.21.15.80:0/2721120937 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a2415e710 con 0x7f5a240c9860 2024-05-08T21:10:12.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.752+0000 7f5a29e72700 1 --2- 172.21.15.80:0/2721120937 >> v2:172.21.15.106:3300/0 conn(0x7f5a24072600 0x7f5a24072a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:10:12.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.752+0000 7f5a28e70700 1 --2- 172.21.15.80:0/2721120937 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5a240c9860 0x7f5a2415a1a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5a20009840 tx=0x7f5a20009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11f7e6598c88b674 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:12.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.753+0000 7f5a1bfff700 1 -- 172.21.15.80:0/2721120937 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a20011830 con 0x7f5a240c9860 2024-05-08T21:10:12.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.753+0000 7f5a1bfff700 1 -- 172.21.15.80:0/2721120937 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a20011990 con 0x7f5a240c9860 2024-05-08T21:10:12.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.753+0000 7f5a1bfff700 1 -- 172.21.15.80:0/2721120937 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a20011d20 con 0x7f5a240c9860 2024-05-08T21:10:12.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.753+0000 7f5a2b8d5700 1 -- 172.21.15.80:0/2721120937 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5a240c9860 msgr2=0x7f5a2415a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:12.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.753+0000 7f5a2b8d5700 1 --2- 172.21.15.80:0/2721120937 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5a240c9860 0x7f5a2415a1a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5a20009840 tx=0x7f5a20009b50 comp rx=0 tx=0).stop 2024-05-08T21:10:12.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.753+0000 7f5a2b8d5700 1 -- 172.21.15.80:0/2721120937 shutdown_connections 2024-05-08T21:10:12.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.753+0000 7f5a2b8d5700 1 --2- 172.21.15.80:0/2721120937 >> v2:172.21.15.106:3300/0 conn(0x7f5a24072600 0x7f5a24072a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:12.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.753+0000 7f5a2b8d5700 1 --2- 172.21.15.80:0/2721120937 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5a240c9860 0x7f5a2415a1a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:12.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.753+0000 7f5a2b8d5700 1 -- 172.21.15.80:0/2721120937 >> 172.21.15.80:0/2721120937 conn(0x7f5a2406ef80 msgr2=0x7f5a2406f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:12.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.753+0000 7f5a2b8d5700 1 -- 172.21.15.80:0/2721120937 shutdown_connections 2024-05-08T21:10:12.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.753+0000 7f5a2b8d5700 1 -- 172.21.15.80:0/2721120937 wait complete. 2024-05-08T21:10:12.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.754+0000 7f5a2b8d5700 1 Processor -- start 2024-05-08T21:10:12.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.754+0000 7f5a2b8d5700 1 -- start start 2024-05-08T21:10:12.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.755+0000 7f5a2b8d5700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5a24072600 0x7f5a241f2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:12.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.755+0000 7f5a2b8d5700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5a240c9860 0x7f5a241ef5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:12.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.755+0000 7f5a2b8d5700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a241541a0 0x7f5a24156890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:12.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.755+0000 7f5a2b8d5700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a241577f0 con 0x7f5a241541a0 2024-05-08T21:10:12.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.755+0000 7f5a2b8d5700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a241f0a90 con 0x7f5a240c9860 2024-05-08T21:10:12.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.755+0000 7f5a2b8d5700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a241f0510 con 0x7f5a24072600 2024-05-08T21:10:12.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.755+0000 7f5a29e72700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a241541a0 0x7f5a24156890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:12.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.755+0000 7f5a29e72700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a241541a0 0x7f5a24156890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37250/0 (socket says 172.21.15.80:37250) 2024-05-08T21:10:12.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.755+0000 7f5a29e72700 1 -- 172.21.15.80:0/3889440873 learned_addr learned my addr 172.21.15.80:0/3889440873 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:12.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.755+0000 7f5a28e70700 1 --2- 172.21.15.80:0/3889440873 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5a240c9860 0x7f5a241ef5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:12.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.755+0000 7f5a29671700 1 --2- 172.21.15.80:0/3889440873 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5a24072600 0x7f5a241f2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:12.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.755+0000 7f5a29e72700 1 -- 172.21.15.80:0/3889440873 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5a24072600 msgr2=0x7f5a241f2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:12.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.755+0000 7f5a29e72700 1 --2- 172.21.15.80:0/3889440873 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5a24072600 0x7f5a241f2380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:12.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.755+0000 7f5a29e72700 1 -- 172.21.15.80:0/3889440873 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5a240c9860 msgr2=0x7f5a241ef5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:12.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.755+0000 7f5a29e72700 1 --2- 172.21.15.80:0/3889440873 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5a240c9860 0x7f5a241ef5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:12.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.755+0000 7f5a29e72700 1 -- 172.21.15.80:0/3889440873 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a1c009b30 con 0x7f5a241541a0 2024-05-08T21:10:12.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.756+0000 7f5a29e72700 1 --2- 172.21.15.80:0/3889440873 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a241541a0 0x7f5a24156890 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c00efc0 tx=0x7f5a1c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:12.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.756+0000 7f5a19ffb700 1 -- 172.21.15.80:0/3889440873 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a1c018070 con 0x7f5a241541a0 2024-05-08T21:10:12.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.756+0000 7f5a19ffb700 1 -- 172.21.15.80:0/3889440873 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a1c00f040 con 0x7f5a241541a0 2024-05-08T21:10:12.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.756+0000 7f5a19ffb700 1 -- 172.21.15.80:0/3889440873 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a1c003c20 con 0x7f5a241541a0 2024-05-08T21:10:12.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.756+0000 7f5a2b8d5700 1 -- 172.21.15.80:0/3889440873 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a200094a0 con 0x7f5a241541a0 2024-05-08T21:10:12.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.756+0000 7f5a2b8d5700 1 -- 172.21.15.80:0/3889440873 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a241f0230 con 0x7f5a241541a0 2024-05-08T21:10:12.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.757+0000 7f5a19ffb700 1 -- 172.21.15.80:0/3889440873 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5a1c00c880 con 0x7f5a241541a0 2024-05-08T21:10:12.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.758+0000 7f5a19ffb700 1 --2- 172.21.15.80:0/3889440873 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f5a0806acc0 0x7f5a0806d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:12.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.758+0000 7f5a19ffb700 1 -- 172.21.15.80:0/3889440873 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5a1c089830 con 0x7f5a241541a0 2024-05-08T21:10:12.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.758+0000 7f5a29671700 1 --2- 172.21.15.80:0/3889440873 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f5a0806acc0 0x7f5a0806d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:12.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.758+0000 7f5a29671700 1 --2- 172.21.15.80:0/3889440873 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f5a0806acc0 0x7f5a0806d180 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5a140011e0 tx=0x7f5a14009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:12.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.760+0000 7f5a37a8fb80 1 Processor -- start 2024-05-08T21:10:12.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.760+0000 7f5a37a8fb80 1 -- start start 2024-05-08T21:10:12.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.760+0000 7f5a37a8fb80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d6a3c09dd0 0x55d6a3c09450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:12.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.760+0000 7f5a37a8fb80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d6a3bcc930 0x55d6a3bf3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:12.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.760+0000 7f5a37a8fb80 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55d6a3c0a1b0 0x55d6a3bf3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:12.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.760+0000 7f5a37a8fb80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6a3b21100 con 0x55d6a3bcc930 2024-05-08T21:10:12.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.760+0000 7f5a37a8fb80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6a3b1eac0 con 0x55d6a3c09dd0 2024-05-08T21:10:12.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.760+0000 7f5a37a8fb80 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d6a3b1a3b0 con 0x55d6a3c0a1b0 2024-05-08T21:10:12.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.760+0000 7f5a28e70700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d6a3bcc930 0x55d6a3bf3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:12.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.760+0000 7f5a28e70700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d6a3bcc930 0x55d6a3bf3580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37258/0 (socket says 172.21.15.80:37258) 2024-05-08T21:10:12.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.760+0000 7f5a28e70700 1 -- 172.21.15.80:0/4054280792 learned_addr learned my addr 172.21.15.80:0/4054280792 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:12.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.760+0000 7f5a29e72700 1 --2- 172.21.15.80:0/4054280792 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55d6a3c0a1b0 0x55d6a3bf3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:12.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.760+0000 7f5a29671700 1 --2- 172.21.15.80:0/4054280792 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d6a3c09dd0 0x55d6a3c09450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:12.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.761+0000 7f5a28e70700 1 -- 172.21.15.80:0/4054280792 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55d6a3c0a1b0 msgr2=0x55d6a3bf3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:12.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.761+0000 7f5a28e70700 1 --2- 172.21.15.80:0/4054280792 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55d6a3c0a1b0 0x55d6a3bf3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:12.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.761+0000 7f5a28e70700 1 -- 172.21.15.80:0/4054280792 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d6a3c09dd0 msgr2=0x55d6a3c09450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:12.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.761+0000 7f5a28e70700 1 --2- 172.21.15.80:0/4054280792 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d6a3c09dd0 0x55d6a3c09450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:12.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.761+0000 7f5a28e70700 1 -- 172.21.15.80:0/4054280792 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d6a399b360 con 0x55d6a3bcc930 2024-05-08T21:10:12.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.761+0000 7f5a28e70700 1 --2- 172.21.15.80:0/4054280792 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d6a3bcc930 0x55d6a3bf3580 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5a20013000 tx=0x7f5a20010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6ce818f640058a0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:12.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.761+0000 7f5a06ffd700 1 -- 172.21.15.80:0/4054280792 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a20020070 con 0x55d6a3bcc930 2024-05-08T21:10:12.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.761+0000 7f5a06ffd700 1 -- 172.21.15.80:0/4054280792 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a20011630 con 0x55d6a3bcc930 2024-05-08T21:10:12.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.761+0000 7f5a06ffd700 1 -- 172.21.15.80:0/4054280792 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a20011d20 con 0x55d6a3bcc930 2024-05-08T21:10:12.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.762+0000 7f5a37a8fb80 1 -- 172.21.15.80:0/4054280792 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d6a3bcc930 msgr2=0x55d6a3bf3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:12.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.762+0000 7f5a37a8fb80 1 --2- 172.21.15.80:0/4054280792 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d6a3bcc930 0x55d6a3bf3580 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5a20013000 tx=0x7f5a20010000 comp rx=0 tx=0).stop 2024-05-08T21:10:12.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.762+0000 7f5a37a8fb80 1 -- 172.21.15.80:0/4054280792 shutdown_connections 2024-05-08T21:10:12.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.762+0000 7f5a37a8fb80 1 --2- 172.21.15.80:0/4054280792 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55d6a3c0a1b0 0x55d6a3bf3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:12.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.762+0000 7f5a37a8fb80 1 --2- 172.21.15.80:0/4054280792 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d6a3c09dd0 0x55d6a3c09450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:12.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.762+0000 7f5a37a8fb80 1 --2- 172.21.15.80:0/4054280792 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d6a3bcc930 0x55d6a3bf3580 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:12.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.762+0000 7f5a37a8fb80 1 -- 172.21.15.80:0/4054280792 >> 172.21.15.80:0/4054280792 conn(0x55d6a3b281c0 msgr2=0x55d6a3bc8300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:12.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.762+0000 7f5a37a8fb80 1 -- 172.21.15.80:0/4054280792 shutdown_connections 2024-05-08T21:10:12.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.762+0000 7f5a37a8fb80 1 -- 172.21.15.80:0/4054280792 wait complete. 2024-05-08T21:10:12.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.762+0000 7f5a37a8fb80 1 -- start start 2024-05-08T21:10:12.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.762+0000 7f5a37a8fb80 1 Processor -- start 2024-05-08T21:10:12.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.763+0000 7f5a37a8fb80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d6a3c09dd0 0x55d6a3bcae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:12.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.763+0000 7f5a37a8fb80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d6a3c0a1b0 0x55d6a3c1e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:12.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.763+0000 7f5a37a8fb80 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55d6a3bf1100 0x55d6a3be83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:12.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.763+0000 7f5a37a8fb80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6a3ab6510 con 0x55d6a3c09dd0 2024-05-08T21:10:12.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.763+0000 7f5a37a8fb80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6a3ab61b0 con 0x55d6a3c0a1b0 2024-05-08T21:10:12.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.763+0000 7f5a37a8fb80 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d6a399d650 con 0x55d6a3bf1100 2024-05-08T21:10:12.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.763+0000 7f5a37a8fb80 10 client.0 _ll_register_callbacks cb 0x55d6a3abfae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T21:10:12.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.763+0000 7f5a29671700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d6a3c09dd0 0x55d6a3bcae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:12.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.763+0000 7f5a29671700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d6a3c09dd0 0x55d6a3bcae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37268/0 (socket says 172.21.15.80:37268) 2024-05-08T21:10:12.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.763+0000 7f5a29671700 1 -- 172.21.15.80:0/2977747747 learned_addr learned my addr 172.21.15.80:0/2977747747 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:12.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.763+0000 7f5a28e70700 1 --2- 172.21.15.80:0/2977747747 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d6a3c0a1b0 0x55d6a3c1e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:12.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.763+0000 7f5a29e72700 1 --2- 172.21.15.80:0/2977747747 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55d6a3bf1100 0x55d6a3be83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:12.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.764+0000 7f5a29671700 1 -- 172.21.15.80:0/2977747747 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55d6a3bf1100 msgr2=0x55d6a3be83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:12.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.764+0000 7f5a29671700 1 --2- 172.21.15.80:0/2977747747 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55d6a3bf1100 0x55d6a3be83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:12.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.764+0000 7f5a29671700 1 -- 172.21.15.80:0/2977747747 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d6a3c0a1b0 msgr2=0x55d6a3c1e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:12.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.764+0000 7f5a29671700 1 --2- 172.21.15.80:0/2977747747 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d6a3c0a1b0 0x55d6a3c1e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:12.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.764+0000 7f5a29671700 1 -- 172.21.15.80:0/2977747747 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a2415e710 con 0x55d6a3c09dd0 2024-05-08T21:10:12.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.764+0000 7f5a29671700 1 --2- 172.21.15.80:0/2977747747 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d6a3c09dd0 0x55d6a3bcae80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5a14001e90 tx=0x7f5a14001150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2603dd2af7850b0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:12.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.764+0000 7f59fffff700 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-05-08T21:10:12.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.764+0000 7f59fffff700 1 -- 172.21.15.80:0/2977747747 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a14014af0 con 0x55d6a3c09dd0 2024-05-08T21:10:12.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.764+0000 7f59fffff700 1 -- 172.21.15.80:0/2977747747 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5a1401c040 con 0x55d6a3c09dd0 2024-05-08T21:10:12.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.764+0000 7f5a37a8fb80 1 -- 172.21.15.80:0/2977747747 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d6a3a73220 con 0x55d6a3c09dd0 2024-05-08T21:10:12.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.764+0000 7f59fffff700 1 -- 172.21.15.80:0/2977747747 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5a14014c50 con 0x55d6a3c09dd0 2024-05-08T21:10:12.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.764+0000 7f5a37a8fb80 10 client.4410 fetch_fsmap learned FSMap version 7 2024-05-08T21:10:12.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.764+0000 7f5a37a8fb80 1 -- 172.21.15.80:0/2977747747 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55d6a3947b10 con 0x55d6a3c09dd0 2024-05-08T21:10:12.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.764+0000 7f59fffff700 1 -- 172.21.15.80:0/2977747747 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d6a3a73220 con 0x55d6a3c09dd0 2024-05-08T21:10:12.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.764+0000 7f59fffff700 1 -- 172.21.15.80:0/2977747747 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 7) v1 ==== 4212+0+0 (secure 0 0 0) 0x7f5a1402a3f0 con 0x55d6a3c09dd0 2024-05-08T21:10:12.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.764+0000 7f5a37a8fb80 10 client.4410 fetch_fsmap finished waiting for FSMap version 7 2024-05-08T21:10:12.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.764+0000 7f5a37a8fb80 10 client.4410 resolve_mds: resolved name 'd' to daemon mds.d 2024-05-08T21:10:12.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.764+0000 7f5a37a8fb80 20 client.4410 populate_metadata read hostname 'smithi080' 2024-05-08T21:10:12.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.764+0000 7f5a37a8fb80 1 --2- 172.21.15.80:0/2977747747 >> [v2:172.21.15.106:6834/1949999190,v1:172.21.15.106:6836/1949999190] conn(0x55d6a3c0cf20 0x55d6a3c29560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:12.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.764+0000 7f5a37a8fb80 4 client.4410 mds_command: new command op to 4291 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T21:10:12.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.764+0000 7f5a37a8fb80 1 -- 172.21.15.80:0/2977747747 --> [v2:172.21.15.106:6834/1949999190,v1:172.21.15.106:6836/1949999190] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d6a3b99790 con 0x55d6a3c0cf20 2024-05-08T21:10:12.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.765+0000 7f5a28e70700 1 --2- 172.21.15.80:0/2977747747 >> [v2:172.21.15.106:6834/1949999190,v1:172.21.15.106:6836/1949999190] conn(0x55d6a3c0cf20 0x55d6a3c29560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:12.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.765+0000 7f59fffff700 10 client.4410 ms_handle_connect on v2:172.21.15.106:6834/1949999190 2024-05-08T21:10:12.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:12.765+0000 7f5a28e70700 1 --2- 172.21.15.80:0/2977747747 >> [v2:172.21.15.106:6834/1949999190,v1:172.21.15.106:6836/1949999190] conn(0x55d6a3c0cf20 0x55d6a3c29560 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2da483f9611784bd server_cookie=f6f864777f3a0082 in_seq=0 out_seq=0 2024-05-08T21:10:14.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.761+0000 7f59fffff700 1 -- 172.21.15.80:0/2977747747 <== mds.0 v2:172.21.15.106:6834/1949999190 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d6a3b99790 con 0x55d6a3c0cf20 2024-05-08T21:10:14.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.761+0000 7f59fffff700 10 client.4410 handle_command_reply: tid=0 2024-05-08T21:10:14.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.761+0000 7f5a37a8fb80 1 client.4410 shutdown 2024-05-08T21:10:14.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.762+0000 7f5a37a8fb80 1 -- 172.21.15.80:0/2977747747 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d6a3c09dd0 msgr2=0x55d6a3bcae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:14.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.762+0000 7f5a37a8fb80 1 --2- 172.21.15.80:0/2977747747 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d6a3c09dd0 0x55d6a3bcae80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5a14001e90 tx=0x7f5a14001150 comp rx=0 tx=0).stop 2024-05-08T21:10:14.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.762+0000 7f5a37a8fb80 1 -- 172.21.15.80:0/2977747747 shutdown_connections 2024-05-08T21:10:14.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.762+0000 7f5a37a8fb80 1 --2- 172.21.15.80:0/2977747747 >> [v2:172.21.15.106:6834/1949999190,v1:172.21.15.106:6836/1949999190] conn(0x55d6a3c0cf20 0x55d6a3c29560 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:14.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.762+0000 7f5a37a8fb80 1 --2- 172.21.15.80:0/2977747747 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d6a3c09dd0 0x55d6a3bcae80 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:14.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.762+0000 7f5a37a8fb80 1 --2- 172.21.15.80:0/2977747747 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55d6a3bf1100 0x55d6a3be83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:14.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.762+0000 7f5a37a8fb80 1 --2- 172.21.15.80:0/2977747747 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d6a3c0a1b0 0x55d6a3c1e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:14.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.762+0000 7f59fffff700 0 client.4410 ms_handle_reset on v2:172.21.15.106:6834/1949999190 2024-05-08T21:10:14.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.762+0000 7f5a37a8fb80 1 -- 172.21.15.80:0/2977747747 >> 172.21.15.80:0/2977747747 conn(0x55d6a3b281c0 msgr2=0x55d6a3bc8290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:14.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.762+0000 7f5a37a8fb80 1 -- 172.21.15.80:0/2977747747 shutdown_connections 2024-05-08T21:10:14.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.762+0000 7f5a37a8fb80 1 -- 172.21.15.80:0/2977747747 wait complete. 2024-05-08T21:10:14.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.762+0000 7f5a37a8fb80 20 client.4410 trim_cache size 0 max 16384 2024-05-08T21:10:14.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.781+0000 7f5a37a8fb80 1 Processor -- start 2024-05-08T21:10:14.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.781+0000 7f5a37a8fb80 1 -- start start 2024-05-08T21:10:14.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.782+0000 7f5a37a8fb80 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55d6a3bf1100 0x55d6a3c1a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:14.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.782+0000 7f5a37a8fb80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d6a3c09dd0 0x55d6a3c1ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:14.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.782+0000 7f5a37a8fb80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d6a3c0a1b0 0x55d6a3c0bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:14.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.782+0000 7f5a37a8fb80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6a3c1e980 con 0x55d6a3c09dd0 2024-05-08T21:10:14.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.782+0000 7f5a37a8fb80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6a3bec1d0 con 0x55d6a3c0a1b0 2024-05-08T21:10:14.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.782+0000 7f5a37a8fb80 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d6a3bc5500 con 0x55d6a3bf1100 2024-05-08T21:10:14.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.782+0000 7f5a28e70700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d6a3c09dd0 0x55d6a3c1ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:14.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.782+0000 7f5a28e70700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d6a3c09dd0 0x55d6a3c1ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37284/0 (socket says 172.21.15.80:37284) 2024-05-08T21:10:14.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.782+0000 7f5a28e70700 1 -- 172.21.15.80:0/3217428797 learned_addr learned my addr 172.21.15.80:0/3217428797 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:14.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.782+0000 7f5a29e72700 1 --2- 172.21.15.80:0/3217428797 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d6a3c0a1b0 0x55d6a3c0bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:14.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.782+0000 7f5a29671700 1 --2- 172.21.15.80:0/3217428797 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55d6a3bf1100 0x55d6a3c1a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:14.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.782+0000 7f5a28e70700 1 -- 172.21.15.80:0/3217428797 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55d6a3bf1100 msgr2=0x55d6a3c1a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:14.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.782+0000 7f5a28e70700 1 --2- 172.21.15.80:0/3217428797 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55d6a3bf1100 0x55d6a3c1a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:14.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.782+0000 7f5a28e70700 1 -- 172.21.15.80:0/3217428797 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d6a3c0a1b0 msgr2=0x55d6a3c0bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:14.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.782+0000 7f5a28e70700 1 --2- 172.21.15.80:0/3217428797 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d6a3c0a1b0 0x55d6a3c0bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:14.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.782+0000 7f5a28e70700 1 -- 172.21.15.80:0/3217428797 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d6a3ae0510 con 0x55d6a3c09dd0 2024-05-08T21:10:14.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.782+0000 7f5a29e72700 1 --2- 172.21.15.80:0/3217428797 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d6a3c0a1b0 0x55d6a3c0bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:10:14.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.782+0000 7f5a28e70700 1 --2- 172.21.15.80:0/3217428797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d6a3c09dd0 0x55d6a3c1ad90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5a2406c070 tx=0x7f5a20009210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f52f0b55f26a167e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:14.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.782+0000 7f5a077fe700 1 -- 172.21.15.80:0/3217428797 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a20020040 con 0x55d6a3c09dd0 2024-05-08T21:10:14.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.782+0000 7f5a077fe700 1 -- 172.21.15.80:0/3217428797 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a20004240 con 0x55d6a3c09dd0 2024-05-08T21:10:14.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.782+0000 7f5a077fe700 1 -- 172.21.15.80:0/3217428797 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a20006ab0 con 0x55d6a3c09dd0 2024-05-08T21:10:14.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.783+0000 7f5a37a8fb80 1 -- 172.21.15.80:0/3217428797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d6a3c09dd0 msgr2=0x55d6a3c1ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:14.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.783+0000 7f5a37a8fb80 1 --2- 172.21.15.80:0/3217428797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d6a3c09dd0 0x55d6a3c1ad90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5a2406c070 tx=0x7f5a20009210 comp rx=0 tx=0).stop 2024-05-08T21:10:14.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.783+0000 7f5a37a8fb80 1 -- 172.21.15.80:0/3217428797 shutdown_connections 2024-05-08T21:10:14.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.783+0000 7f5a37a8fb80 1 --2- 172.21.15.80:0/3217428797 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d6a3c0a1b0 0x55d6a3c0bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:14.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.783+0000 7f5a37a8fb80 1 --2- 172.21.15.80:0/3217428797 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55d6a3bf1100 0x55d6a3c1a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:14.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.783+0000 7f5a37a8fb80 1 --2- 172.21.15.80:0/3217428797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d6a3c09dd0 0x55d6a3c1ad90 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:14.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.783+0000 7f5a37a8fb80 1 -- 172.21.15.80:0/3217428797 >> 172.21.15.80:0/3217428797 conn(0x55d6a3b281c0 msgr2=0x55d6a3bc72b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:14.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.783+0000 7f5a37a8fb80 1 -- 172.21.15.80:0/3217428797 shutdown_connections 2024-05-08T21:10:14.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.783+0000 7f5a37a8fb80 1 -- 172.21.15.80:0/3217428797 wait complete. 2024-05-08T21:10:14.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.784+0000 7f5a37a8fb80 1 -- start start 2024-05-08T21:10:14.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.784+0000 7f5a37a8fb80 1 Processor -- start 2024-05-08T21:10:14.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.785+0000 7f5a37a8fb80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d6a3bf1100 0x55d6a3c2df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:14.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.785+0000 7f5a37a8fb80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d6a3c09dd0 0x55d6a3bea850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:14.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.785+0000 7f5a37a8fb80 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55d6a3c0a1b0 0x55d6a3c78440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:14.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.785+0000 7f5a37a8fb80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6a3bead90 con 0x55d6a3bf1100 2024-05-08T21:10:14.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.785+0000 7f5a37a8fb80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6a3c0d6f0 con 0x55d6a3c09dd0 2024-05-08T21:10:14.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.785+0000 7f5a37a8fb80 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d6a3c2d870 con 0x55d6a3c0a1b0 2024-05-08T21:10:14.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.785+0000 7f5a37a8fb80 10 client.0 _ll_register_callbacks cb 0x55d6a3abfae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T21:10:14.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.785+0000 7f5a29671700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d6a3bf1100 0x55d6a3c2df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:14.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.785+0000 7f5a29671700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d6a3bf1100 0x55d6a3c2df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37300/0 (socket says 172.21.15.80:37300) 2024-05-08T21:10:14.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.785+0000 7f5a29671700 1 -- 172.21.15.80:0/516920660 learned_addr learned my addr 172.21.15.80:0/516920660 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:14.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.785+0000 7f5a29e72700 1 --2- 172.21.15.80:0/516920660 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55d6a3c0a1b0 0x55d6a3c78440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:14.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.785+0000 7f5a28e70700 1 --2- 172.21.15.80:0/516920660 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d6a3c09dd0 0x55d6a3bea850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:14.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.785+0000 7f5a29671700 1 -- 172.21.15.80:0/516920660 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55d6a3c0a1b0 msgr2=0x55d6a3c78440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:14.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.785+0000 7f5a29671700 1 --2- 172.21.15.80:0/516920660 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55d6a3c0a1b0 0x55d6a3c78440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:14.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.785+0000 7f5a29671700 1 -- 172.21.15.80:0/516920660 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d6a3c09dd0 msgr2=0x55d6a3bea850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:14.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.785+0000 7f5a29671700 1 --2- 172.21.15.80:0/516920660 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d6a3c09dd0 0x55d6a3bea850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:14.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.785+0000 7f5a29671700 1 -- 172.21.15.80:0/516920660 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d6a399b360 con 0x55d6a3bf1100 2024-05-08T21:10:14.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.786+0000 7f5a29671700 1 --2- 172.21.15.80:0/516920660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d6a3bf1100 0x55d6a3c2df10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5a1400f530 tx=0x7f5a14015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31e1866152f57326 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:14.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.786+0000 7f59fffff700 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-05-08T21:10:14.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.786+0000 7f59fffff700 1 -- 172.21.15.80:0/516920660 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a1403b410 con 0x55d6a3bf1100 2024-05-08T21:10:14.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.786+0000 7f59fffff700 1 -- 172.21.15.80:0/516920660 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5a1403b570 con 0x55d6a3bf1100 2024-05-08T21:10:14.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.786+0000 7f5a37a8fb80 1 -- 172.21.15.80:0/516920660 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5a20011630 con 0x55d6a3bf1100 2024-05-08T21:10:14.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.786+0000 7f59fffff700 1 -- 172.21.15.80:0/516920660 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5a1403b730 con 0x55d6a3bf1100 2024-05-08T21:10:14.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.786+0000 7f5a37a8fb80 10 client.4416 fetch_fsmap learned FSMap version 7 2024-05-08T21:10:14.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.786+0000 7f5a37a8fb80 1 -- 172.21.15.80:0/516920660 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55d6a399fc80 con 0x55d6a3bf1100 2024-05-08T21:10:14.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.786+0000 7f59fffff700 1 -- 172.21.15.80:0/516920660 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a20011630 con 0x55d6a3bf1100 2024-05-08T21:10:14.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.786+0000 7f59fffff700 1 -- 172.21.15.80:0/516920660 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 7) v1 ==== 4212+0+0 (secure 0 0 0) 0x7f5a1403b890 con 0x55d6a3bf1100 2024-05-08T21:10:14.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.786+0000 7f5a37a8fb80 10 client.4416 fetch_fsmap finished waiting for FSMap version 7 2024-05-08T21:10:14.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.786+0000 7f5a37a8fb80 10 client.4416 resolve_mds: resolved name 'd' to daemon mds.d 2024-05-08T21:10:14.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.786+0000 7f5a37a8fb80 20 client.4416 populate_metadata read hostname 'smithi080' 2024-05-08T21:10:14.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.786+0000 7f5a37a8fb80 1 --2- 172.21.15.80:0/516920660 >> [v2:172.21.15.106:6834/1949999190,v1:172.21.15.106:6836/1949999190] conn(0x55d6a3c78f30 0x55d6a3c773c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:14.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.786+0000 7f5a37a8fb80 4 client.4416 mds_command: new command op to 4291 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-08T21:10:14.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.786+0000 7f5a37a8fb80 1 -- 172.21.15.80:0/516920660 --> [v2:172.21.15.106:6834/1949999190,v1:172.21.15.106:6836/1949999190] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d6a3b12e70 con 0x55d6a3c78f30 2024-05-08T21:10:14.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.787+0000 7f5a28e70700 1 --2- 172.21.15.80:0/516920660 >> [v2:172.21.15.106:6834/1949999190,v1:172.21.15.106:6836/1949999190] conn(0x55d6a3c78f30 0x55d6a3c773c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:14.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.787+0000 7f5a28e70700 1 -- 172.21.15.80:0/516920660 >> [v2:172.21.15.106:6834/1949999190,v1:172.21.15.106:6836/1949999190] conn(0x55d6a3c78f30 msgr2=0x55d6a3c773c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 19 2024-05-08T21:10:14.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.787+0000 7f5a28e70700 1 -- 172.21.15.80:0/516920660 >> [v2:172.21.15.106:6834/1949999190,v1:172.21.15.106:6836/1949999190] conn(0x55d6a3c78f30 msgr2=0x55d6a3c773c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T21:10:14.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.787+0000 7f5a28e70700 1 --2- 172.21.15.80:0/516920660 >> [v2:172.21.15.106:6834/1949999190,v1:172.21.15.106:6836/1949999190] conn(0x55d6a3c78f30 0x55d6a3c773c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T21:10:14.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.787+0000 7f5a28e70700 1 --2- 172.21.15.80:0/516920660 >> [v2:172.21.15.106:6834/1949999190,v1:172.21.15.106:6836/1949999190] conn(0x55d6a3c78f30 0x55d6a3c773c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T21:10:14.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.988+0000 7f5a28e70700 1 --2- 172.21.15.80:0/516920660 >> [v2:172.21.15.106:6834/1949999190,v1:172.21.15.106:6836/1949999190] conn(0x55d6a3c78f30 0x55d6a3c773c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:14.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.988+0000 7f5a28e70700 1 --2- 172.21.15.80:0/516920660 >> [v2:172.21.15.106:6834/1949999190,v1:172.21.15.106:6836/1949999190] conn(0x55d6a3c78f30 0x55d6a3c773c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=582db76be214aa44 server_cookie=45e059f900e5bb40 in_seq=0 out_seq=0 2024-05-08T21:10:14.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.988+0000 7f59fffff700 10 client.4416 ms_handle_connect on v2:172.21.15.106:6834/1949999190 2024-05-08T21:10:14.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.989+0000 7f59fffff700 1 -- 172.21.15.80:0/516920660 <== mds.0 v2:172.21.15.106:6834/1949999190 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55d6a3b12e70 con 0x55d6a3c78f30 2024-05-08T21:10:14.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.989+0000 7f59fffff700 10 client.4416 handle_command_reply: tid=0 2024-05-08T21:10:14.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.989+0000 7f5a37a8fb80 1 client.4416 shutdown 2024-05-08T21:10:14.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.989+0000 7f5a37a8fb80 1 -- 172.21.15.80:0/516920660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d6a3bf1100 msgr2=0x55d6a3c2df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:14.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.989+0000 7f5a37a8fb80 1 --2- 172.21.15.80:0/516920660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d6a3bf1100 0x55d6a3c2df10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5a1400f530 tx=0x7f5a14015000 comp rx=0 tx=0).stop 2024-05-08T21:10:14.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.989+0000 7f5a37a8fb80 1 -- 172.21.15.80:0/516920660 shutdown_connections 2024-05-08T21:10:14.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.989+0000 7f5a37a8fb80 1 --2- 172.21.15.80:0/516920660 >> [v2:172.21.15.106:6834/1949999190,v1:172.21.15.106:6836/1949999190] conn(0x55d6a3c78f30 0x55d6a3c773c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:14.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.989+0000 7f5a37a8fb80 1 --2- 172.21.15.80:0/516920660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55d6a3bf1100 0x55d6a3c2df10 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:14.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.989+0000 7f5a37a8fb80 1 --2- 172.21.15.80:0/516920660 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55d6a3c0a1b0 0x55d6a3c78440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:14.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.989+0000 7f59fffff700 0 client.4416 ms_handle_reset on v2:172.21.15.106:6834/1949999190 2024-05-08T21:10:14.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.989+0000 7f5a37a8fb80 1 --2- 172.21.15.80:0/516920660 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d6a3c09dd0 0x55d6a3bea850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:14.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.989+0000 7f5a37a8fb80 1 -- 172.21.15.80:0/516920660 >> 172.21.15.80:0/516920660 conn(0x55d6a3b281c0 msgr2=0x55d6a3c1a850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:14.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.989+0000 7f5a37a8fb80 1 -- 172.21.15.80:0/516920660 shutdown_connections 2024-05-08T21:10:14.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.989+0000 7f5a37a8fb80 1 -- 172.21.15.80:0/516920660 wait complete. 2024-05-08T21:10:14.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.989+0000 7f5a37a8fb80 20 client.4416 trim_cache size 0 max 16384 2024-05-08T21:10:14.994 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T21:10:14.994 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_fsid": "44d31c1e-aad3-47ca-a4fa-85a63d4a60aa", 2024-05-08T21:10:14.994 INFO:teuthology.orchestra.run.smithi080.stdout: "whoami": 0, 2024-05-08T21:10:14.994 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 4291, 2024-05-08T21:10:14.994 INFO:teuthology.orchestra.run.smithi080.stdout: "want_state": "up:active", 2024-05-08T21:10:14.994 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "up:active", 2024-05-08T21:10:14.994 INFO:teuthology.orchestra.run.smithi080.stdout: "fs_name": "cephfs", 2024-05-08T21:10:14.994 INFO:teuthology.orchestra.run.smithi080.stdout: "rank_uptime": 11.262202886000001, 2024-05-08T21:10:14.995 INFO:teuthology.orchestra.run.smithi080.stdout: "mdsmap_epoch": 6, 2024-05-08T21:10:14.995 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch": 26, 2024-05-08T21:10:14.995 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch_barrier": 26, 2024-05-08T21:10:14.995 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 17.266490112 2024-05-08T21:10:14.995 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T21:10:14.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.990+0000 7f5a2b8d5700 1 -- 172.21.15.80:0/3889440873 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f5a0806acc0 msgr2=0x7f5a0806d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:14.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.990+0000 7f5a2b8d5700 1 --2- 172.21.15.80:0/3889440873 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f5a0806acc0 0x7f5a0806d180 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5a140011e0 tx=0x7f5a14009040 comp rx=0 tx=0).stop 2024-05-08T21:10:14.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.990+0000 7f5a2b8d5700 1 -- 172.21.15.80:0/3889440873 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a241541a0 msgr2=0x7f5a24156890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:14.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.990+0000 7f5a2b8d5700 1 --2- 172.21.15.80:0/3889440873 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a241541a0 0x7f5a24156890 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c00efc0 tx=0x7f5a1c00c3a0 comp rx=0 tx=0).stop 2024-05-08T21:10:14.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.990+0000 7f5a2b8d5700 1 -- 172.21.15.80:0/3889440873 shutdown_connections 2024-05-08T21:10:14.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.990+0000 7f5a2b8d5700 1 --2- 172.21.15.80:0/3889440873 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f5a0806acc0 0x7f5a0806d180 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:14.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.990+0000 7f5a2b8d5700 1 --2- 172.21.15.80:0/3889440873 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5a241541a0 0x7f5a24156890 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:14.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.990+0000 7f5a2b8d5700 1 --2- 172.21.15.80:0/3889440873 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5a24072600 0x7f5a241f2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:14.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.990+0000 7f5a2b8d5700 1 --2- 172.21.15.80:0/3889440873 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5a240c9860 0x7f5a241ef5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:14.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.990+0000 7f5a2b8d5700 1 -- 172.21.15.80:0/3889440873 >> 172.21.15.80:0/3889440873 conn(0x7f5a2406ef80 msgr2=0x7f5a24151250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:14.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.990+0000 7f5a2b8d5700 1 -- 172.21.15.80:0/3889440873 shutdown_connections 2024-05-08T21:10:14.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:14.990+0000 7f5a2b8d5700 1 -- 172.21.15.80:0/3889440873 wait complete. 2024-05-08T21:10:15.009 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-08T21:10:15.009 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-05-08T21:10:15.009 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-08T21:10:15.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.134+0000 7f48bb862700 1 Processor -- start 2024-05-08T21:10:15.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.134+0000 7f48bb862700 1 -- start start 2024-05-08T21:10:15.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.135+0000 7f48bb862700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f48b40cc010 0x7f48b40cb370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:15.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.135+0000 7f48bb862700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f48b40cb8b0 0x7f48b406a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:15.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.135+0000 7f48bb862700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48b40c7c10 con 0x7f48b4154530 2024-05-08T21:10:15.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.135+0000 7f48bb862700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48b4154910 con 0x7f48b40cb8b0 2024-05-08T21:10:15.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.135+0000 7f48bb862700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48b415a150 con 0x7f48b40cc010 2024-05-08T21:10:15.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.135+0000 7f48b8dfd700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f48b40cc010 0x7f48b40cb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:15.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.135+0000 7f48b9dff700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f48b40cb8b0 0x7f48b406a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:15.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.135+0000 7f48b95fe700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f48b4154530 0x7f48b415ab60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.80:44160/0 (socket says 172.21.15.80:44160) 2024-05-08T21:10:15.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.135+0000 7f48b95fe700 1 -- 172.21.15.80:0/923458438 learned_addr learned my addr 172.21.15.80:0/923458438 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:10:15.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.135+0000 7f48b8dfd700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f48b40cc010 0x7f48b40cb370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:59636/0 (socket says 172.21.15.80:59636) 2024-05-08T21:10:15.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.135+0000 7f48b8dfd700 1 -- 172.21.15.80:0/923458438 >> v2:172.21.15.106:3300/0 conn(0x7f48b40cb8b0 msgr2=0x7f48b406a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:15.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.135+0000 7f48b8dfd700 1 --2- 172.21.15.80:0/923458438 >> v2:172.21.15.106:3300/0 conn(0x7f48b40cb8b0 0x7f48b406a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:15.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.135+0000 7f48b8dfd700 1 -- 172.21.15.80:0/923458438 >> v1:172.21.15.106:6789/0 conn(0x7f48b4154530 legacy=0x7f48b415ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:15.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.135+0000 7f48b8dfd700 1 -- 172.21.15.80:0/923458438 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b40c70b0 con 0x7f48b40cc010 2024-05-08T21:10:15.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.135+0000 7f48abfff700 1 -- 172.21.15.80:0/923458438 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3939723410 0 0) 0x7f48b40c7c10 con 0x7f48b4154530 2024-05-08T21:10:15.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.135+0000 7f48b9dff700 1 --2- 172.21.15.80:0/923458438 >> v2:172.21.15.106:3300/0 conn(0x7f48b40cb8b0 0x7f48b406a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:10:15.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.136+0000 7f48b8dfd700 1 --2- 172.21.15.80:0/923458438 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f48b40cc010 0x7f48b40cb370 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f48a4009840 tx=0x7f48a4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15004a75382ffda9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:15.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.136+0000 7f48abfff700 1 -- 172.21.15.80:0/923458438 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a4011830 con 0x7f48b40cc010 2024-05-08T21:10:15.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.136+0000 7f48abfff700 1 -- 172.21.15.80:0/923458438 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48a4011990 con 0x7f48b40cc010 2024-05-08T21:10:15.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.136+0000 7f48abfff700 1 -- 172.21.15.80:0/923458438 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a4011d20 con 0x7f48b40cc010 2024-05-08T21:10:15.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.136+0000 7f48bb862700 1 -- 172.21.15.80:0/923458438 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f48b40cc010 msgr2=0x7f48b40cb370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:15.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.136+0000 7f48bb862700 1 --2- 172.21.15.80:0/923458438 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f48b40cc010 0x7f48b40cb370 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f48a4009840 tx=0x7f48a4009b50 comp rx=0 tx=0).stop 2024-05-08T21:10:15.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.136+0000 7f48bb862700 1 -- 172.21.15.80:0/923458438 shutdown_connections 2024-05-08T21:10:15.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.136+0000 7f48bb862700 1 --2- 172.21.15.80:0/923458438 >> v2:172.21.15.106:3300/0 conn(0x7f48b40cb8b0 0x7f48b406a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:15.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.136+0000 7f48bb862700 1 --2- 172.21.15.80:0/923458438 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f48b40cc010 0x7f48b40cb370 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:15.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.136+0000 7f48bb862700 1 -- 172.21.15.80:0/923458438 >> 172.21.15.80:0/923458438 conn(0x7f48b4066960 msgr2=0x7f48b406eff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:15.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.137+0000 7f48bb862700 1 -- 172.21.15.80:0/923458438 shutdown_connections 2024-05-08T21:10:15.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.137+0000 7f48bb862700 1 -- 172.21.15.80:0/923458438 wait complete. 2024-05-08T21:10:15.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.138+0000 7f48bb862700 1 Processor -- start 2024-05-08T21:10:15.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.138+0000 7f48bb862700 1 -- start start 2024-05-08T21:10:15.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.139+0000 7f48bb862700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f48b40cb8b0 0x7f48b40c39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:15.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.139+0000 7f48bb862700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f48b40cc010 0x7f48b414d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:15.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.139+0000 7f48bb862700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48b4154530 0x7f48b41f2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:15.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.139+0000 7f48bb862700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b40c5b10 con 0x7f48b4154530 2024-05-08T21:10:15.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.139+0000 7f48bb862700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b414f1e0 con 0x7f48b40cb8b0 2024-05-08T21:10:15.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.139+0000 7f48bb862700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48b41503d0 con 0x7f48b40cc010 2024-05-08T21:10:15.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.139+0000 7f48b9dff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48b4154530 0x7f48b41f2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:15.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.139+0000 7f48b9dff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48b4154530 0x7f48b41f2f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37312/0 (socket says 172.21.15.80:37312) 2024-05-08T21:10:15.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.139+0000 7f48b9dff700 1 -- 172.21.15.80:0/2244292604 learned_addr learned my addr 172.21.15.80:0/2244292604 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:15.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.139+0000 7f48b8dfd700 1 --2- 172.21.15.80:0/2244292604 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f48b40cc010 0x7f48b414d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:15.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.139+0000 7f48b95fe700 1 --2- 172.21.15.80:0/2244292604 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f48b40cb8b0 0x7f48b40c39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:15.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.139+0000 7f48b9dff700 1 -- 172.21.15.80:0/2244292604 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f48b40cc010 msgr2=0x7f48b414d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:15.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.139+0000 7f48b9dff700 1 --2- 172.21.15.80:0/2244292604 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f48b40cc010 0x7f48b414d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:15.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.139+0000 7f48b9dff700 1 -- 172.21.15.80:0/2244292604 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f48b40cb8b0 msgr2=0x7f48b40c39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:15.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.139+0000 7f48b9dff700 1 --2- 172.21.15.80:0/2244292604 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f48b40cb8b0 0x7f48b40c39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:15.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.139+0000 7f48b9dff700 1 -- 172.21.15.80:0/2244292604 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48ac009a70 con 0x7f48b4154530 2024-05-08T21:10:15.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.139+0000 7f48b8dfd700 1 --2- 172.21.15.80:0/2244292604 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f48b40cc010 0x7f48b414d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:10:15.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.139+0000 7f48b95fe700 1 --2- 172.21.15.80:0/2244292604 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f48b40cb8b0 0x7f48b40c39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:10:15.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.140+0000 7f48b9dff700 1 --2- 172.21.15.80:0/2244292604 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48b4154530 0x7f48b41f2f30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f48ac009e60 tx=0x7f48ac00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:15.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.140+0000 7f48a9ffb700 1 -- 172.21.15.80:0/2244292604 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ac009cd0 con 0x7f48b4154530 2024-05-08T21:10:15.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.140+0000 7f48a9ffb700 1 -- 172.21.15.80:0/2244292604 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48ac00f040 con 0x7f48b4154530 2024-05-08T21:10:15.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.140+0000 7f48bb862700 1 -- 172.21.15.80:0/2244292604 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48a40094a0 con 0x7f48b4154530 2024-05-08T21:10:15.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.140+0000 7f48a9ffb700 1 -- 172.21.15.80:0/2244292604 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ac00ce20 con 0x7f48b4154530 2024-05-08T21:10:15.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.140+0000 7f48bb862700 1 -- 172.21.15.80:0/2244292604 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48b414f410 con 0x7f48b4154530 2024-05-08T21:10:15.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.141+0000 7f48bb862700 1 -- 172.21.15.80:0/2244292604 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48b404ec60 con 0x7f48b4154530 2024-05-08T21:10:15.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.141+0000 7f48a9ffb700 1 -- 172.21.15.80:0/2244292604 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f48ac014480 con 0x7f48b4154530 2024-05-08T21:10:15.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.142+0000 7f48a9ffb700 1 --2- 172.21.15.80:0/2244292604 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f489806acc0 0x7f489806d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:15.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.142+0000 7f48a9ffb700 1 -- 172.21.15.80:0/2244292604 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f48ac089d70 con 0x7f48b4154530 2024-05-08T21:10:15.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.142+0000 7f48b95fe700 1 --2- 172.21.15.80:0/2244292604 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f489806acc0 0x7f489806d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:15.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.142+0000 7f48b95fe700 1 --2- 172.21.15.80:0/2244292604 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f489806acc0 0x7f489806d180 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f48b0000f60 tx=0x7f48b0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:15.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.146+0000 7f48a9ffb700 1 -- 172.21.15.80:0/2244292604 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f48ac054bc0 con 0x7f48b4154530 2024-05-08T21:10:15.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.388+0000 7f48bb862700 1 -- 172.21.15.80:0/2244292604 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f48b40cbdf0 con 0x7f48b4154530 2024-05-08T21:10:15.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.388+0000 7f48a9ffb700 1 -- 172.21.15.80:0/2244292604 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f48ac018070 con 0x7f48b4154530 2024-05-08T21:10:15.392 INFO:teuthology.orchestra.run.smithi080.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-08T21:10:15.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.390+0000 7f48bb862700 1 -- 172.21.15.80:0/2244292604 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f489806acc0 msgr2=0x7f489806d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:15.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.390+0000 7f48bb862700 1 --2- 172.21.15.80:0/2244292604 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f489806acc0 0x7f489806d180 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f48b0000f60 tx=0x7f48b0009040 comp rx=0 tx=0).stop 2024-05-08T21:10:15.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.390+0000 7f48bb862700 1 -- 172.21.15.80:0/2244292604 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48b4154530 msgr2=0x7f48b41f2f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:15.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.390+0000 7f48bb862700 1 --2- 172.21.15.80:0/2244292604 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48b4154530 0x7f48b41f2f30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f48ac009e60 tx=0x7f48ac00c3a0 comp rx=0 tx=0).stop 2024-05-08T21:10:15.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.391+0000 7f48bb862700 1 -- 172.21.15.80:0/2244292604 shutdown_connections 2024-05-08T21:10:15.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.391+0000 7f48bb862700 1 --2- 172.21.15.80:0/2244292604 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f489806acc0 0x7f489806d180 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:15.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.391+0000 7f48bb862700 1 --2- 172.21.15.80:0/2244292604 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f48b4154530 0x7f48b41f2f30 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:15.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.391+0000 7f48bb862700 1 --2- 172.21.15.80:0/2244292604 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f48b40cb8b0 0x7f48b40c39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:15.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.391+0000 7f48bb862700 1 --2- 172.21.15.80:0/2244292604 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f48b40cc010 0x7f48b414d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:15.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.391+0000 7f48bb862700 1 -- 172.21.15.80:0/2244292604 >> 172.21.15.80:0/2244292604 conn(0x7f48b4066960 msgr2=0x7f48b40720b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:15.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.391+0000 7f48bb862700 1 -- 172.21.15.80:0/2244292604 shutdown_connections 2024-05-08T21:10:15.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:15.391+0000 7f48bb862700 1 -- 172.21.15.80:0/2244292604 wait complete. 2024-05-08T21:10:15.406 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-08T21:10:15.406 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-08T21:10:15.406 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi080.front.sepia.ceph.com 2024-05-08T21:10:15.406 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-05-08T21:10:15.406 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-05-08T21:10:15.406 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-08T21:10:15.406 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-08T21:10:15.406 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-08T21:10:15.406 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-05-08T21:10:15.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:10:15.407 DEBUG:teuthology.orchestra.run.smithi080:> ip addr 2024-05-08T21:10:15.424 INFO:teuthology.orchestra.run.smithi080.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-08T21:10:15.424 INFO:teuthology.orchestra.run.smithi080.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-08T21:10:15.424 INFO:teuthology.orchestra.run.smithi080.stdout: inet 127.0.0.1/8 scope host lo 2024-05-08T21:10:15.424 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-05-08T21:10:15.424 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 ::1/128 scope host 2024-05-08T21:10:15.424 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-05-08T21:10:15.424 INFO:teuthology.orchestra.run.smithi080.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T21:10:15.424 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:d8:d9:b2 brd ff:ff:ff:ff:ff:ff 2024-05-08T21:10:15.424 INFO:teuthology.orchestra.run.smithi080.stdout: altname enp7s0f0 2024-05-08T21:10:15.424 INFO:teuthology.orchestra.run.smithi080.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T21:10:15.424 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:d8:d9:b3 brd ff:ff:ff:ff:ff:ff 2024-05-08T21:10:15.424 INFO:teuthology.orchestra.run.smithi080.stdout: altname enp7s0f1 2024-05-08T21:10:15.424 INFO:teuthology.orchestra.run.smithi080.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T21:10:15.424 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:8f:cb:a8 brd ff:ff:ff:ff:ff:ff 2024-05-08T21:10:15.425 INFO:teuthology.orchestra.run.smithi080.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-08T21:10:15.425 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:8f:cb:a9 brd ff:ff:ff:ff:ff:ff 2024-05-08T21:10:15.425 INFO:teuthology.orchestra.run.smithi080.stdout: inet 172.21.15.80/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-08T21:10:15.425 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft 42306sec preferred_lft 42306sec 2024-05-08T21:10:15.425 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 fe80::69a5:2970:53c:897f/64 scope link noprefixroute 2024-05-08T21:10:15.425 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-05-08T21:10:15.425 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-08T21:10:15.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:10:15.425 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec bash -c ' 2024-05-08T21:10:15.426 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-05-08T21:10:15.426 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link add name ceph-brx type bridge 2024-05-08T21:10:15.426 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip addr flush dev ceph-brx 2024-05-08T21:10:15.426 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link set ceph-brx up 2024-05-08T21:10:15.426 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-08T21:10:15.426 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-05-08T21:10:15.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:10:15.584 DEBUG:teuthology.orchestra.run.smithi080:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-08T21:10:15.610 INFO:teuthology.orchestra.run.smithi080.stdout:1 2024-05-08T21:10:15.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:10:15.612 DEBUG:teuthology.orchestra.run.smithi080:> route 2024-05-08T21:10:15.686 INFO:teuthology.orchestra.run.smithi080.stdout:Kernel IP routing table 2024-05-08T21:10:15.686 INFO:teuthology.orchestra.run.smithi080.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-08T21:10:15.686 INFO:teuthology.orchestra.run.smithi080.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-08T21:10:15.686 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-08T21:10:15.686 INFO:teuthology.orchestra.run.smithi080.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-08T21:10:15.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:10:15.687 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec bash -c ' 2024-05-08T21:10:15.687 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-05-08T21:10:15.687 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-08T21:10:15.687 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-08T21:10:15.687 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-08T21:10:15.687 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-05-08T21:10:15.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:10:15.922 DEBUG:teuthology.orchestra.run.smithi080:> ip netns list 2024-05-08T21:10:15.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:10:15.939 DEBUG:teuthology.orchestra.run.smithi080:> ip netns list-id 2024-05-08T21:10:15.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:10:15.996 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec bash -c ' 2024-05-08T21:10:15.997 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-05-08T21:10:15.997 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-08T21:10:15.997 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-05-08T21:10:15.997 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-05-08T21:10:16.093 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-05-08T21:10:16.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:10:16.093 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec bash -c ' 2024-05-08T21:10:16.094 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-05-08T21:10:16.094 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-05-08T21:10:16.094 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-08T21:10:16.094 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-05-08T21:10:16.094 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-05-08T21:10:16.094 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-05-08T21:10:16.094 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-05-08T21:10:16.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:10:16.324 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec bash -c ' 2024-05-08T21:10:16.324 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-05-08T21:10:16.324 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link set brx.0 up 2024-05-08T21:10:16.324 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link set dev brx.0 master ceph-brx 2024-05-08T21:10:16.324 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-05-08T21:10:16.422 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-05-08T21:10:16.422 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T21:10:16.422 DEBUG:teuthology.orchestra.run.smithi080:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-05-08T21:10:16.439 INFO:teuthology.orchestra.run.smithi080.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-05-08T21:10:16.439 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T21:10:16.439 DEBUG:teuthology.orchestra.run.smithi080:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-05-08T21:10:16.495 DEBUG:teuthology.orchestra.run.smithi080:> sudo modprobe fuse 2024-05-08T21:10:16.563 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-05-08T21:10:16.563 DEBUG:teuthology.orchestra.run.smithi080:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-05-08T21:10:16.631 INFO:teuthology.orchestra.run.smithi080.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-05-08T21:10:16.632 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-05-08T21:10:16.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:10:16.634 DEBUG:teuthology.orchestra.run.smithi080:> ls /sys/fs/fuse/connections 2024-05-08T21:10:16.690 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-08T21:10:16.690 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-05-08T21:10:16.732 DEBUG:teuthology.orchestra.run.smithi080:> sudo modprobe fuse 2024-05-08T21:10:16.758 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-05-08T21:10:16.759 DEBUG:teuthology.orchestra.run.smithi080:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-05-08T21:10:16.821 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi080.stderr:2024-05-08T21:10:16.818+0000 7f322c5765c0 -1 init, newargv = 0x55fff2b613f0 newargc=15 2024-05-08T21:10:16.821 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi080.stderr:ceph-fuse[53104]: starting ceph client 2024-05-08T21:10:16.826 INFO:teuthology.orchestra.run.smithi080.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-05-08T21:10:16.827 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-05-08T21:10:16.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:10:16.828 DEBUG:teuthology.orchestra.run.smithi080:> ls /sys/fs/fuse/connections 2024-05-08T21:10:16.828 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi080.stderr:ceph-fuse[53104]: starting fuse 2024-05-08T21:10:16.845 INFO:teuthology.orchestra.run.smithi080.stdout:47 2024-05-08T21:10:16.845 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2024-05-08T21:10:16.845 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-05-08T21:10:16.845 DEBUG:teuthology.orchestra.run.smithi080:> import glob 2024-05-08T21:10:16.845 DEBUG:teuthology.orchestra.run.smithi080:> import re 2024-05-08T21:10:16.845 DEBUG:teuthology.orchestra.run.smithi080:> import os 2024-05-08T21:10:16.845 DEBUG:teuthology.orchestra.run.smithi080:> import subprocess 2024-05-08T21:10:16.845 DEBUG:teuthology.orchestra.run.smithi080:> 2024-05-08T21:10:16.845 DEBUG:teuthology.orchestra.run.smithi080:> def _find_admin_socket(client_name): 2024-05-08T21:10:16.845 DEBUG:teuthology.orchestra.run.smithi080:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-05-08T21:10:16.845 DEBUG:teuthology.orchestra.run.smithi080:> files = glob.glob(asok_path) 2024-05-08T21:10:16.846 DEBUG:teuthology.orchestra.run.smithi080:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-05-08T21:10:16.846 DEBUG:teuthology.orchestra.run.smithi080:> 2024-05-08T21:10:16.846 DEBUG:teuthology.orchestra.run.smithi080:> # Given a non-glob path, it better be there 2024-05-08T21:10:16.846 DEBUG:teuthology.orchestra.run.smithi080:> if "*" not in asok_path: 2024-05-08T21:10:16.846 DEBUG:teuthology.orchestra.run.smithi080:> assert(len(files) == 1) 2024-05-08T21:10:16.846 DEBUG:teuthology.orchestra.run.smithi080:> return files[0] 2024-05-08T21:10:16.846 DEBUG:teuthology.orchestra.run.smithi080:> 2024-05-08T21:10:16.846 DEBUG:teuthology.orchestra.run.smithi080:> for f in files: 2024-05-08T21:10:16.846 DEBUG:teuthology.orchestra.run.smithi080:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-08T21:10:16.846 DEBUG:teuthology.orchestra.run.smithi080:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-08T21:10:16.846 DEBUG:teuthology.orchestra.run.smithi080:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-08T21:10:16.846 DEBUG:teuthology.orchestra.run.smithi080:> contents = proc_f.read() 2024-05-08T21:10:16.846 DEBUG:teuthology.orchestra.run.smithi080:> if mountpoint in contents: 2024-05-08T21:10:16.846 DEBUG:teuthology.orchestra.run.smithi080:> return f 2024-05-08T21:10:16.846 DEBUG:teuthology.orchestra.run.smithi080:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-08T21:10:16.846 DEBUG:teuthology.orchestra.run.smithi080:> 2024-05-08T21:10:16.847 DEBUG:teuthology.orchestra.run.smithi080:> print(_find_admin_socket("client.admin")) 2024-05-08T21:10:16.847 DEBUG:teuthology.orchestra.run.smithi080:> ' 2024-05-08T21:10:16.968 INFO:teuthology.orchestra.run.smithi080.stdout:/var/run/ceph/ceph-client.admin.53104.asok 2024-05-08T21:10:17.151 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.53104.asok 2024-05-08T21:10:17.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:10:17.151 DEBUG:teuthology.orchestra.run.smithi080:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.53104.asok status 2024-05-08T21:10:17.313 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T21:10:17.313 INFO:teuthology.orchestra.run.smithi080.stdout: "metadata": { 2024-05-08T21:10:17.313 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph_sha1": "d21e4f961318b56f0d915caa2490c3711bf13c34", 2024-05-08T21:10:17.313 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph_version": "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)", 2024-05-08T21:10:17.313 INFO:teuthology.orchestra.run.smithi080.stdout: "entity_id": "admin", 2024-05-08T21:10:17.314 INFO:teuthology.orchestra.run.smithi080.stdout: "hostname": "smithi080", 2024-05-08T21:10:17.314 INFO:teuthology.orchestra.run.smithi080.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-05-08T21:10:17.314 INFO:teuthology.orchestra.run.smithi080.stdout: "pid": "53104", 2024-05-08T21:10:17.314 INFO:teuthology.orchestra.run.smithi080.stdout: "root": "/" 2024-05-08T21:10:17.314 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T21:10:17.314 INFO:teuthology.orchestra.run.smithi080.stdout: "dentry_count": 0, 2024-05-08T21:10:17.314 INFO:teuthology.orchestra.run.smithi080.stdout: "dentry_pinned_count": 0, 2024-05-08T21:10:17.314 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 4425, 2024-05-08T21:10:17.314 INFO:teuthology.orchestra.run.smithi080.stdout: "inst": { 2024-05-08T21:10:17.314 INFO:teuthology.orchestra.run.smithi080.stdout: "name": { 2024-05-08T21:10:17.314 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "client", 2024-05-08T21:10:17.314 INFO:teuthology.orchestra.run.smithi080.stdout: "num": 4425 2024-05-08T21:10:17.315 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T21:10:17.315 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": { 2024-05-08T21:10:17.315 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T21:10:17.315 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "192.168.0.1:0", 2024-05-08T21:10:17.315 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 234697864 2024-05-08T21:10:17.315 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-08T21:10:17.315 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T21:10:17.315 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": { 2024-05-08T21:10:17.315 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-05-08T21:10:17.315 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "192.168.0.1:0", 2024-05-08T21:10:17.315 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 234697864 2024-05-08T21:10:17.315 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-08T21:10:17.315 INFO:teuthology.orchestra.run.smithi080.stdout: "inst_str": "client.4425 192.168.0.1:0/234697864", 2024-05-08T21:10:17.315 INFO:teuthology.orchestra.run.smithi080.stdout: "addr_str": "192.168.0.1:0/234697864", 2024-05-08T21:10:17.316 INFO:teuthology.orchestra.run.smithi080.stdout: "inode_count": 1, 2024-05-08T21:10:17.316 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_epoch": 6, 2024-05-08T21:10:17.316 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_epoch": 26, 2024-05-08T21:10:17.316 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_epoch_barrier": 0, 2024-05-08T21:10:17.316 INFO:teuthology.orchestra.run.smithi080.stdout: "blocklisted": false, 2024-05-08T21:10:17.316 INFO:teuthology.orchestra.run.smithi080.stdout: "fs_name": "cephfs" 2024-05-08T21:10:17.316 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T21:10:17.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:10:17.322 DEBUG:teuthology.orchestra.run.smithi080:> stat --file-system '--printf=%T 2024-05-08T21:10:17.322 DEBUG:teuthology.orchestra.run.smithi080:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-05-08T21:10:17.339 INFO:teuthology.orchestra.run.smithi080.stdout:fuseblk 2024-05-08T21:10:17.339 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-05-08T21:10:17.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:10:17.339 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-05-08T21:10:17.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:10:17.408 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-05-08T21:10:17.511 INFO:teuthology.orchestra.run.smithi080.stdout:# file: . 2024-05-08T21:10:17.511 INFO:teuthology.orchestra.run.smithi080.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-05-08T21:10:17.511 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:10:17.511 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T21:10:17.512 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T21:10:17.529 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T21:10:17.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.686+0000 7f2943087700 1 Processor -- start 2024-05-08T21:10:17.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.686+0000 7f2943087700 1 -- start start 2024-05-08T21:10:17.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.687+0000 7f2943087700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f293c06eff0 0x7f293c06dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:17.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.687+0000 7f2943087700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f293c158f40 con 0x7f293c141450 2024-05-08T21:10:17.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.687+0000 7f2943087700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f293c0c57f0 con 0x7f293c158ab0 2024-05-08T21:10:17.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.687+0000 7f2943087700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f293c0c5a40 con 0x7f293c06eff0 2024-05-08T21:10:17.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.687+0000 7f2940e23700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f293c141450 0x7f293c0c7120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59076/0 (socket says 172.21.15.80:59076) 2024-05-08T21:10:17.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.687+0000 7f2940e23700 1 -- 172.21.15.80:0/3784682852 learned_addr learned my addr 172.21.15.80:0/3784682852 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:10:17.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.687+0000 7f293b7fe700 1 -- 172.21.15.80:0/3784682852 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4003970054 0 0) 0x7f293c158f40 con 0x7f293c141450 2024-05-08T21:10:17.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.687+0000 7f293bfff700 1 --2- 172.21.15.80:0/3784682852 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f293c06eff0 0x7f293c06dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:17.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.687+0000 7f293b7fe700 1 -- 172.21.15.80:0/3784682852 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f292c0035b0 con 0x7f293c141450 2024-05-08T21:10:17.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.687+0000 7f293b7fe700 1 -- 172.21.15.80:0/3784682852 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4266151911 0 0) 0x7f292c0035b0 con 0x7f293c141450 2024-05-08T21:10:17.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.687+0000 7f293b7fe700 1 -- 172.21.15.80:0/3784682852 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f293c06eff0 msgr2=0x7f293c06dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:17.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.687+0000 7f293b7fe700 1 --2- 172.21.15.80:0/3784682852 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f293c06eff0 0x7f293c06dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:17.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.687+0000 7f293b7fe700 1 -- 172.21.15.80:0/3784682852 >> v1:172.21.15.106:6789/0 conn(0x7f293c158ab0 legacy=0x7f293c1628e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:17.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.687+0000 7f293b7fe700 1 -- 172.21.15.80:0/3784682852 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f293c0cae60 con 0x7f293c141450 2024-05-08T21:10:17.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.687+0000 7f293b7fe700 1 -- 172.21.15.80:0/3784682852 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3520646302 0 0) 0x7f2930001670 con 0x7f293c141450 2024-05-08T21:10:17.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.687+0000 7f293b7fe700 1 -- 172.21.15.80:0/3784682852 >> v1:172.21.15.80:6789/0 conn(0x7f293c141450 legacy=0x7f293c0c7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:17.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.687+0000 7f293b7fe700 1 --2- 172.21.15.80:0/3784682852 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f293c06eff0 0x7f292c003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:17.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.687+0000 7f293b7fe700 1 --2- 172.21.15.80:0/3784682852 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f292c004000 0x7f292c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:17.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.687+0000 7f293b7fe700 1 --2- 172.21.15.80:0/3784682852 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f292c004d90 0x7f292c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:17.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.687+0000 7f293b7fe700 1 -- 172.21.15.80:0/3784682852 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f293c0c5a40 con 0x7f292c004000 2024-05-08T21:10:17.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.687+0000 7f293b7fe700 1 -- 172.21.15.80:0/3784682852 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f292c00bb50 con 0x7f292c004d90 2024-05-08T21:10:17.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.687+0000 7f293b7fe700 1 -- 172.21.15.80:0/3784682852 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f292c00bd10 con 0x7f293c06eff0 2024-05-08T21:10:17.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.688+0000 7f293bfff700 1 --2- 172.21.15.80:0/3784682852 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f292c004000 0x7f292c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:17.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.688+0000 7f2940e23700 1 --2- 172.21.15.80:0/3784682852 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f293c06eff0 0x7f292c003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:17.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.688+0000 7f2941624700 1 --2- 172.21.15.80:0/3784682852 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f292c004d90 0x7f292c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:17.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.688+0000 7f293bfff700 1 -- 172.21.15.80:0/3784682852 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f293c06eff0 msgr2=0x7f292c003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:17.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.688+0000 7f293bfff700 1 --2- 172.21.15.80:0/3784682852 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f293c06eff0 0x7f292c003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:17.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.688+0000 7f293bfff700 1 -- 172.21.15.80:0/3784682852 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f292c004d90 msgr2=0x7f292c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:17.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.688+0000 7f293bfff700 1 --2- 172.21.15.80:0/3784682852 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f292c004d90 0x7f292c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:17.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.688+0000 7f293bfff700 1 -- 172.21.15.80:0/3784682852 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f292c0035b0 con 0x7f292c004000 2024-05-08T21:10:17.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.688+0000 7f293bfff700 1 --2- 172.21.15.80:0/3784682852 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f292c004000 0x7f292c004850 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2928009b60 tx=0x7f292c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20a9b302c7a8ab06 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:17.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.688+0000 7f293b7fe700 1 -- 172.21.15.80:0/3784682852 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f292800e6c0 con 0x7f292c004000 2024-05-08T21:10:17.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.688+0000 7f293b7fe700 1 -- 172.21.15.80:0/3784682852 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f292800e820 con 0x7f292c004000 2024-05-08T21:10:17.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.688+0000 7f293b7fe700 1 -- 172.21.15.80:0/3784682852 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f292800eb90 con 0x7f292c004000 2024-05-08T21:10:17.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.689+0000 7f2943087700 1 -- 172.21.15.80:0/3784682852 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f292c004000 msgr2=0x7f292c004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:17.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.689+0000 7f2943087700 1 --2- 172.21.15.80:0/3784682852 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f292c004000 0x7f292c004850 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2928009b60 tx=0x7f292c005880 comp rx=0 tx=0).stop 2024-05-08T21:10:17.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.689+0000 7f2941624700 1 -- 172.21.15.80:0/3784682852 reap_dead start 2024-05-08T21:10:17.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.689+0000 7f2943087700 1 -- 172.21.15.80:0/3784682852 shutdown_connections 2024-05-08T21:10:17.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.689+0000 7f2943087700 1 -- 172.21.15.80:0/3784682852 >> 172.21.15.80:0/3784682852 conn(0x7f293c0ca340 msgr2=0x7f293c0ca750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:17.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.689+0000 7f2943087700 1 -- 172.21.15.80:0/3784682852 shutdown_connections 2024-05-08T21:10:17.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.689+0000 7f2943087700 1 -- 172.21.15.80:0/3784682852 wait complete. 2024-05-08T21:10:17.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.690+0000 7f2943087700 1 Processor -- start 2024-05-08T21:10:17.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.690+0000 7f2943087700 1 -- start start 2024-05-08T21:10:17.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.691+0000 7f2943087700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f292c004000 0x7f293c0c9320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:17.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.691+0000 7f2943087700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f293c15c080 0x7f293c1ee0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:17.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.691+0000 7f2943087700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f293c1ee630 0x7f293c139780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:17.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.691+0000 7f2943087700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f293c13b3c0 con 0x7f292c004000 2024-05-08T21:10:17.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.691+0000 7f2943087700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f293c1f1e80 con 0x7f293c1ee630 2024-05-08T21:10:17.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.691+0000 7f2943087700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f293c13bf50 con 0x7f293c15c080 2024-05-08T21:10:17.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.691+0000 7f2940e23700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f292c004000 0x7f293c0c9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:17.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.691+0000 7f2940e23700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f292c004000 0x7f293c0c9320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37332/0 (socket says 172.21.15.80:37332) 2024-05-08T21:10:17.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.691+0000 7f2940e23700 1 -- 172.21.15.80:0/1126701549 learned_addr learned my addr 172.21.15.80:0/1126701549 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:17.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.691+0000 7f2940e23700 1 -- 172.21.15.80:0/1126701549 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f293c15c080 msgr2=0x7f293c1ee0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:17.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.691+0000 7f2940e23700 1 --2- 172.21.15.80:0/1126701549 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f293c15c080 0x7f293c1ee0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:17.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.691+0000 7f2940e23700 1 -- 172.21.15.80:0/1126701549 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f293c1ee630 msgr2=0x7f293c139780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:17.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.691+0000 7f2940e23700 1 --2- 172.21.15.80:0/1126701549 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f293c1ee630 0x7f293c139780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:17.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.691+0000 7f2940e23700 1 -- 172.21.15.80:0/1126701549 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f293c1f1300 con 0x7f292c004000 2024-05-08T21:10:17.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.691+0000 7f2940e23700 1 --2- 172.21.15.80:0/1126701549 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f292c004000 0x7f293c0c9320 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f29300017a0 tx=0x7f2930007570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:17.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.691+0000 7f29397fa700 1 -- 172.21.15.80:0/1126701549 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293000f710 con 0x7f292c004000 2024-05-08T21:10:17.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.691+0000 7f29397fa700 1 -- 172.21.15.80:0/1126701549 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f293000f870 con 0x7f292c004000 2024-05-08T21:10:17.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.691+0000 7f29397fa700 1 -- 172.21.15.80:0/1126701549 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293000fbe0 con 0x7f292c004000 2024-05-08T21:10:17.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.691+0000 7f2943087700 1 -- 172.21.15.80:0/1126701549 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f293c1f15e0 con 0x7f292c004000 2024-05-08T21:10:17.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.691+0000 7f2943087700 1 -- 172.21.15.80:0/1126701549 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f293c1f1ba0 con 0x7f292c004000 2024-05-08T21:10:17.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.692+0000 7f2943087700 1 -- 172.21.15.80:0/1126701549 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f293c04ec60 con 0x7f292c004000 2024-05-08T21:10:17.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.693+0000 7f29397fa700 1 -- 172.21.15.80:0/1126701549 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f293000fd40 con 0x7f292c004000 2024-05-08T21:10:17.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.693+0000 7f29397fa700 1 --2- 172.21.15.80:0/1126701549 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f292006acc0 0x7f292006d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:17.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.693+0000 7f29397fa700 1 -- 172.21.15.80:0/1126701549 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2930088f40 con 0x7f292c004000 2024-05-08T21:10:17.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.693+0000 7f293bfff700 1 --2- 172.21.15.80:0/1126701549 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f292006acc0 0x7f292006d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:17.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.694+0000 7f293bfff700 1 --2- 172.21.15.80:0/1126701549 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f292006acc0 0x7f292006d180 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f293c15c4c0 tx=0x7f2928013000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:17.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.698+0000 7f29397fa700 1 -- 172.21.15.80:0/1126701549 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f2930053da0 con 0x7f292c004000 2024-05-08T21:10:17.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.895+0000 7f2943087700 1 -- 172.21.15.80:0/1126701549 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f293c0c7c80 con 0x7f292c004000 2024-05-08T21:10:17.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.896+0000 7f29397fa700 1 -- 172.21.15.80:0/1126701549 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+17878 (secure 0 0 0) 0x7f293001a030 con 0x7f292c004000 2024-05-08T21:10:17.900 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:10:17.900 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":26,"fsid":"44d31c1e-aad3-47ca-a4fa-85a63d4a60aa","created":"2024-05-08T21:09:46.467038+0000","modified":"2024-05-08T21:10:08.163735+0000","last_up_change":"2024-05-08T21:09:57.284675+0000","last_in_change":"2024-05-08T21:09:49.125444+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T21:09:58.238951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T21:10:02.177476+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T21:10:02.685535+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-08T21:10:05.753779+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c3f9d93e-ed6d-4a0c-b5c0-0e8d44c65fdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":47011},{"type":"v1","addr":"172.21.15.80:6817","nonce":47011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":47011},{"type":"v1","addr":"172.21.15.80:6819","nonce":47011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":47011},{"type":"v1","addr":"172.21.15.80:6823","nonce":47011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":47011},{"type":"v1","addr":"172.21.15.80:6821","nonce":47011}]},"public_addr":"172.21.15.80:6817/47011","cluster_addr":"172.21.15.80:6819/47011","heartbeat_back_addr":"172.21.15.80:6823/47011","heartbeat_front_addr":"172.21.15.80:6821/47011","state":["exists","up"]},{"osd":1,"uuid":"4ce2b4d6-6c40-43aa-8dd1-743fef8915df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":47010},{"type":"v1","addr":"172.21.15.80:6809","nonce":47010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":47010},{"type":"v1","addr":"172.21.15.80:6811","nonce":47010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":47010},{"type":"v1","addr":"172.21.15.80:6815","nonce":47010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":47010},{"type":"v1","addr":"172.21.15.80:6813","nonce":47010}]},"public_addr":"172.21.15.80:6809/47010","cluster_addr":"172.21.15.80:6811/47010","heartbeat_back_addr":"172.21.15.80:6815/47010","heartbeat_front_addr":"172.21.15.80:6813/47010","state":["exists","up"]},{"osd":2,"uuid":"e30cc3bc-6461-4fac-960a-de00c9488d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":47009},{"type":"v1","addr":"172.21.15.80:6801","nonce":47009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":47009},{"type":"v1","addr":"172.21.15.80:6803","nonce":47009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":47009},{"type":"v1","addr":"172.21.15.80:6807","nonce":47009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":47009},{"type":"v1","addr":"172.21.15.80:6805","nonce":47009}]},"public_addr":"172.21.15.80:6801/47009","cluster_addr":"172.21.15.80:6803/47009","heartbeat_back_addr":"172.21.15.80:6807/47009","heartbeat_front_addr":"172.21.15.80:6805/47009","state":["exists","up"]},{"osd":3,"uuid":"a415c099-9ea6-40be-98ed-f2932f98dfd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":47012},{"type":"v1","addr":"172.21.15.80:6825","nonce":47012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":47012},{"type":"v1","addr":"172.21.15.80:6827","nonce":47012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":47012},{"type":"v1","addr":"172.21.15.80:6831","nonce":47012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":47012},{"type":"v1","addr":"172.21.15.80:6829","nonce":47012}]},"public_addr":"172.21.15.80:6825/47012","cluster_addr":"172.21.15.80:6827/47012","heartbeat_back_addr":"172.21.15.80:6831/47012","heartbeat_front_addr":"172.21.15.80:6829/47012","state":["exists","up"]},{"osd":4,"uuid":"5ae1d51f-0918-4571-b79b-154308d46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6823","nonce":47114},{"type":"v1","addr":"172.21.15.106:6825","nonce":47114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":47114},{"type":"v1","addr":"172.21.15.106:6827","nonce":47114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":47114},{"type":"v1","addr":"172.21.15.106:6831","nonce":47114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":47114},{"type":"v1","addr":"172.21.15.106:6829","nonce":47114}]},"public_addr":"172.21.15.106:6825/47114","cluster_addr":"172.21.15.106:6827/47114","heartbeat_back_addr":"172.21.15.106:6831/47114","heartbeat_front_addr":"172.21.15.106:6829/47114","state":["exists","up"]},{"osd":5,"uuid":"a19ac74e-4282-4428-b167-26ba6b92f732","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6807","nonce":47111},{"type":"v1","addr":"172.21.15.106:6809","nonce":47111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":47111},{"type":"v1","addr":"172.21.15.106:6811","nonce":47111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":47111},{"type":"v1","addr":"172.21.15.106:6815","nonce":47111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":47111},{"type":"v1","addr":"172.21.15.106:6813","nonce":47111}]},"public_addr":"172.21.15.106:6809/47111","cluster_addr":"172.21.15.106:6811/47111","heartbeat_back_addr":"172.21.15.106:6815/47111","heartbeat_front_addr":"172.21.15.106:6813/47111","state":["exists","up"]},{"osd":6,"uuid":"bfe72edd-7acc-4805-807d-2000e76f2feb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":47112},{"type":"v1","addr":"172.21.15.106:6817","nonce":47112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":47112},{"type":"v1","addr":"172.21.15.106:6819","nonce":47112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":47112},{"type":"v1","addr":"172.21.15.106:6824","nonce":47112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":47112},{"type":"v1","addr":"172.21.15.106:6821","nonce":47112}]},"public_addr":"172.21.15.106:6817/47112","cluster_addr":"172.21.15.106:6819/47112","heartbeat_back_addr":"172.21.15.106:6824/47112","heartbeat_front_addr":"172.21.15.106:6821/47112","state":["exists","up"]},{"osd":7,"uuid":"99897f22-ed17-4c7c-9088-cc0c4a51f786","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":47113},{"type":"v1","addr":"172.21.15.106:6801","nonce":47113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":47113},{"type":"v1","addr":"172.21.15.106:6803","nonce":47113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":47113},{"type":"v1","addr":"172.21.15.106:6808","nonce":47113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":47113},{"type":"v1","addr":"172.21.15.106:6805","nonce":47113}]},"public_addr":"172.21.15.106:6801/47113","cluster_addr":"172.21.15.106:6803/47113","heartbeat_back_addr":"172.21.15.106:6808/47113","heartbeat_front_addr":"172.21.15.106:6805/47113","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.232670+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.277753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.050087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.349312+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.344080+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.348781+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.352539+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.275013+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T21:10:17.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.898+0000 7f2943087700 1 -- 172.21.15.80:0/1126701549 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f292006acc0 msgr2=0x7f292006d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:17.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.898+0000 7f2943087700 1 --2- 172.21.15.80:0/1126701549 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f292006acc0 0x7f292006d180 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f293c15c4c0 tx=0x7f2928013000 comp rx=0 tx=0).stop 2024-05-08T21:10:17.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.898+0000 7f2943087700 1 -- 172.21.15.80:0/1126701549 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f292c004000 msgr2=0x7f293c0c9320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:17.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.898+0000 7f2943087700 1 --2- 172.21.15.80:0/1126701549 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f292c004000 0x7f293c0c9320 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f29300017a0 tx=0x7f2930007570 comp rx=0 tx=0).stop 2024-05-08T21:10:17.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.899+0000 7f2943087700 1 -- 172.21.15.80:0/1126701549 shutdown_connections 2024-05-08T21:10:17.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.899+0000 7f2943087700 1 --2- 172.21.15.80:0/1126701549 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f292006acc0 0x7f292006d180 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:17.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.899+0000 7f2943087700 1 --2- 172.21.15.80:0/1126701549 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f292c004000 0x7f293c0c9320 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:17.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.899+0000 7f2943087700 1 --2- 172.21.15.80:0/1126701549 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f293c1ee630 0x7f293c139780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:17.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.899+0000 7f2943087700 1 --2- 172.21.15.80:0/1126701549 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f293c15c080 0x7f293c1ee0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:17.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.899+0000 7f2943087700 1 -- 172.21.15.80:0/1126701549 >> 172.21.15.80:0/1126701549 conn(0x7f293c0ca340 msgr2=0x7f293c0c70b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:17.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.899+0000 7f2943087700 1 -- 172.21.15.80:0/1126701549 shutdown_connections 2024-05-08T21:10:17.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:17.899+0000 7f2943087700 1 -- 172.21.15.80:0/1126701549 wait complete. 2024-05-08T21:10:17.914 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T21:09:58.238951+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T21:10:02.177476+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T21:10:02.685535+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-08T21:10:05.753779+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-08T21:10:17.915 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T21:10:18.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.035+0000 7fe218ac0700 1 Processor -- start 2024-05-08T21:10:18.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.035+0000 7fe218ac0700 1 -- start start 2024-05-08T21:10:18.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.036+0000 7fe218ac0700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe2140ccc00 0x7fe214071be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:18.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.036+0000 7fe218ac0700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe2140c8380 0x7fe2140c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:18.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.036+0000 7fe218ac0700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2140c9150 con 0x7fe2140ccfe0 2024-05-08T21:10:18.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.036+0000 7fe218ac0700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2140c99f0 con 0x7fe2140ccc00 2024-05-08T21:10:18.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.036+0000 7fe218ac0700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2141579c0 con 0x7fe2140c8380 2024-05-08T21:10:18.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.036+0000 7fe21259c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe2140ccc00 0x7fe214071be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:18.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.036+0000 7fe21259c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe2140ccc00 0x7fe214071be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37342/0 (socket says 172.21.15.80:37342) 2024-05-08T21:10:18.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.036+0000 7fe21259c700 1 -- 172.21.15.80:0/544849058 learned_addr learned my addr 172.21.15.80:0/544849058 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:18.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.036+0000 7fe212d9d700 1 --2- 172.21.15.80:0/544849058 >> v2:172.21.15.106:3300/0 conn(0x7fe2140c8380 0x7fe2140c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:18.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.037+0000 7fe21259c700 1 -- 172.21.15.80:0/544849058 >> v2:172.21.15.106:3300/0 conn(0x7fe2140c8380 msgr2=0x7fe2140c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:18.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.037+0000 7fe21259c700 1 --2- 172.21.15.80:0/544849058 >> v2:172.21.15.106:3300/0 conn(0x7fe2140c8380 0x7fe2140c9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:18.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.037+0000 7fe21259c700 1 -- 172.21.15.80:0/544849058 >> v1:172.21.15.106:6789/0 conn(0x7fe2140ccfe0 legacy=0x7fe214156ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:18.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.037+0000 7fe21259c700 1 -- 172.21.15.80:0/544849058 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe214157ca0 con 0x7fe2140ccc00 2024-05-08T21:10:18.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.037+0000 7fe21259c700 1 --2- 172.21.15.80:0/544849058 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2140ccc00 0x7fe214071be0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe214070060 tx=0x7fe208009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59469b39efd8eef0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:18.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.037+0000 7fe21159a700 1 -- 172.21.15.80:0/544849058 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe208004230 con 0x7fe2140ccc00 2024-05-08T21:10:18.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.037+0000 7fe21159a700 1 -- 172.21.15.80:0/544849058 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe208004390 con 0x7fe2140ccc00 2024-05-08T21:10:18.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.037+0000 7fe21159a700 1 -- 172.21.15.80:0/544849058 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2080036a0 con 0x7fe2140ccc00 2024-05-08T21:10:18.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.037+0000 7fe218ac0700 1 -- 172.21.15.80:0/544849058 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2140ccc00 msgr2=0x7fe214071be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:18.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.037+0000 7fe218ac0700 1 --2- 172.21.15.80:0/544849058 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2140ccc00 0x7fe214071be0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe214070060 tx=0x7fe208009bd0 comp rx=0 tx=0).stop 2024-05-08T21:10:18.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.037+0000 7fe218ac0700 1 -- 172.21.15.80:0/544849058 shutdown_connections 2024-05-08T21:10:18.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.037+0000 7fe218ac0700 1 --2- 172.21.15.80:0/544849058 >> v2:172.21.15.106:3300/0 conn(0x7fe2140c8380 0x7fe2140c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:18.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.037+0000 7fe218ac0700 1 --2- 172.21.15.80:0/544849058 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2140ccc00 0x7fe214071be0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:18.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.037+0000 7fe218ac0700 1 -- 172.21.15.80:0/544849058 >> 172.21.15.80:0/544849058 conn(0x7fe21406f140 msgr2=0x7fe21406f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:18.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.038+0000 7fe218ac0700 1 -- 172.21.15.80:0/544849058 shutdown_connections 2024-05-08T21:10:18.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.038+0000 7fe218ac0700 1 -- 172.21.15.80:0/544849058 wait complete. 2024-05-08T21:10:18.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.039+0000 7fe218ac0700 1 Processor -- start 2024-05-08T21:10:18.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.039+0000 7fe218ac0700 1 -- start start 2024-05-08T21:10:18.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.039+0000 7fe218ac0700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe2140c8380 0x7fe2141f0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:18.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.039+0000 7fe218ac0700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe2140ccc00 0x7fe214147450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:18.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.039+0000 7fe218ac0700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2140ccfe0 0x7fe21415f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:18.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.039+0000 7fe218ac0700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe214143030 con 0x7fe2140ccfe0 2024-05-08T21:10:18.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.039+0000 7fe218ac0700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2141616a0 con 0x7fe2140ccc00 2024-05-08T21:10:18.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.039+0000 7fe218ac0700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2141f0db0 con 0x7fe2140c8380 2024-05-08T21:10:18.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.040+0000 7fe212d9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2140ccfe0 0x7fe21415f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:18.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.040+0000 7fe212d9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2140ccfe0 0x7fe21415f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37344/0 (socket says 172.21.15.80:37344) 2024-05-08T21:10:18.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.040+0000 7fe212d9d700 1 -- 172.21.15.80:0/465691025 learned_addr learned my addr 172.21.15.80:0/465691025 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:18.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.040+0000 7fe21259c700 1 --2- 172.21.15.80:0/465691025 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe2140c8380 0x7fe2141f0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:18.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.040+0000 7fe211d9b700 1 --2- 172.21.15.80:0/465691025 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe2140ccc00 0x7fe214147450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:18.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.040+0000 7fe212d9d700 1 -- 172.21.15.80:0/465691025 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe2140c8380 msgr2=0x7fe2141f0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:18.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.040+0000 7fe212d9d700 1 --2- 172.21.15.80:0/465691025 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe2140c8380 0x7fe2141f0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:18.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.040+0000 7fe212d9d700 1 -- 172.21.15.80:0/465691025 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe2140ccc00 msgr2=0x7fe214147450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:18.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.040+0000 7fe212d9d700 1 --2- 172.21.15.80:0/465691025 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe2140ccc00 0x7fe214147450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:18.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.040+0000 7fe212d9d700 1 -- 172.21.15.80:0/465691025 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe208009550 con 0x7fe2140ccfe0 2024-05-08T21:10:18.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.040+0000 7fe212d9d700 1 --2- 172.21.15.80:0/465691025 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2140ccfe0 0x7fe21415f990 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe20c007e40 tx=0x7fe20c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:18.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.040+0000 7fe202ffd700 1 -- 172.21.15.80:0/465691025 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe20c00ecd0 con 0x7fe2140ccfe0 2024-05-08T21:10:18.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.040+0000 7fe202ffd700 1 -- 172.21.15.80:0/465691025 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe20c00ee50 con 0x7fe2140ccfe0 2024-05-08T21:10:18.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.040+0000 7fe202ffd700 1 -- 172.21.15.80:0/465691025 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe20c014660 con 0x7fe2140ccfe0 2024-05-08T21:10:18.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.040+0000 7fe218ac0700 1 -- 172.21.15.80:0/465691025 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe21414b8b0 con 0x7fe2140ccfe0 2024-05-08T21:10:18.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.040+0000 7fe218ac0700 1 -- 172.21.15.80:0/465691025 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2141613c0 con 0x7fe2140ccfe0 2024-05-08T21:10:18.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.041+0000 7fe218ac0700 1 -- 172.21.15.80:0/465691025 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe21414ba40 con 0x7fe2140ccfe0 2024-05-08T21:10:18.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.042+0000 7fe202ffd700 1 -- 172.21.15.80:0/465691025 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe20c0147c0 con 0x7fe2140ccfe0 2024-05-08T21:10:18.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.042+0000 7fe202ffd700 1 --2- 172.21.15.80:0/465691025 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe1f406acc0 0x7fe1f406d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:18.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.042+0000 7fe21259c700 1 --2- 172.21.15.80:0/465691025 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe1f406acc0 0x7fe1f406d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:18.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.042+0000 7fe202ffd700 1 -- 172.21.15.80:0/465691025 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe20c089cc0 con 0x7fe2140ccfe0 2024-05-08T21:10:18.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.043+0000 7fe21259c700 1 --2- 172.21.15.80:0/465691025 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe1f406acc0 0x7fe1f406d180 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe208009130 tx=0x7fe208008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:18.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.047+0000 7fe202ffd700 1 -- 172.21.15.80:0/465691025 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fe20c054c60 con 0x7fe2140ccfe0 2024-05-08T21:10:18.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.242+0000 7fe218ac0700 1 -- 172.21.15.80:0/465691025 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe21404ec60 con 0x7fe2140ccfe0 2024-05-08T21:10:18.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.242+0000 7fe202ffd700 1 -- 172.21.15.80:0/465691025 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe20c058280 con 0x7fe2140ccfe0 2024-05-08T21:10:18.245 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-05-08T21:10:18.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.244+0000 7fe218ac0700 1 -- 172.21.15.80:0/465691025 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe1f406acc0 msgr2=0x7fe1f406d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:18.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.244+0000 7fe218ac0700 1 --2- 172.21.15.80:0/465691025 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe1f406acc0 0x7fe1f406d180 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe208009130 tx=0x7fe208008030 comp rx=0 tx=0).stop 2024-05-08T21:10:18.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.244+0000 7fe218ac0700 1 -- 172.21.15.80:0/465691025 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2140ccfe0 msgr2=0x7fe21415f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:18.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.244+0000 7fe218ac0700 1 --2- 172.21.15.80:0/465691025 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2140ccfe0 0x7fe21415f990 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe20c007e40 tx=0x7fe20c00e3c0 comp rx=0 tx=0).stop 2024-05-08T21:10:18.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.244+0000 7fe218ac0700 1 -- 172.21.15.80:0/465691025 shutdown_connections 2024-05-08T21:10:18.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.244+0000 7fe218ac0700 1 --2- 172.21.15.80:0/465691025 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe1f406acc0 0x7fe1f406d180 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:18.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.244+0000 7fe218ac0700 1 --2- 172.21.15.80:0/465691025 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2140ccfe0 0x7fe21415f990 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:18.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.244+0000 7fe218ac0700 1 --2- 172.21.15.80:0/465691025 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe2140c8380 0x7fe2141f0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:18.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.244+0000 7fe218ac0700 1 --2- 172.21.15.80:0/465691025 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe2140ccc00 0x7fe214147450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:18.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.244+0000 7fe218ac0700 1 -- 172.21.15.80:0/465691025 >> 172.21.15.80:0/465691025 conn(0x7fe21406f140 msgr2=0x7fe2140c6710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:18.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.244+0000 7fe218ac0700 1 -- 172.21.15.80:0/465691025 shutdown_connections 2024-05-08T21:10:18.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.244+0000 7fe218ac0700 1 -- 172.21.15.80:0/465691025 wait complete. 2024-05-08T21:10:18.259 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T21:10:18.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.381+0000 7eff78609700 1 Processor -- start 2024-05-08T21:10:18.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.381+0000 7eff78609700 1 -- start start 2024-05-08T21:10:18.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.382+0000 7eff78609700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7eff70150dd0 0x7eff70071390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:18.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.382+0000 7eff78609700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff700c7950 con 0x7eff7006bad0 2024-05-08T21:10:18.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.382+0000 7eff78609700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff700c8a30 con 0x7eff700c97f0 2024-05-08T21:10:18.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.382+0000 7eff78609700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff700c93d0 con 0x7eff70150dd0 2024-05-08T21:10:18.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.382+0000 7eff76ba6700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7eff7006bad0 0x7eff7006bf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59082/0 (socket says 172.21.15.80:59082) 2024-05-08T21:10:18.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.382+0000 7eff76ba6700 1 -- 172.21.15.80:0/971351465 learned_addr learned my addr 172.21.15.80:0/971351465 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:10:18.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.382+0000 7eff753a3700 1 -- 172.21.15.80:0/971351465 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 281070743 0 0) 0x7eff700c7950 con 0x7eff7006bad0 2024-05-08T21:10:18.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.382+0000 7eff753a3700 1 -- 172.21.15.80:0/971351465 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff5c0035b0 con 0x7eff7006bad0 2024-05-08T21:10:18.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.382+0000 7eff763a5700 1 --2- 172.21.15.80:0/971351465 >> v2:172.21.15.106:3300/0 conn(0x7eff70150dd0 0x7eff70071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:18.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.382+0000 7eff753a3700 1 -- 172.21.15.80:0/971351465 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2161396857 0 0) 0x7eff5c0035b0 con 0x7eff7006bad0 2024-05-08T21:10:18.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.382+0000 7eff753a3700 1 -- 172.21.15.80:0/971351465 >> v2:172.21.15.106:3300/0 conn(0x7eff70150dd0 msgr2=0x7eff70071390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:18.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.382+0000 7eff753a3700 1 --2- 172.21.15.80:0/971351465 >> v2:172.21.15.106:3300/0 conn(0x7eff70150dd0 0x7eff70071390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:18.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.382+0000 7eff753a3700 1 -- 172.21.15.80:0/971351465 >> v1:172.21.15.106:6789/0 conn(0x7eff700c97f0 legacy=0x7eff70157940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:18.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.382+0000 7eff753a3700 1 -- 172.21.15.80:0/971351465 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff700c8d10 con 0x7eff7006bad0 2024-05-08T21:10:18.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.382+0000 7eff763a5700 1 --2- 172.21.15.80:0/971351465 >> v2:172.21.15.106:3300/0 conn(0x7eff70150dd0 0x7eff70071390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:10:18.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.382+0000 7eff753a3700 1 -- 172.21.15.80:0/971351465 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3520646302 0 0) 0x7eff680019f0 con 0x7eff7006bad0 2024-05-08T21:10:18.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.382+0000 7eff753a3700 1 -- 172.21.15.80:0/971351465 >> v1:172.21.15.80:6789/0 conn(0x7eff7006bad0 legacy=0x7eff7006bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:18.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.382+0000 7eff753a3700 1 --2- 172.21.15.80:0/971351465 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7eff5c003a00 0x7eff5c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:18.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.382+0000 7eff753a3700 1 --2- 172.21.15.80:0/971351465 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff5c004850 0x7eff5c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:18.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.382+0000 7eff753a3700 1 --2- 172.21.15.80:0/971351465 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7eff5c005210 0x7eff5c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:18.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.382+0000 7eff753a3700 1 -- 172.21.15.80:0/971351465 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff700c93d0 con 0x7eff5c004850 2024-05-08T21:10:18.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.382+0000 7eff753a3700 1 -- 172.21.15.80:0/971351465 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff5c00c160 con 0x7eff5c003a00 2024-05-08T21:10:18.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.382+0000 7eff753a3700 1 -- 172.21.15.80:0/971351465 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff5c00c320 con 0x7eff5c005210 2024-05-08T21:10:18.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.383+0000 7eff763a5700 1 --2- 172.21.15.80:0/971351465 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7eff5c003a00 0x7eff5c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:18.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.383+0000 7eff75ba4700 1 --2- 172.21.15.80:0/971351465 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff5c004850 0x7eff5c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:18.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.383+0000 7eff76ba6700 1 --2- 172.21.15.80:0/971351465 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7eff5c005210 0x7eff5c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:18.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.383+0000 7eff75ba4700 1 -- 172.21.15.80:0/971351465 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7eff5c005210 msgr2=0x7eff5c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:18.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.383+0000 7eff75ba4700 1 --2- 172.21.15.80:0/971351465 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7eff5c005210 0x7eff5c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:18.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.383+0000 7eff75ba4700 1 -- 172.21.15.80:0/971351465 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7eff5c003a00 msgr2=0x7eff5c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:18.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.383+0000 7eff75ba4700 1 --2- 172.21.15.80:0/971351465 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7eff5c003a00 0x7eff5c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:18.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.383+0000 7eff75ba4700 1 -- 172.21.15.80:0/971351465 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff5c0035b0 con 0x7eff5c004850 2024-05-08T21:10:18.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.383+0000 7eff76ba6700 1 -- 172.21.15.80:0/971351465 reap_dead start 2024-05-08T21:10:18.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.383+0000 7eff75ba4700 1 --2- 172.21.15.80:0/971351465 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff5c004850 0x7eff5c004cd0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7eff600017c0 tx=0x7eff5c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6754c449bef40bfb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:18.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.383+0000 7eff753a3700 1 -- 172.21.15.80:0/971351465 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff600052d0 con 0x7eff5c004850 2024-05-08T21:10:18.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.383+0000 7eff753a3700 1 -- 172.21.15.80:0/971351465 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff60005450 con 0x7eff5c004850 2024-05-08T21:10:18.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.383+0000 7eff753a3700 1 -- 172.21.15.80:0/971351465 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff600038c0 con 0x7eff5c004850 2024-05-08T21:10:18.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.384+0000 7eff78609700 1 -- 172.21.15.80:0/971351465 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff5c004850 msgr2=0x7eff5c004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:18.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.384+0000 7eff78609700 1 --2- 172.21.15.80:0/971351465 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff5c004850 0x7eff5c004cd0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7eff600017c0 tx=0x7eff5c005880 comp rx=0 tx=0).stop 2024-05-08T21:10:18.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.384+0000 7eff78609700 1 -- 172.21.15.80:0/971351465 shutdown_connections 2024-05-08T21:10:18.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.384+0000 7eff78609700 1 --2- 172.21.15.80:0/971351465 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff5c004850 0x7eff5c004cd0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:18.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.384+0000 7eff78609700 1 -- 172.21.15.80:0/971351465 >> 172.21.15.80:0/971351465 conn(0x7eff7006ef80 msgr2=0x7eff7006f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:18.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.384+0000 7eff78609700 1 -- 172.21.15.80:0/971351465 shutdown_connections 2024-05-08T21:10:18.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.384+0000 7eff78609700 1 -- 172.21.15.80:0/971351465 wait complete. 2024-05-08T21:10:18.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.385+0000 7eff78609700 1 Processor -- start 2024-05-08T21:10:18.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.385+0000 7eff78609700 1 -- start start 2024-05-08T21:10:18.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.386+0000 7eff78609700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7eff5c004850 0x7eff700cc820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:18.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.386+0000 7eff78609700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff70143060 0x7eff701434e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:18.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.386+0000 7eff78609700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7eff7014a8b0 0x7eff7014ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:18.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.386+0000 7eff78609700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff700c9c80 con 0x7eff70143060 2024-05-08T21:10:18.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.386+0000 7eff78609700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff700cd290 con 0x7eff5c004850 2024-05-08T21:10:18.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.386+0000 7eff78609700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff70143a20 con 0x7eff7014a8b0 2024-05-08T21:10:18.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.386+0000 7eff75ba4700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff70143060 0x7eff701434e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:18.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.386+0000 7eff75ba4700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff70143060 0x7eff701434e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37370/0 (socket says 172.21.15.80:37370) 2024-05-08T21:10:18.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.386+0000 7eff75ba4700 1 -- 172.21.15.80:0/2655666347 learned_addr learned my addr 172.21.15.80:0/2655666347 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:18.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.386+0000 7eff75ba4700 1 -- 172.21.15.80:0/2655666347 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7eff7014a8b0 msgr2=0x7eff7014ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:18.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.386+0000 7eff763a5700 1 --2- 172.21.15.80:0/2655666347 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7eff5c004850 0x7eff700cc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:18.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.386+0000 7eff76ba6700 1 --2- 172.21.15.80:0/2655666347 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7eff7014a8b0 0x7eff7014ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:18.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.386+0000 7eff75ba4700 1 --2- 172.21.15.80:0/2655666347 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7eff7014a8b0 0x7eff7014ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:18.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.386+0000 7eff75ba4700 1 -- 172.21.15.80:0/2655666347 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7eff5c004850 msgr2=0x7eff700cc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:18.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.386+0000 7eff75ba4700 1 --2- 172.21.15.80:0/2655666347 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7eff5c004850 0x7eff700cc820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:18.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.387+0000 7eff75ba4700 1 -- 172.21.15.80:0/2655666347 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff70149b80 con 0x7eff70143060 2024-05-08T21:10:18.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.387+0000 7eff75ba4700 1 --2- 172.21.15.80:0/2655666347 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff70143060 0x7eff701434e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7eff5c00c130 tx=0x7eff60001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:18.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.387+0000 7eff66ffd700 1 -- 172.21.15.80:0/2655666347 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff60006d10 con 0x7eff70143060 2024-05-08T21:10:18.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.387+0000 7eff66ffd700 1 -- 172.21.15.80:0/2655666347 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff60021070 con 0x7eff70143060 2024-05-08T21:10:18.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.387+0000 7eff78609700 1 -- 172.21.15.80:0/2655666347 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff7014a420 con 0x7eff70143060 2024-05-08T21:10:18.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.387+0000 7eff66ffd700 1 -- 172.21.15.80:0/2655666347 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff60007280 con 0x7eff70143060 2024-05-08T21:10:18.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.387+0000 7eff78609700 1 -- 172.21.15.80:0/2655666347 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff700cb070 con 0x7eff70143060 2024-05-08T21:10:18.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.388+0000 7eff78609700 1 -- 172.21.15.80:0/2655666347 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff7004ec60 con 0x7eff70143060 2024-05-08T21:10:18.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.388+0000 7eff66ffd700 1 -- 172.21.15.80:0/2655666347 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7eff60023030 con 0x7eff70143060 2024-05-08T21:10:18.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.388+0000 7eff66ffd700 1 --2- 172.21.15.80:0/2655666347 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7eff5406acc0 0x7eff5406d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:18.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.389+0000 7eff66ffd700 1 -- 172.21.15.80:0/2655666347 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7eff6008bd00 con 0x7eff70143060 2024-05-08T21:10:18.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.389+0000 7eff763a5700 1 --2- 172.21.15.80:0/2655666347 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7eff5406acc0 0x7eff5406d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:18.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.389+0000 7eff763a5700 1 --2- 172.21.15.80:0/2655666347 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7eff5406acc0 0x7eff5406d180 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7eff700647e0 tx=0x7eff6c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:18.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.393+0000 7eff66ffd700 1 -- 172.21.15.80:0/2655666347 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7eff60056c80 con 0x7eff70143060 2024-05-08T21:10:18.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.588+0000 7eff78609700 1 -- 172.21.15.80:0/2655666347 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7eff700c8460 con 0x7eff70143060 2024-05-08T21:10:18.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.588+0000 7eff66ffd700 1 -- 172.21.15.80:0/2655666347 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7eff600170a0 con 0x7eff70143060 2024-05-08T21:10:18.592 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-05-08T21:10:18.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.590+0000 7eff78609700 1 -- 172.21.15.80:0/2655666347 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7eff5406acc0 msgr2=0x7eff5406d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:18.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.590+0000 7eff78609700 1 --2- 172.21.15.80:0/2655666347 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7eff5406acc0 0x7eff5406d180 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7eff700647e0 tx=0x7eff6c008040 comp rx=0 tx=0).stop 2024-05-08T21:10:18.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.590+0000 7eff78609700 1 -- 172.21.15.80:0/2655666347 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff70143060 msgr2=0x7eff701434e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:18.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.590+0000 7eff78609700 1 --2- 172.21.15.80:0/2655666347 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff70143060 0x7eff701434e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7eff5c00c130 tx=0x7eff60001120 comp rx=0 tx=0).stop 2024-05-08T21:10:18.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.590+0000 7eff78609700 1 -- 172.21.15.80:0/2655666347 shutdown_connections 2024-05-08T21:10:18.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.590+0000 7eff78609700 1 --2- 172.21.15.80:0/2655666347 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7eff5406acc0 0x7eff5406d180 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:18.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.590+0000 7eff78609700 1 --2- 172.21.15.80:0/2655666347 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7eff7014a8b0 0x7eff7014ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:18.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.590+0000 7eff78609700 1 --2- 172.21.15.80:0/2655666347 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7eff5c004850 0x7eff700cc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:18.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.590+0000 7eff78609700 1 --2- 172.21.15.80:0/2655666347 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff70143060 0x7eff701434e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:18.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.590+0000 7eff78609700 1 -- 172.21.15.80:0/2655666347 >> 172.21.15.80:0/2655666347 conn(0x7eff7006ef80 msgr2=0x7eff70157800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:18.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.590+0000 7eff78609700 1 -- 172.21.15.80:0/2655666347 shutdown_connections 2024-05-08T21:10:18.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.590+0000 7eff78609700 1 -- 172.21.15.80:0/2655666347 wait complete. 2024-05-08T21:10:18.605 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T21:10:18.725 INFO:tasks.ceph.mds.d.smithi106.stderr:2024-05-08T21:10:18.721+0000 7f46020c5700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-08T21:10:18.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.725+0000 7f97828ad700 1 Processor -- start 2024-05-08T21:10:18.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.725+0000 7f97828ad700 1 -- start start 2024-05-08T21:10:18.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.726+0000 7f97828ad700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f977c0ccfe0 0x7f977c071be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:18.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.726+0000 7f97828ad700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f977c0c9150 con 0x7f977c0c8380 2024-05-08T21:10:18.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.726+0000 7f97828ad700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f977c0c99f0 con 0x7f977c0ccc00 2024-05-08T21:10:18.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.726+0000 7f97828ad700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f977c1579c0 con 0x7f977c0ccfe0 2024-05-08T21:10:18.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.726+0000 7f9780e4a700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f977c0c8380 0x7f977c14d840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59084/0 (socket says 172.21.15.80:59084) 2024-05-08T21:10:18.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.726+0000 7f9780e4a700 1 -- 172.21.15.80:0/1248398706 learned_addr learned my addr 172.21.15.80:0/1248398706 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:10:18.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.726+0000 7f977b7fe700 1 --2- 172.21.15.80:0/1248398706 >> v2:172.21.15.106:3300/0 conn(0x7f977c0ccfe0 0x7f977c071be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:18.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.727+0000 7f977affd700 1 -- 172.21.15.80:0/1248398706 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1466631609 0 0) 0x7f977c0c9150 con 0x7f977c0c8380 2024-05-08T21:10:18.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.727+0000 7f977affd700 1 -- 172.21.15.80:0/1248398706 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97680035b0 con 0x7f977c0c8380 2024-05-08T21:10:18.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.727+0000 7f977b7fe700 1 -- 172.21.15.80:0/1248398706 >> v1:172.21.15.106:6789/0 conn(0x7f977c0ccc00 legacy=0x7f977c156ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:18.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.727+0000 7f977b7fe700 1 -- 172.21.15.80:0/1248398706 >> v1:172.21.15.80:6789/0 conn(0x7f977c0c8380 legacy=0x7f977c14d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:18.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.727+0000 7f977b7fe700 1 -- 172.21.15.80:0/1248398706 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f977c157ca0 con 0x7f977c0ccfe0 2024-05-08T21:10:18.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.727+0000 7f977b7fe700 1 --2- 172.21.15.80:0/1248398706 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f977c0ccfe0 0x7f977c071be0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9764009840 tx=0x7f9764009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e3eb43fd45f485d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:18.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.727+0000 7f977affd700 1 -- 172.21.15.80:0/1248398706 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9764011830 con 0x7f977c0ccfe0 2024-05-08T21:10:18.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.727+0000 7f977affd700 1 -- 172.21.15.80:0/1248398706 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9764011990 con 0x7f977c0ccfe0 2024-05-08T21:10:18.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.727+0000 7f977affd700 1 -- 172.21.15.80:0/1248398706 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9764011d20 con 0x7f977c0ccfe0 2024-05-08T21:10:18.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.728+0000 7f97828ad700 1 -- 172.21.15.80:0/1248398706 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f977c0ccfe0 msgr2=0x7f977c071be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:18.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.728+0000 7f97828ad700 1 --2- 172.21.15.80:0/1248398706 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f977c0ccfe0 0x7f977c071be0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9764009840 tx=0x7f9764009b50 comp rx=0 tx=0).stop 2024-05-08T21:10:18.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.728+0000 7f97828ad700 1 -- 172.21.15.80:0/1248398706 shutdown_connections 2024-05-08T21:10:18.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.728+0000 7f97828ad700 1 --2- 172.21.15.80:0/1248398706 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f977c0ccfe0 0x7f977c071be0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:18.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.728+0000 7f97828ad700 1 -- 172.21.15.80:0/1248398706 >> 172.21.15.80:0/1248398706 conn(0x7f977c06f140 msgr2=0x7f977c06f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:18.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.728+0000 7f97828ad700 1 -- 172.21.15.80:0/1248398706 shutdown_connections 2024-05-08T21:10:18.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.728+0000 7f97828ad700 1 -- 172.21.15.80:0/1248398706 wait complete. 2024-05-08T21:10:18.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.729+0000 7f97828ad700 1 Processor -- start 2024-05-08T21:10:18.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.729+0000 7f97828ad700 1 -- start start 2024-05-08T21:10:18.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.730+0000 7f97828ad700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f977c0c8380 0x7f977c1481b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:18.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.730+0000 7f97828ad700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f977c0ccc00 0x7f977c1edb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:18.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.730+0000 7f97828ad700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f977c0ccfe0 0x7f977c144160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:18.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.730+0000 7f97828ad700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977c159690 con 0x7f977c0ccc00 2024-05-08T21:10:18.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.730+0000 7f97828ad700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977c1ed450 con 0x7f977c0c8380 2024-05-08T21:10:18.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.730+0000 7f97828ad700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f977c158480 con 0x7f977c0ccfe0 2024-05-08T21:10:18.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.730+0000 7f977b7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f977c0ccc00 0x7f977c1edb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:18.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.730+0000 7f977b7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f977c0ccc00 0x7f977c1edb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37386/0 (socket says 172.21.15.80:37386) 2024-05-08T21:10:18.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.730+0000 7f977b7fe700 1 -- 172.21.15.80:0/4072741502 learned_addr learned my addr 172.21.15.80:0/4072741502 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:18.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.730+0000 7f9780e4a700 1 --2- 172.21.15.80:0/4072741502 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f977c0ccfe0 0x7f977c144160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:18.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.730+0000 7f977bfff700 1 --2- 172.21.15.80:0/4072741502 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f977c0c8380 0x7f977c1481b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:18.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.730+0000 7f977b7fe700 1 -- 172.21.15.80:0/4072741502 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f977c0ccfe0 msgr2=0x7f977c144160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:18.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.730+0000 7f977b7fe700 1 --2- 172.21.15.80:0/4072741502 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f977c0ccfe0 0x7f977c144160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:18.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.730+0000 7f977b7fe700 1 -- 172.21.15.80:0/4072741502 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f977c0c8380 msgr2=0x7f977c1481b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:18.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.730+0000 7f977b7fe700 1 --2- 172.21.15.80:0/4072741502 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f977c0c8380 0x7f977c1481b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:18.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.730+0000 7f977b7fe700 1 -- 172.21.15.80:0/4072741502 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97640094a0 con 0x7f977c0ccc00 2024-05-08T21:10:18.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.730+0000 7f9780e4a700 1 --2- 172.21.15.80:0/4072741502 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f977c0ccfe0 0x7f977c144160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:10:18.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.730+0000 7f977bfff700 1 --2- 172.21.15.80:0/4072741502 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f977c0c8380 0x7f977c1481b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:10:18.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.730+0000 7f977b7fe700 1 --2- 172.21.15.80:0/4072741502 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f977c0ccc00 0x7f977c1edb80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9764009fd0 tx=0x7f9764004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:18.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.731+0000 7f9778ff9700 1 -- 172.21.15.80:0/4072741502 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97640036a0 con 0x7f977c0ccc00 2024-05-08T21:10:18.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.731+0000 7f9778ff9700 1 -- 172.21.15.80:0/4072741502 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9764003800 con 0x7f977c0ccc00 2024-05-08T21:10:18.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.731+0000 7f9778ff9700 1 -- 172.21.15.80:0/4072741502 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9764003bb0 con 0x7f977c0ccc00 2024-05-08T21:10:18.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.731+0000 7f97828ad700 1 -- 172.21.15.80:0/4072741502 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f977c15abb0 con 0x7f977c0ccc00 2024-05-08T21:10:18.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.731+0000 7f97828ad700 1 -- 172.21.15.80:0/4072741502 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f977c15b170 con 0x7f977c0ccc00 2024-05-08T21:10:18.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.732+0000 7f97828ad700 1 -- 172.21.15.80:0/4072741502 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f977c04ec60 con 0x7f977c0ccc00 2024-05-08T21:10:18.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.732+0000 7f9778ff9700 1 -- 172.21.15.80:0/4072741502 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9764003d10 con 0x7f977c0ccc00 2024-05-08T21:10:18.738 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.732+0000 7f9778ff9700 1 --2- 172.21.15.80:0/4072741502 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f975c06ac90 0x7f975c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:18.738 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.732+0000 7f9778ff9700 1 -- 172.21.15.80:0/4072741502 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f976408abb0 con 0x7f977c0ccc00 2024-05-08T21:10:18.738 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.732+0000 7f977bfff700 1 --2- 172.21.15.80:0/4072741502 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f975c06ac90 0x7f975c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:18.738 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.733+0000 7f977bfff700 1 --2- 172.21.15.80:0/4072741502 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f975c06ac90 0x7f975c06d150 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f976c000f60 tx=0x7f976c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:18.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.737+0000 7f9778ff9700 1 -- 172.21.15.80:0/4072741502 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f9764055bc0 con 0x7f977c0ccc00 2024-05-08T21:10:18.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.934+0000 7f97828ad700 1 -- 172.21.15.80:0/4072741502 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f977c072e60 con 0x7f977c0ccc00 2024-05-08T21:10:18.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.935+0000 7f9778ff9700 1 -- 172.21.15.80:0/4072741502 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f97640150a0 con 0x7f977c0ccc00 2024-05-08T21:10:18.938 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-05-08T21:10:18.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.937+0000 7f97828ad700 1 -- 172.21.15.80:0/4072741502 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f975c06ac90 msgr2=0x7f975c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:18.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.937+0000 7f97828ad700 1 --2- 172.21.15.80:0/4072741502 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f975c06ac90 0x7f975c06d150 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f976c000f60 tx=0x7f976c009040 comp rx=0 tx=0).stop 2024-05-08T21:10:18.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.937+0000 7f97828ad700 1 -- 172.21.15.80:0/4072741502 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f977c0ccc00 msgr2=0x7f977c1edb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:18.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.937+0000 7f97828ad700 1 --2- 172.21.15.80:0/4072741502 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f977c0ccc00 0x7f977c1edb80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9764009fd0 tx=0x7f9764004750 comp rx=0 tx=0).stop 2024-05-08T21:10:18.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.937+0000 7f97828ad700 1 -- 172.21.15.80:0/4072741502 shutdown_connections 2024-05-08T21:10:18.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.937+0000 7f97828ad700 1 --2- 172.21.15.80:0/4072741502 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f975c06ac90 0x7f975c06d150 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:18.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.937+0000 7f97828ad700 1 --2- 172.21.15.80:0/4072741502 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f977c0ccfe0 0x7f977c144160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:18.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.937+0000 7f97828ad700 1 --2- 172.21.15.80:0/4072741502 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f977c0c8380 0x7f977c1481b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:18.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.937+0000 7f97828ad700 1 --2- 172.21.15.80:0/4072741502 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f977c0ccc00 0x7f977c1edb80 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:18.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.937+0000 7f97828ad700 1 -- 172.21.15.80:0/4072741502 >> 172.21.15.80:0/4072741502 conn(0x7f977c06f140 msgr2=0x7f977c071ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:18.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.937+0000 7f97828ad700 1 -- 172.21.15.80:0/4072741502 shutdown_connections 2024-05-08T21:10:18.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:18.937+0000 7f97828ad700 1 -- 172.21.15.80:0/4072741502 wait complete. 2024-05-08T21:10:18.952 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-08T21:10:19.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.072+0000 7fc4624de700 1 Processor -- start 2024-05-08T21:10:19.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.073+0000 7fc4624de700 1 -- start start 2024-05-08T21:10:19.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.073+0000 7fc4624de700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc45c06c2b0 0x7fc45c0c7a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:19.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.073+0000 7fc4624de700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc45c0c6880 0x7fc45c156c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:19.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.073+0000 7fc4624de700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc45c0c8250 con 0x7fc45c150c10 2024-05-08T21:10:19.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.073+0000 7fc4624de700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc45c0c8810 con 0x7fc45c0c6880 2024-05-08T21:10:19.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.073+0000 7fc4624de700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc45c0c78c0 con 0x7fc45c06c2b0 2024-05-08T21:10:19.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.073+0000 7fc460a7b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc45c0c6880 0x7fc45c156c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:19.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.073+0000 7fc45bfff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc45c150c10 0x7fc45c0c18b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59090/0 (socket says 172.21.15.80:59090) 2024-05-08T21:10:19.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.073+0000 7fc45bfff700 1 -- 172.21.15.80:0/2883065603 learned_addr learned my addr 172.21.15.80:0/2883065603 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:10:19.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.074+0000 7fc45b7fe700 1 --2- 172.21.15.80:0/2883065603 >> v2:172.21.15.106:3300/0 conn(0x7fc45c06c2b0 0x7fc45c0c7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:19.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.074+0000 7fc460a7b700 1 -- 172.21.15.80:0/2883065603 >> v2:172.21.15.106:3300/0 conn(0x7fc45c06c2b0 msgr2=0x7fc45c0c7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:19.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.074+0000 7fc460a7b700 1 --2- 172.21.15.80:0/2883065603 >> v2:172.21.15.106:3300/0 conn(0x7fc45c06c2b0 0x7fc45c0c7a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:19.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.074+0000 7fc460a7b700 1 -- 172.21.15.80:0/2883065603 >> v1:172.21.15.80:6789/0 conn(0x7fc45c150c10 legacy=0x7fc45c0c18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:19.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.074+0000 7fc460a7b700 1 -- 172.21.15.80:0/2883065603 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc45c0c8530 con 0x7fc45c0c6880 2024-05-08T21:10:19.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.074+0000 7fc45affd700 1 -- 172.21.15.80:0/2883065603 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2307398414 0 0) 0x7fc45c0c8250 con 0x7fc45c150c10 2024-05-08T21:10:19.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.074+0000 7fc45b7fe700 1 --2- 172.21.15.80:0/2883065603 >> v2:172.21.15.106:3300/0 conn(0x7fc45c06c2b0 0x7fc45c0c7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:10:19.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.074+0000 7fc460a7b700 1 --2- 172.21.15.80:0/2883065603 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc45c0c6880 0x7fc45c156c20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc45c0c3250 tx=0x7fc45400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0b108068a4a5766 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:19.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.074+0000 7fc45affd700 1 -- 172.21.15.80:0/2883065603 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc45400e070 con 0x7fc45c0c6880 2024-05-08T21:10:19.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.074+0000 7fc45affd700 1 -- 172.21.15.80:0/2883065603 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc45400bbd0 con 0x7fc45c0c6880 2024-05-08T21:10:19.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.074+0000 7fc45affd700 1 -- 172.21.15.80:0/2883065603 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc454012430 con 0x7fc45c0c6880 2024-05-08T21:10:19.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.075+0000 7fc4624de700 1 -- 172.21.15.80:0/2883065603 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc45c0c6880 msgr2=0x7fc45c156c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:19.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.075+0000 7fc4624de700 1 --2- 172.21.15.80:0/2883065603 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc45c0c6880 0x7fc45c156c20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc45c0c3250 tx=0x7fc45400b330 comp rx=0 tx=0).stop 2024-05-08T21:10:19.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.075+0000 7fc4624de700 1 -- 172.21.15.80:0/2883065603 shutdown_connections 2024-05-08T21:10:19.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.075+0000 7fc4624de700 1 --2- 172.21.15.80:0/2883065603 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc45c0c6880 0x7fc45c156c20 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:19.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.075+0000 7fc4624de700 1 --2- 172.21.15.80:0/2883065603 >> v2:172.21.15.106:3300/0 conn(0x7fc45c06c2b0 0x7fc45c0c7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:19.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.075+0000 7fc4624de700 1 -- 172.21.15.80:0/2883065603 >> 172.21.15.80:0/2883065603 conn(0x7fc45c0cbe80 msgr2=0x7fc45c0cc290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:19.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.075+0000 7fc4624de700 1 -- 172.21.15.80:0/2883065603 shutdown_connections 2024-05-08T21:10:19.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.075+0000 7fc4624de700 1 -- 172.21.15.80:0/2883065603 wait complete. 2024-05-08T21:10:19.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.076+0000 7fc4624de700 1 Processor -- start 2024-05-08T21:10:19.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.076+0000 7fc4624de700 1 -- start start 2024-05-08T21:10:19.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.077+0000 7fc4624de700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc45c06c2b0 0x7fc45c0c2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:19.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.077+0000 7fc4624de700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc45c0c6880 0x7fc45c15bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:19.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.077+0000 7fc4624de700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc45c150c10 0x7fc45c146c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:19.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.077+0000 7fc4624de700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc45c0c5ed0 con 0x7fc45c150c10 2024-05-08T21:10:19.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.077+0000 7fc4624de700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc45c14e700 con 0x7fc45c0c6880 2024-05-08T21:10:19.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.077+0000 7fc4624de700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc45c14e9e0 con 0x7fc45c06c2b0 2024-05-08T21:10:19.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.077+0000 7fc460a7b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc45c150c10 0x7fc45c146c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:19.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.077+0000 7fc460a7b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc45c150c10 0x7fc45c146c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37394/0 (socket says 172.21.15.80:37394) 2024-05-08T21:10:19.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.077+0000 7fc460a7b700 1 -- 172.21.15.80:0/2126133584 learned_addr learned my addr 172.21.15.80:0/2126133584 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:19.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.077+0000 7fc45b7fe700 1 --2- 172.21.15.80:0/2126133584 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc45c0c6880 0x7fc45c15bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:19.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.077+0000 7fc45bfff700 1 --2- 172.21.15.80:0/2126133584 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc45c06c2b0 0x7fc45c0c2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:19.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.077+0000 7fc460a7b700 1 -- 172.21.15.80:0/2126133584 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc45c06c2b0 msgr2=0x7fc45c0c2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:19.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.077+0000 7fc460a7b700 1 --2- 172.21.15.80:0/2126133584 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc45c06c2b0 0x7fc45c0c2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:19.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.077+0000 7fc460a7b700 1 -- 172.21.15.80:0/2126133584 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc45c0c6880 msgr2=0x7fc45c15bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:19.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.077+0000 7fc460a7b700 1 --2- 172.21.15.80:0/2126133584 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc45c0c6880 0x7fc45c15bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:19.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.077+0000 7fc460a7b700 1 -- 172.21.15.80:0/2126133584 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc454009a70 con 0x7fc45c150c10 2024-05-08T21:10:19.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.077+0000 7fc460a7b700 1 --2- 172.21.15.80:0/2126133584 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc45c150c10 0x7fc45c146c30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc45c06f220 tx=0x7fc454004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:19.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.077+0000 7fc458ff9700 1 -- 172.21.15.80:0/2126133584 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc454012430 con 0x7fc45c150c10 2024-05-08T21:10:19.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.077+0000 7fc458ff9700 1 -- 172.21.15.80:0/2126133584 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc454020070 con 0x7fc45c150c10 2024-05-08T21:10:19.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.077+0000 7fc4624de700 1 -- 172.21.15.80:0/2126133584 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc45c1f0e30 con 0x7fc45c150c10 2024-05-08T21:10:19.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.077+0000 7fc458ff9700 1 -- 172.21.15.80:0/2126133584 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc454004280 con 0x7fc45c150c10 2024-05-08T21:10:19.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.077+0000 7fc4624de700 1 -- 172.21.15.80:0/2126133584 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc45c1f13f0 con 0x7fc45c150c10 2024-05-08T21:10:19.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.079+0000 7fc4624de700 1 -- 172.21.15.80:0/2126133584 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc45c06bc00 con 0x7fc45c150c10 2024-05-08T21:10:19.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.079+0000 7fc458ff9700 1 -- 172.21.15.80:0/2126133584 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc4540043e0 con 0x7fc45c150c10 2024-05-08T21:10:19.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.079+0000 7fc458ff9700 1 --2- 172.21.15.80:0/2126133584 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fc43c06ac90 0x7fc43c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:19.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.079+0000 7fc458ff9700 1 -- 172.21.15.80:0/2126133584 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc454022070 con 0x7fc45c150c10 2024-05-08T21:10:19.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.079+0000 7fc45bfff700 1 --2- 172.21.15.80:0/2126133584 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fc43c06ac90 0x7fc43c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:19.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.080+0000 7fc45bfff700 1 --2- 172.21.15.80:0/2126133584 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fc43c06ac90 0x7fc43c06d150 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc44c000f60 tx=0x7fc44c007e70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:19.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.084+0000 7fc458ff9700 1 -- 172.21.15.80:0/2126133584 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fc454056580 con 0x7fc45c150c10 2024-05-08T21:10:19.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.279+0000 7fc4624de700 1 -- 172.21.15.80:0/2126133584 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc45c04ec60 con 0x7fc45c150c10 2024-05-08T21:10:19.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.279+0000 7fc458ff9700 1 -- 172.21.15.80:0/2126133584 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc454059ba0 con 0x7fc45c150c10 2024-05-08T21:10:19.283 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-05-08T21:10:19.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.281+0000 7fc4624de700 1 -- 172.21.15.80:0/2126133584 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fc43c06ac90 msgr2=0x7fc43c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:19.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.281+0000 7fc4624de700 1 --2- 172.21.15.80:0/2126133584 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fc43c06ac90 0x7fc43c06d150 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc44c000f60 tx=0x7fc44c007e70 comp rx=0 tx=0).stop 2024-05-08T21:10:19.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.281+0000 7fc4624de700 1 -- 172.21.15.80:0/2126133584 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc45c150c10 msgr2=0x7fc45c146c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:19.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.281+0000 7fc4624de700 1 --2- 172.21.15.80:0/2126133584 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc45c150c10 0x7fc45c146c30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc45c06f220 tx=0x7fc454004ad0 comp rx=0 tx=0).stop 2024-05-08T21:10:19.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.281+0000 7fc4624de700 1 -- 172.21.15.80:0/2126133584 shutdown_connections 2024-05-08T21:10:19.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.281+0000 7fc4624de700 1 --2- 172.21.15.80:0/2126133584 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fc43c06ac90 0x7fc43c06d150 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:19.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.281+0000 7fc4624de700 1 --2- 172.21.15.80:0/2126133584 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc45c150c10 0x7fc45c146c30 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:19.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.281+0000 7fc4624de700 1 --2- 172.21.15.80:0/2126133584 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc45c06c2b0 0x7fc45c0c2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:19.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.281+0000 7fc4624de700 1 --2- 172.21.15.80:0/2126133584 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc45c0c6880 0x7fc45c15bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:19.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.281+0000 7fc4624de700 1 -- 172.21.15.80:0/2126133584 >> 172.21.15.80:0/2126133584 conn(0x7fc45c0cbe80 msgr2=0x7fc45c06e410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:19.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.281+0000 7fc4624de700 1 -- 172.21.15.80:0/2126133584 shutdown_connections 2024-05-08T21:10:19.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.281+0000 7fc4624de700 1 -- 172.21.15.80:0/2126133584 wait complete. 2024-05-08T21:10:19.297 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-08T21:10:19.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.417+0000 7f6864ed2700 1 Processor -- start 2024-05-08T21:10:19.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.417+0000 7f6864ed2700 1 -- start start 2024-05-08T21:10:19.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.418+0000 7f6864ed2700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f68601541a0 0x7f686015a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:19.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.418+0000 7f6864ed2700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f68600c9150 0x7f68600c95b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:19.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.418+0000 7f6864ed2700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68600c8cc0 con 0x7f6860072600 2024-05-08T21:10:19.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.418+0000 7f6864ed2700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f686006c5a0 con 0x7f68601541a0 2024-05-08T21:10:19.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.418+0000 7f6864ed2700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f686006ce60 con 0x7f68600c9150 2024-05-08T21:10:19.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.418+0000 7f685e59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f68601541a0 0x7f686015a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:19.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.418+0000 7f685ed9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f6860072600 0x7f6860072a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59092/0 (socket says 172.21.15.80:59092) 2024-05-08T21:10:19.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.418+0000 7f685ed9d700 1 -- 172.21.15.80:0/3392731006 learned_addr learned my addr 172.21.15.80:0/3392731006 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:10:19.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.418+0000 7f685dd9b700 1 --2- 172.21.15.80:0/3392731006 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f68600c9150 0x7f68600c95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:19.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.418+0000 7f685e59c700 1 -- 172.21.15.80:0/3392731006 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f68600c9150 msgr2=0x7f68600c95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:19.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.418+0000 7f685e59c700 1 --2- 172.21.15.80:0/3392731006 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f68600c9150 0x7f68600c95b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:19.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.418+0000 7f685e59c700 1 -- 172.21.15.80:0/3392731006 >> v1:172.21.15.80:6789/0 conn(0x7f6860072600 legacy=0x7f6860072a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:19.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.418+0000 7f685e59c700 1 -- 172.21.15.80:0/3392731006 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f686015e710 con 0x7f68601541a0 2024-05-08T21:10:19.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.418+0000 7f685dd9b700 1 --2- 172.21.15.80:0/3392731006 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f68600c9150 0x7f68600c95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:10:19.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.419+0000 7f685e59c700 1 --2- 172.21.15.80:0/3392731006 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68601541a0 0x7f686015a1a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6848009840 tx=0x7f6848009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dfc7f00dffca6e3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:19.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.419+0000 7f685d59a700 1 -- 172.21.15.80:0/3392731006 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6848011830 con 0x7f68601541a0 2024-05-08T21:10:19.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.419+0000 7f685d59a700 1 -- 172.21.15.80:0/3392731006 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6848011990 con 0x7f68601541a0 2024-05-08T21:10:19.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.419+0000 7f685d59a700 1 -- 172.21.15.80:0/3392731006 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6848011d20 con 0x7f68601541a0 2024-05-08T21:10:19.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.419+0000 7f6864ed2700 1 -- 172.21.15.80:0/3392731006 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68601541a0 msgr2=0x7f686015a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:19.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.419+0000 7f6864ed2700 1 --2- 172.21.15.80:0/3392731006 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68601541a0 0x7f686015a1a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6848009840 tx=0x7f6848009b50 comp rx=0 tx=0).stop 2024-05-08T21:10:19.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.419+0000 7f6864ed2700 1 -- 172.21.15.80:0/3392731006 shutdown_connections 2024-05-08T21:10:19.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.419+0000 7f6864ed2700 1 --2- 172.21.15.80:0/3392731006 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68601541a0 0x7f686015a1a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:19.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.419+0000 7f6864ed2700 1 --2- 172.21.15.80:0/3392731006 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f68600c9150 0x7f68600c95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:19.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.419+0000 7f6864ed2700 1 -- 172.21.15.80:0/3392731006 >> 172.21.15.80:0/3392731006 conn(0x7f686006ef80 msgr2=0x7f686006f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:19.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.419+0000 7f6864ed2700 1 -- 172.21.15.80:0/3392731006 shutdown_connections 2024-05-08T21:10:19.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.419+0000 7f6864ed2700 1 -- 172.21.15.80:0/3392731006 wait complete. 2024-05-08T21:10:19.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.421+0000 7f6864ed2700 1 Processor -- start 2024-05-08T21:10:19.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.421+0000 7f6864ed2700 1 -- start start 2024-05-08T21:10:19.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.421+0000 7f6864ed2700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6860072600 0x7f686014f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:19.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.421+0000 7f6864ed2700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f68600c9150 0x7f68601efa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:19.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.421+0000 7f6864ed2700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f68601541a0 0x7f68601eff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:19.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.421+0000 7f6864ed2700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f686014b520 con 0x7f6860072600 2024-05-08T21:10:19.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.421+0000 7f6864ed2700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68601f3c80 con 0x7f68600c9150 2024-05-08T21:10:19.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.421+0000 7f6864ed2700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68600c5c60 con 0x7f68601541a0 2024-05-08T21:10:19.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.422+0000 7f685e59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6860072600 0x7f686014f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:19.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.422+0000 7f685e59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6860072600 0x7f686014f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37410/0 (socket says 172.21.15.80:37410) 2024-05-08T21:10:19.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.422+0000 7f685e59c700 1 -- 172.21.15.80:0/2858804756 learned_addr learned my addr 172.21.15.80:0/2858804756 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:19.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.422+0000 7f685ed9d700 1 --2- 172.21.15.80:0/2858804756 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f68601541a0 0x7f68601eff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:19.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.422+0000 7f685dd9b700 1 --2- 172.21.15.80:0/2858804756 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f68600c9150 0x7f68601efa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:19.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.422+0000 7f685e59c700 1 -- 172.21.15.80:0/2858804756 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f68601541a0 msgr2=0x7f68601eff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:19.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.422+0000 7f685e59c700 1 --2- 172.21.15.80:0/2858804756 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f68601541a0 0x7f68601eff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:19.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.422+0000 7f685e59c700 1 -- 172.21.15.80:0/2858804756 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f68600c9150 msgr2=0x7f68601efa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:19.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.422+0000 7f685e59c700 1 --2- 172.21.15.80:0/2858804756 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f68600c9150 0x7f68601efa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:19.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.422+0000 7f685e59c700 1 -- 172.21.15.80:0/2858804756 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68480094a0 con 0x7f6860072600 2024-05-08T21:10:19.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.422+0000 7f685e59c700 1 --2- 172.21.15.80:0/2858804756 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6860072600 0x7f686014f570 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6848000c00 tx=0x7f6848004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:19.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.422+0000 7f6856ffd700 1 -- 172.21.15.80:0/2858804756 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68480038a0 con 0x7f6860072600 2024-05-08T21:10:19.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.422+0000 7f6864ed2700 1 -- 172.21.15.80:0/2858804756 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68600c5f40 con 0x7f6860072600 2024-05-08T21:10:19.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.422+0000 7f6856ffd700 1 -- 172.21.15.80:0/2858804756 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f684801e070 con 0x7f6860072600 2024-05-08T21:10:19.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.422+0000 7f6856ffd700 1 -- 172.21.15.80:0/2858804756 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6848003c60 con 0x7f6860072600 2024-05-08T21:10:19.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.422+0000 7f6864ed2700 1 -- 172.21.15.80:0/2858804756 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68600ca930 con 0x7f6860072600 2024-05-08T21:10:19.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.423+0000 7f6864ed2700 1 -- 172.21.15.80:0/2858804756 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f686014b380 con 0x7f6860072600 2024-05-08T21:10:19.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.424+0000 7f6856ffd700 1 -- 172.21.15.80:0/2858804756 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f684802d450 con 0x7f6860072600 2024-05-08T21:10:19.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.424+0000 7f6856ffd700 1 --2- 172.21.15.80:0/2858804756 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f684006ac90 0x7f684006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:19.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.424+0000 7f6856ffd700 1 -- 172.21.15.80:0/2858804756 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f684808a840 con 0x7f6860072600 2024-05-08T21:10:19.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.424+0000 7f685dd9b700 1 --2- 172.21.15.80:0/2858804756 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f684006ac90 0x7f684006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:19.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.424+0000 7f685dd9b700 1 --2- 172.21.15.80:0/2858804756 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f684006ac90 0x7f684006d150 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f68600c95d0 tx=0x7f6850008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:19.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.428+0000 7f6856ffd700 1 -- 172.21.15.80:0/2858804756 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f686014b380 con 0x7f6860072600 2024-05-08T21:10:19.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.640+0000 7f6864ed2700 1 -- 172.21.15.80:0/2858804756 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f686014ba00 con 0x7f6860072600 2024-05-08T21:10:19.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.640+0000 7f6856ffd700 1 -- 172.21.15.80:0/2858804756 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f686014ba00 con 0x7f6860072600 2024-05-08T21:10:19.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.643+0000 7f6864ed2700 1 -- 172.21.15.80:0/2858804756 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f684006ac90 msgr2=0x7f684006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:19.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.643+0000 7f6864ed2700 1 --2- 172.21.15.80:0/2858804756 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f684006ac90 0x7f684006d150 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f68600c95d0 tx=0x7f6850008040 comp rx=0 tx=0).stop 2024-05-08T21:10:19.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.643+0000 7f6864ed2700 1 -- 172.21.15.80:0/2858804756 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6860072600 msgr2=0x7f686014f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:19.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.643+0000 7f6864ed2700 1 --2- 172.21.15.80:0/2858804756 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6860072600 0x7f686014f570 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6848000c00 tx=0x7f6848004750 comp rx=0 tx=0).stop 2024-05-08T21:10:19.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.643+0000 7f6864ed2700 1 -- 172.21.15.80:0/2858804756 shutdown_connections 2024-05-08T21:10:19.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.643+0000 7f6864ed2700 1 --2- 172.21.15.80:0/2858804756 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f684006ac90 0x7f684006d150 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:19.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.643+0000 7f6864ed2700 1 --2- 172.21.15.80:0/2858804756 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6860072600 0x7f686014f570 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:19.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.643+0000 7f6864ed2700 1 --2- 172.21.15.80:0/2858804756 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f68601541a0 0x7f68601eff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:19.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.643+0000 7f6864ed2700 1 --2- 172.21.15.80:0/2858804756 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f68600c9150 0x7f68601efa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:19.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.643+0000 7f6864ed2700 1 -- 172.21.15.80:0/2858804756 >> 172.21.15.80:0/2858804756 conn(0x7f686006ef80 msgr2=0x7f6860150e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:19.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.643+0000 7f6864ed2700 1 -- 172.21.15.80:0/2858804756 shutdown_connections 2024-05-08T21:10:19.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.643+0000 7f6864ed2700 1 -- 172.21.15.80:0/2858804756 wait complete. 2024-05-08T21:10:19.647 INFO:teuthology.orchestra.run.smithi080.stderr:listed 0 entries 2024-05-08T21:10:19.658 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T21:10:19.658 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T21:10:19.676 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T21:10:19.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.836+0000 7f2c0dbf8700 1 Processor -- start 2024-05-08T21:10:19.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.836+0000 7f2c0dbf8700 1 -- start start 2024-05-08T21:10:19.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.836+0000 7f2c0dbf8700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f2c080ccc00 0x7f2c08071be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:19.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.836+0000 7f2c0dbf8700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2c080ccfe0 0x7f2c080c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:19.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.836+0000 7f2c0dbf8700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c080c9150 con 0x7f2c080c8380 2024-05-08T21:10:19.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.836+0000 7f2c0dbf8700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c080c99f0 con 0x7f2c080ccc00 2024-05-08T21:10:19.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.836+0000 7f2c0dbf8700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c081579c0 con 0x7f2c080ccfe0 2024-05-08T21:10:19.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.837+0000 7f2c07fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f2c080c8380 0x7f2c08156ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59100/0 (socket says 172.21.15.80:59100) 2024-05-08T21:10:19.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.837+0000 7f2c07fff700 1 -- 172.21.15.80:0/4200282337 learned_addr learned my addr 172.21.15.80:0/4200282337 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:10:19.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.837+0000 7f2c06ffd700 1 --2- 172.21.15.80:0/4200282337 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2c080ccfe0 0x7f2c080c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:19.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.837+0000 7f2c077fe700 1 --2- 172.21.15.80:0/4200282337 >> v2:172.21.15.106:3300/0 conn(0x7f2c080ccc00 0x7f2c08071be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:19.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.837+0000 7f2c067fc700 1 -- 172.21.15.80:0/4200282337 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1586386430 0 0) 0x7f2c080c9150 con 0x7f2c080c8380 2024-05-08T21:10:19.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.837+0000 7f2c067fc700 1 -- 172.21.15.80:0/4200282337 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2bf00035b0 con 0x7f2c080c8380 2024-05-08T21:10:19.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.837+0000 7f2c067fc700 1 -- 172.21.15.80:0/4200282337 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4260011014 0 0) 0x7f2bf00035b0 con 0x7f2c080c8380 2024-05-08T21:10:19.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.837+0000 7f2c067fc700 1 -- 172.21.15.80:0/4200282337 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2c080ccfe0 msgr2=0x7f2c080c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:19.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.837+0000 7f2c067fc700 1 --2- 172.21.15.80:0/4200282337 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2c080ccfe0 0x7f2c080c9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:19.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.837+0000 7f2c067fc700 1 -- 172.21.15.80:0/4200282337 >> v2:172.21.15.106:3300/0 conn(0x7f2c080ccc00 msgr2=0x7f2c08071be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:19.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.837+0000 7f2c067fc700 1 --2- 172.21.15.80:0/4200282337 >> v2:172.21.15.106:3300/0 conn(0x7f2c080ccc00 0x7f2c08071be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:19.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.837+0000 7f2c067fc700 1 -- 172.21.15.80:0/4200282337 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c08157ca0 con 0x7f2c080c8380 2024-05-08T21:10:19.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.837+0000 7f2c067fc700 1 -- 172.21.15.80:0/4200282337 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3520646302 0 0) 0x7f2c000019f0 con 0x7f2c080c8380 2024-05-08T21:10:19.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.837+0000 7f2c067fc700 1 -- 172.21.15.80:0/4200282337 >> v1:172.21.15.80:6789/0 conn(0x7f2c080c8380 legacy=0x7f2c08156ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:19.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.837+0000 7f2c067fc700 1 --2- 172.21.15.80:0/4200282337 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2bf0003a00 0x7f2bf0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:19.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.837+0000 7f2c067fc700 1 --2- 172.21.15.80:0/4200282337 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2bf0004850 0x7f2bf0004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:19.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.837+0000 7f2c067fc700 1 --2- 172.21.15.80:0/4200282337 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2c080ccfe0 0x7f2bf0005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:19.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.837+0000 7f2c067fc700 1 -- 172.21.15.80:0/4200282337 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c080c99f0 con 0x7f2bf0003a00 2024-05-08T21:10:19.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.837+0000 7f2c067fc700 1 -- 172.21.15.80:0/4200282337 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c081579c0 con 0x7f2bf0004850 2024-05-08T21:10:19.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.837+0000 7f2c067fc700 1 -- 172.21.15.80:0/4200282337 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf000ba10 con 0x7f2c080ccfe0 2024-05-08T21:10:19.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.837+0000 7f2c077fe700 1 --2- 172.21.15.80:0/4200282337 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2bf0003a00 0x7f2bf0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:19.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.837+0000 7f2c06ffd700 1 --2- 172.21.15.80:0/4200282337 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2bf0004850 0x7f2bf0004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:19.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.837+0000 7f2c07fff700 1 --2- 172.21.15.80:0/4200282337 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2c080ccfe0 0x7f2bf0005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:19.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.837+0000 7f2c077fe700 1 -- 172.21.15.80:0/4200282337 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2c080ccfe0 msgr2=0x7f2bf0005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:19.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.837+0000 7f2c077fe700 1 --2- 172.21.15.80:0/4200282337 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2c080ccfe0 0x7f2bf0005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:19.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.837+0000 7f2c077fe700 1 -- 172.21.15.80:0/4200282337 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2bf0004850 msgr2=0x7f2bf0004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:19.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.837+0000 7f2c077fe700 1 --2- 172.21.15.80:0/4200282337 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2bf0004850 0x7f2bf0004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:19.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.838+0000 7f2c077fe700 1 -- 172.21.15.80:0/4200282337 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bf00035b0 con 0x7f2bf0003a00 2024-05-08T21:10:19.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.838+0000 7f2c077fe700 1 --2- 172.21.15.80:0/4200282337 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2bf0003a00 0x7f2bf0003e20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2bf8009b60 tx=0x7f2bf0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4560a2928121439c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:19.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.838+0000 7f2c067fc700 1 -- 172.21.15.80:0/4200282337 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf800e6c0 con 0x7f2bf0003a00 2024-05-08T21:10:19.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.838+0000 7f2c067fc700 1 -- 172.21.15.80:0/4200282337 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bf800e820 con 0x7f2bf0003a00 2024-05-08T21:10:19.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.838+0000 7f2c067fc700 1 -- 172.21.15.80:0/4200282337 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf800eb90 con 0x7f2bf0003a00 2024-05-08T21:10:19.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.838+0000 7f2c0dbf8700 1 -- 172.21.15.80:0/4200282337 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2bf0003a00 msgr2=0x7f2bf0003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:19.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.838+0000 7f2c0dbf8700 1 --2- 172.21.15.80:0/4200282337 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2bf0003a00 0x7f2bf0003e20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2bf8009b60 tx=0x7f2bf0005880 comp rx=0 tx=0).stop 2024-05-08T21:10:19.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.838+0000 7f2c07fff700 1 -- 172.21.15.80:0/4200282337 reap_dead start 2024-05-08T21:10:19.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.838+0000 7f2c0dbf8700 1 -- 172.21.15.80:0/4200282337 shutdown_connections 2024-05-08T21:10:19.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.838+0000 7f2c0dbf8700 1 -- 172.21.15.80:0/4200282337 >> 172.21.15.80:0/4200282337 conn(0x7f2c0806f140 msgr2=0x7f2c0806f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:19.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.838+0000 7f2c0dbf8700 1 -- 172.21.15.80:0/4200282337 shutdown_connections 2024-05-08T21:10:19.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.838+0000 7f2c0dbf8700 1 -- 172.21.15.80:0/4200282337 wait complete. 2024-05-08T21:10:19.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.840+0000 7f2c0dbf8700 1 Processor -- start 2024-05-08T21:10:19.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.840+0000 7f2c0dbf8700 1 -- start start 2024-05-08T21:10:19.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.841+0000 7f2c0dbf8700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2bf0003a00 0x7f2c08149860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:19.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.841+0000 7f2c0dbf8700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c08147380 0x7f2c08147800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:19.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.841+0000 7f2c0dbf8700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c081f1090 0x7f2c081f1510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:19.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.841+0000 7f2c0dbf8700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c08147d40 con 0x7f2c081f1090 2024-05-08T21:10:19.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.841+0000 7f2c0dbf8700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c0806b860 con 0x7f2c08147380 2024-05-08T21:10:19.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.841+0000 7f2c0dbf8700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c080cbad0 con 0x7f2bf0003a00 2024-05-08T21:10:19.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.841+0000 7f2c07fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c081f1090 0x7f2c081f1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:19.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.841+0000 7f2c07fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c081f1090 0x7f2c081f1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37434/0 (socket says 172.21.15.80:37434) 2024-05-08T21:10:19.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.841+0000 7f2c07fff700 1 -- 172.21.15.80:0/2630479149 learned_addr learned my addr 172.21.15.80:0/2630479149 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:19.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.841+0000 7f2c077fe700 1 --2- 172.21.15.80:0/2630479149 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2bf0003a00 0x7f2c08149860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:19.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.841+0000 7f2c06ffd700 1 --2- 172.21.15.80:0/2630479149 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c08147380 0x7f2c08147800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:19.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.841+0000 7f2c07fff700 1 -- 172.21.15.80:0/2630479149 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2bf0003a00 msgr2=0x7f2c08149860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:19.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.841+0000 7f2c07fff700 1 --2- 172.21.15.80:0/2630479149 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2bf0003a00 0x7f2c08149860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:19.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.841+0000 7f2c07fff700 1 -- 172.21.15.80:0/2630479149 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c08147380 msgr2=0x7f2c08147800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:19.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.841+0000 7f2c07fff700 1 --2- 172.21.15.80:0/2630479149 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c08147380 0x7f2c08147800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:19.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.841+0000 7f2c07fff700 1 -- 172.21.15.80:0/2630479149 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c080cc090 con 0x7f2c081f1090 2024-05-08T21:10:19.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.842+0000 7f2c07fff700 1 --2- 172.21.15.80:0/2630479149 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c081f1090 0x7f2c081f1510 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2c080c7810 tx=0x7f2c00007c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:19.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.842+0000 7f2beffff700 1 -- 172.21.15.80:0/2630479149 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c00017070 con 0x7f2c081f1090 2024-05-08T21:10:19.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.842+0000 7f2beffff700 1 -- 172.21.15.80:0/2630479149 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c0000ec80 con 0x7f2c081f1090 2024-05-08T21:10:19.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.842+0000 7f2beffff700 1 -- 172.21.15.80:0/2630479149 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0000ee10 con 0x7f2c081f1090 2024-05-08T21:10:19.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.842+0000 7f2c0dbf8700 1 -- 172.21.15.80:0/2630479149 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c081f1a50 con 0x7f2c081f1090 2024-05-08T21:10:19.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.842+0000 7f2c0dbf8700 1 -- 172.21.15.80:0/2630479149 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c080c36f0 con 0x7f2c081f1090 2024-05-08T21:10:19.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.843+0000 7f2c0dbf8700 1 -- 172.21.15.80:0/2630479149 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c080c38b0 con 0x7f2c081f1090 2024-05-08T21:10:19.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.843+0000 7f2beffff700 1 -- 172.21.15.80:0/2630479149 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2c00013420 con 0x7f2c081f1090 2024-05-08T21:10:19.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.843+0000 7f2beffff700 1 --2- 172.21.15.80:0/2630479149 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f2bf406ac90 0x7f2bf406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:19.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.844+0000 7f2beffff700 1 -- 172.21.15.80:0/2630479149 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2c00089290 con 0x7f2c081f1090 2024-05-08T21:10:19.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.844+0000 7f2c077fe700 1 --2- 172.21.15.80:0/2630479149 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f2bf406ac90 0x7f2bf406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:19.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.844+0000 7f2c077fe700 1 --2- 172.21.15.80:0/2630479149 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f2bf406ac90 0x7f2bf406d150 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2bf80090b0 tx=0x7f2bf8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:19.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:19.848+0000 7f2beffff700 1 -- 172.21.15.80:0/2630479149 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f2c080c38b0 con 0x7f2c081f1090 2024-05-08T21:10:20.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.044+0000 7f2c0dbf8700 1 -- 172.21.15.80:0/2630479149 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2c080c3880 con 0x7f2c081f1090 2024-05-08T21:10:20.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.045+0000 7f2beffff700 1 -- 172.21.15.80:0/2630479149 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+17878 (secure 0 0 0) 0x7f2c00057c10 con 0x7f2c081f1090 2024-05-08T21:10:20.049 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:10:20.049 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":26,"fsid":"44d31c1e-aad3-47ca-a4fa-85a63d4a60aa","created":"2024-05-08T21:09:46.467038+0000","modified":"2024-05-08T21:10:08.163735+0000","last_up_change":"2024-05-08T21:09:57.284675+0000","last_in_change":"2024-05-08T21:09:49.125444+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T21:09:58.238951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T21:10:02.177476+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T21:10:02.685535+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-08T21:10:05.753779+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c3f9d93e-ed6d-4a0c-b5c0-0e8d44c65fdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":47011},{"type":"v1","addr":"172.21.15.80:6817","nonce":47011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":47011},{"type":"v1","addr":"172.21.15.80:6819","nonce":47011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":47011},{"type":"v1","addr":"172.21.15.80:6823","nonce":47011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":47011},{"type":"v1","addr":"172.21.15.80:6821","nonce":47011}]},"public_addr":"172.21.15.80:6817/47011","cluster_addr":"172.21.15.80:6819/47011","heartbeat_back_addr":"172.21.15.80:6823/47011","heartbeat_front_addr":"172.21.15.80:6821/47011","state":["exists","up"]},{"osd":1,"uuid":"4ce2b4d6-6c40-43aa-8dd1-743fef8915df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":47010},{"type":"v1","addr":"172.21.15.80:6809","nonce":47010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":47010},{"type":"v1","addr":"172.21.15.80:6811","nonce":47010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":47010},{"type":"v1","addr":"172.21.15.80:6815","nonce":47010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":47010},{"type":"v1","addr":"172.21.15.80:6813","nonce":47010}]},"public_addr":"172.21.15.80:6809/47010","cluster_addr":"172.21.15.80:6811/47010","heartbeat_back_addr":"172.21.15.80:6815/47010","heartbeat_front_addr":"172.21.15.80:6813/47010","state":["exists","up"]},{"osd":2,"uuid":"e30cc3bc-6461-4fac-960a-de00c9488d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":47009},{"type":"v1","addr":"172.21.15.80:6801","nonce":47009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":47009},{"type":"v1","addr":"172.21.15.80:6803","nonce":47009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":47009},{"type":"v1","addr":"172.21.15.80:6807","nonce":47009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":47009},{"type":"v1","addr":"172.21.15.80:6805","nonce":47009}]},"public_addr":"172.21.15.80:6801/47009","cluster_addr":"172.21.15.80:6803/47009","heartbeat_back_addr":"172.21.15.80:6807/47009","heartbeat_front_addr":"172.21.15.80:6805/47009","state":["exists","up"]},{"osd":3,"uuid":"a415c099-9ea6-40be-98ed-f2932f98dfd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":47012},{"type":"v1","addr":"172.21.15.80:6825","nonce":47012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":47012},{"type":"v1","addr":"172.21.15.80:6827","nonce":47012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":47012},{"type":"v1","addr":"172.21.15.80:6831","nonce":47012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":47012},{"type":"v1","addr":"172.21.15.80:6829","nonce":47012}]},"public_addr":"172.21.15.80:6825/47012","cluster_addr":"172.21.15.80:6827/47012","heartbeat_back_addr":"172.21.15.80:6831/47012","heartbeat_front_addr":"172.21.15.80:6829/47012","state":["exists","up"]},{"osd":4,"uuid":"5ae1d51f-0918-4571-b79b-154308d46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6823","nonce":47114},{"type":"v1","addr":"172.21.15.106:6825","nonce":47114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":47114},{"type":"v1","addr":"172.21.15.106:6827","nonce":47114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":47114},{"type":"v1","addr":"172.21.15.106:6831","nonce":47114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":47114},{"type":"v1","addr":"172.21.15.106:6829","nonce":47114}]},"public_addr":"172.21.15.106:6825/47114","cluster_addr":"172.21.15.106:6827/47114","heartbeat_back_addr":"172.21.15.106:6831/47114","heartbeat_front_addr":"172.21.15.106:6829/47114","state":["exists","up"]},{"osd":5,"uuid":"a19ac74e-4282-4428-b167-26ba6b92f732","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6807","nonce":47111},{"type":"v1","addr":"172.21.15.106:6809","nonce":47111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":47111},{"type":"v1","addr":"172.21.15.106:6811","nonce":47111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":47111},{"type":"v1","addr":"172.21.15.106:6815","nonce":47111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":47111},{"type":"v1","addr":"172.21.15.106:6813","nonce":47111}]},"public_addr":"172.21.15.106:6809/47111","cluster_addr":"172.21.15.106:6811/47111","heartbeat_back_addr":"172.21.15.106:6815/47111","heartbeat_front_addr":"172.21.15.106:6813/47111","state":["exists","up"]},{"osd":6,"uuid":"bfe72edd-7acc-4805-807d-2000e76f2feb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":47112},{"type":"v1","addr":"172.21.15.106:6817","nonce":47112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":47112},{"type":"v1","addr":"172.21.15.106:6819","nonce":47112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":47112},{"type":"v1","addr":"172.21.15.106:6824","nonce":47112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":47112},{"type":"v1","addr":"172.21.15.106:6821","nonce":47112}]},"public_addr":"172.21.15.106:6817/47112","cluster_addr":"172.21.15.106:6819/47112","heartbeat_back_addr":"172.21.15.106:6824/47112","heartbeat_front_addr":"172.21.15.106:6821/47112","state":["exists","up"]},{"osd":7,"uuid":"99897f22-ed17-4c7c-9088-cc0c4a51f786","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":47113},{"type":"v1","addr":"172.21.15.106:6801","nonce":47113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":47113},{"type":"v1","addr":"172.21.15.106:6803","nonce":47113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":47113},{"type":"v1","addr":"172.21.15.106:6808","nonce":47113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":47113},{"type":"v1","addr":"172.21.15.106:6805","nonce":47113}]},"public_addr":"172.21.15.106:6801/47113","cluster_addr":"172.21.15.106:6803/47113","heartbeat_back_addr":"172.21.15.106:6808/47113","heartbeat_front_addr":"172.21.15.106:6805/47113","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.232670+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.277753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.050087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.349312+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.344080+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.348781+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.352539+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.275013+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T21:10:20.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.047+0000 7f2c0dbf8700 1 -- 172.21.15.80:0/2630479149 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f2bf406ac90 msgr2=0x7f2bf406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:20.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.047+0000 7f2c0dbf8700 1 --2- 172.21.15.80:0/2630479149 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f2bf406ac90 0x7f2bf406d150 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2bf80090b0 tx=0x7f2bf8008030 comp rx=0 tx=0).stop 2024-05-08T21:10:20.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.047+0000 7f2c0dbf8700 1 -- 172.21.15.80:0/2630479149 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c081f1090 msgr2=0x7f2c081f1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:20.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.047+0000 7f2c0dbf8700 1 --2- 172.21.15.80:0/2630479149 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c081f1090 0x7f2c081f1510 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2c080c7810 tx=0x7f2c00007c90 comp rx=0 tx=0).stop 2024-05-08T21:10:20.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.047+0000 7f2c0dbf8700 1 -- 172.21.15.80:0/2630479149 shutdown_connections 2024-05-08T21:10:20.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.047+0000 7f2c0dbf8700 1 --2- 172.21.15.80:0/2630479149 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f2bf406ac90 0x7f2bf406d150 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:20.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.047+0000 7f2c0dbf8700 1 --2- 172.21.15.80:0/2630479149 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c081f1090 0x7f2c081f1510 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:20.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.047+0000 7f2c0dbf8700 1 --2- 172.21.15.80:0/2630479149 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2bf0003a00 0x7f2c08149860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:20.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.047+0000 7f2c0dbf8700 1 --2- 172.21.15.80:0/2630479149 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c08147380 0x7f2c08147800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:20.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.047+0000 7f2c0dbf8700 1 -- 172.21.15.80:0/2630479149 >> 172.21.15.80:0/2630479149 conn(0x7f2c0806f140 msgr2=0x7f2c080c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:20.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.048+0000 7f2c0dbf8700 1 -- 172.21.15.80:0/2630479149 shutdown_connections 2024-05-08T21:10:20.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.048+0000 7f2c0dbf8700 1 -- 172.21.15.80:0/2630479149 wait complete. 2024-05-08T21:10:20.063 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T21:09:58.238951+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T21:10:02.177476+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T21:10:02.685535+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-08T21:10:05.753779+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-08T21:10:20.064 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T21:10:20.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.184+0000 7fb864626700 1 Processor -- start 2024-05-08T21:10:20.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.184+0000 7fb864626700 1 -- start start 2024-05-08T21:10:20.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.184+0000 7fb864626700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb85c0ccfe0 0x7fb85c071be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:20.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.184+0000 7fb864626700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb85c0c8380 0x7fb85c0c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:20.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.184+0000 7fb864626700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb85c0c9150 con 0x7fb85c0ccc00 2024-05-08T21:10:20.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.184+0000 7fb864626700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb85c0c99f0 con 0x7fb85c0ccfe0 2024-05-08T21:10:20.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.185+0000 7fb864626700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb85c1579c0 con 0x7fb85c0c8380 2024-05-08T21:10:20.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.185+0000 7fb861bc1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb85c0ccfe0 0x7fb85c071be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:20.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.185+0000 7fb861bc1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb85c0ccfe0 0x7fb85c071be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37444/0 (socket says 172.21.15.80:37444) 2024-05-08T21:10:20.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.185+0000 7fb861bc1700 1 -- 172.21.15.80:0/2399365084 learned_addr learned my addr 172.21.15.80:0/2399365084 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:20.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.185+0000 7fb862bc3700 1 --2- 172.21.15.80:0/2399365084 >> v2:172.21.15.106:3300/0 conn(0x7fb85c0c8380 0x7fb85c0c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:20.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.185+0000 7fb861bc1700 1 -- 172.21.15.80:0/2399365084 >> v2:172.21.15.106:3300/0 conn(0x7fb85c0c8380 msgr2=0x7fb85c0c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:20.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.185+0000 7fb861bc1700 1 --2- 172.21.15.80:0/2399365084 >> v2:172.21.15.106:3300/0 conn(0x7fb85c0c8380 0x7fb85c0c9e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:20.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.185+0000 7fb861bc1700 1 -- 172.21.15.80:0/2399365084 >> v1:172.21.15.106:6789/0 conn(0x7fb85c0ccc00 legacy=0x7fb85c156ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:20.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.185+0000 7fb861bc1700 1 -- 172.21.15.80:0/2399365084 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb85c157ca0 con 0x7fb85c0ccfe0 2024-05-08T21:10:20.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.185+0000 7fb861bc1700 1 --2- 172.21.15.80:0/2399365084 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb85c0ccfe0 0x7fb85c071be0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb85c070060 tx=0x7fb858009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ceb43f91fcb6679 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:20.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.185+0000 7fb8613c0700 1 -- 172.21.15.80:0/2399365084 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb858004230 con 0x7fb85c0ccfe0 2024-05-08T21:10:20.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.185+0000 7fb8613c0700 1 -- 172.21.15.80:0/2399365084 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb858004390 con 0x7fb85c0ccfe0 2024-05-08T21:10:20.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.185+0000 7fb8613c0700 1 -- 172.21.15.80:0/2399365084 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8580036a0 con 0x7fb85c0ccfe0 2024-05-08T21:10:20.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.186+0000 7fb864626700 1 -- 172.21.15.80:0/2399365084 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb85c0ccfe0 msgr2=0x7fb85c071be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:20.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.186+0000 7fb864626700 1 --2- 172.21.15.80:0/2399365084 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb85c0ccfe0 0x7fb85c071be0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb85c070060 tx=0x7fb858009bd0 comp rx=0 tx=0).stop 2024-05-08T21:10:20.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.186+0000 7fb864626700 1 -- 172.21.15.80:0/2399365084 shutdown_connections 2024-05-08T21:10:20.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.186+0000 7fb864626700 1 --2- 172.21.15.80:0/2399365084 >> v2:172.21.15.106:3300/0 conn(0x7fb85c0c8380 0x7fb85c0c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:20.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.186+0000 7fb864626700 1 --2- 172.21.15.80:0/2399365084 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb85c0ccfe0 0x7fb85c071be0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:20.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.186+0000 7fb864626700 1 -- 172.21.15.80:0/2399365084 >> 172.21.15.80:0/2399365084 conn(0x7fb85c06f140 msgr2=0x7fb85c06f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:20.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.186+0000 7fb864626700 1 -- 172.21.15.80:0/2399365084 shutdown_connections 2024-05-08T21:10:20.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.186+0000 7fb864626700 1 -- 172.21.15.80:0/2399365084 wait complete. 2024-05-08T21:10:20.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.187+0000 7fb864626700 1 Processor -- start 2024-05-08T21:10:20.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.187+0000 7fb864626700 1 -- start start 2024-05-08T21:10:20.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.188+0000 7fb864626700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb85c0c8380 0x7fb85c1ecf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:20.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.188+0000 7fb864626700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb85c0ccc00 0x7fb85c1ed450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:20.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.188+0000 7fb864626700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb85c0ccfe0 0x7fb85c1582d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:20.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.188+0000 7fb864626700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85c1ecae0 con 0x7fb85c0c8380 2024-05-08T21:10:20.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.188+0000 7fb864626700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85c159fd0 con 0x7fb85c0ccc00 2024-05-08T21:10:20.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.188+0000 7fb864626700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb85c15a590 con 0x7fb85c0ccfe0 2024-05-08T21:10:20.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.188+0000 7fb8623c2700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb85c0c8380 0x7fb85c1ecf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:20.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.188+0000 7fb8623c2700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb85c0c8380 0x7fb85c1ecf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37458/0 (socket says 172.21.15.80:37458) 2024-05-08T21:10:20.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.188+0000 7fb8623c2700 1 -- 172.21.15.80:0/2201714339 learned_addr learned my addr 172.21.15.80:0/2201714339 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:20.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.188+0000 7fb862bc3700 1 --2- 172.21.15.80:0/2201714339 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb85c0ccfe0 0x7fb85c1582d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:20.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.188+0000 7fb861bc1700 1 --2- 172.21.15.80:0/2201714339 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb85c0ccc00 0x7fb85c1ed450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:20.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.188+0000 7fb8623c2700 1 -- 172.21.15.80:0/2201714339 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb85c0ccfe0 msgr2=0x7fb85c1582d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:20.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.188+0000 7fb8623c2700 1 --2- 172.21.15.80:0/2201714339 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb85c0ccfe0 0x7fb85c1582d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:20.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.188+0000 7fb8623c2700 1 -- 172.21.15.80:0/2201714339 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb85c0ccc00 msgr2=0x7fb85c1ed450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:20.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.188+0000 7fb8623c2700 1 --2- 172.21.15.80:0/2201714339 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb85c0ccc00 0x7fb85c1ed450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:20.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.188+0000 7fb8623c2700 1 -- 172.21.15.80:0/2201714339 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb858009550 con 0x7fb85c0c8380 2024-05-08T21:10:20.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.188+0000 7fb862bc3700 1 --2- 172.21.15.80:0/2201714339 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb85c0ccfe0 0x7fb85c1582d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:10:20.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.188+0000 7fb861bc1700 1 --2- 172.21.15.80:0/2201714339 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb85c0ccc00 0x7fb85c1ed450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:10:20.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.188+0000 7fb8623c2700 1 --2- 172.21.15.80:0/2201714339 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb85c0c8380 0x7fb85c1ecf10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb84c00e910 tx=0x7fb84c00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:20.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.188+0000 7fb852ffd700 1 -- 172.21.15.80:0/2201714339 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84c004060 con 0x7fb85c0c8380 2024-05-08T21:10:20.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.188+0000 7fb852ffd700 1 -- 172.21.15.80:0/2201714339 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb84c0041e0 con 0x7fb85c0c8380 2024-05-08T21:10:20.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.188+0000 7fb864626700 1 -- 172.21.15.80:0/2201714339 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb85c15a870 con 0x7fb85c0c8380 2024-05-08T21:10:20.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.188+0000 7fb852ffd700 1 -- 172.21.15.80:0/2201714339 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84c011470 con 0x7fb85c0c8380 2024-05-08T21:10:20.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.188+0000 7fb864626700 1 -- 172.21.15.80:0/2201714339 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb85c15ae30 con 0x7fb85c0c8380 2024-05-08T21:10:20.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.189+0000 7fb864626700 1 -- 172.21.15.80:0/2201714339 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb85c0c3750 con 0x7fb85c0c8380 2024-05-08T21:10:20.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.190+0000 7fb852ffd700 1 -- 172.21.15.80:0/2201714339 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb84c0115d0 con 0x7fb85c0c8380 2024-05-08T21:10:20.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.190+0000 7fb852ffd700 1 --2- 172.21.15.80:0/2201714339 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fb84006ac90 0x7fb84006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:20.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.190+0000 7fb852ffd700 1 -- 172.21.15.80:0/2201714339 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb84c08bb60 con 0x7fb85c0c8380 2024-05-08T21:10:20.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.190+0000 7fb861bc1700 1 --2- 172.21.15.80:0/2201714339 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fb84006ac90 0x7fb84006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:20.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.191+0000 7fb861bc1700 1 --2- 172.21.15.80:0/2201714339 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fb84006ac90 0x7fb84006d150 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb858009840 tx=0x7fb858008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:20.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.195+0000 7fb852ffd700 1 -- 172.21.15.80:0/2201714339 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fb84c056a50 con 0x7fb85c0c8380 2024-05-08T21:10:20.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.392+0000 7fb864626700 1 -- 172.21.15.80:0/2201714339 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb85c04ec60 con 0x7fb85c0c8380 2024-05-08T21:10:20.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.392+0000 7fb852ffd700 1 -- 172.21.15.80:0/2201714339 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb84c01f070 con 0x7fb85c0c8380 2024-05-08T21:10:20.395 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-05-08T21:10:20.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.394+0000 7fb864626700 1 -- 172.21.15.80:0/2201714339 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fb84006ac90 msgr2=0x7fb84006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:20.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.394+0000 7fb864626700 1 --2- 172.21.15.80:0/2201714339 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fb84006ac90 0x7fb84006d150 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb858009840 tx=0x7fb858008030 comp rx=0 tx=0).stop 2024-05-08T21:10:20.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.394+0000 7fb864626700 1 -- 172.21.15.80:0/2201714339 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb85c0c8380 msgr2=0x7fb85c1ecf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:20.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.394+0000 7fb864626700 1 --2- 172.21.15.80:0/2201714339 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb85c0c8380 0x7fb85c1ecf10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb84c00e910 tx=0x7fb84c00ecd0 comp rx=0 tx=0).stop 2024-05-08T21:10:20.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.394+0000 7fb864626700 1 -- 172.21.15.80:0/2201714339 shutdown_connections 2024-05-08T21:10:20.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.394+0000 7fb864626700 1 --2- 172.21.15.80:0/2201714339 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fb84006ac90 0x7fb84006d150 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:20.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.394+0000 7fb864626700 1 --2- 172.21.15.80:0/2201714339 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb85c0c8380 0x7fb85c1ecf10 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:20.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.394+0000 7fb864626700 1 --2- 172.21.15.80:0/2201714339 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb85c0ccfe0 0x7fb85c1582d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:20.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.394+0000 7fb864626700 1 --2- 172.21.15.80:0/2201714339 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb85c0ccc00 0x7fb85c1ed450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:20.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.394+0000 7fb864626700 1 -- 172.21.15.80:0/2201714339 >> 172.21.15.80:0/2201714339 conn(0x7fb85c06f140 msgr2=0x7fb85c0727e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:20.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.394+0000 7fb864626700 1 -- 172.21.15.80:0/2201714339 shutdown_connections 2024-05-08T21:10:20.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.394+0000 7fb864626700 1 -- 172.21.15.80:0/2201714339 wait complete. 2024-05-08T21:10:20.409 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T21:10:20.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.530+0000 7f07fb535700 1 Processor -- start 2024-05-08T21:10:20.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.530+0000 7f07fb535700 1 -- start start 2024-05-08T21:10:20.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.531+0000 7f07fb535700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f07f41579e0 0x7f07f406c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:20.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.531+0000 7f07fb535700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07f4066900 con 0x7f07f4151110 2024-05-08T21:10:20.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.531+0000 7f07fb535700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07f4066be0 con 0x7f07f41514f0 2024-05-08T21:10:20.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.531+0000 7f07fb535700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07f4066ec0 con 0x7f07f41579e0 2024-05-08T21:10:20.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.531+0000 7f07f9ad2700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f07f41579e0 0x7f07f406c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:20.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.531+0000 7f07f92d1700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f07f4151110 0x7f07f406b360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59112/0 (socket says 172.21.15.80:59112) 2024-05-08T21:10:20.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.531+0000 7f07f92d1700 1 -- 172.21.15.80:0/1615277344 learned_addr learned my addr 172.21.15.80:0/1615277344 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:10:20.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.531+0000 7f07f9ad2700 1 -- 172.21.15.80:0/1615277344 >> v1:172.21.15.106:6789/0 conn(0x7f07f41514f0 legacy=0x7f07f4071e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:20.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.531+0000 7f07f9ad2700 1 -- 172.21.15.80:0/1615277344 >> v1:172.21.15.80:6789/0 conn(0x7f07f4151110 legacy=0x7f07f406b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:20.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.531+0000 7f07ebfff700 1 -- 172.21.15.80:0/1615277344 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1695333578 0 0) 0x7f07f4066900 con 0x7f07f4151110 2024-05-08T21:10:20.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.531+0000 7f07f9ad2700 1 -- 172.21.15.80:0/1615277344 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f406ab60 con 0x7f07f41579e0 2024-05-08T21:10:20.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.531+0000 7f07f9ad2700 1 --2- 172.21.15.80:0/1615277344 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07f41579e0 0x7f07f406c2e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f07ec009d90 tx=0x7f07ec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36e75e62442e6b97 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:20.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.532+0000 7f07ebfff700 1 -- 172.21.15.80:0/1615277344 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ec00e070 con 0x7f07f41579e0 2024-05-08T21:10:20.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.532+0000 7f07ebfff700 1 -- 172.21.15.80:0/1615277344 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07ec00bb90 con 0x7f07f41579e0 2024-05-08T21:10:20.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.532+0000 7f07ebfff700 1 -- 172.21.15.80:0/1615277344 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ec003a20 con 0x7f07f41579e0 2024-05-08T21:10:20.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.532+0000 7f07fb535700 1 -- 172.21.15.80:0/1615277344 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07f41579e0 msgr2=0x7f07f406c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:20.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.532+0000 7f07fb535700 1 --2- 172.21.15.80:0/1615277344 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07f41579e0 0x7f07f406c2e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f07ec009d90 tx=0x7f07ec00b330 comp rx=0 tx=0).stop 2024-05-08T21:10:20.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.532+0000 7f07fb535700 1 -- 172.21.15.80:0/1615277344 shutdown_connections 2024-05-08T21:10:20.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.532+0000 7f07fb535700 1 --2- 172.21.15.80:0/1615277344 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07f41579e0 0x7f07f406c2e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:20.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.532+0000 7f07fb535700 1 -- 172.21.15.80:0/1615277344 >> 172.21.15.80:0/1615277344 conn(0x7f07f40cc260 msgr2=0x7f07f40cc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:20.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.532+0000 7f07fb535700 1 -- 172.21.15.80:0/1615277344 shutdown_connections 2024-05-08T21:10:20.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.532+0000 7f07fb535700 1 -- 172.21.15.80:0/1615277344 wait complete. 2024-05-08T21:10:20.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.533+0000 7f07fb535700 1 Processor -- start 2024-05-08T21:10:20.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.533+0000 7f07fb535700 1 -- start start 2024-05-08T21:10:20.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.534+0000 7f07fb535700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07f4151110 0x7f07f41580c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:20.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.534+0000 7f07fb535700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f07f41514f0 0x7f07f4149270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:20.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.534+0000 7f07fb535700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f07f41579e0 0x7f07f414bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:20.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.534+0000 7f07fb535700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f414ebd0 con 0x7f07f4151110 2024-05-08T21:10:20.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.534+0000 7f07fb535700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f414ee20 con 0x7f07f41579e0 2024-05-08T21:10:20.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.534+0000 7f07fb535700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07f414f100 con 0x7f07f41514f0 2024-05-08T21:10:20.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.534+0000 7f07f92d1700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07f4151110 0x7f07f41580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:20.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.534+0000 7f07f92d1700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07f4151110 0x7f07f41580c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37478/0 (socket says 172.21.15.80:37478) 2024-05-08T21:10:20.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.534+0000 7f07f92d1700 1 -- 172.21.15.80:0/766450926 learned_addr learned my addr 172.21.15.80:0/766450926 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:20.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.534+0000 7f07f9ad2700 1 --2- 172.21.15.80:0/766450926 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f07f41579e0 0x7f07f414bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:20.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.534+0000 7f07f8ad0700 1 --2- 172.21.15.80:0/766450926 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f07f41514f0 0x7f07f4149270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:20.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.534+0000 7f07f92d1700 1 -- 172.21.15.80:0/766450926 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f07f41514f0 msgr2=0x7f07f4149270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:20.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.534+0000 7f07f92d1700 1 --2- 172.21.15.80:0/766450926 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f07f41514f0 0x7f07f4149270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:20.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.534+0000 7f07f92d1700 1 -- 172.21.15.80:0/766450926 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f07f41579e0 msgr2=0x7f07f414bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:20.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.534+0000 7f07f92d1700 1 --2- 172.21.15.80:0/766450926 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f07f41579e0 0x7f07f414bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:20.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.534+0000 7f07f92d1700 1 -- 172.21.15.80:0/766450926 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07ec009a70 con 0x7f07f4151110 2024-05-08T21:10:20.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.535+0000 7f07f92d1700 1 --2- 172.21.15.80:0/766450926 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07f4151110 0x7f07f41580c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f07f00011e0 tx=0x7f07f000cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:20.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.535+0000 7f07e9ffb700 1 -- 172.21.15.80:0/766450926 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f0004c80 con 0x7f07f4151110 2024-05-08T21:10:20.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.535+0000 7f07e9ffb700 1 -- 172.21.15.80:0/766450926 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07f0004e00 con 0x7f07f4151110 2024-05-08T21:10:20.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.535+0000 7f07fb535700 1 -- 172.21.15.80:0/766450926 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07f414f3e0 con 0x7f07f4151110 2024-05-08T21:10:20.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.535+0000 7f07e9ffb700 1 -- 172.21.15.80:0/766450926 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f0007310 con 0x7f07f4151110 2024-05-08T21:10:20.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.535+0000 7f07fb535700 1 -- 172.21.15.80:0/766450926 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07f4158600 con 0x7f07f4151110 2024-05-08T21:10:20.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.536+0000 7f07fb535700 1 -- 172.21.15.80:0/766450926 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07f414ba30 con 0x7f07f4151110 2024-05-08T21:10:20.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.536+0000 7f07e9ffb700 1 -- 172.21.15.80:0/766450926 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f07f0007470 con 0x7f07f4151110 2024-05-08T21:10:20.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.537+0000 7f07e9ffb700 1 --2- 172.21.15.80:0/766450926 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f07d806ac90 0x7f07d806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:20.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.537+0000 7f07e9ffb700 1 -- 172.21.15.80:0/766450926 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f07f0089540 con 0x7f07f4151110 2024-05-08T21:10:20.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.537+0000 7f07f8ad0700 1 --2- 172.21.15.80:0/766450926 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f07d806ac90 0x7f07d806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:20.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.537+0000 7f07f8ad0700 1 --2- 172.21.15.80:0/766450926 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f07d806ac90 0x7f07d806d150 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f07f4156930 tx=0x7f07e4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:20.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.541+0000 7f07e9ffb700 1 -- 172.21.15.80:0/766450926 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f07f0054300 con 0x7f07f4151110 2024-05-08T21:10:20.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.735+0000 7f07fb535700 1 -- 172.21.15.80:0/766450926 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f07f404ec60 con 0x7f07f4151110 2024-05-08T21:10:20.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.736+0000 7f07e9ffb700 1 -- 172.21.15.80:0/766450926 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f07f0057920 con 0x7f07f4151110 2024-05-08T21:10:20.739 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-05-08T21:10:20.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.738+0000 7f07fb535700 1 -- 172.21.15.80:0/766450926 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f07d806ac90 msgr2=0x7f07d806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:20.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.738+0000 7f07fb535700 1 --2- 172.21.15.80:0/766450926 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f07d806ac90 0x7f07d806d150 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f07f4156930 tx=0x7f07e4009040 comp rx=0 tx=0).stop 2024-05-08T21:10:20.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.738+0000 7f07fb535700 1 -- 172.21.15.80:0/766450926 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07f4151110 msgr2=0x7f07f41580c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:20.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.738+0000 7f07fb535700 1 --2- 172.21.15.80:0/766450926 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07f4151110 0x7f07f41580c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f07f00011e0 tx=0x7f07f000cae0 comp rx=0 tx=0).stop 2024-05-08T21:10:20.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.738+0000 7f07fb535700 1 -- 172.21.15.80:0/766450926 shutdown_connections 2024-05-08T21:10:20.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.738+0000 7f07fb535700 1 --2- 172.21.15.80:0/766450926 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f07d806ac90 0x7f07d806d150 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:20.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.738+0000 7f07fb535700 1 --2- 172.21.15.80:0/766450926 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07f4151110 0x7f07f41580c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:20.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.738+0000 7f07fb535700 1 --2- 172.21.15.80:0/766450926 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f07f41579e0 0x7f07f414bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:20.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.738+0000 7f07fb535700 1 --2- 172.21.15.80:0/766450926 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f07f41514f0 0x7f07f4149270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:20.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.738+0000 7f07fb535700 1 -- 172.21.15.80:0/766450926 >> 172.21.15.80:0/766450926 conn(0x7f07f40cc260 msgr2=0x7f07f40cc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:20.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.738+0000 7f07fb535700 1 -- 172.21.15.80:0/766450926 shutdown_connections 2024-05-08T21:10:20.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.738+0000 7f07fb535700 1 -- 172.21.15.80:0/766450926 wait complete. 2024-05-08T21:10:20.753 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T21:10:20.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.873+0000 7f05cb4d7700 1 Processor -- start 2024-05-08T21:10:20.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.873+0000 7f05cb4d7700 1 -- start start 2024-05-08T21:10:20.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.874+0000 7f05cb4d7700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f05c4150f80 0x7f05c41578e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:20.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.874+0000 7f05cb4d7700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f05c40ca820 0x7f05c40cb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:20.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.874+0000 7f05cb4d7700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05c40cc340 con 0x7f05c40cbb30 2024-05-08T21:10:20.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.874+0000 7f05cb4d7700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05c415b3d0 con 0x7f05c40ca820 2024-05-08T21:10:20.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.874+0000 7f05cb4d7700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05c40cb220 con 0x7f05c4150f80 2024-05-08T21:10:20.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.874+0000 7f05c9273700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f05c4150f80 0x7f05c41578e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:20.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.874+0000 7f05c8a72700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f05c40ca820 0x7f05c40cb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:20.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.874+0000 7f05c9273700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f05c4150f80 0x7f05c41578e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:59800/0 (socket says 172.21.15.80:59800) 2024-05-08T21:10:20.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.874+0000 7f05c9a74700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f05c40cbb30 0x7f05c40cc7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.80:44230/0 (socket says 172.21.15.80:44230) 2024-05-08T21:10:20.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.874+0000 7f05c9273700 1 -- 172.21.15.80:0/1474051023 learned_addr learned my addr 172.21.15.80:0/1474051023 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:20.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.874+0000 7f05c9273700 1 -- 172.21.15.80:0/1474051023 >> v2:172.21.15.106:3300/0 conn(0x7f05c40ca820 msgr2=0x7f05c40cb5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:20.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.874+0000 7f05c9273700 1 --2- 172.21.15.80:0/1474051023 >> v2:172.21.15.106:3300/0 conn(0x7f05c40ca820 0x7f05c40cb5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:20.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.874+0000 7f05c9273700 1 -- 172.21.15.80:0/1474051023 >> v1:172.21.15.106:6789/0 conn(0x7f05c40cbb30 legacy=0x7f05c40cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:20.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.874+0000 7f05c9273700 1 -- 172.21.15.80:0/1474051023 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c415a870 con 0x7f05c4150f80 2024-05-08T21:10:20.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.874+0000 7f05c8a72700 1 --2- 172.21.15.80:0/1474051023 >> v2:172.21.15.106:3300/0 conn(0x7f05c40ca820 0x7f05c40cb5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:10:20.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.875+0000 7f05c9273700 1 --2- 172.21.15.80:0/1474051023 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f05c4150f80 0x7f05c41578e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f05c00098f0 tx=0x7f05c0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59211f0eb679095c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:20.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.875+0000 7f05bbfff700 1 -- 172.21.15.80:0/1474051023 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c0011830 con 0x7f05c4150f80 2024-05-08T21:10:20.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.875+0000 7f05bbfff700 1 -- 172.21.15.80:0/1474051023 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05c0011990 con 0x7f05c4150f80 2024-05-08T21:10:20.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.875+0000 7f05bbfff700 1 -- 172.21.15.80:0/1474051023 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c0011d20 con 0x7f05c4150f80 2024-05-08T21:10:20.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.875+0000 7f05cb4d7700 1 -- 172.21.15.80:0/1474051023 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f05c4150f80 msgr2=0x7f05c41578e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:20.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.875+0000 7f05cb4d7700 1 --2- 172.21.15.80:0/1474051023 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f05c4150f80 0x7f05c41578e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f05c00098f0 tx=0x7f05c0009c00 comp rx=0 tx=0).stop 2024-05-08T21:10:20.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.875+0000 7f05cb4d7700 1 -- 172.21.15.80:0/1474051023 shutdown_connections 2024-05-08T21:10:20.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.875+0000 7f05cb4d7700 1 --2- 172.21.15.80:0/1474051023 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f05c4150f80 0x7f05c41578e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:20.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.875+0000 7f05cb4d7700 1 --2- 172.21.15.80:0/1474051023 >> v2:172.21.15.106:3300/0 conn(0x7f05c40ca820 0x7f05c40cb5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:20.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.875+0000 7f05cb4d7700 1 -- 172.21.15.80:0/1474051023 >> 172.21.15.80:0/1474051023 conn(0x7f05c406bad0 msgr2=0x7f05c406bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:20.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.875+0000 7f05cb4d7700 1 -- 172.21.15.80:0/1474051023 shutdown_connections 2024-05-08T21:10:20.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.875+0000 7f05cb4d7700 1 -- 172.21.15.80:0/1474051023 wait complete. 2024-05-08T21:10:20.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.877+0000 7f05cb4d7700 1 Processor -- start 2024-05-08T21:10:20.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.877+0000 7f05cb4d7700 1 -- start start 2024-05-08T21:10:20.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.877+0000 7f05cb4d7700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05c40ca820 0x7f05c414e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:20.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.877+0000 7f05cb4d7700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05c40cbb30 0x7f05c40c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:20.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.877+0000 7f05cb4d7700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f05c4150f80 0x7f05c413eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:20.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.877+0000 7f05cb4d7700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c4145360 con 0x7f05c40cbb30 2024-05-08T21:10:20.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.877+0000 7f05cb4d7700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c414ec50 con 0x7f05c40ca820 2024-05-08T21:10:20.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.877+0000 7f05cb4d7700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05c41f3430 con 0x7f05c4150f80 2024-05-08T21:10:20.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.877+0000 7f05c9273700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05c40ca820 0x7f05c414e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:20.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.877+0000 7f05c8a72700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05c40cbb30 0x7f05c40c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:20.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.877+0000 7f05c9a74700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f05c4150f80 0x7f05c413eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:20.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.877+0000 7f05c9273700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05c40ca820 0x7f05c414e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.80:53454/0 (socket says 172.21.15.80:53454) 2024-05-08T21:10:20.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.877+0000 7f05c9273700 1 -- 172.21.15.80:0/3933660699 learned_addr learned my addr 172.21.15.80:0/3933660699 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:20.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.878+0000 7f05c8a72700 1 -- 172.21.15.80:0/3933660699 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f05c4150f80 msgr2=0x7f05c413eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:20.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.878+0000 7f05c8a72700 1 --2- 172.21.15.80:0/3933660699 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f05c4150f80 0x7f05c413eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:20.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.878+0000 7f05c8a72700 1 -- 172.21.15.80:0/3933660699 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05c40ca820 msgr2=0x7f05c414e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:20.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.878+0000 7f05c8a72700 1 --2- 172.21.15.80:0/3933660699 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05c40ca820 0x7f05c414e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:20.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.878+0000 7f05c8a72700 1 -- 172.21.15.80:0/3933660699 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b40094a0 con 0x7f05c40cbb30 2024-05-08T21:10:20.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.878+0000 7f05c8a72700 1 --2- 172.21.15.80:0/3933660699 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05c40cbb30 0x7f05c40c8040 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f05b400e930 tx=0x7f05b400ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:20.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.878+0000 7f05b9ffb700 1 -- 172.21.15.80:0/3933660699 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b4013680 con 0x7f05c40cbb30 2024-05-08T21:10:20.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.878+0000 7f05b9ffb700 1 -- 172.21.15.80:0/3933660699 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b40137e0 con 0x7f05c40cbb30 2024-05-08T21:10:20.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.878+0000 7f05cb4d7700 1 -- 172.21.15.80:0/3933660699 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05c0009550 con 0x7f05c40cbb30 2024-05-08T21:10:20.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.878+0000 7f05b9ffb700 1 -- 172.21.15.80:0/3933660699 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b4013b90 con 0x7f05c40cbb30 2024-05-08T21:10:20.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.878+0000 7f05cb4d7700 1 -- 172.21.15.80:0/3933660699 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05c41f39f0 con 0x7f05c40cbb30 2024-05-08T21:10:20.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.879+0000 7f05cb4d7700 1 -- 172.21.15.80:0/3933660699 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05c406b8f0 con 0x7f05c40cbb30 2024-05-08T21:10:20.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.880+0000 7f05b9ffb700 1 -- 172.21.15.80:0/3933660699 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f05b4013cf0 con 0x7f05c40cbb30 2024-05-08T21:10:20.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.880+0000 7f05b9ffb700 1 --2- 172.21.15.80:0/3933660699 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f05a806ac90 0x7f05a806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:20.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.880+0000 7f05b9ffb700 1 -- 172.21.15.80:0/3933660699 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f05b40895d0 con 0x7f05c40cbb30 2024-05-08T21:10:20.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.880+0000 7f05c9273700 1 --2- 172.21.15.80:0/3933660699 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f05a806ac90 0x7f05a806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:20.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.881+0000 7f05c9273700 1 --2- 172.21.15.80:0/3933660699 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f05a806ac90 0x7f05a806d150 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f05c0009130 tx=0x7f05c0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:20.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:20.884+0000 7f05b9ffb700 1 -- 172.21.15.80:0/3933660699 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f05b40543b0 con 0x7f05c40cbb30 2024-05-08T21:10:21.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.079+0000 7f05cb4d7700 1 -- 172.21.15.80:0/3933660699 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f05c404ec60 con 0x7f05c40cbb30 2024-05-08T21:10:21.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.079+0000 7f05b9ffb700 1 -- 172.21.15.80:0/3933660699 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f05b40579d0 con 0x7f05c40cbb30 2024-05-08T21:10:21.083 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-05-08T21:10:21.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.081+0000 7f05cb4d7700 1 -- 172.21.15.80:0/3933660699 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f05a806ac90 msgr2=0x7f05a806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:21.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.081+0000 7f05cb4d7700 1 --2- 172.21.15.80:0/3933660699 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f05a806ac90 0x7f05a806d150 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f05c0009130 tx=0x7f05c0008030 comp rx=0 tx=0).stop 2024-05-08T21:10:21.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.081+0000 7f05cb4d7700 1 -- 172.21.15.80:0/3933660699 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05c40cbb30 msgr2=0x7f05c40c8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:21.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.081+0000 7f05cb4d7700 1 --2- 172.21.15.80:0/3933660699 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05c40cbb30 0x7f05c40c8040 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f05b400e930 tx=0x7f05b400ec40 comp rx=0 tx=0).stop 2024-05-08T21:10:21.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.081+0000 7f05cb4d7700 1 -- 172.21.15.80:0/3933660699 shutdown_connections 2024-05-08T21:10:21.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.081+0000 7f05cb4d7700 1 --2- 172.21.15.80:0/3933660699 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f05a806ac90 0x7f05a806d150 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:21.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.081+0000 7f05cb4d7700 1 --2- 172.21.15.80:0/3933660699 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f05c4150f80 0x7f05c413eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:21.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.081+0000 7f05cb4d7700 1 --2- 172.21.15.80:0/3933660699 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05c40ca820 0x7f05c414e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:21.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.081+0000 7f05cb4d7700 1 --2- 172.21.15.80:0/3933660699 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05c40cbb30 0x7f05c40c8040 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:21.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.081+0000 7f05cb4d7700 1 -- 172.21.15.80:0/3933660699 >> 172.21.15.80:0/3933660699 conn(0x7f05c406bad0 msgr2=0x7f05c40c8e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:21.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.081+0000 7f05cb4d7700 1 -- 172.21.15.80:0/3933660699 shutdown_connections 2024-05-08T21:10:21.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.081+0000 7f05cb4d7700 1 -- 172.21.15.80:0/3933660699 wait complete. 2024-05-08T21:10:21.096 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-08T21:10:21.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.217+0000 7f31ab5ee700 1 Processor -- start 2024-05-08T21:10:21.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.217+0000 7f31ab5ee700 1 -- start start 2024-05-08T21:10:21.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.218+0000 7f31ab5ee700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f31a4142a70 0x7f31a4071f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:21.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.218+0000 7f31ab5ee700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f31a40c9cb0 0x7f31a415ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:21.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.218+0000 7f31ab5ee700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31a415b1b0 con 0x7f31a40c73d0 2024-05-08T21:10:21.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.218+0000 7f31ab5ee700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31a415a630 con 0x7f31a40c9cb0 2024-05-08T21:10:21.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.218+0000 7f31ab5ee700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31a415a910 con 0x7f31a4142a70 2024-05-08T21:10:21.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.218+0000 7f31a8b89700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f31a40c73d0 0x7f31a406a9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59124/0 (socket says 172.21.15.80:59124) 2024-05-08T21:10:21.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.218+0000 7f31a8b89700 1 -- 172.21.15.80:0/2215483872 learned_addr learned my addr 172.21.15.80:0/2215483872 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:10:21.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.218+0000 7f31a9b8b700 1 --2- 172.21.15.80:0/2215483872 >> v2:172.21.15.106:3300/0 conn(0x7f31a40c9cb0 0x7f31a415ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:21.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.218+0000 7f31a938a700 1 --2- 172.21.15.80:0/2215483872 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f31a4142a70 0x7f31a4071f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:21.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.218+0000 7f319bfff700 1 -- 172.21.15.80:0/2215483872 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2880400589 0 0) 0x7f31a415b1b0 con 0x7f31a40c73d0 2024-05-08T21:10:21.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.218+0000 7f319bfff700 1 -- 172.21.15.80:0/2215483872 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31900035b0 con 0x7f31a40c73d0 2024-05-08T21:10:21.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.218+0000 7f319bfff700 1 -- 172.21.15.80:0/2215483872 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 411667775 0 0) 0x7f31900035b0 con 0x7f31a40c73d0 2024-05-08T21:10:21.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.218+0000 7f319bfff700 1 -- 172.21.15.80:0/2215483872 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f31a4142a70 msgr2=0x7f31a4071f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:21.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.218+0000 7f319bfff700 1 --2- 172.21.15.80:0/2215483872 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f31a4142a70 0x7f31a4071f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:21.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.218+0000 7f319bfff700 1 -- 172.21.15.80:0/2215483872 >> v2:172.21.15.106:3300/0 conn(0x7f31a40c9cb0 msgr2=0x7f31a415ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:21.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.218+0000 7f319bfff700 1 --2- 172.21.15.80:0/2215483872 >> v2:172.21.15.106:3300/0 conn(0x7f31a40c9cb0 0x7f31a415ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:21.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.218+0000 7f319bfff700 1 -- 172.21.15.80:0/2215483872 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a415abf0 con 0x7f31a40c73d0 2024-05-08T21:10:21.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.218+0000 7f319bfff700 1 -- 172.21.15.80:0/2215483872 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3520646302 0 0) 0x7f3194001670 con 0x7f31a40c73d0 2024-05-08T21:10:21.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.218+0000 7f319bfff700 1 -- 172.21.15.80:0/2215483872 >> v1:172.21.15.80:6789/0 conn(0x7f31a40c73d0 legacy=0x7f31a406a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:21.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.218+0000 7f319bfff700 1 --2- 172.21.15.80:0/2215483872 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3190003a00 0x7f3190003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:21.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.218+0000 7f319bfff700 1 --2- 172.21.15.80:0/2215483872 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f31a4142a70 0x7f3190004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:21.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.218+0000 7f319bfff700 1 --2- 172.21.15.80:0/2215483872 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3190004d90 0x7f3190005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:21.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.218+0000 7f319bfff700 1 -- 172.21.15.80:0/2215483872 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a415a630 con 0x7f3190003a00 2024-05-08T21:10:21.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.218+0000 7f319bfff700 1 -- 172.21.15.80:0/2215483872 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a415a910 con 0x7f3190004d90 2024-05-08T21:10:21.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.218+0000 7f319bfff700 1 -- 172.21.15.80:0/2215483872 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f319000ba40 con 0x7f31a4142a70 2024-05-08T21:10:21.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.218+0000 7f31a938a700 1 --2- 172.21.15.80:0/2215483872 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3190003a00 0x7f3190003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:21.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.219+0000 7f31a9b8b700 1 --2- 172.21.15.80:0/2215483872 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3190004d90 0x7f3190005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:21.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.219+0000 7f31a8b89700 1 --2- 172.21.15.80:0/2215483872 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f31a4142a70 0x7f3190004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:21.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.219+0000 7f31a938a700 1 -- 172.21.15.80:0/2215483872 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f31a4142a70 msgr2=0x7f3190004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:21.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.219+0000 7f31a938a700 1 --2- 172.21.15.80:0/2215483872 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f31a4142a70 0x7f3190004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:21.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.219+0000 7f31a938a700 1 -- 172.21.15.80:0/2215483872 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3190004d90 msgr2=0x7f3190005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:21.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.219+0000 7f31a938a700 1 --2- 172.21.15.80:0/2215483872 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3190004d90 0x7f3190005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:21.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.219+0000 7f31a938a700 1 -- 172.21.15.80:0/2215483872 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31900035b0 con 0x7f3190003a00 2024-05-08T21:10:21.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.219+0000 7f31a9b8b700 1 --2- 172.21.15.80:0/2215483872 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3190004d90 0x7f3190005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:10:21.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.219+0000 7f31a938a700 1 --2- 172.21.15.80:0/2215483872 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3190003a00 0x7f3190003e20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f31a0009b60 tx=0x7f3190005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7bc25f543d21110 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:21.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.219+0000 7f319bfff700 1 -- 172.21.15.80:0/2215483872 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a000e6c0 con 0x7f3190003a00 2024-05-08T21:10:21.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.219+0000 7f319bfff700 1 -- 172.21.15.80:0/2215483872 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31a000e820 con 0x7f3190003a00 2024-05-08T21:10:21.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.219+0000 7f319bfff700 1 -- 172.21.15.80:0/2215483872 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a000eb90 con 0x7f3190003a00 2024-05-08T21:10:21.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.219+0000 7f31ab5ee700 1 -- 172.21.15.80:0/2215483872 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3190003a00 msgr2=0x7f3190003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:21.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.219+0000 7f31ab5ee700 1 --2- 172.21.15.80:0/2215483872 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3190003a00 0x7f3190003e20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f31a0009b60 tx=0x7f3190005880 comp rx=0 tx=0).stop 2024-05-08T21:10:21.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.219+0000 7f31a9b8b700 1 -- 172.21.15.80:0/2215483872 reap_dead start 2024-05-08T21:10:21.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.219+0000 7f31ab5ee700 1 -- 172.21.15.80:0/2215483872 shutdown_connections 2024-05-08T21:10:21.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.219+0000 7f31ab5ee700 1 -- 172.21.15.80:0/2215483872 >> 172.21.15.80:0/2215483872 conn(0x7f31a406f140 msgr2=0x7f31a406f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:21.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.220+0000 7f31ab5ee700 1 -- 172.21.15.80:0/2215483872 shutdown_connections 2024-05-08T21:10:21.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.220+0000 7f31ab5ee700 1 -- 172.21.15.80:0/2215483872 wait complete. 2024-05-08T21:10:21.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.221+0000 7f31ab5ee700 1 Processor -- start 2024-05-08T21:10:21.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.221+0000 7f31ab5ee700 1 -- start start 2024-05-08T21:10:21.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.221+0000 7f31ab5ee700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3190003a00 0x7f31a40bfe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:21.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.221+0000 7f31ab5ee700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f31a40c5bd0 0x7f31a41f01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:21.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.221+0000 7f31ab5ee700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f31a40cca40 0x7f31a413f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:21.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.221+0000 7f31ab5ee700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a40c03a0 con 0x7f3190003a00 2024-05-08T21:10:21.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.221+0000 7f31ab5ee700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a41f0710 con 0x7f31a40cca40 2024-05-08T21:10:21.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.221+0000 7f31ab5ee700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31a40bdf60 con 0x7f31a40c5bd0 2024-05-08T21:10:21.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.221+0000 7f31a938a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3190003a00 0x7f31a40bfe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:21.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.221+0000 7f31a938a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3190003a00 0x7f31a40bfe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37516/0 (socket says 172.21.15.80:37516) 2024-05-08T21:10:21.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.221+0000 7f31a938a700 1 -- 172.21.15.80:0/3406724940 learned_addr learned my addr 172.21.15.80:0/3406724940 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:21.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.222+0000 7f31a9b8b700 1 --2- 172.21.15.80:0/3406724940 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f31a40cca40 0x7f31a413f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:21.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.222+0000 7f31a8b89700 1 --2- 172.21.15.80:0/3406724940 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f31a40c5bd0 0x7f31a41f01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:21.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.222+0000 7f31a938a700 1 -- 172.21.15.80:0/3406724940 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f31a40c5bd0 msgr2=0x7f31a41f01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:21.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.222+0000 7f31a938a700 1 --2- 172.21.15.80:0/3406724940 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f31a40c5bd0 0x7f31a41f01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:21.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.222+0000 7f31a938a700 1 -- 172.21.15.80:0/3406724940 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f31a40cca40 msgr2=0x7f31a413f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:21.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.222+0000 7f31a938a700 1 --2- 172.21.15.80:0/3406724940 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f31a40cca40 0x7f31a413f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:21.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.222+0000 7f31a938a700 1 -- 172.21.15.80:0/3406724940 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a40c6110 con 0x7f3190003a00 2024-05-08T21:10:21.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.222+0000 7f31a938a700 1 --2- 172.21.15.80:0/3406724940 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3190003a00 0x7f31a40bfe60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f31a000e4b0 tx=0x7f31a00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:21.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.222+0000 7f3199ffb700 1 -- 172.21.15.80:0/3406724940 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a000e6c0 con 0x7f3190003a00 2024-05-08T21:10:21.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.222+0000 7f3199ffb700 1 -- 172.21.15.80:0/3406724940 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31a00038c0 con 0x7f3190003a00 2024-05-08T21:10:21.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.222+0000 7f3199ffb700 1 -- 172.21.15.80:0/3406724940 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a0003c70 con 0x7f3190003a00 2024-05-08T21:10:21.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.222+0000 7f31ab5ee700 1 -- 172.21.15.80:0/3406724940 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31a40bd320 con 0x7f3190003a00 2024-05-08T21:10:21.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.222+0000 7f31ab5ee700 1 -- 172.21.15.80:0/3406724940 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31a40bd8e0 con 0x7f3190003a00 2024-05-08T21:10:21.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.223+0000 7f31ab5ee700 1 -- 172.21.15.80:0/3406724940 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31a4067d70 con 0x7f3190003a00 2024-05-08T21:10:21.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.224+0000 7f3199ffb700 1 -- 172.21.15.80:0/3406724940 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f31a0013470 con 0x7f3190003a00 2024-05-08T21:10:21.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.224+0000 7f3199ffb700 1 --2- 172.21.15.80:0/3406724940 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f318806ac90 0x7f318806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:21.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.224+0000 7f3199ffb700 1 -- 172.21.15.80:0/3406724940 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f31a008aee0 con 0x7f3190003a00 2024-05-08T21:10:21.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.224+0000 7f31a8b89700 1 --2- 172.21.15.80:0/3406724940 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f318806ac90 0x7f318806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:21.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.224+0000 7f31a8b89700 1 --2- 172.21.15.80:0/3406724940 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f318806ac90 0x7f318806d150 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3194001860 tx=0x7f3194007040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:21.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.229+0000 7f3199ffb700 1 -- 172.21.15.80:0/3406724940 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f31a0055e60 con 0x7f3190003a00 2024-05-08T21:10:21.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.424+0000 7f31ab5ee700 1 -- 172.21.15.80:0/3406724940 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f31a40bdd30 con 0x7f3190003a00 2024-05-08T21:10:21.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.424+0000 7f3199ffb700 1 -- 172.21.15.80:0/3406724940 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f31a00170a0 con 0x7f3190003a00 2024-05-08T21:10:21.428 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-05-08T21:10:21.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.427+0000 7f31ab5ee700 1 -- 172.21.15.80:0/3406724940 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f318806ac90 msgr2=0x7f318806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:21.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.427+0000 7f31ab5ee700 1 --2- 172.21.15.80:0/3406724940 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f318806ac90 0x7f318806d150 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3194001860 tx=0x7f3194007040 comp rx=0 tx=0).stop 2024-05-08T21:10:21.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.427+0000 7f31ab5ee700 1 -- 172.21.15.80:0/3406724940 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3190003a00 msgr2=0x7f31a40bfe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:21.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.427+0000 7f31ab5ee700 1 --2- 172.21.15.80:0/3406724940 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3190003a00 0x7f31a40bfe60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f31a000e4b0 tx=0x7f31a00047c0 comp rx=0 tx=0).stop 2024-05-08T21:10:21.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.427+0000 7f31ab5ee700 1 -- 172.21.15.80:0/3406724940 shutdown_connections 2024-05-08T21:10:21.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.427+0000 7f31ab5ee700 1 --2- 172.21.15.80:0/3406724940 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f318806ac90 0x7f318806d150 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:21.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.427+0000 7f31ab5ee700 1 --2- 172.21.15.80:0/3406724940 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3190003a00 0x7f31a40bfe60 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:21.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.427+0000 7f31ab5ee700 1 --2- 172.21.15.80:0/3406724940 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f31a40cca40 0x7f31a413f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:21.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.427+0000 7f31ab5ee700 1 --2- 172.21.15.80:0/3406724940 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f31a40c5bd0 0x7f31a41f01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:21.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.427+0000 7f31ab5ee700 1 -- 172.21.15.80:0/3406724940 >> 172.21.15.80:0/3406724940 conn(0x7f31a406f140 msgr2=0x7f31a41409c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:21.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.427+0000 7f31ab5ee700 1 -- 172.21.15.80:0/3406724940 shutdown_connections 2024-05-08T21:10:21.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.427+0000 7f31ab5ee700 1 -- 172.21.15.80:0/3406724940 wait complete. 2024-05-08T21:10:21.442 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-08T21:10:21.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.561+0000 7fe9920cb700 1 Processor -- start 2024-05-08T21:10:21.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.561+0000 7fe9920cb700 1 -- start start 2024-05-08T21:10:21.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.562+0000 7fe9920cb700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe98c0c6880 0x7fe98c070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:21.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.562+0000 7fe9920cb700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe98c158ae0 con 0x7fe98c070b20 2024-05-08T21:10:21.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.562+0000 7fe9920cb700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe98c0735e0 con 0x7fe98c15b600 2024-05-08T21:10:21.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.562+0000 7fe9920cb700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe98c0730f0 con 0x7fe98c0c6880 2024-05-08T21:10:21.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.562+0000 7fe98b7fe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe98c070b20 0x7fe98c0729e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59136/0 (socket says 172.21.15.80:59136) 2024-05-08T21:10:21.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.562+0000 7fe98b7fe700 1 -- 172.21.15.80:0/2847741497 learned_addr learned my addr 172.21.15.80:0/2847741497 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:10:21.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.562+0000 7fe98a7fc700 1 -- 172.21.15.80:0/2847741497 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 595361758 0 0) 0x7fe98c158ae0 con 0x7fe98c070b20 2024-05-08T21:10:21.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.562+0000 7fe98a7fc700 1 -- 172.21.15.80:0/2847741497 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9740035b0 con 0x7fe98c070b20 2024-05-08T21:10:21.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.562+0000 7fe98affd700 1 --2- 172.21.15.80:0/2847741497 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe98c0c6880 0x7fe98c070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:21.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.562+0000 7fe98a7fc700 1 -- 172.21.15.80:0/2847741497 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2063223989 0 0) 0x7fe9740035b0 con 0x7fe98c070b20 2024-05-08T21:10:21.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.562+0000 7fe98a7fc700 1 -- 172.21.15.80:0/2847741497 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe98c0c6880 msgr2=0x7fe98c070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:21.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.562+0000 7fe98a7fc700 1 --2- 172.21.15.80:0/2847741497 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe98c0c6880 0x7fe98c070f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:21.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.562+0000 7fe98a7fc700 1 -- 172.21.15.80:0/2847741497 >> v1:172.21.15.106:6789/0 conn(0x7fe98c15b600 legacy=0x7fe98c162990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:21.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.562+0000 7fe98a7fc700 1 -- 172.21.15.80:0/2847741497 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe98c073300 con 0x7fe98c070b20 2024-05-08T21:10:21.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.562+0000 7fe98a7fc700 1 -- 172.21.15.80:0/2847741497 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3520646302 0 0) 0x7fe97c001670 con 0x7fe98c070b20 2024-05-08T21:10:21.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.562+0000 7fe98a7fc700 1 -- 172.21.15.80:0/2847741497 >> v1:172.21.15.80:6789/0 conn(0x7fe98c070b20 legacy=0x7fe98c0729e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:21.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.562+0000 7fe98a7fc700 1 --2- 172.21.15.80:0/2847741497 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe974003a30 0x7fe974003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:21.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.562+0000 7fe98a7fc700 1 --2- 172.21.15.80:0/2847741497 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe974004850 0x7fe974004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:21.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.562+0000 7fe98a7fc700 1 --2- 172.21.15.80:0/2847741497 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe98c0c6880 0x7fe974005250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:21.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.562+0000 7fe98a7fc700 1 -- 172.21.15.80:0/2847741497 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe98c0730f0 con 0x7fe974003a30 2024-05-08T21:10:21.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.562+0000 7fe98a7fc700 1 -- 172.21.15.80:0/2847741497 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe97400bbd0 con 0x7fe974004850 2024-05-08T21:10:21.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.562+0000 7fe98a7fc700 1 -- 172.21.15.80:0/2847741497 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe97400bd90 con 0x7fe98c0c6880 2024-05-08T21:10:21.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.562+0000 7fe98b7fe700 1 --2- 172.21.15.80:0/2847741497 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe974003a30 0x7fe974003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:21.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.563+0000 7fe98affd700 1 --2- 172.21.15.80:0/2847741497 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe974004850 0x7fe974004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:21.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.563+0000 7fe98bfff700 1 --2- 172.21.15.80:0/2847741497 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe98c0c6880 0x7fe974005250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:21.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.563+0000 7fe98b7fe700 1 -- 172.21.15.80:0/2847741497 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe98c0c6880 msgr2=0x7fe974005250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:21.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.563+0000 7fe98b7fe700 1 --2- 172.21.15.80:0/2847741497 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe98c0c6880 0x7fe974005250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:21.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.563+0000 7fe98b7fe700 1 -- 172.21.15.80:0/2847741497 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe974004850 msgr2=0x7fe974004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:21.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.563+0000 7fe98b7fe700 1 --2- 172.21.15.80:0/2847741497 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe974004850 0x7fe974004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:21.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.563+0000 7fe98b7fe700 1 -- 172.21.15.80:0/2847741497 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9740035b0 con 0x7fe974003a30 2024-05-08T21:10:21.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.563+0000 7fe98b7fe700 1 --2- 172.21.15.80:0/2847741497 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe974003a30 0x7fe974003e50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe97c00c240 tx=0x7fe974005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e07c07685bb9c64 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:21.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.563+0000 7fe98a7fc700 1 -- 172.21.15.80:0/2847741497 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe97c007c10 con 0x7fe974003a30 2024-05-08T21:10:21.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.563+0000 7fe98a7fc700 1 -- 172.21.15.80:0/2847741497 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe97c00ce00 con 0x7fe974003a30 2024-05-08T21:10:21.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.563+0000 7fe98a7fc700 1 -- 172.21.15.80:0/2847741497 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe97c005ba0 con 0x7fe974003a30 2024-05-08T21:10:21.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.563+0000 7fe9920cb700 1 -- 172.21.15.80:0/2847741497 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe974003a30 msgr2=0x7fe974003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:21.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.563+0000 7fe9920cb700 1 --2- 172.21.15.80:0/2847741497 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe974003a30 0x7fe974003e50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe97c00c240 tx=0x7fe974005880 comp rx=0 tx=0).stop 2024-05-08T21:10:21.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.564+0000 7fe98bfff700 1 -- 172.21.15.80:0/2847741497 reap_dead start 2024-05-08T21:10:21.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.564+0000 7fe9920cb700 1 -- 172.21.15.80:0/2847741497 shutdown_connections 2024-05-08T21:10:21.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.564+0000 7fe9920cb700 1 -- 172.21.15.80:0/2847741497 >> 172.21.15.80:0/2847741497 conn(0x7fe98c0cbe80 msgr2=0x7fe98c0cc290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:21.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.564+0000 7fe9920cb700 1 -- 172.21.15.80:0/2847741497 shutdown_connections 2024-05-08T21:10:21.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.564+0000 7fe9920cb700 1 -- 172.21.15.80:0/2847741497 wait complete. 2024-05-08T21:10:21.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.565+0000 7fe9920cb700 1 Processor -- start 2024-05-08T21:10:21.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.565+0000 7fe9920cb700 1 -- start start 2024-05-08T21:10:21.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.566+0000 7fe9920cb700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe974003a30 0x7fe98c14b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:21.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.566+0000 7fe9920cb700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe98c1556b0 0x7fe98c152900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:21.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.566+0000 7fe9920cb700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe98c152e40 0x7fe98c0c8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:21.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.566+0000 7fe9920cb700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe98c0c87e0 con 0x7fe98c152e40 2024-05-08T21:10:21.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.566+0000 7fe9920cb700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe98c1edd30 con 0x7fe98c1556b0 2024-05-08T21:10:21.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.566+0000 7fe9920cb700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe98c1edff0 con 0x7fe974003a30 2024-05-08T21:10:21.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.566+0000 7fe98bfff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe98c152e40 0x7fe98c0c8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:21.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.566+0000 7fe98bfff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe98c152e40 0x7fe98c0c8c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37532/0 (socket says 172.21.15.80:37532) 2024-05-08T21:10:21.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.566+0000 7fe98bfff700 1 -- 172.21.15.80:0/2318453402 learned_addr learned my addr 172.21.15.80:0/2318453402 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:21.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.566+0000 7fe98b7fe700 1 --2- 172.21.15.80:0/2318453402 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe974003a30 0x7fe98c14b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:21.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.566+0000 7fe98affd700 1 --2- 172.21.15.80:0/2318453402 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe98c1556b0 0x7fe98c152900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:21.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.566+0000 7fe98bfff700 1 -- 172.21.15.80:0/2318453402 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe974003a30 msgr2=0x7fe98c14b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:21.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.566+0000 7fe98bfff700 1 --2- 172.21.15.80:0/2318453402 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe974003a30 0x7fe98c14b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:21.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.566+0000 7fe98bfff700 1 -- 172.21.15.80:0/2318453402 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe98c1556b0 msgr2=0x7fe98c152900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:21.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.566+0000 7fe98bfff700 1 --2- 172.21.15.80:0/2318453402 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe98c1556b0 0x7fe98c152900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:21.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.566+0000 7fe98bfff700 1 -- 172.21.15.80:0/2318453402 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe98c1ee2d0 con 0x7fe98c152e40 2024-05-08T21:10:21.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.566+0000 7fe98bfff700 1 --2- 172.21.15.80:0/2318453402 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe98c152e40 0x7fe98c0c8c30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe98c15b9e0 tx=0x7fe98400d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:21.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.566+0000 7fe973fff700 1 -- 172.21.15.80:0/2318453402 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe984003c10 con 0x7fe98c152e40 2024-05-08T21:10:21.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.566+0000 7fe973fff700 1 -- 172.21.15.80:0/2318453402 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe984003d90 con 0x7fe98c152e40 2024-05-08T21:10:21.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.566+0000 7fe973fff700 1 -- 172.21.15.80:0/2318453402 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe98400dbd0 con 0x7fe98c152e40 2024-05-08T21:10:21.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.566+0000 7fe9920cb700 1 -- 172.21.15.80:0/2318453402 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe98c1ee5b0 con 0x7fe98c152e40 2024-05-08T21:10:21.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.566+0000 7fe9920cb700 1 -- 172.21.15.80:0/2318453402 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe98c1eeb70 con 0x7fe98c152e40 2024-05-08T21:10:21.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.567+0000 7fe9920cb700 1 -- 172.21.15.80:0/2318453402 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe98c071a10 con 0x7fe98c152e40 2024-05-08T21:10:21.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.568+0000 7fe973fff700 1 -- 172.21.15.80:0/2318453402 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe98400dd30 con 0x7fe98c152e40 2024-05-08T21:10:21.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.568+0000 7fe973fff700 1 --2- 172.21.15.80:0/2318453402 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe97806ac90 0x7fe97806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:21.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.568+0000 7fe973fff700 1 -- 172.21.15.80:0/2318453402 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe984089930 con 0x7fe98c152e40 2024-05-08T21:10:21.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.568+0000 7fe98b7fe700 1 --2- 172.21.15.80:0/2318453402 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe97806ac90 0x7fe97806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:21.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.569+0000 7fe98b7fe700 1 --2- 172.21.15.80:0/2318453402 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe97806ac90 0x7fe97806d150 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe97c015040 tx=0x7fe97c007000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:21.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.573+0000 7fe973fff700 1 -- 172.21.15.80:0/2318453402 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fe984054820 con 0x7fe98c152e40 2024-05-08T21:10:21.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.786+0000 7fe9920cb700 1 -- 172.21.15.80:0/2318453402 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe98c158440 con 0x7fe98c152e40 2024-05-08T21:10:21.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.786+0000 7fe973fff700 1 -- 172.21.15.80:0/2318453402 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe984057e40 con 0x7fe98c152e40 2024-05-08T21:10:21.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.788+0000 7fe9920cb700 1 -- 172.21.15.80:0/2318453402 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe97806ac90 msgr2=0x7fe97806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:21.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.788+0000 7fe9920cb700 1 --2- 172.21.15.80:0/2318453402 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe97806ac90 0x7fe97806d150 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe97c015040 tx=0x7fe97c007000 comp rx=0 tx=0).stop 2024-05-08T21:10:21.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.788+0000 7fe9920cb700 1 -- 172.21.15.80:0/2318453402 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe98c152e40 msgr2=0x7fe98c0c8c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:21.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.788+0000 7fe9920cb700 1 --2- 172.21.15.80:0/2318453402 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe98c152e40 0x7fe98c0c8c30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe98c15b9e0 tx=0x7fe98400d430 comp rx=0 tx=0).stop 2024-05-08T21:10:21.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.788+0000 7fe9920cb700 1 -- 172.21.15.80:0/2318453402 shutdown_connections 2024-05-08T21:10:21.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.788+0000 7fe9920cb700 1 --2- 172.21.15.80:0/2318453402 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe97806ac90 0x7fe97806d150 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:21.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.788+0000 7fe9920cb700 1 --2- 172.21.15.80:0/2318453402 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe98c152e40 0x7fe98c0c8c30 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:21.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.788+0000 7fe9920cb700 1 --2- 172.21.15.80:0/2318453402 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe974003a30 0x7fe98c14b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:21.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.788+0000 7fe9920cb700 1 --2- 172.21.15.80:0/2318453402 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe98c1556b0 0x7fe98c152900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:21.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.788+0000 7fe9920cb700 1 -- 172.21.15.80:0/2318453402 >> 172.21.15.80:0/2318453402 conn(0x7fe98c0cbe80 msgr2=0x7fe98c0ca7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:21.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.789+0000 7fe9920cb700 1 -- 172.21.15.80:0/2318453402 shutdown_connections 2024-05-08T21:10:21.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:21.789+0000 7fe9920cb700 1 -- 172.21.15.80:0/2318453402 wait complete. 2024-05-08T21:10:21.793 INFO:teuthology.orchestra.run.smithi080.stderr:listed 0 entries 2024-05-08T21:10:21.803 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi080.front.sepia.ceph.com... 2024-05-08T21:10:21.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:10:21.804 DEBUG:teuthology.orchestra.run.smithi080:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-05-08T21:10:21.843 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi080.stderr:ceph-fuse[53104]: fuse finished with error 0 and tester_r 0 2024-05-08T21:10:21.845 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:10:27.950 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi080.front.sepia.ceph.com 2024-05-08T21:10:27.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:10:27.950 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-05-08T21:10:27.985 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T21:10:28.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.160+0000 7fa8dc31f700 1 Processor -- start 2024-05-08T21:10:28.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.160+0000 7fa8dc31f700 1 -- start start 2024-05-08T21:10:28.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.161+0000 7fa8dc31f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa8d41541a0 0x7fa8d415a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:28.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.161+0000 7fa8dc31f700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa8d40c9150 0x7fa8d40c95b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:28.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.161+0000 7fa8dc31f700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8d40c8cc0 con 0x7fa8d4072600 2024-05-08T21:10:28.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.161+0000 7fa8dc31f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8d406c5a0 con 0x7fa8d41541a0 2024-05-08T21:10:28.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.161+0000 7fa8dc31f700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8d406ce60 con 0x7fa8d40c9150 2024-05-08T21:10:28.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.162+0000 7fa8da0bb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa8d41541a0 0x7fa8d415a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:28.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.162+0000 7fa8da0bb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa8d41541a0 0x7fa8d415a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52724/0 (socket says 172.21.15.80:52724) 2024-05-08T21:10:28.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.162+0000 7fa8da0bb700 1 -- 172.21.15.80:0/478826981 learned_addr learned my addr 172.21.15.80:0/478826981 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:28.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.162+0000 7fa8d98ba700 1 --2- 172.21.15.80:0/478826981 >> v2:172.21.15.106:3300/0 conn(0x7fa8d40c9150 0x7fa8d40c95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:28.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.162+0000 7fa8da0bb700 1 -- 172.21.15.80:0/478826981 >> v2:172.21.15.106:3300/0 conn(0x7fa8d40c9150 msgr2=0x7fa8d40c95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:28.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.162+0000 7fa8da0bb700 1 --2- 172.21.15.80:0/478826981 >> v2:172.21.15.106:3300/0 conn(0x7fa8d40c9150 0x7fa8d40c95b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:28.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.162+0000 7fa8da0bb700 1 -- 172.21.15.80:0/478826981 >> v1:172.21.15.106:6789/0 conn(0x7fa8d4072600 legacy=0x7fa8d4072a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:28.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.162+0000 7fa8da0bb700 1 -- 172.21.15.80:0/478826981 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d415e710 con 0x7fa8d41541a0 2024-05-08T21:10:28.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.162+0000 7fa8d98ba700 1 --2- 172.21.15.80:0/478826981 >> v2:172.21.15.106:3300/0 conn(0x7fa8d40c9150 0x7fa8d40c95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:10:28.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.162+0000 7fa8da0bb700 1 --2- 172.21.15.80:0/478826981 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8d41541a0 0x7fa8d415a1a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa8d406dfb0 tx=0x7fa8c4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad64e1fd3ed0892e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:28.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.162+0000 7fa8d90b9700 1 -- 172.21.15.80:0/478826981 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c400b870 con 0x7fa8d41541a0 2024-05-08T21:10:28.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.162+0000 7fa8d90b9700 1 -- 172.21.15.80:0/478826981 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c400b9d0 con 0x7fa8d41541a0 2024-05-08T21:10:28.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.162+0000 7fa8d90b9700 1 -- 172.21.15.80:0/478826981 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c400bd60 con 0x7fa8d41541a0 2024-05-08T21:10:28.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.163+0000 7fa8dc31f700 1 -- 172.21.15.80:0/478826981 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8d41541a0 msgr2=0x7fa8d415a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:28.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.163+0000 7fa8dc31f700 1 --2- 172.21.15.80:0/478826981 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8d41541a0 0x7fa8d415a1a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa8d406dfb0 tx=0x7fa8c4009bd0 comp rx=0 tx=0).stop 2024-05-08T21:10:28.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.163+0000 7fa8dc31f700 1 -- 172.21.15.80:0/478826981 shutdown_connections 2024-05-08T21:10:28.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.163+0000 7fa8dc31f700 1 --2- 172.21.15.80:0/478826981 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8d41541a0 0x7fa8d415a1a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:28.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.163+0000 7fa8dc31f700 1 --2- 172.21.15.80:0/478826981 >> v2:172.21.15.106:3300/0 conn(0x7fa8d40c9150 0x7fa8d40c95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:28.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.163+0000 7fa8dc31f700 1 -- 172.21.15.80:0/478826981 >> 172.21.15.80:0/478826981 conn(0x7fa8d406ef80 msgr2=0x7fa8d406f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:28.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.163+0000 7fa8dc31f700 1 -- 172.21.15.80:0/478826981 shutdown_connections 2024-05-08T21:10:28.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.163+0000 7fa8dc31f700 1 -- 172.21.15.80:0/478826981 wait complete. 2024-05-08T21:10:28.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.164+0000 7fa8dc31f700 1 Processor -- start 2024-05-08T21:10:28.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.164+0000 7fa8dc31f700 1 -- start start 2024-05-08T21:10:28.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.165+0000 7fa8dc31f700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa8d4072600 0x7fa8d41563c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:28.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.165+0000 7fa8dc31f700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8d40c9150 0x7fa8d4156900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:28.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.165+0000 7fa8dc31f700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8d41541a0 0x7fa8d4159b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:28.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.165+0000 7fa8dc31f700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d4158410 con 0x7fa8d41541a0 2024-05-08T21:10:28.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.165+0000 7fa8dc31f700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d4158100 con 0x7fa8d40c9150 2024-05-08T21:10:28.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.165+0000 7fa8dc31f700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d4159570 con 0x7fa8d4072600 2024-05-08T21:10:28.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.165+0000 7fa8da8bc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8d41541a0 0x7fa8d4159b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:28.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.165+0000 7fa8da8bc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8d41541a0 0x7fa8d4159b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52740/0 (socket says 172.21.15.80:52740) 2024-05-08T21:10:28.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.165+0000 7fa8da8bc700 1 -- 172.21.15.80:0/1022531745 learned_addr learned my addr 172.21.15.80:0/1022531745 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:28.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.165+0000 7fa8d98ba700 1 --2- 172.21.15.80:0/1022531745 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8d40c9150 0x7fa8d4156900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:28.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.165+0000 7fa8da0bb700 1 --2- 172.21.15.80:0/1022531745 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa8d4072600 0x7fa8d41563c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:28.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.165+0000 7fa8da8bc700 1 -- 172.21.15.80:0/1022531745 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa8d4072600 msgr2=0x7fa8d41563c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:28.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.165+0000 7fa8da8bc700 1 --2- 172.21.15.80:0/1022531745 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa8d4072600 0x7fa8d41563c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:28.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.165+0000 7fa8da8bc700 1 -- 172.21.15.80:0/1022531745 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8d40c9150 msgr2=0x7fa8d4156900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:28.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.165+0000 7fa8da8bc700 1 --2- 172.21.15.80:0/1022531745 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8d40c9150 0x7fa8d4156900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:28.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.165+0000 7fa8da8bc700 1 -- 172.21.15.80:0/1022531745 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c4009550 con 0x7fa8d41541a0 2024-05-08T21:10:28.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.166+0000 7fa8da8bc700 1 --2- 172.21.15.80:0/1022531745 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8d41541a0 0x7fa8d4159b00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc00cc50 tx=0x7fa8cc00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:28.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.166+0000 7fa8caffd700 1 -- 172.21.15.80:0/1022531745 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc003c00 con 0x7fa8d41541a0 2024-05-08T21:10:28.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.166+0000 7fa8caffd700 1 -- 172.21.15.80:0/1022531745 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8cc003d60 con 0x7fa8d41541a0 2024-05-08T21:10:28.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.166+0000 7fa8dc31f700 1 -- 172.21.15.80:0/1022531745 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8d40cc0b0 con 0x7fa8d41541a0 2024-05-08T21:10:28.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.166+0000 7fa8caffd700 1 -- 172.21.15.80:0/1022531745 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc00aab0 con 0x7fa8d41541a0 2024-05-08T21:10:28.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.166+0000 7fa8dc31f700 1 -- 172.21.15.80:0/1022531745 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8d40cc670 con 0x7fa8d41541a0 2024-05-08T21:10:28.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.167+0000 7fa8dc31f700 1 -- 172.21.15.80:0/1022531745 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8d404ec60 con 0x7fa8d41541a0 2024-05-08T21:10:28.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.167+0000 7fa8caffd700 1 -- 172.21.15.80:0/1022531745 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa8cc00ac10 con 0x7fa8d41541a0 2024-05-08T21:10:28.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.168+0000 7fa8caffd700 1 --2- 172.21.15.80:0/1022531745 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fa8b806ac90 0x7fa8b806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:28.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.168+0000 7fa8caffd700 1 -- 172.21.15.80:0/1022531745 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa8cc0894f0 con 0x7fa8d41541a0 2024-05-08T21:10:28.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.168+0000 7fa8da0bb700 1 --2- 172.21.15.80:0/1022531745 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fa8b806ac90 0x7fa8b806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:28.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.168+0000 7fa8da0bb700 1 --2- 172.21.15.80:0/1022531745 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fa8b806ac90 0x7fa8b806d150 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4014040 tx=0x7fa8c4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:28.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.172+0000 7fa8caffd700 1 -- 172.21.15.80:0/1022531745 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fa8cc054470 con 0x7fa8d41541a0 2024-05-08T21:10:28.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.373+0000 7fa8dc31f700 1 -- 172.21.15.80:0/1022531745 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa8d40718a0 con 0x7fa8d41541a0 2024-05-08T21:10:28.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.374+0000 7fa8caffd700 1 -- 172.21.15.80:0/1022531745 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+17878 (secure 0 0 0) 0x7fa8cc057a90 con 0x7fa8d41541a0 2024-05-08T21:10:28.377 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:10:28.378 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":26,"fsid":"44d31c1e-aad3-47ca-a4fa-85a63d4a60aa","created":"2024-05-08T21:09:46.467038+0000","modified":"2024-05-08T21:10:08.163735+0000","last_up_change":"2024-05-08T21:09:57.284675+0000","last_in_change":"2024-05-08T21:09:49.125444+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T21:09:58.238951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T21:10:02.177476+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T21:10:02.685535+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-08T21:10:05.753779+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c3f9d93e-ed6d-4a0c-b5c0-0e8d44c65fdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":47011},{"type":"v1","addr":"172.21.15.80:6817","nonce":47011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":47011},{"type":"v1","addr":"172.21.15.80:6819","nonce":47011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":47011},{"type":"v1","addr":"172.21.15.80:6823","nonce":47011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":47011},{"type":"v1","addr":"172.21.15.80:6821","nonce":47011}]},"public_addr":"172.21.15.80:6817/47011","cluster_addr":"172.21.15.80:6819/47011","heartbeat_back_addr":"172.21.15.80:6823/47011","heartbeat_front_addr":"172.21.15.80:6821/47011","state":["exists","up"]},{"osd":1,"uuid":"4ce2b4d6-6c40-43aa-8dd1-743fef8915df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":47010},{"type":"v1","addr":"172.21.15.80:6809","nonce":47010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":47010},{"type":"v1","addr":"172.21.15.80:6811","nonce":47010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":47010},{"type":"v1","addr":"172.21.15.80:6815","nonce":47010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":47010},{"type":"v1","addr":"172.21.15.80:6813","nonce":47010}]},"public_addr":"172.21.15.80:6809/47010","cluster_addr":"172.21.15.80:6811/47010","heartbeat_back_addr":"172.21.15.80:6815/47010","heartbeat_front_addr":"172.21.15.80:6813/47010","state":["exists","up"]},{"osd":2,"uuid":"e30cc3bc-6461-4fac-960a-de00c9488d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":47009},{"type":"v1","addr":"172.21.15.80:6801","nonce":47009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":47009},{"type":"v1","addr":"172.21.15.80:6803","nonce":47009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":47009},{"type":"v1","addr":"172.21.15.80:6807","nonce":47009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":47009},{"type":"v1","addr":"172.21.15.80:6805","nonce":47009}]},"public_addr":"172.21.15.80:6801/47009","cluster_addr":"172.21.15.80:6803/47009","heartbeat_back_addr":"172.21.15.80:6807/47009","heartbeat_front_addr":"172.21.15.80:6805/47009","state":["exists","up"]},{"osd":3,"uuid":"a415c099-9ea6-40be-98ed-f2932f98dfd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":47012},{"type":"v1","addr":"172.21.15.80:6825","nonce":47012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":47012},{"type":"v1","addr":"172.21.15.80:6827","nonce":47012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":47012},{"type":"v1","addr":"172.21.15.80:6831","nonce":47012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":47012},{"type":"v1","addr":"172.21.15.80:6829","nonce":47012}]},"public_addr":"172.21.15.80:6825/47012","cluster_addr":"172.21.15.80:6827/47012","heartbeat_back_addr":"172.21.15.80:6831/47012","heartbeat_front_addr":"172.21.15.80:6829/47012","state":["exists","up"]},{"osd":4,"uuid":"5ae1d51f-0918-4571-b79b-154308d46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6823","nonce":47114},{"type":"v1","addr":"172.21.15.106:6825","nonce":47114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":47114},{"type":"v1","addr":"172.21.15.106:6827","nonce":47114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":47114},{"type":"v1","addr":"172.21.15.106:6831","nonce":47114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":47114},{"type":"v1","addr":"172.21.15.106:6829","nonce":47114}]},"public_addr":"172.21.15.106:6825/47114","cluster_addr":"172.21.15.106:6827/47114","heartbeat_back_addr":"172.21.15.106:6831/47114","heartbeat_front_addr":"172.21.15.106:6829/47114","state":["exists","up"]},{"osd":5,"uuid":"a19ac74e-4282-4428-b167-26ba6b92f732","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6807","nonce":47111},{"type":"v1","addr":"172.21.15.106:6809","nonce":47111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":47111},{"type":"v1","addr":"172.21.15.106:6811","nonce":47111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":47111},{"type":"v1","addr":"172.21.15.106:6815","nonce":47111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":47111},{"type":"v1","addr":"172.21.15.106:6813","nonce":47111}]},"public_addr":"172.21.15.106:6809/47111","cluster_addr":"172.21.15.106:6811/47111","heartbeat_back_addr":"172.21.15.106:6815/47111","heartbeat_front_addr":"172.21.15.106:6813/47111","state":["exists","up"]},{"osd":6,"uuid":"bfe72edd-7acc-4805-807d-2000e76f2feb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":47112},{"type":"v1","addr":"172.21.15.106:6817","nonce":47112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":47112},{"type":"v1","addr":"172.21.15.106:6819","nonce":47112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":47112},{"type":"v1","addr":"172.21.15.106:6824","nonce":47112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":47112},{"type":"v1","addr":"172.21.15.106:6821","nonce":47112}]},"public_addr":"172.21.15.106:6817/47112","cluster_addr":"172.21.15.106:6819/47112","heartbeat_back_addr":"172.21.15.106:6824/47112","heartbeat_front_addr":"172.21.15.106:6821/47112","state":["exists","up"]},{"osd":7,"uuid":"99897f22-ed17-4c7c-9088-cc0c4a51f786","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":47113},{"type":"v1","addr":"172.21.15.106:6801","nonce":47113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":47113},{"type":"v1","addr":"172.21.15.106:6803","nonce":47113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":47113},{"type":"v1","addr":"172.21.15.106:6808","nonce":47113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":47113},{"type":"v1","addr":"172.21.15.106:6805","nonce":47113}]},"public_addr":"172.21.15.106:6801/47113","cluster_addr":"172.21.15.106:6803/47113","heartbeat_back_addr":"172.21.15.106:6808/47113","heartbeat_front_addr":"172.21.15.106:6805/47113","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.232670+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.277753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.050087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.349312+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.344080+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.348781+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.352539+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.275013+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T21:10:28.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.376+0000 7fa8dc31f700 1 -- 172.21.15.80:0/1022531745 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fa8b806ac90 msgr2=0x7fa8b806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:28.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.376+0000 7fa8dc31f700 1 --2- 172.21.15.80:0/1022531745 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fa8b806ac90 0x7fa8b806d150 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4014040 tx=0x7fa8c4008030 comp rx=0 tx=0).stop 2024-05-08T21:10:28.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.376+0000 7fa8dc31f700 1 -- 172.21.15.80:0/1022531745 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8d41541a0 msgr2=0x7fa8d4159b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:28.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.376+0000 7fa8dc31f700 1 --2- 172.21.15.80:0/1022531745 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8d41541a0 0x7fa8d4159b00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc00cc50 tx=0x7fa8cc00cf60 comp rx=0 tx=0).stop 2024-05-08T21:10:28.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.376+0000 7fa8dc31f700 1 -- 172.21.15.80:0/1022531745 shutdown_connections 2024-05-08T21:10:28.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.376+0000 7fa8dc31f700 1 --2- 172.21.15.80:0/1022531745 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fa8b806ac90 0x7fa8b806d150 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:28.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.376+0000 7fa8dc31f700 1 --2- 172.21.15.80:0/1022531745 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8d41541a0 0x7fa8d4159b00 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:28.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.376+0000 7fa8dc31f700 1 --2- 172.21.15.80:0/1022531745 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa8d4072600 0x7fa8d41563c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:28.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.376+0000 7fa8dc31f700 1 --2- 172.21.15.80:0/1022531745 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8d40c9150 0x7fa8d4156900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:28.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.376+0000 7fa8dc31f700 1 -- 172.21.15.80:0/1022531745 >> 172.21.15.80:0/1022531745 conn(0x7fa8d406ef80 msgr2=0x7fa8d41513e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:28.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.376+0000 7fa8dc31f700 1 -- 172.21.15.80:0/1022531745 shutdown_connections 2024-05-08T21:10:28.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.376+0000 7fa8dc31f700 1 -- 172.21.15.80:0/1022531745 wait complete. 2024-05-08T21:10:28.392 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T21:10:28.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.510+0000 7f82cf6b8700 1 Processor -- start 2024-05-08T21:10:28.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.510+0000 7f82cf6b8700 1 -- start start 2024-05-08T21:10:28.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.511+0000 7f82cf6b8700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f82c8154470 0x7f82c806a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:28.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.511+0000 7f82cf6b8700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f82c806af00 0x7f82c806f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:28.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.511+0000 7f82cf6b8700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82c815b5c0 con 0x7f82c806f730 2024-05-08T21:10:28.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.511+0000 7f82cf6b8700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82c806fbc0 con 0x7f82c8154470 2024-05-08T21:10:28.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.511+0000 7f82cf6b8700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82c8154850 con 0x7f82c806af00 2024-05-08T21:10:28.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.511+0000 7f82ccc53700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f82c806af00 0x7f82c806f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:28.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.511+0000 7f82cd454700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f82c8154470 0x7f82c806a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:28.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.511+0000 7f82ccc53700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f82c806af00 0x7f82c806f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:36062/0 (socket says 172.21.15.80:36062) 2024-05-08T21:10:28.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.511+0000 7f82ccc53700 1 -- 172.21.15.80:0/1315530825 learned_addr learned my addr 172.21.15.80:0/1315530825 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:28.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.511+0000 7f82bffff700 1 -- 172.21.15.80:0/1315530825 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2104988902 0 0) 0x7f82c815b5c0 con 0x7f82c806f730 2024-05-08T21:10:28.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.511+0000 7f82bffff700 1 -- 172.21.15.80:0/1315530825 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82b40035b0 con 0x7f82c806f730 2024-05-08T21:10:28.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.511+0000 7f82ccc53700 1 -- 172.21.15.80:0/1315530825 >> v2:172.21.15.106:3300/0 conn(0x7f82c8154470 msgr2=0x7f82c806a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:28.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.511+0000 7f82ccc53700 1 --2- 172.21.15.80:0/1315530825 >> v2:172.21.15.106:3300/0 conn(0x7f82c8154470 0x7f82c806a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:28.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.511+0000 7f82ccc53700 1 -- 172.21.15.80:0/1315530825 >> v1:172.21.15.106:6789/0 conn(0x7f82c806f730 legacy=0x7f82c815ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:28.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.511+0000 7f82ccc53700 1 -- 172.21.15.80:0/1315530825 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82c815a0d0 con 0x7f82c806af00 2024-05-08T21:10:28.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.511+0000 7f82cd454700 1 --2- 172.21.15.80:0/1315530825 >> v2:172.21.15.106:3300/0 conn(0x7f82c8154470 0x7f82c806a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:10:28.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.512+0000 7f82ccc53700 1 --2- 172.21.15.80:0/1315530825 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f82c806af00 0x7f82c806f1f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f82c40098f0 tx=0x7f82c4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36c2c8b181019347 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:28.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.512+0000 7f82bffff700 1 -- 172.21.15.80:0/1315530825 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c4011830 con 0x7f82c806af00 2024-05-08T21:10:28.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.512+0000 7f82bffff700 1 -- 172.21.15.80:0/1315530825 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c4011990 con 0x7f82c806af00 2024-05-08T21:10:28.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.512+0000 7f82bffff700 1 -- 172.21.15.80:0/1315530825 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c4011d20 con 0x7f82c806af00 2024-05-08T21:10:28.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.512+0000 7f82cf6b8700 1 -- 172.21.15.80:0/1315530825 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f82c806af00 msgr2=0x7f82c806f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:28.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.512+0000 7f82cf6b8700 1 --2- 172.21.15.80:0/1315530825 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f82c806af00 0x7f82c806f1f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f82c40098f0 tx=0x7f82c4009c00 comp rx=0 tx=0).stop 2024-05-08T21:10:28.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.512+0000 7f82cf6b8700 1 -- 172.21.15.80:0/1315530825 shutdown_connections 2024-05-08T21:10:28.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.512+0000 7f82cf6b8700 1 --2- 172.21.15.80:0/1315530825 >> v2:172.21.15.106:3300/0 conn(0x7f82c8154470 0x7f82c806a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:28.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.512+0000 7f82cf6b8700 1 --2- 172.21.15.80:0/1315530825 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f82c806af00 0x7f82c806f1f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:28.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.512+0000 7f82cf6b8700 1 -- 172.21.15.80:0/1315530825 >> 172.21.15.80:0/1315530825 conn(0x7f82c806bad0 msgr2=0x7f82c806bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:28.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.512+0000 7f82cf6b8700 1 -- 172.21.15.80:0/1315530825 shutdown_connections 2024-05-08T21:10:28.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.512+0000 7f82cf6b8700 1 -- 172.21.15.80:0/1315530825 wait complete. 2024-05-08T21:10:28.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.514+0000 7f82cf6b8700 1 Processor -- start 2024-05-08T21:10:28.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.514+0000 7f82cf6b8700 1 -- start start 2024-05-08T21:10:28.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.514+0000 7f82cf6b8700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f82c806af00 0x7f82c814b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:28.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.514+0000 7f82cf6b8700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f82c806f730 0x7f82c8149f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:28.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.514+0000 7f82cf6b8700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f82c8154470 0x7f82c814a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:28.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.514+0000 7f82cf6b8700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c814c8f0 con 0x7f82c806f730 2024-05-08T21:10:28.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.514+0000 7f82cf6b8700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c80731d0 con 0x7f82c8154470 2024-05-08T21:10:28.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.514+0000 7f82cf6b8700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82c81f0b30 con 0x7f82c806af00 2024-05-08T21:10:28.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.514+0000 7f82ccc53700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f82c806f730 0x7f82c8149f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:28.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.514+0000 7f82ccc53700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f82c806f730 0x7f82c8149f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52744/0 (socket says 172.21.15.80:52744) 2024-05-08T21:10:28.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.514+0000 7f82ccc53700 1 -- 172.21.15.80:0/174321936 learned_addr learned my addr 172.21.15.80:0/174321936 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:28.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.514+0000 7f82cd454700 1 --2- 172.21.15.80:0/174321936 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f82c806af00 0x7f82c814b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:28.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.514+0000 7f82cdc55700 1 --2- 172.21.15.80:0/174321936 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f82c8154470 0x7f82c814a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:28.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.515+0000 7f82ccc53700 1 -- 172.21.15.80:0/174321936 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f82c806af00 msgr2=0x7f82c814b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:28.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.515+0000 7f82ccc53700 1 --2- 172.21.15.80:0/174321936 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f82c806af00 0x7f82c814b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:28.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.515+0000 7f82ccc53700 1 -- 172.21.15.80:0/174321936 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f82c8154470 msgr2=0x7f82c814a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:28.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.515+0000 7f82ccc53700 1 --2- 172.21.15.80:0/174321936 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f82c8154470 0x7f82c814a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:28.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.515+0000 7f82ccc53700 1 -- 172.21.15.80:0/174321936 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b80094a0 con 0x7f82c806f730 2024-05-08T21:10:28.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.515+0000 7f82ccc53700 1 --2- 172.21.15.80:0/174321936 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f82c806f730 0x7f82c8149f70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f82c4000c00 tx=0x7f82c4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:28.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.515+0000 7f82bdffb700 1 -- 172.21.15.80:0/174321936 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c4004300 con 0x7f82c806f730 2024-05-08T21:10:28.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.515+0000 7f82cf6b8700 1 -- 172.21.15.80:0/174321936 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82c4009550 con 0x7f82c806f730 2024-05-08T21:10:28.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.515+0000 7f82bdffb700 1 -- 172.21.15.80:0/174321936 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c401f070 con 0x7f82c806f730 2024-05-08T21:10:28.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.515+0000 7f82bdffb700 1 -- 172.21.15.80:0/174321936 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c40036a0 con 0x7f82c806f730 2024-05-08T21:10:28.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.515+0000 7f82cf6b8700 1 -- 172.21.15.80:0/174321936 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82c81f0290 con 0x7f82c806f730 2024-05-08T21:10:28.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.516+0000 7f82cf6b8700 1 -- 172.21.15.80:0/174321936 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82c814ca80 con 0x7f82c806f730 2024-05-08T21:10:28.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.517+0000 7f82bdffb700 1 -- 172.21.15.80:0/174321936 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f82c4021030 con 0x7f82c806f730 2024-05-08T21:10:28.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.517+0000 7f82bdffb700 1 --2- 172.21.15.80:0/174321936 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f82ac06ac90 0x7f82ac06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:28.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.517+0000 7f82bdffb700 1 -- 172.21.15.80:0/174321936 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f82c408a500 con 0x7f82c806f730 2024-05-08T21:10:28.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.517+0000 7f82cd454700 1 --2- 172.21.15.80:0/174321936 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f82ac06ac90 0x7f82ac06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:28.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.517+0000 7f82cd454700 1 --2- 172.21.15.80:0/174321936 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f82ac06ac90 0x7f82ac06d150 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f82b8009cd0 tx=0x7f82b8009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:28.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.521+0000 7f82bdffb700 1 -- 172.21.15.80:0/174321936 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f82c4055370 con 0x7f82c806f730 2024-05-08T21:10:28.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.720+0000 7f82cf6b8700 1 -- 172.21.15.80:0/174321936 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f82c804ec60 con 0x7f82c806f730 2024-05-08T21:10:28.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.721+0000 7f82bdffb700 1 -- 172.21.15.80:0/174321936 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+17878 (secure 0 0 0) 0x7f82c4058990 con 0x7f82c806f730 2024-05-08T21:10:28.725 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:10:28.725 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":26,"fsid":"44d31c1e-aad3-47ca-a4fa-85a63d4a60aa","created":"2024-05-08T21:09:46.467038+0000","modified":"2024-05-08T21:10:08.163735+0000","last_up_change":"2024-05-08T21:09:57.284675+0000","last_in_change":"2024-05-08T21:09:49.125444+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T21:09:58.238951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T21:10:02.177476+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T21:10:02.685535+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-08T21:10:05.753779+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c3f9d93e-ed6d-4a0c-b5c0-0e8d44c65fdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":47011},{"type":"v1","addr":"172.21.15.80:6817","nonce":47011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":47011},{"type":"v1","addr":"172.21.15.80:6819","nonce":47011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":47011},{"type":"v1","addr":"172.21.15.80:6823","nonce":47011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":47011},{"type":"v1","addr":"172.21.15.80:6821","nonce":47011}]},"public_addr":"172.21.15.80:6817/47011","cluster_addr":"172.21.15.80:6819/47011","heartbeat_back_addr":"172.21.15.80:6823/47011","heartbeat_front_addr":"172.21.15.80:6821/47011","state":["exists","up"]},{"osd":1,"uuid":"4ce2b4d6-6c40-43aa-8dd1-743fef8915df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":47010},{"type":"v1","addr":"172.21.15.80:6809","nonce":47010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":47010},{"type":"v1","addr":"172.21.15.80:6811","nonce":47010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":47010},{"type":"v1","addr":"172.21.15.80:6815","nonce":47010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":47010},{"type":"v1","addr":"172.21.15.80:6813","nonce":47010}]},"public_addr":"172.21.15.80:6809/47010","cluster_addr":"172.21.15.80:6811/47010","heartbeat_back_addr":"172.21.15.80:6815/47010","heartbeat_front_addr":"172.21.15.80:6813/47010","state":["exists","up"]},{"osd":2,"uuid":"e30cc3bc-6461-4fac-960a-de00c9488d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":47009},{"type":"v1","addr":"172.21.15.80:6801","nonce":47009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":47009},{"type":"v1","addr":"172.21.15.80:6803","nonce":47009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":47009},{"type":"v1","addr":"172.21.15.80:6807","nonce":47009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":47009},{"type":"v1","addr":"172.21.15.80:6805","nonce":47009}]},"public_addr":"172.21.15.80:6801/47009","cluster_addr":"172.21.15.80:6803/47009","heartbeat_back_addr":"172.21.15.80:6807/47009","heartbeat_front_addr":"172.21.15.80:6805/47009","state":["exists","up"]},{"osd":3,"uuid":"a415c099-9ea6-40be-98ed-f2932f98dfd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":47012},{"type":"v1","addr":"172.21.15.80:6825","nonce":47012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":47012},{"type":"v1","addr":"172.21.15.80:6827","nonce":47012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":47012},{"type":"v1","addr":"172.21.15.80:6831","nonce":47012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":47012},{"type":"v1","addr":"172.21.15.80:6829","nonce":47012}]},"public_addr":"172.21.15.80:6825/47012","cluster_addr":"172.21.15.80:6827/47012","heartbeat_back_addr":"172.21.15.80:6831/47012","heartbeat_front_addr":"172.21.15.80:6829/47012","state":["exists","up"]},{"osd":4,"uuid":"5ae1d51f-0918-4571-b79b-154308d46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6823","nonce":47114},{"type":"v1","addr":"172.21.15.106:6825","nonce":47114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":47114},{"type":"v1","addr":"172.21.15.106:6827","nonce":47114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":47114},{"type":"v1","addr":"172.21.15.106:6831","nonce":47114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":47114},{"type":"v1","addr":"172.21.15.106:6829","nonce":47114}]},"public_addr":"172.21.15.106:6825/47114","cluster_addr":"172.21.15.106:6827/47114","heartbeat_back_addr":"172.21.15.106:6831/47114","heartbeat_front_addr":"172.21.15.106:6829/47114","state":["exists","up"]},{"osd":5,"uuid":"a19ac74e-4282-4428-b167-26ba6b92f732","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6807","nonce":47111},{"type":"v1","addr":"172.21.15.106:6809","nonce":47111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":47111},{"type":"v1","addr":"172.21.15.106:6811","nonce":47111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":47111},{"type":"v1","addr":"172.21.15.106:6815","nonce":47111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":47111},{"type":"v1","addr":"172.21.15.106:6813","nonce":47111}]},"public_addr":"172.21.15.106:6809/47111","cluster_addr":"172.21.15.106:6811/47111","heartbeat_back_addr":"172.21.15.106:6815/47111","heartbeat_front_addr":"172.21.15.106:6813/47111","state":["exists","up"]},{"osd":6,"uuid":"bfe72edd-7acc-4805-807d-2000e76f2feb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":47112},{"type":"v1","addr":"172.21.15.106:6817","nonce":47112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":47112},{"type":"v1","addr":"172.21.15.106:6819","nonce":47112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":47112},{"type":"v1","addr":"172.21.15.106:6824","nonce":47112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":47112},{"type":"v1","addr":"172.21.15.106:6821","nonce":47112}]},"public_addr":"172.21.15.106:6817/47112","cluster_addr":"172.21.15.106:6819/47112","heartbeat_back_addr":"172.21.15.106:6824/47112","heartbeat_front_addr":"172.21.15.106:6821/47112","state":["exists","up"]},{"osd":7,"uuid":"99897f22-ed17-4c7c-9088-cc0c4a51f786","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":47113},{"type":"v1","addr":"172.21.15.106:6801","nonce":47113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":47113},{"type":"v1","addr":"172.21.15.106:6803","nonce":47113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":47113},{"type":"v1","addr":"172.21.15.106:6808","nonce":47113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":47113},{"type":"v1","addr":"172.21.15.106:6805","nonce":47113}]},"public_addr":"172.21.15.106:6801/47113","cluster_addr":"172.21.15.106:6803/47113","heartbeat_back_addr":"172.21.15.106:6808/47113","heartbeat_front_addr":"172.21.15.106:6805/47113","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.232670+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.277753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.050087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.349312+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.344080+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.348781+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.352539+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.275013+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T21:10:28.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.724+0000 7f82cf6b8700 1 -- 172.21.15.80:0/174321936 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f82ac06ac90 msgr2=0x7f82ac06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:28.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.724+0000 7f82cf6b8700 1 --2- 172.21.15.80:0/174321936 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f82ac06ac90 0x7f82ac06d150 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f82b8009cd0 tx=0x7f82b8009210 comp rx=0 tx=0).stop 2024-05-08T21:10:28.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.724+0000 7f82cf6b8700 1 -- 172.21.15.80:0/174321936 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f82c806f730 msgr2=0x7f82c8149f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:28.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.724+0000 7f82cf6b8700 1 --2- 172.21.15.80:0/174321936 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f82c806f730 0x7f82c8149f70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f82c4000c00 tx=0x7f82c4004750 comp rx=0 tx=0).stop 2024-05-08T21:10:28.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.724+0000 7f82cf6b8700 1 -- 172.21.15.80:0/174321936 shutdown_connections 2024-05-08T21:10:28.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.724+0000 7f82cf6b8700 1 --2- 172.21.15.80:0/174321936 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f82ac06ac90 0x7f82ac06d150 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:28.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.724+0000 7f82cf6b8700 1 --2- 172.21.15.80:0/174321936 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f82c8154470 0x7f82c814a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:28.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.724+0000 7f82cf6b8700 1 --2- 172.21.15.80:0/174321936 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f82c806af00 0x7f82c814b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:28.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.724+0000 7f82cf6b8700 1 --2- 172.21.15.80:0/174321936 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f82c806f730 0x7f82c8149f70 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:28.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.724+0000 7f82cf6b8700 1 -- 172.21.15.80:0/174321936 >> 172.21.15.80:0/174321936 conn(0x7f82c806bad0 msgr2=0x7f82c8151c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:28.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.724+0000 7f82cf6b8700 1 -- 172.21.15.80:0/174321936 shutdown_connections 2024-05-08T21:10:28.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.724+0000 7f82cf6b8700 1 -- 172.21.15.80:0/174321936 wait complete. 2024-05-08T21:10:28.740 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-08T21:10:28.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.860+0000 7ffad7b0f700 1 Processor -- start 2024-05-08T21:10:28.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.861+0000 7ffad7b0f700 1 -- start start 2024-05-08T21:10:28.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.861+0000 7ffad7b0f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ffad01544f0 0x7ffad00c8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:28.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.861+0000 7ffad7b0f700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ffad00c6db0 0x7ffad015a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:28.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.861+0000 7ffad7b0f700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffad00c56d0 con 0x7ffad00c5890 2024-05-08T21:10:28.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.861+0000 7ffad7b0f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffad00c4ae0 con 0x7ffad01544f0 2024-05-08T21:10:28.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.861+0000 7ffad7b0f700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffad00c6920 con 0x7ffad00c6db0 2024-05-08T21:10:28.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.862+0000 7ffad58ab700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ffad01544f0 0x7ffad00c8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:28.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.862+0000 7ffad60ac700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ffad00c5890 0x7ffad015d7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:56106/0 (socket says 172.21.15.80:56106) 2024-05-08T21:10:28.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.862+0000 7ffad60ac700 1 -- 172.21.15.80:0/3611277047 learned_addr learned my addr 172.21.15.80:0/3611277047 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:10:28.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.862+0000 7ffad50aa700 1 --2- 172.21.15.80:0/3611277047 >> v2:172.21.15.106:3300/0 conn(0x7ffad00c6db0 0x7ffad015a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:28.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.862+0000 7ffad58ab700 1 -- 172.21.15.80:0/3611277047 >> v2:172.21.15.106:3300/0 conn(0x7ffad00c6db0 msgr2=0x7ffad015a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:28.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.862+0000 7ffad58ab700 1 --2- 172.21.15.80:0/3611277047 >> v2:172.21.15.106:3300/0 conn(0x7ffad00c6db0 0x7ffad015a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:28.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.862+0000 7ffad58ab700 1 -- 172.21.15.80:0/3611277047 >> v1:172.21.15.80:6789/0 conn(0x7ffad00c5890 legacy=0x7ffad015d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:28.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.862+0000 7ffad58ab700 1 -- 172.21.15.80:0/3611277047 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffad00cb270 con 0x7ffad01544f0 2024-05-08T21:10:28.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.862+0000 7ffad50aa700 1 --2- 172.21.15.80:0/3611277047 >> v2:172.21.15.106:3300/0 conn(0x7ffad00c6db0 0x7ffad015a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:10:28.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.862+0000 7ffad58ab700 1 --2- 172.21.15.80:0/3611277047 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffad01544f0 0x7ffad00c8240 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ffad004f3a0 tx=0x7ffac4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faefdeb1487479 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:28.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.862+0000 7ffad48a9700 1 -- 172.21.15.80:0/3611277047 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac4011830 con 0x7ffad01544f0 2024-05-08T21:10:28.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.862+0000 7ffad48a9700 1 -- 172.21.15.80:0/3611277047 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac4011990 con 0x7ffad01544f0 2024-05-08T21:10:28.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.862+0000 7ffad48a9700 1 -- 172.21.15.80:0/3611277047 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac4011d20 con 0x7ffad01544f0 2024-05-08T21:10:28.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.863+0000 7ffad7b0f700 1 -- 172.21.15.80:0/3611277047 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffad01544f0 msgr2=0x7ffad00c8240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:28.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.863+0000 7ffad7b0f700 1 --2- 172.21.15.80:0/3611277047 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffad01544f0 0x7ffad00c8240 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ffad004f3a0 tx=0x7ffac4009b20 comp rx=0 tx=0).stop 2024-05-08T21:10:28.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.863+0000 7ffad7b0f700 1 -- 172.21.15.80:0/3611277047 shutdown_connections 2024-05-08T21:10:28.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.863+0000 7ffad7b0f700 1 --2- 172.21.15.80:0/3611277047 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffad01544f0 0x7ffad00c8240 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:28.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.863+0000 7ffad7b0f700 1 --2- 172.21.15.80:0/3611277047 >> v2:172.21.15.106:3300/0 conn(0x7ffad00c6db0 0x7ffad015a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:28.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.863+0000 7ffad7b0f700 1 -- 172.21.15.80:0/3611277047 >> 172.21.15.80:0/3611277047 conn(0x7ffad00ca340 msgr2=0x7ffad00ca750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:28.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.863+0000 7ffad7b0f700 1 -- 172.21.15.80:0/3611277047 shutdown_connections 2024-05-08T21:10:28.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.863+0000 7ffad7b0f700 1 -- 172.21.15.80:0/3611277047 wait complete. 2024-05-08T21:10:28.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.864+0000 7ffad7b0f700 1 Processor -- start 2024-05-08T21:10:28.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.864+0000 7ffad7b0f700 1 -- start start 2024-05-08T21:10:28.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.865+0000 7ffad7b0f700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ffad00c5890 0x7ffad014bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:28.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.865+0000 7ffad7b0f700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffad00c6db0 0x7ffad01f02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:28.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.865+0000 7ffad7b0f700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffad01544f0 0x7ffad01f2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:28.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.865+0000 7ffad7b0f700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad01efe80 con 0x7ffad01544f0 2024-05-08T21:10:28.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.865+0000 7ffad7b0f700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad014d030 con 0x7ffad00c6db0 2024-05-08T21:10:28.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.865+0000 7ffad7b0f700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffad014d310 con 0x7ffad00c5890 2024-05-08T21:10:28.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.865+0000 7ffad60ac700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffad01544f0 0x7ffad01f2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:28.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.865+0000 7ffad60ac700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffad01544f0 0x7ffad01f2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52752/0 (socket says 172.21.15.80:52752) 2024-05-08T21:10:28.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.865+0000 7ffad60ac700 1 -- 172.21.15.80:0/740293229 learned_addr learned my addr 172.21.15.80:0/740293229 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:28.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.865+0000 7ffad58ab700 1 --2- 172.21.15.80:0/740293229 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ffad00c5890 0x7ffad014bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:28.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.865+0000 7ffad50aa700 1 --2- 172.21.15.80:0/740293229 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffad00c6db0 0x7ffad01f02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:28.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.865+0000 7ffad60ac700 1 -- 172.21.15.80:0/740293229 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ffad00c5890 msgr2=0x7ffad014bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:28.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.865+0000 7ffad60ac700 1 --2- 172.21.15.80:0/740293229 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ffad00c5890 0x7ffad014bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:28.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.865+0000 7ffad60ac700 1 -- 172.21.15.80:0/740293229 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffad00c6db0 msgr2=0x7ffad01f02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:28.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.865+0000 7ffad60ac700 1 --2- 172.21.15.80:0/740293229 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffad00c6db0 0x7ffad01f02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:28.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.865+0000 7ffad60ac700 1 -- 172.21.15.80:0/740293229 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac40094a0 con 0x7ffad01544f0 2024-05-08T21:10:28.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.865+0000 7ffad50aa700 1 --2- 172.21.15.80:0/740293229 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffad00c6db0 0x7ffad01f02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:10:28.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.865+0000 7ffad60ac700 1 --2- 172.21.15.80:0/740293229 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffad01544f0 0x7ffad01f2d20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ffac800cbc0 tx=0x7ffac800ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:28.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.865+0000 7ffac27fc700 1 -- 172.21.15.80:0/740293229 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac800aaa0 con 0x7ffad01544f0 2024-05-08T21:10:28.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.865+0000 7ffac27fc700 1 -- 172.21.15.80:0/740293229 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac800ac00 con 0x7ffad01544f0 2024-05-08T21:10:28.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.865+0000 7ffad7b0f700 1 -- 172.21.15.80:0/740293229 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffad014d5f0 con 0x7ffad01544f0 2024-05-08T21:10:28.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.865+0000 7ffac27fc700 1 -- 172.21.15.80:0/740293229 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac8012400 con 0x7ffad01544f0 2024-05-08T21:10:28.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.865+0000 7ffad7b0f700 1 -- 172.21.15.80:0/740293229 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffad01ef750 con 0x7ffad01544f0 2024-05-08T21:10:28.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.866+0000 7ffad7b0f700 1 -- 172.21.15.80:0/740293229 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffad00c7b10 con 0x7ffad01544f0 2024-05-08T21:10:28.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.867+0000 7ffac27fc700 1 -- 172.21.15.80:0/740293229 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ffac801b3b0 con 0x7ffad01544f0 2024-05-08T21:10:28.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.867+0000 7ffac27fc700 1 --2- 172.21.15.80:0/740293229 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7ffab406ac90 0x7ffab406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:28.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.867+0000 7ffac27fc700 1 -- 172.21.15.80:0/740293229 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ffac80890d0 con 0x7ffad01544f0 2024-05-08T21:10:28.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.867+0000 7ffad58ab700 1 --2- 172.21.15.80:0/740293229 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7ffab406ac90 0x7ffab406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:28.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.868+0000 7ffad58ab700 1 --2- 172.21.15.80:0/740293229 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7ffab406ac90 0x7ffab406d150 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ffac4000c00 tx=0x7ffac401c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:28.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:28.872+0000 7ffac27fc700 1 -- 172.21.15.80:0/740293229 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7ffac8053fe0 con 0x7ffad01544f0 2024-05-08T21:10:29.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.113+0000 7ffad7b0f700 1 -- 172.21.15.80:0/740293229 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ffad00c56d0 con 0x7ffad01544f0 2024-05-08T21:10:29.300 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.297+0000 7ffac27fc700 1 -- 172.21.15.80:0/740293229 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7ffad00c56d0 con 0x7ffad01544f0 2024-05-08T21:10:29.302 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.299+0000 7ffad7b0f700 1 -- 172.21.15.80:0/740293229 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7ffab406ac90 msgr2=0x7ffab406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:29.303 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.299+0000 7ffad7b0f700 1 --2- 172.21.15.80:0/740293229 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7ffab406ac90 0x7ffab406d150 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ffac4000c00 tx=0x7ffac401c040 comp rx=0 tx=0).stop 2024-05-08T21:10:29.303 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.299+0000 7ffad7b0f700 1 -- 172.21.15.80:0/740293229 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffad01544f0 msgr2=0x7ffad01f2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:29.303 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.299+0000 7ffad7b0f700 1 --2- 172.21.15.80:0/740293229 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffad01544f0 0x7ffad01f2d20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ffac800cbc0 tx=0x7ffac800ced0 comp rx=0 tx=0).stop 2024-05-08T21:10:29.303 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.299+0000 7ffad7b0f700 1 -- 172.21.15.80:0/740293229 shutdown_connections 2024-05-08T21:10:29.303 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.299+0000 7ffad7b0f700 1 --2- 172.21.15.80:0/740293229 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7ffab406ac90 0x7ffab406d150 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:29.303 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.299+0000 7ffad7b0f700 1 --2- 172.21.15.80:0/740293229 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffad01544f0 0x7ffad01f2d20 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:29.303 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.299+0000 7ffad7b0f700 1 --2- 172.21.15.80:0/740293229 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ffad00c5890 0x7ffad014bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:29.303 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.299+0000 7ffad7b0f700 1 --2- 172.21.15.80:0/740293229 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffad00c6db0 0x7ffad01f02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:29.303 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.299+0000 7ffad7b0f700 1 -- 172.21.15.80:0/740293229 >> 172.21.15.80:0/740293229 conn(0x7ffad00ca340 msgr2=0x7ffad00cc320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:29.303 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.299+0000 7ffad7b0f700 1 -- 172.21.15.80:0/740293229 shutdown_connections 2024-05-08T21:10:29.303 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.299+0000 7ffad7b0f700 1 -- 172.21.15.80:0/740293229 wait complete. 2024-05-08T21:10:29.314 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'session_timeout': 300} 2024-05-08T21:10:29.315 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-08T21:10:29.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.435+0000 7f8d57ba3700 1 Processor -- start 2024-05-08T21:10:29.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.435+0000 7f8d57ba3700 1 -- start start 2024-05-08T21:10:29.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.436+0000 7f8d57ba3700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8d500ccc00 0x7f8d50071be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:29.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.436+0000 7f8d57ba3700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8d500ccfe0 0x7f8d500c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:29.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.436+0000 7f8d57ba3700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d500c9150 con 0x7f8d500c8380 2024-05-08T21:10:29.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.436+0000 7f8d57ba3700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d500c99f0 con 0x7f8d500ccfe0 2024-05-08T21:10:29.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.436+0000 7f8d57ba3700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d501579c0 con 0x7f8d500ccc00 2024-05-08T21:10:29.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.436+0000 7f8d5513e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8d500ccfe0 0x7f8d500c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:29.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.436+0000 7f8d56140700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f8d500c8380 0x7f8d50156ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:56114/0 (socket says 172.21.15.80:56114) 2024-05-08T21:10:29.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.436+0000 7f8d56140700 1 -- 172.21.15.80:0/704866642 learned_addr learned my addr 172.21.15.80:0/704866642 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:10:29.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.436+0000 7f8d5593f700 1 --2- 172.21.15.80:0/704866642 >> v2:172.21.15.106:3300/0 conn(0x7f8d500ccc00 0x7f8d50071be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:29.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.437+0000 7f8d5513e700 1 -- 172.21.15.80:0/704866642 >> v2:172.21.15.106:3300/0 conn(0x7f8d500ccc00 msgr2=0x7f8d50071be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:29.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.437+0000 7f8d5513e700 1 --2- 172.21.15.80:0/704866642 >> v2:172.21.15.106:3300/0 conn(0x7f8d500ccc00 0x7f8d50071be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:29.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.437+0000 7f8d5513e700 1 -- 172.21.15.80:0/704866642 >> v1:172.21.15.80:6789/0 conn(0x7f8d500c8380 legacy=0x7f8d50156ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:29.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.437+0000 7f8d5513e700 1 -- 172.21.15.80:0/704866642 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d50157ca0 con 0x7f8d500ccfe0 2024-05-08T21:10:29.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.437+0000 7f8d5493d700 1 -- 172.21.15.80:0/704866642 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2685091875 0 0) 0x7f8d500c9150 con 0x7f8d500c8380 2024-05-08T21:10:29.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.437+0000 7f8d5513e700 1 --2- 172.21.15.80:0/704866642 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d500ccfe0 0x7f8d500c9e80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8d500c7860 tx=0x7f8d4c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6e948b09fa40ceb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:29.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.437+0000 7f8d5493d700 1 -- 172.21.15.80:0/704866642 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4c011830 con 0x7f8d500ccfe0 2024-05-08T21:10:29.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.437+0000 7f8d5493d700 1 -- 172.21.15.80:0/704866642 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d4c011990 con 0x7f8d500ccfe0 2024-05-08T21:10:29.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.437+0000 7f8d5493d700 1 -- 172.21.15.80:0/704866642 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4c011d20 con 0x7f8d500ccfe0 2024-05-08T21:10:29.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.437+0000 7f8d57ba3700 1 -- 172.21.15.80:0/704866642 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d500ccfe0 msgr2=0x7f8d500c9e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:29.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.437+0000 7f8d57ba3700 1 --2- 172.21.15.80:0/704866642 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d500ccfe0 0x7f8d500c9e80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8d500c7860 tx=0x7f8d4c009b20 comp rx=0 tx=0).stop 2024-05-08T21:10:29.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.437+0000 7f8d57ba3700 1 -- 172.21.15.80:0/704866642 shutdown_connections 2024-05-08T21:10:29.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.438+0000 7f8d57ba3700 1 --2- 172.21.15.80:0/704866642 >> v2:172.21.15.106:3300/0 conn(0x7f8d500ccc00 0x7f8d50071be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:29.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.438+0000 7f8d57ba3700 1 --2- 172.21.15.80:0/704866642 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d500ccfe0 0x7f8d500c9e80 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:29.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.438+0000 7f8d57ba3700 1 -- 172.21.15.80:0/704866642 >> 172.21.15.80:0/704866642 conn(0x7f8d5006f140 msgr2=0x7f8d5006f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:29.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.438+0000 7f8d57ba3700 1 -- 172.21.15.80:0/704866642 shutdown_connections 2024-05-08T21:10:29.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.438+0000 7f8d57ba3700 1 -- 172.21.15.80:0/704866642 wait complete. 2024-05-08T21:10:29.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.439+0000 7f8d57ba3700 1 Processor -- start 2024-05-08T21:10:29.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.439+0000 7f8d57ba3700 1 -- start start 2024-05-08T21:10:29.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.439+0000 7f8d57ba3700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8d500c8380 0x7f8d50155520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:29.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.439+0000 7f8d57ba3700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d500ccc00 0x7f8d501ed620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:29.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.439+0000 7f8d57ba3700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d500ccfe0 0x7f8d501edb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:29.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.439+0000 7f8d57ba3700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d501f1740 con 0x7f8d500ccc00 2024-05-08T21:10:29.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.439+0000 7f8d57ba3700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d501f0b90 con 0x7f8d500ccfe0 2024-05-08T21:10:29.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.439+0000 7f8d57ba3700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d50153a10 con 0x7f8d500c8380 2024-05-08T21:10:29.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.440+0000 7f8d5513e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d500ccc00 0x7f8d501ed620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:29.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.440+0000 7f8d5513e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d500ccc00 0x7f8d501ed620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52760/0 (socket says 172.21.15.80:52760) 2024-05-08T21:10:29.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.440+0000 7f8d5513e700 1 -- 172.21.15.80:0/1238857376 learned_addr learned my addr 172.21.15.80:0/1238857376 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:29.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.440+0000 7f8d56140700 1 --2- 172.21.15.80:0/1238857376 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d500ccfe0 0x7f8d501edb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:29.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.440+0000 7f8d5593f700 1 --2- 172.21.15.80:0/1238857376 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8d500c8380 0x7f8d50155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:29.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.440+0000 7f8d5513e700 1 -- 172.21.15.80:0/1238857376 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8d500c8380 msgr2=0x7f8d50155520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:29.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.440+0000 7f8d5513e700 1 --2- 172.21.15.80:0/1238857376 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8d500c8380 0x7f8d50155520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:29.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.440+0000 7f8d5513e700 1 -- 172.21.15.80:0/1238857376 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d500ccfe0 msgr2=0x7f8d501edb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:29.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.440+0000 7f8d5513e700 1 --2- 172.21.15.80:0/1238857376 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d500ccfe0 0x7f8d501edb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:29.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.440+0000 7f8d5513e700 1 -- 172.21.15.80:0/1238857376 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d4c0094a0 con 0x7f8d500ccc00 2024-05-08T21:10:29.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.440+0000 7f8d5513e700 1 --2- 172.21.15.80:0/1238857376 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d500ccc00 0x7f8d501ed620 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c009790 tx=0x7f8d4c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:29.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.440+0000 7f8d467fc700 1 -- 172.21.15.80:0/1238857376 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4c0038a0 con 0x7f8d500ccc00 2024-05-08T21:10:29.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.440+0000 7f8d467fc700 1 -- 172.21.15.80:0/1238857376 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d4c01f070 con 0x7f8d500ccc00 2024-05-08T21:10:29.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.440+0000 7f8d57ba3700 1 -- 172.21.15.80:0/1238857376 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d50147f10 con 0x7f8d500ccc00 2024-05-08T21:10:29.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.440+0000 7f8d467fc700 1 -- 172.21.15.80:0/1238857376 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4c003c40 con 0x7f8d500ccc00 2024-05-08T21:10:29.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.440+0000 7f8d57ba3700 1 -- 172.21.15.80:0/1238857376 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d501f0da0 con 0x7f8d500ccc00 2024-05-08T21:10:29.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.441+0000 7f8d57ba3700 1 -- 172.21.15.80:0/1238857376 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d5004ec60 con 0x7f8d500ccc00 2024-05-08T21:10:29.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.442+0000 7f8d467fc700 1 -- 172.21.15.80:0/1238857376 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8d4c026480 con 0x7f8d500ccc00 2024-05-08T21:10:29.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.442+0000 7f8d467fc700 1 --2- 172.21.15.80:0/1238857376 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f8d3406ac90 0x7f8d3406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:29.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.442+0000 7f8d467fc700 1 -- 172.21.15.80:0/1238857376 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8d4c021070 con 0x7f8d500ccc00 2024-05-08T21:10:29.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.442+0000 7f8d5593f700 1 --2- 172.21.15.80:0/1238857376 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f8d3406ac90 0x7f8d3406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:29.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.442+0000 7f8d5593f700 1 --2- 172.21.15.80:0/1238857376 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f8d3406ac90 0x7f8d3406d150 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8d40009930 tx=0x7f8d40008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:29.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.446+0000 7f8d467fc700 1 -- 172.21.15.80:0/1238857376 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f8d4c055e50 con 0x7f8d500ccc00 2024-05-08T21:10:29.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:29.687+0000 7f8d57ba3700 1 -- 172.21.15.80:0/1238857376 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f8d5014a490 con 0x7f8d500ccc00 2024-05-08T21:10:30.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.305+0000 7f8d467fc700 1 -- 172.21.15.80:0/1238857376 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8d4c02b0c0 con 0x7f8d500ccc00 2024-05-08T21:10:30.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.307+0000 7f8d57ba3700 1 -- 172.21.15.80:0/1238857376 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f8d3406ac90 msgr2=0x7f8d3406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:30.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.307+0000 7f8d57ba3700 1 --2- 172.21.15.80:0/1238857376 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f8d3406ac90 0x7f8d3406d150 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8d40009930 tx=0x7f8d40008040 comp rx=0 tx=0).stop 2024-05-08T21:10:30.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.307+0000 7f8d57ba3700 1 -- 172.21.15.80:0/1238857376 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d500ccc00 msgr2=0x7f8d501ed620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:30.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.307+0000 7f8d57ba3700 1 --2- 172.21.15.80:0/1238857376 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d500ccc00 0x7f8d501ed620 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c009790 tx=0x7f8d4c004750 comp rx=0 tx=0).stop 2024-05-08T21:10:30.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.307+0000 7f8d57ba3700 1 -- 172.21.15.80:0/1238857376 shutdown_connections 2024-05-08T21:10:30.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.307+0000 7f8d57ba3700 1 --2- 172.21.15.80:0/1238857376 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f8d3406ac90 0x7f8d3406d150 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:30.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.307+0000 7f8d57ba3700 1 --2- 172.21.15.80:0/1238857376 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d500ccfe0 0x7f8d501edb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:30.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.307+0000 7f8d57ba3700 1 --2- 172.21.15.80:0/1238857376 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8d500c8380 0x7f8d50155520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:30.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.307+0000 7f8d57ba3700 1 --2- 172.21.15.80:0/1238857376 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d500ccc00 0x7f8d501ed620 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:30.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.307+0000 7f8d57ba3700 1 -- 172.21.15.80:0/1238857376 >> 172.21.15.80:0/1238857376 conn(0x7f8d5006f140 msgr2=0x7f8d500727e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:30.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.307+0000 7f8d57ba3700 1 -- 172.21.15.80:0/1238857376 shutdown_connections 2024-05-08T21:10:30.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.307+0000 7f8d57ba3700 1 -- 172.21.15.80:0/1238857376 wait complete. 2024-05-08T21:10:30.324 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-05-08T21:10:30.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.448+0000 7f7038fb4700 1 Processor -- start 2024-05-08T21:10:30.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.448+0000 7f7038fb4700 1 -- start start 2024-05-08T21:10:30.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.449+0000 7f7038fb4700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7034141450 0x7f703406dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:30.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.449+0000 7f7038fb4700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7034158ab0 0x7f70341628e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:30.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.449+0000 7f7038fb4700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7034158f40 con 0x7f703406eff0 2024-05-08T21:10:30.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.449+0000 7f7038fb4700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70340c57f0 con 0x7f7034158ab0 2024-05-08T21:10:30.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.449+0000 7f7038fb4700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70340c5a40 con 0x7f7034141450 2024-05-08T21:10:30.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.449+0000 7f7032d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7034158ab0 0x7f70341628e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:30.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.449+0000 7f7031d9b700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f703406eff0 0x7f70340c7120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:56122/0 (socket says 172.21.15.80:56122) 2024-05-08T21:10:30.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.449+0000 7f7031d9b700 1 -- 172.21.15.80:0/948536093 learned_addr learned my addr 172.21.15.80:0/948536093 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:10:30.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.449+0000 7f7032d9d700 1 --2- 172.21.15.80:0/948536093 >> v2:172.21.15.80:3300/0 conn(0x7f7034158ab0 0x7f70341628e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52772/0 (socket says 172.21.15.80:52772) 2024-05-08T21:10:30.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.449+0000 7f703259c700 1 --2- 172.21.15.80:0/948536093 >> v2:172.21.15.106:3300/0 conn(0x7f7034141450 0x7f703406dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:30.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.449+0000 7f7032d9d700 1 -- 172.21.15.80:0/948536093 >> v2:172.21.15.106:3300/0 conn(0x7f7034141450 msgr2=0x7f703406dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:30.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.449+0000 7f7032d9d700 1 --2- 172.21.15.80:0/948536093 >> v2:172.21.15.106:3300/0 conn(0x7f7034141450 0x7f703406dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:30.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.449+0000 7f7032d9d700 1 -- 172.21.15.80:0/948536093 >> v1:172.21.15.80:6789/0 conn(0x7f703406eff0 legacy=0x7f70340c7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:30.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.449+0000 7f7032d9d700 1 -- 172.21.15.80:0/948536093 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70340cae60 con 0x7f7034158ab0 2024-05-08T21:10:30.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.449+0000 7f703259c700 1 --2- 172.21.15.80:0/948536093 >> v2:172.21.15.106:3300/0 conn(0x7f7034141450 0x7f703406dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:10:30.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.449+0000 7f7032d9d700 1 --2- 172.21.15.80:0/948536093 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7034158ab0 0x7f70341628e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7034070080 tx=0x7f702c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcfd14a922be8b23 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:30.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.449+0000 7f703159a700 1 -- 172.21.15.80:0/948536093 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702c00e070 con 0x7f7034158ab0 2024-05-08T21:10:30.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.449+0000 7f703159a700 1 -- 172.21.15.80:0/948536093 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f702c00bbd0 con 0x7f7034158ab0 2024-05-08T21:10:30.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.449+0000 7f703159a700 1 -- 172.21.15.80:0/948536093 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702c012430 con 0x7f7034158ab0 2024-05-08T21:10:30.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.450+0000 7f7038fb4700 1 -- 172.21.15.80:0/948536093 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7034158ab0 msgr2=0x7f70341628e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:30.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.450+0000 7f7038fb4700 1 --2- 172.21.15.80:0/948536093 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7034158ab0 0x7f70341628e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7034070080 tx=0x7f702c00b330 comp rx=0 tx=0).stop 2024-05-08T21:10:30.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.450+0000 7f7038fb4700 1 -- 172.21.15.80:0/948536093 shutdown_connections 2024-05-08T21:10:30.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.450+0000 7f7038fb4700 1 --2- 172.21.15.80:0/948536093 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7034158ab0 0x7f70341628e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:30.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.450+0000 7f7038fb4700 1 --2- 172.21.15.80:0/948536093 >> v2:172.21.15.106:3300/0 conn(0x7f7034141450 0x7f703406dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:30.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.450+0000 7f7038fb4700 1 -- 172.21.15.80:0/948536093 >> 172.21.15.80:0/948536093 conn(0x7f70340ca340 msgr2=0x7f70340ca750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:30.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.450+0000 7f7038fb4700 1 -- 172.21.15.80:0/948536093 shutdown_connections 2024-05-08T21:10:30.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.450+0000 7f7038fb4700 1 -- 172.21.15.80:0/948536093 wait complete. 2024-05-08T21:10:30.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.452+0000 7f7038fb4700 1 Processor -- start 2024-05-08T21:10:30.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.452+0000 7f7038fb4700 1 -- start start 2024-05-08T21:10:30.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.453+0000 7f7038fb4700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f703406eff0 0x7f70341eec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:30.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.453+0000 7f7038fb4700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7034141450 0x7f70340bb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:30.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.453+0000 7f7038fb4700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7034158ab0 0x7f70340bc8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:30.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.453+0000 7f7038fb4700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70340bce30 con 0x7f703406eff0 2024-05-08T21:10:30.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.453+0000 7f7038fb4700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70340baca0 con 0x7f7034158ab0 2024-05-08T21:10:30.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.453+0000 7f7038fb4700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70340bb540 con 0x7f7034141450 2024-05-08T21:10:30.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.453+0000 7f703259c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f703406eff0 0x7f70341eec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:30.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.453+0000 7f703259c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f703406eff0 0x7f70341eec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52784/0 (socket says 172.21.15.80:52784) 2024-05-08T21:10:30.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.453+0000 7f703259c700 1 -- 172.21.15.80:0/1880434934 learned_addr learned my addr 172.21.15.80:0/1880434934 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:30.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.453+0000 7f7032d9d700 1 --2- 172.21.15.80:0/1880434934 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7034158ab0 0x7f70340bc8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:30.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.453+0000 7f7031d9b700 1 --2- 172.21.15.80:0/1880434934 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7034141450 0x7f70340bb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:30.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.453+0000 7f703259c700 1 -- 172.21.15.80:0/1880434934 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7034141450 msgr2=0x7f70340bb9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:30.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.453+0000 7f703259c700 1 --2- 172.21.15.80:0/1880434934 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7034141450 0x7f70340bb9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:30.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.453+0000 7f703259c700 1 -- 172.21.15.80:0/1880434934 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7034158ab0 msgr2=0x7f70340bc8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:30.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.453+0000 7f703259c700 1 --2- 172.21.15.80:0/1880434934 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7034158ab0 0x7f70340bc8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:30.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.453+0000 7f703259c700 1 -- 172.21.15.80:0/1880434934 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f702c009a70 con 0x7f703406eff0 2024-05-08T21:10:30.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.453+0000 7f703259c700 1 --2- 172.21.15.80:0/1880434934 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f703406eff0 0x7f70341eec80 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f702400c750 tx=0x7f702400cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:30.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.453+0000 7f7022ffd700 1 -- 172.21.15.80:0/1880434934 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7024011800 con 0x7f703406eff0 2024-05-08T21:10:30.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.453+0000 7f7022ffd700 1 -- 172.21.15.80:0/1880434934 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7024011960 con 0x7f703406eff0 2024-05-08T21:10:30.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.453+0000 7f7022ffd700 1 -- 172.21.15.80:0/1880434934 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7024011cd0 con 0x7f703406eff0 2024-05-08T21:10:30.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.453+0000 7f7038fb4700 1 -- 172.21.15.80:0/1880434934 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70341ee340 con 0x7f703406eff0 2024-05-08T21:10:30.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.453+0000 7f7038fb4700 1 -- 172.21.15.80:0/1880434934 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70340baef0 con 0x7f703406eff0 2024-05-08T21:10:30.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.454+0000 7f7038fb4700 1 -- 172.21.15.80:0/1880434934 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70340bb820 con 0x7f703406eff0 2024-05-08T21:10:30.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.455+0000 7f7022ffd700 1 -- 172.21.15.80:0/1880434934 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7024021350 con 0x7f703406eff0 2024-05-08T21:10:30.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.455+0000 7f7022ffd700 1 --2- 172.21.15.80:0/1880434934 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f701406ac90 0x7f701406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:30.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.455+0000 7f7031d9b700 1 --2- 172.21.15.80:0/1880434934 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f701406ac90 0x7f701406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:30.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.455+0000 7f7022ffd700 1 -- 172.21.15.80:0/1880434934 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f70240895d0 con 0x7f703406eff0 2024-05-08T21:10:30.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.456+0000 7f7031d9b700 1 --2- 172.21.15.80:0/1880434934 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f701406ac90 0x7f701406d150 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f70341eb3a0 tx=0x7f7028009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:30.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.460+0000 7f7022ffd700 1 -- 172.21.15.80:0/1880434934 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f7024054430 con 0x7f703406eff0 2024-05-08T21:10:30.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:30.704+0000 7f7038fb4700 1 -- 172.21.15.80:0/1880434934 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f703404ec60 con 0x7f703406eff0 2024-05-08T21:10:31.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.311+0000 7f7022ffd700 1 -- 172.21.15.80:0/1880434934 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v10) v1 ==== 115+0+0 (secure 0 0 0) 0x7f7024057a50 con 0x7f703406eff0 2024-05-08T21:10:31.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.314+0000 7f7038fb4700 1 -- 172.21.15.80:0/1880434934 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f701406ac90 msgr2=0x7f701406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:31.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.314+0000 7f7038fb4700 1 --2- 172.21.15.80:0/1880434934 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f701406ac90 0x7f701406d150 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f70341eb3a0 tx=0x7f7028009040 comp rx=0 tx=0).stop 2024-05-08T21:10:31.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.314+0000 7f7038fb4700 1 -- 172.21.15.80:0/1880434934 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f703406eff0 msgr2=0x7f70341eec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:31.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.314+0000 7f7038fb4700 1 --2- 172.21.15.80:0/1880434934 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f703406eff0 0x7f70341eec80 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f702400c750 tx=0x7f702400cb10 comp rx=0 tx=0).stop 2024-05-08T21:10:31.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.314+0000 7f7038fb4700 1 -- 172.21.15.80:0/1880434934 shutdown_connections 2024-05-08T21:10:31.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.314+0000 7f7038fb4700 1 --2- 172.21.15.80:0/1880434934 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f701406ac90 0x7f701406d150 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:31.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.314+0000 7f7038fb4700 1 --2- 172.21.15.80:0/1880434934 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f703406eff0 0x7f70341eec80 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:31.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.314+0000 7f7038fb4700 1 --2- 172.21.15.80:0/1880434934 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7034158ab0 0x7f70340bc8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:31.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.314+0000 7f7038fb4700 1 --2- 172.21.15.80:0/1880434934 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7034141450 0x7f70340bb9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:31.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.314+0000 7f7038fb4700 1 -- 172.21.15.80:0/1880434934 >> 172.21.15.80:0/1880434934 conn(0x7f70340ca340 msgr2=0x7f70340cc470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:31.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.314+0000 7f7038fb4700 1 -- 172.21.15.80:0/1880434934 shutdown_connections 2024-05-08T21:10:31.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.314+0000 7f7038fb4700 1 -- 172.21.15.80:0/1880434934 wait complete. 2024-05-08T21:10:31.331 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-08T21:10:31.332 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:10:31.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.455+0000 7fb801fab700 1 Processor -- start 2024-05-08T21:10:31.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.455+0000 7fb801fab700 1 -- start start 2024-05-08T21:10:31.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.455+0000 7fb801fab700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb7fc1541a0 0x7fb7fc15a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:31.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.455+0000 7fb801fab700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb7fc0c9150 0x7fb7fc0c95b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:31.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.456+0000 7fb801fab700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7fc0c8cc0 con 0x7fb7fc072600 2024-05-08T21:10:31.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.456+0000 7fb801fab700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7fc06c5a0 con 0x7fb7fc1541a0 2024-05-08T21:10:31.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.456+0000 7fb801fab700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7fc06ce60 con 0x7fb7fc0c9150 2024-05-08T21:10:31.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.456+0000 7fb7faffd700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb7fc0c9150 0x7fb7fc0c95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:31.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.456+0000 7fb7fb7fe700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb7fc1541a0 0x7fb7fc15a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:31.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.456+0000 7fb7fbfff700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fb7fc072600 0x7fb7fc072a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.80:39950/0 (socket says 172.21.15.80:39950) 2024-05-08T21:10:31.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.456+0000 7fb7fbfff700 1 -- 172.21.15.80:0/3861916404 learned_addr learned my addr 172.21.15.80:0/3861916404 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:10:31.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.456+0000 7fb7fb7fe700 1 -- 172.21.15.80:0/3861916404 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb7fc0c9150 msgr2=0x7fb7fc0c95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:31.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.456+0000 7fb7fb7fe700 1 --2- 172.21.15.80:0/3861916404 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb7fc0c9150 0x7fb7fc0c95b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:31.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.456+0000 7fb7fb7fe700 1 -- 172.21.15.80:0/3861916404 >> v1:172.21.15.106:6789/0 conn(0x7fb7fc072600 legacy=0x7fb7fc072a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:31.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.456+0000 7fb7fb7fe700 1 -- 172.21.15.80:0/3861916404 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7fc15e710 con 0x7fb7fc1541a0 2024-05-08T21:10:31.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.456+0000 7fb7fb7fe700 1 --2- 172.21.15.80:0/3861916404 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb7fc1541a0 0x7fb7fc15a1a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec009840 tx=0x7fb7ec009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95c38bb85b0831ff server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:31.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.457+0000 7fb7fa7fc700 1 -- 172.21.15.80:0/3861916404 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec004230 con 0x7fb7fc1541a0 2024-05-08T21:10:31.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.457+0000 7fb7fa7fc700 1 -- 172.21.15.80:0/3861916404 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7ec004390 con 0x7fb7fc1541a0 2024-05-08T21:10:31.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.457+0000 7fb7fa7fc700 1 -- 172.21.15.80:0/3861916404 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec0036a0 con 0x7fb7fc1541a0 2024-05-08T21:10:31.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.457+0000 7fb801fab700 1 -- 172.21.15.80:0/3861916404 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb7fc1541a0 msgr2=0x7fb7fc15a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:31.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.457+0000 7fb801fab700 1 --2- 172.21.15.80:0/3861916404 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb7fc1541a0 0x7fb7fc15a1a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec009840 tx=0x7fb7ec009b50 comp rx=0 tx=0).stop 2024-05-08T21:10:31.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.457+0000 7fb801fab700 1 -- 172.21.15.80:0/3861916404 shutdown_connections 2024-05-08T21:10:31.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.457+0000 7fb801fab700 1 --2- 172.21.15.80:0/3861916404 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb7fc1541a0 0x7fb7fc15a1a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:31.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.457+0000 7fb801fab700 1 --2- 172.21.15.80:0/3861916404 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb7fc0c9150 0x7fb7fc0c95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:31.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.457+0000 7fb801fab700 1 -- 172.21.15.80:0/3861916404 >> 172.21.15.80:0/3861916404 conn(0x7fb7fc06ef80 msgr2=0x7fb7fc06f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:31.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.457+0000 7fb801fab700 1 -- 172.21.15.80:0/3861916404 shutdown_connections 2024-05-08T21:10:31.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.457+0000 7fb801fab700 1 -- 172.21.15.80:0/3861916404 wait complete. 2024-05-08T21:10:31.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.458+0000 7fb801fab700 1 Processor -- start 2024-05-08T21:10:31.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.458+0000 7fb801fab700 1 -- start start 2024-05-08T21:10:31.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.459+0000 7fb801fab700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb7fc072600 0x7fb7fc0ccc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:31.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.459+0000 7fb801fab700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb7fc0c9150 0x7fb7fc0cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:31.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.459+0000 7fb801fab700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7fc1541a0 0x7fb7fc0cade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:31.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.459+0000 7fb801fab700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7fc0ca9c0 con 0x7fb7fc1541a0 2024-05-08T21:10:31.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.459+0000 7fb801fab700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7fc0cc800 con 0x7fb7fc072600 2024-05-08T21:10:31.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.459+0000 7fb801fab700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7fc1535e0 con 0x7fb7fc0c9150 2024-05-08T21:10:31.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.459+0000 7fb7fbfff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7fc1541a0 0x7fb7fc0cade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:31.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.459+0000 7fb7fbfff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7fc1541a0 0x7fb7fc0cade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52788/0 (socket says 172.21.15.80:52788) 2024-05-08T21:10:31.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.459+0000 7fb7fbfff700 1 -- 172.21.15.80:0/2032481961 learned_addr learned my addr 172.21.15.80:0/2032481961 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:31.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.459+0000 7fb7faffd700 1 --2- 172.21.15.80:0/2032481961 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb7fc0c9150 0x7fb7fc0cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:31.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.459+0000 7fb7fb7fe700 1 --2- 172.21.15.80:0/2032481961 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb7fc072600 0x7fb7fc0ccc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:31.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.460+0000 7fb7fbfff700 1 -- 172.21.15.80:0/2032481961 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb7fc0c9150 msgr2=0x7fb7fc0cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:31.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.460+0000 7fb7fbfff700 1 --2- 172.21.15.80:0/2032481961 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb7fc0c9150 0x7fb7fc0cd1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:31.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.460+0000 7fb7fbfff700 1 -- 172.21.15.80:0/2032481961 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb7fc072600 msgr2=0x7fb7fc0ccc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:31.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.460+0000 7fb7fbfff700 1 --2- 172.21.15.80:0/2032481961 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb7fc072600 0x7fb7fc0ccc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:31.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.460+0000 7fb7fbfff700 1 -- 172.21.15.80:0/2032481961 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7ec0094a0 con 0x7fb7fc1541a0 2024-05-08T21:10:31.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.460+0000 7fb7fbfff700 1 --2- 172.21.15.80:0/2032481961 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7fc1541a0 0x7fb7fc0cade0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb7f4002030 tx=0x7fb7f400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:31.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.460+0000 7fb7e3fff700 1 -- 172.21.15.80:0/2032481961 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f400ac50 con 0x7fb7fc1541a0 2024-05-08T21:10:31.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.460+0000 7fb801fab700 1 -- 172.21.15.80:0/2032481961 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7fc0cc560 con 0x7fb7fc1541a0 2024-05-08T21:10:31.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.460+0000 7fb801fab700 1 -- 172.21.15.80:0/2032481961 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7fc1f09d0 con 0x7fb7fc1541a0 2024-05-08T21:10:31.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.460+0000 7fb7e3fff700 1 -- 172.21.15.80:0/2032481961 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7f400adb0 con 0x7fb7fc1541a0 2024-05-08T21:10:31.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.460+0000 7fb7e3fff700 1 -- 172.21.15.80:0/2032481961 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f40072d0 con 0x7fb7fc1541a0 2024-05-08T21:10:31.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.461+0000 7fb801fab700 1 -- 172.21.15.80:0/2032481961 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7dc0052f0 con 0x7fb7fc1541a0 2024-05-08T21:10:31.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.462+0000 7fb7e3fff700 1 -- 172.21.15.80:0/2032481961 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb7f4007430 con 0x7fb7fc1541a0 2024-05-08T21:10:31.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.462+0000 7fb7e3fff700 1 --2- 172.21.15.80:0/2032481961 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fb7e806acc0 0x7fb7e806d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:31.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.462+0000 7fb7e3fff700 1 -- 172.21.15.80:0/2032481961 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb7f4089480 con 0x7fb7fc1541a0 2024-05-08T21:10:31.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.462+0000 7fb7fb7fe700 1 --2- 172.21.15.80:0/2032481961 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fb7e806acc0 0x7fb7e806d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:31.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.462+0000 7fb7fb7fe700 1 --2- 172.21.15.80:0/2032481961 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fb7e806acc0 0x7fb7e806d180 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec009840 tx=0x7fb7ec008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:31.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.467+0000 7fb7e3fff700 1 -- 172.21.15.80:0/2032481961 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fb7f40543a0 con 0x7fb7fc1541a0 2024-05-08T21:10:31.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.705+0000 7fb801fab700 1 -- 172.21.15.80:0/2032481961 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb7dc0055a0 con 0x7fb7fc1541a0 2024-05-08T21:10:31.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.706+0000 7fb7e3fff700 1 -- 172.21.15.80:0/2032481961 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6254 (secure 0 0 0) 0x7fb7f40579c0 con 0x7fb7fc1541a0 2024-05-08T21:10:31.709 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:10:31.709 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/2289230272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":2289230272},{"type":"v1","addr":"172.21.15.106:6833","nonce":2289230272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:10:31.304591+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.106:6836/1949999190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1949999190},{"type":"v1","addr":"172.21.15.106:6836","nonce":1949999190}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:10:31.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.708+0000 7fb801fab700 1 -- 172.21.15.80:0/2032481961 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fb7e806acc0 msgr2=0x7fb7e806d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:31.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.708+0000 7fb801fab700 1 --2- 172.21.15.80:0/2032481961 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fb7e806acc0 0x7fb7e806d180 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec009840 tx=0x7fb7ec008030 comp rx=0 tx=0).stop 2024-05-08T21:10:31.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.708+0000 7fb801fab700 1 -- 172.21.15.80:0/2032481961 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7fc1541a0 msgr2=0x7fb7fc0cade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:31.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.708+0000 7fb801fab700 1 --2- 172.21.15.80:0/2032481961 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7fc1541a0 0x7fb7fc0cade0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb7f4002030 tx=0x7fb7f400a340 comp rx=0 tx=0).stop 2024-05-08T21:10:31.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.708+0000 7fb801fab700 1 -- 172.21.15.80:0/2032481961 shutdown_connections 2024-05-08T21:10:31.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.708+0000 7fb801fab700 1 --2- 172.21.15.80:0/2032481961 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fb7e806acc0 0x7fb7e806d180 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:31.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.708+0000 7fb801fab700 1 --2- 172.21.15.80:0/2032481961 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7fc1541a0 0x7fb7fc0cade0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:31.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.708+0000 7fb801fab700 1 --2- 172.21.15.80:0/2032481961 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb7fc072600 0x7fb7fc0ccc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:31.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.708+0000 7fb801fab700 1 --2- 172.21.15.80:0/2032481961 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb7fc0c9150 0x7fb7fc0cd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:31.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.708+0000 7fb801fab700 1 -- 172.21.15.80:0/2032481961 >> 172.21.15.80:0/2032481961 conn(0x7fb7fc06ef80 msgr2=0x7fb7fc150210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:31.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.708+0000 7fb801fab700 1 -- 172.21.15.80:0/2032481961 shutdown_connections 2024-05-08T21:10:31.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.708+0000 7fb801fab700 1 -- 172.21.15.80:0/2032481961 wait complete. 2024-05-08T21:10:31.712 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 10 2024-05-08T21:10:31.723 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T21:10:31.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.843+0000 7fafedbff700 1 Processor -- start 2024-05-08T21:10:31.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.843+0000 7fafedbff700 1 -- start start 2024-05-08T21:10:31.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.843+0000 7fafedbff700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fafe8072d80 0x7fafe8073210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:31.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.844+0000 7fafedbff700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafe815b6d0 con 0x7fafe81520b0 2024-05-08T21:10:31.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.844+0000 7fafedbff700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafe815c650 con 0x7fafe80cbba0 2024-05-08T21:10:31.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.844+0000 7fafedbff700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafe81580e0 con 0x7fafe8072d80 2024-05-08T21:10:31.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.844+0000 7fafe77fe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fafe81520b0 0x7fafe8158810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:56136/0 (socket says 172.21.15.80:56136) 2024-05-08T21:10:31.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.844+0000 7fafe77fe700 1 -- 172.21.15.80:0/3059380077 learned_addr learned my addr 172.21.15.80:0/3059380077 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:10:31.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.844+0000 7fafe67fc700 1 -- 172.21.15.80:0/3059380077 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2584044019 0 0) 0x7fafe815b6d0 con 0x7fafe81520b0 2024-05-08T21:10:31.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.844+0000 7fafe67fc700 1 -- 172.21.15.80:0/3059380077 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafd00035b0 con 0x7fafe81520b0 2024-05-08T21:10:31.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.844+0000 7fafe6ffd700 1 --2- 172.21.15.80:0/3059380077 >> v2:172.21.15.106:3300/0 conn(0x7fafe8072d80 0x7fafe8073210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:31.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.844+0000 7fafe67fc700 1 -- 172.21.15.80:0/3059380077 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2424281223 0 0) 0x7fafd00035b0 con 0x7fafe81520b0 2024-05-08T21:10:31.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.844+0000 7fafe67fc700 1 -- 172.21.15.80:0/3059380077 >> v2:172.21.15.106:3300/0 conn(0x7fafe8072d80 msgr2=0x7fafe8073210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:31.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.844+0000 7fafe67fc700 1 --2- 172.21.15.80:0/3059380077 >> v2:172.21.15.106:3300/0 conn(0x7fafe8072d80 0x7fafe8073210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:31.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.844+0000 7fafe67fc700 1 -- 172.21.15.80:0/3059380077 >> v1:172.21.15.106:6789/0 conn(0x7fafe80cbba0 legacy=0x7fafe8162a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:31.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.844+0000 7fafe67fc700 1 -- 172.21.15.80:0/3059380077 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe80c5cd0 con 0x7fafe81520b0 2024-05-08T21:10:31.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.844+0000 7fafe67fc700 1 -- 172.21.15.80:0/3059380077 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3520646302 0 0) 0x7fafd8001670 con 0x7fafe81520b0 2024-05-08T21:10:31.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.844+0000 7fafe67fc700 1 -- 172.21.15.80:0/3059380077 >> v1:172.21.15.80:6789/0 conn(0x7fafe81520b0 legacy=0x7fafe8158810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:31.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.844+0000 7fafe67fc700 1 --2- 172.21.15.80:0/3059380077 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fafd0003a00 0x7fafd0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:31.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.844+0000 7fafe67fc700 1 --2- 172.21.15.80:0/3059380077 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fafd0004850 0x7fafd0004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:31.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.844+0000 7fafe67fc700 1 --2- 172.21.15.80:0/3059380077 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fafd0005210 0x7fafd000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:31.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.844+0000 7fafe67fc700 1 -- 172.21.15.80:0/3059380077 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe81580e0 con 0x7fafd0003a00 2024-05-08T21:10:31.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.844+0000 7fafe67fc700 1 -- 172.21.15.80:0/3059380077 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd000c0c0 con 0x7fafd0004850 2024-05-08T21:10:31.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.844+0000 7fafe67fc700 1 -- 172.21.15.80:0/3059380077 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafd000c280 con 0x7fafd0005210 2024-05-08T21:10:31.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.844+0000 7fafe77fe700 1 --2- 172.21.15.80:0/3059380077 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fafd0003a00 0x7fafd0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:31.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.844+0000 7fafe6ffd700 1 --2- 172.21.15.80:0/3059380077 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fafd0004850 0x7fafd0004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:31.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.844+0000 7fafe7fff700 1 --2- 172.21.15.80:0/3059380077 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fafd0005210 0x7fafd000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:31.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.845+0000 7fafe77fe700 1 -- 172.21.15.80:0/3059380077 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fafd0005210 msgr2=0x7fafd000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:31.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.845+0000 7fafe77fe700 1 --2- 172.21.15.80:0/3059380077 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fafd0005210 0x7fafd000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:31.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.845+0000 7fafe77fe700 1 -- 172.21.15.80:0/3059380077 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fafd0004850 msgr2=0x7fafd0004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:31.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.845+0000 7fafe77fe700 1 --2- 172.21.15.80:0/3059380077 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fafd0004850 0x7fafd0004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:31.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.845+0000 7fafe7fff700 1 -- 172.21.15.80:0/3059380077 reap_dead start 2024-05-08T21:10:31.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.845+0000 7fafe77fe700 1 -- 172.21.15.80:0/3059380077 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd00035b0 con 0x7fafd0003a00 2024-05-08T21:10:31.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.845+0000 7fafe77fe700 1 --2- 172.21.15.80:0/3059380077 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fafd0003a00 0x7fafd0003e20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fafd800c2a0 tx=0x7fafd0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a85b598c693d81ff server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:31.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.845+0000 7fafe67fc700 1 -- 172.21.15.80:0/3059380077 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd8007c10 con 0x7fafd0003a00 2024-05-08T21:10:31.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.845+0000 7fafe67fc700 1 -- 172.21.15.80:0/3059380077 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafd800cd80 con 0x7fafd0003a00 2024-05-08T21:10:31.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.845+0000 7fafe67fc700 1 -- 172.21.15.80:0/3059380077 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd8005ba0 con 0x7fafd0003a00 2024-05-08T21:10:31.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.845+0000 7fafedbff700 1 -- 172.21.15.80:0/3059380077 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fafd0003a00 msgr2=0x7fafd0003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:31.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.845+0000 7fafedbff700 1 --2- 172.21.15.80:0/3059380077 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fafd0003a00 0x7fafd0003e20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fafd800c2a0 tx=0x7fafd0005880 comp rx=0 tx=0).stop 2024-05-08T21:10:31.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.845+0000 7fafedbff700 1 -- 172.21.15.80:0/3059380077 shutdown_connections 2024-05-08T21:10:31.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.845+0000 7fafedbff700 1 --2- 172.21.15.80:0/3059380077 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fafd0003a00 0x7fafd0003e20 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:31.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.845+0000 7fafedbff700 1 -- 172.21.15.80:0/3059380077 >> 172.21.15.80:0/3059380077 conn(0x7fafe8066780 msgr2=0x7fafe8066b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:31.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.846+0000 7fafedbff700 1 -- 172.21.15.80:0/3059380077 shutdown_connections 2024-05-08T21:10:31.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.846+0000 7fafedbff700 1 -- 172.21.15.80:0/3059380077 wait complete. 2024-05-08T21:10:31.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.847+0000 7fafedbff700 1 Processor -- start 2024-05-08T21:10:31.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.847+0000 7fafedbff700 1 -- start start 2024-05-08T21:10:31.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.848+0000 7fafedbff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fafd0003a00 0x7fafe814b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:31.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.848+0000 7fafedbff700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fafe806c5c0 0x7fafe806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:31.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.848+0000 7fafedbff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fafe806d050 0x7fafe80ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:31.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.848+0000 7fafedbff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe806c410 con 0x7fafe806d050 2024-05-08T21:10:31.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.848+0000 7fafedbff700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe81ebfa0 con 0x7fafd0003a00 2024-05-08T21:10:31.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.848+0000 7fafedbff700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafe814f8a0 con 0x7fafe806c5c0 2024-05-08T21:10:31.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.848+0000 7fafe7fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fafe806d050 0x7fafe80ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:31.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.848+0000 7fafe7fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fafe806d050 0x7fafe80ccf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52800/0 (socket says 172.21.15.80:52800) 2024-05-08T21:10:31.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.848+0000 7fafe7fff700 1 -- 172.21.15.80:0/1045807409 learned_addr learned my addr 172.21.15.80:0/1045807409 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:31.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.848+0000 7fafe77fe700 1 --2- 172.21.15.80:0/1045807409 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fafd0003a00 0x7fafe814b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:31.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.848+0000 7fafe6ffd700 1 --2- 172.21.15.80:0/1045807409 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fafe806c5c0 0x7fafe806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:31.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.848+0000 7fafe7fff700 1 -- 172.21.15.80:0/1045807409 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fafe806c5c0 msgr2=0x7fafe806cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:31.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.848+0000 7fafe7fff700 1 --2- 172.21.15.80:0/1045807409 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fafe806c5c0 0x7fafe806cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:31.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.848+0000 7fafe7fff700 1 -- 172.21.15.80:0/1045807409 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fafd0003a00 msgr2=0x7fafe814b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:31.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.848+0000 7fafe7fff700 1 --2- 172.21.15.80:0/1045807409 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fafd0003a00 0x7fafe814b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:31.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.848+0000 7fafe7fff700 1 -- 172.21.15.80:0/1045807409 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe81ec3c0 con 0x7fafe806d050 2024-05-08T21:10:31.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.848+0000 7fafe7fff700 1 --2- 172.21.15.80:0/1045807409 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fafe806d050 0x7fafe80ccf90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fafe8072ac0 tx=0x7fafe000d150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:31.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.848+0000 7fafcffff700 1 -- 172.21.15.80:0/1045807409 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe0003c10 con 0x7fafe806d050 2024-05-08T21:10:31.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.848+0000 7fafcffff700 1 -- 172.21.15.80:0/1045807409 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafe0003d90 con 0x7fafe806d050 2024-05-08T21:10:31.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.848+0000 7fafedbff700 1 -- 172.21.15.80:0/1045807409 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafe806c130 con 0x7fafe806d050 2024-05-08T21:10:31.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.848+0000 7fafcffff700 1 -- 172.21.15.80:0/1045807409 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe0005310 con 0x7fafe806d050 2024-05-08T21:10:31.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.848+0000 7fafedbff700 1 -- 172.21.15.80:0/1045807409 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafe81eb8e0 con 0x7fafe806d050 2024-05-08T21:10:31.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.849+0000 7fafedbff700 1 -- 172.21.15.80:0/1045807409 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafe81ec0e0 con 0x7fafe806d050 2024-05-08T21:10:31.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.850+0000 7fafcffff700 1 -- 172.21.15.80:0/1045807409 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fafe0005470 con 0x7fafe806d050 2024-05-08T21:10:31.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.850+0000 7fafcffff700 1 --2- 172.21.15.80:0/1045807409 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fafd406acc0 0x7fafd406d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:31.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.850+0000 7fafcffff700 1 -- 172.21.15.80:0/1045807409 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fafe0089690 con 0x7fafe806d050 2024-05-08T21:10:31.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.850+0000 7fafe77fe700 1 --2- 172.21.15.80:0/1045807409 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fafd406acc0 0x7fafd406d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:31.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.850+0000 7fafe77fe700 1 --2- 172.21.15.80:0/1045807409 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fafd406acc0 0x7fafd406d180 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fafd8000c00 tx=0x7fafd8007000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:31.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:31.855+0000 7fafcffff700 1 -- 172.21.15.80:0/1045807409 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fafe81ec0e0 con 0x7fafe806d050 2024-05-08T21:10:32.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.053+0000 7fafedbff700 1 -- 172.21.15.80:0/1045807409 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fafe81ec0e0 con 0x7fafe806d050 2024-05-08T21:10:32.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.054+0000 7fafcffff700 1 -- 172.21.15.80:0/1045807409 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+17878 (secure 0 0 0) 0x7fafe81ec0e0 con 0x7fafe806d050 2024-05-08T21:10:32.058 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:10:32.058 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":26,"fsid":"44d31c1e-aad3-47ca-a4fa-85a63d4a60aa","created":"2024-05-08T21:09:46.467038+0000","modified":"2024-05-08T21:10:08.163735+0000","last_up_change":"2024-05-08T21:09:57.284675+0000","last_in_change":"2024-05-08T21:09:49.125444+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T21:09:58.238951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T21:10:02.177476+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T21:10:02.685535+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-08T21:10:05.753779+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c3f9d93e-ed6d-4a0c-b5c0-0e8d44c65fdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":47011},{"type":"v1","addr":"172.21.15.80:6817","nonce":47011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":47011},{"type":"v1","addr":"172.21.15.80:6819","nonce":47011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":47011},{"type":"v1","addr":"172.21.15.80:6823","nonce":47011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":47011},{"type":"v1","addr":"172.21.15.80:6821","nonce":47011}]},"public_addr":"172.21.15.80:6817/47011","cluster_addr":"172.21.15.80:6819/47011","heartbeat_back_addr":"172.21.15.80:6823/47011","heartbeat_front_addr":"172.21.15.80:6821/47011","state":["exists","up"]},{"osd":1,"uuid":"4ce2b4d6-6c40-43aa-8dd1-743fef8915df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":47010},{"type":"v1","addr":"172.21.15.80:6809","nonce":47010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":47010},{"type":"v1","addr":"172.21.15.80:6811","nonce":47010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":47010},{"type":"v1","addr":"172.21.15.80:6815","nonce":47010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":47010},{"type":"v1","addr":"172.21.15.80:6813","nonce":47010}]},"public_addr":"172.21.15.80:6809/47010","cluster_addr":"172.21.15.80:6811/47010","heartbeat_back_addr":"172.21.15.80:6815/47010","heartbeat_front_addr":"172.21.15.80:6813/47010","state":["exists","up"]},{"osd":2,"uuid":"e30cc3bc-6461-4fac-960a-de00c9488d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":47009},{"type":"v1","addr":"172.21.15.80:6801","nonce":47009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":47009},{"type":"v1","addr":"172.21.15.80:6803","nonce":47009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":47009},{"type":"v1","addr":"172.21.15.80:6807","nonce":47009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":47009},{"type":"v1","addr":"172.21.15.80:6805","nonce":47009}]},"public_addr":"172.21.15.80:6801/47009","cluster_addr":"172.21.15.80:6803/47009","heartbeat_back_addr":"172.21.15.80:6807/47009","heartbeat_front_addr":"172.21.15.80:6805/47009","state":["exists","up"]},{"osd":3,"uuid":"a415c099-9ea6-40be-98ed-f2932f98dfd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":47012},{"type":"v1","addr":"172.21.15.80:6825","nonce":47012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":47012},{"type":"v1","addr":"172.21.15.80:6827","nonce":47012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":47012},{"type":"v1","addr":"172.21.15.80:6831","nonce":47012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":47012},{"type":"v1","addr":"172.21.15.80:6829","nonce":47012}]},"public_addr":"172.21.15.80:6825/47012","cluster_addr":"172.21.15.80:6827/47012","heartbeat_back_addr":"172.21.15.80:6831/47012","heartbeat_front_addr":"172.21.15.80:6829/47012","state":["exists","up"]},{"osd":4,"uuid":"5ae1d51f-0918-4571-b79b-154308d46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6823","nonce":47114},{"type":"v1","addr":"172.21.15.106:6825","nonce":47114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":47114},{"type":"v1","addr":"172.21.15.106:6827","nonce":47114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":47114},{"type":"v1","addr":"172.21.15.106:6831","nonce":47114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":47114},{"type":"v1","addr":"172.21.15.106:6829","nonce":47114}]},"public_addr":"172.21.15.106:6825/47114","cluster_addr":"172.21.15.106:6827/47114","heartbeat_back_addr":"172.21.15.106:6831/47114","heartbeat_front_addr":"172.21.15.106:6829/47114","state":["exists","up"]},{"osd":5,"uuid":"a19ac74e-4282-4428-b167-26ba6b92f732","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6807","nonce":47111},{"type":"v1","addr":"172.21.15.106:6809","nonce":47111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":47111},{"type":"v1","addr":"172.21.15.106:6811","nonce":47111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":47111},{"type":"v1","addr":"172.21.15.106:6815","nonce":47111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":47111},{"type":"v1","addr":"172.21.15.106:6813","nonce":47111}]},"public_addr":"172.21.15.106:6809/47111","cluster_addr":"172.21.15.106:6811/47111","heartbeat_back_addr":"172.21.15.106:6815/47111","heartbeat_front_addr":"172.21.15.106:6813/47111","state":["exists","up"]},{"osd":6,"uuid":"bfe72edd-7acc-4805-807d-2000e76f2feb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":47112},{"type":"v1","addr":"172.21.15.106:6817","nonce":47112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":47112},{"type":"v1","addr":"172.21.15.106:6819","nonce":47112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":47112},{"type":"v1","addr":"172.21.15.106:6824","nonce":47112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":47112},{"type":"v1","addr":"172.21.15.106:6821","nonce":47112}]},"public_addr":"172.21.15.106:6817/47112","cluster_addr":"172.21.15.106:6819/47112","heartbeat_back_addr":"172.21.15.106:6824/47112","heartbeat_front_addr":"172.21.15.106:6821/47112","state":["exists","up"]},{"osd":7,"uuid":"99897f22-ed17-4c7c-9088-cc0c4a51f786","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":47113},{"type":"v1","addr":"172.21.15.106:6801","nonce":47113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":47113},{"type":"v1","addr":"172.21.15.106:6803","nonce":47113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":47113},{"type":"v1","addr":"172.21.15.106:6808","nonce":47113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":47113},{"type":"v1","addr":"172.21.15.106:6805","nonce":47113}]},"public_addr":"172.21.15.106:6801/47113","cluster_addr":"172.21.15.106:6803/47113","heartbeat_back_addr":"172.21.15.106:6808/47113","heartbeat_front_addr":"172.21.15.106:6805/47113","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.232670+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.277753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.050087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.349312+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.344080+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.348781+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.352539+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.275013+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T21:10:32.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.057+0000 7fafedbff700 1 -- 172.21.15.80:0/1045807409 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fafd406acc0 msgr2=0x7fafd406d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:32.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.057+0000 7fafedbff700 1 --2- 172.21.15.80:0/1045807409 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fafd406acc0 0x7fafd406d180 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fafd8000c00 tx=0x7fafd8007000 comp rx=0 tx=0).stop 2024-05-08T21:10:32.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.057+0000 7fafedbff700 1 -- 172.21.15.80:0/1045807409 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fafe806d050 msgr2=0x7fafe80ccf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:32.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.057+0000 7fafedbff700 1 --2- 172.21.15.80:0/1045807409 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fafe806d050 0x7fafe80ccf90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fafe8072ac0 tx=0x7fafe000d150 comp rx=0 tx=0).stop 2024-05-08T21:10:32.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.057+0000 7fafedbff700 1 -- 172.21.15.80:0/1045807409 shutdown_connections 2024-05-08T21:10:32.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.057+0000 7fafedbff700 1 --2- 172.21.15.80:0/1045807409 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fafd406acc0 0x7fafd406d180 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:32.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.057+0000 7fafedbff700 1 --2- 172.21.15.80:0/1045807409 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fafe806d050 0x7fafe80ccf90 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:32.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.057+0000 7fafedbff700 1 --2- 172.21.15.80:0/1045807409 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fafd0003a00 0x7fafe814b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:32.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.057+0000 7fafedbff700 1 --2- 172.21.15.80:0/1045807409 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fafe806c5c0 0x7fafe806cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:32.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.057+0000 7fafedbff700 1 -- 172.21.15.80:0/1045807409 >> 172.21.15.80:0/1045807409 conn(0x7fafe8066780 msgr2=0x7fafe8158710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:32.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.057+0000 7fafedbff700 1 -- 172.21.15.80:0/1045807409 shutdown_connections 2024-05-08T21:10:32.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.057+0000 7fafedbff700 1 -- 172.21.15.80:0/1045807409 wait complete. 2024-05-08T21:10:32.072 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-05-08T21:10:32.073 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T21:10:32.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.191+0000 7fd8b9b28700 1 Processor -- start 2024-05-08T21:10:32.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.191+0000 7fd8b9b28700 1 -- start start 2024-05-08T21:10:32.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.192+0000 7fd8b9b28700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd8b406ac30 0x7fd8b4158600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:32.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.192+0000 7fd8b9b28700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8b40c6100 con 0x7fd8b406b010 2024-05-08T21:10:32.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.192+0000 7fd8b9b28700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8b40c6350 con 0x7fd8b41523a0 2024-05-08T21:10:32.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.192+0000 7fd8b9b28700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8b40c6ed0 con 0x7fd8b406ac30 2024-05-08T21:10:32.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.192+0000 7fd8b37fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd8b406ac30 0x7fd8b4158600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:32.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.192+0000 7fd8b2ffd700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd8b406b010 0x7fd8b4151c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:56140/0 (socket says 172.21.15.80:56140) 2024-05-08T21:10:32.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.192+0000 7fd8b2ffd700 1 -- 172.21.15.80:0/3368019416 learned_addr learned my addr 172.21.15.80:0/3368019416 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:10:32.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.192+0000 7fd8b37fe700 1 -- 172.21.15.80:0/3368019416 >> v1:172.21.15.106:6789/0 conn(0x7fd8b41523a0 legacy=0x7fd8b40c9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:32.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.192+0000 7fd8b37fe700 1 -- 172.21.15.80:0/3368019416 >> v1:172.21.15.80:6789/0 conn(0x7fd8b406b010 legacy=0x7fd8b4151c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:32.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.192+0000 7fd8b37fe700 1 -- 172.21.15.80:0/3368019416 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b40c6630 con 0x7fd8b406ac30 2024-05-08T21:10:32.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.192+0000 7fd8b37fe700 1 --2- 172.21.15.80:0/3368019416 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd8b406ac30 0x7fd8b4158600 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd8a4009840 tx=0x7fd8a4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b22cb0e05f7ee2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:32.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.192+0000 7fd8b27fc700 1 -- 172.21.15.80:0/3368019416 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a4004230 con 0x7fd8b406ac30 2024-05-08T21:10:32.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.192+0000 7fd8b27fc700 1 -- 172.21.15.80:0/3368019416 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8a4004390 con 0x7fd8b406ac30 2024-05-08T21:10:32.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.192+0000 7fd8b27fc700 1 -- 172.21.15.80:0/3368019416 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a40036a0 con 0x7fd8b406ac30 2024-05-08T21:10:32.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.193+0000 7fd8b9b28700 1 -- 172.21.15.80:0/3368019416 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd8b406ac30 msgr2=0x7fd8b4158600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:32.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.193+0000 7fd8b9b28700 1 --2- 172.21.15.80:0/3368019416 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd8b406ac30 0x7fd8b4158600 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd8a4009840 tx=0x7fd8a4009b50 comp rx=0 tx=0).stop 2024-05-08T21:10:32.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.193+0000 7fd8b9b28700 1 -- 172.21.15.80:0/3368019416 shutdown_connections 2024-05-08T21:10:32.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.193+0000 7fd8b9b28700 1 --2- 172.21.15.80:0/3368019416 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd8b406ac30 0x7fd8b4158600 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:32.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.193+0000 7fd8b9b28700 1 -- 172.21.15.80:0/3368019416 >> 172.21.15.80:0/3368019416 conn(0x7fd8b406f140 msgr2=0x7fd8b406f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:32.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.193+0000 7fd8b9b28700 1 -- 172.21.15.80:0/3368019416 shutdown_connections 2024-05-08T21:10:32.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.193+0000 7fd8b9b28700 1 -- 172.21.15.80:0/3368019416 wait complete. 2024-05-08T21:10:32.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.194+0000 7fd8b9b28700 1 Processor -- start 2024-05-08T21:10:32.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.194+0000 7fd8b9b28700 1 -- start start 2024-05-08T21:10:32.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.195+0000 7fd8b9b28700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd8b406ac30 0x7fd8b41590b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:32.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.195+0000 7fd8b9b28700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd8b406b010 0x7fd8b4141210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:32.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.195+0000 7fd8b9b28700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd8b41523a0 0x7fd8b4141750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:32.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.195+0000 7fd8b9b28700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b40cc890 con 0x7fd8b406b010 2024-05-08T21:10:32.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.195+0000 7fd8b9b28700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b40ccb00 con 0x7fd8b41523a0 2024-05-08T21:10:32.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.195+0000 7fd8b9b28700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b40ccde0 con 0x7fd8b406ac30 2024-05-08T21:10:32.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.195+0000 7fd8b2ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd8b406b010 0x7fd8b4141210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:32.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.195+0000 7fd8b2ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd8b406b010 0x7fd8b4141210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52820/0 (socket says 172.21.15.80:52820) 2024-05-08T21:10:32.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.195+0000 7fd8b2ffd700 1 -- 172.21.15.80:0/922890616 learned_addr learned my addr 172.21.15.80:0/922890616 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:32.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.195+0000 7fd8b37fe700 1 --2- 172.21.15.80:0/922890616 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd8b406ac30 0x7fd8b41590b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:32.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.195+0000 7fd8b3fff700 1 --2- 172.21.15.80:0/922890616 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd8b41523a0 0x7fd8b4141750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:32.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.195+0000 7fd8b2ffd700 1 -- 172.21.15.80:0/922890616 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd8b406ac30 msgr2=0x7fd8b41590b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:32.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.195+0000 7fd8b2ffd700 1 --2- 172.21.15.80:0/922890616 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd8b406ac30 0x7fd8b41590b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:32.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.195+0000 7fd8b2ffd700 1 -- 172.21.15.80:0/922890616 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd8b41523a0 msgr2=0x7fd8b4141750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:32.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.195+0000 7fd8b2ffd700 1 --2- 172.21.15.80:0/922890616 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd8b41523a0 0x7fd8b4141750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:32.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.195+0000 7fd8b2ffd700 1 -- 172.21.15.80:0/922890616 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8a40094a0 con 0x7fd8b406b010 2024-05-08T21:10:32.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.196+0000 7fd8b2ffd700 1 --2- 172.21.15.80:0/922890616 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd8b406b010 0x7fd8b4141210 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd8a800c490 tx=0x7fd8a800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:32.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.196+0000 7fd89bfff700 1 -- 172.21.15.80:0/922890616 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a8005d70 con 0x7fd8b406b010 2024-05-08T21:10:32.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.196+0000 7fd89bfff700 1 -- 172.21.15.80:0/922890616 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8a80070d0 con 0x7fd8b406b010 2024-05-08T21:10:32.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.196+0000 7fd8b9b28700 1 -- 172.21.15.80:0/922890616 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8b40cd0c0 con 0x7fd8b406b010 2024-05-08T21:10:32.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.196+0000 7fd89bfff700 1 -- 172.21.15.80:0/922890616 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a8007460 con 0x7fd8b406b010 2024-05-08T21:10:32.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.196+0000 7fd8b9b28700 1 -- 172.21.15.80:0/922890616 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8b40cd680 con 0x7fd8b406b010 2024-05-08T21:10:32.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.197+0000 7fd8b9b28700 1 -- 172.21.15.80:0/922890616 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8b41434f0 con 0x7fd8b406b010 2024-05-08T21:10:32.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.197+0000 7fd89bfff700 1 -- 172.21.15.80:0/922890616 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd8a80075c0 con 0x7fd8b406b010 2024-05-08T21:10:32.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.197+0000 7fd89bfff700 1 --2- 172.21.15.80:0/922890616 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fd8a006ac90 0x7fd8a006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:32.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.198+0000 7fd89bfff700 1 -- 172.21.15.80:0/922890616 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd8a8088bb0 con 0x7fd8b406b010 2024-05-08T21:10:32.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.198+0000 7fd8b37fe700 1 --2- 172.21.15.80:0/922890616 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fd8a006ac90 0x7fd8a006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:32.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.198+0000 7fd8b37fe700 1 --2- 172.21.15.80:0/922890616 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fd8a006ac90 0x7fd8a006d150 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd8a40090b0 tx=0x7fd8a4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:32.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.202+0000 7fd89bfff700 1 -- 172.21.15.80:0/922890616 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fd8a8053a10 con 0x7fd8b406b010 2024-05-08T21:10:32.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.398+0000 7fd8b9b28700 1 -- 172.21.15.80:0/922890616 --> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd8b40ccf50 con 0x7fd8a006ac90 2024-05-08T21:10:32.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.408+0000 7fd89bfff700 1 -- 172.21.15.80:0/922890616 <== mgr.4100 v2:172.21.15.80:6832/46731 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345379 (secure 0 0 0) 0x7fd8b40ccf50 con 0x7fd8a006ac90 2024-05-08T21:10:32.416 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:10:32.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.412+0000 7fd8b9b28700 1 -- 172.21.15.80:0/922890616 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fd8a006ac90 msgr2=0x7fd8a006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:32.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.412+0000 7fd8b9b28700 1 --2- 172.21.15.80:0/922890616 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fd8a006ac90 0x7fd8a006d150 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd8a40090b0 tx=0x7fd8a4008030 comp rx=0 tx=0).stop 2024-05-08T21:10:32.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.412+0000 7fd8b9b28700 1 -- 172.21.15.80:0/922890616 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd8b406b010 msgr2=0x7fd8b4141210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:32.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.412+0000 7fd8b9b28700 1 --2- 172.21.15.80:0/922890616 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd8b406b010 0x7fd8b4141210 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd8a800c490 tx=0x7fd8a800c850 comp rx=0 tx=0).stop 2024-05-08T21:10:32.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.412+0000 7fd8b9b28700 1 -- 172.21.15.80:0/922890616 shutdown_connections 2024-05-08T21:10:32.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.412+0000 7fd8b9b28700 1 --2- 172.21.15.80:0/922890616 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fd8a006ac90 0x7fd8a006d150 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:32.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.412+0000 7fd8b9b28700 1 --2- 172.21.15.80:0/922890616 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd8b41523a0 0x7fd8b4141750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:32.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.412+0000 7fd8b9b28700 1 --2- 172.21.15.80:0/922890616 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd8b406ac30 0x7fd8b41590b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:32.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.412+0000 7fd8b9b28700 1 --2- 172.21.15.80:0/922890616 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd8b406b010 0x7fd8b4141210 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:32.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.412+0000 7fd8b9b28700 1 -- 172.21.15.80:0/922890616 >> 172.21.15.80:0/922890616 conn(0x7fd8b406f140 msgr2=0x7fd8b414c360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:32.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.412+0000 7fd8b9b28700 1 -- 172.21.15.80:0/922890616 shutdown_connections 2024-05-08T21:10:32.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.412+0000 7fd8b9b28700 1 -- 172.21.15.80:0/922890616 wait complete. 2024-05-08T21:10:32.420 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-05-08T21:10:32.427 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2024-05-08T21:10:32.204713+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594962,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218452,"kb_used_data":2304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756268,"statfs":{"total":773094113280,"available":772870418432,"internally_reserved":0,"allocated":2359296,"data_stored":2039860,"data_compressed":64612,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003510"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.048091+0000","last_change":"2024-05-08T21:10:03.747477+0000","last_active":"2024-05-08T21:10:08.048091+0000","last_peered":"2024-05-08T21:10:08.048091+0000","last_clean":"2024-05-08T21:10:08.048091+0000","last_became_active":"2024-05-08T21:10:03.747059+0000","last_became_peered":"2024-05-08T21:10:03.747059+0000","last_unstale":"2024-05-08T21:10:08.048091+0000","last_undegraded":"2024-05-08T21:10:08.048091+0000","last_fullsized":"2024-05-08T21:10:08.048091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:15:24.340135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.187600+0000","last_change":"2024-05-08T21:10:03.738974+0000","last_active":"2024-05-08T21:10:08.187600+0000","last_peered":"2024-05-08T21:10:08.187600+0000","last_clean":"2024-05-08T21:10:08.187600+0000","last_became_active":"2024-05-08T21:10:03.738466+0000","last_became_peered":"2024-05-08T21:10:03.738466+0000","last_unstale":"2024-05-08T21:10:08.187600+0000","last_undegraded":"2024-05-08T21:10:08.187600+0000","last_fullsized":"2024-05-08T21:10:08.187600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:59.683039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.753636+0000","last_change":"2024-05-08T21:10:03.740146+0000","last_active":"2024-05-08T21:10:07.753636+0000","last_peered":"2024-05-08T21:10:07.753636+0000","last_clean":"2024-05-08T21:10:07.753636+0000","last_became_active":"2024-05-08T21:10:03.739884+0000","last_became_peered":"2024-05-08T21:10:03.739884+0000","last_unstale":"2024-05-08T21:10:07.753636+0000","last_undegraded":"2024-05-08T21:10:07.753636+0000","last_fullsized":"2024-05-08T21:10:07.753636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:51:44.301305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.168400+0000","last_change":"2024-05-08T21:10:03.754159+0000","last_active":"2024-05-08T21:10:08.168400+0000","last_peered":"2024-05-08T21:10:08.168400+0000","last_clean":"2024-05-08T21:10:08.168400+0000","last_became_active":"2024-05-08T21:10:03.753800+0000","last_became_peered":"2024-05-08T21:10:03.753800+0000","last_unstale":"2024-05-08T21:10:08.168400+0000","last_undegraded":"2024-05-08T21:10:08.168400+0000","last_fullsized":"2024-05-08T21:10:08.168400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:41:02.625080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046322+0000","last_change":"2024-05-08T21:10:03.750051+0000","last_active":"2024-05-08T21:10:08.046322+0000","last_peered":"2024-05-08T21:10:08.046322+0000","last_clean":"2024-05-08T21:10:08.046322+0000","last_became_active":"2024-05-08T21:10:03.749730+0000","last_became_peered":"2024-05-08T21:10:03.749730+0000","last_unstale":"2024-05-08T21:10:08.046322+0000","last_undegraded":"2024-05-08T21:10:08.046322+0000","last_fullsized":"2024-05-08T21:10:08.046322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:49.402253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.168597+0000","last_change":"2024-05-08T21:10:03.746043+0000","last_active":"2024-05-08T21:10:08.168597+0000","last_peered":"2024-05-08T21:10:08.168597+0000","last_clean":"2024-05-08T21:10:08.168597+0000","last_became_active":"2024-05-08T21:10:03.745747+0000","last_became_peered":"2024-05-08T21:10:03.745747+0000","last_unstale":"2024-05-08T21:10:08.168597+0000","last_undegraded":"2024-05-08T21:10:08.168597+0000","last_fullsized":"2024-05-08T21:10:08.168597+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:05:49.465405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046256+0000","last_change":"2024-05-08T21:10:03.743802+0000","last_active":"2024-05-08T21:10:08.046256+0000","last_peered":"2024-05-08T21:10:08.046256+0000","last_clean":"2024-05-08T21:10:08.046256+0000","last_became_active":"2024-05-08T21:10:03.743349+0000","last_became_peered":"2024-05-08T21:10:03.743349+0000","last_unstale":"2024-05-08T21:10:08.046256+0000","last_undegraded":"2024-05-08T21:10:08.046256+0000","last_fullsized":"2024-05-08T21:10:08.046256+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:08:06.408724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.757451+0000","last_change":"2024-05-08T21:10:03.747558+0000","last_active":"2024-05-08T21:10:07.757451+0000","last_peered":"2024-05-08T21:10:07.757451+0000","last_clean":"2024-05-08T21:10:07.757451+0000","last_became_active":"2024-05-08T21:10:03.747300+0000","last_became_peered":"2024-05-08T21:10:03.747300+0000","last_unstale":"2024-05-08T21:10:07.757451+0000","last_undegraded":"2024-05-08T21:10:07.757451+0000","last_fullsized":"2024-05-08T21:10:07.757451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:07:50.266894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046942+0000","last_change":"2024-05-08T21:10:03.748221+0000","last_active":"2024-05-08T21:10:08.046942+0000","last_peered":"2024-05-08T21:10:08.046942+0000","last_clean":"2024-05-08T21:10:08.046942+0000","last_became_active":"2024-05-08T21:10:03.747956+0000","last_became_peered":"2024-05-08T21:10:03.747956+0000","last_unstale":"2024-05-08T21:10:08.046942+0000","last_undegraded":"2024-05-08T21:10:08.046942+0000","last_fullsized":"2024-05-08T21:10:08.046942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:27:35.947884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.271333+0000","last_change":"2024-05-08T21:10:03.745291+0000","last_active":"2024-05-08T21:10:08.271333+0000","last_peered":"2024-05-08T21:10:08.271333+0000","last_clean":"2024-05-08T21:10:08.271333+0000","last_became_active":"2024-05-08T21:10:03.744976+0000","last_became_peered":"2024-05-08T21:10:03.744976+0000","last_unstale":"2024-05-08T21:10:08.271333+0000","last_undegraded":"2024-05-08T21:10:08.271333+0000","last_fullsized":"2024-05-08T21:10:08.271333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:36:54.983642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.271323+0000","last_change":"2024-05-08T21:10:03.748518+0000","last_active":"2024-05-08T21:10:08.271323+0000","last_peered":"2024-05-08T21:10:08.271323+0000","last_clean":"2024-05-08T21:10:08.271323+0000","last_became_active":"2024-05-08T21:10:03.748253+0000","last_became_peered":"2024-05-08T21:10:03.748253+0000","last_unstale":"2024-05-08T21:10:08.271323+0000","last_undegraded":"2024-05-08T21:10:08.271323+0000","last_fullsized":"2024-05-08T21:10:08.271323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:03:26.013122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.170038+0000","last_change":"2024-05-08T21:10:03.745985+0000","last_active":"2024-05-08T21:10:08.170038+0000","last_peered":"2024-05-08T21:10:08.170038+0000","last_clean":"2024-05-08T21:10:08.170038+0000","last_became_active":"2024-05-08T21:10:03.745247+0000","last_became_peered":"2024-05-08T21:10:03.745247+0000","last_unstale":"2024-05-08T21:10:08.170038+0000","last_undegraded":"2024-05-08T21:10:08.170038+0000","last_fullsized":"2024-05-08T21:10:08.170038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:59:42.506304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.761196+0000","last_change":"2024-05-08T21:10:03.747016+0000","last_active":"2024-05-08T21:10:07.761196+0000","last_peered":"2024-05-08T21:10:07.761196+0000","last_clean":"2024-05-08T21:10:07.761196+0000","last_became_active":"2024-05-08T21:10:03.746848+0000","last_became_peered":"2024-05-08T21:10:03.746848+0000","last_unstale":"2024-05-08T21:10:07.761196+0000","last_undegraded":"2024-05-08T21:10:07.761196+0000","last_fullsized":"2024-05-08T21:10:07.761196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:41:21.081035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.753493+0000","last_change":"2024-05-08T21:10:03.737984+0000","last_active":"2024-05-08T21:10:07.753493+0000","last_peered":"2024-05-08T21:10:07.753493+0000","last_clean":"2024-05-08T21:10:07.753493+0000","last_became_active":"2024-05-08T21:10:03.737716+0000","last_became_peered":"2024-05-08T21:10:03.737716+0000","last_unstale":"2024-05-08T21:10:07.753493+0000","last_undegraded":"2024-05-08T21:10:07.753493+0000","last_fullsized":"2024-05-08T21:10:07.753493+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:09:47.758272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.186816+0000","last_change":"2024-05-08T21:10:03.744543+0000","last_active":"2024-05-08T21:10:08.186816+0000","last_peered":"2024-05-08T21:10:08.186816+0000","last_clean":"2024-05-08T21:10:08.186816+0000","last_became_active":"2024-05-08T21:10:03.744276+0000","last_became_peered":"2024-05-08T21:10:03.744276+0000","last_unstale":"2024-05-08T21:10:08.186816+0000","last_undegraded":"2024-05-08T21:10:08.186816+0000","last_fullsized":"2024-05-08T21:10:08.186816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:25:04.113297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.167751+0000","last_change":"2024-05-08T21:10:03.746547+0000","last_active":"2024-05-08T21:10:08.167751+0000","last_peered":"2024-05-08T21:10:08.167751+0000","last_clean":"2024-05-08T21:10:08.167751+0000","last_became_active":"2024-05-08T21:10:03.745862+0000","last_became_peered":"2024-05-08T21:10:03.745862+0000","last_unstale":"2024-05-08T21:10:08.167751+0000","last_undegraded":"2024-05-08T21:10:08.167751+0000","last_fullsized":"2024-05-08T21:10:08.167751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:12.776310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169108+0000","last_change":"2024-05-08T21:10:03.754230+0000","last_active":"2024-05-08T21:10:08.169108+0000","last_peered":"2024-05-08T21:10:08.169108+0000","last_clean":"2024-05-08T21:10:08.169108+0000","last_became_active":"2024-05-08T21:10:03.753895+0000","last_became_peered":"2024-05-08T21:10:03.753895+0000","last_unstale":"2024-05-08T21:10:08.169108+0000","last_undegraded":"2024-05-08T21:10:08.169108+0000","last_fullsized":"2024-05-08T21:10:08.169108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:41:47.214215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.751781+0000","last_change":"2024-05-08T21:10:03.743889+0000","last_active":"2024-05-08T21:10:07.751781+0000","last_peered":"2024-05-08T21:10:07.751781+0000","last_clean":"2024-05-08T21:10:07.751781+0000","last_became_active":"2024-05-08T21:10:03.743596+0000","last_became_peered":"2024-05-08T21:10:03.743596+0000","last_unstale":"2024-05-08T21:10:07.751781+0000","last_undegraded":"2024-05-08T21:10:07.751781+0000","last_fullsized":"2024-05-08T21:10:07.751781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:53.981781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046658+0000","last_change":"2024-05-08T21:10:03.743893+0000","last_active":"2024-05-08T21:10:08.046658+0000","last_peered":"2024-05-08T21:10:08.046658+0000","last_clean":"2024-05-08T21:10:08.046658+0000","last_became_active":"2024-05-08T21:10:03.743580+0000","last_became_peered":"2024-05-08T21:10:03.743580+0000","last_unstale":"2024-05-08T21:10:08.046658+0000","last_undegraded":"2024-05-08T21:10:08.046658+0000","last_fullsized":"2024-05-08T21:10:08.046658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:44:21.747625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.059425+0000","last_change":"2024-05-08T21:10:08.052394+0000","last_active":"2024-05-08T21:10:08.059425+0000","last_peered":"2024-05-08T21:10:08.059425+0000","last_clean":"2024-05-08T21:10:08.059425+0000","last_became_active":"2024-05-08T21:10:08.052009+0000","last_became_peered":"2024-05-08T21:10:08.052009+0000","last_unstale":"2024-05-08T21:10:08.059425+0000","last_undegraded":"2024-05-08T21:10:08.059425+0000","last_fullsized":"2024-05-08T21:10:08.059425+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:47:20.148683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"25'4","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.741230+0000","last_change":"2024-05-08T21:10:03.340118+0000","last_active":"2024-05-08T21:10:08.741230+0000","last_peered":"2024-05-08T21:10:08.741230+0000","last_clean":"2024-05-08T21:10:08.741230+0000","last_became_active":"2024-05-08T21:10:03.339847+0000","last_became_peered":"2024-05-08T21:10:03.339847+0000","last_unstale":"2024-05-08T21:10:08.741230+0000","last_undegraded":"2024-05-08T21:10:08.741230+0000","last_fullsized":"2024-05-08T21:10:08.741230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:05:56.369631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.768418+0000","last_change":"2024-05-08T21:10:03.746516+0000","last_active":"2024-05-08T21:10:07.768418+0000","last_peered":"2024-05-08T21:10:07.768418+0000","last_clean":"2024-05-08T21:10:07.768418+0000","last_became_active":"2024-05-08T21:10:03.746383+0000","last_became_peered":"2024-05-08T21:10:03.746383+0000","last_unstale":"2024-05-08T21:10:07.768418+0000","last_undegraded":"2024-05-08T21:10:07.768418+0000","last_fullsized":"2024-05-08T21:10:07.768418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:29:05.305134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169483+0000","last_change":"2024-05-08T21:10:07.766498+0000","last_active":"2024-05-08T21:10:08.169483+0000","last_peered":"2024-05-08T21:10:08.169483+0000","last_clean":"2024-05-08T21:10:08.169483+0000","last_became_active":"2024-05-08T21:10:07.766119+0000","last_became_peered":"2024-05-08T21:10:07.766119+0000","last_unstale":"2024-05-08T21:10:08.169483+0000","last_undegraded":"2024-05-08T21:10:08.169483+0000","last_fullsized":"2024-05-08T21:10:08.169483+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:58:38.720848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"26'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.508429+0000","last_change":"2024-05-08T21:10:03.329414+0000","last_active":"2024-05-08T21:10:08.508429+0000","last_peered":"2024-05-08T21:10:08.508429+0000","last_clean":"2024-05-08T21:10:08.508429+0000","last_became_active":"2024-05-08T21:10:03.328970+0000","last_became_peered":"2024-05-08T21:10:03.328970+0000","last_unstale":"2024-05-08T21:10:08.508429+0000","last_undegraded":"2024-05-08T21:10:08.508429+0000","last_fullsized":"2024-05-08T21:10:08.508429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:34:32.820755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.753820+0000","last_change":"2024-05-08T21:10:03.748566+0000","last_active":"2024-05-08T21:10:07.753820+0000","last_peered":"2024-05-08T21:10:07.753820+0000","last_clean":"2024-05-08T21:10:07.753820+0000","last_became_active":"2024-05-08T21:10:03.747989+0000","last_became_peered":"2024-05-08T21:10:03.747989+0000","last_unstale":"2024-05-08T21:10:07.753820+0000","last_undegraded":"2024-05-08T21:10:07.753820+0000","last_fullsized":"2024-05-08T21:10:07.753820+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:19:03.468394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169607+0000","last_change":"2024-05-08T21:10:07.770390+0000","last_active":"2024-05-08T21:10:08.169607+0000","last_peered":"2024-05-08T21:10:08.169607+0000","last_clean":"2024-05-08T21:10:08.169607+0000","last_became_active":"2024-05-08T21:10:07.770017+0000","last_became_peered":"2024-05-08T21:10:07.770017+0000","last_unstale":"2024-05-08T21:10:08.169607+0000","last_undegraded":"2024-05-08T21:10:08.169607+0000","last_fullsized":"2024-05-08T21:10:08.169607+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:12:00.200848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.738243+0000","last_change":"2024-05-08T21:10:03.339207+0000","last_active":"2024-05-08T21:10:08.738243+0000","last_peered":"2024-05-08T21:10:08.738243+0000","last_clean":"2024-05-08T21:10:08.738243+0000","last_became_active":"2024-05-08T21:10:03.338917+0000","last_became_peered":"2024-05-08T21:10:03.338917+0000","last_unstale":"2024-05-08T21:10:08.738243+0000","last_undegraded":"2024-05-08T21:10:08.738243+0000","last_fullsized":"2024-05-08T21:10:08.738243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:20.676853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.168481+0000","last_change":"2024-05-08T21:10:03.753998+0000","last_active":"2024-05-08T21:10:08.168481+0000","last_peered":"2024-05-08T21:10:08.168481+0000","last_clean":"2024-05-08T21:10:08.168481+0000","last_became_active":"2024-05-08T21:10:03.753720+0000","last_became_peered":"2024-05-08T21:10:03.753720+0000","last_unstale":"2024-05-08T21:10:08.168481+0000","last_undegraded":"2024-05-08T21:10:08.168481+0000","last_fullsized":"2024-05-08T21:10:08.168481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:00:38.531282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169599+0000","last_change":"2024-05-08T21:10:07.776367+0000","last_active":"2024-05-08T21:10:08.169599+0000","last_peered":"2024-05-08T21:10:08.169599+0000","last_clean":"2024-05-08T21:10:08.169599+0000","last_became_active":"2024-05-08T21:10:07.775998+0000","last_became_peered":"2024-05-08T21:10:07.775998+0000","last_unstale":"2024-05-08T21:10:08.169599+0000","last_undegraded":"2024-05-08T21:10:08.169599+0000","last_fullsized":"2024-05-08T21:10:08.169599+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:24:18.845560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.740209+0000","last_change":"2024-05-08T21:10:03.339182+0000","last_active":"2024-05-08T21:10:08.740209+0000","last_peered":"2024-05-08T21:10:08.740209+0000","last_clean":"2024-05-08T21:10:08.740209+0000","last_became_active":"2024-05-08T21:10:03.338899+0000","last_became_peered":"2024-05-08T21:10:03.338899+0000","last_unstale":"2024-05-08T21:10:08.740209+0000","last_undegraded":"2024-05-08T21:10:08.740209+0000","last_fullsized":"2024-05-08T21:10:08.740209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:55:53.368546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.168672+0000","last_change":"2024-05-08T21:10:03.750724+0000","last_active":"2024-05-08T21:10:08.168672+0000","last_peered":"2024-05-08T21:10:08.168672+0000","last_clean":"2024-05-08T21:10:08.168672+0000","last_became_active":"2024-05-08T21:10:03.750371+0000","last_became_peered":"2024-05-08T21:10:03.750371+0000","last_unstale":"2024-05-08T21:10:08.168672+0000","last_undegraded":"2024-05-08T21:10:08.168672+0000","last_fullsized":"2024-05-08T21:10:08.168672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:14:01.935211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.775704+0000","last_change":"2024-05-08T21:10:07.767604+0000","last_active":"2024-05-08T21:10:07.775704+0000","last_peered":"2024-05-08T21:10:07.775704+0000","last_clean":"2024-05-08T21:10:07.775704+0000","last_became_active":"2024-05-08T21:10:07.767234+0000","last_became_peered":"2024-05-08T21:10:07.767234+0000","last_unstale":"2024-05-08T21:10:07.775704+0000","last_undegraded":"2024-05-08T21:10:07.775704+0000","last_fullsized":"2024-05-08T21:10:07.775704+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:30:21.411491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"26'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.508102+0000","last_change":"2024-05-08T21:10:03.338149+0000","last_active":"2024-05-08T21:10:08.508102+0000","last_peered":"2024-05-08T21:10:08.508102+0000","last_clean":"2024-05-08T21:10:08.508102+0000","last_became_active":"2024-05-08T21:10:03.337860+0000","last_became_peered":"2024-05-08T21:10:03.337860+0000","last_unstale":"2024-05-08T21:10:08.508102+0000","last_undegraded":"2024-05-08T21:10:08.508102+0000","last_fullsized":"2024-05-08T21:10:08.508102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:07:39.052625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169664+0000","last_change":"2024-05-08T21:10:03.743506+0000","last_active":"2024-05-08T21:10:08.169664+0000","last_peered":"2024-05-08T21:10:08.169664+0000","last_clean":"2024-05-08T21:10:08.169664+0000","last_became_active":"2024-05-08T21:10:03.743227+0000","last_became_peered":"2024-05-08T21:10:03.743227+0000","last_unstale":"2024-05-08T21:10:08.169664+0000","last_undegraded":"2024-05-08T21:10:08.169664+0000","last_fullsized":"2024-05-08T21:10:08.169664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:45:47.977619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.741849+0000","last_change":"2024-05-08T21:10:07.768424+0000","last_active":"2024-05-08T21:10:08.741849+0000","last_peered":"2024-05-08T21:10:08.741849+0000","last_clean":"2024-05-08T21:10:08.741849+0000","last_became_active":"2024-05-08T21:10:07.768160+0000","last_became_peered":"2024-05-08T21:10:07.768160+0000","last_unstale":"2024-05-08T21:10:08.741849+0000","last_undegraded":"2024-05-08T21:10:08.741849+0000","last_fullsized":"2024-05-08T21:10:08.741849+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:42:44.327080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"26'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.606664+0000","last_change":"2024-05-08T21:10:03.333647+0000","last_active":"2024-05-08T21:10:08.606664+0000","last_peered":"2024-05-08T21:10:08.606664+0000","last_clean":"2024-05-08T21:10:08.606664+0000","last_became_active":"2024-05-08T21:10:03.332844+0000","last_became_peered":"2024-05-08T21:10:03.332844+0000","last_unstale":"2024-05-08T21:10:08.606664+0000","last_undegraded":"2024-05-08T21:10:08.606664+0000","last_fullsized":"2024-05-08T21:10:08.606664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:47:40.344808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.753370+0000","last_change":"2024-05-08T21:10:03.743003+0000","last_active":"2024-05-08T21:10:07.753370+0000","last_peered":"2024-05-08T21:10:07.753370+0000","last_clean":"2024-05-08T21:10:07.753370+0000","last_became_active":"2024-05-08T21:10:03.742753+0000","last_became_peered":"2024-05-08T21:10:03.742753+0000","last_unstale":"2024-05-08T21:10:07.753370+0000","last_undegraded":"2024-05-08T21:10:07.753370+0000","last_fullsized":"2024-05-08T21:10:07.753370+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:45:49.575877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.271366+0000","last_change":"2024-05-08T21:10:07.770105+0000","last_active":"2024-05-08T21:10:08.271366+0000","last_peered":"2024-05-08T21:10:08.271366+0000","last_clean":"2024-05-08T21:10:08.271366+0000","last_became_active":"2024-05-08T21:10:07.769668+0000","last_became_peered":"2024-05-08T21:10:07.769668+0000","last_unstale":"2024-05-08T21:10:08.271366+0000","last_undegraded":"2024-05-08T21:10:08.271366+0000","last_fullsized":"2024-05-08T21:10:08.271366+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:07:21.560031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.766792+0000","last_change":"2024-05-08T21:10:03.333025+0000","last_active":"2024-05-08T21:10:07.766792+0000","last_peered":"2024-05-08T21:10:07.766792+0000","last_clean":"2024-05-08T21:10:07.766792+0000","last_became_active":"2024-05-08T21:10:03.332750+0000","last_became_peered":"2024-05-08T21:10:03.332750+0000","last_unstale":"2024-05-08T21:10:07.766792+0000","last_undegraded":"2024-05-08T21:10:07.766792+0000","last_fullsized":"2024-05-08T21:10:07.766792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:20:50.134647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.756963+0000","last_change":"2024-05-08T21:10:03.744023+0000","last_active":"2024-05-08T21:10:07.756963+0000","last_peered":"2024-05-08T21:10:07.756963+0000","last_clean":"2024-05-08T21:10:07.756963+0000","last_became_active":"2024-05-08T21:10:03.743724+0000","last_became_peered":"2024-05-08T21:10:03.743724+0000","last_unstale":"2024-05-08T21:10:07.756963+0000","last_undegraded":"2024-05-08T21:10:07.756963+0000","last_fullsized":"2024-05-08T21:10:07.756963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:50:36.857245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.059558+0000","last_change":"2024-05-08T21:10:08.052307+0000","last_active":"2024-05-08T21:10:08.059558+0000","last_peered":"2024-05-08T21:10:08.059558+0000","last_clean":"2024-05-08T21:10:08.059558+0000","last_became_active":"2024-05-08T21:10:08.051924+0000","last_became_peered":"2024-05-08T21:10:08.051924+0000","last_unstale":"2024-05-08T21:10:08.059558+0000","last_undegraded":"2024-05-08T21:10:08.059558+0000","last_fullsized":"2024-05-08T21:10:08.059558+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:56:37.264246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.750197+0000","last_change":"2024-05-08T21:10:03.330304+0000","last_active":"2024-05-08T21:10:07.750197+0000","last_peered":"2024-05-08T21:10:07.750197+0000","last_clean":"2024-05-08T21:10:07.750197+0000","last_became_active":"2024-05-08T21:10:03.330054+0000","last_became_peered":"2024-05-08T21:10:03.330054+0000","last_unstale":"2024-05-08T21:10:07.750197+0000","last_undegraded":"2024-05-08T21:10:07.750197+0000","last_fullsized":"2024-05-08T21:10:07.750197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:30.518935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.186997+0000","last_change":"2024-05-08T21:10:03.739687+0000","last_active":"2024-05-08T21:10:08.186997+0000","last_peered":"2024-05-08T21:10:08.186997+0000","last_clean":"2024-05-08T21:10:08.186997+0000","last_became_active":"2024-05-08T21:10:03.739425+0000","last_became_peered":"2024-05-08T21:10:03.739425+0000","last_unstale":"2024-05-08T21:10:08.186997+0000","last_undegraded":"2024-05-08T21:10:08.186997+0000","last_fullsized":"2024-05-08T21:10:08.186997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:45:59.295081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.054235+0000","last_change":"2024-05-08T21:10:08.050980+0000","last_active":"2024-05-08T21:10:08.054235+0000","last_peered":"2024-05-08T21:10:08.054235+0000","last_clean":"2024-05-08T21:10:08.054235+0000","last_became_active":"2024-05-08T21:10:08.050625+0000","last_became_peered":"2024-05-08T21:10:08.050625+0000","last_unstale":"2024-05-08T21:10:08.054235+0000","last_undegraded":"2024-05-08T21:10:08.054235+0000","last_fullsized":"2024-05-08T21:10:08.054235+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:39:43.917363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.755963+0000","last_change":"2024-05-08T21:10:03.331297+0000","last_active":"2024-05-08T21:10:07.755963+0000","last_peered":"2024-05-08T21:10:07.755963+0000","last_clean":"2024-05-08T21:10:07.755963+0000","last_became_active":"2024-05-08T21:10:03.330973+0000","last_became_peered":"2024-05-08T21:10:03.330973+0000","last_unstale":"2024-05-08T21:10:07.755963+0000","last_undegraded":"2024-05-08T21:10:07.755963+0000","last_fullsized":"2024-05-08T21:10:07.755963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:57:26.190186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.168346+0000","last_change":"2024-05-08T21:10:03.751746+0000","last_active":"2024-05-08T21:10:08.168346+0000","last_peered":"2024-05-08T21:10:08.168346+0000","last_clean":"2024-05-08T21:10:08.168346+0000","last_became_active":"2024-05-08T21:10:03.751426+0000","last_became_peered":"2024-05-08T21:10:03.751426+0000","last_unstale":"2024-05-08T21:10:08.168346+0000","last_undegraded":"2024-05-08T21:10:08.168346+0000","last_fullsized":"2024-05-08T21:10:08.168346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:00:23.529543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.778416+0000","last_change":"2024-05-08T21:10:07.771834+0000","last_active":"2024-05-08T21:10:07.778416+0000","last_peered":"2024-05-08T21:10:07.778416+0000","last_clean":"2024-05-08T21:10:07.778416+0000","last_became_active":"2024-05-08T21:10:07.771324+0000","last_became_peered":"2024-05-08T21:10:07.771324+0000","last_unstale":"2024-05-08T21:10:07.778416+0000","last_undegraded":"2024-05-08T21:10:07.778416+0000","last_fullsized":"2024-05-08T21:10:07.778416+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:35.948317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.749656+0000","last_change":"2024-05-08T21:10:03.332049+0000","last_active":"2024-05-08T21:10:07.749656+0000","last_peered":"2024-05-08T21:10:07.749656+0000","last_clean":"2024-05-08T21:10:07.749656+0000","last_became_active":"2024-05-08T21:10:03.331712+0000","last_became_peered":"2024-05-08T21:10:03.331712+0000","last_unstale":"2024-05-08T21:10:07.749656+0000","last_undegraded":"2024-05-08T21:10:07.749656+0000","last_fullsized":"2024-05-08T21:10:07.749656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:30:16.135672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.753983+0000","last_change":"2024-05-08T21:10:03.748728+0000","last_active":"2024-05-08T21:10:07.753983+0000","last_peered":"2024-05-08T21:10:07.753983+0000","last_clean":"2024-05-08T21:10:07.753983+0000","last_became_active":"2024-05-08T21:10:03.748315+0000","last_became_peered":"2024-05-08T21:10:03.748315+0000","last_unstale":"2024-05-08T21:10:07.753983+0000","last_undegraded":"2024-05-08T21:10:07.753983+0000","last_fullsized":"2024-05-08T21:10:07.753983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:14:15.224603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.170061+0000","last_change":"2024-05-08T21:10:07.761559+0000","last_active":"2024-05-08T21:10:08.170061+0000","last_peered":"2024-05-08T21:10:08.170061+0000","last_clean":"2024-05-08T21:10:08.170061+0000","last_became_active":"2024-05-08T21:10:07.761129+0000","last_became_peered":"2024-05-08T21:10:07.761129+0000","last_unstale":"2024-05-08T21:10:08.170061+0000","last_undegraded":"2024-05-08T21:10:08.170061+0000","last_fullsized":"2024-05-08T21:10:08.170061+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:29:03.444853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'3","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.737377+0000","last_change":"2024-05-08T21:10:03.333077+0000","last_active":"2024-05-08T21:10:08.737377+0000","last_peered":"2024-05-08T21:10:08.737377+0000","last_clean":"2024-05-08T21:10:08.737377+0000","last_became_active":"2024-05-08T21:10:03.332796+0000","last_became_peered":"2024-05-08T21:10:03.332796+0000","last_unstale":"2024-05-08T21:10:08.737377+0000","last_undegraded":"2024-05-08T21:10:08.737377+0000","last_fullsized":"2024-05-08T21:10:08.737377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:30:16.135672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169929+0000","last_change":"2024-05-08T21:10:03.751370+0000","last_active":"2024-05-08T21:10:08.169929+0000","last_peered":"2024-05-08T21:10:08.169929+0000","last_clean":"2024-05-08T21:10:08.169929+0000","last_became_active":"2024-05-08T21:10:03.750394+0000","last_became_peered":"2024-05-08T21:10:03.750394+0000","last_unstale":"2024-05-08T21:10:08.169929+0000","last_undegraded":"2024-05-08T21:10:08.169929+0000","last_fullsized":"2024-05-08T21:10:08.169929+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:31:06.682543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.187439+0000","last_change":"2024-05-08T21:10:07.764815+0000","last_active":"2024-05-08T21:10:08.187439+0000","last_peered":"2024-05-08T21:10:08.187439+0000","last_clean":"2024-05-08T21:10:08.187439+0000","last_became_active":"2024-05-08T21:10:07.763591+0000","last_became_peered":"2024-05-08T21:10:07.763591+0000","last_unstale":"2024-05-08T21:10:08.187439+0000","last_undegraded":"2024-05-08T21:10:08.187439+0000","last_fullsized":"2024-05-08T21:10:08.187439+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:47.977517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:17.506385+0000","last_change":"2024-05-08T21:10:03.342400+0000","last_active":"2024-05-08T21:10:17.506385+0000","last_peered":"2024-05-08T21:10:17.506385+0000","last_clean":"2024-05-08T21:10:17.506385+0000","last_became_active":"2024-05-08T21:10:03.342202+0000","last_became_peered":"2024-05-08T21:10:03.342202+0000","last_unstale":"2024-05-08T21:10:17.506385+0000","last_undegraded":"2024-05-08T21:10:17.506385+0000","last_fullsized":"2024-05-08T21:10:17.506385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:10:04.668029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3796,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046564+0000","last_change":"2024-05-08T21:10:03.752144+0000","last_active":"2024-05-08T21:10:08.046564+0000","last_peered":"2024-05-08T21:10:08.046564+0000","last_clean":"2024-05-08T21:10:08.046564+0000","last_became_active":"2024-05-08T21:10:03.751868+0000","last_became_peered":"2024-05-08T21:10:03.751868+0000","last_unstale":"2024-05-08T21:10:08.046564+0000","last_undegraded":"2024-05-08T21:10:08.046564+0000","last_fullsized":"2024-05-08T21:10:08.046564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:40:43.168591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.168406+0000","last_change":"2024-05-08T21:10:08.052390+0000","last_active":"2024-05-08T21:10:08.168406+0000","last_peered":"2024-05-08T21:10:08.168406+0000","last_clean":"2024-05-08T21:10:08.168406+0000","last_became_active":"2024-05-08T21:10:08.051967+0000","last_became_peered":"2024-05-08T21:10:08.051967+0000","last_unstale":"2024-05-08T21:10:08.168406+0000","last_undegraded":"2024-05-08T21:10:08.168406+0000","last_fullsized":"2024-05-08T21:10:08.168406+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:40:07.127492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.739991+0000","last_change":"2024-05-08T21:10:03.330102+0000","last_active":"2024-05-08T21:10:08.739991+0000","last_peered":"2024-05-08T21:10:08.739991+0000","last_clean":"2024-05-08T21:10:08.739991+0000","last_became_active":"2024-05-08T21:10:03.329761+0000","last_became_peered":"2024-05-08T21:10:03.329761+0000","last_unstale":"2024-05-08T21:10:08.739991+0000","last_undegraded":"2024-05-08T21:10:08.739991+0000","last_fullsized":"2024-05-08T21:10:08.739991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:37:14.930549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.753579+0000","last_change":"2024-05-08T21:10:03.749332+0000","last_active":"2024-05-08T21:10:07.753579+0000","last_peered":"2024-05-08T21:10:07.753579+0000","last_clean":"2024-05-08T21:10:07.753579+0000","last_became_active":"2024-05-08T21:10:03.749094+0000","last_became_peered":"2024-05-08T21:10:03.749094+0000","last_unstale":"2024-05-08T21:10:07.753579+0000","last_undegraded":"2024-05-08T21:10:07.753579+0000","last_fullsized":"2024-05-08T21:10:07.753579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:25.969085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.048813+0000","last_change":"2024-05-08T21:10:08.048331+0000","last_active":"2024-05-08T21:10:08.048813+0000","last_peered":"2024-05-08T21:10:08.048813+0000","last_clean":"2024-05-08T21:10:08.048813+0000","last_became_active":"2024-05-08T21:10:08.047505+0000","last_became_peered":"2024-05-08T21:10:08.047505+0000","last_unstale":"2024-05-08T21:10:08.048813+0000","last_undegraded":"2024-05-08T21:10:08.048813+0000","last_fullsized":"2024-05-08T21:10:08.048813+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:18:39.268730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.749622+0000","last_change":"2024-05-08T21:10:03.328021+0000","last_active":"2024-05-08T21:10:07.749622+0000","last_peered":"2024-05-08T21:10:07.749622+0000","last_clean":"2024-05-08T21:10:07.749622+0000","last_became_active":"2024-05-08T21:10:03.327648+0000","last_became_peered":"2024-05-08T21:10:03.327648+0000","last_unstale":"2024-05-08T21:10:07.749622+0000","last_undegraded":"2024-05-08T21:10:07.749622+0000","last_fullsized":"2024-05-08T21:10:07.749622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:37:54.491930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046495+0000","last_change":"2024-05-08T21:10:03.750560+0000","last_active":"2024-05-08T21:10:08.046495+0000","last_peered":"2024-05-08T21:10:08.046495+0000","last_clean":"2024-05-08T21:10:08.046495+0000","last_became_active":"2024-05-08T21:10:03.750294+0000","last_became_peered":"2024-05-08T21:10:03.750294+0000","last_unstale":"2024-05-08T21:10:08.046495+0000","last_undegraded":"2024-05-08T21:10:08.046495+0000","last_fullsized":"2024-05-08T21:10:08.046495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:30:47.937326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.059433+0000","last_change":"2024-05-08T21:10:08.052318+0000","last_active":"2024-05-08T21:10:08.059433+0000","last_peered":"2024-05-08T21:10:08.059433+0000","last_clean":"2024-05-08T21:10:08.059433+0000","last_became_active":"2024-05-08T21:10:08.051920+0000","last_became_peered":"2024-05-08T21:10:08.051920+0000","last_unstale":"2024-05-08T21:10:08.059433+0000","last_undegraded":"2024-05-08T21:10:08.059433+0000","last_fullsized":"2024-05-08T21:10:08.059433+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:25:27.669768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.754124+0000","last_change":"2024-05-08T21:10:03.332390+0000","last_active":"2024-05-08T21:10:07.754124+0000","last_peered":"2024-05-08T21:10:07.754124+0000","last_clean":"2024-05-08T21:10:07.754124+0000","last_became_active":"2024-05-08T21:10:03.332105+0000","last_became_peered":"2024-05-08T21:10:03.332105+0000","last_unstale":"2024-05-08T21:10:07.754124+0000","last_undegraded":"2024-05-08T21:10:07.754124+0000","last_fullsized":"2024-05-08T21:10:07.754124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:32:44.705682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.271145+0000","last_change":"2024-05-08T21:10:03.742100+0000","last_active":"2024-05-08T21:10:08.271145+0000","last_peered":"2024-05-08T21:10:08.271145+0000","last_clean":"2024-05-08T21:10:08.271145+0000","last_became_active":"2024-05-08T21:10:03.741742+0000","last_became_peered":"2024-05-08T21:10:03.741742+0000","last_unstale":"2024-05-08T21:10:08.271145+0000","last_undegraded":"2024-05-08T21:10:08.271145+0000","last_fullsized":"2024-05-08T21:10:08.271145+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:53:19.394126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.775032+0000","last_change":"2024-05-08T21:10:07.769850+0000","last_active":"2024-05-08T21:10:07.775032+0000","last_peered":"2024-05-08T21:10:07.775032+0000","last_clean":"2024-05-08T21:10:07.775032+0000","last_became_active":"2024-05-08T21:10:07.769016+0000","last_became_peered":"2024-05-08T21:10:07.769016+0000","last_unstale":"2024-05-08T21:10:07.775032+0000","last_undegraded":"2024-05-08T21:10:07.775032+0000","last_fullsized":"2024-05-08T21:10:07.775032+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:31:52.621418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"25'8","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.741624+0000","last_change":"2024-05-08T21:10:03.331783+0000","last_active":"2024-05-08T21:10:08.741624+0000","last_peered":"2024-05-08T21:10:08.741624+0000","last_clean":"2024-05-08T21:10:08.741624+0000","last_became_active":"2024-05-08T21:10:03.331501+0000","last_became_peered":"2024-05-08T21:10:03.331501+0000","last_unstale":"2024-05-08T21:10:08.741624+0000","last_undegraded":"2024-05-08T21:10:08.741624+0000","last_fullsized":"2024-05-08T21:10:08.741624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:41:28.137295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046481+0000","last_change":"2024-05-08T21:10:03.744007+0000","last_active":"2024-05-08T21:10:08.046481+0000","last_peered":"2024-05-08T21:10:08.046481+0000","last_clean":"2024-05-08T21:10:08.046481+0000","last_became_active":"2024-05-08T21:10:03.743557+0000","last_became_peered":"2024-05-08T21:10:03.743557+0000","last_unstale":"2024-05-08T21:10:08.046481+0000","last_undegraded":"2024-05-08T21:10:08.046481+0000","last_fullsized":"2024-05-08T21:10:08.046481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:45:26.458377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169408+0000","last_change":"2024-05-08T21:10:07.777283+0000","last_active":"2024-05-08T21:10:08.169408+0000","last_peered":"2024-05-08T21:10:08.169408+0000","last_clean":"2024-05-08T21:10:08.169408+0000","last_became_active":"2024-05-08T21:10:07.776858+0000","last_became_peered":"2024-05-08T21:10:07.776858+0000","last_unstale":"2024-05-08T21:10:08.169408+0000","last_undegraded":"2024-05-08T21:10:08.169408+0000","last_fullsized":"2024-05-08T21:10:08.169408+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:51.725885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"26'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.170185+0000","last_change":"2024-05-08T21:10:03.326892+0000","last_active":"2024-05-08T21:10:08.170185+0000","last_peered":"2024-05-08T21:10:08.170185+0000","last_clean":"2024-05-08T21:10:08.170185+0000","last_became_active":"2024-05-08T21:10:03.326608+0000","last_became_peered":"2024-05-08T21:10:03.326608+0000","last_unstale":"2024-05-08T21:10:08.170185+0000","last_undegraded":"2024-05-08T21:10:08.170185+0000","last_fullsized":"2024-05-08T21:10:08.170185+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:33.441985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046649+0000","last_change":"2024-05-08T21:10:03.749221+0000","last_active":"2024-05-08T21:10:08.046649+0000","last_peered":"2024-05-08T21:10:08.046649+0000","last_clean":"2024-05-08T21:10:08.046649+0000","last_became_active":"2024-05-08T21:10:03.748915+0000","last_became_peered":"2024-05-08T21:10:03.748915+0000","last_unstale":"2024-05-08T21:10:08.046649+0000","last_undegraded":"2024-05-08T21:10:08.046649+0000","last_fullsized":"2024-05-08T21:10:08.046649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:03:10.791535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.187371+0000","last_change":"2024-05-08T21:10:07.759492+0000","last_active":"2024-05-08T21:10:08.187371+0000","last_peered":"2024-05-08T21:10:08.187371+0000","last_clean":"2024-05-08T21:10:08.187371+0000","last_became_active":"2024-05-08T21:10:07.759139+0000","last_became_peered":"2024-05-08T21:10:07.759139+0000","last_unstale":"2024-05-08T21:10:08.187371+0000","last_undegraded":"2024-05-08T21:10:08.187371+0000","last_fullsized":"2024-05-08T21:10:08.187371+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:10.579105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.743655+0000","last_change":"2024-05-08T21:10:03.329020+0000","last_active":"2024-05-08T21:10:07.743655+0000","last_peered":"2024-05-08T21:10:07.743655+0000","last_clean":"2024-05-08T21:10:07.743655+0000","last_became_active":"2024-05-08T21:10:03.328739+0000","last_became_peered":"2024-05-08T21:10:03.328739+0000","last_unstale":"2024-05-08T21:10:07.743655+0000","last_undegraded":"2024-05-08T21:10:07.743655+0000","last_fullsized":"2024-05-08T21:10:07.743655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:27:11.168780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.168756+0000","last_change":"2024-05-08T21:10:03.744662+0000","last_active":"2024-05-08T21:10:08.168756+0000","last_peered":"2024-05-08T21:10:08.168756+0000","last_clean":"2024-05-08T21:10:08.168756+0000","last_became_active":"2024-05-08T21:10:03.744398+0000","last_became_peered":"2024-05-08T21:10:03.744398+0000","last_unstale":"2024-05-08T21:10:08.168756+0000","last_undegraded":"2024-05-08T21:10:08.168756+0000","last_fullsized":"2024-05-08T21:10:08.168756+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:05:28.046055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.187253+0000","last_change":"2024-05-08T21:10:07.776566+0000","last_active":"2024-05-08T21:10:08.187253+0000","last_peered":"2024-05-08T21:10:08.187253+0000","last_clean":"2024-05-08T21:10:08.187253+0000","last_became_active":"2024-05-08T21:10:07.776080+0000","last_became_peered":"2024-05-08T21:10:07.776080+0000","last_unstale":"2024-05-08T21:10:08.187253+0000","last_undegraded":"2024-05-08T21:10:08.187253+0000","last_fullsized":"2024-05-08T21:10:08.187253+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:26:09.323466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.749542+0000","last_change":"2024-05-08T21:10:03.332953+0000","last_active":"2024-05-08T21:10:07.749542+0000","last_peered":"2024-05-08T21:10:07.749542+0000","last_clean":"2024-05-08T21:10:07.749542+0000","last_became_active":"2024-05-08T21:10:03.332689+0000","last_became_peered":"2024-05-08T21:10:03.332689+0000","last_unstale":"2024-05-08T21:10:07.749542+0000","last_undegraded":"2024-05-08T21:10:07.749542+0000","last_fullsized":"2024-05-08T21:10:07.749542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:15:32.058369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169816+0000","last_change":"2024-05-08T21:10:03.745651+0000","last_active":"2024-05-08T21:10:08.169816+0000","last_peered":"2024-05-08T21:10:08.169816+0000","last_clean":"2024-05-08T21:10:08.169816+0000","last_became_active":"2024-05-08T21:10:03.742744+0000","last_became_peered":"2024-05-08T21:10:03.742744+0000","last_unstale":"2024-05-08T21:10:08.169816+0000","last_undegraded":"2024-05-08T21:10:08.169816+0000","last_fullsized":"2024-05-08T21:10:08.169816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:32:31.689490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.187096+0000","last_change":"2024-05-08T21:10:07.776527+0000","last_active":"2024-05-08T21:10:08.187096+0000","last_peered":"2024-05-08T21:10:08.187096+0000","last_clean":"2024-05-08T21:10:08.187096+0000","last_became_active":"2024-05-08T21:10:07.776053+0000","last_became_peered":"2024-05-08T21:10:07.776053+0000","last_unstale":"2024-05-08T21:10:08.187096+0000","last_undegraded":"2024-05-08T21:10:08.187096+0000","last_fullsized":"2024-05-08T21:10:08.187096+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:08:26.401358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.186861+0000","last_change":"2024-05-08T21:10:03.738421+0000","last_active":"2024-05-08T21:10:08.186861+0000","last_peered":"2024-05-08T21:10:08.186861+0000","last_clean":"2024-05-08T21:10:08.186861+0000","last_became_active":"2024-05-08T21:10:03.738000+0000","last_became_peered":"2024-05-08T21:10:03.738000+0000","last_unstale":"2024-05-08T21:10:08.186861+0000","last_undegraded":"2024-05-08T21:10:08.186861+0000","last_fullsized":"2024-05-08T21:10:08.186861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:38:05.948755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.751476+0000","last_change":"2024-05-08T21:10:03.331141+0000","last_active":"2024-05-08T21:10:07.751476+0000","last_peered":"2024-05-08T21:10:07.751476+0000","last_clean":"2024-05-08T21:10:07.751476+0000","last_became_active":"2024-05-08T21:10:03.330842+0000","last_became_peered":"2024-05-08T21:10:03.330842+0000","last_unstale":"2024-05-08T21:10:07.751476+0000","last_undegraded":"2024-05-08T21:10:07.751476+0000","last_fullsized":"2024-05-08T21:10:07.751476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:42:52.648932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.271310+0000","last_change":"2024-05-08T21:10:08.049274+0000","last_active":"2024-05-08T21:10:08.271310+0000","last_peered":"2024-05-08T21:10:08.271310+0000","last_clean":"2024-05-08T21:10:08.271310+0000","last_became_active":"2024-05-08T21:10:08.048763+0000","last_became_peered":"2024-05-08T21:10:08.048763+0000","last_unstale":"2024-05-08T21:10:08.271310+0000","last_undegraded":"2024-05-08T21:10:08.271310+0000","last_fullsized":"2024-05-08T21:10:08.271310+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:00:41.257040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.754546+0000","last_change":"2024-05-08T21:10:03.747594+0000","last_active":"2024-05-08T21:10:07.754546+0000","last_peered":"2024-05-08T21:10:07.754546+0000","last_clean":"2024-05-08T21:10:07.754546+0000","last_became_active":"2024-05-08T21:10:03.747360+0000","last_became_peered":"2024-05-08T21:10:03.747360+0000","last_unstale":"2024-05-08T21:10:07.754546+0000","last_undegraded":"2024-05-08T21:10:07.754546+0000","last_fullsized":"2024-05-08T21:10:07.754546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:31:12.357348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.749455+0000","last_change":"2024-05-08T21:10:03.327847+0000","last_active":"2024-05-08T21:10:07.749455+0000","last_peered":"2024-05-08T21:10:07.749455+0000","last_clean":"2024-05-08T21:10:07.749455+0000","last_became_active":"2024-05-08T21:10:03.327530+0000","last_became_peered":"2024-05-08T21:10:03.327530+0000","last_unstale":"2024-05-08T21:10:07.749455+0000","last_undegraded":"2024-05-08T21:10:07.749455+0000","last_fullsized":"2024-05-08T21:10:07.749455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:46.232166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":168,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046147+0000","last_change":"2024-05-08T21:09:59.333990+0000","last_active":"2024-05-08T21:10:08.046147+0000","last_peered":"2024-05-08T21:10:08.046147+0000","last_clean":"2024-05-08T21:10:08.046147+0000","last_became_active":"2024-05-08T21:09:59.332929+0000","last_became_peered":"2024-05-08T21:09:59.332929+0000","last_unstale":"2024-05-08T21:10:08.046147+0000","last_undegraded":"2024-05-08T21:10:08.046147+0000","last_fullsized":"2024-05-08T21:10:08.046147+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:09:58.287675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:09:58.287675+0000","last_clean_scrub_stamp":"2024-05-08T21:09:58.287675+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:47.595380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.052138+0000","last_change":"2024-05-08T21:10:08.049848+0000","last_active":"2024-05-08T21:10:08.052138+0000","last_peered":"2024-05-08T21:10:08.052138+0000","last_clean":"2024-05-08T21:10:08.052138+0000","last_became_active":"2024-05-08T21:10:08.049153+0000","last_became_peered":"2024-05-08T21:10:08.049153+0000","last_unstale":"2024-05-08T21:10:08.052138+0000","last_undegraded":"2024-05-08T21:10:08.052138+0000","last_fullsized":"2024-05-08T21:10:08.052138+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:23.704112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.753311+0000","last_change":"2024-05-08T21:10:03.743094+0000","last_active":"2024-05-08T21:10:07.753311+0000","last_peered":"2024-05-08T21:10:07.753311+0000","last_clean":"2024-05-08T21:10:07.753311+0000","last_became_active":"2024-05-08T21:10:03.742819+0000","last_became_peered":"2024-05-08T21:10:03.742819+0000","last_unstale":"2024-05-08T21:10:07.753311+0000","last_undegraded":"2024-05-08T21:10:07.753311+0000","last_fullsized":"2024-05-08T21:10:07.753311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:41:25.593884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046341+0000","last_change":"2024-05-08T21:10:03.340259+0000","last_active":"2024-05-08T21:10:08.046341+0000","last_peered":"2024-05-08T21:10:08.046341+0000","last_clean":"2024-05-08T21:10:08.046341+0000","last_became_active":"2024-05-08T21:10:03.339957+0000","last_became_peered":"2024-05-08T21:10:03.339957+0000","last_unstale":"2024-05-08T21:10:08.046341+0000","last_undegraded":"2024-05-08T21:10:08.046341+0000","last_fullsized":"2024-05-08T21:10:08.046341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:38:36.535689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.051520+0000","last_change":"2024-05-08T21:10:08.050370+0000","last_active":"2024-05-08T21:10:08.051520+0000","last_peered":"2024-05-08T21:10:08.051520+0000","last_clean":"2024-05-08T21:10:08.051520+0000","last_became_active":"2024-05-08T21:10:08.049962+0000","last_became_peered":"2024-05-08T21:10:08.049962+0000","last_unstale":"2024-05-08T21:10:08.051520+0000","last_undegraded":"2024-05-08T21:10:08.051520+0000","last_fullsized":"2024-05-08T21:10:08.051520+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:11:35.394334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046359+0000","last_change":"2024-05-08T21:10:03.337949+0000","last_active":"2024-05-08T21:10:08.046359+0000","last_peered":"2024-05-08T21:10:08.046359+0000","last_clean":"2024-05-08T21:10:08.046359+0000","last_became_active":"2024-05-08T21:10:03.337627+0000","last_became_peered":"2024-05-08T21:10:03.337627+0000","last_unstale":"2024-05-08T21:10:08.046359+0000","last_undegraded":"2024-05-08T21:10:08.046359+0000","last_fullsized":"2024-05-08T21:10:08.046359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:17:36.792731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.187476+0000","last_change":"2024-05-08T21:10:03.738212+0000","last_active":"2024-05-08T21:10:08.187476+0000","last_peered":"2024-05-08T21:10:08.187476+0000","last_clean":"2024-05-08T21:10:08.187476+0000","last_became_active":"2024-05-08T21:10:03.737927+0000","last_became_peered":"2024-05-08T21:10:03.737927+0000","last_unstale":"2024-05-08T21:10:08.187476+0000","last_undegraded":"2024-05-08T21:10:08.187476+0000","last_fullsized":"2024-05-08T21:10:08.187476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:03:08.031584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.059425+0000","last_change":"2024-05-08T21:10:08.052270+0000","last_active":"2024-05-08T21:10:08.059425+0000","last_peered":"2024-05-08T21:10:08.059425+0000","last_clean":"2024-05-08T21:10:08.059425+0000","last_became_active":"2024-05-08T21:10:08.051881+0000","last_became_peered":"2024-05-08T21:10:08.051881+0000","last_unstale":"2024-05-08T21:10:08.059425+0000","last_undegraded":"2024-05-08T21:10:08.059425+0000","last_fullsized":"2024-05-08T21:10:08.059425+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:39:07.929942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.187471+0000","last_change":"2024-05-08T21:10:03.333696+0000","last_active":"2024-05-08T21:10:08.187471+0000","last_peered":"2024-05-08T21:10:08.187471+0000","last_clean":"2024-05-08T21:10:08.187471+0000","last_became_active":"2024-05-08T21:10:03.333368+0000","last_became_peered":"2024-05-08T21:10:03.333368+0000","last_unstale":"2024-05-08T21:10:08.187471+0000","last_undegraded":"2024-05-08T21:10:08.187471+0000","last_fullsized":"2024-05-08T21:10:08.187471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:00:08.459270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.762624+0000","last_change":"2024-05-08T21:10:03.752578+0000","last_active":"2024-05-08T21:10:07.762624+0000","last_peered":"2024-05-08T21:10:07.762624+0000","last_clean":"2024-05-08T21:10:07.762624+0000","last_became_active":"2024-05-08T21:10:03.752389+0000","last_became_peered":"2024-05-08T21:10:03.752389+0000","last_unstale":"2024-05-08T21:10:07.762624+0000","last_undegraded":"2024-05-08T21:10:07.762624+0000","last_fullsized":"2024-05-08T21:10:07.762624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:54:02.318162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169418+0000","last_change":"2024-05-08T21:10:08.048081+0000","last_active":"2024-05-08T21:10:08.169418+0000","last_peered":"2024-05-08T21:10:08.169418+0000","last_clean":"2024-05-08T21:10:08.169418+0000","last_became_active":"2024-05-08T21:10:08.047632+0000","last_became_peered":"2024-05-08T21:10:08.047632+0000","last_unstale":"2024-05-08T21:10:08.169418+0000","last_undegraded":"2024-05-08T21:10:08.169418+0000","last_fullsized":"2024-05-08T21:10:08.169418+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:26:05.857718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"26'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.738320+0000","last_change":"2024-05-08T21:10:03.340553+0000","last_active":"2024-05-08T21:10:08.738320+0000","last_peered":"2024-05-08T21:10:08.738320+0000","last_clean":"2024-05-08T21:10:08.738320+0000","last_became_active":"2024-05-08T21:10:03.340280+0000","last_became_peered":"2024-05-08T21:10:03.340280+0000","last_unstale":"2024-05-08T21:10:08.738320+0000","last_undegraded":"2024-05-08T21:10:08.738320+0000","last_fullsized":"2024-05-08T21:10:08.738320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:36:24.866220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.754313+0000","last_change":"2024-05-08T21:10:03.736316+0000","last_active":"2024-05-08T21:10:07.754313+0000","last_peered":"2024-05-08T21:10:07.754313+0000","last_clean":"2024-05-08T21:10:07.754313+0000","last_became_active":"2024-05-08T21:10:03.736049+0000","last_became_peered":"2024-05-08T21:10:03.736049+0000","last_unstale":"2024-05-08T21:10:07.754313+0000","last_undegraded":"2024-05-08T21:10:07.754313+0000","last_fullsized":"2024-05-08T21:10:07.754313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:09:48.973609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.170097+0000","last_change":"2024-05-08T21:10:07.777357+0000","last_active":"2024-05-08T21:10:08.170097+0000","last_peered":"2024-05-08T21:10:08.170097+0000","last_clean":"2024-05-08T21:10:08.170097+0000","last_became_active":"2024-05-08T21:10:07.776848+0000","last_became_peered":"2024-05-08T21:10:07.776848+0000","last_unstale":"2024-05-08T21:10:08.170097+0000","last_undegraded":"2024-05-08T21:10:08.170097+0000","last_fullsized":"2024-05-08T21:10:08.170097+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:51:47.727804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046274+0000","last_change":"2024-05-08T21:10:03.340078+0000","last_active":"2024-05-08T21:10:08.046274+0000","last_peered":"2024-05-08T21:10:08.046274+0000","last_clean":"2024-05-08T21:10:08.046274+0000","last_became_active":"2024-05-08T21:10:03.339690+0000","last_became_peered":"2024-05-08T21:10:03.339690+0000","last_unstale":"2024-05-08T21:10:08.046274+0000","last_undegraded":"2024-05-08T21:10:08.046274+0000","last_fullsized":"2024-05-08T21:10:08.046274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:01:33.991878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169765+0000","last_change":"2024-05-08T21:10:03.744606+0000","last_active":"2024-05-08T21:10:08.169765+0000","last_peered":"2024-05-08T21:10:08.169765+0000","last_clean":"2024-05-08T21:10:08.169765+0000","last_became_active":"2024-05-08T21:10:03.744160+0000","last_became_peered":"2024-05-08T21:10:03.744160+0000","last_unstale":"2024-05-08T21:10:08.169765+0000","last_undegraded":"2024-05-08T21:10:08.169765+0000","last_fullsized":"2024-05-08T21:10:08.169765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:10:25.144058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.187244+0000","last_change":"2024-05-08T21:10:08.049224+0000","last_active":"2024-05-08T21:10:08.187244+0000","last_peered":"2024-05-08T21:10:08.187244+0000","last_clean":"2024-05-08T21:10:08.187244+0000","last_became_active":"2024-05-08T21:10:08.048866+0000","last_became_peered":"2024-05-08T21:10:08.048866+0000","last_unstale":"2024-05-08T21:10:08.187244+0000","last_undegraded":"2024-05-08T21:10:08.187244+0000","last_fullsized":"2024-05-08T21:10:08.187244+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:38:20.601167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.743199+0000","last_change":"2024-05-08T21:10:03.339344+0000","last_active":"2024-05-08T21:10:07.743199+0000","last_peered":"2024-05-08T21:10:07.743199+0000","last_clean":"2024-05-08T21:10:07.743199+0000","last_became_active":"2024-05-08T21:10:03.339136+0000","last_became_peered":"2024-05-08T21:10:03.339136+0000","last_unstale":"2024-05-08T21:10:07.743199+0000","last_undegraded":"2024-05-08T21:10:07.743199+0000","last_fullsized":"2024-05-08T21:10:07.743199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:02:55.623727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.757429+0000","last_change":"2024-05-08T21:10:03.737684+0000","last_active":"2024-05-08T21:10:07.757429+0000","last_peered":"2024-05-08T21:10:07.757429+0000","last_clean":"2024-05-08T21:10:07.757429+0000","last_became_active":"2024-05-08T21:10:03.737459+0000","last_became_peered":"2024-05-08T21:10:03.737459+0000","last_unstale":"2024-05-08T21:10:07.757429+0000","last_undegraded":"2024-05-08T21:10:07.757429+0000","last_fullsized":"2024-05-08T21:10:07.757429+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:39.662018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169949+0000","last_change":"2024-05-08T21:10:07.776483+0000","last_active":"2024-05-08T21:10:08.169949+0000","last_peered":"2024-05-08T21:10:08.169949+0000","last_clean":"2024-05-08T21:10:08.169949+0000","last_became_active":"2024-05-08T21:10:07.775956+0000","last_became_peered":"2024-05-08T21:10:07.775956+0000","last_unstale":"2024-05-08T21:10:08.169949+0000","last_undegraded":"2024-05-08T21:10:08.169949+0000","last_fullsized":"2024-05-08T21:10:08.169949+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:28:17.332488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.743317+0000","last_change":"2024-05-08T21:10:03.331695+0000","last_active":"2024-05-08T21:10:07.743317+0000","last_peered":"2024-05-08T21:10:07.743317+0000","last_clean":"2024-05-08T21:10:07.743317+0000","last_became_active":"2024-05-08T21:10:03.331198+0000","last_became_peered":"2024-05-08T21:10:03.331198+0000","last_unstale":"2024-05-08T21:10:07.743317+0000","last_undegraded":"2024-05-08T21:10:07.743317+0000","last_fullsized":"2024-05-08T21:10:07.743317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:37:54.491930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.761445+0000","last_change":"2024-05-08T21:10:03.744562+0000","last_active":"2024-05-08T21:10:07.761445+0000","last_peered":"2024-05-08T21:10:07.761445+0000","last_clean":"2024-05-08T21:10:07.761445+0000","last_became_active":"2024-05-08T21:10:03.744326+0000","last_became_peered":"2024-05-08T21:10:03.744326+0000","last_unstale":"2024-05-08T21:10:07.761445+0000","last_undegraded":"2024-05-08T21:10:07.761445+0000","last_fullsized":"2024-05-08T21:10:07.761445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:21:52.947209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.170163+0000","last_change":"2024-05-08T21:10:07.763204+0000","last_active":"2024-05-08T21:10:08.170163+0000","last_peered":"2024-05-08T21:10:08.170163+0000","last_clean":"2024-05-08T21:10:08.170163+0000","last_became_active":"2024-05-08T21:10:07.762886+0000","last_became_peered":"2024-05-08T21:10:07.762886+0000","last_unstale":"2024-05-08T21:10:08.170163+0000","last_undegraded":"2024-05-08T21:10:08.170163+0000","last_fullsized":"2024-05-08T21:10:08.170163+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:01.599700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.740037+0000","last_change":"2024-05-08T21:10:03.337993+0000","last_active":"2024-05-08T21:10:08.740037+0000","last_peered":"2024-05-08T21:10:08.740037+0000","last_clean":"2024-05-08T21:10:08.740037+0000","last_became_active":"2024-05-08T21:10:03.337654+0000","last_became_peered":"2024-05-08T21:10:03.337654+0000","last_unstale":"2024-05-08T21:10:08.740037+0000","last_undegraded":"2024-05-08T21:10:08.740037+0000","last_fullsized":"2024-05-08T21:10:08.740037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:23:20.536178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.271247+0000","last_change":"2024-05-08T21:10:03.744871+0000","last_active":"2024-05-08T21:10:08.271247+0000","last_peered":"2024-05-08T21:10:08.271247+0000","last_clean":"2024-05-08T21:10:08.271247+0000","last_became_active":"2024-05-08T21:10:03.744589+0000","last_became_peered":"2024-05-08T21:10:03.744589+0000","last_unstale":"2024-05-08T21:10:08.271247+0000","last_undegraded":"2024-05-08T21:10:08.271247+0000","last_fullsized":"2024-05-08T21:10:08.271247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:41.090204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.271212+0000","last_change":"2024-05-08T21:10:08.047735+0000","last_active":"2024-05-08T21:10:08.271212+0000","last_peered":"2024-05-08T21:10:08.271212+0000","last_clean":"2024-05-08T21:10:08.271212+0000","last_became_active":"2024-05-08T21:10:08.047331+0000","last_became_peered":"2024-05-08T21:10:08.047331+0000","last_unstale":"2024-05-08T21:10:08.271212+0000","last_undegraded":"2024-05-08T21:10:08.271212+0000","last_fullsized":"2024-05-08T21:10:08.271212+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:44:22.797154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.751739+0000","last_change":"2024-05-08T21:10:03.333117+0000","last_active":"2024-05-08T21:10:07.751739+0000","last_peered":"2024-05-08T21:10:07.751739+0000","last_clean":"2024-05-08T21:10:07.751739+0000","last_became_active":"2024-05-08T21:10:03.332790+0000","last_became_peered":"2024-05-08T21:10:03.332790+0000","last_unstale":"2024-05-08T21:10:07.751739+0000","last_undegraded":"2024-05-08T21:10:07.751739+0000","last_fullsized":"2024-05-08T21:10:07.751739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:52:36.355804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046458+0000","last_change":"2024-05-08T21:10:03.748047+0000","last_active":"2024-05-08T21:10:08.046458+0000","last_peered":"2024-05-08T21:10:08.046458+0000","last_clean":"2024-05-08T21:10:08.046458+0000","last_became_active":"2024-05-08T21:10:03.747759+0000","last_became_peered":"2024-05-08T21:10:03.747759+0000","last_unstale":"2024-05-08T21:10:08.046458+0000","last_undegraded":"2024-05-08T21:10:08.046458+0000","last_fullsized":"2024-05-08T21:10:08.046458+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:11:05.309278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.775292+0000","last_change":"2024-05-08T21:10:07.761000+0000","last_active":"2024-05-08T21:10:07.775292+0000","last_peered":"2024-05-08T21:10:07.775292+0000","last_clean":"2024-05-08T21:10:07.775292+0000","last_became_active":"2024-05-08T21:10:07.760566+0000","last_became_peered":"2024-05-08T21:10:07.760566+0000","last_unstale":"2024-05-08T21:10:07.775292+0000","last_undegraded":"2024-05-08T21:10:07.775292+0000","last_fullsized":"2024-05-08T21:10:07.775292+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:48:27.435678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"26'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.187152+0000","last_change":"2024-05-08T21:10:03.331358+0000","last_active":"2024-05-08T21:10:08.187152+0000","last_peered":"2024-05-08T21:10:08.187152+0000","last_clean":"2024-05-08T21:10:08.187152+0000","last_became_active":"2024-05-08T21:10:03.331028+0000","last_became_peered":"2024-05-08T21:10:03.331028+0000","last_unstale":"2024-05-08T21:10:08.187152+0000","last_undegraded":"2024-05-08T21:10:08.187152+0000","last_fullsized":"2024-05-08T21:10:08.187152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:18:47.922157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.168527+0000","last_change":"2024-05-08T21:10:03.751285+0000","last_active":"2024-05-08T21:10:08.168527+0000","last_peered":"2024-05-08T21:10:08.168527+0000","last_clean":"2024-05-08T21:10:08.168527+0000","last_became_active":"2024-05-08T21:10:03.746557+0000","last_became_peered":"2024-05-08T21:10:03.746557+0000","last_unstale":"2024-05-08T21:10:08.168527+0000","last_undegraded":"2024-05-08T21:10:08.168527+0000","last_fullsized":"2024-05-08T21:10:08.168527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:50:27.241404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.167816+0000","last_change":"2024-05-08T21:10:08.048830+0000","last_active":"2024-05-08T21:10:08.167816+0000","last_peered":"2024-05-08T21:10:08.167816+0000","last_clean":"2024-05-08T21:10:08.167816+0000","last_became_active":"2024-05-08T21:10:08.048453+0000","last_became_peered":"2024-05-08T21:10:08.048453+0000","last_unstale":"2024-05-08T21:10:08.167816+0000","last_undegraded":"2024-05-08T21:10:08.167816+0000","last_fullsized":"2024-05-08T21:10:08.167816+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:19:28.758712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.737384+0000","last_change":"2024-05-08T21:10:03.330419+0000","last_active":"2024-05-08T21:10:08.737384+0000","last_peered":"2024-05-08T21:10:08.737384+0000","last_clean":"2024-05-08T21:10:08.737384+0000","last_became_active":"2024-05-08T21:10:03.330082+0000","last_became_peered":"2024-05-08T21:10:03.330082+0000","last_unstale":"2024-05-08T21:10:08.737384+0000","last_undegraded":"2024-05-08T21:10:08.737384+0000","last_fullsized":"2024-05-08T21:10:08.737384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:09:20.516386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046810+0000","last_change":"2024-05-08T21:10:03.747306+0000","last_active":"2024-05-08T21:10:08.046810+0000","last_peered":"2024-05-08T21:10:08.046810+0000","last_clean":"2024-05-08T21:10:08.046810+0000","last_became_active":"2024-05-08T21:10:03.746755+0000","last_became_peered":"2024-05-08T21:10:03.746755+0000","last_unstale":"2024-05-08T21:10:08.046810+0000","last_undegraded":"2024-05-08T21:10:08.046810+0000","last_fullsized":"2024-05-08T21:10:08.046810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:17:51.344821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.271171+0000","last_change":"2024-05-08T21:10:03.738627+0000","last_active":"2024-05-08T21:10:08.271171+0000","last_peered":"2024-05-08T21:10:08.271171+0000","last_clean":"2024-05-08T21:10:08.271171+0000","last_became_active":"2024-05-08T21:10:03.738338+0000","last_became_peered":"2024-05-08T21:10:03.738338+0000","last_unstale":"2024-05-08T21:10:08.271171+0000","last_undegraded":"2024-05-08T21:10:08.271171+0000","last_fullsized":"2024-05-08T21:10:08.271171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:34.088831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.751564+0000","last_change":"2024-05-08T21:10:03.745607+0000","last_active":"2024-05-08T21:10:07.751564+0000","last_peered":"2024-05-08T21:10:07.751564+0000","last_clean":"2024-05-08T21:10:07.751564+0000","last_became_active":"2024-05-08T21:10:03.745362+0000","last_became_peered":"2024-05-08T21:10:03.745362+0000","last_unstale":"2024-05-08T21:10:07.751564+0000","last_undegraded":"2024-05-08T21:10:07.751564+0000","last_fullsized":"2024-05-08T21:10:07.751564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:54.399930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.168448+0000","last_change":"2024-05-08T21:10:03.745137+0000","last_active":"2024-05-08T21:10:08.168448+0000","last_peered":"2024-05-08T21:10:08.168448+0000","last_clean":"2024-05-08T21:10:08.168448+0000","last_became_active":"2024-05-08T21:10:03.744844+0000","last_became_peered":"2024-05-08T21:10:03.744844+0000","last_unstale":"2024-05-08T21:10:08.168448+0000","last_undegraded":"2024-05-08T21:10:08.168448+0000","last_fullsized":"2024-05-08T21:10:08.168448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:06.853429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.753792+0000","last_change":"2024-05-08T21:10:03.745163+0000","last_active":"2024-05-08T21:10:07.753792+0000","last_peered":"2024-05-08T21:10:07.753792+0000","last_clean":"2024-05-08T21:10:07.753792+0000","last_became_active":"2024-05-08T21:10:03.744908+0000","last_became_peered":"2024-05-08T21:10:03.744908+0000","last_unstale":"2024-05-08T21:10:07.753792+0000","last_undegraded":"2024-05-08T21:10:07.753792+0000","last_fullsized":"2024-05-08T21:10:07.753792+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:06.593989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.762986+0000","last_change":"2024-05-08T21:10:03.748542+0000","last_active":"2024-05-08T21:10:07.762986+0000","last_peered":"2024-05-08T21:10:07.762986+0000","last_clean":"2024-05-08T21:10:07.762986+0000","last_became_active":"2024-05-08T21:10:03.748284+0000","last_became_peered":"2024-05-08T21:10:03.748284+0000","last_unstale":"2024-05-08T21:10:07.762986+0000","last_undegraded":"2024-05-08T21:10:07.762986+0000","last_fullsized":"2024-05-08T21:10:07.762986+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:49:10.430406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.187090+0000","last_change":"2024-05-08T21:10:03.739778+0000","last_active":"2024-05-08T21:10:08.187090+0000","last_peered":"2024-05-08T21:10:08.187090+0000","last_clean":"2024-05-08T21:10:08.187090+0000","last_became_active":"2024-05-08T21:10:03.739522+0000","last_became_peered":"2024-05-08T21:10:03.739522+0000","last_unstale":"2024-05-08T21:10:08.187090+0000","last_undegraded":"2024-05-08T21:10:08.187090+0000","last_fullsized":"2024-05-08T21:10:08.187090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:07:42.115999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.271345+0000","last_change":"2024-05-08T21:10:03.746126+0000","last_active":"2024-05-08T21:10:08.271345+0000","last_peered":"2024-05-08T21:10:08.271345+0000","last_clean":"2024-05-08T21:10:08.271345+0000","last_became_active":"2024-05-08T21:10:03.745842+0000","last_became_peered":"2024-05-08T21:10:03.745842+0000","last_unstale":"2024-05-08T21:10:08.271345+0000","last_undegraded":"2024-05-08T21:10:08.271345+0000","last_fullsized":"2024-05-08T21:10:08.271345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:51:06.176371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.762738+0000","last_change":"2024-05-08T21:10:03.745007+0000","last_active":"2024-05-08T21:10:07.762738+0000","last_peered":"2024-05-08T21:10:07.762738+0000","last_clean":"2024-05-08T21:10:07.762738+0000","last_became_active":"2024-05-08T21:10:03.744709+0000","last_became_peered":"2024-05-08T21:10:03.744709+0000","last_unstale":"2024-05-08T21:10:07.762738+0000","last_undegraded":"2024-05-08T21:10:07.762738+0000","last_fullsized":"2024-05-08T21:10:07.762738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:12:20.712861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.167909+0000","last_change":"2024-05-08T21:10:03.751111+0000","last_active":"2024-05-08T21:10:08.167909+0000","last_peered":"2024-05-08T21:10:08.167909+0000","last_clean":"2024-05-08T21:10:08.167909+0000","last_became_active":"2024-05-08T21:10:03.747059+0000","last_became_peered":"2024-05-08T21:10:03.747059+0000","last_unstale":"2024-05-08T21:10:08.167909+0000","last_undegraded":"2024-05-08T21:10:08.167909+0000","last_fullsized":"2024-05-08T21:10:08.167909+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:43.254221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.766689+0000","last_change":"2024-05-08T21:10:03.747207+0000","last_active":"2024-05-08T21:10:07.766689+0000","last_peered":"2024-05-08T21:10:07.766689+0000","last_clean":"2024-05-08T21:10:07.766689+0000","last_became_active":"2024-05-08T21:10:03.746942+0000","last_became_peered":"2024-05-08T21:10:03.746942+0000","last_unstale":"2024-05-08T21:10:07.766689+0000","last_undegraded":"2024-05-08T21:10:07.766689+0000","last_fullsized":"2024-05-08T21:10:07.766689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:33:52.317273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.168575+0000","last_change":"2024-05-08T21:10:03.753663+0000","last_active":"2024-05-08T21:10:08.168575+0000","last_peered":"2024-05-08T21:10:08.168575+0000","last_clean":"2024-05-08T21:10:08.168575+0000","last_became_active":"2024-05-08T21:10:03.752486+0000","last_became_peered":"2024-05-08T21:10:03.752486+0000","last_unstale":"2024-05-08T21:10:08.168575+0000","last_undegraded":"2024-05-08T21:10:08.168575+0000","last_fullsized":"2024-05-08T21:10:08.168575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:21:45.895154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.753497+0000","last_change":"2024-05-08T21:10:03.753849+0000","last_active":"2024-05-08T21:10:07.753497+0000","last_peered":"2024-05-08T21:10:07.753497+0000","last_clean":"2024-05-08T21:10:07.753497+0000","last_became_active":"2024-05-08T21:10:03.753616+0000","last_became_peered":"2024-05-08T21:10:03.753616+0000","last_unstale":"2024-05-08T21:10:07.753497+0000","last_undegraded":"2024-05-08T21:10:07.753497+0000","last_fullsized":"2024-05-08T21:10:07.753497+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:02:58.650310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.271297+0000","last_change":"2024-05-08T21:10:03.744906+0000","last_active":"2024-05-08T21:10:08.271297+0000","last_peered":"2024-05-08T21:10:08.271297+0000","last_clean":"2024-05-08T21:10:08.271297+0000","last_became_active":"2024-05-08T21:10:03.744562+0000","last_became_peered":"2024-05-08T21:10:03.744562+0000","last_unstale":"2024-05-08T21:10:08.271297+0000","last_undegraded":"2024-05-08T21:10:08.271297+0000","last_fullsized":"2024-05-08T21:10:08.271297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:21:30.416392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64612,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4594,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":110038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]}]},{"osd":5,"up_from":15,"seq":64424509449,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":106332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]}]},{"osd":0,"up_from":14,"seq":60129542153,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":348160,"data_stored":697248,"data_compressed":32306,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]}]},{"osd":7,"up_from":14,"seq":60129542152,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":339968,"data_stored":697192,"data_compressed":32306,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":106242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.245}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]}]},{"osd":3,"up_from":14,"seq":60129542152,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":110038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.253}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]}]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":106402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]}]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":106368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32306,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32306,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T21:10:32.434 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T21:10:32.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.586+0000 7f75a3d07700 1 Processor -- start 2024-05-08T21:10:32.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.586+0000 7f75a3d07700 1 -- start start 2024-05-08T21:10:32.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.587+0000 7f75a3d07700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f759c15a340 0x7f759c15a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:32.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.587+0000 7f75a3d07700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f759c15e570 con 0x7f759c154320 2024-05-08T21:10:32.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.587+0000 7f75a3d07700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f759c15d710 con 0x7f759c071f90 2024-05-08T21:10:32.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.587+0000 7f75a3d07700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f759c072400 con 0x7f759c15a340 2024-05-08T21:10:32.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.587+0000 7f75a22a4700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f759c15a340 0x7f759c15a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:32.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.587+0000 7f75a1aa3700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f759c154320 0x7f759c0c99d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41752/0 (socket says 172.21.15.80:41752) 2024-05-08T21:10:32.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.587+0000 7f75a1aa3700 1 -- 172.21.15.80:0/3084158376 learned_addr learned my addr 172.21.15.80:0/3084158376 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:10:32.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.587+0000 7f75a22a4700 1 -- 172.21.15.80:0/3084158376 >> v1:172.21.15.106:6789/0 conn(0x7f759c071f90 legacy=0x7f759c06a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:32.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.587+0000 7f75a22a4700 1 -- 172.21.15.80:0/3084158376 >> v1:172.21.15.80:6789/0 conn(0x7f759c154320 legacy=0x7f759c0c99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:32.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.587+0000 7f75a22a4700 1 -- 172.21.15.80:0/3084158376 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f759c15acb0 con 0x7f759c15a340 2024-05-08T21:10:32.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.587+0000 7f75a0aa1700 1 -- 172.21.15.80:0/3084158376 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4259749556 0 0) 0x7f759c15e570 con 0x7f759c154320 2024-05-08T21:10:32.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.587+0000 7f75a22a4700 1 --2- 172.21.15.80:0/3084158376 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f759c15a340 0x7f759c15a770 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7594009d90 tx=0x7f759400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f194c1977414463b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:32.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.587+0000 7f75a0aa1700 1 -- 172.21.15.80:0/3084158376 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759400e070 con 0x7f759c15a340 2024-05-08T21:10:32.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.587+0000 7f75a0aa1700 1 -- 172.21.15.80:0/3084158376 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f759400bbd0 con 0x7f759c15a340 2024-05-08T21:10:32.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.587+0000 7f75a0aa1700 1 -- 172.21.15.80:0/3084158376 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7594012430 con 0x7f759c15a340 2024-05-08T21:10:32.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.588+0000 7f75a3d07700 1 -- 172.21.15.80:0/3084158376 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f759c15a340 msgr2=0x7f759c15a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:32.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.588+0000 7f75a3d07700 1 --2- 172.21.15.80:0/3084158376 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f759c15a340 0x7f759c15a770 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7594009d90 tx=0x7f759400b330 comp rx=0 tx=0).stop 2024-05-08T21:10:32.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.588+0000 7f75a3d07700 1 -- 172.21.15.80:0/3084158376 shutdown_connections 2024-05-08T21:10:32.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.588+0000 7f75a3d07700 1 --2- 172.21.15.80:0/3084158376 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f759c15a340 0x7f759c15a770 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:32.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.588+0000 7f75a3d07700 1 -- 172.21.15.80:0/3084158376 >> 172.21.15.80:0/3084158376 conn(0x7f759c06f140 msgr2=0x7f759c06f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:32.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.588+0000 7f75a3d07700 1 -- 172.21.15.80:0/3084158376 shutdown_connections 2024-05-08T21:10:32.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.588+0000 7f75a3d07700 1 -- 172.21.15.80:0/3084158376 wait complete. 2024-05-08T21:10:32.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.589+0000 7f75a3d07700 1 Processor -- start 2024-05-08T21:10:32.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.589+0000 7f75a3d07700 1 -- start start 2024-05-08T21:10:32.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.590+0000 7f75a3d07700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f759c071f90 0x7f759c1581e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:32.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.590+0000 7f75a3d07700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f759c154320 0x7f759c0ca7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:32.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.590+0000 7f75a3d07700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f759c15a340 0x7f759c1efb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:32.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.590+0000 7f75a3d07700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f759c1f2df0 con 0x7f759c154320 2024-05-08T21:10:32.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.590+0000 7f75a3d07700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f759c1f3090 con 0x7f759c071f90 2024-05-08T21:10:32.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.590+0000 7f75a3d07700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f759c1f3370 con 0x7f759c15a340 2024-05-08T21:10:32.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.590+0000 7f75a12a2700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f759c154320 0x7f759c0ca7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:32.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.590+0000 7f75a12a2700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f759c154320 0x7f759c0ca7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42276/0 (socket says 172.21.15.80:42276) 2024-05-08T21:10:32.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.590+0000 7f75a12a2700 1 -- 172.21.15.80:0/185396325 learned_addr learned my addr 172.21.15.80:0/185396325 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:32.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.590+0000 7f75a1aa3700 1 --2- 172.21.15.80:0/185396325 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f759c071f90 0x7f759c1581e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:32.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.590+0000 7f75a12a2700 1 -- 172.21.15.80:0/185396325 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f759c15a340 msgr2=0x7f759c1efb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:32.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.590+0000 7f75a12a2700 1 --2- 172.21.15.80:0/185396325 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f759c15a340 0x7f759c1efb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:32.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.590+0000 7f75a12a2700 1 -- 172.21.15.80:0/185396325 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f759c071f90 msgr2=0x7f759c1581e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:32.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.590+0000 7f75a12a2700 1 --2- 172.21.15.80:0/185396325 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f759c071f90 0x7f759c1581e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:32.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.590+0000 7f75a12a2700 1 -- 172.21.15.80:0/185396325 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7594009a70 con 0x7f759c154320 2024-05-08T21:10:32.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.590+0000 7f75a12a2700 1 --2- 172.21.15.80:0/185396325 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f759c154320 0x7f759c0ca7c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f758c00c4e0 tx=0x7f758c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:32.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.591+0000 7f75927fc700 1 -- 172.21.15.80:0/185396325 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758c0052d0 con 0x7f759c154320 2024-05-08T21:10:32.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.591+0000 7f75927fc700 1 -- 172.21.15.80:0/185396325 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f758c005430 con 0x7f759c154320 2024-05-08T21:10:32.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.591+0000 7f75a3d07700 1 -- 172.21.15.80:0/185396325 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f759c1f3650 con 0x7f759c154320 2024-05-08T21:10:32.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.591+0000 7f75927fc700 1 -- 172.21.15.80:0/185396325 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758c0038c0 con 0x7f759c154320 2024-05-08T21:10:32.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.591+0000 7f75a3d07700 1 -- 172.21.15.80:0/185396325 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f759c072570 con 0x7f759c154320 2024-05-08T21:10:32.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.591+0000 7f75a3d07700 1 -- 172.21.15.80:0/185396325 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f759c04ec60 con 0x7f759c154320 2024-05-08T21:10:32.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.592+0000 7f75927fc700 1 -- 172.21.15.80:0/185396325 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f758c003a20 con 0x7f759c154320 2024-05-08T21:10:32.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.592+0000 7f75927fc700 1 --2- 172.21.15.80:0/185396325 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f758006ac90 0x7f758006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:32.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.592+0000 7f75927fc700 1 -- 172.21.15.80:0/185396325 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f758c088ae0 con 0x7f759c154320 2024-05-08T21:10:32.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.592+0000 7f75a1aa3700 1 --2- 172.21.15.80:0/185396325 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f758006ac90 0x7f758006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:32.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.593+0000 7f75a1aa3700 1 --2- 172.21.15.80:0/185396325 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f758006ac90 0x7f758006d150 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7598000f60 tx=0x7f7598009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:32.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.597+0000 7f75927fc700 1 -- 172.21.15.80:0/185396325 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f758c0539d0 con 0x7f759c154320 2024-05-08T21:10:32.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.787+0000 7f75a3d07700 1 -- 172.21.15.80:0/185396325 --> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f759c073e30 con 0x7f758006ac90 2024-05-08T21:10:32.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.796+0000 7f75927fc700 1 -- 172.21.15.80:0/185396325 <== mgr.4100 v2:172.21.15.80:6832/46731 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345379 (secure 0 0 0) 0x7f759c073e30 con 0x7f758006ac90 2024-05-08T21:10:32.804 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:10:32.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.800+0000 7f75a3d07700 1 -- 172.21.15.80:0/185396325 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f758006ac90 msgr2=0x7f758006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:32.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.800+0000 7f75a3d07700 1 --2- 172.21.15.80:0/185396325 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f758006ac90 0x7f758006d150 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7598000f60 tx=0x7f7598009040 comp rx=0 tx=0).stop 2024-05-08T21:10:32.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.800+0000 7f75a3d07700 1 -- 172.21.15.80:0/185396325 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f759c154320 msgr2=0x7f759c0ca7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:32.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.800+0000 7f75a3d07700 1 --2- 172.21.15.80:0/185396325 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f759c154320 0x7f759c0ca7c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f758c00c4e0 tx=0x7f758c00c8a0 comp rx=0 tx=0).stop 2024-05-08T21:10:32.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.800+0000 7f75a3d07700 1 -- 172.21.15.80:0/185396325 shutdown_connections 2024-05-08T21:10:32.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.800+0000 7f75a3d07700 1 --2- 172.21.15.80:0/185396325 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f758006ac90 0x7f758006d150 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:32.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.800+0000 7f75a3d07700 1 --2- 172.21.15.80:0/185396325 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f759c15a340 0x7f759c1efb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:32.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.800+0000 7f75a3d07700 1 --2- 172.21.15.80:0/185396325 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f759c071f90 0x7f759c1581e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:32.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.800+0000 7f75a3d07700 1 --2- 172.21.15.80:0/185396325 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f759c154320 0x7f759c0ca7c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:32.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.800+0000 7f75a3d07700 1 -- 172.21.15.80:0/185396325 >> 172.21.15.80:0/185396325 conn(0x7f759c06f140 msgr2=0x7f759c06f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:32.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.800+0000 7f75a3d07700 1 -- 172.21.15.80:0/185396325 shutdown_connections 2024-05-08T21:10:32.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.800+0000 7f75a3d07700 1 -- 172.21.15.80:0/185396325 wait complete. 2024-05-08T21:10:32.807 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-05-08T21:10:32.815 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2024-05-08T21:10:32.204713+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594962,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218452,"kb_used_data":2304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756268,"statfs":{"total":773094113280,"available":772870418432,"internally_reserved":0,"allocated":2359296,"data_stored":2039860,"data_compressed":64612,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003510"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.048091+0000","last_change":"2024-05-08T21:10:03.747477+0000","last_active":"2024-05-08T21:10:08.048091+0000","last_peered":"2024-05-08T21:10:08.048091+0000","last_clean":"2024-05-08T21:10:08.048091+0000","last_became_active":"2024-05-08T21:10:03.747059+0000","last_became_peered":"2024-05-08T21:10:03.747059+0000","last_unstale":"2024-05-08T21:10:08.048091+0000","last_undegraded":"2024-05-08T21:10:08.048091+0000","last_fullsized":"2024-05-08T21:10:08.048091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:15:24.340135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.187600+0000","last_change":"2024-05-08T21:10:03.738974+0000","last_active":"2024-05-08T21:10:08.187600+0000","last_peered":"2024-05-08T21:10:08.187600+0000","last_clean":"2024-05-08T21:10:08.187600+0000","last_became_active":"2024-05-08T21:10:03.738466+0000","last_became_peered":"2024-05-08T21:10:03.738466+0000","last_unstale":"2024-05-08T21:10:08.187600+0000","last_undegraded":"2024-05-08T21:10:08.187600+0000","last_fullsized":"2024-05-08T21:10:08.187600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:59.683039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.753636+0000","last_change":"2024-05-08T21:10:03.740146+0000","last_active":"2024-05-08T21:10:07.753636+0000","last_peered":"2024-05-08T21:10:07.753636+0000","last_clean":"2024-05-08T21:10:07.753636+0000","last_became_active":"2024-05-08T21:10:03.739884+0000","last_became_peered":"2024-05-08T21:10:03.739884+0000","last_unstale":"2024-05-08T21:10:07.753636+0000","last_undegraded":"2024-05-08T21:10:07.753636+0000","last_fullsized":"2024-05-08T21:10:07.753636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:51:44.301305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.168400+0000","last_change":"2024-05-08T21:10:03.754159+0000","last_active":"2024-05-08T21:10:08.168400+0000","last_peered":"2024-05-08T21:10:08.168400+0000","last_clean":"2024-05-08T21:10:08.168400+0000","last_became_active":"2024-05-08T21:10:03.753800+0000","last_became_peered":"2024-05-08T21:10:03.753800+0000","last_unstale":"2024-05-08T21:10:08.168400+0000","last_undegraded":"2024-05-08T21:10:08.168400+0000","last_fullsized":"2024-05-08T21:10:08.168400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:41:02.625080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046322+0000","last_change":"2024-05-08T21:10:03.750051+0000","last_active":"2024-05-08T21:10:08.046322+0000","last_peered":"2024-05-08T21:10:08.046322+0000","last_clean":"2024-05-08T21:10:08.046322+0000","last_became_active":"2024-05-08T21:10:03.749730+0000","last_became_peered":"2024-05-08T21:10:03.749730+0000","last_unstale":"2024-05-08T21:10:08.046322+0000","last_undegraded":"2024-05-08T21:10:08.046322+0000","last_fullsized":"2024-05-08T21:10:08.046322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:49.402253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.168597+0000","last_change":"2024-05-08T21:10:03.746043+0000","last_active":"2024-05-08T21:10:08.168597+0000","last_peered":"2024-05-08T21:10:08.168597+0000","last_clean":"2024-05-08T21:10:08.168597+0000","last_became_active":"2024-05-08T21:10:03.745747+0000","last_became_peered":"2024-05-08T21:10:03.745747+0000","last_unstale":"2024-05-08T21:10:08.168597+0000","last_undegraded":"2024-05-08T21:10:08.168597+0000","last_fullsized":"2024-05-08T21:10:08.168597+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:05:49.465405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046256+0000","last_change":"2024-05-08T21:10:03.743802+0000","last_active":"2024-05-08T21:10:08.046256+0000","last_peered":"2024-05-08T21:10:08.046256+0000","last_clean":"2024-05-08T21:10:08.046256+0000","last_became_active":"2024-05-08T21:10:03.743349+0000","last_became_peered":"2024-05-08T21:10:03.743349+0000","last_unstale":"2024-05-08T21:10:08.046256+0000","last_undegraded":"2024-05-08T21:10:08.046256+0000","last_fullsized":"2024-05-08T21:10:08.046256+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:08:06.408724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.757451+0000","last_change":"2024-05-08T21:10:03.747558+0000","last_active":"2024-05-08T21:10:07.757451+0000","last_peered":"2024-05-08T21:10:07.757451+0000","last_clean":"2024-05-08T21:10:07.757451+0000","last_became_active":"2024-05-08T21:10:03.747300+0000","last_became_peered":"2024-05-08T21:10:03.747300+0000","last_unstale":"2024-05-08T21:10:07.757451+0000","last_undegraded":"2024-05-08T21:10:07.757451+0000","last_fullsized":"2024-05-08T21:10:07.757451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:07:50.266894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046942+0000","last_change":"2024-05-08T21:10:03.748221+0000","last_active":"2024-05-08T21:10:08.046942+0000","last_peered":"2024-05-08T21:10:08.046942+0000","last_clean":"2024-05-08T21:10:08.046942+0000","last_became_active":"2024-05-08T21:10:03.747956+0000","last_became_peered":"2024-05-08T21:10:03.747956+0000","last_unstale":"2024-05-08T21:10:08.046942+0000","last_undegraded":"2024-05-08T21:10:08.046942+0000","last_fullsized":"2024-05-08T21:10:08.046942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:27:35.947884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.271333+0000","last_change":"2024-05-08T21:10:03.745291+0000","last_active":"2024-05-08T21:10:08.271333+0000","last_peered":"2024-05-08T21:10:08.271333+0000","last_clean":"2024-05-08T21:10:08.271333+0000","last_became_active":"2024-05-08T21:10:03.744976+0000","last_became_peered":"2024-05-08T21:10:03.744976+0000","last_unstale":"2024-05-08T21:10:08.271333+0000","last_undegraded":"2024-05-08T21:10:08.271333+0000","last_fullsized":"2024-05-08T21:10:08.271333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:36:54.983642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.271323+0000","last_change":"2024-05-08T21:10:03.748518+0000","last_active":"2024-05-08T21:10:08.271323+0000","last_peered":"2024-05-08T21:10:08.271323+0000","last_clean":"2024-05-08T21:10:08.271323+0000","last_became_active":"2024-05-08T21:10:03.748253+0000","last_became_peered":"2024-05-08T21:10:03.748253+0000","last_unstale":"2024-05-08T21:10:08.271323+0000","last_undegraded":"2024-05-08T21:10:08.271323+0000","last_fullsized":"2024-05-08T21:10:08.271323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:03:26.013122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.170038+0000","last_change":"2024-05-08T21:10:03.745985+0000","last_active":"2024-05-08T21:10:08.170038+0000","last_peered":"2024-05-08T21:10:08.170038+0000","last_clean":"2024-05-08T21:10:08.170038+0000","last_became_active":"2024-05-08T21:10:03.745247+0000","last_became_peered":"2024-05-08T21:10:03.745247+0000","last_unstale":"2024-05-08T21:10:08.170038+0000","last_undegraded":"2024-05-08T21:10:08.170038+0000","last_fullsized":"2024-05-08T21:10:08.170038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:59:42.506304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.761196+0000","last_change":"2024-05-08T21:10:03.747016+0000","last_active":"2024-05-08T21:10:07.761196+0000","last_peered":"2024-05-08T21:10:07.761196+0000","last_clean":"2024-05-08T21:10:07.761196+0000","last_became_active":"2024-05-08T21:10:03.746848+0000","last_became_peered":"2024-05-08T21:10:03.746848+0000","last_unstale":"2024-05-08T21:10:07.761196+0000","last_undegraded":"2024-05-08T21:10:07.761196+0000","last_fullsized":"2024-05-08T21:10:07.761196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:41:21.081035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.753493+0000","last_change":"2024-05-08T21:10:03.737984+0000","last_active":"2024-05-08T21:10:07.753493+0000","last_peered":"2024-05-08T21:10:07.753493+0000","last_clean":"2024-05-08T21:10:07.753493+0000","last_became_active":"2024-05-08T21:10:03.737716+0000","last_became_peered":"2024-05-08T21:10:03.737716+0000","last_unstale":"2024-05-08T21:10:07.753493+0000","last_undegraded":"2024-05-08T21:10:07.753493+0000","last_fullsized":"2024-05-08T21:10:07.753493+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:09:47.758272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.186816+0000","last_change":"2024-05-08T21:10:03.744543+0000","last_active":"2024-05-08T21:10:08.186816+0000","last_peered":"2024-05-08T21:10:08.186816+0000","last_clean":"2024-05-08T21:10:08.186816+0000","last_became_active":"2024-05-08T21:10:03.744276+0000","last_became_peered":"2024-05-08T21:10:03.744276+0000","last_unstale":"2024-05-08T21:10:08.186816+0000","last_undegraded":"2024-05-08T21:10:08.186816+0000","last_fullsized":"2024-05-08T21:10:08.186816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:25:04.113297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.167751+0000","last_change":"2024-05-08T21:10:03.746547+0000","last_active":"2024-05-08T21:10:08.167751+0000","last_peered":"2024-05-08T21:10:08.167751+0000","last_clean":"2024-05-08T21:10:08.167751+0000","last_became_active":"2024-05-08T21:10:03.745862+0000","last_became_peered":"2024-05-08T21:10:03.745862+0000","last_unstale":"2024-05-08T21:10:08.167751+0000","last_undegraded":"2024-05-08T21:10:08.167751+0000","last_fullsized":"2024-05-08T21:10:08.167751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:12.776310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169108+0000","last_change":"2024-05-08T21:10:03.754230+0000","last_active":"2024-05-08T21:10:08.169108+0000","last_peered":"2024-05-08T21:10:08.169108+0000","last_clean":"2024-05-08T21:10:08.169108+0000","last_became_active":"2024-05-08T21:10:03.753895+0000","last_became_peered":"2024-05-08T21:10:03.753895+0000","last_unstale":"2024-05-08T21:10:08.169108+0000","last_undegraded":"2024-05-08T21:10:08.169108+0000","last_fullsized":"2024-05-08T21:10:08.169108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:41:47.214215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.751781+0000","last_change":"2024-05-08T21:10:03.743889+0000","last_active":"2024-05-08T21:10:07.751781+0000","last_peered":"2024-05-08T21:10:07.751781+0000","last_clean":"2024-05-08T21:10:07.751781+0000","last_became_active":"2024-05-08T21:10:03.743596+0000","last_became_peered":"2024-05-08T21:10:03.743596+0000","last_unstale":"2024-05-08T21:10:07.751781+0000","last_undegraded":"2024-05-08T21:10:07.751781+0000","last_fullsized":"2024-05-08T21:10:07.751781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:53.981781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046658+0000","last_change":"2024-05-08T21:10:03.743893+0000","last_active":"2024-05-08T21:10:08.046658+0000","last_peered":"2024-05-08T21:10:08.046658+0000","last_clean":"2024-05-08T21:10:08.046658+0000","last_became_active":"2024-05-08T21:10:03.743580+0000","last_became_peered":"2024-05-08T21:10:03.743580+0000","last_unstale":"2024-05-08T21:10:08.046658+0000","last_undegraded":"2024-05-08T21:10:08.046658+0000","last_fullsized":"2024-05-08T21:10:08.046658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:44:21.747625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.059425+0000","last_change":"2024-05-08T21:10:08.052394+0000","last_active":"2024-05-08T21:10:08.059425+0000","last_peered":"2024-05-08T21:10:08.059425+0000","last_clean":"2024-05-08T21:10:08.059425+0000","last_became_active":"2024-05-08T21:10:08.052009+0000","last_became_peered":"2024-05-08T21:10:08.052009+0000","last_unstale":"2024-05-08T21:10:08.059425+0000","last_undegraded":"2024-05-08T21:10:08.059425+0000","last_fullsized":"2024-05-08T21:10:08.059425+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:47:20.148683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"25'4","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.741230+0000","last_change":"2024-05-08T21:10:03.340118+0000","last_active":"2024-05-08T21:10:08.741230+0000","last_peered":"2024-05-08T21:10:08.741230+0000","last_clean":"2024-05-08T21:10:08.741230+0000","last_became_active":"2024-05-08T21:10:03.339847+0000","last_became_peered":"2024-05-08T21:10:03.339847+0000","last_unstale":"2024-05-08T21:10:08.741230+0000","last_undegraded":"2024-05-08T21:10:08.741230+0000","last_fullsized":"2024-05-08T21:10:08.741230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:05:56.369631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.768418+0000","last_change":"2024-05-08T21:10:03.746516+0000","last_active":"2024-05-08T21:10:07.768418+0000","last_peered":"2024-05-08T21:10:07.768418+0000","last_clean":"2024-05-08T21:10:07.768418+0000","last_became_active":"2024-05-08T21:10:03.746383+0000","last_became_peered":"2024-05-08T21:10:03.746383+0000","last_unstale":"2024-05-08T21:10:07.768418+0000","last_undegraded":"2024-05-08T21:10:07.768418+0000","last_fullsized":"2024-05-08T21:10:07.768418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:29:05.305134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169483+0000","last_change":"2024-05-08T21:10:07.766498+0000","last_active":"2024-05-08T21:10:08.169483+0000","last_peered":"2024-05-08T21:10:08.169483+0000","last_clean":"2024-05-08T21:10:08.169483+0000","last_became_active":"2024-05-08T21:10:07.766119+0000","last_became_peered":"2024-05-08T21:10:07.766119+0000","last_unstale":"2024-05-08T21:10:08.169483+0000","last_undegraded":"2024-05-08T21:10:08.169483+0000","last_fullsized":"2024-05-08T21:10:08.169483+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:58:38.720848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"26'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.508429+0000","last_change":"2024-05-08T21:10:03.329414+0000","last_active":"2024-05-08T21:10:08.508429+0000","last_peered":"2024-05-08T21:10:08.508429+0000","last_clean":"2024-05-08T21:10:08.508429+0000","last_became_active":"2024-05-08T21:10:03.328970+0000","last_became_peered":"2024-05-08T21:10:03.328970+0000","last_unstale":"2024-05-08T21:10:08.508429+0000","last_undegraded":"2024-05-08T21:10:08.508429+0000","last_fullsized":"2024-05-08T21:10:08.508429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:34:32.820755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.753820+0000","last_change":"2024-05-08T21:10:03.748566+0000","last_active":"2024-05-08T21:10:07.753820+0000","last_peered":"2024-05-08T21:10:07.753820+0000","last_clean":"2024-05-08T21:10:07.753820+0000","last_became_active":"2024-05-08T21:10:03.747989+0000","last_became_peered":"2024-05-08T21:10:03.747989+0000","last_unstale":"2024-05-08T21:10:07.753820+0000","last_undegraded":"2024-05-08T21:10:07.753820+0000","last_fullsized":"2024-05-08T21:10:07.753820+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:19:03.468394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169607+0000","last_change":"2024-05-08T21:10:07.770390+0000","last_active":"2024-05-08T21:10:08.169607+0000","last_peered":"2024-05-08T21:10:08.169607+0000","last_clean":"2024-05-08T21:10:08.169607+0000","last_became_active":"2024-05-08T21:10:07.770017+0000","last_became_peered":"2024-05-08T21:10:07.770017+0000","last_unstale":"2024-05-08T21:10:08.169607+0000","last_undegraded":"2024-05-08T21:10:08.169607+0000","last_fullsized":"2024-05-08T21:10:08.169607+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:12:00.200848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.738243+0000","last_change":"2024-05-08T21:10:03.339207+0000","last_active":"2024-05-08T21:10:08.738243+0000","last_peered":"2024-05-08T21:10:08.738243+0000","last_clean":"2024-05-08T21:10:08.738243+0000","last_became_active":"2024-05-08T21:10:03.338917+0000","last_became_peered":"2024-05-08T21:10:03.338917+0000","last_unstale":"2024-05-08T21:10:08.738243+0000","last_undegraded":"2024-05-08T21:10:08.738243+0000","last_fullsized":"2024-05-08T21:10:08.738243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:20.676853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.168481+0000","last_change":"2024-05-08T21:10:03.753998+0000","last_active":"2024-05-08T21:10:08.168481+0000","last_peered":"2024-05-08T21:10:08.168481+0000","last_clean":"2024-05-08T21:10:08.168481+0000","last_became_active":"2024-05-08T21:10:03.753720+0000","last_became_peered":"2024-05-08T21:10:03.753720+0000","last_unstale":"2024-05-08T21:10:08.168481+0000","last_undegraded":"2024-05-08T21:10:08.168481+0000","last_fullsized":"2024-05-08T21:10:08.168481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:00:38.531282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169599+0000","last_change":"2024-05-08T21:10:07.776367+0000","last_active":"2024-05-08T21:10:08.169599+0000","last_peered":"2024-05-08T21:10:08.169599+0000","last_clean":"2024-05-08T21:10:08.169599+0000","last_became_active":"2024-05-08T21:10:07.775998+0000","last_became_peered":"2024-05-08T21:10:07.775998+0000","last_unstale":"2024-05-08T21:10:08.169599+0000","last_undegraded":"2024-05-08T21:10:08.169599+0000","last_fullsized":"2024-05-08T21:10:08.169599+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:24:18.845560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.740209+0000","last_change":"2024-05-08T21:10:03.339182+0000","last_active":"2024-05-08T21:10:08.740209+0000","last_peered":"2024-05-08T21:10:08.740209+0000","last_clean":"2024-05-08T21:10:08.740209+0000","last_became_active":"2024-05-08T21:10:03.338899+0000","last_became_peered":"2024-05-08T21:10:03.338899+0000","last_unstale":"2024-05-08T21:10:08.740209+0000","last_undegraded":"2024-05-08T21:10:08.740209+0000","last_fullsized":"2024-05-08T21:10:08.740209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:55:53.368546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.168672+0000","last_change":"2024-05-08T21:10:03.750724+0000","last_active":"2024-05-08T21:10:08.168672+0000","last_peered":"2024-05-08T21:10:08.168672+0000","last_clean":"2024-05-08T21:10:08.168672+0000","last_became_active":"2024-05-08T21:10:03.750371+0000","last_became_peered":"2024-05-08T21:10:03.750371+0000","last_unstale":"2024-05-08T21:10:08.168672+0000","last_undegraded":"2024-05-08T21:10:08.168672+0000","last_fullsized":"2024-05-08T21:10:08.168672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:14:01.935211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.775704+0000","last_change":"2024-05-08T21:10:07.767604+0000","last_active":"2024-05-08T21:10:07.775704+0000","last_peered":"2024-05-08T21:10:07.775704+0000","last_clean":"2024-05-08T21:10:07.775704+0000","last_became_active":"2024-05-08T21:10:07.767234+0000","last_became_peered":"2024-05-08T21:10:07.767234+0000","last_unstale":"2024-05-08T21:10:07.775704+0000","last_undegraded":"2024-05-08T21:10:07.775704+0000","last_fullsized":"2024-05-08T21:10:07.775704+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:30:21.411491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"26'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.508102+0000","last_change":"2024-05-08T21:10:03.338149+0000","last_active":"2024-05-08T21:10:08.508102+0000","last_peered":"2024-05-08T21:10:08.508102+0000","last_clean":"2024-05-08T21:10:08.508102+0000","last_became_active":"2024-05-08T21:10:03.337860+0000","last_became_peered":"2024-05-08T21:10:03.337860+0000","last_unstale":"2024-05-08T21:10:08.508102+0000","last_undegraded":"2024-05-08T21:10:08.508102+0000","last_fullsized":"2024-05-08T21:10:08.508102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:07:39.052625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169664+0000","last_change":"2024-05-08T21:10:03.743506+0000","last_active":"2024-05-08T21:10:08.169664+0000","last_peered":"2024-05-08T21:10:08.169664+0000","last_clean":"2024-05-08T21:10:08.169664+0000","last_became_active":"2024-05-08T21:10:03.743227+0000","last_became_peered":"2024-05-08T21:10:03.743227+0000","last_unstale":"2024-05-08T21:10:08.169664+0000","last_undegraded":"2024-05-08T21:10:08.169664+0000","last_fullsized":"2024-05-08T21:10:08.169664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:45:47.977619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.741849+0000","last_change":"2024-05-08T21:10:07.768424+0000","last_active":"2024-05-08T21:10:08.741849+0000","last_peered":"2024-05-08T21:10:08.741849+0000","last_clean":"2024-05-08T21:10:08.741849+0000","last_became_active":"2024-05-08T21:10:07.768160+0000","last_became_peered":"2024-05-08T21:10:07.768160+0000","last_unstale":"2024-05-08T21:10:08.741849+0000","last_undegraded":"2024-05-08T21:10:08.741849+0000","last_fullsized":"2024-05-08T21:10:08.741849+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:42:44.327080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"26'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.606664+0000","last_change":"2024-05-08T21:10:03.333647+0000","last_active":"2024-05-08T21:10:08.606664+0000","last_peered":"2024-05-08T21:10:08.606664+0000","last_clean":"2024-05-08T21:10:08.606664+0000","last_became_active":"2024-05-08T21:10:03.332844+0000","last_became_peered":"2024-05-08T21:10:03.332844+0000","last_unstale":"2024-05-08T21:10:08.606664+0000","last_undegraded":"2024-05-08T21:10:08.606664+0000","last_fullsized":"2024-05-08T21:10:08.606664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:47:40.344808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.753370+0000","last_change":"2024-05-08T21:10:03.743003+0000","last_active":"2024-05-08T21:10:07.753370+0000","last_peered":"2024-05-08T21:10:07.753370+0000","last_clean":"2024-05-08T21:10:07.753370+0000","last_became_active":"2024-05-08T21:10:03.742753+0000","last_became_peered":"2024-05-08T21:10:03.742753+0000","last_unstale":"2024-05-08T21:10:07.753370+0000","last_undegraded":"2024-05-08T21:10:07.753370+0000","last_fullsized":"2024-05-08T21:10:07.753370+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:45:49.575877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.271366+0000","last_change":"2024-05-08T21:10:07.770105+0000","last_active":"2024-05-08T21:10:08.271366+0000","last_peered":"2024-05-08T21:10:08.271366+0000","last_clean":"2024-05-08T21:10:08.271366+0000","last_became_active":"2024-05-08T21:10:07.769668+0000","last_became_peered":"2024-05-08T21:10:07.769668+0000","last_unstale":"2024-05-08T21:10:08.271366+0000","last_undegraded":"2024-05-08T21:10:08.271366+0000","last_fullsized":"2024-05-08T21:10:08.271366+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:07:21.560031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.766792+0000","last_change":"2024-05-08T21:10:03.333025+0000","last_active":"2024-05-08T21:10:07.766792+0000","last_peered":"2024-05-08T21:10:07.766792+0000","last_clean":"2024-05-08T21:10:07.766792+0000","last_became_active":"2024-05-08T21:10:03.332750+0000","last_became_peered":"2024-05-08T21:10:03.332750+0000","last_unstale":"2024-05-08T21:10:07.766792+0000","last_undegraded":"2024-05-08T21:10:07.766792+0000","last_fullsized":"2024-05-08T21:10:07.766792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:20:50.134647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.756963+0000","last_change":"2024-05-08T21:10:03.744023+0000","last_active":"2024-05-08T21:10:07.756963+0000","last_peered":"2024-05-08T21:10:07.756963+0000","last_clean":"2024-05-08T21:10:07.756963+0000","last_became_active":"2024-05-08T21:10:03.743724+0000","last_became_peered":"2024-05-08T21:10:03.743724+0000","last_unstale":"2024-05-08T21:10:07.756963+0000","last_undegraded":"2024-05-08T21:10:07.756963+0000","last_fullsized":"2024-05-08T21:10:07.756963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:50:36.857245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.059558+0000","last_change":"2024-05-08T21:10:08.052307+0000","last_active":"2024-05-08T21:10:08.059558+0000","last_peered":"2024-05-08T21:10:08.059558+0000","last_clean":"2024-05-08T21:10:08.059558+0000","last_became_active":"2024-05-08T21:10:08.051924+0000","last_became_peered":"2024-05-08T21:10:08.051924+0000","last_unstale":"2024-05-08T21:10:08.059558+0000","last_undegraded":"2024-05-08T21:10:08.059558+0000","last_fullsized":"2024-05-08T21:10:08.059558+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:56:37.264246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.750197+0000","last_change":"2024-05-08T21:10:03.330304+0000","last_active":"2024-05-08T21:10:07.750197+0000","last_peered":"2024-05-08T21:10:07.750197+0000","last_clean":"2024-05-08T21:10:07.750197+0000","last_became_active":"2024-05-08T21:10:03.330054+0000","last_became_peered":"2024-05-08T21:10:03.330054+0000","last_unstale":"2024-05-08T21:10:07.750197+0000","last_undegraded":"2024-05-08T21:10:07.750197+0000","last_fullsized":"2024-05-08T21:10:07.750197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:30.518935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.186997+0000","last_change":"2024-05-08T21:10:03.739687+0000","last_active":"2024-05-08T21:10:08.186997+0000","last_peered":"2024-05-08T21:10:08.186997+0000","last_clean":"2024-05-08T21:10:08.186997+0000","last_became_active":"2024-05-08T21:10:03.739425+0000","last_became_peered":"2024-05-08T21:10:03.739425+0000","last_unstale":"2024-05-08T21:10:08.186997+0000","last_undegraded":"2024-05-08T21:10:08.186997+0000","last_fullsized":"2024-05-08T21:10:08.186997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:45:59.295081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.054235+0000","last_change":"2024-05-08T21:10:08.050980+0000","last_active":"2024-05-08T21:10:08.054235+0000","last_peered":"2024-05-08T21:10:08.054235+0000","last_clean":"2024-05-08T21:10:08.054235+0000","last_became_active":"2024-05-08T21:10:08.050625+0000","last_became_peered":"2024-05-08T21:10:08.050625+0000","last_unstale":"2024-05-08T21:10:08.054235+0000","last_undegraded":"2024-05-08T21:10:08.054235+0000","last_fullsized":"2024-05-08T21:10:08.054235+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:39:43.917363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.755963+0000","last_change":"2024-05-08T21:10:03.331297+0000","last_active":"2024-05-08T21:10:07.755963+0000","last_peered":"2024-05-08T21:10:07.755963+0000","last_clean":"2024-05-08T21:10:07.755963+0000","last_became_active":"2024-05-08T21:10:03.330973+0000","last_became_peered":"2024-05-08T21:10:03.330973+0000","last_unstale":"2024-05-08T21:10:07.755963+0000","last_undegraded":"2024-05-08T21:10:07.755963+0000","last_fullsized":"2024-05-08T21:10:07.755963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:57:26.190186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.168346+0000","last_change":"2024-05-08T21:10:03.751746+0000","last_active":"2024-05-08T21:10:08.168346+0000","last_peered":"2024-05-08T21:10:08.168346+0000","last_clean":"2024-05-08T21:10:08.168346+0000","last_became_active":"2024-05-08T21:10:03.751426+0000","last_became_peered":"2024-05-08T21:10:03.751426+0000","last_unstale":"2024-05-08T21:10:08.168346+0000","last_undegraded":"2024-05-08T21:10:08.168346+0000","last_fullsized":"2024-05-08T21:10:08.168346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:00:23.529543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.778416+0000","last_change":"2024-05-08T21:10:07.771834+0000","last_active":"2024-05-08T21:10:07.778416+0000","last_peered":"2024-05-08T21:10:07.778416+0000","last_clean":"2024-05-08T21:10:07.778416+0000","last_became_active":"2024-05-08T21:10:07.771324+0000","last_became_peered":"2024-05-08T21:10:07.771324+0000","last_unstale":"2024-05-08T21:10:07.778416+0000","last_undegraded":"2024-05-08T21:10:07.778416+0000","last_fullsized":"2024-05-08T21:10:07.778416+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:35.948317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.749656+0000","last_change":"2024-05-08T21:10:03.332049+0000","last_active":"2024-05-08T21:10:07.749656+0000","last_peered":"2024-05-08T21:10:07.749656+0000","last_clean":"2024-05-08T21:10:07.749656+0000","last_became_active":"2024-05-08T21:10:03.331712+0000","last_became_peered":"2024-05-08T21:10:03.331712+0000","last_unstale":"2024-05-08T21:10:07.749656+0000","last_undegraded":"2024-05-08T21:10:07.749656+0000","last_fullsized":"2024-05-08T21:10:07.749656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:30:16.135672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.753983+0000","last_change":"2024-05-08T21:10:03.748728+0000","last_active":"2024-05-08T21:10:07.753983+0000","last_peered":"2024-05-08T21:10:07.753983+0000","last_clean":"2024-05-08T21:10:07.753983+0000","last_became_active":"2024-05-08T21:10:03.748315+0000","last_became_peered":"2024-05-08T21:10:03.748315+0000","last_unstale":"2024-05-08T21:10:07.753983+0000","last_undegraded":"2024-05-08T21:10:07.753983+0000","last_fullsized":"2024-05-08T21:10:07.753983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:14:15.224603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.170061+0000","last_change":"2024-05-08T21:10:07.761559+0000","last_active":"2024-05-08T21:10:08.170061+0000","last_peered":"2024-05-08T21:10:08.170061+0000","last_clean":"2024-05-08T21:10:08.170061+0000","last_became_active":"2024-05-08T21:10:07.761129+0000","last_became_peered":"2024-05-08T21:10:07.761129+0000","last_unstale":"2024-05-08T21:10:08.170061+0000","last_undegraded":"2024-05-08T21:10:08.170061+0000","last_fullsized":"2024-05-08T21:10:08.170061+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:29:03.444853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'3","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.737377+0000","last_change":"2024-05-08T21:10:03.333077+0000","last_active":"2024-05-08T21:10:08.737377+0000","last_peered":"2024-05-08T21:10:08.737377+0000","last_clean":"2024-05-08T21:10:08.737377+0000","last_became_active":"2024-05-08T21:10:03.332796+0000","last_became_peered":"2024-05-08T21:10:03.332796+0000","last_unstale":"2024-05-08T21:10:08.737377+0000","last_undegraded":"2024-05-08T21:10:08.737377+0000","last_fullsized":"2024-05-08T21:10:08.737377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:30:16.135672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169929+0000","last_change":"2024-05-08T21:10:03.751370+0000","last_active":"2024-05-08T21:10:08.169929+0000","last_peered":"2024-05-08T21:10:08.169929+0000","last_clean":"2024-05-08T21:10:08.169929+0000","last_became_active":"2024-05-08T21:10:03.750394+0000","last_became_peered":"2024-05-08T21:10:03.750394+0000","last_unstale":"2024-05-08T21:10:08.169929+0000","last_undegraded":"2024-05-08T21:10:08.169929+0000","last_fullsized":"2024-05-08T21:10:08.169929+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:31:06.682543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.187439+0000","last_change":"2024-05-08T21:10:07.764815+0000","last_active":"2024-05-08T21:10:08.187439+0000","last_peered":"2024-05-08T21:10:08.187439+0000","last_clean":"2024-05-08T21:10:08.187439+0000","last_became_active":"2024-05-08T21:10:07.763591+0000","last_became_peered":"2024-05-08T21:10:07.763591+0000","last_unstale":"2024-05-08T21:10:08.187439+0000","last_undegraded":"2024-05-08T21:10:08.187439+0000","last_fullsized":"2024-05-08T21:10:08.187439+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:47.977517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:17.506385+0000","last_change":"2024-05-08T21:10:03.342400+0000","last_active":"2024-05-08T21:10:17.506385+0000","last_peered":"2024-05-08T21:10:17.506385+0000","last_clean":"2024-05-08T21:10:17.506385+0000","last_became_active":"2024-05-08T21:10:03.342202+0000","last_became_peered":"2024-05-08T21:10:03.342202+0000","last_unstale":"2024-05-08T21:10:17.506385+0000","last_undegraded":"2024-05-08T21:10:17.506385+0000","last_fullsized":"2024-05-08T21:10:17.506385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:10:04.668029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3796,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046564+0000","last_change":"2024-05-08T21:10:03.752144+0000","last_active":"2024-05-08T21:10:08.046564+0000","last_peered":"2024-05-08T21:10:08.046564+0000","last_clean":"2024-05-08T21:10:08.046564+0000","last_became_active":"2024-05-08T21:10:03.751868+0000","last_became_peered":"2024-05-08T21:10:03.751868+0000","last_unstale":"2024-05-08T21:10:08.046564+0000","last_undegraded":"2024-05-08T21:10:08.046564+0000","last_fullsized":"2024-05-08T21:10:08.046564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:40:43.168591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.168406+0000","last_change":"2024-05-08T21:10:08.052390+0000","last_active":"2024-05-08T21:10:08.168406+0000","last_peered":"2024-05-08T21:10:08.168406+0000","last_clean":"2024-05-08T21:10:08.168406+0000","last_became_active":"2024-05-08T21:10:08.051967+0000","last_became_peered":"2024-05-08T21:10:08.051967+0000","last_unstale":"2024-05-08T21:10:08.168406+0000","last_undegraded":"2024-05-08T21:10:08.168406+0000","last_fullsized":"2024-05-08T21:10:08.168406+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:40:07.127492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.739991+0000","last_change":"2024-05-08T21:10:03.330102+0000","last_active":"2024-05-08T21:10:08.739991+0000","last_peered":"2024-05-08T21:10:08.739991+0000","last_clean":"2024-05-08T21:10:08.739991+0000","last_became_active":"2024-05-08T21:10:03.329761+0000","last_became_peered":"2024-05-08T21:10:03.329761+0000","last_unstale":"2024-05-08T21:10:08.739991+0000","last_undegraded":"2024-05-08T21:10:08.739991+0000","last_fullsized":"2024-05-08T21:10:08.739991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:37:14.930549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.753579+0000","last_change":"2024-05-08T21:10:03.749332+0000","last_active":"2024-05-08T21:10:07.753579+0000","last_peered":"2024-05-08T21:10:07.753579+0000","last_clean":"2024-05-08T21:10:07.753579+0000","last_became_active":"2024-05-08T21:10:03.749094+0000","last_became_peered":"2024-05-08T21:10:03.749094+0000","last_unstale":"2024-05-08T21:10:07.753579+0000","last_undegraded":"2024-05-08T21:10:07.753579+0000","last_fullsized":"2024-05-08T21:10:07.753579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:25.969085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.048813+0000","last_change":"2024-05-08T21:10:08.048331+0000","last_active":"2024-05-08T21:10:08.048813+0000","last_peered":"2024-05-08T21:10:08.048813+0000","last_clean":"2024-05-08T21:10:08.048813+0000","last_became_active":"2024-05-08T21:10:08.047505+0000","last_became_peered":"2024-05-08T21:10:08.047505+0000","last_unstale":"2024-05-08T21:10:08.048813+0000","last_undegraded":"2024-05-08T21:10:08.048813+0000","last_fullsized":"2024-05-08T21:10:08.048813+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:18:39.268730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.749622+0000","last_change":"2024-05-08T21:10:03.328021+0000","last_active":"2024-05-08T21:10:07.749622+0000","last_peered":"2024-05-08T21:10:07.749622+0000","last_clean":"2024-05-08T21:10:07.749622+0000","last_became_active":"2024-05-08T21:10:03.327648+0000","last_became_peered":"2024-05-08T21:10:03.327648+0000","last_unstale":"2024-05-08T21:10:07.749622+0000","last_undegraded":"2024-05-08T21:10:07.749622+0000","last_fullsized":"2024-05-08T21:10:07.749622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:37:54.491930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046495+0000","last_change":"2024-05-08T21:10:03.750560+0000","last_active":"2024-05-08T21:10:08.046495+0000","last_peered":"2024-05-08T21:10:08.046495+0000","last_clean":"2024-05-08T21:10:08.046495+0000","last_became_active":"2024-05-08T21:10:03.750294+0000","last_became_peered":"2024-05-08T21:10:03.750294+0000","last_unstale":"2024-05-08T21:10:08.046495+0000","last_undegraded":"2024-05-08T21:10:08.046495+0000","last_fullsized":"2024-05-08T21:10:08.046495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:30:47.937326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.059433+0000","last_change":"2024-05-08T21:10:08.052318+0000","last_active":"2024-05-08T21:10:08.059433+0000","last_peered":"2024-05-08T21:10:08.059433+0000","last_clean":"2024-05-08T21:10:08.059433+0000","last_became_active":"2024-05-08T21:10:08.051920+0000","last_became_peered":"2024-05-08T21:10:08.051920+0000","last_unstale":"2024-05-08T21:10:08.059433+0000","last_undegraded":"2024-05-08T21:10:08.059433+0000","last_fullsized":"2024-05-08T21:10:08.059433+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:25:27.669768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.754124+0000","last_change":"2024-05-08T21:10:03.332390+0000","last_active":"2024-05-08T21:10:07.754124+0000","last_peered":"2024-05-08T21:10:07.754124+0000","last_clean":"2024-05-08T21:10:07.754124+0000","last_became_active":"2024-05-08T21:10:03.332105+0000","last_became_peered":"2024-05-08T21:10:03.332105+0000","last_unstale":"2024-05-08T21:10:07.754124+0000","last_undegraded":"2024-05-08T21:10:07.754124+0000","last_fullsized":"2024-05-08T21:10:07.754124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:32:44.705682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.271145+0000","last_change":"2024-05-08T21:10:03.742100+0000","last_active":"2024-05-08T21:10:08.271145+0000","last_peered":"2024-05-08T21:10:08.271145+0000","last_clean":"2024-05-08T21:10:08.271145+0000","last_became_active":"2024-05-08T21:10:03.741742+0000","last_became_peered":"2024-05-08T21:10:03.741742+0000","last_unstale":"2024-05-08T21:10:08.271145+0000","last_undegraded":"2024-05-08T21:10:08.271145+0000","last_fullsized":"2024-05-08T21:10:08.271145+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:53:19.394126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.775032+0000","last_change":"2024-05-08T21:10:07.769850+0000","last_active":"2024-05-08T21:10:07.775032+0000","last_peered":"2024-05-08T21:10:07.775032+0000","last_clean":"2024-05-08T21:10:07.775032+0000","last_became_active":"2024-05-08T21:10:07.769016+0000","last_became_peered":"2024-05-08T21:10:07.769016+0000","last_unstale":"2024-05-08T21:10:07.775032+0000","last_undegraded":"2024-05-08T21:10:07.775032+0000","last_fullsized":"2024-05-08T21:10:07.775032+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:31:52.621418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"25'8","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.741624+0000","last_change":"2024-05-08T21:10:03.331783+0000","last_active":"2024-05-08T21:10:08.741624+0000","last_peered":"2024-05-08T21:10:08.741624+0000","last_clean":"2024-05-08T21:10:08.741624+0000","last_became_active":"2024-05-08T21:10:03.331501+0000","last_became_peered":"2024-05-08T21:10:03.331501+0000","last_unstale":"2024-05-08T21:10:08.741624+0000","last_undegraded":"2024-05-08T21:10:08.741624+0000","last_fullsized":"2024-05-08T21:10:08.741624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:41:28.137295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046481+0000","last_change":"2024-05-08T21:10:03.744007+0000","last_active":"2024-05-08T21:10:08.046481+0000","last_peered":"2024-05-08T21:10:08.046481+0000","last_clean":"2024-05-08T21:10:08.046481+0000","last_became_active":"2024-05-08T21:10:03.743557+0000","last_became_peered":"2024-05-08T21:10:03.743557+0000","last_unstale":"2024-05-08T21:10:08.046481+0000","last_undegraded":"2024-05-08T21:10:08.046481+0000","last_fullsized":"2024-05-08T21:10:08.046481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:45:26.458377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169408+0000","last_change":"2024-05-08T21:10:07.777283+0000","last_active":"2024-05-08T21:10:08.169408+0000","last_peered":"2024-05-08T21:10:08.169408+0000","last_clean":"2024-05-08T21:10:08.169408+0000","last_became_active":"2024-05-08T21:10:07.776858+0000","last_became_peered":"2024-05-08T21:10:07.776858+0000","last_unstale":"2024-05-08T21:10:08.169408+0000","last_undegraded":"2024-05-08T21:10:08.169408+0000","last_fullsized":"2024-05-08T21:10:08.169408+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:51.725885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"26'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.170185+0000","last_change":"2024-05-08T21:10:03.326892+0000","last_active":"2024-05-08T21:10:08.170185+0000","last_peered":"2024-05-08T21:10:08.170185+0000","last_clean":"2024-05-08T21:10:08.170185+0000","last_became_active":"2024-05-08T21:10:03.326608+0000","last_became_peered":"2024-05-08T21:10:03.326608+0000","last_unstale":"2024-05-08T21:10:08.170185+0000","last_undegraded":"2024-05-08T21:10:08.170185+0000","last_fullsized":"2024-05-08T21:10:08.170185+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:33.441985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046649+0000","last_change":"2024-05-08T21:10:03.749221+0000","last_active":"2024-05-08T21:10:08.046649+0000","last_peered":"2024-05-08T21:10:08.046649+0000","last_clean":"2024-05-08T21:10:08.046649+0000","last_became_active":"2024-05-08T21:10:03.748915+0000","last_became_peered":"2024-05-08T21:10:03.748915+0000","last_unstale":"2024-05-08T21:10:08.046649+0000","last_undegraded":"2024-05-08T21:10:08.046649+0000","last_fullsized":"2024-05-08T21:10:08.046649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:03:10.791535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.187371+0000","last_change":"2024-05-08T21:10:07.759492+0000","last_active":"2024-05-08T21:10:08.187371+0000","last_peered":"2024-05-08T21:10:08.187371+0000","last_clean":"2024-05-08T21:10:08.187371+0000","last_became_active":"2024-05-08T21:10:07.759139+0000","last_became_peered":"2024-05-08T21:10:07.759139+0000","last_unstale":"2024-05-08T21:10:08.187371+0000","last_undegraded":"2024-05-08T21:10:08.187371+0000","last_fullsized":"2024-05-08T21:10:08.187371+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:10.579105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.743655+0000","last_change":"2024-05-08T21:10:03.329020+0000","last_active":"2024-05-08T21:10:07.743655+0000","last_peered":"2024-05-08T21:10:07.743655+0000","last_clean":"2024-05-08T21:10:07.743655+0000","last_became_active":"2024-05-08T21:10:03.328739+0000","last_became_peered":"2024-05-08T21:10:03.328739+0000","last_unstale":"2024-05-08T21:10:07.743655+0000","last_undegraded":"2024-05-08T21:10:07.743655+0000","last_fullsized":"2024-05-08T21:10:07.743655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:27:11.168780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.168756+0000","last_change":"2024-05-08T21:10:03.744662+0000","last_active":"2024-05-08T21:10:08.168756+0000","last_peered":"2024-05-08T21:10:08.168756+0000","last_clean":"2024-05-08T21:10:08.168756+0000","last_became_active":"2024-05-08T21:10:03.744398+0000","last_became_peered":"2024-05-08T21:10:03.744398+0000","last_unstale":"2024-05-08T21:10:08.168756+0000","last_undegraded":"2024-05-08T21:10:08.168756+0000","last_fullsized":"2024-05-08T21:10:08.168756+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:05:28.046055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.187253+0000","last_change":"2024-05-08T21:10:07.776566+0000","last_active":"2024-05-08T21:10:08.187253+0000","last_peered":"2024-05-08T21:10:08.187253+0000","last_clean":"2024-05-08T21:10:08.187253+0000","last_became_active":"2024-05-08T21:10:07.776080+0000","last_became_peered":"2024-05-08T21:10:07.776080+0000","last_unstale":"2024-05-08T21:10:08.187253+0000","last_undegraded":"2024-05-08T21:10:08.187253+0000","last_fullsized":"2024-05-08T21:10:08.187253+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:26:09.323466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.749542+0000","last_change":"2024-05-08T21:10:03.332953+0000","last_active":"2024-05-08T21:10:07.749542+0000","last_peered":"2024-05-08T21:10:07.749542+0000","last_clean":"2024-05-08T21:10:07.749542+0000","last_became_active":"2024-05-08T21:10:03.332689+0000","last_became_peered":"2024-05-08T21:10:03.332689+0000","last_unstale":"2024-05-08T21:10:07.749542+0000","last_undegraded":"2024-05-08T21:10:07.749542+0000","last_fullsized":"2024-05-08T21:10:07.749542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:15:32.058369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169816+0000","last_change":"2024-05-08T21:10:03.745651+0000","last_active":"2024-05-08T21:10:08.169816+0000","last_peered":"2024-05-08T21:10:08.169816+0000","last_clean":"2024-05-08T21:10:08.169816+0000","last_became_active":"2024-05-08T21:10:03.742744+0000","last_became_peered":"2024-05-08T21:10:03.742744+0000","last_unstale":"2024-05-08T21:10:08.169816+0000","last_undegraded":"2024-05-08T21:10:08.169816+0000","last_fullsized":"2024-05-08T21:10:08.169816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:32:31.689490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.187096+0000","last_change":"2024-05-08T21:10:07.776527+0000","last_active":"2024-05-08T21:10:08.187096+0000","last_peered":"2024-05-08T21:10:08.187096+0000","last_clean":"2024-05-08T21:10:08.187096+0000","last_became_active":"2024-05-08T21:10:07.776053+0000","last_became_peered":"2024-05-08T21:10:07.776053+0000","last_unstale":"2024-05-08T21:10:08.187096+0000","last_undegraded":"2024-05-08T21:10:08.187096+0000","last_fullsized":"2024-05-08T21:10:08.187096+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:08:26.401358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.186861+0000","last_change":"2024-05-08T21:10:03.738421+0000","last_active":"2024-05-08T21:10:08.186861+0000","last_peered":"2024-05-08T21:10:08.186861+0000","last_clean":"2024-05-08T21:10:08.186861+0000","last_became_active":"2024-05-08T21:10:03.738000+0000","last_became_peered":"2024-05-08T21:10:03.738000+0000","last_unstale":"2024-05-08T21:10:08.186861+0000","last_undegraded":"2024-05-08T21:10:08.186861+0000","last_fullsized":"2024-05-08T21:10:08.186861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:38:05.948755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.751476+0000","last_change":"2024-05-08T21:10:03.331141+0000","last_active":"2024-05-08T21:10:07.751476+0000","last_peered":"2024-05-08T21:10:07.751476+0000","last_clean":"2024-05-08T21:10:07.751476+0000","last_became_active":"2024-05-08T21:10:03.330842+0000","last_became_peered":"2024-05-08T21:10:03.330842+0000","last_unstale":"2024-05-08T21:10:07.751476+0000","last_undegraded":"2024-05-08T21:10:07.751476+0000","last_fullsized":"2024-05-08T21:10:07.751476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:42:52.648932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.271310+0000","last_change":"2024-05-08T21:10:08.049274+0000","last_active":"2024-05-08T21:10:08.271310+0000","last_peered":"2024-05-08T21:10:08.271310+0000","last_clean":"2024-05-08T21:10:08.271310+0000","last_became_active":"2024-05-08T21:10:08.048763+0000","last_became_peered":"2024-05-08T21:10:08.048763+0000","last_unstale":"2024-05-08T21:10:08.271310+0000","last_undegraded":"2024-05-08T21:10:08.271310+0000","last_fullsized":"2024-05-08T21:10:08.271310+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:00:41.257040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.754546+0000","last_change":"2024-05-08T21:10:03.747594+0000","last_active":"2024-05-08T21:10:07.754546+0000","last_peered":"2024-05-08T21:10:07.754546+0000","last_clean":"2024-05-08T21:10:07.754546+0000","last_became_active":"2024-05-08T21:10:03.747360+0000","last_became_peered":"2024-05-08T21:10:03.747360+0000","last_unstale":"2024-05-08T21:10:07.754546+0000","last_undegraded":"2024-05-08T21:10:07.754546+0000","last_fullsized":"2024-05-08T21:10:07.754546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:31:12.357348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.749455+0000","last_change":"2024-05-08T21:10:03.327847+0000","last_active":"2024-05-08T21:10:07.749455+0000","last_peered":"2024-05-08T21:10:07.749455+0000","last_clean":"2024-05-08T21:10:07.749455+0000","last_became_active":"2024-05-08T21:10:03.327530+0000","last_became_peered":"2024-05-08T21:10:03.327530+0000","last_unstale":"2024-05-08T21:10:07.749455+0000","last_undegraded":"2024-05-08T21:10:07.749455+0000","last_fullsized":"2024-05-08T21:10:07.749455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:46.232166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":168,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046147+0000","last_change":"2024-05-08T21:09:59.333990+0000","last_active":"2024-05-08T21:10:08.046147+0000","last_peered":"2024-05-08T21:10:08.046147+0000","last_clean":"2024-05-08T21:10:08.046147+0000","last_became_active":"2024-05-08T21:09:59.332929+0000","last_became_peered":"2024-05-08T21:09:59.332929+0000","last_unstale":"2024-05-08T21:10:08.046147+0000","last_undegraded":"2024-05-08T21:10:08.046147+0000","last_fullsized":"2024-05-08T21:10:08.046147+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:09:58.287675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:09:58.287675+0000","last_clean_scrub_stamp":"2024-05-08T21:09:58.287675+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:47.595380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.052138+0000","last_change":"2024-05-08T21:10:08.049848+0000","last_active":"2024-05-08T21:10:08.052138+0000","last_peered":"2024-05-08T21:10:08.052138+0000","last_clean":"2024-05-08T21:10:08.052138+0000","last_became_active":"2024-05-08T21:10:08.049153+0000","last_became_peered":"2024-05-08T21:10:08.049153+0000","last_unstale":"2024-05-08T21:10:08.052138+0000","last_undegraded":"2024-05-08T21:10:08.052138+0000","last_fullsized":"2024-05-08T21:10:08.052138+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:23.704112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.753311+0000","last_change":"2024-05-08T21:10:03.743094+0000","last_active":"2024-05-08T21:10:07.753311+0000","last_peered":"2024-05-08T21:10:07.753311+0000","last_clean":"2024-05-08T21:10:07.753311+0000","last_became_active":"2024-05-08T21:10:03.742819+0000","last_became_peered":"2024-05-08T21:10:03.742819+0000","last_unstale":"2024-05-08T21:10:07.753311+0000","last_undegraded":"2024-05-08T21:10:07.753311+0000","last_fullsized":"2024-05-08T21:10:07.753311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:41:25.593884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046341+0000","last_change":"2024-05-08T21:10:03.340259+0000","last_active":"2024-05-08T21:10:08.046341+0000","last_peered":"2024-05-08T21:10:08.046341+0000","last_clean":"2024-05-08T21:10:08.046341+0000","last_became_active":"2024-05-08T21:10:03.339957+0000","last_became_peered":"2024-05-08T21:10:03.339957+0000","last_unstale":"2024-05-08T21:10:08.046341+0000","last_undegraded":"2024-05-08T21:10:08.046341+0000","last_fullsized":"2024-05-08T21:10:08.046341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:38:36.535689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.051520+0000","last_change":"2024-05-08T21:10:08.050370+0000","last_active":"2024-05-08T21:10:08.051520+0000","last_peered":"2024-05-08T21:10:08.051520+0000","last_clean":"2024-05-08T21:10:08.051520+0000","last_became_active":"2024-05-08T21:10:08.049962+0000","last_became_peered":"2024-05-08T21:10:08.049962+0000","last_unstale":"2024-05-08T21:10:08.051520+0000","last_undegraded":"2024-05-08T21:10:08.051520+0000","last_fullsized":"2024-05-08T21:10:08.051520+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:11:35.394334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046359+0000","last_change":"2024-05-08T21:10:03.337949+0000","last_active":"2024-05-08T21:10:08.046359+0000","last_peered":"2024-05-08T21:10:08.046359+0000","last_clean":"2024-05-08T21:10:08.046359+0000","last_became_active":"2024-05-08T21:10:03.337627+0000","last_became_peered":"2024-05-08T21:10:03.337627+0000","last_unstale":"2024-05-08T21:10:08.046359+0000","last_undegraded":"2024-05-08T21:10:08.046359+0000","last_fullsized":"2024-05-08T21:10:08.046359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:17:36.792731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.187476+0000","last_change":"2024-05-08T21:10:03.738212+0000","last_active":"2024-05-08T21:10:08.187476+0000","last_peered":"2024-05-08T21:10:08.187476+0000","last_clean":"2024-05-08T21:10:08.187476+0000","last_became_active":"2024-05-08T21:10:03.737927+0000","last_became_peered":"2024-05-08T21:10:03.737927+0000","last_unstale":"2024-05-08T21:10:08.187476+0000","last_undegraded":"2024-05-08T21:10:08.187476+0000","last_fullsized":"2024-05-08T21:10:08.187476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:03:08.031584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.059425+0000","last_change":"2024-05-08T21:10:08.052270+0000","last_active":"2024-05-08T21:10:08.059425+0000","last_peered":"2024-05-08T21:10:08.059425+0000","last_clean":"2024-05-08T21:10:08.059425+0000","last_became_active":"2024-05-08T21:10:08.051881+0000","last_became_peered":"2024-05-08T21:10:08.051881+0000","last_unstale":"2024-05-08T21:10:08.059425+0000","last_undegraded":"2024-05-08T21:10:08.059425+0000","last_fullsized":"2024-05-08T21:10:08.059425+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:39:07.929942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.187471+0000","last_change":"2024-05-08T21:10:03.333696+0000","last_active":"2024-05-08T21:10:08.187471+0000","last_peered":"2024-05-08T21:10:08.187471+0000","last_clean":"2024-05-08T21:10:08.187471+0000","last_became_active":"2024-05-08T21:10:03.333368+0000","last_became_peered":"2024-05-08T21:10:03.333368+0000","last_unstale":"2024-05-08T21:10:08.187471+0000","last_undegraded":"2024-05-08T21:10:08.187471+0000","last_fullsized":"2024-05-08T21:10:08.187471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:00:08.459270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.762624+0000","last_change":"2024-05-08T21:10:03.752578+0000","last_active":"2024-05-08T21:10:07.762624+0000","last_peered":"2024-05-08T21:10:07.762624+0000","last_clean":"2024-05-08T21:10:07.762624+0000","last_became_active":"2024-05-08T21:10:03.752389+0000","last_became_peered":"2024-05-08T21:10:03.752389+0000","last_unstale":"2024-05-08T21:10:07.762624+0000","last_undegraded":"2024-05-08T21:10:07.762624+0000","last_fullsized":"2024-05-08T21:10:07.762624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:54:02.318162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169418+0000","last_change":"2024-05-08T21:10:08.048081+0000","last_active":"2024-05-08T21:10:08.169418+0000","last_peered":"2024-05-08T21:10:08.169418+0000","last_clean":"2024-05-08T21:10:08.169418+0000","last_became_active":"2024-05-08T21:10:08.047632+0000","last_became_peered":"2024-05-08T21:10:08.047632+0000","last_unstale":"2024-05-08T21:10:08.169418+0000","last_undegraded":"2024-05-08T21:10:08.169418+0000","last_fullsized":"2024-05-08T21:10:08.169418+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:26:05.857718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"26'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.738320+0000","last_change":"2024-05-08T21:10:03.340553+0000","last_active":"2024-05-08T21:10:08.738320+0000","last_peered":"2024-05-08T21:10:08.738320+0000","last_clean":"2024-05-08T21:10:08.738320+0000","last_became_active":"2024-05-08T21:10:03.340280+0000","last_became_peered":"2024-05-08T21:10:03.340280+0000","last_unstale":"2024-05-08T21:10:08.738320+0000","last_undegraded":"2024-05-08T21:10:08.738320+0000","last_fullsized":"2024-05-08T21:10:08.738320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:36:24.866220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.754313+0000","last_change":"2024-05-08T21:10:03.736316+0000","last_active":"2024-05-08T21:10:07.754313+0000","last_peered":"2024-05-08T21:10:07.754313+0000","last_clean":"2024-05-08T21:10:07.754313+0000","last_became_active":"2024-05-08T21:10:03.736049+0000","last_became_peered":"2024-05-08T21:10:03.736049+0000","last_unstale":"2024-05-08T21:10:07.754313+0000","last_undegraded":"2024-05-08T21:10:07.754313+0000","last_fullsized":"2024-05-08T21:10:07.754313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:09:48.973609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.170097+0000","last_change":"2024-05-08T21:10:07.777357+0000","last_active":"2024-05-08T21:10:08.170097+0000","last_peered":"2024-05-08T21:10:08.170097+0000","last_clean":"2024-05-08T21:10:08.170097+0000","last_became_active":"2024-05-08T21:10:07.776848+0000","last_became_peered":"2024-05-08T21:10:07.776848+0000","last_unstale":"2024-05-08T21:10:08.170097+0000","last_undegraded":"2024-05-08T21:10:08.170097+0000","last_fullsized":"2024-05-08T21:10:08.170097+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:51:47.727804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046274+0000","last_change":"2024-05-08T21:10:03.340078+0000","last_active":"2024-05-08T21:10:08.046274+0000","last_peered":"2024-05-08T21:10:08.046274+0000","last_clean":"2024-05-08T21:10:08.046274+0000","last_became_active":"2024-05-08T21:10:03.339690+0000","last_became_peered":"2024-05-08T21:10:03.339690+0000","last_unstale":"2024-05-08T21:10:08.046274+0000","last_undegraded":"2024-05-08T21:10:08.046274+0000","last_fullsized":"2024-05-08T21:10:08.046274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:01:33.991878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169765+0000","last_change":"2024-05-08T21:10:03.744606+0000","last_active":"2024-05-08T21:10:08.169765+0000","last_peered":"2024-05-08T21:10:08.169765+0000","last_clean":"2024-05-08T21:10:08.169765+0000","last_became_active":"2024-05-08T21:10:03.744160+0000","last_became_peered":"2024-05-08T21:10:03.744160+0000","last_unstale":"2024-05-08T21:10:08.169765+0000","last_undegraded":"2024-05-08T21:10:08.169765+0000","last_fullsized":"2024-05-08T21:10:08.169765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:10:25.144058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.187244+0000","last_change":"2024-05-08T21:10:08.049224+0000","last_active":"2024-05-08T21:10:08.187244+0000","last_peered":"2024-05-08T21:10:08.187244+0000","last_clean":"2024-05-08T21:10:08.187244+0000","last_became_active":"2024-05-08T21:10:08.048866+0000","last_became_peered":"2024-05-08T21:10:08.048866+0000","last_unstale":"2024-05-08T21:10:08.187244+0000","last_undegraded":"2024-05-08T21:10:08.187244+0000","last_fullsized":"2024-05-08T21:10:08.187244+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:38:20.601167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.743199+0000","last_change":"2024-05-08T21:10:03.339344+0000","last_active":"2024-05-08T21:10:07.743199+0000","last_peered":"2024-05-08T21:10:07.743199+0000","last_clean":"2024-05-08T21:10:07.743199+0000","last_became_active":"2024-05-08T21:10:03.339136+0000","last_became_peered":"2024-05-08T21:10:03.339136+0000","last_unstale":"2024-05-08T21:10:07.743199+0000","last_undegraded":"2024-05-08T21:10:07.743199+0000","last_fullsized":"2024-05-08T21:10:07.743199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:02:55.623727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.757429+0000","last_change":"2024-05-08T21:10:03.737684+0000","last_active":"2024-05-08T21:10:07.757429+0000","last_peered":"2024-05-08T21:10:07.757429+0000","last_clean":"2024-05-08T21:10:07.757429+0000","last_became_active":"2024-05-08T21:10:03.737459+0000","last_became_peered":"2024-05-08T21:10:03.737459+0000","last_unstale":"2024-05-08T21:10:07.757429+0000","last_undegraded":"2024-05-08T21:10:07.757429+0000","last_fullsized":"2024-05-08T21:10:07.757429+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:39.662018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169949+0000","last_change":"2024-05-08T21:10:07.776483+0000","last_active":"2024-05-08T21:10:08.169949+0000","last_peered":"2024-05-08T21:10:08.169949+0000","last_clean":"2024-05-08T21:10:08.169949+0000","last_became_active":"2024-05-08T21:10:07.775956+0000","last_became_peered":"2024-05-08T21:10:07.775956+0000","last_unstale":"2024-05-08T21:10:08.169949+0000","last_undegraded":"2024-05-08T21:10:08.169949+0000","last_fullsized":"2024-05-08T21:10:08.169949+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:28:17.332488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.743317+0000","last_change":"2024-05-08T21:10:03.331695+0000","last_active":"2024-05-08T21:10:07.743317+0000","last_peered":"2024-05-08T21:10:07.743317+0000","last_clean":"2024-05-08T21:10:07.743317+0000","last_became_active":"2024-05-08T21:10:03.331198+0000","last_became_peered":"2024-05-08T21:10:03.331198+0000","last_unstale":"2024-05-08T21:10:07.743317+0000","last_undegraded":"2024-05-08T21:10:07.743317+0000","last_fullsized":"2024-05-08T21:10:07.743317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:37:54.491930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.761445+0000","last_change":"2024-05-08T21:10:03.744562+0000","last_active":"2024-05-08T21:10:07.761445+0000","last_peered":"2024-05-08T21:10:07.761445+0000","last_clean":"2024-05-08T21:10:07.761445+0000","last_became_active":"2024-05-08T21:10:03.744326+0000","last_became_peered":"2024-05-08T21:10:03.744326+0000","last_unstale":"2024-05-08T21:10:07.761445+0000","last_undegraded":"2024-05-08T21:10:07.761445+0000","last_fullsized":"2024-05-08T21:10:07.761445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:21:52.947209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.170163+0000","last_change":"2024-05-08T21:10:07.763204+0000","last_active":"2024-05-08T21:10:08.170163+0000","last_peered":"2024-05-08T21:10:08.170163+0000","last_clean":"2024-05-08T21:10:08.170163+0000","last_became_active":"2024-05-08T21:10:07.762886+0000","last_became_peered":"2024-05-08T21:10:07.762886+0000","last_unstale":"2024-05-08T21:10:08.170163+0000","last_undegraded":"2024-05-08T21:10:08.170163+0000","last_fullsized":"2024-05-08T21:10:08.170163+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:01.599700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.740037+0000","last_change":"2024-05-08T21:10:03.337993+0000","last_active":"2024-05-08T21:10:08.740037+0000","last_peered":"2024-05-08T21:10:08.740037+0000","last_clean":"2024-05-08T21:10:08.740037+0000","last_became_active":"2024-05-08T21:10:03.337654+0000","last_became_peered":"2024-05-08T21:10:03.337654+0000","last_unstale":"2024-05-08T21:10:08.740037+0000","last_undegraded":"2024-05-08T21:10:08.740037+0000","last_fullsized":"2024-05-08T21:10:08.740037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:23:20.536178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.271247+0000","last_change":"2024-05-08T21:10:03.744871+0000","last_active":"2024-05-08T21:10:08.271247+0000","last_peered":"2024-05-08T21:10:08.271247+0000","last_clean":"2024-05-08T21:10:08.271247+0000","last_became_active":"2024-05-08T21:10:03.744589+0000","last_became_peered":"2024-05-08T21:10:03.744589+0000","last_unstale":"2024-05-08T21:10:08.271247+0000","last_undegraded":"2024-05-08T21:10:08.271247+0000","last_fullsized":"2024-05-08T21:10:08.271247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:41.090204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.271212+0000","last_change":"2024-05-08T21:10:08.047735+0000","last_active":"2024-05-08T21:10:08.271212+0000","last_peered":"2024-05-08T21:10:08.271212+0000","last_clean":"2024-05-08T21:10:08.271212+0000","last_became_active":"2024-05-08T21:10:08.047331+0000","last_became_peered":"2024-05-08T21:10:08.047331+0000","last_unstale":"2024-05-08T21:10:08.271212+0000","last_undegraded":"2024-05-08T21:10:08.271212+0000","last_fullsized":"2024-05-08T21:10:08.271212+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:44:22.797154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.751739+0000","last_change":"2024-05-08T21:10:03.333117+0000","last_active":"2024-05-08T21:10:07.751739+0000","last_peered":"2024-05-08T21:10:07.751739+0000","last_clean":"2024-05-08T21:10:07.751739+0000","last_became_active":"2024-05-08T21:10:03.332790+0000","last_became_peered":"2024-05-08T21:10:03.332790+0000","last_unstale":"2024-05-08T21:10:07.751739+0000","last_undegraded":"2024-05-08T21:10:07.751739+0000","last_fullsized":"2024-05-08T21:10:07.751739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:52:36.355804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046458+0000","last_change":"2024-05-08T21:10:03.748047+0000","last_active":"2024-05-08T21:10:08.046458+0000","last_peered":"2024-05-08T21:10:08.046458+0000","last_clean":"2024-05-08T21:10:08.046458+0000","last_became_active":"2024-05-08T21:10:03.747759+0000","last_became_peered":"2024-05-08T21:10:03.747759+0000","last_unstale":"2024-05-08T21:10:08.046458+0000","last_undegraded":"2024-05-08T21:10:08.046458+0000","last_fullsized":"2024-05-08T21:10:08.046458+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:11:05.309278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.775292+0000","last_change":"2024-05-08T21:10:07.761000+0000","last_active":"2024-05-08T21:10:07.775292+0000","last_peered":"2024-05-08T21:10:07.775292+0000","last_clean":"2024-05-08T21:10:07.775292+0000","last_became_active":"2024-05-08T21:10:07.760566+0000","last_became_peered":"2024-05-08T21:10:07.760566+0000","last_unstale":"2024-05-08T21:10:07.775292+0000","last_undegraded":"2024-05-08T21:10:07.775292+0000","last_fullsized":"2024-05-08T21:10:07.775292+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:48:27.435678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"26'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.187152+0000","last_change":"2024-05-08T21:10:03.331358+0000","last_active":"2024-05-08T21:10:08.187152+0000","last_peered":"2024-05-08T21:10:08.187152+0000","last_clean":"2024-05-08T21:10:08.187152+0000","last_became_active":"2024-05-08T21:10:03.331028+0000","last_became_peered":"2024-05-08T21:10:03.331028+0000","last_unstale":"2024-05-08T21:10:08.187152+0000","last_undegraded":"2024-05-08T21:10:08.187152+0000","last_fullsized":"2024-05-08T21:10:08.187152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:18:47.922157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.168527+0000","last_change":"2024-05-08T21:10:03.751285+0000","last_active":"2024-05-08T21:10:08.168527+0000","last_peered":"2024-05-08T21:10:08.168527+0000","last_clean":"2024-05-08T21:10:08.168527+0000","last_became_active":"2024-05-08T21:10:03.746557+0000","last_became_peered":"2024-05-08T21:10:03.746557+0000","last_unstale":"2024-05-08T21:10:08.168527+0000","last_undegraded":"2024-05-08T21:10:08.168527+0000","last_fullsized":"2024-05-08T21:10:08.168527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:50:27.241404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.167816+0000","last_change":"2024-05-08T21:10:08.048830+0000","last_active":"2024-05-08T21:10:08.167816+0000","last_peered":"2024-05-08T21:10:08.167816+0000","last_clean":"2024-05-08T21:10:08.167816+0000","last_became_active":"2024-05-08T21:10:08.048453+0000","last_became_peered":"2024-05-08T21:10:08.048453+0000","last_unstale":"2024-05-08T21:10:08.167816+0000","last_undegraded":"2024-05-08T21:10:08.167816+0000","last_fullsized":"2024-05-08T21:10:08.167816+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:19:28.758712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.737384+0000","last_change":"2024-05-08T21:10:03.330419+0000","last_active":"2024-05-08T21:10:08.737384+0000","last_peered":"2024-05-08T21:10:08.737384+0000","last_clean":"2024-05-08T21:10:08.737384+0000","last_became_active":"2024-05-08T21:10:03.330082+0000","last_became_peered":"2024-05-08T21:10:03.330082+0000","last_unstale":"2024-05-08T21:10:08.737384+0000","last_undegraded":"2024-05-08T21:10:08.737384+0000","last_fullsized":"2024-05-08T21:10:08.737384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:09:20.516386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046810+0000","last_change":"2024-05-08T21:10:03.747306+0000","last_active":"2024-05-08T21:10:08.046810+0000","last_peered":"2024-05-08T21:10:08.046810+0000","last_clean":"2024-05-08T21:10:08.046810+0000","last_became_active":"2024-05-08T21:10:03.746755+0000","last_became_peered":"2024-05-08T21:10:03.746755+0000","last_unstale":"2024-05-08T21:10:08.046810+0000","last_undegraded":"2024-05-08T21:10:08.046810+0000","last_fullsized":"2024-05-08T21:10:08.046810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:17:51.344821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.271171+0000","last_change":"2024-05-08T21:10:03.738627+0000","last_active":"2024-05-08T21:10:08.271171+0000","last_peered":"2024-05-08T21:10:08.271171+0000","last_clean":"2024-05-08T21:10:08.271171+0000","last_became_active":"2024-05-08T21:10:03.738338+0000","last_became_peered":"2024-05-08T21:10:03.738338+0000","last_unstale":"2024-05-08T21:10:08.271171+0000","last_undegraded":"2024-05-08T21:10:08.271171+0000","last_fullsized":"2024-05-08T21:10:08.271171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:34.088831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.751564+0000","last_change":"2024-05-08T21:10:03.745607+0000","last_active":"2024-05-08T21:10:07.751564+0000","last_peered":"2024-05-08T21:10:07.751564+0000","last_clean":"2024-05-08T21:10:07.751564+0000","last_became_active":"2024-05-08T21:10:03.745362+0000","last_became_peered":"2024-05-08T21:10:03.745362+0000","last_unstale":"2024-05-08T21:10:07.751564+0000","last_undegraded":"2024-05-08T21:10:07.751564+0000","last_fullsized":"2024-05-08T21:10:07.751564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:54.399930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.168448+0000","last_change":"2024-05-08T21:10:03.745137+0000","last_active":"2024-05-08T21:10:08.168448+0000","last_peered":"2024-05-08T21:10:08.168448+0000","last_clean":"2024-05-08T21:10:08.168448+0000","last_became_active":"2024-05-08T21:10:03.744844+0000","last_became_peered":"2024-05-08T21:10:03.744844+0000","last_unstale":"2024-05-08T21:10:08.168448+0000","last_undegraded":"2024-05-08T21:10:08.168448+0000","last_fullsized":"2024-05-08T21:10:08.168448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:06.853429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.753792+0000","last_change":"2024-05-08T21:10:03.745163+0000","last_active":"2024-05-08T21:10:07.753792+0000","last_peered":"2024-05-08T21:10:07.753792+0000","last_clean":"2024-05-08T21:10:07.753792+0000","last_became_active":"2024-05-08T21:10:03.744908+0000","last_became_peered":"2024-05-08T21:10:03.744908+0000","last_unstale":"2024-05-08T21:10:07.753792+0000","last_undegraded":"2024-05-08T21:10:07.753792+0000","last_fullsized":"2024-05-08T21:10:07.753792+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:06.593989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.762986+0000","last_change":"2024-05-08T21:10:03.748542+0000","last_active":"2024-05-08T21:10:07.762986+0000","last_peered":"2024-05-08T21:10:07.762986+0000","last_clean":"2024-05-08T21:10:07.762986+0000","last_became_active":"2024-05-08T21:10:03.748284+0000","last_became_peered":"2024-05-08T21:10:03.748284+0000","last_unstale":"2024-05-08T21:10:07.762986+0000","last_undegraded":"2024-05-08T21:10:07.762986+0000","last_fullsized":"2024-05-08T21:10:07.762986+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:49:10.430406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.187090+0000","last_change":"2024-05-08T21:10:03.739778+0000","last_active":"2024-05-08T21:10:08.187090+0000","last_peered":"2024-05-08T21:10:08.187090+0000","last_clean":"2024-05-08T21:10:08.187090+0000","last_became_active":"2024-05-08T21:10:03.739522+0000","last_became_peered":"2024-05-08T21:10:03.739522+0000","last_unstale":"2024-05-08T21:10:08.187090+0000","last_undegraded":"2024-05-08T21:10:08.187090+0000","last_fullsized":"2024-05-08T21:10:08.187090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:07:42.115999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.271345+0000","last_change":"2024-05-08T21:10:03.746126+0000","last_active":"2024-05-08T21:10:08.271345+0000","last_peered":"2024-05-08T21:10:08.271345+0000","last_clean":"2024-05-08T21:10:08.271345+0000","last_became_active":"2024-05-08T21:10:03.745842+0000","last_became_peered":"2024-05-08T21:10:03.745842+0000","last_unstale":"2024-05-08T21:10:08.271345+0000","last_undegraded":"2024-05-08T21:10:08.271345+0000","last_fullsized":"2024-05-08T21:10:08.271345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:51:06.176371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.762738+0000","last_change":"2024-05-08T21:10:03.745007+0000","last_active":"2024-05-08T21:10:07.762738+0000","last_peered":"2024-05-08T21:10:07.762738+0000","last_clean":"2024-05-08T21:10:07.762738+0000","last_became_active":"2024-05-08T21:10:03.744709+0000","last_became_peered":"2024-05-08T21:10:03.744709+0000","last_unstale":"2024-05-08T21:10:07.762738+0000","last_undegraded":"2024-05-08T21:10:07.762738+0000","last_fullsized":"2024-05-08T21:10:07.762738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:12:20.712861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.167909+0000","last_change":"2024-05-08T21:10:03.751111+0000","last_active":"2024-05-08T21:10:08.167909+0000","last_peered":"2024-05-08T21:10:08.167909+0000","last_clean":"2024-05-08T21:10:08.167909+0000","last_became_active":"2024-05-08T21:10:03.747059+0000","last_became_peered":"2024-05-08T21:10:03.747059+0000","last_unstale":"2024-05-08T21:10:08.167909+0000","last_undegraded":"2024-05-08T21:10:08.167909+0000","last_fullsized":"2024-05-08T21:10:08.167909+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:43.254221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.766689+0000","last_change":"2024-05-08T21:10:03.747207+0000","last_active":"2024-05-08T21:10:07.766689+0000","last_peered":"2024-05-08T21:10:07.766689+0000","last_clean":"2024-05-08T21:10:07.766689+0000","last_became_active":"2024-05-08T21:10:03.746942+0000","last_became_peered":"2024-05-08T21:10:03.746942+0000","last_unstale":"2024-05-08T21:10:07.766689+0000","last_undegraded":"2024-05-08T21:10:07.766689+0000","last_fullsized":"2024-05-08T21:10:07.766689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:33:52.317273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.168575+0000","last_change":"2024-05-08T21:10:03.753663+0000","last_active":"2024-05-08T21:10:08.168575+0000","last_peered":"2024-05-08T21:10:08.168575+0000","last_clean":"2024-05-08T21:10:08.168575+0000","last_became_active":"2024-05-08T21:10:03.752486+0000","last_became_peered":"2024-05-08T21:10:03.752486+0000","last_unstale":"2024-05-08T21:10:08.168575+0000","last_undegraded":"2024-05-08T21:10:08.168575+0000","last_fullsized":"2024-05-08T21:10:08.168575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:21:45.895154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.753497+0000","last_change":"2024-05-08T21:10:03.753849+0000","last_active":"2024-05-08T21:10:07.753497+0000","last_peered":"2024-05-08T21:10:07.753497+0000","last_clean":"2024-05-08T21:10:07.753497+0000","last_became_active":"2024-05-08T21:10:03.753616+0000","last_became_peered":"2024-05-08T21:10:03.753616+0000","last_unstale":"2024-05-08T21:10:07.753497+0000","last_undegraded":"2024-05-08T21:10:07.753497+0000","last_fullsized":"2024-05-08T21:10:07.753497+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:02:58.650310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.271297+0000","last_change":"2024-05-08T21:10:03.744906+0000","last_active":"2024-05-08T21:10:08.271297+0000","last_peered":"2024-05-08T21:10:08.271297+0000","last_clean":"2024-05-08T21:10:08.271297+0000","last_became_active":"2024-05-08T21:10:03.744562+0000","last_became_peered":"2024-05-08T21:10:03.744562+0000","last_unstale":"2024-05-08T21:10:08.271297+0000","last_undegraded":"2024-05-08T21:10:08.271297+0000","last_fullsized":"2024-05-08T21:10:08.271297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:21:30.416392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64612,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4594,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":110038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]}]},{"osd":5,"up_from":15,"seq":64424509449,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":106332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]}]},{"osd":0,"up_from":14,"seq":60129542153,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":348160,"data_stored":697248,"data_compressed":32306,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]}]},{"osd":7,"up_from":14,"seq":60129542152,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":339968,"data_stored":697192,"data_compressed":32306,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":106242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.245}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]}]},{"osd":3,"up_from":14,"seq":60129542152,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":110038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.253}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]}]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":106402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]}]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":106368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32306,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32306,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T21:10:32.820 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-05-08T21:10:32.821 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-08T21:10:32.821 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-05-08T21:10:32.821 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-05-08T21:10:32.821 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-05-08T21:10:32.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.973+0000 7f0b8fbba700 1 Processor -- start 2024-05-08T21:10:32.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.973+0000 7f0b8fbba700 1 -- start start 2024-05-08T21:10:32.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.974+0000 7f0b8fbba700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0b88141450 0x7f0b8806dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:32.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.974+0000 7f0b8fbba700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0b8806eff0 0x7f0b88158ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:32.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.974+0000 7f0b8fbba700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b880c57f0 con 0x7f0b880c7120 2024-05-08T21:10:32.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.974+0000 7f0b8fbba700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b880c5a40 con 0x7f0b88141450 2024-05-08T21:10:32.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.974+0000 7f0b8fbba700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b880cae60 con 0x7f0b8806eff0 2024-05-08T21:10:32.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.974+0000 7f0b8e157700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f0b880c7120 0x7f0b8815b550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41766/0 (socket says 172.21.15.80:41766) 2024-05-08T21:10:32.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.974+0000 7f0b8e157700 1 -- 172.21.15.80:0/1892564150 learned_addr learned my addr 172.21.15.80:0/1892564150 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:10:32.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.974+0000 7f0b8d956700 1 --2- 172.21.15.80:0/1892564150 >> v2:172.21.15.106:3300/0 conn(0x7f0b88141450 0x7f0b8806dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:32.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.974+0000 7f0b8d155700 1 --2- 172.21.15.80:0/1892564150 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0b8806eff0 0x7f0b88158ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:32.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.974+0000 7f0b8c954700 1 -- 172.21.15.80:0/1892564150 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4134497690 0 0) 0x7f0b880c57f0 con 0x7f0b880c7120 2024-05-08T21:10:32.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.974+0000 7f0b8c954700 1 -- 172.21.15.80:0/1892564150 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b740035b0 con 0x7f0b880c7120 2024-05-08T21:10:32.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.974+0000 7f0b8c954700 1 -- 172.21.15.80:0/1892564150 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4292134422 0 0) 0x7f0b740035b0 con 0x7f0b880c7120 2024-05-08T21:10:32.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.974+0000 7f0b8c954700 1 -- 172.21.15.80:0/1892564150 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0b8806eff0 msgr2=0x7f0b88158ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:32.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.974+0000 7f0b8c954700 1 --2- 172.21.15.80:0/1892564150 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0b8806eff0 0x7f0b88158ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:32.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.974+0000 7f0b8c954700 1 -- 172.21.15.80:0/1892564150 >> v2:172.21.15.106:3300/0 conn(0x7f0b88141450 msgr2=0x7f0b8806dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:32.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.974+0000 7f0b8c954700 1 --2- 172.21.15.80:0/1892564150 >> v2:172.21.15.106:3300/0 conn(0x7f0b88141450 0x7f0b8806dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:32.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.974+0000 7f0b8c954700 1 -- 172.21.15.80:0/1892564150 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b880cb140 con 0x7f0b880c7120 2024-05-08T21:10:32.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.974+0000 7f0b8c954700 1 -- 172.21.15.80:0/1892564150 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3520646302 0 0) 0x7f0b800019f0 con 0x7f0b880c7120 2024-05-08T21:10:32.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.974+0000 7f0b8c954700 1 -- 172.21.15.80:0/1892564150 >> v1:172.21.15.80:6789/0 conn(0x7f0b880c7120 legacy=0x7f0b8815b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:32.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.974+0000 7f0b8c954700 1 --2- 172.21.15.80:0/1892564150 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b74003a00 0x7f0b74003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:32.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.975+0000 7f0b8c954700 1 --2- 172.21.15.80:0/1892564150 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b74004850 0x7f0b74004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:32.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.975+0000 7f0b8c954700 1 --2- 172.21.15.80:0/1892564150 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0b8806eff0 0x7f0b74005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:32.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.975+0000 7f0b8c954700 1 -- 172.21.15.80:0/1892564150 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b880c5a40 con 0x7f0b74003a00 2024-05-08T21:10:32.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.975+0000 7f0b8c954700 1 -- 172.21.15.80:0/1892564150 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b880cae60 con 0x7f0b74004850 2024-05-08T21:10:32.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.975+0000 7f0b8c954700 1 -- 172.21.15.80:0/1892564150 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7400ba10 con 0x7f0b8806eff0 2024-05-08T21:10:32.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.975+0000 7f0b8d956700 1 --2- 172.21.15.80:0/1892564150 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b74003a00 0x7f0b74003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:32.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.975+0000 7f0b8d155700 1 --2- 172.21.15.80:0/1892564150 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b74004850 0x7f0b74004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:32.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.975+0000 7f0b8e157700 1 --2- 172.21.15.80:0/1892564150 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0b8806eff0 0x7f0b74005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:32.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.975+0000 7f0b8d956700 1 -- 172.21.15.80:0/1892564150 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0b8806eff0 msgr2=0x7f0b74005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:32.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.975+0000 7f0b8d956700 1 --2- 172.21.15.80:0/1892564150 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0b8806eff0 0x7f0b74005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:32.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.975+0000 7f0b8d956700 1 -- 172.21.15.80:0/1892564150 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b74004850 msgr2=0x7f0b74004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:32.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.975+0000 7f0b8d956700 1 --2- 172.21.15.80:0/1892564150 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b74004850 0x7f0b74004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:32.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.975+0000 7f0b8d956700 1 -- 172.21.15.80:0/1892564150 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b740035b0 con 0x7f0b74003a00 2024-05-08T21:10:32.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.975+0000 7f0b8d956700 1 --2- 172.21.15.80:0/1892564150 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b74003a00 0x7f0b74003e20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0b84009b60 tx=0x7f0b74005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=628b432fbfa4678e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:32.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.975+0000 7f0b8c954700 1 -- 172.21.15.80:0/1892564150 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8400e6c0 con 0x7f0b74003a00 2024-05-08T21:10:32.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.975+0000 7f0b8c954700 1 -- 172.21.15.80:0/1892564150 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b8400e820 con 0x7f0b74003a00 2024-05-08T21:10:32.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.975+0000 7f0b8c954700 1 -- 172.21.15.80:0/1892564150 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8400eb90 con 0x7f0b74003a00 2024-05-08T21:10:32.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.976+0000 7f0b8fbba700 1 -- 172.21.15.80:0/1892564150 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b74003a00 msgr2=0x7f0b74003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:32.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.976+0000 7f0b8fbba700 1 --2- 172.21.15.80:0/1892564150 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b74003a00 0x7f0b74003e20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0b84009b60 tx=0x7f0b74005880 comp rx=0 tx=0).stop 2024-05-08T21:10:32.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.976+0000 7f0b8e157700 1 -- 172.21.15.80:0/1892564150 reap_dead start 2024-05-08T21:10:32.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.976+0000 7f0b8fbba700 1 -- 172.21.15.80:0/1892564150 shutdown_connections 2024-05-08T21:10:32.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.976+0000 7f0b8fbba700 1 -- 172.21.15.80:0/1892564150 >> 172.21.15.80:0/1892564150 conn(0x7f0b880ca340 msgr2=0x7f0b880ca750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:32.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.976+0000 7f0b8fbba700 1 -- 172.21.15.80:0/1892564150 shutdown_connections 2024-05-08T21:10:32.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.976+0000 7f0b8fbba700 1 -- 172.21.15.80:0/1892564150 wait complete. 2024-05-08T21:10:32.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.977+0000 7f0b8fbba700 1 Processor -- start 2024-05-08T21:10:32.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.977+0000 7f0b8fbba700 1 -- start start 2024-05-08T21:10:32.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.978+0000 7f0b8fbba700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0b74003a00 0x7f0b881df410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:32.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.978+0000 7f0b8fbba700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b881564b0 0x7f0b881df950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:32.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.978+0000 7f0b8fbba700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b8813bef0 0x7f0b8813c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:32.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.978+0000 7f0b8fbba700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b881e07a0 con 0x7f0b8813bef0 2024-05-08T21:10:32.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.978+0000 7f0b8fbba700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b881de310 con 0x7f0b881564b0 2024-05-08T21:10:32.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.978+0000 7f0b8fbba700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b88151c70 con 0x7f0b74003a00 2024-05-08T21:10:32.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.978+0000 7f0b8e157700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b8813bef0 0x7f0b8813c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:32.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.978+0000 7f0b8e157700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b8813bef0 0x7f0b8813c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42286/0 (socket says 172.21.15.80:42286) 2024-05-08T21:10:32.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.978+0000 7f0b8e157700 1 -- 172.21.15.80:0/1245355570 learned_addr learned my addr 172.21.15.80:0/1245355570 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:32.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.978+0000 7f0b8d956700 1 --2- 172.21.15.80:0/1245355570 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0b74003a00 0x7f0b881df410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:32.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.978+0000 7f0b8d155700 1 --2- 172.21.15.80:0/1245355570 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b881564b0 0x7f0b881df950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:32.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.978+0000 7f0b8e157700 1 -- 172.21.15.80:0/1245355570 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0b74003a00 msgr2=0x7f0b881df410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:32.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.978+0000 7f0b8e157700 1 --2- 172.21.15.80:0/1245355570 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0b74003a00 0x7f0b881df410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:32.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.978+0000 7f0b8e157700 1 -- 172.21.15.80:0/1245355570 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b881564b0 msgr2=0x7f0b881df950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:32.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.978+0000 7f0b8e157700 1 --2- 172.21.15.80:0/1245355570 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b881564b0 0x7f0b881df950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:32.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.978+0000 7f0b8e157700 1 -- 172.21.15.80:0/1245355570 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b88151f30 con 0x7f0b8813bef0 2024-05-08T21:10:32.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.978+0000 7f0b8e157700 1 --2- 172.21.15.80:0/1245355570 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b8813bef0 0x7f0b8813c350 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0b88071e90 tx=0x7f0b80007c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:32.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.978+0000 7f0b7e7fc700 1 -- 172.21.15.80:0/1245355570 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8000ed90 con 0x7f0b8813bef0 2024-05-08T21:10:32.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.978+0000 7f0b7e7fc700 1 -- 172.21.15.80:0/1245355570 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b80013420 con 0x7f0b8813bef0 2024-05-08T21:10:32.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.978+0000 7f0b8fbba700 1 -- 172.21.15.80:0/1245355570 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b881ee2b0 con 0x7f0b8813bef0 2024-05-08T21:10:32.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.978+0000 7f0b7e7fc700 1 -- 172.21.15.80:0/1245355570 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b800137d0 con 0x7f0b8813bef0 2024-05-08T21:10:32.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.978+0000 7f0b8fbba700 1 -- 172.21.15.80:0/1245355570 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b881e1470 con 0x7f0b8813bef0 2024-05-08T21:10:32.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.979+0000 7f0b8fbba700 1 -- 172.21.15.80:0/1245355570 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b880c7c50 con 0x7f0b8813bef0 2024-05-08T21:10:32.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.980+0000 7f0b7e7fc700 1 -- 172.21.15.80:0/1245355570 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0b80013930 con 0x7f0b8813bef0 2024-05-08T21:10:32.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.980+0000 7f0b7e7fc700 1 --2- 172.21.15.80:0/1245355570 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f0b6c06ac90 0x7f0b6c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:32.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.980+0000 7f0b7e7fc700 1 -- 172.21.15.80:0/1245355570 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0b80089cd0 con 0x7f0b8813bef0 2024-05-08T21:10:32.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.980+0000 7f0b8d956700 1 --2- 172.21.15.80:0/1245355570 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f0b6c06ac90 0x7f0b6c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:32.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.981+0000 7f0b8d956700 1 --2- 172.21.15.80:0/1245355570 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f0b6c06ac90 0x7f0b6c06d150 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0b840090b0 tx=0x7f0b84008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:32.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:32.985+0000 7f0b7e7fc700 1 -- 172.21.15.80:0/1245355570 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f0b80054bc0 con 0x7f0b8813bef0 2024-05-08T21:10:33.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.239+0000 7f0b8fbba700 1 -- 172.21.15.80:0/1245355570 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f0b881ee4a0 con 0x7f0b8813bef0 2024-05-08T21:10:33.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.242+0000 7f0b7e7fc700 1 -- 172.21.15.80:0/1245355570 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+170934 (secure 0 0 0) 0x7f0b800581e0 con 0x7f0b8813bef0 2024-05-08T21:10:33.247 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:10:33.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.245+0000 7f0b8fbba700 1 -- 172.21.15.80:0/1245355570 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f0b6c06ac90 msgr2=0x7f0b6c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:33.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.245+0000 7f0b8fbba700 1 --2- 172.21.15.80:0/1245355570 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f0b6c06ac90 0x7f0b6c06d150 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0b840090b0 tx=0x7f0b84008030 comp rx=0 tx=0).stop 2024-05-08T21:10:33.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.245+0000 7f0b8fbba700 1 -- 172.21.15.80:0/1245355570 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b8813bef0 msgr2=0x7f0b8813c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:33.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.245+0000 7f0b8fbba700 1 --2- 172.21.15.80:0/1245355570 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b8813bef0 0x7f0b8813c350 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0b88071e90 tx=0x7f0b80007c90 comp rx=0 tx=0).stop 2024-05-08T21:10:33.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.245+0000 7f0b8fbba700 1 -- 172.21.15.80:0/1245355570 shutdown_connections 2024-05-08T21:10:33.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.245+0000 7f0b8fbba700 1 --2- 172.21.15.80:0/1245355570 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f0b6c06ac90 0x7f0b6c06d150 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:33.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.245+0000 7f0b8fbba700 1 --2- 172.21.15.80:0/1245355570 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0b8813bef0 0x7f0b8813c350 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:33.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.245+0000 7f0b8fbba700 1 --2- 172.21.15.80:0/1245355570 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0b74003a00 0x7f0b881df410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:33.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.245+0000 7f0b8fbba700 1 --2- 172.21.15.80:0/1245355570 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b881564b0 0x7f0b881df950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:33.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.245+0000 7f0b8fbba700 1 -- 172.21.15.80:0/1245355570 >> 172.21.15.80:0/1245355570 conn(0x7f0b880ca340 msgr2=0x7f0b88072500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:33.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.245+0000 7f0b8fbba700 1 -- 172.21.15.80:0/1245355570 shutdown_connections 2024-05-08T21:10:33.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.245+0000 7f0b8fbba700 1 -- 172.21.15.80:0/1245355570 wait complete. 2024-05-08T21:10:33.260 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":46731},{"type":"v1","addr":"172.21.15.80:6833","nonce":46731}]},"active_addr":"172.21.15.80:6833/46731","active_change":"2024-05-08T21:09:52.190127+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4108,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.80:0","nonce":528811518}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.80:0","nonce":143556843}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.80:0","nonce":3156115500}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.80:0","nonce":654466545}]}]} 2024-05-08T21:10:33.264 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-05-08T21:10:33.264 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-08T21:10:33.264 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T21:10:33.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.384+0000 7f6c5639e700 1 Processor -- start 2024-05-08T21:10:33.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.384+0000 7f6c5639e700 1 -- start start 2024-05-08T21:10:33.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.385+0000 7f6c5639e700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6c500cbe20 0x7f6c500c4c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:33.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.385+0000 7f6c5639e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6c500c5190 0x7f6c500bfa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:33.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.385+0000 7f6c5639e700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c50158480 con 0x7f6c50141290 2024-05-08T21:10:33.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.385+0000 7f6c5639e700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c500c5570 con 0x7f6c500c5190 2024-05-08T21:10:33.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.385+0000 7f6c5639e700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c50158760 con 0x7f6c500cbe20 2024-05-08T21:10:33.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.385+0000 7f6c5493b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6c500c5190 0x7f6c500bfa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:33.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.385+0000 7f6c5493b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6c500c5190 0x7f6c500bfa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42288/0 (socket says 172.21.15.80:42288) 2024-05-08T21:10:33.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.385+0000 7f6c5493b700 1 -- 172.21.15.80:0/696389955 learned_addr learned my addr 172.21.15.80:0/696389955 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:33.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.385+0000 7f6c4f7fe700 1 --2- 172.21.15.80:0/696389955 >> v2:172.21.15.106:3300/0 conn(0x7f6c500cbe20 0x7f6c500c4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:33.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.385+0000 7f6c5493b700 1 -- 172.21.15.80:0/696389955 >> v2:172.21.15.106:3300/0 conn(0x7f6c500cbe20 msgr2=0x7f6c500c4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:33.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.385+0000 7f6c5493b700 1 --2- 172.21.15.80:0/696389955 >> v2:172.21.15.106:3300/0 conn(0x7f6c500cbe20 0x7f6c500c4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:33.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.386+0000 7f6c5493b700 1 -- 172.21.15.80:0/696389955 >> v1:172.21.15.106:6789/0 conn(0x7f6c50141290 legacy=0x7f6c500c60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:33.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.386+0000 7f6c5493b700 1 -- 172.21.15.80:0/696389955 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c50158a40 con 0x7f6c500c5190 2024-05-08T21:10:33.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.386+0000 7f6c5493b700 1 --2- 172.21.15.80:0/696389955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c500c5190 0x7f6c500bfa60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6c500737e0 tx=0x7f6c4800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=768c845bac5b1871 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:33.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.386+0000 7f6c4effd700 1 -- 172.21.15.80:0/696389955 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4800e070 con 0x7f6c500c5190 2024-05-08T21:10:33.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.386+0000 7f6c4effd700 1 -- 172.21.15.80:0/696389955 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c4800b9c0 con 0x7f6c500c5190 2024-05-08T21:10:33.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.386+0000 7f6c4effd700 1 -- 172.21.15.80:0/696389955 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4800bd70 con 0x7f6c500c5190 2024-05-08T21:10:33.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.386+0000 7f6c5639e700 1 -- 172.21.15.80:0/696389955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c500c5190 msgr2=0x7f6c500bfa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:33.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.386+0000 7f6c5639e700 1 --2- 172.21.15.80:0/696389955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c500c5190 0x7f6c500bfa60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6c500737e0 tx=0x7f6c4800b330 comp rx=0 tx=0).stop 2024-05-08T21:10:33.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.386+0000 7f6c5639e700 1 -- 172.21.15.80:0/696389955 shutdown_connections 2024-05-08T21:10:33.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.386+0000 7f6c5639e700 1 --2- 172.21.15.80:0/696389955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c500c5190 0x7f6c500bfa60 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:33.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.386+0000 7f6c5639e700 1 --2- 172.21.15.80:0/696389955 >> v2:172.21.15.106:3300/0 conn(0x7f6c500cbe20 0x7f6c500c4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:33.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.386+0000 7f6c5639e700 1 -- 172.21.15.80:0/696389955 >> 172.21.15.80:0/696389955 conn(0x7f6c5006a9c0 msgr2=0x7f6c5006ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:33.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.386+0000 7f6c5639e700 1 -- 172.21.15.80:0/696389955 shutdown_connections 2024-05-08T21:10:33.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.386+0000 7f6c5639e700 1 -- 172.21.15.80:0/696389955 wait complete. 2024-05-08T21:10:33.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.388+0000 7f6c5639e700 1 Processor -- start 2024-05-08T21:10:33.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.388+0000 7f6c5639e700 1 -- start start 2024-05-08T21:10:33.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.389+0000 7f6c5639e700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6c500c5190 0x7f6c501df4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:33.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.389+0000 7f6c5639e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c500cbe20 0x7f6c501dfa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:33.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.389+0000 7f6c5639e700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c50141290 0x7f6c5013fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:33.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.389+0000 7f6c5639e700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c501e0c50 con 0x7f6c500cbe20 2024-05-08T21:10:33.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.389+0000 7f6c5639e700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c501df010 con 0x7f6c50141290 2024-05-08T21:10:33.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.389+0000 7f6c5639e700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c501de3d0 con 0x7f6c500c5190 2024-05-08T21:10:33.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.389+0000 7f6c4f7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c500cbe20 0x7f6c501dfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:33.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.389+0000 7f6c4f7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c500cbe20 0x7f6c501dfa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42290/0 (socket says 172.21.15.80:42290) 2024-05-08T21:10:33.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.389+0000 7f6c4f7fe700 1 -- 172.21.15.80:0/68552921 learned_addr learned my addr 172.21.15.80:0/68552921 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:33.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.389+0000 7f6c5493b700 1 --2- 172.21.15.80:0/68552921 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c50141290 0x7f6c5013fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:33.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.389+0000 7f6c4ffff700 1 --2- 172.21.15.80:0/68552921 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6c500c5190 0x7f6c501df4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:33.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.389+0000 7f6c4f7fe700 1 -- 172.21.15.80:0/68552921 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6c500c5190 msgr2=0x7f6c501df4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:33.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.389+0000 7f6c4f7fe700 1 --2- 172.21.15.80:0/68552921 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6c500c5190 0x7f6c501df4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:33.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.389+0000 7f6c4f7fe700 1 -- 172.21.15.80:0/68552921 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c50141290 msgr2=0x7f6c5013fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:33.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.389+0000 7f6c4f7fe700 1 --2- 172.21.15.80:0/68552921 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c50141290 0x7f6c5013fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:33.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.389+0000 7f6c4f7fe700 1 -- 172.21.15.80:0/68552921 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c48009b30 con 0x7f6c500cbe20 2024-05-08T21:10:33.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.389+0000 7f6c5493b700 1 --2- 172.21.15.80:0/68552921 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c50141290 0x7f6c5013fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:10:33.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.389+0000 7f6c4ffff700 1 --2- 172.21.15.80:0/68552921 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6c500c5190 0x7f6c501df4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:10:33.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.390+0000 7f6c4f7fe700 1 --2- 172.21.15.80:0/68552921 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c500cbe20 0x7f6c501dfa00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6c4000e840 tx=0x7f6c4000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:33.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.390+0000 7f6c4cff9700 1 -- 172.21.15.80:0/68552921 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c40013610 con 0x7f6c500cbe20 2024-05-08T21:10:33.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.390+0000 7f6c4cff9700 1 -- 172.21.15.80:0/68552921 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c40013770 con 0x7f6c500cbe20 2024-05-08T21:10:33.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.390+0000 7f6c5639e700 1 -- 172.21.15.80:0/68552921 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c501de6b0 con 0x7f6c500cbe20 2024-05-08T21:10:33.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.390+0000 7f6c4cff9700 1 -- 172.21.15.80:0/68552921 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c40013b20 con 0x7f6c500cbe20 2024-05-08T21:10:33.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.390+0000 7f6c5639e700 1 -- 172.21.15.80:0/68552921 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c501dec70 con 0x7f6c500cbe20 2024-05-08T21:10:33.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.391+0000 7f6c5639e700 1 -- 172.21.15.80:0/68552921 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c501df1e0 con 0x7f6c500cbe20 2024-05-08T21:10:33.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.391+0000 7f6c4cff9700 1 -- 172.21.15.80:0/68552921 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6c40013c80 con 0x7f6c500cbe20 2024-05-08T21:10:33.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.391+0000 7f6c4cff9700 1 --2- 172.21.15.80:0/68552921 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f6c3c06acc0 0x7f6c3c06d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:33.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.392+0000 7f6c4cff9700 1 -- 172.21.15.80:0/68552921 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6c400892e0 con 0x7f6c500cbe20 2024-05-08T21:10:33.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.392+0000 7f6c4ffff700 1 --2- 172.21.15.80:0/68552921 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f6c3c06acc0 0x7f6c3c06d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:33.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.392+0000 7f6c4ffff700 1 --2- 172.21.15.80:0/68552921 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f6c3c06acc0 0x7f6c3c06d180 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6c44000f60 tx=0x7f6c44009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:33.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.396+0000 7f6c4cff9700 1 -- 172.21.15.80:0/68552921 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f6c501df1e0 con 0x7f6c500cbe20 2024-05-08T21:10:33.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.593+0000 7f6c5639e700 1 -- 172.21.15.80:0/68552921 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6c501df1e0 con 0x7f6c500cbe20 2024-05-08T21:10:33.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.594+0000 7f6c4cff9700 1 -- 172.21.15.80:0/68552921 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+17878 (secure 0 0 0) 0x7f6c501df1e0 con 0x7f6c500cbe20 2024-05-08T21:10:33.598 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:10:33.598 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":26,"fsid":"44d31c1e-aad3-47ca-a4fa-85a63d4a60aa","created":"2024-05-08T21:09:46.467038+0000","modified":"2024-05-08T21:10:08.163735+0000","last_up_change":"2024-05-08T21:09:57.284675+0000","last_in_change":"2024-05-08T21:09:49.125444+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T21:09:58.238951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T21:10:02.177476+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T21:10:02.685535+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-08T21:10:05.753779+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c3f9d93e-ed6d-4a0c-b5c0-0e8d44c65fdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":47011},{"type":"v1","addr":"172.21.15.80:6817","nonce":47011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":47011},{"type":"v1","addr":"172.21.15.80:6819","nonce":47011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":47011},{"type":"v1","addr":"172.21.15.80:6823","nonce":47011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":47011},{"type":"v1","addr":"172.21.15.80:6821","nonce":47011}]},"public_addr":"172.21.15.80:6817/47011","cluster_addr":"172.21.15.80:6819/47011","heartbeat_back_addr":"172.21.15.80:6823/47011","heartbeat_front_addr":"172.21.15.80:6821/47011","state":["exists","up"]},{"osd":1,"uuid":"4ce2b4d6-6c40-43aa-8dd1-743fef8915df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":47010},{"type":"v1","addr":"172.21.15.80:6809","nonce":47010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":47010},{"type":"v1","addr":"172.21.15.80:6811","nonce":47010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":47010},{"type":"v1","addr":"172.21.15.80:6815","nonce":47010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":47010},{"type":"v1","addr":"172.21.15.80:6813","nonce":47010}]},"public_addr":"172.21.15.80:6809/47010","cluster_addr":"172.21.15.80:6811/47010","heartbeat_back_addr":"172.21.15.80:6815/47010","heartbeat_front_addr":"172.21.15.80:6813/47010","state":["exists","up"]},{"osd":2,"uuid":"e30cc3bc-6461-4fac-960a-de00c9488d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":47009},{"type":"v1","addr":"172.21.15.80:6801","nonce":47009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":47009},{"type":"v1","addr":"172.21.15.80:6803","nonce":47009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":47009},{"type":"v1","addr":"172.21.15.80:6807","nonce":47009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":47009},{"type":"v1","addr":"172.21.15.80:6805","nonce":47009}]},"public_addr":"172.21.15.80:6801/47009","cluster_addr":"172.21.15.80:6803/47009","heartbeat_back_addr":"172.21.15.80:6807/47009","heartbeat_front_addr":"172.21.15.80:6805/47009","state":["exists","up"]},{"osd":3,"uuid":"a415c099-9ea6-40be-98ed-f2932f98dfd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":47012},{"type":"v1","addr":"172.21.15.80:6825","nonce":47012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":47012},{"type":"v1","addr":"172.21.15.80:6827","nonce":47012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":47012},{"type":"v1","addr":"172.21.15.80:6831","nonce":47012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":47012},{"type":"v1","addr":"172.21.15.80:6829","nonce":47012}]},"public_addr":"172.21.15.80:6825/47012","cluster_addr":"172.21.15.80:6827/47012","heartbeat_back_addr":"172.21.15.80:6831/47012","heartbeat_front_addr":"172.21.15.80:6829/47012","state":["exists","up"]},{"osd":4,"uuid":"5ae1d51f-0918-4571-b79b-154308d46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6823","nonce":47114},{"type":"v1","addr":"172.21.15.106:6825","nonce":47114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":47114},{"type":"v1","addr":"172.21.15.106:6827","nonce":47114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":47114},{"type":"v1","addr":"172.21.15.106:6831","nonce":47114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":47114},{"type":"v1","addr":"172.21.15.106:6829","nonce":47114}]},"public_addr":"172.21.15.106:6825/47114","cluster_addr":"172.21.15.106:6827/47114","heartbeat_back_addr":"172.21.15.106:6831/47114","heartbeat_front_addr":"172.21.15.106:6829/47114","state":["exists","up"]},{"osd":5,"uuid":"a19ac74e-4282-4428-b167-26ba6b92f732","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6807","nonce":47111},{"type":"v1","addr":"172.21.15.106:6809","nonce":47111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":47111},{"type":"v1","addr":"172.21.15.106:6811","nonce":47111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":47111},{"type":"v1","addr":"172.21.15.106:6815","nonce":47111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":47111},{"type":"v1","addr":"172.21.15.106:6813","nonce":47111}]},"public_addr":"172.21.15.106:6809/47111","cluster_addr":"172.21.15.106:6811/47111","heartbeat_back_addr":"172.21.15.106:6815/47111","heartbeat_front_addr":"172.21.15.106:6813/47111","state":["exists","up"]},{"osd":6,"uuid":"bfe72edd-7acc-4805-807d-2000e76f2feb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":47112},{"type":"v1","addr":"172.21.15.106:6817","nonce":47112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":47112},{"type":"v1","addr":"172.21.15.106:6819","nonce":47112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":47112},{"type":"v1","addr":"172.21.15.106:6824","nonce":47112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":47112},{"type":"v1","addr":"172.21.15.106:6821","nonce":47112}]},"public_addr":"172.21.15.106:6817/47112","cluster_addr":"172.21.15.106:6819/47112","heartbeat_back_addr":"172.21.15.106:6824/47112","heartbeat_front_addr":"172.21.15.106:6821/47112","state":["exists","up"]},{"osd":7,"uuid":"99897f22-ed17-4c7c-9088-cc0c4a51f786","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":47113},{"type":"v1","addr":"172.21.15.106:6801","nonce":47113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":47113},{"type":"v1","addr":"172.21.15.106:6803","nonce":47113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":47113},{"type":"v1","addr":"172.21.15.106:6808","nonce":47113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":47113},{"type":"v1","addr":"172.21.15.106:6805","nonce":47113}]},"public_addr":"172.21.15.106:6801/47113","cluster_addr":"172.21.15.106:6803/47113","heartbeat_back_addr":"172.21.15.106:6808/47113","heartbeat_front_addr":"172.21.15.106:6805/47113","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.232670+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.277753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.050087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.349312+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.344080+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.348781+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.352539+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.275013+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T21:10:33.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.597+0000 7f6c5639e700 1 -- 172.21.15.80:0/68552921 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f6c3c06acc0 msgr2=0x7f6c3c06d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:33.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.597+0000 7f6c5639e700 1 --2- 172.21.15.80:0/68552921 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f6c3c06acc0 0x7f6c3c06d180 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6c44000f60 tx=0x7f6c44009040 comp rx=0 tx=0).stop 2024-05-08T21:10:33.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.597+0000 7f6c5639e700 1 -- 172.21.15.80:0/68552921 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c500cbe20 msgr2=0x7f6c501dfa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:33.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.597+0000 7f6c5639e700 1 --2- 172.21.15.80:0/68552921 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c500cbe20 0x7f6c501dfa00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6c4000e840 tx=0x7f6c4000ec00 comp rx=0 tx=0).stop 2024-05-08T21:10:33.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.597+0000 7f6c5639e700 1 -- 172.21.15.80:0/68552921 shutdown_connections 2024-05-08T21:10:33.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.597+0000 7f6c5639e700 1 --2- 172.21.15.80:0/68552921 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f6c3c06acc0 0x7f6c3c06d180 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:33.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.597+0000 7f6c5639e700 1 --2- 172.21.15.80:0/68552921 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c50141290 0x7f6c5013fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:33.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.597+0000 7f6c5639e700 1 --2- 172.21.15.80:0/68552921 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6c500c5190 0x7f6c501df4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:33.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.597+0000 7f6c5639e700 1 --2- 172.21.15.80:0/68552921 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c500cbe20 0x7f6c501dfa00 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:33.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.597+0000 7f6c5639e700 1 -- 172.21.15.80:0/68552921 >> 172.21.15.80:0/68552921 conn(0x7f6c5006a9c0 msgr2=0x7f6c500c5e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:33.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.597+0000 7f6c5639e700 1 -- 172.21.15.80:0/68552921 shutdown_connections 2024-05-08T21:10:33.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.597+0000 7f6c5639e700 1 -- 172.21.15.80:0/68552921 wait complete. 2024-05-08T21:10:33.612 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-08T21:10:33.612 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T21:10:33.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.730+0000 7fd767dd6700 1 Processor -- start 2024-05-08T21:10:33.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.731+0000 7fd767dd6700 1 -- start start 2024-05-08T21:10:33.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.731+0000 7fd767dd6700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd76015e0e0 0x7fd760072bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:33.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.731+0000 7fd767dd6700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd76015a4d0 con 0x7fd7601433e0 2024-05-08T21:10:33.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.732+0000 7fd767dd6700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd76015a7b0 con 0x7fd7601437c0 2024-05-08T21:10:33.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.732+0000 7fd767dd6700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd76006d1f0 con 0x7fd76015e0e0 2024-05-08T21:10:33.738 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.732+0000 7fd765b72700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd7601433e0 0x7fd7600cd8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41770/0 (socket says 172.21.15.80:41770) 2024-05-08T21:10:33.738 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.732+0000 7fd765b72700 1 -- 172.21.15.80:0/4152816385 learned_addr learned my addr 172.21.15.80:0/4152816385 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:10:33.738 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.732+0000 7fd766373700 1 --2- 172.21.15.80:0/4152816385 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd76015e0e0 0x7fd760072bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:33.738 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.732+0000 7fd764b70700 1 -- 172.21.15.80:0/4152816385 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3463596458 0 0) 0x7fd76015a4d0 con 0x7fd7601433e0 2024-05-08T21:10:33.738 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.732+0000 7fd764b70700 1 -- 172.21.15.80:0/4152816385 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd74c0035b0 con 0x7fd7601433e0 2024-05-08T21:10:33.738 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.732+0000 7fd764b70700 1 -- 172.21.15.80:0/4152816385 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2141007248 0 0) 0x7fd76015a7b0 con 0x7fd7601437c0 2024-05-08T21:10:33.738 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.732+0000 7fd764b70700 1 -- 172.21.15.80:0/4152816385 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd76015a4d0 con 0x7fd7601437c0 2024-05-08T21:10:33.738 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.732+0000 7fd766373700 1 -- 172.21.15.80:0/4152816385 >> v1:172.21.15.106:6789/0 conn(0x7fd7601437c0 legacy=0x7fd76015d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:33.738 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.732+0000 7fd766373700 1 -- 172.21.15.80:0/4152816385 >> v1:172.21.15.80:6789/0 conn(0x7fd7601433e0 legacy=0x7fd7600cd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:33.738 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.732+0000 7fd764b70700 1 -- 172.21.15.80:0/4152816385 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3221560285 0 0) 0x7fd74c0035b0 con 0x7fd7601433e0 2024-05-08T21:10:33.738 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.732+0000 7fd766373700 1 -- 172.21.15.80:0/4152816385 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd76015aa90 con 0x7fd76015e0e0 2024-05-08T21:10:33.738 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.732+0000 7fd766373700 1 --2- 172.21.15.80:0/4152816385 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd76015e0e0 0x7fd760072bc0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd758009dc0 tx=0x7fd75800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b69b2ed431d50f6d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:33.738 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.732+0000 7fd764b70700 1 -- 172.21.15.80:0/4152816385 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75800e070 con 0x7fd76015e0e0 2024-05-08T21:10:33.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.732+0000 7fd764b70700 1 -- 172.21.15.80:0/4152816385 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd75800bb20 con 0x7fd76015e0e0 2024-05-08T21:10:33.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.733+0000 7fd764b70700 1 -- 172.21.15.80:0/4152816385 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75800be90 con 0x7fd76015e0e0 2024-05-08T21:10:33.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.733+0000 7fd767dd6700 1 -- 172.21.15.80:0/4152816385 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd76015e0e0 msgr2=0x7fd760072bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:33.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.733+0000 7fd767dd6700 1 --2- 172.21.15.80:0/4152816385 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd76015e0e0 0x7fd760072bc0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd758009dc0 tx=0x7fd75800b330 comp rx=0 tx=0).stop 2024-05-08T21:10:33.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.733+0000 7fd767dd6700 1 -- 172.21.15.80:0/4152816385 shutdown_connections 2024-05-08T21:10:33.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.733+0000 7fd767dd6700 1 --2- 172.21.15.80:0/4152816385 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd76015e0e0 0x7fd760072bc0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:33.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.733+0000 7fd767dd6700 1 -- 172.21.15.80:0/4152816385 >> 172.21.15.80:0/4152816385 conn(0x7fd760066780 msgr2=0x7fd760066b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:33.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.733+0000 7fd767dd6700 1 -- 172.21.15.80:0/4152816385 shutdown_connections 2024-05-08T21:10:33.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.733+0000 7fd767dd6700 1 -- 172.21.15.80:0/4152816385 wait complete. 2024-05-08T21:10:33.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.734+0000 7fd767dd6700 1 Processor -- start 2024-05-08T21:10:33.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.734+0000 7fd767dd6700 1 -- start start 2024-05-08T21:10:33.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.735+0000 7fd767dd6700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd7601433e0 0x7fd7601f3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:33.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.735+0000 7fd767dd6700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd7601437c0 0x7fd760139570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:33.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.735+0000 7fd767dd6700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd76015e0e0 0x7fd76013b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:33.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.735+0000 7fd767dd6700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7600ccb80 con 0x7fd76015e0e0 2024-05-08T21:10:33.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.735+0000 7fd767dd6700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd760159b20 con 0x7fd7601433e0 2024-05-08T21:10:33.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.735+0000 7fd767dd6700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7601f3cc0 con 0x7fd7601437c0 2024-05-08T21:10:33.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.735+0000 7fd766373700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd76015e0e0 0x7fd76013b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:33.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.735+0000 7fd766373700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd76015e0e0 0x7fd76013b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42302/0 (socket says 172.21.15.80:42302) 2024-05-08T21:10:33.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.735+0000 7fd766373700 1 -- 172.21.15.80:0/3301700888 learned_addr learned my addr 172.21.15.80:0/3301700888 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:33.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.735+0000 7fd765b72700 1 --2- 172.21.15.80:0/3301700888 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd7601433e0 0x7fd7601f3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:33.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.735+0000 7fd765371700 1 --2- 172.21.15.80:0/3301700888 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd7601437c0 0x7fd760139570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:33.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.735+0000 7fd766373700 1 -- 172.21.15.80:0/3301700888 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd7601437c0 msgr2=0x7fd760139570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:33.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.735+0000 7fd766373700 1 --2- 172.21.15.80:0/3301700888 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd7601437c0 0x7fd760139570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:33.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.735+0000 7fd766373700 1 -- 172.21.15.80:0/3301700888 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd7601433e0 msgr2=0x7fd7601f3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:33.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.735+0000 7fd766373700 1 --2- 172.21.15.80:0/3301700888 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd7601433e0 0x7fd7601f3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:33.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.735+0000 7fd766373700 1 -- 172.21.15.80:0/3301700888 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd758009a70 con 0x7fd76015e0e0 2024-05-08T21:10:33.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.735+0000 7fd765371700 1 --2- 172.21.15.80:0/3301700888 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd7601437c0 0x7fd760139570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:10:33.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.735+0000 7fd766373700 1 --2- 172.21.15.80:0/3301700888 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd76015e0e0 0x7fd76013b1b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd7600ce4d0 tx=0x7fd758004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:33.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.736+0000 7fd7527fc700 1 -- 172.21.15.80:0/3301700888 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd758004810 con 0x7fd76015e0e0 2024-05-08T21:10:33.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.736+0000 7fd7527fc700 1 -- 172.21.15.80:0/3301700888 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd758021070 con 0x7fd76015e0e0 2024-05-08T21:10:33.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.736+0000 7fd7527fc700 1 -- 172.21.15.80:0/3301700888 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd758004970 con 0x7fd76015e0e0 2024-05-08T21:10:33.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.736+0000 7fd767dd6700 1 -- 172.21.15.80:0/3301700888 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd760139ab0 con 0x7fd76015e0e0 2024-05-08T21:10:33.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.736+0000 7fd767dd6700 1 -- 172.21.15.80:0/3301700888 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd760159d70 con 0x7fd76015e0e0 2024-05-08T21:10:33.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.736+0000 7fd767dd6700 1 -- 172.21.15.80:0/3301700888 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd76004ec60 con 0x7fd76015e0e0 2024-05-08T21:10:33.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.737+0000 7fd7527fc700 1 -- 172.21.15.80:0/3301700888 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd758023030 con 0x7fd76015e0e0 2024-05-08T21:10:33.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.737+0000 7fd7527fc700 1 --2- 172.21.15.80:0/3301700888 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fd74406ac90 0x7fd74406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:33.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.737+0000 7fd7527fc700 1 -- 172.21.15.80:0/3301700888 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd75808b740 con 0x7fd76015e0e0 2024-05-08T21:10:33.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.737+0000 7fd765b72700 1 --2- 172.21.15.80:0/3301700888 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fd74406ac90 0x7fd74406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:33.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.738+0000 7fd765b72700 1 --2- 172.21.15.80:0/3301700888 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fd74406ac90 0x7fd74406d150 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd754005910 tx=0x7fd754009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:33.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.742+0000 7fd7527fc700 1 -- 172.21.15.80:0/3301700888 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fd758056750 con 0x7fd76015e0e0 2024-05-08T21:10:33.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.936+0000 7fd767dd6700 1 -- 172.21.15.80:0/3301700888 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd760159f30 con 0x7fd76015e0e0 2024-05-08T21:10:33.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.937+0000 7fd7527fc700 1 -- 172.21.15.80:0/3301700888 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+17878 (secure 0 0 0) 0x7fd758059d70 con 0x7fd76015e0e0 2024-05-08T21:10:33.941 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:10:33.941 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":26,"fsid":"44d31c1e-aad3-47ca-a4fa-85a63d4a60aa","created":"2024-05-08T21:09:46.467038+0000","modified":"2024-05-08T21:10:08.163735+0000","last_up_change":"2024-05-08T21:09:57.284675+0000","last_in_change":"2024-05-08T21:09:49.125444+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T21:09:58.238951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T21:10:02.177476+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T21:10:02.685535+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-08T21:10:05.753779+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c3f9d93e-ed6d-4a0c-b5c0-0e8d44c65fdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":47011},{"type":"v1","addr":"172.21.15.80:6817","nonce":47011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":47011},{"type":"v1","addr":"172.21.15.80:6819","nonce":47011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":47011},{"type":"v1","addr":"172.21.15.80:6823","nonce":47011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":47011},{"type":"v1","addr":"172.21.15.80:6821","nonce":47011}]},"public_addr":"172.21.15.80:6817/47011","cluster_addr":"172.21.15.80:6819/47011","heartbeat_back_addr":"172.21.15.80:6823/47011","heartbeat_front_addr":"172.21.15.80:6821/47011","state":["exists","up"]},{"osd":1,"uuid":"4ce2b4d6-6c40-43aa-8dd1-743fef8915df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":47010},{"type":"v1","addr":"172.21.15.80:6809","nonce":47010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":47010},{"type":"v1","addr":"172.21.15.80:6811","nonce":47010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":47010},{"type":"v1","addr":"172.21.15.80:6815","nonce":47010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":47010},{"type":"v1","addr":"172.21.15.80:6813","nonce":47010}]},"public_addr":"172.21.15.80:6809/47010","cluster_addr":"172.21.15.80:6811/47010","heartbeat_back_addr":"172.21.15.80:6815/47010","heartbeat_front_addr":"172.21.15.80:6813/47010","state":["exists","up"]},{"osd":2,"uuid":"e30cc3bc-6461-4fac-960a-de00c9488d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":47009},{"type":"v1","addr":"172.21.15.80:6801","nonce":47009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":47009},{"type":"v1","addr":"172.21.15.80:6803","nonce":47009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":47009},{"type":"v1","addr":"172.21.15.80:6807","nonce":47009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":47009},{"type":"v1","addr":"172.21.15.80:6805","nonce":47009}]},"public_addr":"172.21.15.80:6801/47009","cluster_addr":"172.21.15.80:6803/47009","heartbeat_back_addr":"172.21.15.80:6807/47009","heartbeat_front_addr":"172.21.15.80:6805/47009","state":["exists","up"]},{"osd":3,"uuid":"a415c099-9ea6-40be-98ed-f2932f98dfd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":47012},{"type":"v1","addr":"172.21.15.80:6825","nonce":47012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":47012},{"type":"v1","addr":"172.21.15.80:6827","nonce":47012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":47012},{"type":"v1","addr":"172.21.15.80:6831","nonce":47012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":47012},{"type":"v1","addr":"172.21.15.80:6829","nonce":47012}]},"public_addr":"172.21.15.80:6825/47012","cluster_addr":"172.21.15.80:6827/47012","heartbeat_back_addr":"172.21.15.80:6831/47012","heartbeat_front_addr":"172.21.15.80:6829/47012","state":["exists","up"]},{"osd":4,"uuid":"5ae1d51f-0918-4571-b79b-154308d46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6823","nonce":47114},{"type":"v1","addr":"172.21.15.106:6825","nonce":47114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":47114},{"type":"v1","addr":"172.21.15.106:6827","nonce":47114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":47114},{"type":"v1","addr":"172.21.15.106:6831","nonce":47114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":47114},{"type":"v1","addr":"172.21.15.106:6829","nonce":47114}]},"public_addr":"172.21.15.106:6825/47114","cluster_addr":"172.21.15.106:6827/47114","heartbeat_back_addr":"172.21.15.106:6831/47114","heartbeat_front_addr":"172.21.15.106:6829/47114","state":["exists","up"]},{"osd":5,"uuid":"a19ac74e-4282-4428-b167-26ba6b92f732","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6807","nonce":47111},{"type":"v1","addr":"172.21.15.106:6809","nonce":47111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":47111},{"type":"v1","addr":"172.21.15.106:6811","nonce":47111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":47111},{"type":"v1","addr":"172.21.15.106:6815","nonce":47111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":47111},{"type":"v1","addr":"172.21.15.106:6813","nonce":47111}]},"public_addr":"172.21.15.106:6809/47111","cluster_addr":"172.21.15.106:6811/47111","heartbeat_back_addr":"172.21.15.106:6815/47111","heartbeat_front_addr":"172.21.15.106:6813/47111","state":["exists","up"]},{"osd":6,"uuid":"bfe72edd-7acc-4805-807d-2000e76f2feb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":47112},{"type":"v1","addr":"172.21.15.106:6817","nonce":47112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":47112},{"type":"v1","addr":"172.21.15.106:6819","nonce":47112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":47112},{"type":"v1","addr":"172.21.15.106:6824","nonce":47112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":47112},{"type":"v1","addr":"172.21.15.106:6821","nonce":47112}]},"public_addr":"172.21.15.106:6817/47112","cluster_addr":"172.21.15.106:6819/47112","heartbeat_back_addr":"172.21.15.106:6824/47112","heartbeat_front_addr":"172.21.15.106:6821/47112","state":["exists","up"]},{"osd":7,"uuid":"99897f22-ed17-4c7c-9088-cc0c4a51f786","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":47113},{"type":"v1","addr":"172.21.15.106:6801","nonce":47113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":47113},{"type":"v1","addr":"172.21.15.106:6803","nonce":47113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":47113},{"type":"v1","addr":"172.21.15.106:6808","nonce":47113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":47113},{"type":"v1","addr":"172.21.15.106:6805","nonce":47113}]},"public_addr":"172.21.15.106:6801/47113","cluster_addr":"172.21.15.106:6803/47113","heartbeat_back_addr":"172.21.15.106:6808/47113","heartbeat_front_addr":"172.21.15.106:6805/47113","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.232670+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.277753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.050087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.349312+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.344080+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.348781+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.352539+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.275013+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T21:10:33.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.939+0000 7fd767dd6700 1 -- 172.21.15.80:0/3301700888 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fd74406ac90 msgr2=0x7fd74406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:33.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.939+0000 7fd767dd6700 1 --2- 172.21.15.80:0/3301700888 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fd74406ac90 0x7fd74406d150 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd754005910 tx=0x7fd754009040 comp rx=0 tx=0).stop 2024-05-08T21:10:33.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.939+0000 7fd767dd6700 1 -- 172.21.15.80:0/3301700888 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd76015e0e0 msgr2=0x7fd76013b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:33.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.939+0000 7fd767dd6700 1 --2- 172.21.15.80:0/3301700888 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd76015e0e0 0x7fd76013b1b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd7600ce4d0 tx=0x7fd758004ad0 comp rx=0 tx=0).stop 2024-05-08T21:10:33.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.939+0000 7fd767dd6700 1 -- 172.21.15.80:0/3301700888 shutdown_connections 2024-05-08T21:10:33.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.939+0000 7fd767dd6700 1 --2- 172.21.15.80:0/3301700888 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fd74406ac90 0x7fd74406d150 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:33.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.940+0000 7fd767dd6700 1 --2- 172.21.15.80:0/3301700888 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd76015e0e0 0x7fd76013b1b0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:33.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.940+0000 7fd767dd6700 1 --2- 172.21.15.80:0/3301700888 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd7601433e0 0x7fd7601f3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:33.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.940+0000 7fd767dd6700 1 --2- 172.21.15.80:0/3301700888 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd7601437c0 0x7fd760139570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:33.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.940+0000 7fd767dd6700 1 -- 172.21.15.80:0/3301700888 >> 172.21.15.80:0/3301700888 conn(0x7fd760066780 msgr2=0x7fd76006c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:33.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.940+0000 7fd767dd6700 1 -- 172.21.15.80:0/3301700888 shutdown_connections 2024-05-08T21:10:33.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:33.940+0000 7fd767dd6700 1 -- 172.21.15.80:0/3301700888 wait complete. 2024-05-08T21:10:33.955 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-08T21:10:33.956 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-08T21:10:33.956 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-08T21:10:33.957 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-08T21:10:33.957 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-05-08T21:10:33.957 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-05-08T21:10:33.958 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-05-08T21:10:33.958 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-05-08T21:10:34.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.162+0000 7f6f9831d700 1 Processor -- start 2024-05-08T21:10:34.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.163+0000 7f6f9831d700 1 -- start start 2024-05-08T21:10:34.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.164+0000 7f6f9831d700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6f9006b4b0 0x7f6f90150410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.164+0000 7f6f9831d700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6f900c3100 0x7f6f900c3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.164+0000 7f6f9831d700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f900c7010 con 0x7f6f900c6af0 2024-05-08T21:10:34.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.164+0000 7f6f9831d700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f900c2bf0 con 0x7f6f900c3100 2024-05-08T21:10:34.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.164+0000 7f6f9831d700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f900c7f40 con 0x7f6f9006b4b0 2024-05-08T21:10:34.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.165+0000 7fdbedca1700 1 Processor -- start 2024-05-08T21:10:34.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.164+0000 7f8fc166a700 1 Processor -- start 2024-05-08T21:10:34.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.165+0000 7f8fc166a700 1 -- start start 2024-05-08T21:10:34.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.166+0000 7f8fc166a700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8fbc158760 0x7f8fbc0c8050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.166+0000 7f8fc166a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8fbc0c6680 0x7f8fbc0c8590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.166+0000 7f8fc166a700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8fbc162160 0x7f8fbc1625f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.166+0000 7f8fc166a700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fbc15e790 con 0x7f8fbc0c6680 2024-05-08T21:10:34.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.166+0000 7f8fc166a700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fbc162b30 con 0x7f8fbc162160 2024-05-08T21:10:34.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.166+0000 7f8fc166a700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fbc15e980 con 0x7f8fbc158760 2024-05-08T21:10:34.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.166+0000 7f8fbb7fe700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8fbc162160 0x7f8fbc1625f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.166+0000 7f8fbb7fe700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8fbc162160 0x7f8fbc1625f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.80:45212/0 (socket says 172.21.15.80:45212) 2024-05-08T21:10:34.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.166+0000 7f8fbb7fe700 1 -- 172.21.15.80:0/3435455482 learned_addr learned my addr 172.21.15.80:0/3435455482 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:34.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.166+0000 7f8fba7fc700 1 --2- 172.21.15.80:0/3435455482 >> v2:172.21.15.80:3300/0 conn(0x7f8fbc0c6680 0x7f8fbc0c8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.165+0000 7fdbedca1700 1 -- start start 2024-05-08T21:10:34.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.166+0000 7fdbedca1700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdbe8158540 0x7fdbe815f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.166+0000 7fdbedca1700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fdbe806ad30 0x7fdbe806b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.166+0000 7fdbedca1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fdbe8161b70 0x7fdbe8162000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.166+0000 7fdbedca1700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbe806c2d0 con 0x7fdbe8161b70 2024-05-08T21:10:34.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.166+0000 7fdbedca1700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbe815f540 con 0x7fdbe806ad30 2024-05-08T21:10:34.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.166+0000 7fdbedca1700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe806b6f0 con 0x7fdbe8158540 2024-05-08T21:10:34.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.165+0000 7f6f958b8700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f6f900c6af0 0x7f6f90156dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.80:50862/0 (socket says 172.21.15.80:50862) 2024-05-08T21:10:34.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.165+0000 7f6f958b8700 1 -- 172.21.15.80:0/2316353604 learned_addr learned my addr 172.21.15.80:0/2316353604 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:10:34.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.165+0000 7f6f950b7700 1 -- 172.21.15.80:0/2316353604 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 287615527 0 0) 0x7f6f900c7010 con 0x7f6f900c6af0 2024-05-08T21:10:34.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.165+0000 7f6f950b7700 1 -- 172.21.15.80:0/2316353604 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f7c0035b0 con 0x7f6f900c6af0 2024-05-08T21:10:34.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.165+0000 7f6f950b7700 1 -- 172.21.15.80:0/2316353604 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2244376937 0 0) 0x7f6f7c0035b0 con 0x7f6f900c6af0 2024-05-08T21:10:34.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.165+0000 7f6f950b7700 1 -- 172.21.15.80:0/2316353604 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6f9006b4b0 msgr2=0x7f6f90150410 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T21:10:34.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.165+0000 7f6f950b7700 1 --2- 172.21.15.80:0/2316353604 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6f9006b4b0 0x7f6f90150410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.165+0000 7f6f950b7700 1 -- 172.21.15.80:0/2316353604 >> v2:172.21.15.106:3300/0 conn(0x7f6f900c3100 msgr2=0x7f6f900c3570 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T21:10:34.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.165+0000 7f6f950b7700 1 --2- 172.21.15.80:0/2316353604 >> v2:172.21.15.106:3300/0 conn(0x7f6f900c3100 0x7f6f900c3570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.165+0000 7f6f950b7700 1 -- 172.21.15.80:0/2316353604 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f900c8220 con 0x7f6f900c6af0 2024-05-08T21:10:34.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.165+0000 7f6f950b7700 1 -- 172.21.15.80:0/2316353604 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3520646302 0 0) 0x7f6f880019f0 con 0x7f6f900c6af0 2024-05-08T21:10:34.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.165+0000 7f6f950b7700 1 -- 172.21.15.80:0/2316353604 >> v1:172.21.15.106:6789/0 conn(0x7f6f900c6af0 legacy=0x7f6f90156dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.166+0000 7f6f950b7700 1 --2- 172.21.15.80:0/2316353604 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f7c003a00 0x7f6f7c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.166+0000 7f6f950b7700 1 --2- 172.21.15.80:0/2316353604 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6f7c004850 0x7f6f7c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.166+0000 7f6f950b7700 1 --2- 172.21.15.80:0/2316353604 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6f7c005260 0x7f6f7c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.166+0000 7f6f950b7700 1 -- 172.21.15.80:0/2316353604 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f900c2bf0 con 0x7f6f7c003a00 2024-05-08T21:10:34.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.166+0000 7f6f950b7700 1 -- 172.21.15.80:0/2316353604 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f900c7f40 con 0x7f6f7c005260 2024-05-08T21:10:34.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.166+0000 7f6f950b7700 1 -- 172.21.15.80:0/2316353604 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7c00c210 con 0x7f6f7c004850 2024-05-08T21:10:34.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.166+0000 7f6f958b8700 1 --2- 172.21.15.80:0/2316353604 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6f7c004850 0x7f6f7c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.166+0000 7f6f960b9700 1 --2- 172.21.15.80:0/2316353604 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f7c003a00 0x7f6f7c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.166+0000 7f6f958b8700 1 -- 172.21.15.80:0/2316353604 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6f7c005260 msgr2=0x7f6f7c00ba10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T21:10:34.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.166+0000 7f6f958b8700 1 --2- 172.21.15.80:0/2316353604 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6f7c005260 0x7f6f7c00ba10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.166+0000 7f6f958b8700 1 -- 172.21.15.80:0/2316353604 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f7c003a00 msgr2=0x7f6f7c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:34.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.166+0000 7f6f958b8700 1 --2- 172.21.15.80:0/2316353604 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f7c003a00 0x7f6f7c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.166+0000 7f6f958b8700 1 -- 172.21.15.80:0/2316353604 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f900c8220 con 0x7f6f7c004850 2024-05-08T21:10:34.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.167+0000 7f6f958b8700 1 --2- 172.21.15.80:0/2316353604 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6f7c004850 0x7f6f7c004cd0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6f8800a480 tx=0x7f6f7c005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a6a373dfcfa1543 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:34.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.167+0000 7f6f950b7700 1 -- 172.21.15.80:0/2316353604 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f88034410 con 0x7f6f7c004850 2024-05-08T21:10:34.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.167+0000 7f6f950b7700 1 -- 172.21.15.80:0/2316353604 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f88034570 con 0x7f6f7c004850 2024-05-08T21:10:34.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.167+0000 7f6f950b7700 1 -- 172.21.15.80:0/2316353604 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f88034920 con 0x7f6f7c004850 2024-05-08T21:10:34.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.167+0000 7fdbe77fe700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdbe8158540 0x7fdbe815f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.167+0000 7fdbe77fe700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdbe8158540 0x7fdbe815f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:51896/0 (socket says 172.21.15.80:51896) 2024-05-08T21:10:34.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.167+0000 7fdbe77fe700 1 -- 172.21.15.80:0/2061466840 learned_addr learned my addr 172.21.15.80:0/2061466840 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:34.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.167+0000 7fdbe7fff700 1 --2- 172.21.15.80:0/2061466840 >> v2:172.21.15.80:3300/0 conn(0x7fdbe8161b70 0x7fdbe8162000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.166+0000 7f8fbaffd700 1 --2- 172.21.15.80:0/3435455482 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8fbc158760 0x7f8fbc0c8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.167+0000 7f8fba7fc700 1 -- 172.21.15.80:0/3435455482 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8fbc158760 msgr2=0x7f8fbc0c8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:34.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.167+0000 7f8fba7fc700 1 --2- 172.21.15.80:0/3435455482 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8fbc158760 0x7f8fbc0c8050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.167+0000 7f8fba7fc700 1 -- 172.21.15.80:0/3435455482 >> v2:172.21.15.106:3300/0 conn(0x7f8fbc162160 msgr2=0x7f8fbc1625f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:34.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.167+0000 7f8fba7fc700 1 --2- 172.21.15.80:0/3435455482 >> v2:172.21.15.106:3300/0 conn(0x7f8fbc162160 0x7f8fbc1625f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.167+0000 7f8fba7fc700 1 -- 172.21.15.80:0/3435455482 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fbc15ec60 con 0x7f8fbc0c6680 2024-05-08T21:10:34.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.167+0000 7f8fbb7fe700 1 --2- 172.21.15.80:0/3435455482 >> v2:172.21.15.106:3300/0 conn(0x7f8fbc162160 0x7f8fbc1625f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:10:34.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.167+0000 7fdbe77fe700 1 -- 172.21.15.80:0/2061466840 >> v2:172.21.15.106:3300/0 conn(0x7fdbe806ad30 msgr2=0x7fdbe806b1b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T21:10:34.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.167+0000 7fdbe77fe700 1 --2- 172.21.15.80:0/2061466840 >> v2:172.21.15.106:3300/0 conn(0x7fdbe806ad30 0x7fdbe806b1b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.167+0000 7fdbe77fe700 1 -- 172.21.15.80:0/2061466840 >> v2:172.21.15.80:3300/0 conn(0x7fdbe8161b70 msgr2=0x7fdbe8162000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:34.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.167+0000 7fdbe77fe700 1 --2- 172.21.15.80:0/2061466840 >> v2:172.21.15.80:3300/0 conn(0x7fdbe8161b70 0x7fdbe8162000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.167+0000 7fdbe77fe700 1 -- 172.21.15.80:0/2061466840 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe80c8c50 con 0x7fdbe8158540 2024-05-08T21:10:34.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.167+0000 7f8fba7fc700 1 --2- 172.21.15.80:0/3435455482 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fbc0c6680 0x7f8fbc0c8590 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc06b8a0 tx=0x7f8fb0009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83cda41ed46f5f0e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:34.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.167+0000 7fdbe77fe700 1 --2- 172.21.15.80:0/2061466840 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdbe8158540 0x7fdbe815f000 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fdbe80c9d60 tx=0x7fdbdc009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c02fc5cb8009a4f3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:34.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.168+0000 7fdbe67fc700 1 -- 172.21.15.80:0/2061466840 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbdc011830 con 0x7fdbe8158540 2024-05-08T21:10:34.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.168+0000 7f8fb9ffb700 1 -- 172.21.15.80:0/3435455482 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb0011830 con 0x7f8fbc0c6680 2024-05-08T21:10:34.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.168+0000 7f8fb9ffb700 1 -- 172.21.15.80:0/3435455482 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb0011990 con 0x7f8fbc0c6680 2024-05-08T21:10:34.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.168+0000 7f8fb9ffb700 1 -- 172.21.15.80:0/3435455482 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb0011d20 con 0x7f8fbc0c6680 2024-05-08T21:10:34.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.168+0000 7fdbe67fc700 1 -- 172.21.15.80:0/2061466840 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbdc011990 con 0x7fdbe8158540 2024-05-08T21:10:34.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.168+0000 7fdbe67fc700 1 -- 172.21.15.80:0/2061466840 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbdc011d20 con 0x7fdbe8158540 2024-05-08T21:10:34.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.169+0000 7fdbedca1700 1 -- 172.21.15.80:0/2061466840 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdbe8158540 msgr2=0x7fdbe815f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.169+0000 7fdbedca1700 1 --2- 172.21.15.80:0/2061466840 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdbe8158540 0x7fdbe815f000 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fdbe80c9d60 tx=0x7fdbdc009bd0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.169+0000 7fdbedca1700 1 -- 172.21.15.80:0/2061466840 shutdown_connections 2024-05-08T21:10:34.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.169+0000 7fdbedca1700 1 --2- 172.21.15.80:0/2061466840 >> v2:172.21.15.80:3300/0 conn(0x7fdbe8161b70 0x7fdbe8162000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.169+0000 7fdbedca1700 1 --2- 172.21.15.80:0/2061466840 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdbe8158540 0x7fdbe815f000 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.169+0000 7fdbedca1700 1 --2- 172.21.15.80:0/2061466840 >> v2:172.21.15.106:3300/0 conn(0x7fdbe806ad30 0x7fdbe806b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.169+0000 7fdbedca1700 1 -- 172.21.15.80:0/2061466840 >> 172.21.15.80:0/2061466840 conn(0x7fdbe806ef80 msgr2=0x7fdbe806f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:34.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.169+0000 7f8fc166a700 1 -- 172.21.15.80:0/3435455482 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fbc0c6680 msgr2=0x7f8fbc0c8590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.169+0000 7f8fc166a700 1 --2- 172.21.15.80:0/3435455482 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fbc0c6680 0x7f8fbc0c8590 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc06b8a0 tx=0x7f8fb0009b20 comp rx=0 tx=0).stop 2024-05-08T21:10:34.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.169+0000 7f8fc166a700 1 -- 172.21.15.80:0/3435455482 shutdown_connections 2024-05-08T21:10:34.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.169+0000 7f8fc166a700 1 --2- 172.21.15.80:0/3435455482 >> v2:172.21.15.106:3300/0 conn(0x7f8fbc162160 0x7f8fbc1625f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.169+0000 7f8fc166a700 1 --2- 172.21.15.80:0/3435455482 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8fbc158760 0x7f8fbc0c8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.169+0000 7f8fc166a700 1 --2- 172.21.15.80:0/3435455482 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fbc0c6680 0x7f8fbc0c8590 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.169+0000 7f8fc166a700 1 -- 172.21.15.80:0/3435455482 >> 172.21.15.80:0/3435455482 conn(0x7f8fbc06a9c0 msgr2=0x7f8fbc06ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:34.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.169+0000 7f8fc166a700 1 -- 172.21.15.80:0/3435455482 shutdown_connections 2024-05-08T21:10:34.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.169+0000 7f8fc166a700 1 -- 172.21.15.80:0/3435455482 wait complete. 2024-05-08T21:10:34.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.170+0000 7f628bcef700 1 Processor -- start 2024-05-08T21:10:34.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.170+0000 7f628bcef700 1 -- start start 2024-05-08T21:10:34.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.172+0000 7f6f9831d700 1 -- 172.21.15.80:0/2316353604 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6f7c004850 msgr2=0x7f6f7c004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.172+0000 7f6f9831d700 1 --2- 172.21.15.80:0/2316353604 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6f7c004850 0x7f6f7c004cd0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6f8800a480 tx=0x7f6f7c005880 comp rx=0 tx=0).stop 2024-05-08T21:10:34.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.172+0000 7f6f968ba700 1 -- 172.21.15.80:0/2316353604 reap_dead start 2024-05-08T21:10:34.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.172+0000 7f6f9831d700 1 -- 172.21.15.80:0/2316353604 shutdown_connections 2024-05-08T21:10:34.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.172+0000 7f6f9831d700 1 -- 172.21.15.80:0/2316353604 >> 172.21.15.80:0/2316353604 conn(0x7f6f9006a9c0 msgr2=0x7f6f9006ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:34.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.172+0000 7f6f9831d700 1 -- 172.21.15.80:0/2316353604 shutdown_connections 2024-05-08T21:10:34.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.172+0000 7f6f9831d700 1 -- 172.21.15.80:0/2316353604 wait complete. 2024-05-08T21:10:34.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.172+0000 7f65c089e700 1 Processor -- start 2024-05-08T21:10:34.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.173+0000 7fdbedca1700 1 -- 172.21.15.80:0/2061466840 shutdown_connections 2024-05-08T21:10:34.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.171+0000 7f628bcef700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6284151c50 0x7f6284073280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.171+0000 7f628bcef700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6284152030 0x7f62840c4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.171+0000 7f628bcef700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f62840c6020 0x7f62840c5270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.171+0000 7f628bcef700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f628406be40 con 0x7f6284151c50 2024-05-08T21:10:34.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.171+0000 7f628bcef700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62840c64f0 con 0x7f6284152030 2024-05-08T21:10:34.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.171+0000 7f628bcef700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62840c7090 con 0x7f62840c6020 2024-05-08T21:10:34.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.172+0000 7f628a28c700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f62840c6020 0x7f62840c5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.172+0000 7f628a28c700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f62840c6020 0x7f62840c5270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:51910/0 (socket says 172.21.15.80:51910) 2024-05-08T21:10:34.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.172+0000 7f628a28c700 1 -- 172.21.15.80:0/1618771984 learned_addr learned my addr 172.21.15.80:0/1618771984 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:34.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.171+0000 7f8fc166a700 1 Processor -- start 2024-05-08T21:10:34.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.171+0000 7f8fc166a700 1 -- start start 2024-05-08T21:10:34.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.172+0000 7f8fc166a700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8fbc0c6680 0x7f8fbc1452d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.172+0000 7f8fc166a700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8fbc158760 0x7f8fbc149250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.172+0000 7f8fc166a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fbc162160 0x7f8fbc149790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.172+0000 7f8fc166a700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fbc1458d0 con 0x7f8fbc162160 2024-05-08T21:10:34.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.172+0000 7f8fc166a700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fbc0c95e0 con 0x7f8fbc158760 2024-05-08T21:10:34.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.172+0000 7f8fc166a700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fbc0c98c0 con 0x7f8fbc0c6680 2024-05-08T21:10:34.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.172+0000 7f8fbb7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fbc162160 0x7f8fbc149790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.172+0000 7f8fbb7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fbc162160 0x7f8fbc149790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42356/0 (socket says 172.21.15.80:42356) 2024-05-08T21:10:34.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.172+0000 7f8fbb7fe700 1 -- 172.21.15.80:0/207204705 learned_addr learned my addr 172.21.15.80:0/207204705 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:34.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.172+0000 7f8fba7fc700 1 --2- 172.21.15.80:0/207204705 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8fbc158760 0x7f8fbc149250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.172+0000 7f8fbaffd700 1 --2- 172.21.15.80:0/207204705 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8fbc0c6680 0x7f8fbc1452d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.173+0000 7f8fba7fc700 1 -- 172.21.15.80:0/207204705 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8fbc0c6680 msgr2=0x7f8fbc1452d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.173+0000 7f8fba7fc700 1 --2- 172.21.15.80:0/207204705 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8fbc0c6680 0x7f8fbc1452d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.173+0000 7f8fba7fc700 1 -- 172.21.15.80:0/207204705 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fbc162160 msgr2=0x7f8fbc149790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.173+0000 7f8fba7fc700 1 --2- 172.21.15.80:0/207204705 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fbc162160 0x7f8fbc149790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.173+0000 7f8fba7fc700 1 -- 172.21.15.80:0/207204705 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb00094a0 con 0x7f8fbc158760 2024-05-08T21:10:34.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.173+0000 7f8fbb7fe700 1 --2- 172.21.15.80:0/207204705 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fbc162160 0x7f8fbc149790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:10:34.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.173+0000 7f8fba7fc700 1 --2- 172.21.15.80:0/207204705 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8fbc158760 0x7f8fbc149250 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8fb0016000 tx=0x7f8fb0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:34.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.173+0000 7f8fa37fe700 1 -- 172.21.15.80:0/207204705 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb0004510 con 0x7f8fbc158760 2024-05-08T21:10:34.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.174+0000 7f8fa37fe700 1 -- 172.21.15.80:0/207204705 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb001f070 con 0x7f8fbc158760 2024-05-08T21:10:34.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.174+0000 7f8fa37fe700 1 -- 172.21.15.80:0/207204705 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb00038e0 con 0x7f8fbc158760 2024-05-08T21:10:34.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.174+0000 7f8fc166a700 1 -- 172.21.15.80:0/207204705 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fbc0c9ba0 con 0x7f8fbc158760 2024-05-08T21:10:34.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.174+0000 7f8fc166a700 1 -- 172.21.15.80:0/207204705 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fbc0ca160 con 0x7f8fbc158760 2024-05-08T21:10:34.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.174+0000 7f6f9831d700 1 Processor -- start 2024-05-08T21:10:34.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.172+0000 7f628a28c700 1 -- 172.21.15.80:0/1618771984 >> v2:172.21.15.106:3300/0 conn(0x7f6284152030 msgr2=0x7f62840c4d30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T21:10:34.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.172+0000 7f628a28c700 1 --2- 172.21.15.80:0/1618771984 >> v2:172.21.15.106:3300/0 conn(0x7f6284152030 0x7f62840c4d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.172+0000 7f628a28c700 1 -- 172.21.15.80:0/1618771984 >> v2:172.21.15.80:3300/0 conn(0x7f6284151c50 msgr2=0x7f6284073280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:34.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.172+0000 7f628a28c700 1 --2- 172.21.15.80:0/1618771984 >> v2:172.21.15.80:3300/0 conn(0x7f6284151c50 0x7f6284073280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.172+0000 7f628a28c700 1 -- 172.21.15.80:0/1618771984 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62840c7370 con 0x7f62840c6020 2024-05-08T21:10:34.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.172+0000 7f628a28c700 1 --2- 172.21.15.80:0/1618771984 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f62840c6020 0x7f62840c5270 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f628406fe60 tx=0x7f6280009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab23b77bbf39f8ef server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:34.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.172+0000 7f6288a89700 1 -- 172.21.15.80:0/1618771984 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628000b870 con 0x7f62840c6020 2024-05-08T21:10:34.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.172+0000 7f6288a89700 1 -- 172.21.15.80:0/1618771984 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f628000b9d0 con 0x7f62840c6020 2024-05-08T21:10:34.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.172+0000 7f6288a89700 1 -- 172.21.15.80:0/1618771984 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628000bd60 con 0x7f62840c6020 2024-05-08T21:10:34.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.173+0000 7f628bcef700 1 -- 172.21.15.80:0/1618771984 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f62840c6020 msgr2=0x7f62840c5270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.173+0000 7f628bcef700 1 --2- 172.21.15.80:0/1618771984 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f62840c6020 0x7f62840c5270 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f628406fe60 tx=0x7f6280009bd0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.174+0000 7f628bcef700 1 -- 172.21.15.80:0/1618771984 shutdown_connections 2024-05-08T21:10:34.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.174+0000 7f628bcef700 1 --2- 172.21.15.80:0/1618771984 >> v2:172.21.15.80:3300/0 conn(0x7f6284151c50 0x7f6284073280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.174+0000 7f628bcef700 1 --2- 172.21.15.80:0/1618771984 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f62840c6020 0x7f62840c5270 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.174+0000 7f628bcef700 1 --2- 172.21.15.80:0/1618771984 >> v2:172.21.15.106:3300/0 conn(0x7f6284152030 0x7f62840c4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.174+0000 7f628bcef700 1 -- 172.21.15.80:0/1618771984 >> 172.21.15.80:0/1618771984 conn(0x7f62840c8120 msgr2=0x7f62840c8500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:34.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.174+0000 7f628bcef700 1 -- 172.21.15.80:0/1618771984 shutdown_connections 2024-05-08T21:10:34.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.172+0000 7f65c089e700 1 -- start start 2024-05-08T21:10:34.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.173+0000 7f65c089e700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f65bc150f80 0x7f65bc1578e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.173+0000 7f65c089e700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f65bc0ca820 0x7f65bc0cb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.173+0000 7f65c089e700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65bc0cc340 con 0x7f65bc0cbb30 2024-05-08T21:10:34.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.173+0000 7f65c089e700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65bc15b3d0 con 0x7f65bc150f80 2024-05-08T21:10:34.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.173+0000 7f65c089e700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65bc0cb220 con 0x7f65bc0ca820 2024-05-08T21:10:34.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.174+0000 7f65b9d9b700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f65bc0ca820 0x7f65bc0cb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.173+0000 7fdbedca1700 1 -- 172.21.15.80:0/2061466840 wait complete. 2024-05-08T21:10:34.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.175+0000 7fdbedca1700 1 Processor -- start 2024-05-08T21:10:34.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.174+0000 7f6f9831d700 1 -- start start 2024-05-08T21:10:34.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.175+0000 7f6f9831d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6f7c004850 0x7f6f900c9730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.175+0000 7f6f9831d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f90073400 0x7f6f90150c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.175+0000 7f6f9831d700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6f901533b0 0x7f6f900712e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.175+0000 7f6f9831d700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f90072870 con 0x7f6f90073400 2024-05-08T21:10:34.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.175+0000 7f6f9831d700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f90151ef0 con 0x7f6f7c004850 2024-05-08T21:10:34.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.175+0000 7f6f9831d700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f90153910 con 0x7f6f901533b0 2024-05-08T21:10:34.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.176+0000 7f6f960b9700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6f7c004850 0x7f6f900c9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.176+0000 7f6f968ba700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6f901533b0 0x7f6f900712e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.176+0000 7f6f960b9700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6f7c004850 0x7f6f900c9730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.80:45250/0 (socket says 172.21.15.80:45250) 2024-05-08T21:10:34.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.176+0000 7f6f960b9700 1 -- 172.21.15.80:0/2005677955 learned_addr learned my addr 172.21.15.80:0/2005677955 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:34.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.176+0000 7f6f958b8700 1 --2- 172.21.15.80:0/2005677955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f90073400 0x7f6f90150c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.175+0000 7f628bcef700 1 -- 172.21.15.80:0/1618771984 wait complete. 2024-05-08T21:10:34.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.177+0000 7f628bcef700 1 Processor -- start 2024-05-08T21:10:34.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.176+0000 7f8fa37fe700 1 -- 172.21.15.80:0/207204705 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8fb0003a40 con 0x7f8fbc158760 2024-05-08T21:10:34.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.176+0000 7f8fa37fe700 1 --2- 172.21.15.80:0/207204705 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f8fa806ac90 0x7f8fa806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.176+0000 7f8fa37fe700 1 -- 172.21.15.80:0/207204705 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8fb0021070 con 0x7f8fbc158760 2024-05-08T21:10:34.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.175+0000 7fdbedca1700 1 -- start start 2024-05-08T21:10:34.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.176+0000 7fdbedca1700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdbe806ad30 0x7fdbe81422b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.176+0000 7fdbedca1700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdbe8158540 0x7fdbe8143870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.176+0000 7fdbedca1700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdbe8161b70 0x7fdbe813c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.176+0000 7fdbedca1700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe81427f0 con 0x7fdbe8158540 2024-05-08T21:10:34.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.176+0000 7fdbedca1700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe80c3c30 con 0x7fdbe8161b70 2024-05-08T21:10:34.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.176+0000 7fdbedca1700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe8143db0 con 0x7fdbe806ad30 2024-05-08T21:10:34.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.177+0000 7f65ba59c700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f65bc150f80 0x7f65bc1578e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.177+0000 7fdbe77fe700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdbe806ad30 0x7fdbe81422b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.177+0000 7fdbe7fff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdbe8161b70 0x7fdbe813c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.177+0000 7fdbe7fff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdbe8161b70 0x7fdbe813c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.80:45260/0 (socket says 172.21.15.80:45260) 2024-05-08T21:10:34.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.177+0000 7fdbe7fff700 1 -- 172.21.15.80:0/1080516388 learned_addr learned my addr 172.21.15.80:0/1080516388 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:34.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.177+0000 7fdbe6ffd700 1 --2- 172.21.15.80:0/1080516388 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdbe8158540 0x7fdbe8143870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.177+0000 7f6f968ba700 1 -- 172.21.15.80:0/2005677955 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6f7c004850 msgr2=0x7f6f900c9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.177+0000 7f6f968ba700 1 --2- 172.21.15.80:0/2005677955 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6f7c004850 0x7f6f900c9730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.177+0000 7f6f968ba700 1 -- 172.21.15.80:0/2005677955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f90073400 msgr2=0x7f6f90150c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.177+0000 7f6f968ba700 1 --2- 172.21.15.80:0/2005677955 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6f90073400 0x7f6f90150c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.177+0000 7f6f968ba700 1 -- 172.21.15.80:0/2005677955 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f90153bf0 con 0x7f6f901533b0 2024-05-08T21:10:34.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.178+0000 7f6f968ba700 1 --2- 172.21.15.80:0/2005677955 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6f901533b0 0x7f6f900712e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6f900c6a80 tx=0x7f6f8c00b670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:34.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.177+0000 7f65ba59c700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f65bc150f80 0x7f65bc1578e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.80:45236/0 (socket says 172.21.15.80:45236) 2024-05-08T21:10:34.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.177+0000 7f65ba59c700 1 -- 172.21.15.80:0/1194746667 learned_addr learned my addr 172.21.15.80:0/1194746667 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:34.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.178+0000 7f65ba59c700 1 -- 172.21.15.80:0/1194746667 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f65bc0ca820 msgr2=0x7f65bc0cb5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:34.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.178+0000 7f65ba59c700 1 --2- 172.21.15.80:0/1194746667 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f65bc0ca820 0x7f65bc0cb5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.178+0000 7f65ba59c700 1 -- 172.21.15.80:0/1194746667 >> v1:172.21.15.106:6789/0 conn(0x7f65bc0cbb30 legacy=0x7f65bc0cc7d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T21:10:34.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.178+0000 7f65ba59c700 1 -- 172.21.15.80:0/1194746667 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65bc15a870 con 0x7f65bc150f80 2024-05-08T21:10:34.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.177+0000 7fdbe77fe700 1 -- 172.21.15.80:0/1080516388 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdbe8161b70 msgr2=0x7fdbe813c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.177+0000 7fdbe77fe700 1 --2- 172.21.15.80:0/1080516388 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdbe8161b70 0x7fdbe813c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.177+0000 7fdbe77fe700 1 -- 172.21.15.80:0/1080516388 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdbe8158540 msgr2=0x7fdbe8143870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.177+0000 7fdbe77fe700 1 --2- 172.21.15.80:0/1080516388 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdbe8158540 0x7fdbe8143870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.177+0000 7fdbe77fe700 1 -- 172.21.15.80:0/1080516388 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbdc009550 con 0x7fdbe806ad30 2024-05-08T21:10:34.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.177+0000 7f8fbaffd700 1 --2- 172.21.15.80:0/207204705 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f8fa806ac90 0x7f8fa806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.178+0000 7f8fc166a700 1 --2- 172.21.15.80:0/207204705 >> [v2:172.21.15.106:6816/47112,v1:172.21.15.106:6817/47112] conn(0x7f8f9c0015e0 0x7f8f9c003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.178+0000 7f8fc166a700 1 -- 172.21.15.80:0/207204705 --> [v2:172.21.15.106:6816/47112,v1:172.21.15.106:6817/47112] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8f9c006bd0 con 0x7f8f9c0015e0 2024-05-08T21:10:34.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.178+0000 7f8fbaffd700 1 --2- 172.21.15.80:0/207204705 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f8fa806ac90 0x7f8fa806d150 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8fac00ab70 tx=0x7f8fac008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:34.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.178+0000 7f65ba59c700 1 --2- 172.21.15.80:0/1194746667 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f65bc150f80 0x7f65bc1578e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f65ac0098f0 tx=0x7f65ac009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3d4fdf7d98c55d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:34.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.178+0000 7fdbe77fe700 1 --2- 172.21.15.80:0/1080516388 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdbe806ad30 0x7fdbe81422b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc016000 tx=0x7fdbdc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:34.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.178+0000 7f8fbb7fe700 1 --2- 172.21.15.80:0/207204705 >> [v2:172.21.15.106:6816/47112,v1:172.21.15.106:6817/47112] conn(0x7f8f9c0015e0 0x7f8f9c003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.178+0000 7f6f86ffd700 1 -- 172.21.15.80:0/2005677955 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8c0038e0 con 0x7f6f901533b0 2024-05-08T21:10:34.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.178+0000 7f6f86ffd700 1 -- 172.21.15.80:0/2005677955 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f8c003a40 con 0x7f6f901533b0 2024-05-08T21:10:34.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.178+0000 7f6f86ffd700 1 -- 172.21.15.80:0/2005677955 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8c003df0 con 0x7f6f901533b0 2024-05-08T21:10:34.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.178+0000 7fdbcffff700 1 -- 172.21.15.80:0/1080516388 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbdc004450 con 0x7fdbe806ad30 2024-05-08T21:10:34.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.178+0000 7fdbcffff700 1 -- 172.21.15.80:0/1080516388 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbdc0045b0 con 0x7fdbe806ad30 2024-05-08T21:10:34.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.178+0000 7fdbcffff700 1 -- 172.21.15.80:0/1080516388 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbdc0038a0 con 0x7fdbe806ad30 2024-05-08T21:10:34.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.178+0000 7f8fbb7fe700 1 --2- 172.21.15.80:0/207204705 >> [v2:172.21.15.106:6816/47112,v1:172.21.15.106:6817/47112] conn(0x7f8f9c0015e0 0x7f8f9c003aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:34.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.178+0000 7f65b959a700 1 -- 172.21.15.80:0/1194746667 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ac004230 con 0x7f65bc150f80 2024-05-08T21:10:34.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.178+0000 7f65b959a700 1 -- 172.21.15.80:0/1194746667 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65ac004390 con 0x7f65bc150f80 2024-05-08T21:10:34.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.178+0000 7f65b959a700 1 -- 172.21.15.80:0/1194746667 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ac0036a0 con 0x7f65bc150f80 2024-05-08T21:10:34.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.179+0000 7f65c089e700 1 -- 172.21.15.80:0/1194746667 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f65bc150f80 msgr2=0x7f65bc1578e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.179+0000 7f65c089e700 1 --2- 172.21.15.80:0/1194746667 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f65bc150f80 0x7f65bc1578e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f65ac0098f0 tx=0x7f65ac009c00 comp rx=0 tx=0).stop 2024-05-08T21:10:34.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.178+0000 7f6f9831d700 1 -- 172.21.15.80:0/2005677955 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f90143fa0 con 0x7f6f901533b0 2024-05-08T21:10:34.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.178+0000 7f6f9831d700 1 -- 172.21.15.80:0/2005677955 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f90144560 con 0x7f6f901533b0 2024-05-08T21:10:34.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.179+0000 7f65c089e700 1 -- 172.21.15.80:0/1194746667 shutdown_connections 2024-05-08T21:10:34.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.179+0000 7f65c089e700 1 --2- 172.21.15.80:0/1194746667 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f65bc150f80 0x7f65bc1578e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.179+0000 7f65c089e700 1 --2- 172.21.15.80:0/1194746667 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f65bc0ca820 0x7f65bc0cb5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.179+0000 7f65c089e700 1 -- 172.21.15.80:0/1194746667 >> 172.21.15.80:0/1194746667 conn(0x7f65bc06bad0 msgr2=0x7f65bc06bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:34.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.179+0000 7fdbedca1700 1 -- 172.21.15.80:0/1080516388 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbe813c8d0 con 0x7fdbe806ad30 2024-05-08T21:10:34.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.179+0000 7fdbedca1700 1 -- 172.21.15.80:0/1080516388 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbe8157430 con 0x7fdbe806ad30 2024-05-08T21:10:34.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.180+0000 7f6f9831d700 1 -- 172.21.15.80:0/2005677955 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6f900c8ac0 con 0x7f6f901533b0 2024-05-08T21:10:34.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.180+0000 7f65c089e700 1 -- 172.21.15.80:0/1194746667 shutdown_connections 2024-05-08T21:10:34.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.177+0000 7f628bcef700 1 -- start start 2024-05-08T21:10:34.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.178+0000 7f628bcef700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f62840c6020 0x7f62840c3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.178+0000 7f628bcef700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6284151c50 0x7f628415ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.178+0000 7f628bcef700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6284152030 0x7f6284148a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.178+0000 7f628bcef700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62841fcc40 con 0x7f6284151c50 2024-05-08T21:10:34.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.178+0000 7f628bcef700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62841fce30 con 0x7f62840c6020 2024-05-08T21:10:34.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.178+0000 7f628bcef700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62841fd110 con 0x7f6284152030 2024-05-08T21:10:34.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.180+0000 7f6289a8b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f62840c6020 0x7f62840c3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.180+0000 7f628928a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6284151c50 0x7f628415ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.180+0000 7f6289a8b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f62840c6020 0x7f62840c3ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.80:45264/0 (socket says 172.21.15.80:45264) 2024-05-08T21:10:34.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.180+0000 7f6289a8b700 1 -- 172.21.15.80:0/41666617 learned_addr learned my addr 172.21.15.80:0/41666617 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:34.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.180+0000 7f628a28c700 1 --2- 172.21.15.80:0/41666617 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6284152030 0x7f6284148a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.180+0000 7f628928a700 1 -- 172.21.15.80:0/41666617 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6284152030 msgr2=0x7f6284148a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.180+0000 7f628928a700 1 --2- 172.21.15.80:0/41666617 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6284152030 0x7f6284148a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.180+0000 7f628928a700 1 -- 172.21.15.80:0/41666617 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f62840c6020 msgr2=0x7f62840c3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.180+0000 7f628928a700 1 --2- 172.21.15.80:0/41666617 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f62840c6020 0x7f62840c3ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.180+0000 7f628928a700 1 -- 172.21.15.80:0/41666617 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6280009550 con 0x7f6284151c50 2024-05-08T21:10:34.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.181+0000 7f628928a700 1 --2- 172.21.15.80:0/41666617 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6284151c50 0x7f628415ab30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6274009fd0 tx=0x7f627400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:34.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.181+0000 7f627a7fc700 1 -- 172.21.15.80:0/41666617 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6274011620 con 0x7f6284151c50 2024-05-08T21:10:34.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.181+0000 7f627a7fc700 1 -- 172.21.15.80:0/41666617 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62740117a0 con 0x7f6284151c50 2024-05-08T21:10:34.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.181+0000 7f627a7fc700 1 -- 172.21.15.80:0/41666617 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6274011b50 con 0x7f6284151c50 2024-05-08T21:10:34.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.180+0000 7f8fa37fe700 1 -- 172.21.15.80:0/207204705 <== osd.6 v2:172.21.15.106:6816/47112 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f8f9c006bd0 con 0x7f8f9c0015e0 2024-05-08T21:10:34.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.182+0000 7f65c089e700 1 -- 172.21.15.80:0/1194746667 wait complete. 2024-05-08T21:10:34.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.181+0000 7f6f86ffd700 1 -- 172.21.15.80:0/2005677955 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6f8c005070 con 0x7f6f901533b0 2024-05-08T21:10:34.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.181+0000 7f6f86ffd700 1 --2- 172.21.15.80:0/2005677955 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f6f7406ad60 0x7f6f7406d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.181+0000 7f6f86ffd700 1 -- 172.21.15.80:0/2005677955 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6f8c088430 con 0x7f6f901533b0 2024-05-08T21:10:34.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.181+0000 7f6f960b9700 1 --2- 172.21.15.80:0/2005677955 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f6f7406ad60 0x7f6f7406d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.181+0000 7f6f86ffd700 1 --2- 172.21.15.80:0/2005677955 >> [v2:172.21.15.80:6808/47010,v1:172.21.15.80:6809/47010] conn(0x7f6f74074320 0x7f6f74076760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.181+0000 7f6f86ffd700 1 -- 172.21.15.80:0/2005677955 --> [v2:172.21.15.80:6808/47010,v1:172.21.15.80:6809/47010] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6f74076e30 con 0x7f6f74074320 2024-05-08T21:10:34.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.180+0000 7fdbedca1700 1 -- 172.21.15.80:0/1080516388 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdbe815c1d0 con 0x7fdbe806ad30 2024-05-08T21:10:34.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.182+0000 7fdbcffff700 1 -- 172.21.15.80:0/1080516388 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fdbdc003a00 con 0x7fdbe806ad30 2024-05-08T21:10:34.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.182+0000 7f6f958b8700 1 --2- 172.21.15.80:0/2005677955 >> [v2:172.21.15.80:6808/47010,v1:172.21.15.80:6809/47010] conn(0x7f6f74074320 0x7f6f74076760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.182+0000 7f6f86ffd700 1 -- 172.21.15.80:0/2005677955 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6f8c053300 con 0x7f6f901533b0 2024-05-08T21:10:34.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.182+0000 7fdbcffff700 1 --2- 172.21.15.80:0/1080516388 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fdbd406ad10 0x7fdbd406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.182+0000 7f628bcef700 1 -- 172.21.15.80:0/41666617 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62841fd3f0 con 0x7f6284151c50 2024-05-08T21:10:34.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.182+0000 7f628bcef700 1 -- 172.21.15.80:0/41666617 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62841fd9b0 con 0x7f6284151c50 2024-05-08T21:10:34.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.182+0000 7fdbcffff700 1 -- 172.21.15.80:0/1080516388 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdbdc021030 con 0x7fdbe806ad30 2024-05-08T21:10:34.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.182+0000 7fdbcffff700 1 --2- 172.21.15.80:0/1080516388 >> [v2:172.21.15.80:6824/47012,v1:172.21.15.80:6825/47012] conn(0x7fdbd4074350 0x7fdbd4076790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.182+0000 7fdbcffff700 1 -- 172.21.15.80:0/1080516388 --> [v2:172.21.15.80:6824/47012,v1:172.21.15.80:6825/47012] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdbd4076e60 con 0x7fdbd4074350 2024-05-08T21:10:34.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.182+0000 7fdbcffff700 1 -- 172.21.15.80:0/1080516388 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdbdc08b100 con 0x7fdbe806ad30 2024-05-08T21:10:34.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.183+0000 7f6e4a1b7700 1 Processor -- start 2024-05-08T21:10:34.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.183+0000 7f628bcef700 1 -- 172.21.15.80:0/41666617 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f628406e660 con 0x7f6284151c50 2024-05-08T21:10:34.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.183+0000 7f6f958b8700 1 --2- 172.21.15.80:0/2005677955 >> [v2:172.21.15.80:6808/47010,v1:172.21.15.80:6809/47010] conn(0x7f6f74074320 0x7f6f74076760 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:34.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.183+0000 7fdbe6ffd700 1 --2- 172.21.15.80:0/1080516388 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fdbd406ad10 0x7fdbd406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.183+0000 7fdbe7fff700 1 --2- 172.21.15.80:0/1080516388 >> [v2:172.21.15.80:6824/47012,v1:172.21.15.80:6825/47012] conn(0x7fdbd4074350 0x7fdbd4076790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.183+0000 7f65c089e700 1 Processor -- start 2024-05-08T21:10:34.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.184+0000 7f97718f5700 1 Processor -- start 2024-05-08T21:10:34.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.184+0000 7f97718f5700 1 -- start start 2024-05-08T21:10:34.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.184+0000 7fdbe7fff700 1 --2- 172.21.15.80:0/1080516388 >> [v2:172.21.15.80:6824/47012,v1:172.21.15.80:6825/47012] conn(0x7fdbd4074350 0x7fdbd4076790 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:34.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.185+0000 7fdbcffff700 1 -- 172.21.15.80:0/1080516388 <== osd.3 v2:172.21.15.80:6824/47012 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fdbd4076e60 con 0x7fdbd4074350 2024-05-08T21:10:34.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.185+0000 7f97718f5700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f976c158760 0x7f976c0c8050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.185+0000 7f97718f5700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f976c162870 0x7f976c0c8590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.185+0000 7f97718f5700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f976c15e980 con 0x7f976c0c6680 2024-05-08T21:10:34.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.185+0000 7f97718f5700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f976c15e790 con 0x7f976c162870 2024-05-08T21:10:34.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.185+0000 7f97718f5700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f976c15ec60 con 0x7f976c158760 2024-05-08T21:10:34.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.184+0000 7f65c089e700 1 -- start start 2024-05-08T21:10:34.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.185+0000 7f65c089e700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f65bc0cbb30 0x7f65bc1530a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.185+0000 7f65c089e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65bc150f80 0x7f65bc14ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.185+0000 7f65c089e700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f65bc150490 0x7f65bc14f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.185+0000 7f65c089e700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65bc144690 con 0x7f65bc150f80 2024-05-08T21:10:34.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.185+0000 7f65c089e700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65bc143df0 con 0x7f65bc0cbb30 2024-05-08T21:10:34.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.185+0000 7f65c089e700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65bc144d60 con 0x7f65bc150490 2024-05-08T21:10:34.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.185+0000 7f65b9d9b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65bc150f80 0x7f65bc14ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.185+0000 7f65b9d9b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65bc150f80 0x7f65bc14ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42406/0 (socket says 172.21.15.80:42406) 2024-05-08T21:10:34.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.185+0000 7f65b9d9b700 1 -- 172.21.15.80:0/1511664970 learned_addr learned my addr 172.21.15.80:0/1511664970 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:34.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.184+0000 7f6e4a1b7700 1 -- start start 2024-05-08T21:10:34.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.185+0000 7f6e4a1b7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6e44158760 0x7f6e440c8050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.185+0000 7f6e4a1b7700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e44162870 0x7f6e440c8590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.185+0000 7f6e4a1b7700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e4415e980 con 0x7f6e440c6680 2024-05-08T21:10:34.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.185+0000 7f6e4a1b7700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e4415e790 con 0x7f6e44158760 2024-05-08T21:10:34.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.185+0000 7f6e4a1b7700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4415ec60 con 0x7f6e44162870 2024-05-08T21:10:34.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.185+0000 7f976b7fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f976c162870 0x7f976c0c8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.185+0000 7f976affd700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f976c158760 0x7f976c0c8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.185+0000 7f976b7fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f976c162870 0x7f976c0c8590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42420/0 (socket says 172.21.15.80:42420) 2024-05-08T21:10:34.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.185+0000 7f976b7fe700 1 -- 172.21.15.80:0/2145179292 learned_addr learned my addr 172.21.15.80:0/2145179292 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:34.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.186+0000 7f6f960b9700 1 --2- 172.21.15.80:0/2005677955 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f6f7406ad60 0x7f6f7406d220 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6f8000ba00 tx=0x7f6f80008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:34.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.186+0000 7f6e42ffd700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f6e440c6680 0x7f6e44162160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41772/0 (socket says 172.21.15.80:41772) 2024-05-08T21:10:34.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.186+0000 7f6e42ffd700 1 -- 172.21.15.80:0/129847328 learned_addr learned my addr 172.21.15.80:0/129847328 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:10:34.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.186+0000 7f6e437fe700 1 --2- 172.21.15.80:0/129847328 >> v2:172.21.15.80:3300/0 conn(0x7f6e44158760 0x7f6e440c8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.185+0000 7f65bad9d700 1 --2- 172.21.15.80:0/1511664970 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f65bc150490 0x7f65bc14f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.186+0000 7f65ba59c700 1 --2- 172.21.15.80:0/1511664970 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f65bc0cbb30 0x7f65bc1530a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.186+0000 7f65b9d9b700 1 -- 172.21.15.80:0/1511664970 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f65bc150490 msgr2=0x7f65bc14f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.186+0000 7f65b9d9b700 1 --2- 172.21.15.80:0/1511664970 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f65bc150490 0x7f65bc14f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.186+0000 7f65b9d9b700 1 -- 172.21.15.80:0/1511664970 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f65bc0cbb30 msgr2=0x7f65bc1530a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.186+0000 7f65b9d9b700 1 --2- 172.21.15.80:0/1511664970 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f65bc0cbb30 0x7f65bc1530a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.186+0000 7f65b9d9b700 1 -- 172.21.15.80:0/1511664970 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65ac009550 con 0x7f65bc150f80 2024-05-08T21:10:34.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.186+0000 7f976b7fe700 1 -- 172.21.15.80:0/2145179292 >> v2:172.21.15.106:3300/0 conn(0x7f976c158760 msgr2=0x7f976c0c8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:34.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.186+0000 7f976b7fe700 1 --2- 172.21.15.80:0/2145179292 >> v2:172.21.15.106:3300/0 conn(0x7f976c158760 0x7f976c0c8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.186+0000 7f976b7fe700 1 -- 172.21.15.80:0/2145179292 >> v1:172.21.15.106:6789/0 conn(0x7f976c0c6680 legacy=0x7f976c162160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:34.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.186+0000 7f976b7fe700 1 -- 172.21.15.80:0/2145179292 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f976c15ef40 con 0x7f976c162870 2024-05-08T21:10:34.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.186+0000 7f976affd700 1 --2- 172.21.15.80:0/2145179292 >> v2:172.21.15.106:3300/0 conn(0x7f976c158760 0x7f976c0c8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:10:34.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.186+0000 7f6e43fff700 1 --2- 172.21.15.80:0/129847328 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e44162870 0x7f6e440c8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.187+0000 7f976b7fe700 1 --2- 172.21.15.80:0/2145179292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f976c162870 0x7f976c0c8590 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f976c0c8020 tx=0x7f976400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f15d19f4693ea34 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:34.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.187+0000 7f6e43fff700 1 -- 172.21.15.80:0/129847328 >> v2:172.21.15.80:3300/0 conn(0x7f6e44158760 msgr2=0x7f6e440c8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:34.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.187+0000 7f6e43fff700 1 --2- 172.21.15.80:0/129847328 >> v2:172.21.15.80:3300/0 conn(0x7f6e44158760 0x7f6e440c8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.187+0000 7f6e43fff700 1 -- 172.21.15.80:0/129847328 >> v1:172.21.15.80:6789/0 conn(0x7f6e440c6680 legacy=0x7f6e44162160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:34.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.187+0000 7f6e43fff700 1 -- 172.21.15.80:0/129847328 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e4415ef40 con 0x7f6e44162870 2024-05-08T21:10:34.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.187+0000 7f6e43fff700 1 --2- 172.21.15.80:0/129847328 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e44162870 0x7f6e440c8590 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c009840 tx=0x7f6e2c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=416feac92f8002d2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:34.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.187+0000 7f65b9d9b700 1 --2- 172.21.15.80:0/1511664970 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65bc150f80 0x7f65bc14ee50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f65b000c7a0 tx=0x7f65b000cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:34.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.187+0000 7fdbe6ffd700 1 --2- 172.21.15.80:0/1080516388 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fdbd406ad10 0x7fdbd406d1d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdbe815edb0 tx=0x7fdbe000d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:34.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.187+0000 7f6e427fc700 1 -- 172.21.15.80:0/129847328 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2c004230 con 0x7f6e44162870 2024-05-08T21:10:34.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.187+0000 7f6f86ffd700 1 -- 172.21.15.80:0/2005677955 <== osd.1 v2:172.21.15.80:6808/47010 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f6f74076e30 con 0x7f6f74074320 2024-05-08T21:10:34.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.188+0000 7f627a7fc700 1 -- 172.21.15.80:0/41666617 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6274011cb0 con 0x7f6284151c50 2024-05-08T21:10:34.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.188+0000 7f65aaffd700 1 -- 172.21.15.80:0/1511664970 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b0004220 con 0x7f65bc150f80 2024-05-08T21:10:34.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.188+0000 7f65aaffd700 1 -- 172.21.15.80:0/1511664970 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65b0004380 con 0x7f65bc150f80 2024-05-08T21:10:34.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.188+0000 7f65aaffd700 1 -- 172.21.15.80:0/1511664970 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b00036a0 con 0x7f65bc150f80 2024-05-08T21:10:34.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.188+0000 7f65c089e700 1 -- 172.21.15.80:0/1511664970 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65bc153b80 con 0x7f65bc150f80 2024-05-08T21:10:34.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.188+0000 7f65c089e700 1 -- 172.21.15.80:0/1511664970 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65bc144320 con 0x7f65bc150f80 2024-05-08T21:10:34.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.189+0000 7f65c089e700 1 -- 172.21.15.80:0/1511664970 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f65bc15b0f0 con 0x7f65bc150f80 2024-05-08T21:10:34.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.188+0000 7f627a7fc700 1 --2- 172.21.15.80:0/41666617 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f626806ad90 0x7f626806d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.188+0000 7f627a7fc700 1 -- 172.21.15.80:0/41666617 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f62740896c0 con 0x7f6284151c50 2024-05-08T21:10:34.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.188+0000 7f627a7fc700 1 --2- 172.21.15.80:0/41666617 >> [v2:172.21.15.106:6823/47114,v1:172.21.15.106:6825/47114] conn(0x7f62680743d0 0x7f6268076810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.188+0000 7f627a7fc700 1 -- 172.21.15.80:0/41666617 --> [v2:172.21.15.106:6823/47114,v1:172.21.15.106:6825/47114] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6268076ee0 con 0x7f62680743d0 2024-05-08T21:10:34.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.188+0000 7f627a7fc700 1 -- 172.21.15.80:0/41666617 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6274089a70 con 0x7f6284151c50 2024-05-08T21:10:34.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.188+0000 7f9769ffb700 1 -- 172.21.15.80:0/2145179292 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976400e070 con 0x7f976c162870 2024-05-08T21:10:34.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.188+0000 7f9769ffb700 1 -- 172.21.15.80:0/2145179292 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9764003a20 con 0x7f976c162870 2024-05-08T21:10:34.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.188+0000 7f9769ffb700 1 -- 172.21.15.80:0/2145179292 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9764003dd0 con 0x7f976c162870 2024-05-08T21:10:34.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.187+0000 7fa3c45cf700 1 Processor -- start 2024-05-08T21:10:34.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.187+0000 7fa3c45cf700 1 -- start start 2024-05-08T21:10:34.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.189+0000 7f97718f5700 1 -- 172.21.15.80:0/2145179292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f976c162870 msgr2=0x7f976c0c8590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.189+0000 7f97718f5700 1 --2- 172.21.15.80:0/2145179292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f976c162870 0x7f976c0c8590 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f976c0c8020 tx=0x7f976400b330 comp rx=0 tx=0).stop 2024-05-08T21:10:34.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.189+0000 7f628a28c700 1 --2- 172.21.15.80:0/41666617 >> [v2:172.21.15.106:6823/47114,v1:172.21.15.106:6825/47114] conn(0x7f62680743d0 0x7f6268076810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.190+0000 7fa3c45cf700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa3bc0c3000 0x7fa3bc0c3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.190+0000 7fa3c45cf700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa3bc15f260 0x7fa3bc0c8020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.190+0000 7fa3c45cf700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3bc15edd0 con 0x7fa3bc158980 2024-05-08T21:10:34.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.190+0000 7fa3c45cf700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3bc15f6b0 con 0x7fa3bc0c3000 2024-05-08T21:10:34.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.190+0000 7fa3c45cf700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3bc1625b0 con 0x7fa3bc15f260 2024-05-08T21:10:34.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.190+0000 7fa3c2b6c700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa3bc15f260 0x7fa3bc0c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.190+0000 7fa3c2b6c700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa3bc15f260 0x7fa3bc0c8020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.80:45286/0 (socket says 172.21.15.80:45286) 2024-05-08T21:10:34.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.190+0000 7fa3c2b6c700 1 -- 172.21.15.80:0/2996405455 learned_addr learned my addr 172.21.15.80:0/2996405455 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:34.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.190+0000 7fa3c2b6c700 1 -- 172.21.15.80:0/2996405455 >> v2:172.21.15.80:3300/0 conn(0x7fa3bc0c3000 msgr2=0x7fa3bc0c3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:34.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.190+0000 7fa3c2b6c700 1 --2- 172.21.15.80:0/2996405455 >> v2:172.21.15.80:3300/0 conn(0x7fa3bc0c3000 0x7fa3bc0c3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.190+0000 7fa3c2b6c700 1 -- 172.21.15.80:0/2996405455 >> v1:172.21.15.80:6789/0 conn(0x7fa3bc158980 legacy=0x7fa3bc161d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:34.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.190+0000 7fa3c2b6c700 1 -- 172.21.15.80:0/2996405455 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3bc162890 con 0x7fa3bc15f260 2024-05-08T21:10:34.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.191+0000 7fa3c2b6c700 1 --2- 172.21.15.80:0/2996405455 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3bc15f260 0x7fa3bc0c8020 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc06d010 tx=0x7fa3b8009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51fbc89c8a716d6e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:34.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.191+0000 7f6289a8b700 1 --2- 172.21.15.80:0/41666617 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f626806ad90 0x7f626806d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.191+0000 7f97718f5700 1 -- 172.21.15.80:0/2145179292 shutdown_connections 2024-05-08T21:10:34.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.191+0000 7f97718f5700 1 --2- 172.21.15.80:0/2145179292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f976c162870 0x7f976c0c8590 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.191+0000 7f97718f5700 1 --2- 172.21.15.80:0/2145179292 >> v2:172.21.15.106:3300/0 conn(0x7f976c158760 0x7f976c0c8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.191+0000 7f97718f5700 1 -- 172.21.15.80:0/2145179292 >> 172.21.15.80:0/2145179292 conn(0x7f976c06a9c0 msgr2=0x7f976c06ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:34.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.191+0000 7f97718f5700 1 -- 172.21.15.80:0/2145179292 shutdown_connections 2024-05-08T21:10:34.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.191+0000 7f628a28c700 1 --2- 172.21.15.80:0/41666617 >> [v2:172.21.15.106:6823/47114,v1:172.21.15.106:6825/47114] conn(0x7f62680743d0 0x7f6268076810 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:34.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.192+0000 7f6289a8b700 1 --2- 172.21.15.80:0/41666617 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f626806ad90 0x7f626806d250 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f627c00e250 tx=0x7f627c00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:34.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.191+0000 7f97718f5700 1 -- 172.21.15.80:0/2145179292 wait complete. 2024-05-08T21:10:34.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.192+0000 7f97718f5700 1 Processor -- start 2024-05-08T21:10:34.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.191+0000 7f6e427fc700 1 -- 172.21.15.80:0/129847328 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e2c004390 con 0x7f6e44162870 2024-05-08T21:10:34.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.192+0000 7f6e4a1b7700 1 -- 172.21.15.80:0/129847328 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e44162870 msgr2=0x7f6e440c8590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.192+0000 7f6e427fc700 1 -- 172.21.15.80:0/129847328 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2c0036a0 con 0x7f6e44162870 2024-05-08T21:10:34.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.192+0000 7f6e4a1b7700 1 --2- 172.21.15.80:0/129847328 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e44162870 0x7f6e440c8590 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c009840 tx=0x7f6e2c009b50 comp rx=0 tx=0).stop 2024-05-08T21:10:34.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.192+0000 7f65aaffd700 1 -- 172.21.15.80:0/1511664970 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f65b0003800 con 0x7f65bc150f80 2024-05-08T21:10:34.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.192+0000 7f65aaffd700 1 --2- 172.21.15.80:0/1511664970 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f659c06ad60 0x7f659c06d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.193+0000 7f65aaffd700 1 -- 172.21.15.80:0/1511664970 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f65b0089640 con 0x7f65bc150f80 2024-05-08T21:10:34.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.193+0000 7f65ba59c700 1 --2- 172.21.15.80:0/1511664970 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f659c06ad60 0x7f659c06d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.193+0000 7f65aaffd700 1 --2- 172.21.15.80:0/1511664970 >> [v2:172.21.15.80:6800/47009,v1:172.21.15.80:6801/47009] conn(0x7f659c0743a0 0x7f659c0767e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.193+0000 7f65aaffd700 1 -- 172.21.15.80:0/1511664970 --> [v2:172.21.15.80:6800/47009,v1:172.21.15.80:6801/47009] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f659c076eb0 con 0x7f659c0743a0 2024-05-08T21:10:34.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.193+0000 7f65aaffd700 1 -- 172.21.15.80:0/1511664970 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f65b00899f0 con 0x7f65bc150f80 2024-05-08T21:10:34.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.193+0000 7f65bad9d700 1 --2- 172.21.15.80:0/1511664970 >> [v2:172.21.15.80:6800/47009,v1:172.21.15.80:6801/47009] conn(0x7f659c0743a0 0x7f659c0767e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.193+0000 7f65ba59c700 1 --2- 172.21.15.80:0/1511664970 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f659c06ad60 0x7f659c06d220 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f65ac000c00 tx=0x7f65ac008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:34.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.191+0000 7fa3c1369700 1 -- 172.21.15.80:0/2996405455 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b8004230 con 0x7fa3bc15f260 2024-05-08T21:10:34.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.191+0000 7fa3c1369700 1 -- 172.21.15.80:0/2996405455 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3b8004390 con 0x7fa3bc15f260 2024-05-08T21:10:34.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.191+0000 7fa3c1369700 1 -- 172.21.15.80:0/2996405455 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b80036a0 con 0x7fa3bc15f260 2024-05-08T21:10:34.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.192+0000 7fa3c45cf700 1 -- 172.21.15.80:0/2996405455 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3bc15f260 msgr2=0x7fa3bc0c8020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.192+0000 7fa3c45cf700 1 --2- 172.21.15.80:0/2996405455 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3bc15f260 0x7fa3bc0c8020 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc06d010 tx=0x7fa3b8009bd0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.193+0000 7fa3c45cf700 1 -- 172.21.15.80:0/2996405455 shutdown_connections 2024-05-08T21:10:34.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.193+0000 7fa3c45cf700 1 --2- 172.21.15.80:0/2996405455 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3bc15f260 0x7fa3bc0c8020 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.193+0000 7fa3c45cf700 1 --2- 172.21.15.80:0/2996405455 >> v2:172.21.15.80:3300/0 conn(0x7fa3bc0c3000 0x7fa3bc0c3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.193+0000 7fa3c45cf700 1 -- 172.21.15.80:0/2996405455 >> 172.21.15.80:0/2996405455 conn(0x7fa3bc06a9c0 msgr2=0x7fa3bc06ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:34.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.194+0000 7f65bad9d700 1 --2- 172.21.15.80:0/1511664970 >> [v2:172.21.15.80:6800/47009,v1:172.21.15.80:6801/47009] conn(0x7f659c0743a0 0x7f659c0767e0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:34.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.193+0000 7f97718f5700 1 -- start start 2024-05-08T21:10:34.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.194+0000 7f97718f5700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f976c0c6680 0x7f976c1f7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.194+0000 7f97718f5700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f976c158760 0x7f976c0cbc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.194+0000 7f97718f5700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f976c162870 0x7f976c0c9b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.194+0000 7f97718f5700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f976c0cae30 con 0x7f976c158760 2024-05-08T21:10:34.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.194+0000 7f97718f5700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f976c1f8120 con 0x7f976c0c6680 2024-05-08T21:10:34.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.194+0000 7f97718f5700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f976c0c0ae0 con 0x7f976c162870 2024-05-08T21:10:34.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.194+0000 7f976b7fe700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f976c162870 0x7f976c0c9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.194+0000 7f976b7fe700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f976c162870 0x7f976c0c9b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:51988/0 (socket says 172.21.15.80:51988) 2024-05-08T21:10:34.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.194+0000 7f976b7fe700 1 -- 172.21.15.80:0/1211484298 learned_addr learned my addr 172.21.15.80:0/1211484298 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:34.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.194+0000 7f976a7fc700 1 --2- 172.21.15.80:0/1211484298 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f976c158760 0x7f976c0cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.194+0000 7f976affd700 1 --2- 172.21.15.80:0/1211484298 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f976c0c6680 0x7f976c1f7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.194+0000 7f976b7fe700 1 -- 172.21.15.80:0/1211484298 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f976c0c6680 msgr2=0x7f976c1f7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.194+0000 7f976b7fe700 1 --2- 172.21.15.80:0/1211484298 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f976c0c6680 0x7f976c1f7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.194+0000 7f976b7fe700 1 -- 172.21.15.80:0/1211484298 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f976c158760 msgr2=0x7f976c0cbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.194+0000 7f976b7fe700 1 --2- 172.21.15.80:0/1211484298 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f976c158760 0x7f976c0cbc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.194+0000 7f976b7fe700 1 -- 172.21.15.80:0/1211484298 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97600094a0 con 0x7f976c162870 2024-05-08T21:10:34.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.192+0000 7f627a7fc700 1 -- 172.21.15.80:0/41666617 <== osd.4 v2:172.21.15.106:6823/47114 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f6268076ee0 con 0x7f62680743d0 2024-05-08T21:10:34.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.195+0000 7f6e4a1b7700 1 -- 172.21.15.80:0/129847328 shutdown_connections 2024-05-08T21:10:34.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.195+0000 7f6e4a1b7700 1 --2- 172.21.15.80:0/129847328 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e44162870 0x7f6e440c8590 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.195+0000 7f6e4a1b7700 1 --2- 172.21.15.80:0/129847328 >> v2:172.21.15.80:3300/0 conn(0x7f6e44158760 0x7f6e440c8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.195+0000 7f6e4a1b7700 1 -- 172.21.15.80:0/129847328 >> 172.21.15.80:0/129847328 conn(0x7f6e4406a9c0 msgr2=0x7f6e4406ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:34.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.195+0000 7f65aaffd700 1 -- 172.21.15.80:0/1511664970 <== osd.2 v2:172.21.15.80:6800/47009 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f659c076eb0 con 0x7f659c0743a0 2024-05-08T21:10:34.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.195+0000 7fa3c45cf700 1 -- 172.21.15.80:0/2996405455 shutdown_connections 2024-05-08T21:10:34.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.196+0000 7f6e4a1b7700 1 -- 172.21.15.80:0/129847328 shutdown_connections 2024-05-08T21:10:34.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.196+0000 7f6e4a1b7700 1 -- 172.21.15.80:0/129847328 wait complete. 2024-05-08T21:10:34.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.197+0000 7f6e4a1b7700 1 Processor -- start 2024-05-08T21:10:34.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.197+0000 7f6e4a1b7700 1 -- start start 2024-05-08T21:10:34.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.198+0000 7f6e4a1b7700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e440c6680 0x7f6e44146000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.198+0000 7f6e4a1b7700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6e44158760 0x7f6e4415f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.198+0000 7f6e4a1b7700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e44162870 0x7f6e4415fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.198+0000 7f6e4a1b7700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e441448c0 con 0x7f6e440c6680 2024-05-08T21:10:34.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.198+0000 7f6e4a1b7700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e440bfac0 con 0x7f6e44158760 2024-05-08T21:10:34.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.198+0000 7f6e4a1b7700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e440bffb0 con 0x7f6e44162870 2024-05-08T21:10:34.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.198+0000 7f6e437fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e440c6680 0x7f6e44146000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.198+0000 7f6e437fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e440c6680 0x7f6e44146000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42456/0 (socket says 172.21.15.80:42456) 2024-05-08T21:10:34.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.198+0000 7f6e437fe700 1 -- 172.21.15.80:0/1140592240 learned_addr learned my addr 172.21.15.80:0/1140592240 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:34.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.198+0000 7f6e43fff700 1 --2- 172.21.15.80:0/1140592240 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e44162870 0x7f6e4415fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.198+0000 7f6e42ffd700 1 --2- 172.21.15.80:0/1140592240 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6e44158760 0x7f6e4415f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.198+0000 7f6e43fff700 1 -- 172.21.15.80:0/1140592240 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6e44158760 msgr2=0x7f6e4415f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.198+0000 7f6e43fff700 1 --2- 172.21.15.80:0/1140592240 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6e44158760 0x7f6e4415f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.198+0000 7f6e43fff700 1 -- 172.21.15.80:0/1140592240 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e440c6680 msgr2=0x7f6e44146000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.198+0000 7f6e43fff700 1 --2- 172.21.15.80:0/1140592240 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e440c6680 0x7f6e44146000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.198+0000 7f6e43fff700 1 -- 172.21.15.80:0/1140592240 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e2c0094a0 con 0x7f6e44162870 2024-05-08T21:10:34.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.198+0000 7f6e43fff700 1 --2- 172.21.15.80:0/1140592240 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e44162870 0x7f6e4415fe90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6e440c7520 tx=0x7f6e2c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:34.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.199+0000 7f6e3bfff700 1 -- 172.21.15.80:0/1140592240 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2c003ad0 con 0x7f6e44162870 2024-05-08T21:10:34.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.199+0000 7f6e3bfff700 1 -- 172.21.15.80:0/1140592240 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e2c01f070 con 0x7f6e44162870 2024-05-08T21:10:34.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.199+0000 7f6e3bfff700 1 -- 172.21.15.80:0/1140592240 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2c011630 con 0x7f6e44162870 2024-05-08T21:10:34.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.199+0000 7f6e4a1b7700 1 -- 172.21.15.80:0/1140592240 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e44149120 con 0x7f6e44162870 2024-05-08T21:10:34.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.199+0000 7f6e4a1b7700 1 -- 172.21.15.80:0/1140592240 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e440bfcd0 con 0x7f6e44162870 2024-05-08T21:10:34.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.201+0000 7f6e3bfff700 1 -- 172.21.15.80:0/1140592240 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6e2c021030 con 0x7f6e44162870 2024-05-08T21:10:34.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.201+0000 7f6e3bfff700 1 --2- 172.21.15.80:0/1140592240 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f6e2406ac90 0x7f6e2406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.201+0000 7f6e3bfff700 1 -- 172.21.15.80:0/1140592240 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6e2c08a900 con 0x7f6e44162870 2024-05-08T21:10:34.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.201+0000 7f6e437fe700 1 --2- 172.21.15.80:0/1140592240 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f6e2406ac90 0x7f6e2406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.202+0000 7f6e437fe700 1 --2- 172.21.15.80:0/1140592240 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f6e2406ac90 0x7f6e2406d150 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6e34003c50 tx=0x7f6e34009970 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:34.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.203+0000 7f976b7fe700 1 --2- 172.21.15.80:0/1211484298 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f976c162870 0x7f976c0c9b70 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f976400b370 tx=0x7f9764004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:34.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.204+0000 7f6e4a1b7700 1 --2- 172.21.15.80:0/1140592240 >> [v2:172.21.15.80:6816/47011,v1:172.21.15.80:6817/47011] conn(0x7f6e44149f70 0x7f6e44137b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.204+0000 7f6e4a1b7700 1 -- 172.21.15.80:0/1140592240 --> [v2:172.21.15.80:6816/47011,v1:172.21.15.80:6817/47011] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6e4415f500 con 0x7f6e44149f70 2024-05-08T21:10:34.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.204+0000 7f6e42ffd700 1 --2- 172.21.15.80:0/1140592240 >> [v2:172.21.15.80:6816/47011,v1:172.21.15.80:6817/47011] conn(0x7f6e44149f70 0x7f6e44137b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.204+0000 7f8fc166a700 1 -- 172.21.15.80:0/207204705 --> [v2:172.21.15.106:6816/47112,v1:172.21.15.106:6817/47112] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8f9c005cb0 con 0x7f8f9c0015e0 2024-05-08T21:10:34.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.204+0000 7f6e42ffd700 1 --2- 172.21.15.80:0/1140592240 >> [v2:172.21.15.80:6816/47011,v1:172.21.15.80:6817/47011] conn(0x7f6e44149f70 0x7f6e44137b30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:34.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.205+0000 7f9753fff700 1 -- 172.21.15.80:0/1211484298 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9764004440 con 0x7f976c162870 2024-05-08T21:10:34.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.205+0000 7f9753fff700 1 -- 172.21.15.80:0/1211484298 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97640092e0 con 0x7f976c162870 2024-05-08T21:10:34.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.205+0000 7f9753fff700 1 -- 172.21.15.80:0/1211484298 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9764004800 con 0x7f976c162870 2024-05-08T21:10:34.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.205+0000 7f97718f5700 1 -- 172.21.15.80:0/1211484298 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9764009b30 con 0x7f976c162870 2024-05-08T21:10:34.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.205+0000 7f8fa37fe700 1 -- 172.21.15.80:0/207204705 <== osd.6 v2:172.21.15.106:6816/47112 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8f9c005cb0 con 0x7f8f9c0015e0 2024-05-08T21:10:34.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.205+0000 7f6e3bfff700 1 -- 172.21.15.80:0/1140592240 <== osd.0 v2:172.21.15.80:6816/47011 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f6e3c007120 con 0x7f6e44149f70 2024-05-08T21:10:34.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.205+0000 7f97718f5700 1 -- 172.21.15.80:0/1211484298 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f976c0c96e0 con 0x7f976c162870 2024-05-08T21:10:34.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.207+0000 7f8fc166a700 1 -- 172.21.15.80:0/207204705 >> [v2:172.21.15.106:6816/47112,v1:172.21.15.106:6817/47112] conn(0x7f8f9c0015e0 msgr2=0x7f8f9c003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.207+0000 7f8fc166a700 1 --2- 172.21.15.80:0/207204705 >> [v2:172.21.15.106:6816/47112,v1:172.21.15.106:6817/47112] conn(0x7f8f9c0015e0 0x7f8f9c003aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.207+0000 7f8fc166a700 1 -- 172.21.15.80:0/207204705 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f8fa806ac90 msgr2=0x7f8fa806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.208+0000 7f8fc166a700 1 --2- 172.21.15.80:0/207204705 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f8fa806ac90 0x7f8fa806d150 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8fac00ab70 tx=0x7f8fac008040 comp rx=0 tx=0).stop 2024-05-08T21:10:34.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.208+0000 7f8fc166a700 1 -- 172.21.15.80:0/207204705 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8fbc158760 msgr2=0x7f8fbc149250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.208+0000 7f8fc166a700 1 --2- 172.21.15.80:0/207204705 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8fbc158760 0x7f8fbc149250 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8fb0016000 tx=0x7f8fb0004750 comp rx=0 tx=0).stop 2024-05-08T21:10:34.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.208+0000 7f8fbb7fe700 1 -- 172.21.15.80:0/207204705 reap_dead start 2024-05-08T21:10:34.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.206+0000 7fa3c45cf700 1 -- 172.21.15.80:0/2996405455 wait complete. 2024-05-08T21:10:34.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.207+0000 7fa3c45cf700 1 Processor -- start 2024-05-08T21:10:34.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.211+0000 7f8fc166a700 1 -- 172.21.15.80:0/207204705 shutdown_connections 2024-05-08T21:10:34.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.211+0000 7f8fc166a700 1 -- 172.21.15.80:0/207204705 >> 172.21.15.80:0/207204705 conn(0x7f8fbc06a9c0 msgr2=0x7f8fbc0c3b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:34.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.211+0000 7f6f9831d700 1 -- 172.21.15.80:0/2005677955 --> [v2:172.21.15.80:6808/47010,v1:172.21.15.80:6809/47010] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6f900c87e0 con 0x7f6f74074320 2024-05-08T21:10:34.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.213+0000 7f6f86ffd700 1 -- 172.21.15.80:0/2005677955 <== osd.1 v2:172.21.15.80:6808/47010 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6f880017b0 con 0x7f6f74074320 2024-05-08T21:10:34.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.215+0000 7f6f9831d700 1 -- 172.21.15.80:0/2005677955 >> [v2:172.21.15.80:6808/47010,v1:172.21.15.80:6809/47010] conn(0x7f6f74074320 msgr2=0x7f6f74076760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.215+0000 7f6f9831d700 1 --2- 172.21.15.80:0/2005677955 >> [v2:172.21.15.80:6808/47010,v1:172.21.15.80:6809/47010] conn(0x7f6f74074320 0x7f6f74076760 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.214+0000 7fa3c45cf700 1 -- start start 2024-05-08T21:10:34.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.215+0000 7fa3c45cf700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3bc0c3000 0x7fa3bc0cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.215+0000 7fa3c45cf700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3bc158980 0x7fa3bc1f5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.215+0000 7fa3c45cf700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa3bc15f260 0x7fa3bc1610a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.215+0000 7fa3c45cf700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3bc1f4fc0 con 0x7fa3bc0c3000 2024-05-08T21:10:34.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.215+0000 7fa3c45cf700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3bc1f46f0 con 0x7fa3bc158980 2024-05-08T21:10:34.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.215+0000 7fa3c45cf700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3bc15ba00 con 0x7fa3bc15f260 2024-05-08T21:10:34.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.215+0000 7f6f9831d700 1 -- 172.21.15.80:0/2005677955 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f6f7406ad60 msgr2=0x7f6f7406d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.215+0000 7f6f9831d700 1 --2- 172.21.15.80:0/2005677955 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f6f7406ad60 0x7f6f7406d220 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6f8000ba00 tx=0x7f6f80008040 comp rx=0 tx=0).stop 2024-05-08T21:10:34.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.215+0000 7f6f9831d700 1 -- 172.21.15.80:0/2005677955 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6f901533b0 msgr2=0x7f6f900712e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.215+0000 7f6f9831d700 1 --2- 172.21.15.80:0/2005677955 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6f901533b0 0x7f6f900712e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6f900c6a80 tx=0x7f6f8c00b670 comp rx=0 tx=0).stop 2024-05-08T21:10:34.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.216+0000 7fa3c236b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3bc0c3000 0x7fa3bc0cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.216+0000 7fa3c236b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3bc0c3000 0x7fa3bc0cbe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42462/0 (socket says 172.21.15.80:42462) 2024-05-08T21:10:34.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.216+0000 7fa3c236b700 1 -- 172.21.15.80:0/4119196420 learned_addr learned my addr 172.21.15.80:0/4119196420 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:34.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.216+0000 7fa3c236b700 1 -- 172.21.15.80:0/4119196420 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa3bc15f260 msgr2=0x7fa3bc1610a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T21:10:34.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.216+0000 7fa3c236b700 1 --2- 172.21.15.80:0/4119196420 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa3bc15f260 0x7fa3bc1610a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.216+0000 7fa3c236b700 1 -- 172.21.15.80:0/4119196420 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3bc158980 msgr2=0x7fa3bc1f5b60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T21:10:34.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.216+0000 7fa3c236b700 1 --2- 172.21.15.80:0/4119196420 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3bc158980 0x7fa3bc1f5b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.216+0000 7fa3c236b700 1 -- 172.21.15.80:0/4119196420 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b8009550 con 0x7fa3bc0c3000 2024-05-08T21:10:34.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.213+0000 7f9753fff700 1 -- 172.21.15.80:0/1211484298 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9764012430 con 0x7f976c162870 2024-05-08T21:10:34.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.213+0000 7f9753fff700 1 --2- 172.21.15.80:0/1211484298 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f975806ac90 0x7f975806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.213+0000 7f9753fff700 1 -- 172.21.15.80:0/1211484298 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f976408a8e0 con 0x7f976c162870 2024-05-08T21:10:34.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.215+0000 7f976affd700 1 --2- 172.21.15.80:0/1211484298 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f975806ac90 0x7f975806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.217+0000 7f8fc166a700 1 -- 172.21.15.80:0/207204705 shutdown_connections 2024-05-08T21:10:34.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.217+0000 7f8fc166a700 1 -- 172.21.15.80:0/207204705 wait complete. 2024-05-08T21:10:34.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.217+0000 7f976affd700 1 --2- 172.21.15.80:0/1211484298 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f975806ac90 0x7f975806d150 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f976c0c9050 tx=0x7f9760009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:34.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.217+0000 7fa3c236b700 1 --2- 172.21.15.80:0/4119196420 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3bc0c3000 0x7fa3bc0cbe80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa3b400c8c0 tx=0x7fa3b400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:34.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.217+0000 7fa3b2ffd700 1 -- 172.21.15.80:0/4119196420 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b4003e10 con 0x7fa3bc0c3000 2024-05-08T21:10:34.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.217+0000 7fa3b2ffd700 1 -- 172.21.15.80:0/4119196420 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3b400ce60 con 0x7fa3bc0c3000 2024-05-08T21:10:34.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.217+0000 7fa3b2ffd700 1 -- 172.21.15.80:0/4119196420 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b40052b0 con 0x7fa3bc0c3000 2024-05-08T21:10:34.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.218+0000 7fa3c45cf700 1 -- 172.21.15.80:0/4119196420 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3bc15bc50 con 0x7fa3bc0c3000 2024-05-08T21:10:34.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.218+0000 7fa3c45cf700 1 -- 172.21.15.80:0/4119196420 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3bc1f4900 con 0x7fa3bc0c3000 2024-05-08T21:10:34.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.219+0000 7f6f968ba700 1 -- 172.21.15.80:0/2005677955 reap_dead start 2024-05-08T21:10:34.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.219+0000 7f6f9831d700 1 -- 172.21.15.80:0/2005677955 shutdown_connections 2024-05-08T21:10:34.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.219+0000 7f6f9831d700 1 -- 172.21.15.80:0/2005677955 >> 172.21.15.80:0/2005677955 conn(0x7f6f9006a9c0 msgr2=0x7f6f9006ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:34.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.221+0000 7fa3b2ffd700 1 -- 172.21.15.80:0/4119196420 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa3b4006ba0 con 0x7fa3bc0c3000 2024-05-08T21:10:34.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.221+0000 7fa3b2ffd700 1 --2- 172.21.15.80:0/4119196420 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fa3a006ac90 0x7fa3a006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.221+0000 7fa3b2ffd700 1 -- 172.21.15.80:0/4119196420 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa3b4088aa0 con 0x7fa3bc0c3000 2024-05-08T21:10:34.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.224+0000 7f6f9831d700 1 -- 172.21.15.80:0/2005677955 shutdown_connections 2024-05-08T21:10:34.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.224+0000 7f6f9831d700 1 -- 172.21.15.80:0/2005677955 wait complete. 2024-05-08T21:10:34.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.224+0000 7fdbedca1700 1 -- 172.21.15.80:0/1080516388 --> [v2:172.21.15.80:6824/47012,v1:172.21.15.80:6825/47012] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdbe80c8630 con 0x7fdbd4074350 2024-05-08T21:10:34.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.224+0000 7f97718f5700 1 --2- 172.21.15.80:0/1211484298 >> [v2:172.21.15.106:6807/47111,v1:172.21.15.106:6809/47111] conn(0x7f976c0c8640 0x7f976c156b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.224+0000 7f97718f5700 1 -- 172.21.15.80:0/1211484298 --> [v2:172.21.15.106:6807/47111,v1:172.21.15.106:6809/47111] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f976c0c7d10 con 0x7f976c0c8640 2024-05-08T21:10:34.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.225+0000 7f976a7fc700 1 --2- 172.21.15.80:0/1211484298 >> [v2:172.21.15.106:6807/47111,v1:172.21.15.106:6809/47111] conn(0x7f976c0c8640 0x7f976c156b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.224+0000 7fa3c45cf700 1 --2- 172.21.15.80:0/4119196420 >> [v2:172.21.15.106:6800/47113,v1:172.21.15.106:6801/47113] conn(0x7fa3bc1f4b20 0x7fa3bc0c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.224+0000 7fa3c45cf700 1 -- 172.21.15.80:0/4119196420 --> [v2:172.21.15.106:6800/47113,v1:172.21.15.106:6801/47113] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa3bc15ea60 con 0x7fa3bc1f4b20 2024-05-08T21:10:34.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.225+0000 7fdbcffff700 1 -- 172.21.15.80:0/1080516388 <== osd.3 v2:172.21.15.80:6824/47012 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdbe80c8630 con 0x7fdbd4074350 2024-05-08T21:10:34.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.225+0000 7fa3c1b6a700 1 --2- 172.21.15.80:0/4119196420 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fa3a006ac90 0x7fa3a006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.225+0000 7fa3c2b6c700 1 --2- 172.21.15.80:0/4119196420 >> [v2:172.21.15.106:6800/47113,v1:172.21.15.106:6801/47113] conn(0x7fa3bc1f4b20 0x7fa3bc0c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.225+0000 7f976a7fc700 1 --2- 172.21.15.80:0/1211484298 >> [v2:172.21.15.106:6807/47111,v1:172.21.15.106:6809/47111] conn(0x7f976c0c8640 0x7f976c156b80 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:34.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.226+0000 7fa3c2b6c700 1 --2- 172.21.15.80:0/4119196420 >> [v2:172.21.15.106:6800/47113,v1:172.21.15.106:6801/47113] conn(0x7fa3bc1f4b20 0x7fa3bc0c41c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:34.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.226+0000 7fa3c1b6a700 1 --2- 172.21.15.80:0/4119196420 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fa3a006ac90 0x7fa3a006d150 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc0c8df0 tx=0x7fa3ac006c10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:34.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.226+0000 7f628bcef700 1 -- 172.21.15.80:0/41666617 --> [v2:172.21.15.106:6823/47114,v1:172.21.15.106:6825/47114] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6284070110 con 0x7f62680743d0 2024-05-08T21:10:34.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.226+0000 7fdbedca1700 1 -- 172.21.15.80:0/1080516388 >> [v2:172.21.15.80:6824/47012,v1:172.21.15.80:6825/47012] conn(0x7fdbd4074350 msgr2=0x7fdbd4076790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.226+0000 7fdbedca1700 1 --2- 172.21.15.80:0/1080516388 >> [v2:172.21.15.80:6824/47012,v1:172.21.15.80:6825/47012] conn(0x7fdbd4074350 0x7fdbd4076790 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.227+0000 7fa3b2ffd700 1 -- 172.21.15.80:0/4119196420 <== osd.7 v2:172.21.15.106:6800/47113 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fa3b80040f0 con 0x7fa3bc1f4b20 2024-05-08T21:10:34.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.227+0000 7fdbedca1700 1 -- 172.21.15.80:0/1080516388 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fdbd406ad10 msgr2=0x7fdbd406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.227+0000 7fdbedca1700 1 --2- 172.21.15.80:0/1080516388 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fdbd406ad10 0x7fdbd406d1d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdbe815edb0 tx=0x7fdbe000d040 comp rx=0 tx=0).stop 2024-05-08T21:10:34.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.227+0000 7fdbedca1700 1 -- 172.21.15.80:0/1080516388 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdbe806ad30 msgr2=0x7fdbe81422b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.227+0000 7fdbedca1700 1 --2- 172.21.15.80:0/1080516388 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdbe806ad30 0x7fdbe81422b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc016000 tx=0x7fdbdc004750 comp rx=0 tx=0).stop 2024-05-08T21:10:34.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.227+0000 7fdbe7fff700 1 -- 172.21.15.80:0/1080516388 reap_dead start 2024-05-08T21:10:34.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.227+0000 7fdbedca1700 1 -- 172.21.15.80:0/1080516388 shutdown_connections 2024-05-08T21:10:34.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.227+0000 7fdbedca1700 1 -- 172.21.15.80:0/1080516388 >> 172.21.15.80:0/1080516388 conn(0x7fdbe806ef80 msgr2=0x7fdbe80caec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:34.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.228+0000 7f65c089e700 1 -- 172.21.15.80:0/1511664970 --> [v2:172.21.15.80:6800/47009,v1:172.21.15.80:6801/47009] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f65bc15ae10 con 0x7f659c0743a0 2024-05-08T21:10:34.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.229+0000 7f65aaffd700 1 -- 172.21.15.80:0/1511664970 <== osd.2 v2:172.21.15.80:6800/47009 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f65b4009bf0 con 0x7f659c0743a0 2024-05-08T21:10:34.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.229+0000 7fdbedca1700 1 -- 172.21.15.80:0/1080516388 shutdown_connections 2024-05-08T21:10:34.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.229+0000 7fdbedca1700 1 -- 172.21.15.80:0/1080516388 wait complete. 2024-05-08T21:10:34.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.229+0000 7f65c089e700 1 -- 172.21.15.80:0/1511664970 >> [v2:172.21.15.80:6800/47009,v1:172.21.15.80:6801/47009] conn(0x7f659c0743a0 msgr2=0x7f659c0767e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.229+0000 7f65c089e700 1 --2- 172.21.15.80:0/1511664970 >> [v2:172.21.15.80:6800/47009,v1:172.21.15.80:6801/47009] conn(0x7f659c0743a0 0x7f659c0767e0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.230+0000 7f627a7fc700 1 -- 172.21.15.80:0/41666617 <== osd.4 v2:172.21.15.106:6823/47114 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6284070110 con 0x7f62680743d0 2024-05-08T21:10:34.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.231+0000 7f6e4a1b7700 1 -- 172.21.15.80:0/1140592240 --> [v2:172.21.15.80:6816/47011,v1:172.21.15.80:6817/47011] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6e440c6e50 con 0x7f6e44149f70 2024-05-08T21:10:34.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.231+0000 7f6e3bfff700 1 -- 172.21.15.80:0/1140592240 <== osd.0 v2:172.21.15.80:6816/47011 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6e440c6e50 con 0x7f6e44149f70 2024-05-08T21:10:34.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.232+0000 7f6e4a1b7700 1 -- 172.21.15.80:0/1140592240 >> [v2:172.21.15.80:6816/47011,v1:172.21.15.80:6817/47011] conn(0x7f6e44149f70 msgr2=0x7f6e44137b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.232+0000 7f6e4a1b7700 1 --2- 172.21.15.80:0/1140592240 >> [v2:172.21.15.80:6816/47011,v1:172.21.15.80:6817/47011] conn(0x7f6e44149f70 0x7f6e44137b30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.229+0000 7f65c089e700 1 -- 172.21.15.80:0/1511664970 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f659c06ad60 msgr2=0x7f659c06d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.229+0000 7f65c089e700 1 --2- 172.21.15.80:0/1511664970 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f659c06ad60 0x7f659c06d220 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f65ac000c00 tx=0x7f65ac008030 comp rx=0 tx=0).stop 2024-05-08T21:10:34.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.229+0000 7f65c089e700 1 -- 172.21.15.80:0/1511664970 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65bc150f80 msgr2=0x7f65bc14ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.229+0000 7f65c089e700 1 --2- 172.21.15.80:0/1511664970 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65bc150f80 0x7f65bc14ee50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f65b000c7a0 tx=0x7f65b000cab0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.230+0000 7f65bad9d700 1 -- 172.21.15.80:0/1511664970 reap_dead start 2024-05-08T21:10:34.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.230+0000 7f65c089e700 1 -- 172.21.15.80:0/1511664970 shutdown_connections 2024-05-08T21:10:34.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.230+0000 7f65c089e700 1 -- 172.21.15.80:0/1511664970 >> 172.21.15.80:0/1511664970 conn(0x7f65bc06bad0 msgr2=0x7f65bc072990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:34.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.230+0000 7f65c089e700 1 -- 172.21.15.80:0/1511664970 shutdown_connections 2024-05-08T21:10:34.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.230+0000 7f65c089e700 1 -- 172.21.15.80:0/1511664970 wait complete. 2024-05-08T21:10:34.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.231+0000 7f628bcef700 1 -- 172.21.15.80:0/41666617 >> [v2:172.21.15.106:6823/47114,v1:172.21.15.106:6825/47114] conn(0x7f62680743d0 msgr2=0x7f6268076810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.231+0000 7f628bcef700 1 --2- 172.21.15.80:0/41666617 >> [v2:172.21.15.106:6823/47114,v1:172.21.15.106:6825/47114] conn(0x7f62680743d0 0x7f6268076810 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.231+0000 7f628bcef700 1 -- 172.21.15.80:0/41666617 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f626806ad90 msgr2=0x7f626806d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.231+0000 7f628bcef700 1 --2- 172.21.15.80:0/41666617 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f626806ad90 0x7f626806d250 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f627c00e250 tx=0x7f627c00b040 comp rx=0 tx=0).stop 2024-05-08T21:10:34.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.231+0000 7f628bcef700 1 -- 172.21.15.80:0/41666617 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6284151c50 msgr2=0x7f628415ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.231+0000 7f628bcef700 1 --2- 172.21.15.80:0/41666617 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6284151c50 0x7f628415ab30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6274009fd0 tx=0x7f627400b6c0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.231+0000 7f628a28c700 1 -- 172.21.15.80:0/41666617 reap_dead start 2024-05-08T21:10:34.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.231+0000 7f628bcef700 1 -- 172.21.15.80:0/41666617 shutdown_connections 2024-05-08T21:10:34.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.231+0000 7f628bcef700 1 -- 172.21.15.80:0/41666617 >> 172.21.15.80:0/41666617 conn(0x7f62840c8120 msgr2=0x7f62840710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:34.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.231+0000 7f628bcef700 1 -- 172.21.15.80:0/41666617 shutdown_connections 2024-05-08T21:10:34.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.231+0000 7f628bcef700 1 -- 172.21.15.80:0/41666617 wait complete. 2024-05-08T21:10:34.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.233+0000 7f6e4a1b7700 1 -- 172.21.15.80:0/1140592240 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f6e2406ac90 msgr2=0x7f6e2406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.233+0000 7f6e4a1b7700 1 --2- 172.21.15.80:0/1140592240 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f6e2406ac90 0x7f6e2406d150 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6e34003c50 tx=0x7f6e34009970 comp rx=0 tx=0).stop 2024-05-08T21:10:34.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.233+0000 7f6e4a1b7700 1 -- 172.21.15.80:0/1140592240 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e44162870 msgr2=0x7f6e4415fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.233+0000 7f6e4a1b7700 1 --2- 172.21.15.80:0/1140592240 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e44162870 0x7f6e4415fe90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6e440c7520 tx=0x7f6e2c004750 comp rx=0 tx=0).stop 2024-05-08T21:10:34.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.228+0000 7f9753fff700 1 -- 172.21.15.80:0/1211484298 <== osd.5 v2:172.21.15.106:6807/47111 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f975c0095d0 con 0x7f976c0c8640 2024-05-08T21:10:34.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.241+0000 7f6e43fff700 1 -- 172.21.15.80:0/1140592240 reap_dead start 2024-05-08T21:10:34.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.241+0000 7f6e4a1b7700 1 -- 172.21.15.80:0/1140592240 shutdown_connections 2024-05-08T21:10:34.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.241+0000 7f6e4a1b7700 1 -- 172.21.15.80:0/1140592240 >> 172.21.15.80:0/1140592240 conn(0x7f6e4406a9c0 msgr2=0x7f6e440c7e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:34.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.241+0000 7f6e4a1b7700 1 -- 172.21.15.80:0/1140592240 shutdown_connections 2024-05-08T21:10:34.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.241+0000 7f6e4a1b7700 1 -- 172.21.15.80:0/1140592240 wait complete. 2024-05-08T21:10:34.255 INFO:teuthology.orchestra.run.smithi080.stdout:64424509450 2024-05-08T21:10:34.255 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-08T21:10:34.256 INFO:teuthology.orchestra.run.smithi080.stdout:64424509450 2024-05-08T21:10:34.256 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-08T21:10:34.257 INFO:teuthology.orchestra.run.smithi080.stdout:60129542154 2024-05-08T21:10:34.257 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-08T21:10:34.258 INFO:teuthology.orchestra.run.smithi080.stdout:64424509450 2024-05-08T21:10:34.259 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-08T21:10:34.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.254+0000 7f97718f5700 1 -- 172.21.15.80:0/1211484298 --> [v2:172.21.15.106:6807/47111,v1:172.21.15.106:6809/47111] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f976c15f500 con 0x7f976c0c8640 2024-05-08T21:10:34.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.254+0000 7f9753fff700 1 -- 172.21.15.80:0/1211484298 <== osd.5 v2:172.21.15.106:6807/47111 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f975c009a10 con 0x7f976c0c8640 2024-05-08T21:10:34.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.255+0000 7f97718f5700 1 -- 172.21.15.80:0/1211484298 >> [v2:172.21.15.106:6807/47111,v1:172.21.15.106:6809/47111] conn(0x7f976c0c8640 msgr2=0x7f976c156b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.255+0000 7f97718f5700 1 --2- 172.21.15.80:0/1211484298 >> [v2:172.21.15.106:6807/47111,v1:172.21.15.106:6809/47111] conn(0x7f976c0c8640 0x7f976c156b80 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.255+0000 7f97718f5700 1 -- 172.21.15.80:0/1211484298 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f975806ac90 msgr2=0x7f975806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.255+0000 7f97718f5700 1 --2- 172.21.15.80:0/1211484298 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f975806ac90 0x7f975806d150 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f976c0c9050 tx=0x7f9760009210 comp rx=0 tx=0).stop 2024-05-08T21:10:34.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.255+0000 7f97718f5700 1 -- 172.21.15.80:0/1211484298 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f976c162870 msgr2=0x7f976c0c9b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.255+0000 7f97718f5700 1 --2- 172.21.15.80:0/1211484298 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f976c162870 0x7f976c0c9b70 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f976400b370 tx=0x7f9764004ad0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.255+0000 7f976b7fe700 1 -- 172.21.15.80:0/1211484298 reap_dead start 2024-05-08T21:10:34.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.255+0000 7f97718f5700 1 -- 172.21.15.80:0/1211484298 shutdown_connections 2024-05-08T21:10:34.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.255+0000 7f97718f5700 1 -- 172.21.15.80:0/1211484298 >> 172.21.15.80:0/1211484298 conn(0x7f976c06a9c0 msgr2=0x7f976c06ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:34.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.255+0000 7f97718f5700 1 -- 172.21.15.80:0/1211484298 shutdown_connections 2024-05-08T21:10:34.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.255+0000 7f97718f5700 1 -- 172.21.15.80:0/1211484298 wait complete. 2024-05-08T21:10:34.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.257+0000 7fa3c45cf700 1 -- 172.21.15.80:0/4119196420 --> [v2:172.21.15.106:6800/47113,v1:172.21.15.106:6801/47113] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa3bc0c2ab0 con 0x7fa3bc1f4b20 2024-05-08T21:10:34.263 INFO:teuthology.orchestra.run.smithi080.stdout:60129542155 2024-05-08T21:10:34.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.257+0000 7fa3b2ffd700 1 -- 172.21.15.80:0/4119196420 <== osd.7 v2:172.21.15.106:6800/47113 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa3b80036a0 con 0x7fa3bc1f4b20 2024-05-08T21:10:34.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.258+0000 7fa3c45cf700 1 -- 172.21.15.80:0/4119196420 >> [v2:172.21.15.106:6800/47113,v1:172.21.15.106:6801/47113] conn(0x7fa3bc1f4b20 msgr2=0x7fa3bc0c41c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.258+0000 7fa3c45cf700 1 --2- 172.21.15.80:0/4119196420 >> [v2:172.21.15.106:6800/47113,v1:172.21.15.106:6801/47113] conn(0x7fa3bc1f4b20 0x7fa3bc0c41c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.258+0000 7fa3c45cf700 1 -- 172.21.15.80:0/4119196420 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fa3a006ac90 msgr2=0x7fa3a006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.258+0000 7fa3c45cf700 1 --2- 172.21.15.80:0/4119196420 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fa3a006ac90 0x7fa3a006d150 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc0c8df0 tx=0x7fa3ac006c10 comp rx=0 tx=0).stop 2024-05-08T21:10:34.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.258+0000 7fa3c45cf700 1 -- 172.21.15.80:0/4119196420 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3bc0c3000 msgr2=0x7fa3bc0cbe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.258+0000 7fa3c45cf700 1 --2- 172.21.15.80:0/4119196420 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3bc0c3000 0x7fa3bc0cbe80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa3b400c8c0 tx=0x7fa3b400cc80 comp rx=0 tx=0).stop 2024-05-08T21:10:34.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.258+0000 7fa3c2b6c700 1 -- 172.21.15.80:0/4119196420 reap_dead start 2024-05-08T21:10:34.264 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-08T21:10:34.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.261+0000 7fa3c45cf700 1 -- 172.21.15.80:0/4119196420 shutdown_connections 2024-05-08T21:10:34.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.261+0000 7fa3c45cf700 1 -- 172.21.15.80:0/4119196420 >> 172.21.15.80:0/4119196420 conn(0x7fa3bc06a9c0 msgr2=0x7fa3bc15e0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:34.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.261+0000 7fa3c45cf700 1 -- 172.21.15.80:0/4119196420 shutdown_connections 2024-05-08T21:10:34.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.261+0000 7fa3c45cf700 1 -- 172.21.15.80:0/4119196420 wait complete. 2024-05-08T21:10:34.267 INFO:teuthology.orchestra.run.smithi080.stdout:55834574857 2024-05-08T21:10:34.267 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-08T21:10:34.279 INFO:teuthology.orchestra.run.smithi080.stdout:64424509451 2024-05-08T21:10:34.279 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-08T21:10:34.285 INFO:teuthology.orchestra.run.smithi080.stdout:60129542154 2024-05-08T21:10:34.285 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-08T21:10:34.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.441+0000 7f527c942700 1 Processor -- start 2024-05-08T21:10:34.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.441+0000 7f527c942700 1 -- start start 2024-05-08T21:10:34.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.442+0000 7f527c942700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f52780cba70 0x7f52780c30e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.442+0000 7f527c942700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f527815f030 con 0x7f52780cbe50 2024-05-08T21:10:34.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.442+0000 7f527c942700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f527815f310 con 0x7f5278162860 2024-05-08T21:10:34.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.442+0000 7f527c942700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52780c2df0 con 0x7f52780cba70 2024-05-08T21:10:34.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.443+0000 7f5275d9b700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f52780cbe50 0x7f527815e750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41786/0 (socket says 172.21.15.80:41786) 2024-05-08T21:10:34.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.443+0000 7f5275d9b700 1 -- 172.21.15.80:0/4113876919 learned_addr learned my addr 172.21.15.80:0/4113876919 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:10:34.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.444+0000 7f527659c700 1 --2- 172.21.15.80:0/4113876919 >> v2:172.21.15.80:3300/0 conn(0x7f52780cba70 0x7f52780c30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.444+0000 7f527659c700 1 -- 172.21.15.80:0/4113876919 >> v1:172.21.15.106:6789/0 conn(0x7f5278162860 legacy=0x7f5278158560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.444+0000 7f527659c700 1 -- 172.21.15.80:0/4113876919 >> v1:172.21.15.80:6789/0 conn(0x7f52780cbe50 legacy=0x7f527815e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.444+0000 7f527659c700 1 -- 172.21.15.80:0/4113876919 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5278161d80 con 0x7f52780cba70 2024-05-08T21:10:34.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.445+0000 7f527659c700 1 --2- 172.21.15.80:0/4113876919 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52780cba70 0x7f52780c30e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5270009d90 tx=0x7f527000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=693734fdaa14be0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:34.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.445+0000 7f527559a700 1 -- 172.21.15.80:0/4113876919 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f527000e070 con 0x7f52780cba70 2024-05-08T21:10:34.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.446+0000 7f527559a700 1 -- 172.21.15.80:0/4113876919 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f527000bad0 con 0x7f52780cba70 2024-05-08T21:10:34.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.446+0000 7f527559a700 1 -- 172.21.15.80:0/4113876919 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f527000be60 con 0x7f52780cba70 2024-05-08T21:10:34.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.447+0000 7f527c942700 1 -- 172.21.15.80:0/4113876919 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52780cba70 msgr2=0x7f52780c30e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.447+0000 7f527c942700 1 --2- 172.21.15.80:0/4113876919 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52780cba70 0x7f52780c30e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5270009d90 tx=0x7f527000b330 comp rx=0 tx=0).stop 2024-05-08T21:10:34.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.447+0000 7f527c942700 1 -- 172.21.15.80:0/4113876919 shutdown_connections 2024-05-08T21:10:34.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.447+0000 7f527c942700 1 --2- 172.21.15.80:0/4113876919 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52780cba70 0x7f52780c30e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.447+0000 7f527c942700 1 -- 172.21.15.80:0/4113876919 >> 172.21.15.80:0/4113876919 conn(0x7f527806a9c0 msgr2=0x7f527806ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:34.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.448+0000 7f527c942700 1 -- 172.21.15.80:0/4113876919 shutdown_connections 2024-05-08T21:10:34.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.448+0000 7f527c942700 1 -- 172.21.15.80:0/4113876919 wait complete. 2024-05-08T21:10:34.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.450+0000 7f527c942700 1 Processor -- start 2024-05-08T21:10:34.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.450+0000 7f527c942700 1 -- start start 2024-05-08T21:10:34.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.452+0000 7f527c942700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f52780cba70 0x7f527815af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.452+0000 7f527c942700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52780cbe50 0x7f527813da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.452+0000 7f527c942700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5278162860 0x7f527813d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.452+0000 7f527c942700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f527815c170 con 0x7f52780cbe50 2024-05-08T21:10:34.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.452+0000 7f527c942700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f527815aaf0 con 0x7f52780cba70 2024-05-08T21:10:34.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.452+0000 7f527c942700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f527813d7b0 con 0x7f5278162860 2024-05-08T21:10:34.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.452+0000 7f527659c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f52780cba70 0x7f527815af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.452+0000 7f527659c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f52780cba70 0x7f527815af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.80:45320/0 (socket says 172.21.15.80:45320) 2024-05-08T21:10:34.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.452+0000 7f527659c700 1 -- 172.21.15.80:0/3035919301 learned_addr learned my addr 172.21.15.80:0/3035919301 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:34.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.452+0000 7f5276d9d700 1 --2- 172.21.15.80:0/3035919301 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5278162860 0x7f527813d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.453+0000 7f527659c700 1 -- 172.21.15.80:0/3035919301 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5278162860 msgr2=0x7f527813d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.453+0000 7f527659c700 1 --2- 172.21.15.80:0/3035919301 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5278162860 0x7f527813d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.453+0000 7f527659c700 1 -- 172.21.15.80:0/3035919301 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52780cbe50 msgr2=0x7f527813da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.453+0000 7f527659c700 1 --2- 172.21.15.80:0/3035919301 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52780cbe50 0x7f527813da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.453+0000 7f527659c700 1 -- 172.21.15.80:0/3035919301 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5270009a70 con 0x7f52780cba70 2024-05-08T21:10:34.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.453+0000 7f527659c700 1 --2- 172.21.15.80:0/3035919301 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f52780cba70 0x7f527815af80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f52780cc640 tx=0x7f5270004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:34.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.453+0000 7f5266ffd700 1 -- 172.21.15.80:0/3035919301 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5270004860 con 0x7f52780cba70 2024-05-08T21:10:34.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.453+0000 7f527c942700 1 -- 172.21.15.80:0/3035919301 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52781591b0 con 0x7f52780cba70 2024-05-08T21:10:34.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.453+0000 7f527c942700 1 -- 172.21.15.80:0/3035919301 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f527815a780 con 0x7f52780cba70 2024-05-08T21:10:34.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.454+0000 7f5266ffd700 1 -- 172.21.15.80:0/3035919301 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5270003e10 con 0x7f52780cba70 2024-05-08T21:10:34.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.454+0000 7f5266ffd700 1 -- 172.21.15.80:0/3035919301 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5270012690 con 0x7f52780cba70 2024-05-08T21:10:34.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.456+0000 7f5266ffd700 1 -- 172.21.15.80:0/3035919301 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f52700127f0 con 0x7f52780cba70 2024-05-08T21:10:34.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.456+0000 7f5266ffd700 1 --2- 172.21.15.80:0/3035919301 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f525806acc0 0x7f525806d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.457+0000 7f5266ffd700 1 -- 172.21.15.80:0/3035919301 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f527008b730 con 0x7f52780cba70 2024-05-08T21:10:34.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.460+0000 7f527c942700 1 -- 172.21.15.80:0/3035919301 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f525c0052f0 con 0x7f52780cba70 2024-05-08T21:10:34.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.460+0000 7f5275d9b700 1 --2- 172.21.15.80:0/3035919301 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f525806acc0 0x7f525806d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.461+0000 7f5275d9b700 1 --2- 172.21.15.80:0/3035919301 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f525806acc0 0x7f525806d180 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f526c000c00 tx=0x7f526c007a50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:34.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.466+0000 7f5266ffd700 1 -- 172.21.15.80:0/3035919301 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f5270056610 con 0x7f52780cba70 2024-05-08T21:10:34.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.466+0000 7f3cdfdf5700 1 Processor -- start 2024-05-08T21:10:34.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.466+0000 7f3cdfdf5700 1 -- start start 2024-05-08T21:10:34.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.468+0000 7f3cdfdf5700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f3cd80c68f0 0x7f3cd80cb570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.468+0000 7f3cdfdf5700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3cd80cbab0 0x7f3cd81569d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.468+0000 7f3cdfdf5700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cd80709d0 con 0x7f3cd8150750 2024-05-08T21:10:34.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.468+0000 7f3cdfdf5700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cd80c6d50 con 0x7f3cd80cbab0 2024-05-08T21:10:34.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.468+0000 7f3cdfdf5700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cd81562e0 con 0x7f3cd80c68f0 2024-05-08T21:10:34.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.468+0000 7f3cde392700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3cd80cbab0 0x7f3cd81569d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.468+0000 7f3cde392700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3cd80cbab0 0x7f3cd81569d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42496/0 (socket says 172.21.15.80:42496) 2024-05-08T21:10:34.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.468+0000 7f3cde392700 1 -- 172.21.15.80:0/3401139998 learned_addr learned my addr 172.21.15.80:0/3401139998 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:34.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.469+0000 7f3cdd390700 1 --2- 172.21.15.80:0/3401139998 >> v2:172.21.15.106:3300/0 conn(0x7f3cd80c68f0 0x7f3cd80cb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.469+0000 7f3cde392700 1 -- 172.21.15.80:0/3401139998 >> v2:172.21.15.106:3300/0 conn(0x7f3cd80c68f0 msgr2=0x7f3cd80cb570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:34.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.469+0000 7f3cde392700 1 --2- 172.21.15.80:0/3401139998 >> v2:172.21.15.106:3300/0 conn(0x7f3cd80c68f0 0x7f3cd80cb570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.469+0000 7f3cde392700 1 -- 172.21.15.80:0/3401139998 >> v1:172.21.15.106:6789/0 conn(0x7f3cd8150750 legacy=0x7f3cd815a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.469+0000 7f3cde392700 1 -- 172.21.15.80:0/3401139998 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd81564d0 con 0x7f3cd80cbab0 2024-05-08T21:10:34.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.469+0000 7f3cde392700 1 --2- 172.21.15.80:0/3401139998 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3cd80cbab0 0x7f3cd81569d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3cd80700b0 tx=0x7f3cd4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e516e6b6f0b4e53 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:34.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.469+0000 7ff263ed1700 1 Processor -- start 2024-05-08T21:10:34.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.470+0000 7f3cdcb8f700 1 -- 172.21.15.80:0/3401139998 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd4011830 con 0x7f3cd80cbab0 2024-05-08T21:10:34.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.470+0000 7f3cdcb8f700 1 -- 172.21.15.80:0/3401139998 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd4011990 con 0x7f3cd80cbab0 2024-05-08T21:10:34.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.470+0000 7f3cdcb8f700 1 -- 172.21.15.80:0/3401139998 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd4011d20 con 0x7f3cd80cbab0 2024-05-08T21:10:34.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.470+0000 7ff263ed1700 1 -- start start 2024-05-08T21:10:34.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.470+0000 7ff263ed1700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff25c06b4b0 0x7ff25c150410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.470+0000 7ff263ed1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff25c0c3100 0x7ff25c0c3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.471+0000 7ff263ed1700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff25c0c7010 con 0x7ff25c0c6af0 2024-05-08T21:10:34.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.471+0000 7ff263ed1700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff25c0c2bf0 con 0x7ff25c0c3100 2024-05-08T21:10:34.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.471+0000 7ff263ed1700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff25c0c7f40 con 0x7ff25c06b4b0 2024-05-08T21:10:34.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.471+0000 7ff26246e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff25c0c3100 0x7ff25c0c3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.471+0000 7f3cdfdf5700 1 -- 172.21.15.80:0/3401139998 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3cd80cbab0 msgr2=0x7f3cd81569d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.471+0000 7f3cdfdf5700 1 --2- 172.21.15.80:0/3401139998 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3cd80cbab0 0x7f3cd81569d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3cd80700b0 tx=0x7f3cd4009c00 comp rx=0 tx=0).stop 2024-05-08T21:10:34.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.471+0000 7ff26246e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff25c0c3100 0x7ff25c0c3570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42508/0 (socket says 172.21.15.80:42508) 2024-05-08T21:10:34.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.471+0000 7ff26246e700 1 -- 172.21.15.80:0/2319959357 learned_addr learned my addr 172.21.15.80:0/2319959357 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:34.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.471+0000 7f93b28c1700 1 Processor -- start 2024-05-08T21:10:34.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.471+0000 7f3cdfdf5700 1 -- 172.21.15.80:0/3401139998 shutdown_connections 2024-05-08T21:10:34.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.471+0000 7f3cdfdf5700 1 --2- 172.21.15.80:0/3401139998 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3cd80cbab0 0x7f3cd81569d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.471+0000 7f3cdfdf5700 1 --2- 172.21.15.80:0/3401139998 >> v2:172.21.15.106:3300/0 conn(0x7f3cd80c68f0 0x7f3cd80cb570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.471+0000 7f3cdfdf5700 1 -- 172.21.15.80:0/3401139998 >> 172.21.15.80:0/3401139998 conn(0x7f3cd806a9c0 msgr2=0x7f3cd806ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:34.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.471+0000 7ff26246e700 1 -- 172.21.15.80:0/2319959357 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff25c06b4b0 msgr2=0x7ff25c150410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:34.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.471+0000 7ff26246e700 1 --2- 172.21.15.80:0/2319959357 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff25c06b4b0 0x7ff25c150410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.471+0000 7ff26246e700 1 -- 172.21.15.80:0/2319959357 >> v1:172.21.15.106:6789/0 conn(0x7ff25c0c6af0 legacy=0x7ff25c156dc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T21:10:34.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.471+0000 7ff26246e700 1 -- 172.21.15.80:0/2319959357 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff25c0c8220 con 0x7ff25c0c3100 2024-05-08T21:10:34.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.472+0000 7f3cdfdf5700 1 -- 172.21.15.80:0/3401139998 shutdown_connections 2024-05-08T21:10:34.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.472+0000 7ff26246e700 1 --2- 172.21.15.80:0/2319959357 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff25c0c3100 0x7ff25c0c3570 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff2580098f0 tx=0x7ff258009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7d323200e05472e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:34.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.471+0000 7f93b28c1700 1 -- start start 2024-05-08T21:10:34.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.472+0000 7ff260c6b700 1 -- 172.21.15.80:0/2319959357 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff258004230 con 0x7ff25c0c3100 2024-05-08T21:10:34.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.472+0000 7ff260c6b700 1 -- 172.21.15.80:0/2319959357 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff258004390 con 0x7ff25c0c3100 2024-05-08T21:10:34.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.472+0000 7ff260c6b700 1 -- 172.21.15.80:0/2319959357 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2580036a0 con 0x7ff25c0c3100 2024-05-08T21:10:34.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.472+0000 7f93b28c1700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f93ac0c6680 0x7f93ac162160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.472+0000 7f93b28c1700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f93ac1626a0 0x7f93ac169110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.472+0000 7f93b28c1700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93ac162af0 con 0x7f93ac158760 2024-05-08T21:10:34.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.472+0000 7f93b28c1700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93ac15e790 con 0x7f93ac0c6680 2024-05-08T21:10:34.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.472+0000 7f93b28c1700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac15e980 con 0x7f93ac1626a0 2024-05-08T21:10:34.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.473+0000 7ff263ed1700 1 -- 172.21.15.80:0/2319959357 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff25c0c3100 msgr2=0x7ff25c0c3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.473+0000 7ff263ed1700 1 --2- 172.21.15.80:0/2319959357 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff25c0c3100 0x7ff25c0c3570 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff2580098f0 tx=0x7ff258009c00 comp rx=0 tx=0).stop 2024-05-08T21:10:34.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.473+0000 7f93b0e5e700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f93ac1626a0 0x7f93ac169110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.473+0000 7f93b0e5e700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f93ac1626a0 0x7f93ac169110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:52012/0 (socket says 172.21.15.80:52012) 2024-05-08T21:10:34.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.473+0000 7f93b0e5e700 1 -- 172.21.15.80:0/1290722847 learned_addr learned my addr 172.21.15.80:0/1290722847 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:34.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.473+0000 7ff263ed1700 1 -- 172.21.15.80:0/2319959357 shutdown_connections 2024-05-08T21:10:34.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.473+0000 7ff263ed1700 1 --2- 172.21.15.80:0/2319959357 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff25c0c3100 0x7ff25c0c3570 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.473+0000 7ff263ed1700 1 --2- 172.21.15.80:0/2319959357 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff25c06b4b0 0x7ff25c150410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.473+0000 7ff263ed1700 1 -- 172.21.15.80:0/2319959357 >> 172.21.15.80:0/2319959357 conn(0x7ff25c06a9c0 msgr2=0x7ff25c06ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:34.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.473+0000 7f93b0e5e700 1 -- 172.21.15.80:0/1290722847 >> v2:172.21.15.106:3300/0 conn(0x7f93ac0c6680 msgr2=0x7f93ac162160 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T21:10:34.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.473+0000 7f93b0e5e700 1 --2- 172.21.15.80:0/1290722847 >> v2:172.21.15.106:3300/0 conn(0x7f93ac0c6680 0x7f93ac162160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.473+0000 7f93b0e5e700 1 -- 172.21.15.80:0/1290722847 >> v1:172.21.15.80:6789/0 conn(0x7f93ac158760 legacy=0x7f93ac0c8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.473+0000 7f93b0e5e700 1 -- 172.21.15.80:0/1290722847 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93ac15ec60 con 0x7f93ac1626a0 2024-05-08T21:10:34.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.473+0000 7ff263ed1700 1 -- 172.21.15.80:0/2319959357 shutdown_connections 2024-05-08T21:10:34.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.473+0000 7f93b0e5e700 1 --2- 172.21.15.80:0/1290722847 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f93ac1626a0 0x7f93ac169110 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f93a4009e50 tx=0x7f93a400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7418fa8057947ba server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:34.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.474+0000 7f93aaffd700 1 -- 172.21.15.80:0/1290722847 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a400e070 con 0x7f93ac1626a0 2024-05-08T21:10:34.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.474+0000 7f93aaffd700 1 -- 172.21.15.80:0/1290722847 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a400b9c0 con 0x7f93ac1626a0 2024-05-08T21:10:34.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.472+0000 7f3cdfdf5700 1 -- 172.21.15.80:0/3401139998 wait complete. 2024-05-08T21:10:34.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.474+0000 7f3cdfdf5700 1 Processor -- start 2024-05-08T21:10:34.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.474+0000 7f93aaffd700 1 -- 172.21.15.80:0/1290722847 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a400bd70 con 0x7f93ac1626a0 2024-05-08T21:10:34.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.473+0000 7ff263ed1700 1 -- 172.21.15.80:0/2319959357 wait complete. 2024-05-08T21:10:34.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.475+0000 7f93b28c1700 1 -- 172.21.15.80:0/1290722847 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f93ac1626a0 msgr2=0x7f93ac169110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.475+0000 7f93b28c1700 1 --2- 172.21.15.80:0/1290722847 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f93ac1626a0 0x7f93ac169110 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f93a4009e50 tx=0x7f93a400b330 comp rx=0 tx=0).stop 2024-05-08T21:10:34.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.475+0000 7f93b28c1700 1 -- 172.21.15.80:0/1290722847 shutdown_connections 2024-05-08T21:10:34.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.475+0000 7f93b28c1700 1 --2- 172.21.15.80:0/1290722847 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f93ac1626a0 0x7f93ac169110 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.475+0000 7f93b28c1700 1 --2- 172.21.15.80:0/1290722847 >> v2:172.21.15.106:3300/0 conn(0x7f93ac0c6680 0x7f93ac162160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.475+0000 7f93b28c1700 1 -- 172.21.15.80:0/1290722847 >> 172.21.15.80:0/1290722847 conn(0x7f93ac06a9c0 msgr2=0x7f93ac06ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:34.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.474+0000 7f3cdfdf5700 1 -- start start 2024-05-08T21:10:34.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.475+0000 7f3cdfdf5700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3cd80c68f0 0x7f3cd81538c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.475+0000 7f3cdfdf5700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3cd80cbab0 0x7f3cd814b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.475+0000 7f3cdfdf5700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3cd8150750 0x7f3cd80c2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.475+0000 7f3cdfdf5700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd81f4b60 con 0x7f3cd80c68f0 2024-05-08T21:10:34.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.475+0000 7f3cdfdf5700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd8152b00 con 0x7f3cd80cbab0 2024-05-08T21:10:34.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.475+0000 7f3cdfdf5700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd8152de0 con 0x7f3cd8150750 2024-05-08T21:10:34.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.475+0000 7f3cdd390700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3cd80cbab0 0x7f3cd814b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.476+0000 7f3cdd390700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3cd80cbab0 0x7f3cd814b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.80:45358/0 (socket says 172.21.15.80:45358) 2024-05-08T21:10:34.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.476+0000 7f3cdd390700 1 -- 172.21.15.80:0/1519443732 learned_addr learned my addr 172.21.15.80:0/1519443732 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:34.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.476+0000 7f3cddb91700 1 --2- 172.21.15.80:0/1519443732 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3cd80c68f0 0x7f3cd81538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.476+0000 7f3cddb91700 1 -- 172.21.15.80:0/1519443732 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3cd8150750 msgr2=0x7f3cd80c2d20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T21:10:34.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.476+0000 7f3cddb91700 1 --2- 172.21.15.80:0/1519443732 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3cd8150750 0x7f3cd80c2d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.476+0000 7f3cddb91700 1 -- 172.21.15.80:0/1519443732 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3cd80cbab0 msgr2=0x7f3cd814b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.476+0000 7f3cddb91700 1 --2- 172.21.15.80:0/1519443732 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3cd80cbab0 0x7f3cd814b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.476+0000 7f3cddb91700 1 -- 172.21.15.80:0/1519443732 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd4009550 con 0x7f3cd80c68f0 2024-05-08T21:10:34.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.476+0000 7f3cdd390700 1 --2- 172.21.15.80:0/1519443732 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3cd80cbab0 0x7f3cd814b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:10:34.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.476+0000 7f3cddb91700 1 --2- 172.21.15.80:0/1519443732 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3cd80c68f0 0x7f3cd81538c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3cd000cb10 tx=0x7f3cd000ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:34.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.476+0000 7f3cce7fc700 1 -- 172.21.15.80:0/1519443732 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd0003c00 con 0x7f3cd80c68f0 2024-05-08T21:10:34.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.476+0000 7f3cce7fc700 1 -- 172.21.15.80:0/1519443732 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd0003d60 con 0x7f3cd80c68f0 2024-05-08T21:10:34.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.476+0000 7f3cce7fc700 1 -- 172.21.15.80:0/1519443732 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd000aae0 con 0x7f3cd80c68f0 2024-05-08T21:10:34.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.476+0000 7f3cdfdf5700 1 -- 172.21.15.80:0/1519443732 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cd81530c0 con 0x7f3cd80c68f0 2024-05-08T21:10:34.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.477+0000 7f3cdfdf5700 1 -- 172.21.15.80:0/1519443732 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cd80c4010 con 0x7f3cd80c68f0 2024-05-08T21:10:34.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.478+0000 7f3cce7fc700 1 -- 172.21.15.80:0/1519443732 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3cd000ac40 con 0x7f3cd80c68f0 2024-05-08T21:10:34.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.478+0000 7f3cdfdf5700 1 -- 172.21.15.80:0/1519443732 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cbc0052f0 con 0x7f3cd80c68f0 2024-05-08T21:10:34.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.479+0000 7ff263ed1700 1 Processor -- start 2024-05-08T21:10:34.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.479+0000 7f3cce7fc700 1 --2- 172.21.15.80:0/1519443732 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f3cc406af00 0x7f3cc406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.479+0000 7f3cce7fc700 1 -- 172.21.15.80:0/1519443732 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3cd0089630 con 0x7f3cd80c68f0 2024-05-08T21:10:34.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.479+0000 7ff263ed1700 1 -- start start 2024-05-08T21:10:34.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.481+0000 7f3cdd390700 1 --2- 172.21.15.80:0/1519443732 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f3cc406af00 0x7f3cc406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.480+0000 7ff263ed1700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff25c06b4b0 0x7ff25c153070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.481+0000 7ff263ed1700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff25c0c3100 0x7ff25c166ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.481+0000 7ff263ed1700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff25c0c6af0 0x7ff25c167420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.481+0000 7ff263ed1700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff25c1568d0 con 0x7ff25c0c6af0 2024-05-08T21:10:34.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.481+0000 7ff263ed1700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff25c156ed0 con 0x7ff25c0c3100 2024-05-08T21:10:34.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.481+0000 7ff263ed1700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff25c154910 con 0x7ff25c06b4b0 2024-05-08T21:10:34.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.481+0000 7ff261c6d700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff25c06b4b0 0x7ff25c153070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.481+0000 7ff261c6d700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff25c06b4b0 0x7ff25c153070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:52020/0 (socket says 172.21.15.80:52020) 2024-05-08T21:10:34.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.481+0000 7ff261c6d700 1 -- 172.21.15.80:0/2391670949 learned_addr learned my addr 172.21.15.80:0/2391670949 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:34.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.481+0000 7ff26146c700 1 --2- 172.21.15.80:0/2391670949 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff25c0c3100 0x7ff25c166ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.481+0000 7ff26246e700 1 --2- 172.21.15.80:0/2391670949 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff25c0c6af0 0x7ff25c167420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.481+0000 7ff261c6d700 1 -- 172.21.15.80:0/2391670949 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff25c0c3100 msgr2=0x7ff25c166ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.481+0000 7ff261c6d700 1 --2- 172.21.15.80:0/2391670949 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff25c0c3100 0x7ff25c166ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.481+0000 7ff261c6d700 1 -- 172.21.15.80:0/2391670949 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff25c0c6af0 msgr2=0x7ff25c167420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.481+0000 7ff261c6d700 1 --2- 172.21.15.80:0/2391670949 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff25c0c6af0 0x7ff25c167420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.481+0000 7ff261c6d700 1 -- 172.21.15.80:0/2391670949 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff258009550 con 0x7ff25c06b4b0 2024-05-08T21:10:34.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.481+0000 7ff261c6d700 1 --2- 172.21.15.80:0/2391670949 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff25c06b4b0 0x7ff25c153070 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff25400ba80 tx=0x7ff25400be40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:34.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.482+0000 7ff2527fc700 1 -- 172.21.15.80:0/2391670949 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25400ca50 con 0x7ff25c06b4b0 2024-05-08T21:10:34.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.482+0000 7ff263ed1700 1 -- 172.21.15.80:0/2391670949 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff25c143cc0 con 0x7ff25c06b4b0 2024-05-08T21:10:34.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.482+0000 7ff263ed1700 1 -- 172.21.15.80:0/2391670949 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff25c144260 con 0x7ff25c06b4b0 2024-05-08T21:10:34.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.482+0000 7f3cdd390700 1 --2- 172.21.15.80:0/1519443732 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f3cc406af00 0x7f3cc406d3c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3cd814d600 tx=0x7f3cc8009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:34.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.483+0000 7ff2527fc700 1 -- 172.21.15.80:0/2391670949 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff25400cbb0 con 0x7ff25c06b4b0 2024-05-08T21:10:34.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.483+0000 7ff2527fc700 1 -- 172.21.15.80:0/2391670949 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff254014440 con 0x7ff25c06b4b0 2024-05-08T21:10:34.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.484+0000 7ff263ed1700 1 -- 172.21.15.80:0/2391670949 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2440052f0 con 0x7ff25c06b4b0 2024-05-08T21:10:34.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.484+0000 7f93b28c1700 1 -- 172.21.15.80:0/1290722847 shutdown_connections 2024-05-08T21:10:34.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.483+0000 7f9f311cf700 1 Processor -- start 2024-05-08T21:10:34.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.483+0000 7f9f311cf700 1 -- start start 2024-05-08T21:10:34.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.485+0000 7f9f311cf700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9f2c0c8180 0x7f9f2c0c2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.485+0000 7f9f311cf700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f2c0c6f30 con 0x7f9f2c0c7420 2024-05-08T21:10:34.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.485+0000 7f9f311cf700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f2c15e7d0 con 0x7f9f2c06b0d0 2024-05-08T21:10:34.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.485+0000 7f9f311cf700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f2c15eab0 con 0x7f9f2c0c8180 2024-05-08T21:10:34.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.486+0000 7f9f2b59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9f2c0c8180 0x7f9f2c0c2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.486+0000 7f9f2b59e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9f2c0c8180 0x7f9f2c0c2230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42526/0 (socket says 172.21.15.80:42526) 2024-05-08T21:10:34.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.486+0000 7f9f2b59e700 1 -- 172.21.15.80:0/384704325 learned_addr learned my addr 172.21.15.80:0/384704325 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:34.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.486+0000 7f9f2b59e700 1 -- 172.21.15.80:0/384704325 >> v1:172.21.15.106:6789/0 conn(0x7f9f2c06b0d0 legacy=0x7f9f2c166f50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T21:10:34.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.486+0000 7f9f2b59e700 1 -- 172.21.15.80:0/384704325 >> v1:172.21.15.80:6789/0 conn(0x7f9f2c0c7420 legacy=0x7f9f2c06a9c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T21:10:34.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.486+0000 7f9f2b59e700 1 -- 172.21.15.80:0/384704325 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f2c15ed90 con 0x7f9f2c0c8180 2024-05-08T21:10:34.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.487+0000 7f9f2b59e700 1 --2- 172.21.15.80:0/384704325 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f2c0c8180 0x7f9f2c0c2230 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9f200098f0 tx=0x7f9f20009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb41f7cfe2e3df65 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:34.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.485+0000 7f93b28c1700 1 -- 172.21.15.80:0/1290722847 wait complete. 2024-05-08T21:10:34.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.487+0000 7f93b28c1700 1 Processor -- start 2024-05-08T21:10:34.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.487+0000 7ff2527fc700 1 -- 172.21.15.80:0/2391670949 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff25401d3b0 con 0x7ff25c06b4b0 2024-05-08T21:10:34.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.487+0000 7f3cce7fc700 1 -- 172.21.15.80:0/1519443732 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f3cd0054470 con 0x7f3cd80c68f0 2024-05-08T21:10:34.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.488+0000 7ff2527fc700 1 --2- 172.21.15.80:0/2391670949 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7ff24006ac90 0x7ff24006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.488+0000 7ff2527fc700 1 -- 172.21.15.80:0/2391670949 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff254006e40 con 0x7ff25c06b4b0 2024-05-08T21:10:34.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.487+0000 7f93b28c1700 1 -- start start 2024-05-08T21:10:34.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.488+0000 7f93b28c1700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93ac0c6680 0x7f93ac0c4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.488+0000 7f93b28c1700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f93ac158760 0x7f93ac0c9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.488+0000 7f93b28c1700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f93ac1626a0 0x7f93ac0c9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.488+0000 7f93b28c1700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac15ad00 con 0x7f93ac0c6680 2024-05-08T21:10:34.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.488+0000 7f93b28c1700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac0cbdb0 con 0x7f93ac158760 2024-05-08T21:10:34.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.488+0000 7f93b28c1700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac0cb9d0 con 0x7f93ac1626a0 2024-05-08T21:10:34.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.489+0000 7f93abfff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93ac0c6680 0x7f93ac0c4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.489+0000 7f93abfff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93ac0c6680 0x7f93ac0c4000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42534/0 (socket says 172.21.15.80:42534) 2024-05-08T21:10:34.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.489+0000 7f93abfff700 1 -- 172.21.15.80:0/1967782763 learned_addr learned my addr 172.21.15.80:0/1967782763 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:34.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.489+0000 7ff26146c700 1 --2- 172.21.15.80:0/2391670949 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7ff24006ac90 0x7ff24006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.490+0000 7ff26146c700 1 --2- 172.21.15.80:0/2391670949 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7ff24006ac90 0x7ff24006d150 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff25c146bb0 tx=0x7ff24c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:34.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.489+0000 7f93ab7fe700 1 --2- 172.21.15.80:0/1967782763 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f93ac158760 0x7f93ac0c9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.489+0000 7f93b0e5e700 1 --2- 172.21.15.80:0/1967782763 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f93ac1626a0 0x7f93ac0c9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.489+0000 7f93abfff700 1 -- 172.21.15.80:0/1967782763 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f93ac1626a0 msgr2=0x7f93ac0c9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.489+0000 7f93abfff700 1 --2- 172.21.15.80:0/1967782763 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f93ac1626a0 0x7f93ac0c9a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.489+0000 7f93abfff700 1 -- 172.21.15.80:0/1967782763 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f93ac158760 msgr2=0x7f93ac0c9540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.489+0000 7f93abfff700 1 --2- 172.21.15.80:0/1967782763 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f93ac158760 0x7f93ac0c9540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.489+0000 7f93abfff700 1 -- 172.21.15.80:0/1967782763 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a4009b30 con 0x7f93ac0c6680 2024-05-08T21:10:34.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.490+0000 7f93abfff700 1 --2- 172.21.15.80:0/1967782763 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93ac0c6680 0x7f93ac0c4000 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f93a000c4e0 tx=0x7f93a000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:34.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.489+0000 7f9f29d9b700 1 -- 172.21.15.80:0/384704325 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f20004230 con 0x7f9f2c0c8180 2024-05-08T21:10:34.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.489+0000 7f9f29d9b700 1 -- 172.21.15.80:0/384704325 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f20004390 con 0x7f9f2c0c8180 2024-05-08T21:10:34.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.489+0000 7f9f29d9b700 1 -- 172.21.15.80:0/384704325 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f200036a0 con 0x7f9f2c0c8180 2024-05-08T21:10:34.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.490+0000 7f93a8ff9700 1 -- 172.21.15.80:0/1967782763 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a00052d0 con 0x7f93ac0c6680 2024-05-08T21:10:34.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.490+0000 7f93a8ff9700 1 -- 172.21.15.80:0/1967782763 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a0005430 con 0x7f93ac0c6680 2024-05-08T21:10:34.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.490+0000 7f93a8ff9700 1 -- 172.21.15.80:0/1967782763 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a00038a0 con 0x7f93ac0c6680 2024-05-08T21:10:34.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.490+0000 7f93b28c1700 1 -- 172.21.15.80:0/1967782763 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93ac15a080 con 0x7f93ac0c6680 2024-05-08T21:10:34.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.490+0000 7f9f311cf700 1 -- 172.21.15.80:0/384704325 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f2c0c8180 msgr2=0x7f9f2c0c2230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.490+0000 7f9f311cf700 1 --2- 172.21.15.80:0/384704325 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f2c0c8180 0x7f9f2c0c2230 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9f200098f0 tx=0x7f9f20009c00 comp rx=0 tx=0).stop 2024-05-08T21:10:34.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.491+0000 7f93b28c1700 1 -- 172.21.15.80:0/1967782763 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93ac15a640 con 0x7f93ac0c6680 2024-05-08T21:10:34.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.492+0000 7f9f311cf700 1 -- 172.21.15.80:0/384704325 shutdown_connections 2024-05-08T21:10:34.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.492+0000 7f9f311cf700 1 --2- 172.21.15.80:0/384704325 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f2c0c8180 0x7f9f2c0c2230 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.492+0000 7f9f311cf700 1 -- 172.21.15.80:0/384704325 >> 172.21.15.80:0/384704325 conn(0x7f9f2c0c8980 msgr2=0x7f9f2c0c8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:34.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.492+0000 7f93b28c1700 1 -- 172.21.15.80:0/1967782763 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93ac15dcc0 con 0x7f93ac0c6680 2024-05-08T21:10:34.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.494+0000 7efef33ef700 1 Processor -- start 2024-05-08T21:10:34.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.494+0000 7f93a8ff9700 1 -- 172.21.15.80:0/1967782763 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f93a0003a00 con 0x7f93ac0c6680 2024-05-08T21:10:34.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.494+0000 7f93a8ff9700 1 --2- 172.21.15.80:0/1967782763 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f939806ad60 0x7f939806d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.494+0000 7f93a8ff9700 1 -- 172.21.15.80:0/1967782763 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f93a0088f10 con 0x7f93ac0c6680 2024-05-08T21:10:34.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.494+0000 7efef33ef700 1 -- start start 2024-05-08T21:10:34.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.495+0000 7efef33ef700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7efeec071390 0x7efeec0c97f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.495+0000 7efef33ef700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efeec06bad0 0x7efeec06bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.495+0000 7efef33ef700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeec0c7950 con 0x7efeec150dd0 2024-05-08T21:10:34.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.495+0000 7efef33ef700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeec0c93d0 con 0x7efeec06bad0 2024-05-08T21:10:34.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.495+0000 7efef33ef700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeec071820 con 0x7efeec071390 2024-05-08T21:10:34.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.495+0000 7efef198c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efeec06bad0 0x7efeec06bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.496+0000 7efef198c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efeec06bad0 0x7efeec06bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42540/0 (socket says 172.21.15.80:42540) 2024-05-08T21:10:34.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.496+0000 7efef198c700 1 -- 172.21.15.80:0/1934898364 learned_addr learned my addr 172.21.15.80:0/1934898364 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:34.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.496+0000 7f93ab7fe700 1 --2- 172.21.15.80:0/1967782763 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f939806ad60 0x7f939806d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.496+0000 7efef098a700 1 --2- 172.21.15.80:0/1934898364 >> v2:172.21.15.106:3300/0 conn(0x7efeec071390 0x7efeec0c97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.496+0000 7efef198c700 1 -- 172.21.15.80:0/1934898364 >> v2:172.21.15.106:3300/0 conn(0x7efeec071390 msgr2=0x7efeec0c97f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:34.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.496+0000 7efef198c700 1 --2- 172.21.15.80:0/1934898364 >> v2:172.21.15.106:3300/0 conn(0x7efeec071390 0x7efeec0c97f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.496+0000 7efef198c700 1 -- 172.21.15.80:0/1934898364 >> v1:172.21.15.106:6789/0 conn(0x7efeec150dd0 legacy=0x7efeec157940 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T21:10:34.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.496+0000 7efef198c700 1 -- 172.21.15.80:0/1934898364 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeec0c8a30 con 0x7efeec06bad0 2024-05-08T21:10:34.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.496+0000 7efef198c700 1 --2- 172.21.15.80:0/1934898364 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efeec06bad0 0x7efeec06bf40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7efeec0c4ca0 tx=0x7efee400d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22248c3d9254a899 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:34.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.496+0000 7f93ab7fe700 1 --2- 172.21.15.80:0/1967782763 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f939806ad60 0x7f939806d220 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f93ac12ce30 tx=0x7f939c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:34.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.497+0000 7ff2527fc700 1 -- 172.21.15.80:0/2391670949 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7ff254054240 con 0x7ff25c06b4b0 2024-05-08T21:10:34.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.497+0000 7f9f311cf700 1 -- 172.21.15.80:0/384704325 shutdown_connections 2024-05-08T21:10:34.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.497+0000 7f9f311cf700 1 -- 172.21.15.80:0/384704325 wait complete. 2024-05-08T21:10:34.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.499+0000 7f9f311cf700 1 Processor -- start 2024-05-08T21:10:34.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.499+0000 7f9f311cf700 1 -- start start 2024-05-08T21:10:34.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.500+0000 7f9f311cf700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9f2c06b0d0 0x7f9f2c1e9400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.501+0000 7f9f311cf700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9f2c0c7420 0x7f9f2c1f50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.501+0000 7f9f311cf700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f2c0c8180 0x7f9f2c152880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.501+0000 7f9f311cf700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2c15d390 con 0x7f9f2c0c8180 2024-05-08T21:10:34.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.501+0000 7f9f311cf700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2c0caf00 con 0x7f9f2c06b0d0 2024-05-08T21:10:34.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.501+0000 7f9f311cf700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2c0cb1e0 con 0x7f9f2c0c7420 2024-05-08T21:10:34.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.501+0000 7f9f2b59e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f2c0c8180 0x7f9f2c152880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.501+0000 7f9f2b59e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f2c0c8180 0x7f9f2c152880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42556/0 (socket says 172.21.15.80:42556) 2024-05-08T21:10:34.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.501+0000 7f9f2b59e700 1 -- 172.21.15.80:0/2130350997 learned_addr learned my addr 172.21.15.80:0/2130350997 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:34.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.501+0000 7f9f2a59c700 1 --2- 172.21.15.80:0/2130350997 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9f2c0c7420 0x7f9f2c1f50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.501+0000 7f9f2ad9d700 1 --2- 172.21.15.80:0/2130350997 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9f2c06b0d0 0x7f9f2c1e9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.501+0000 7f9f2a59c700 1 -- 172.21.15.80:0/2130350997 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9f2c06b0d0 msgr2=0x7f9f2c1e9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.501+0000 7f9f2a59c700 1 --2- 172.21.15.80:0/2130350997 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9f2c06b0d0 0x7f9f2c1e9400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.501+0000 7f9f2a59c700 1 -- 172.21.15.80:0/2130350997 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f2c0c8180 msgr2=0x7f9f2c152880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.502+0000 7f9f2a59c700 1 --2- 172.21.15.80:0/2130350997 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f2c0c8180 0x7f9f2c152880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.502+0000 7f9f2a59c700 1 -- 172.21.15.80:0/2130350997 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f20009550 con 0x7f9f2c0c7420 2024-05-08T21:10:34.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.502+0000 7f9f2b59e700 1 --2- 172.21.15.80:0/2130350997 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f2c0c8180 0x7f9f2c152880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:10:34.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.502+0000 7f9f2a59c700 1 --2- 172.21.15.80:0/2130350997 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9f2c0c7420 0x7f9f2c1f50b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c00b390 tx=0x7f9f1c00b6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:34.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.502+0000 7efee3fff700 1 -- 172.21.15.80:0/1934898364 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee4010070 con 0x7efeec06bad0 2024-05-08T21:10:34.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.502+0000 7efee3fff700 1 -- 172.21.15.80:0/1934898364 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efee400b2e0 con 0x7efeec06bad0 2024-05-08T21:10:34.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.502+0000 7efee3fff700 1 -- 172.21.15.80:0/1934898364 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee400dcb0 con 0x7efeec06bad0 2024-05-08T21:10:34.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.503+0000 7efef33ef700 1 -- 172.21.15.80:0/1934898364 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efeec06bad0 msgr2=0x7efeec06bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.503+0000 7efef33ef700 1 --2- 172.21.15.80:0/1934898364 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efeec06bad0 0x7efeec06bf40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7efeec0c4ca0 tx=0x7efee400d430 comp rx=0 tx=0).stop 2024-05-08T21:10:34.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.504+0000 7f9f1b7fe700 1 -- 172.21.15.80:0/2130350997 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f1c011830 con 0x7f9f2c0c7420 2024-05-08T21:10:34.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.504+0000 7f9f1b7fe700 1 -- 172.21.15.80:0/2130350997 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f1c011990 con 0x7f9f2c0c7420 2024-05-08T21:10:34.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.504+0000 7f9f1b7fe700 1 -- 172.21.15.80:0/2130350997 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f1c011d20 con 0x7f9f2c0c7420 2024-05-08T21:10:34.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.504+0000 7f9f311cf700 1 -- 172.21.15.80:0/2130350997 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f2c0cb4c0 con 0x7f9f2c0c7420 2024-05-08T21:10:34.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.504+0000 7f9f311cf700 1 -- 172.21.15.80:0/2130350997 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f2c152080 con 0x7f9f2c0c7420 2024-05-08T21:10:34.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.506+0000 7f9f311cf700 1 -- 172.21.15.80:0/2130350997 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f080052f0 con 0x7f9f2c0c7420 2024-05-08T21:10:34.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.504+0000 7f93a8ff9700 1 -- 172.21.15.80:0/1967782763 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f93a0053e70 con 0x7f93ac0c6680 2024-05-08T21:10:34.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.506+0000 7efef33ef700 1 -- 172.21.15.80:0/1934898364 shutdown_connections 2024-05-08T21:10:34.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.506+0000 7efef33ef700 1 --2- 172.21.15.80:0/1934898364 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efeec06bad0 0x7efeec06bf40 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.506+0000 7efef33ef700 1 --2- 172.21.15.80:0/1934898364 >> v2:172.21.15.106:3300/0 conn(0x7efeec071390 0x7efeec0c97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.506+0000 7efef33ef700 1 -- 172.21.15.80:0/1934898364 >> 172.21.15.80:0/1934898364 conn(0x7efeec06ef80 msgr2=0x7efeec06f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:34.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.510+0000 7f9f1b7fe700 1 -- 172.21.15.80:0/2130350997 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9f1c004020 con 0x7f9f2c0c7420 2024-05-08T21:10:34.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.510+0000 7f9f1b7fe700 1 --2- 172.21.15.80:0/2130350997 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f9f1006acc0 0x7f9f1006d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.511+0000 7f9f1b7fe700 1 -- 172.21.15.80:0/2130350997 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9f1c089630 con 0x7f9f2c0c7420 2024-05-08T21:10:34.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.512+0000 7f9f2ad9d700 1 --2- 172.21.15.80:0/2130350997 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f9f1006acc0 0x7f9f1006d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.512+0000 7f9f2ad9d700 1 --2- 172.21.15.80:0/2130350997 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f9f1006acc0 0x7f9f1006d180 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9f24001e30 tx=0x7f9f24009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:34.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.514+0000 7efef33ef700 1 -- 172.21.15.80:0/1934898364 shutdown_connections 2024-05-08T21:10:34.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.514+0000 7efef33ef700 1 -- 172.21.15.80:0/1934898364 wait complete. 2024-05-08T21:10:34.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.515+0000 7efef33ef700 1 Processor -- start 2024-05-08T21:10:34.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.516+0000 7efef33ef700 1 -- start start 2024-05-08T21:10:34.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.517+0000 7efef33ef700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efeec06bad0 0x7efeec0c5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.517+0000 7efef33ef700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efeec071390 0x7efeec1481a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.517+0000 7efef33ef700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efeec150dd0 0x7efeec1476b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.517+0000 7efef33ef700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeec159c70 con 0x7efeec06bad0 2024-05-08T21:10:34.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.517+0000 7efef33ef700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeec148ac0 con 0x7efeec150dd0 2024-05-08T21:10:34.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.517+0000 7efef33ef700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeec15a6e0 con 0x7efeec071390 2024-05-08T21:10:34.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.516+0000 7f9f1b7fe700 1 -- 172.21.15.80:0/2130350997 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f9f1c054590 con 0x7f9f2c0c7420 2024-05-08T21:10:34.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.517+0000 7efef198c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efeec150dd0 0x7efeec1476b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.517+0000 7efef098a700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efeec071390 0x7efeec1481a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.518+0000 7efef198c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efeec150dd0 0x7efeec1476b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.80:45394/0 (socket says 172.21.15.80:45394) 2024-05-08T21:10:34.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.518+0000 7efef198c700 1 -- 172.21.15.80:0/4005062146 learned_addr learned my addr 172.21.15.80:0/4005062146 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:34.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.518+0000 7efef118b700 1 --2- 172.21.15.80:0/4005062146 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efeec06bad0 0x7efeec0c5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.518+0000 7efef198c700 1 -- 172.21.15.80:0/4005062146 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efeec071390 msgr2=0x7efeec1481a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.518+0000 7efef198c700 1 --2- 172.21.15.80:0/4005062146 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efeec071390 0x7efeec1481a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.518+0000 7efef198c700 1 -- 172.21.15.80:0/4005062146 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efeec06bad0 msgr2=0x7efeec0c5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.518+0000 7efef198c700 1 --2- 172.21.15.80:0/4005062146 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efeec06bad0 0x7efeec0c5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.518+0000 7efef198c700 1 -- 172.21.15.80:0/4005062146 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efee400bd40 con 0x7efeec150dd0 2024-05-08T21:10:34.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.518+0000 7efef198c700 1 --2- 172.21.15.80:0/4005062146 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efeec150dd0 0x7efeec1476b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efee400d780 tx=0x7efee4004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:34.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.519+0000 7efee1ffb700 1 -- 172.21.15.80:0/4005062146 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee4009810 con 0x7efeec150dd0 2024-05-08T21:10:34.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.519+0000 7efee1ffb700 1 -- 172.21.15.80:0/4005062146 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efee4009970 con 0x7efeec150dd0 2024-05-08T21:10:34.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.520+0000 7efef33ef700 1 -- 172.21.15.80:0/4005062146 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeec15a980 con 0x7efeec150dd0 2024-05-08T21:10:34.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.520+0000 7efef33ef700 1 -- 172.21.15.80:0/4005062146 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeec15af40 con 0x7efeec150dd0 2024-05-08T21:10:34.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.521+0000 7efee1ffb700 1 -- 172.21.15.80:0/4005062146 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee4009ce0 con 0x7efeec150dd0 2024-05-08T21:10:34.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.522+0000 7efef33ef700 1 -- 172.21.15.80:0/4005062146 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeec04ec60 con 0x7efeec150dd0 2024-05-08T21:10:34.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.523+0000 7efee1ffb700 1 -- 172.21.15.80:0/4005062146 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7efee401b040 con 0x7efeec150dd0 2024-05-08T21:10:34.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.524+0000 7efee1ffb700 1 --2- 172.21.15.80:0/4005062146 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7efed006ace0 0x7efed006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.524+0000 7efee1ffb700 1 -- 172.21.15.80:0/4005062146 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efee408b190 con 0x7efeec150dd0 2024-05-08T21:10:34.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.524+0000 7efef118b700 1 --2- 172.21.15.80:0/4005062146 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7efed006ace0 0x7efed006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.525+0000 7efef118b700 1 --2- 172.21.15.80:0/4005062146 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7efed006ace0 0x7efed006d1a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7efedc009870 tx=0x7efedc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:34.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.527+0000 7efee1ffb700 1 -- 172.21.15.80:0/4005062146 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7efee40560f0 con 0x7efeec150dd0 2024-05-08T21:10:34.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.558+0000 7fc3ef017700 1 Processor -- start 2024-05-08T21:10:34.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.558+0000 7fc3ef017700 1 -- start start 2024-05-08T21:10:34.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.560+0000 7fc3ef017700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc3e80cba70 0x7fc3e80c30e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.560+0000 7fc3ef017700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc3e80cbe50 0x7fc3e8162860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.560+0000 7fc3ef017700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc3e80c7100 0x7fc3e815e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.560+0000 7fc3ef017700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3e80c2df0 con 0x7fc3e80c7100 2024-05-08T21:10:34.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.560+0000 7fc3ef017700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3e815f030 con 0x7fc3e80cba70 2024-05-08T21:10:34.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.560+0000 7fc3ef017700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e815f310 con 0x7fc3e80cbe50 2024-05-08T21:10:34.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.560+0000 7f08a5193700 1 Processor -- start 2024-05-08T21:10:34.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.560+0000 7fc3ecdb3700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc3e80cba70 0x7fc3e80c30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.560+0000 7fc3ecdb3700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc3e80cba70 0x7fc3e80c30e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.80:45404/0 (socket says 172.21.15.80:45404) 2024-05-08T21:10:34.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.560+0000 7fc3ecdb3700 1 -- 172.21.15.80:0/3203347154 learned_addr learned my addr 172.21.15.80:0/3203347154 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:34.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.560+0000 7fc3e7fff700 1 --2- 172.21.15.80:0/3203347154 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc3e80cbe50 0x7fc3e8162860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.561+0000 7fc3ed5b4700 1 --2- 172.21.15.80:0/3203347154 >> v2:172.21.15.80:3300/0 conn(0x7fc3e80c7100 0x7fc3e815e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.561+0000 7fc3e7fff700 1 -- 172.21.15.80:0/3203347154 >> v2:172.21.15.106:3300/0 conn(0x7fc3e80cba70 msgr2=0x7fc3e80c30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:34.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.561+0000 7fc3e7fff700 1 --2- 172.21.15.80:0/3203347154 >> v2:172.21.15.106:3300/0 conn(0x7fc3e80cba70 0x7fc3e80c30e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.561+0000 7fc3e7fff700 1 -- 172.21.15.80:0/3203347154 >> v2:172.21.15.80:3300/0 conn(0x7fc3e80c7100 msgr2=0x7fc3e815e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:34.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.561+0000 7fc3e7fff700 1 --2- 172.21.15.80:0/3203347154 >> v2:172.21.15.80:3300/0 conn(0x7fc3e80c7100 0x7fc3e815e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.561+0000 7fc3e7fff700 1 -- 172.21.15.80:0/3203347154 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3e8161d80 con 0x7fc3e80cbe50 2024-05-08T21:10:34.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.560+0000 7f08a5193700 1 -- start start 2024-05-08T21:10:34.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.561+0000 7f08a5193700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f08a0158760 0x7f08a00c8050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.561+0000 7f08a5193700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f08a0162870 0x7f08a00c8590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.562+0000 7f089ed9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f08a0158760 0x7f08a00c8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.562+0000 7f089ed9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f08a0158760 0x7f08a00c8050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42572/0 (socket says 172.21.15.80:42572) 2024-05-08T21:10:34.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.562+0000 7f089ed9d700 1 -- 172.21.15.80:0/1687087584 learned_addr learned my addr 172.21.15.80:0/1687087584 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:34.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.562+0000 7f08a5193700 1 -- 172.21.15.80:0/1687087584 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08a015e980 con 0x7f08a00c6680 2024-05-08T21:10:34.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.562+0000 7f08a5193700 1 -- 172.21.15.80:0/1687087584 --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08a015e790 con 0x7f08a0158760 2024-05-08T21:10:34.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.562+0000 7f08a5193700 1 -- 172.21.15.80:0/1687087584 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08a015ec60 con 0x7f08a0162870 2024-05-08T21:10:34.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.562+0000 7fc3e7fff700 1 --2- 172.21.15.80:0/3203347154 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc3e80cbe50 0x7fc3e8162860 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc3e80cc3e0 tx=0x7fc3e000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7053cbdd59c35f8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:34.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.562+0000 7f089ed9d700 1 -- 172.21.15.80:0/1687087584 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f08a0162870 msgr2=0x7f08a00c8590 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T21:10:34.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.562+0000 7f089ed9d700 1 --2- 172.21.15.80:0/1687087584 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f08a0162870 0x7f08a00c8590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.562+0000 7f089ed9d700 1 -- 172.21.15.80:0/1687087584 >> v1:172.21.15.106:6789/0 conn(0x7f08a00c6680 legacy=0x7f08a0162160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:34.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.562+0000 7f089ed9d700 1 -- 172.21.15.80:0/1687087584 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a015ef40 con 0x7f08a0158760 2024-05-08T21:10:34.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.562+0000 7f089ed9d700 1 --2- 172.21.15.80:0/1687087584 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08a0158760 0x7f08a00c8050 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f08900098f0 tx=0x7f0890009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2f9f88ca675897b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:34.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.563+0000 7f089dd9b700 1 -- 172.21.15.80:0/1687087584 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0890004230 con 0x7f08a0158760 2024-05-08T21:10:34.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.563+0000 7f089dd9b700 1 -- 172.21.15.80:0/1687087584 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0890004390 con 0x7f08a0158760 2024-05-08T21:10:34.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.563+0000 7f089dd9b700 1 -- 172.21.15.80:0/1687087584 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08900036a0 con 0x7f08a0158760 2024-05-08T21:10:34.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.563+0000 7fc3e77fe700 1 -- 172.21.15.80:0/3203347154 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e000e070 con 0x7fc3e80cbe50 2024-05-08T21:10:34.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.563+0000 7fc3e77fe700 1 -- 172.21.15.80:0/3203347154 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3e000bb20 con 0x7fc3e80cbe50 2024-05-08T21:10:34.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.563+0000 7fc3e77fe700 1 -- 172.21.15.80:0/3203347154 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e0012430 con 0x7fc3e80cbe50 2024-05-08T21:10:34.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.564+0000 7fc3ef017700 1 -- 172.21.15.80:0/3203347154 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc3e80cbe50 msgr2=0x7fc3e8162860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.564+0000 7fc3ef017700 1 --2- 172.21.15.80:0/3203347154 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc3e80cbe50 0x7fc3e8162860 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc3e80cc3e0 tx=0x7fc3e000b330 comp rx=0 tx=0).stop 2024-05-08T21:10:34.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.564+0000 7f08a5193700 1 -- 172.21.15.80:0/1687087584 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08a0158760 msgr2=0x7f08a00c8050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.564+0000 7f08a5193700 1 --2- 172.21.15.80:0/1687087584 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08a0158760 0x7f08a00c8050 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f08900098f0 tx=0x7f0890009c00 comp rx=0 tx=0).stop 2024-05-08T21:10:34.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.564+0000 7f08a5193700 1 -- 172.21.15.80:0/1687087584 shutdown_connections 2024-05-08T21:10:34.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.564+0000 7f08a5193700 1 --2- 172.21.15.80:0/1687087584 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f08a0162870 0x7f08a00c8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.564+0000 7f08a5193700 1 --2- 172.21.15.80:0/1687087584 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08a0158760 0x7f08a00c8050 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.564+0000 7f08a5193700 1 -- 172.21.15.80:0/1687087584 >> 172.21.15.80:0/1687087584 conn(0x7f08a006a9c0 msgr2=0x7f08a006ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:34.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.564+0000 7f08a5193700 1 -- 172.21.15.80:0/1687087584 shutdown_connections 2024-05-08T21:10:34.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.564+0000 7f08a5193700 1 -- 172.21.15.80:0/1687087584 wait complete. 2024-05-08T21:10:34.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.565+0000 7fc3ef017700 1 -- 172.21.15.80:0/3203347154 shutdown_connections 2024-05-08T21:10:34.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.565+0000 7fc3ef017700 1 --2- 172.21.15.80:0/3203347154 >> v2:172.21.15.80:3300/0 conn(0x7fc3e80c7100 0x7fc3e815e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.565+0000 7fc3ef017700 1 --2- 172.21.15.80:0/3203347154 >> v2:172.21.15.106:3300/0 conn(0x7fc3e80cba70 0x7fc3e80c30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.565+0000 7fc3ef017700 1 --2- 172.21.15.80:0/3203347154 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc3e80cbe50 0x7fc3e8162860 secure :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc3e80cc3e0 tx=0x7fc3e000b330 comp rx=0 tx=0).stop 2024-05-08T21:10:34.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.565+0000 7fc3ef017700 1 -- 172.21.15.80:0/3203347154 >> 172.21.15.80:0/3203347154 conn(0x7fc3e806a9c0 msgr2=0x7fc3e806ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:34.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.565+0000 7fc3ef017700 1 -- 172.21.15.80:0/3203347154 shutdown_connections 2024-05-08T21:10:34.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.566+0000 7f08a5193700 1 Processor -- start 2024-05-08T21:10:34.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.565+0000 7fc3ef017700 1 -- 172.21.15.80:0/3203347154 wait complete. 2024-05-08T21:10:34.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.567+0000 7fc3ef017700 1 Processor -- start 2024-05-08T21:10:34.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.566+0000 7f08a5193700 1 -- start start 2024-05-08T21:10:34.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.567+0000 7f08a5193700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08a00c6680 0x7f08a006e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.567+0000 7f08a5193700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f08a0158760 0x7f08a00cbc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.567+0000 7f08a5193700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08a0162870 0x7f08a015b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.567+0000 7f08a5193700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a00cb9a0 con 0x7f08a00c6680 2024-05-08T21:10:34.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.567+0000 7f08a5193700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a01f7720 con 0x7f08a0162870 2024-05-08T21:10:34.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.567+0000 7f08a5193700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08a01f7970 con 0x7f08a0158760 2024-05-08T21:10:34.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.568+0000 7f089ed9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08a00c6680 0x7f08a006e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.568+0000 7f089ed9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08a00c6680 0x7f08a006e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42578/0 (socket says 172.21.15.80:42578) 2024-05-08T21:10:34.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.568+0000 7f089ed9d700 1 -- 172.21.15.80:0/456864738 learned_addr learned my addr 172.21.15.80:0/456864738 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:34.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.568+0000 7f089ed9d700 1 -- 172.21.15.80:0/456864738 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f08a0158760 msgr2=0x7f08a00cbc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.568+0000 7f089ed9d700 1 --2- 172.21.15.80:0/456864738 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f08a0158760 0x7f08a00cbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.568+0000 7f089ed9d700 1 -- 172.21.15.80:0/456864738 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08a0162870 msgr2=0x7f08a015b3b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T21:10:34.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.568+0000 7f089ed9d700 1 --2- 172.21.15.80:0/456864738 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08a0162870 0x7f08a015b3b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.568+0000 7f089ed9d700 1 -- 172.21.15.80:0/456864738 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0890009550 con 0x7f08a00c6680 2024-05-08T21:10:34.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.569+0000 7f089ed9d700 1 --2- 172.21.15.80:0/456864738 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08a00c6680 0x7f08a006e010 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0890000c00 tx=0x7f0890004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:34.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.567+0000 7fc3ef017700 1 -- start start 2024-05-08T21:10:34.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.569+0000 7fc3ef017700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc3e80c7100 0x7fc3e80c20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.569+0000 7fc3ef017700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3e80cba70 0x7fc3e80c8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.569+0000 7fc3ef017700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3e8072a70 0x7fc3e81fd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.569+0000 7fc3ef017700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e81fccb0 con 0x7fc3e80cba70 2024-05-08T21:10:34.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.569+0000 7fc3ef017700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e81fc910 con 0x7fc3e8072a70 2024-05-08T21:10:34.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.569+0000 7fc3ef017700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e8070470 con 0x7fc3e80c7100 2024-05-08T21:10:34.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.569+0000 7fc3e7fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3e80cba70 0x7fc3e80c8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.569+0000 7fc3e7fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3e80cba70 0x7fc3e80c8850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42594/0 (socket says 172.21.15.80:42594) 2024-05-08T21:10:34.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.569+0000 7fc3e7fff700 1 -- 172.21.15.80:0/3387968240 learned_addr learned my addr 172.21.15.80:0/3387968240 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:34.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.569+0000 7fc3e7fff700 1 -- 172.21.15.80:0/3387968240 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc3e80c7100 msgr2=0x7fc3e80c20e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T21:10:34.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.569+0000 7fc3e7fff700 1 --2- 172.21.15.80:0/3387968240 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc3e80c7100 0x7fc3e80c20e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.569+0000 7fc3e7fff700 1 -- 172.21.15.80:0/3387968240 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3e8072a70 msgr2=0x7fc3e81fd0d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T21:10:34.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.569+0000 7fc3e7fff700 1 --2- 172.21.15.80:0/3387968240 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3e8072a70 0x7fc3e81fd0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.569+0000 7fc3e7fff700 1 -- 172.21.15.80:0/3387968240 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3e0009a70 con 0x7fc3e80cba70 2024-05-08T21:10:34.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.570+0000 7fc3e7fff700 1 --2- 172.21.15.80:0/3387968240 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3e80cba70 0x7fc3e80c8850 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc3e0000f80 tx=0x7fc3e0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:34.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.570+0000 7f08877fe700 1 -- 172.21.15.80:0/456864738 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f089000b660 con 0x7f08a00c6680 2024-05-08T21:10:34.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.570+0000 7f08877fe700 1 -- 172.21.15.80:0/456864738 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f089000b7c0 con 0x7f08a00c6680 2024-05-08T21:10:34.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.570+0000 7f08877fe700 1 -- 172.21.15.80:0/456864738 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f089000bb50 con 0x7f08a00c6680 2024-05-08T21:10:34.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.570+0000 7f08a5193700 1 -- 172.21.15.80:0/456864738 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08a01f7c50 con 0x7f08a00c6680 2024-05-08T21:10:34.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.570+0000 7f08a5193700 1 -- 172.21.15.80:0/456864738 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08a01f8210 con 0x7f08a00c6680 2024-05-08T21:10:34.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.572+0000 7fc3e57fa700 1 -- 172.21.15.80:0/3387968240 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e0004960 con 0x7fc3e80cba70 2024-05-08T21:10:34.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.572+0000 7fc3e57fa700 1 -- 172.21.15.80:0/3387968240 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3e0020070 con 0x7fc3e80cba70 2024-05-08T21:10:34.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.572+0000 7fc3e57fa700 1 -- 172.21.15.80:0/3387968240 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e00276c0 con 0x7fc3e80cba70 2024-05-08T21:10:34.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.572+0000 7fc3ef017700 1 -- 172.21.15.80:0/3387968240 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3e8070750 con 0x7fc3e80cba70 2024-05-08T21:10:34.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.572+0000 7fc3ef017700 1 -- 172.21.15.80:0/3387968240 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3e8070a30 con 0x7fc3e80cba70 2024-05-08T21:10:34.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.575+0000 7f08877fe700 1 -- 172.21.15.80:0/456864738 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0890022070 con 0x7f08a00c6680 2024-05-08T21:10:34.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.576+0000 7f08877fe700 1 --2- 172.21.15.80:0/456864738 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f088806aef0 0x7f088806d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.576+0000 7f08877fe700 1 -- 172.21.15.80:0/456864738 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f089008b220 con 0x7f08a00c6680 2024-05-08T21:10:34.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.576+0000 7fc3e57fa700 1 -- 172.21.15.80:0/3387968240 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc3e0012430 con 0x7fc3e80cba70 2024-05-08T21:10:34.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.576+0000 7fc3e57fa700 1 --2- 172.21.15.80:0/3387968240 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fc3d006af20 0x7fc3d006d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:34.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.577+0000 7fc3e57fa700 1 -- 172.21.15.80:0/3387968240 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc3e0022070 con 0x7fc3e80cba70 2024-05-08T21:10:34.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.577+0000 7f089e59c700 1 --2- 172.21.15.80:0/456864738 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f088806aef0 0x7f088806d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.578+0000 7f089e59c700 1 --2- 172.21.15.80:0/456864738 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f088806aef0 0x7f088806d3b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f08a006af50 tx=0x7f0898003eb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:34.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.579+0000 7f08a5193700 1 -- 172.21.15.80:0/456864738 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08800052f0 con 0x7f08a00c6680 2024-05-08T21:10:34.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.579+0000 7fc3ef017700 1 -- 172.21.15.80:0/3387968240 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3c80052f0 con 0x7fc3e80cba70 2024-05-08T21:10:34.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.579+0000 7fc3ecdb3700 1 --2- 172.21.15.80:0/3387968240 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fc3d006af20 0x7fc3d006d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:34.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.580+0000 7fc3ecdb3700 1 --2- 172.21.15.80:0/3387968240 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fc3d006af20 0x7fc3d006d3e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc0099c0 tx=0x7fc3dc0092c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:34.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.588+0000 7f08877fe700 1 -- 172.21.15.80:0/456864738 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f08900560f0 con 0x7f08a00c6680 2024-05-08T21:10:34.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.597+0000 7fc3e57fa700 1 -- 172.21.15.80:0/3387968240 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fc3e0056410 con 0x7fc3e80cba70 2024-05-08T21:10:34.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.879+0000 7f527c942700 1 -- 172.21.15.80:0/3035919301 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f525c0055a0 con 0x7f52780cba70 2024-05-08T21:10:34.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.880+0000 7f5266ffd700 1 -- 172.21.15.80:0/3035919301 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5270017020 con 0x7f52780cba70 2024-05-08T21:10:34.886 INFO:teuthology.orchestra.run.smithi080.stdout:60129542153 2024-05-08T21:10:34.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.883+0000 7f527c942700 1 -- 172.21.15.80:0/3035919301 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f525806acc0 msgr2=0x7f525806d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.883+0000 7f527c942700 1 --2- 172.21.15.80:0/3035919301 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f525806acc0 0x7f525806d180 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f526c000c00 tx=0x7f526c007a50 comp rx=0 tx=0).stop 2024-05-08T21:10:34.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.883+0000 7f527c942700 1 -- 172.21.15.80:0/3035919301 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f52780cba70 msgr2=0x7f527815af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.883+0000 7f527c942700 1 --2- 172.21.15.80:0/3035919301 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f52780cba70 0x7f527815af80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f52780cc640 tx=0x7f5270004ad0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.884+0000 7f527c942700 1 -- 172.21.15.80:0/3035919301 shutdown_connections 2024-05-08T21:10:34.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.884+0000 7f527c942700 1 --2- 172.21.15.80:0/3035919301 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f525806acc0 0x7f525806d180 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.884+0000 7f527c942700 1 --2- 172.21.15.80:0/3035919301 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5278162860 0x7f527813d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.884+0000 7f527c942700 1 --2- 172.21.15.80:0/3035919301 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f52780cba70 0x7f527815af80 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.884+0000 7f527c942700 1 --2- 172.21.15.80:0/3035919301 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52780cbe50 0x7f527813da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.884+0000 7f527c942700 1 -- 172.21.15.80:0/3035919301 >> 172.21.15.80:0/3035919301 conn(0x7f527806a9c0 msgr2=0x7f52780c3640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:34.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.884+0000 7f527c942700 1 -- 172.21.15.80:0/3035919301 shutdown_connections 2024-05-08T21:10:34.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.884+0000 7f527c942700 1 -- 172.21.15.80:0/3035919301 wait complete. 2024-05-08T21:10:34.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.890+0000 7f3cdfdf5700 1 -- 172.21.15.80:0/1519443732 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f3cbc005160 con 0x7f3cd80c68f0 2024-05-08T21:10:34.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.899+0000 7f3cce7fc700 1 -- 172.21.15.80:0/1519443732 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3cd0057a90 con 0x7f3cd80c68f0 2024-05-08T21:10:34.905 INFO:teuthology.orchestra.run.smithi080.stdout:64424509449 2024-05-08T21:10:34.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.903+0000 7f3cdfdf5700 1 -- 172.21.15.80:0/1519443732 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f3cc406af00 msgr2=0x7f3cc406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.903+0000 7f3cdfdf5700 1 --2- 172.21.15.80:0/1519443732 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f3cc406af00 0x7f3cc406d3c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3cd814d600 tx=0x7f3cc8009210 comp rx=0 tx=0).stop 2024-05-08T21:10:34.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.903+0000 7f3cdfdf5700 1 -- 172.21.15.80:0/1519443732 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3cd80c68f0 msgr2=0x7f3cd81538c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.903+0000 7f3cdfdf5700 1 --2- 172.21.15.80:0/1519443732 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3cd80c68f0 0x7f3cd81538c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3cd000cb10 tx=0x7f3cd000ce20 comp rx=0 tx=0).stop 2024-05-08T21:10:34.908 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.3 2024-05-08T21:10:34.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.903+0000 7f3cdfdf5700 1 -- 172.21.15.80:0/1519443732 shutdown_connections 2024-05-08T21:10:34.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.903+0000 7f3cdfdf5700 1 --2- 172.21.15.80:0/1519443732 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f3cc406af00 0x7f3cc406d3c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.903+0000 7f3cdfdf5700 1 --2- 172.21.15.80:0/1519443732 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3cd80c68f0 0x7f3cd81538c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.903+0000 7f3cdfdf5700 1 --2- 172.21.15.80:0/1519443732 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3cd8150750 0x7f3cd80c2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.903+0000 7f3cdfdf5700 1 --2- 172.21.15.80:0/1519443732 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3cd80cbab0 0x7f3cd814b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.903+0000 7f3cdfdf5700 1 -- 172.21.15.80:0/1519443732 >> 172.21.15.80:0/1519443732 conn(0x7f3cd806a9c0 msgr2=0x7f3cd8072160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:34.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.904+0000 7f3cdfdf5700 1 -- 172.21.15.80:0/1519443732 shutdown_connections 2024-05-08T21:10:34.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.904+0000 7f3cdfdf5700 1 -- 172.21.15.80:0/1519443732 wait complete. 2024-05-08T21:10:34.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.916+0000 7f93b28c1700 1 -- 172.21.15.80:0/1967782763 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f93ac0bf000 con 0x7f93ac0c6680 2024-05-08T21:10:34.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.917+0000 7f93a8ff9700 1 -- 172.21.15.80:0/1967782763 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f93a0017090 con 0x7f93ac0c6680 2024-05-08T21:10:34.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.917+0000 7ff263ed1700 1 -- 172.21.15.80:0/2391670949 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff2440055a0 con 0x7ff25c06b4b0 2024-05-08T21:10:34.921 INFO:teuthology.orchestra.run.smithi080.stdout:64424509449 2024-05-08T21:10:34.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.918+0000 7ff2527fc700 1 -- 172.21.15.80:0/2391670949 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff254057860 con 0x7ff25c06b4b0 2024-05-08T21:10:34.922 INFO:teuthology.orchestra.run.smithi080.stdout:64424509449 2024-05-08T21:10:34.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.919+0000 7f93b28c1700 1 -- 172.21.15.80:0/1967782763 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f939806ad60 msgr2=0x7f939806d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.920+0000 7f93b28c1700 1 --2- 172.21.15.80:0/1967782763 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f939806ad60 0x7f939806d220 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f93ac12ce30 tx=0x7f939c008040 comp rx=0 tx=0).stop 2024-05-08T21:10:34.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.920+0000 7f93b28c1700 1 -- 172.21.15.80:0/1967782763 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93ac0c6680 msgr2=0x7f93ac0c4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.920+0000 7f93b28c1700 1 --2- 172.21.15.80:0/1967782763 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93ac0c6680 0x7f93ac0c4000 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f93a000c4e0 tx=0x7f93a000c8a0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.920+0000 7f93b28c1700 1 -- 172.21.15.80:0/1967782763 shutdown_connections 2024-05-08T21:10:34.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.920+0000 7f93b28c1700 1 --2- 172.21.15.80:0/1967782763 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f939806ad60 0x7f939806d220 secure :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f93ac12ce30 tx=0x7f939c008040 comp rx=0 tx=0).stop 2024-05-08T21:10:34.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.920+0000 7f93b28c1700 1 --2- 172.21.15.80:0/1967782763 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93ac0c6680 0x7f93ac0c4000 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.920+0000 7f93b28c1700 1 --2- 172.21.15.80:0/1967782763 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f93ac1626a0 0x7f93ac0c9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.920+0000 7f93b28c1700 1 --2- 172.21.15.80:0/1967782763 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f93ac158760 0x7f93ac0c9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.920+0000 7f93b28c1700 1 -- 172.21.15.80:0/1967782763 >> 172.21.15.80:0/1967782763 conn(0x7f93ac06a9c0 msgr2=0x7f93ac0c4c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:34.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.920+0000 7f93b28c1700 1 -- 172.21.15.80:0/1967782763 shutdown_connections 2024-05-08T21:10:34.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.920+0000 7f93b28c1700 1 -- 172.21.15.80:0/1967782763 wait complete. 2024-05-08T21:10:34.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.920+0000 7f9f311cf700 1 -- 172.21.15.80:0/2130350997 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9f08005870 con 0x7f9f2c0c7420 2024-05-08T21:10:34.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.921+0000 7f9f1b7fe700 1 -- 172.21.15.80:0/2130350997 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9f1c057bb0 con 0x7f9f2c0c7420 2024-05-08T21:10:34.925 INFO:teuthology.orchestra.run.smithi080.stdout:55834574856 2024-05-08T21:10:34.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.922+0000 7efef33ef700 1 -- 172.21.15.80:0/4005062146 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7efeec0c8460 con 0x7efeec150dd0 2024-05-08T21:10:34.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.922+0000 7ff263ed1700 1 -- 172.21.15.80:0/2391670949 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7ff24006ac90 msgr2=0x7ff24006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.922+0000 7ff263ed1700 1 --2- 172.21.15.80:0/2391670949 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7ff24006ac90 0x7ff24006d150 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff25c146bb0 tx=0x7ff24c008040 comp rx=0 tx=0).stop 2024-05-08T21:10:34.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.922+0000 7ff263ed1700 1 -- 172.21.15.80:0/2391670949 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff25c06b4b0 msgr2=0x7ff25c153070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.922+0000 7ff263ed1700 1 --2- 172.21.15.80:0/2391670949 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff25c06b4b0 0x7ff25c153070 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff25400ba80 tx=0x7ff25400be40 comp rx=0 tx=0).stop 2024-05-08T21:10:34.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.922+0000 7ff263ed1700 1 -- 172.21.15.80:0/2391670949 shutdown_connections 2024-05-08T21:10:34.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.922+0000 7ff263ed1700 1 --2- 172.21.15.80:0/2391670949 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7ff24006ac90 0x7ff24006d150 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.922+0000 7ff263ed1700 1 --2- 172.21.15.80:0/2391670949 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff25c0c6af0 0x7ff25c167420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.922+0000 7ff263ed1700 1 --2- 172.21.15.80:0/2391670949 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff25c06b4b0 0x7ff25c153070 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.922+0000 7ff263ed1700 1 --2- 172.21.15.80:0/2391670949 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff25c0c3100 0x7ff25c166ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.922+0000 7ff263ed1700 1 -- 172.21.15.80:0/2391670949 >> 172.21.15.80:0/2391670949 conn(0x7ff25c06a9c0 msgr2=0x7ff25c14d740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:34.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.922+0000 7ff263ed1700 1 -- 172.21.15.80:0/2391670949 shutdown_connections 2024-05-08T21:10:34.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.922+0000 7ff263ed1700 1 -- 172.21.15.80:0/2391670949 wait complete. 2024-05-08T21:10:34.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.923+0000 7efee1ffb700 1 -- 172.21.15.80:0/4005062146 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efee4059710 con 0x7efeec150dd0 2024-05-08T21:10:34.928 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.4 2024-05-08T21:10:34.928 INFO:teuthology.orchestra.run.smithi080.stdout:60129542154 2024-05-08T21:10:34.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.924+0000 7f9f311cf700 1 -- 172.21.15.80:0/2130350997 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f9f1006acc0 msgr2=0x7f9f1006d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.924+0000 7f9f311cf700 1 --2- 172.21.15.80:0/2130350997 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f9f1006acc0 0x7f9f1006d180 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9f24001e30 tx=0x7f9f24009040 comp rx=0 tx=0).stop 2024-05-08T21:10:34.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.924+0000 7f9f311cf700 1 -- 172.21.15.80:0/2130350997 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9f2c0c7420 msgr2=0x7f9f2c1f50b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.925+0000 7f9f311cf700 1 --2- 172.21.15.80:0/2130350997 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9f2c0c7420 0x7f9f2c1f50b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c00b390 tx=0x7f9f1c00b6a0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.925+0000 7f9f311cf700 1 -- 172.21.15.80:0/2130350997 shutdown_connections 2024-05-08T21:10:34.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.925+0000 7f9f311cf700 1 --2- 172.21.15.80:0/2130350997 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f9f1006acc0 0x7f9f1006d180 secure :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9f24001e30 tx=0x7f9f24009040 comp rx=0 tx=0).stop 2024-05-08T21:10:34.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.925+0000 7f9f311cf700 1 --2- 172.21.15.80:0/2130350997 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9f2c0c8180 0x7f9f2c152880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.925+0000 7f9f311cf700 1 --2- 172.21.15.80:0/2130350997 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9f2c06b0d0 0x7f9f2c1e9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.925+0000 7f9f311cf700 1 --2- 172.21.15.80:0/2130350997 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9f2c0c7420 0x7f9f2c1f50b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.925+0000 7f9f311cf700 1 -- 172.21.15.80:0/2130350997 >> 172.21.15.80:0/2130350997 conn(0x7f9f2c0c8980 msgr2=0x7f9f2c15cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:34.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.926+0000 7f9f311cf700 1 -- 172.21.15.80:0/2130350997 shutdown_connections 2024-05-08T21:10:34.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.926+0000 7f9f311cf700 1 -- 172.21.15.80:0/2130350997 wait complete. 2024-05-08T21:10:34.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.926+0000 7efef33ef700 1 -- 172.21.15.80:0/4005062146 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7efed006ace0 msgr2=0x7efed006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.926+0000 7efef33ef700 1 --2- 172.21.15.80:0/4005062146 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7efed006ace0 0x7efed006d1a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7efedc009870 tx=0x7efedc008040 comp rx=0 tx=0).stop 2024-05-08T21:10:34.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.926+0000 7efef33ef700 1 -- 172.21.15.80:0/4005062146 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efeec150dd0 msgr2=0x7efeec1476b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.926+0000 7efef33ef700 1 --2- 172.21.15.80:0/4005062146 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efeec150dd0 0x7efeec1476b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efee400d780 tx=0x7efee4004ad0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.926+0000 7efef33ef700 1 -- 172.21.15.80:0/4005062146 shutdown_connections 2024-05-08T21:10:34.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.926+0000 7efef33ef700 1 --2- 172.21.15.80:0/4005062146 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7efed006ace0 0x7efed006d1a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.926+0000 7efef33ef700 1 --2- 172.21.15.80:0/4005062146 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efeec06bad0 0x7efeec0c5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.926+0000 7efef33ef700 1 --2- 172.21.15.80:0/4005062146 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efeec150dd0 0x7efeec1476b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.926+0000 7efef33ef700 1 --2- 172.21.15.80:0/4005062146 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efeec071390 0x7efeec1481a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.926+0000 7efef33ef700 1 -- 172.21.15.80:0/4005062146 >> 172.21.15.80:0/4005062146 conn(0x7efeec06ef80 msgr2=0x7efeec157400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:34.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.927+0000 7efef33ef700 1 -- 172.21.15.80:0/4005062146 shutdown_connections 2024-05-08T21:10:34.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.930+0000 7efef33ef700 1 -- 172.21.15.80:0/4005062146 wait complete. 2024-05-08T21:10:34.941 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.6 2024-05-08T21:10:34.948 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.1 2024-05-08T21:10:34.949 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542154 for osd.0 2024-05-08T21:10:34.953 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.2 2024-05-08T21:10:34.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.976+0000 7f08a5193700 1 -- 172.21.15.80:0/456864738 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f08800055a0 con 0x7f08a00c6680 2024-05-08T21:10:34.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.976+0000 7f08877fe700 1 -- 172.21.15.80:0/456864738 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0890059710 con 0x7f08a00c6680 2024-05-08T21:10:34.980 INFO:teuthology.orchestra.run.smithi080.stdout:60129542153 2024-05-08T21:10:34.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.978+0000 7f08a5193700 1 -- 172.21.15.80:0/456864738 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f088806aef0 msgr2=0x7f088806d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.978+0000 7f08a5193700 1 --2- 172.21.15.80:0/456864738 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f088806aef0 0x7f088806d3b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f08a006af50 tx=0x7f0898003eb0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.978+0000 7f08a5193700 1 -- 172.21.15.80:0/456864738 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08a00c6680 msgr2=0x7f08a006e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.978+0000 7f08a5193700 1 --2- 172.21.15.80:0/456864738 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08a00c6680 0x7f08a006e010 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0890000c00 tx=0x7f0890004750 comp rx=0 tx=0).stop 2024-05-08T21:10:34.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.978+0000 7f08a5193700 1 -- 172.21.15.80:0/456864738 shutdown_connections 2024-05-08T21:10:34.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.978+0000 7f08a5193700 1 --2- 172.21.15.80:0/456864738 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f088806aef0 0x7f088806d3b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.978+0000 7f08a5193700 1 --2- 172.21.15.80:0/456864738 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f08a00c6680 0x7f08a006e010 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.978+0000 7f08a5193700 1 --2- 172.21.15.80:0/456864738 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08a0162870 0x7f08a015b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.978+0000 7f08a5193700 1 --2- 172.21.15.80:0/456864738 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f08a0158760 0x7f08a00cbc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.978+0000 7f08a5193700 1 -- 172.21.15.80:0/456864738 >> 172.21.15.80:0/456864738 conn(0x7f08a006a9c0 msgr2=0x7f08a015d540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:34.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.978+0000 7f08a5193700 1 -- 172.21.15.80:0/456864738 shutdown_connections 2024-05-08T21:10:34.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.978+0000 7fc3ef017700 1 -- 172.21.15.80:0/3387968240 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fc3c80055a0 con 0x7fc3e80cba70 2024-05-08T21:10:34.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.978+0000 7f08a5193700 1 -- 172.21.15.80:0/456864738 wait complete. 2024-05-08T21:10:34.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.979+0000 7fc3e57fa700 1 -- 172.21.15.80:0/3387968240 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc3e0059a30 con 0x7fc3e80cba70 2024-05-08T21:10:34.983 INFO:teuthology.orchestra.run.smithi080.stdout:64424509450 2024-05-08T21:10:34.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.981+0000 7fc3ef017700 1 -- 172.21.15.80:0/3387968240 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fc3d006af20 msgr2=0x7fc3d006d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.981+0000 7fc3ef017700 1 --2- 172.21.15.80:0/3387968240 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fc3d006af20 0x7fc3d006d3e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc0099c0 tx=0x7fc3dc0092c0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.981+0000 7fc3ef017700 1 -- 172.21.15.80:0/3387968240 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3e80cba70 msgr2=0x7fc3e80c8850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:34.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.981+0000 7fc3ef017700 1 --2- 172.21.15.80:0/3387968240 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3e80cba70 0x7fc3e80c8850 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc3e0000f80 tx=0x7fc3e0004ad0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.981+0000 7fc3ef017700 1 -- 172.21.15.80:0/3387968240 shutdown_connections 2024-05-08T21:10:34.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.981+0000 7fc3ef017700 1 --2- 172.21.15.80:0/3387968240 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fc3d006af20 0x7fc3d006d3e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.981+0000 7fc3ef017700 1 --2- 172.21.15.80:0/3387968240 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3e8072a70 0x7fc3e81fd0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.981+0000 7fc3ef017700 1 --2- 172.21.15.80:0/3387968240 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc3e80c7100 0x7fc3e80c20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.981+0000 7fc3ef017700 1 --2- 172.21.15.80:0/3387968240 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3e80cba70 0x7fc3e80c8850 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:34.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.981+0000 7fc3ef017700 1 -- 172.21.15.80:0/3387968240 >> 172.21.15.80:0/3387968240 conn(0x7fc3e806a9c0 msgr2=0x7fc3e80c3f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:34.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.981+0000 7fc3ef017700 1 -- 172.21.15.80:0/3387968240 shutdown_connections 2024-05-08T21:10:34.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:34.981+0000 7fc3ef017700 1 -- 172.21.15.80:0/3387968240 wait complete. 2024-05-08T21:10:34.995 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.7 2024-05-08T21:10:34.997 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.5 2024-05-08T21:10:35.909 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-08T21:10:35.929 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-08T21:10:35.941 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-08T21:10:35.949 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-08T21:10:35.950 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-08T21:10:35.953 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-08T21:10:35.996 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-08T21:10:35.998 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-08T21:10:36.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.090+0000 7fc5ecdf6700 1 Processor -- start 2024-05-08T21:10:36.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.090+0000 7fc5ecdf6700 1 -- start start 2024-05-08T21:10:36.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.092+0000 7fc5ecdf6700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc5e80cb820 0x7fc5e815b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:36.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.092+0000 7fc5ecdf6700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc5e80cbc00 0x7fc5e80c7820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:36.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.092+0000 7fc5ecdf6700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5e815b5b0 con 0x7fc5e80c0ad0 2024-05-08T21:10:36.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.092+0000 7fc5ecdf6700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5e80c6d30 con 0x7fc5e80cb820 2024-05-08T21:10:36.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.092+0000 7fc5ecdf6700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e80c5ea0 con 0x7fc5e80cbc00 2024-05-08T21:10:36.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.092+0000 7fc5e6d9d700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fc5e80c0ad0 0x7fc5e8150e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.80:50930/0 (socket says 172.21.15.80:50930) 2024-05-08T21:10:36.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.092+0000 7fc5e6d9d700 1 -- 172.21.15.80:0/3867912722 learned_addr learned my addr 172.21.15.80:0/3867912722 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:10:36.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.093+0000 7fc5e659c700 1 --2- 172.21.15.80:0/3867912722 >> v2:172.21.15.106:3300/0 conn(0x7fc5e80cb820 0x7fc5e815b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:36.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.093+0000 7fc5e5d9b700 1 --2- 172.21.15.80:0/3867912722 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc5e80cbc00 0x7fc5e80c7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:36.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.094+0000 7fc5e659c700 1 -- 172.21.15.80:0/3867912722 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc5e80cbc00 msgr2=0x7fc5e80c7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:36.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.094+0000 7fc5e659c700 1 --2- 172.21.15.80:0/3867912722 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc5e80cbc00 0x7fc5e80c7820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.094+0000 7fc5e659c700 1 -- 172.21.15.80:0/3867912722 >> v1:172.21.15.106:6789/0 conn(0x7fc5e80c0ad0 legacy=0x7fc5e8150e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:36.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.094+0000 7fc5e659c700 1 -- 172.21.15.80:0/3867912722 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5e80c9000 con 0x7fc5e80cb820 2024-05-08T21:10:36.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.097+0000 7fc5e659c700 1 --2- 172.21.15.80:0/3867912722 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc5e80cb820 0x7fc5e815b070 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc009840 tx=0x7fc5dc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67021bba5acde3ab server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:36.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.098+0000 7fc5e559a700 1 -- 172.21.15.80:0/3867912722 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5dc011830 con 0x7fc5e80cb820 2024-05-08T21:10:36.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.098+0000 7fc5e559a700 1 -- 172.21.15.80:0/3867912722 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5dc011990 con 0x7fc5e80cb820 2024-05-08T21:10:36.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.098+0000 7fc5e559a700 1 -- 172.21.15.80:0/3867912722 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5dc011d20 con 0x7fc5e80cb820 2024-05-08T21:10:36.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.099+0000 7fc5ecdf6700 1 -- 172.21.15.80:0/3867912722 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc5e80cb820 msgr2=0x7fc5e815b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:36.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.099+0000 7fc5ecdf6700 1 --2- 172.21.15.80:0/3867912722 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc5e80cb820 0x7fc5e815b070 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc009840 tx=0x7fc5dc009b50 comp rx=0 tx=0).stop 2024-05-08T21:10:36.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.099+0000 7fc5ecdf6700 1 -- 172.21.15.80:0/3867912722 shutdown_connections 2024-05-08T21:10:36.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.099+0000 7fc5ecdf6700 1 --2- 172.21.15.80:0/3867912722 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc5e80cb820 0x7fc5e815b070 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.099+0000 7fc5ecdf6700 1 --2- 172.21.15.80:0/3867912722 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc5e80cbc00 0x7fc5e80c7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.099+0000 7fc5ecdf6700 1 -- 172.21.15.80:0/3867912722 >> 172.21.15.80:0/3867912722 conn(0x7fc5e806a9c0 msgr2=0x7fc5e806ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:36.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.099+0000 7fc5ecdf6700 1 -- 172.21.15.80:0/3867912722 shutdown_connections 2024-05-08T21:10:36.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.099+0000 7fc5ecdf6700 1 -- 172.21.15.80:0/3867912722 wait complete. 2024-05-08T21:10:36.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.101+0000 7fc5ecdf6700 1 Processor -- start 2024-05-08T21:10:36.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.102+0000 7fc5ecdf6700 1 -- start start 2024-05-08T21:10:36.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.103+0000 7fc5ecdf6700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc5e80c0ad0 0x7fc5e815a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:36.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.103+0000 7fc5ecdf6700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc5e80cb820 0x7fc5e81f7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:36.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.103+0000 7fc5ecdf6700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc5e80cbc00 0x7fc5e813ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:36.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.103+0000 7fc5ecdf6700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e815ab00 con 0x7fc5e80cbc00 2024-05-08T21:10:36.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.103+0000 7fc5ecdf6700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e815afe0 con 0x7fc5e80cb820 2024-05-08T21:10:36.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.103+0000 7fc5ecdf6700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e81f8530 con 0x7fc5e80c0ad0 2024-05-08T21:10:36.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.105+0000 7fc5e5d9b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc5e80cb820 0x7fc5e81f7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:36.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.105+0000 7fc5e659c700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc5e80c0ad0 0x7fc5e815a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:36.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.105+0000 7fc5e659c700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc5e80c0ad0 0x7fc5e815a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:52114/0 (socket says 172.21.15.80:52114) 2024-05-08T21:10:36.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.105+0000 7fc5e659c700 1 -- 172.21.15.80:0/3139221928 learned_addr learned my addr 172.21.15.80:0/3139221928 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:36.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.106+0000 7fc5e6d9d700 1 --2- 172.21.15.80:0/3139221928 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc5e80cbc00 0x7fc5e813ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:36.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.107+0000 7fc5e6d9d700 1 -- 172.21.15.80:0/3139221928 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc5e80c0ad0 msgr2=0x7fc5e815a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:36.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.107+0000 7fc5e6d9d700 1 --2- 172.21.15.80:0/3139221928 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc5e80c0ad0 0x7fc5e815a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.107+0000 7fc5e6d9d700 1 -- 172.21.15.80:0/3139221928 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc5e80cb820 msgr2=0x7fc5e81f7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:36.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.107+0000 7fc5e6d9d700 1 --2- 172.21.15.80:0/3139221928 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc5e80cb820 0x7fc5e81f7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.107+0000 7fc5e6d9d700 1 -- 172.21.15.80:0/3139221928 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5dc0094a0 con 0x7fc5e80cbc00 2024-05-08T21:10:36.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.107+0000 7fc5e6d9d700 1 --2- 172.21.15.80:0/3139221928 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc5e80cbc00 0x7fc5e813ce20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc5e000ca70 tx=0x7fc5e000cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:36.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.108+0000 7fc5d6ffd700 1 -- 172.21.15.80:0/3139221928 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e000a9e0 con 0x7fc5e80cbc00 2024-05-08T21:10:36.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.108+0000 7fc5d6ffd700 1 -- 172.21.15.80:0/3139221928 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5e000ab40 con 0x7fc5e80cbc00 2024-05-08T21:10:36.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.108+0000 7fc5d6ffd700 1 -- 172.21.15.80:0/3139221928 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e0012400 con 0x7fc5e80cbc00 2024-05-08T21:10:36.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.108+0000 7fc5ecdf6700 1 -- 172.21.15.80:0/3139221928 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5e815ad00 con 0x7fc5e80cbc00 2024-05-08T21:10:36.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.108+0000 7fc5ecdf6700 1 -- 172.21.15.80:0/3139221928 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5e81f5960 con 0x7fc5e80cbc00 2024-05-08T21:10:36.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.111+0000 7fc5d6ffd700 1 -- 172.21.15.80:0/3139221928 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc5e001b3b0 con 0x7fc5e80cbc00 2024-05-08T21:10:36.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.112+0000 7fc5d6ffd700 1 --2- 172.21.15.80:0/3139221928 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fc5c806ad60 0x7fc5c806d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:36.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.112+0000 7fc5d6ffd700 1 -- 172.21.15.80:0/3139221928 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc5e0089100 con 0x7fc5e80cbc00 2024-05-08T21:10:36.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.112+0000 7fc5ecdf6700 1 -- 172.21.15.80:0/3139221928 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5e815b5b0 con 0x7fc5e80cbc00 2024-05-08T21:10:36.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.114+0000 7fc5e659c700 1 --2- 172.21.15.80:0/3139221928 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fc5c806ad60 0x7fc5c806d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:36.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.115+0000 7fc5e659c700 1 --2- 172.21.15.80:0/3139221928 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fc5c806ad60 0x7fc5c806d220 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc009b90 tx=0x7fc5dc008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:36.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.122+0000 7fc5d6ffd700 1 -- 172.21.15.80:0/3139221928 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fc5e815b5b0 con 0x7fc5e80cbc00 2024-05-08T21:10:36.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.137+0000 7f87dcdb0700 1 Processor -- start 2024-05-08T21:10:36.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.137+0000 7f87dcdb0700 1 -- start start 2024-05-08T21:10:36.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.139+0000 7f87dcdb0700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f87d806b0d0 0x7f87d80c2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:36.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.139+0000 7f87dcdb0700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f87d80c8180 0x7f87d80c6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:36.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.139+0000 7f87dcdb0700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87d80c6f30 con 0x7f87d80c7420 2024-05-08T21:10:36.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.139+0000 7f87dcdb0700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87d815e7d0 con 0x7f87d806b0d0 2024-05-08T21:10:36.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.139+0000 7f87dcdb0700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87d815eab0 con 0x7f87d80c8180 2024-05-08T21:10:36.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.139+0000 7f1d68830700 1 Processor -- start 2024-05-08T21:10:36.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.139+0000 7f87d659c700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f87d80c7420 0x7f87d806a9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.80:50932/0 (socket says 172.21.15.80:50932) 2024-05-08T21:10:36.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.139+0000 7f87d659c700 1 -- 172.21.15.80:0/1271350981 learned_addr learned my addr 172.21.15.80:0/1271350981 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:10:36.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.139+0000 7f87d6d9d700 1 --2- 172.21.15.80:0/1271350981 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f87d80c8180 0x7f87d80c6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:36.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.139+0000 7f1d68830700 1 -- start start 2024-05-08T21:10:36.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.140+0000 7f87d6d9d700 1 -- 172.21.15.80:0/1271350981 >> v2:172.21.15.80:3300/0 conn(0x7f87d806b0d0 msgr2=0x7f87d80c2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:36.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.140+0000 7f87d6d9d700 1 --2- 172.21.15.80:0/1271350981 >> v2:172.21.15.80:3300/0 conn(0x7f87d806b0d0 0x7f87d80c2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.140+0000 7f87d6d9d700 1 -- 172.21.15.80:0/1271350981 >> v1:172.21.15.106:6789/0 conn(0x7f87d80c7420 legacy=0x7f87d806a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:36.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.140+0000 7f87d6d9d700 1 -- 172.21.15.80:0/1271350981 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87d815ed90 con 0x7f87d80c8180 2024-05-08T21:10:36.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.141+0000 7f1d68830700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1d640c7420 0x7f1d640c2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:36.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.141+0000 7f1d68830700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1d640c8180 0x7f1d640c6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:36.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.141+0000 7f1d68830700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d640c7c90 con 0x7f1d640c7800 2024-05-08T21:10:36.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.141+0000 7f1d68830700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d640c6f30 con 0x7f1d640c8180 2024-05-08T21:10:36.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.141+0000 7f1d68830700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6415e7d0 con 0x7f1d640c7420 2024-05-08T21:10:36.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.141+0000 7f1d6259c700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1d640c7420 0x7f1d640c2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:36.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.141+0000 7f1d6259c700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1d640c7420 0x7f1d640c2230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:52136/0 (socket says 172.21.15.80:52136) 2024-05-08T21:10:36.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.141+0000 7f1d6259c700 1 -- 172.21.15.80:0/653955525 learned_addr learned my addr 172.21.15.80:0/653955525 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:36.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.141+0000 7f1d61d9b700 1 --2- 172.21.15.80:0/653955525 >> v2:172.21.15.106:3300/0 conn(0x7f1d640c8180 0x7f1d640c6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:36.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.141+0000 7f1d6259c700 1 -- 172.21.15.80:0/653955525 >> v2:172.21.15.106:3300/0 conn(0x7f1d640c8180 msgr2=0x7f1d640c6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:36.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.141+0000 7f1d6259c700 1 --2- 172.21.15.80:0/653955525 >> v2:172.21.15.106:3300/0 conn(0x7f1d640c8180 0x7f1d640c6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.141+0000 7f1d6259c700 1 -- 172.21.15.80:0/653955525 >> v1:172.21.15.106:6789/0 conn(0x7f1d640c7800 legacy=0x7f1d6406a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:36.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.141+0000 7f1d6259c700 1 -- 172.21.15.80:0/653955525 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d6415eab0 con 0x7f1d640c7420 2024-05-08T21:10:36.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.142+0000 7f87d6d9d700 1 --2- 172.21.15.80:0/1271350981 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f87d80c8180 0x7f87d80c6880 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f87d0009d90 tx=0x7f87d000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53eefde90f04fd0b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:36.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.142+0000 7f1d6259c700 1 --2- 172.21.15.80:0/653955525 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1d640c7420 0x7f1d640c2230 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1d580098f0 tx=0x7f1d58009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=205ab015c2528b33 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:36.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.142+0000 7f1d6159a700 1 -- 172.21.15.80:0/653955525 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d58011830 con 0x7f1d640c7420 2024-05-08T21:10:36.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.142+0000 7f1d6159a700 1 -- 172.21.15.80:0/653955525 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d58011990 con 0x7f1d640c7420 2024-05-08T21:10:36.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.142+0000 7f1d6159a700 1 -- 172.21.15.80:0/653955525 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d58011d00 con 0x7f1d640c7420 2024-05-08T21:10:36.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.142+0000 7f87d559a700 1 -- 172.21.15.80:0/1271350981 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d000e070 con 0x7f87d80c8180 2024-05-08T21:10:36.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.142+0000 7f87d559a700 1 -- 172.21.15.80:0/1271350981 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d000bad0 con 0x7f87d80c8180 2024-05-08T21:10:36.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.142+0000 7f87d559a700 1 -- 172.21.15.80:0/1271350981 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d000be80 con 0x7f87d80c8180 2024-05-08T21:10:36.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.143+0000 7f1d68830700 1 -- 172.21.15.80:0/653955525 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1d640c7420 msgr2=0x7f1d640c2230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:36.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.143+0000 7f1d68830700 1 --2- 172.21.15.80:0/653955525 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1d640c7420 0x7f1d640c2230 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1d580098f0 tx=0x7f1d58009c00 comp rx=0 tx=0).stop 2024-05-08T21:10:36.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.143+0000 7f87dcdb0700 1 -- 172.21.15.80:0/1271350981 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f87d80c8180 msgr2=0x7f87d80c6880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:36.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.143+0000 7f87dcdb0700 1 --2- 172.21.15.80:0/1271350981 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f87d80c8180 0x7f87d80c6880 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f87d0009d90 tx=0x7f87d000b330 comp rx=0 tx=0).stop 2024-05-08T21:10:36.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.143+0000 7f1d68830700 1 -- 172.21.15.80:0/653955525 shutdown_connections 2024-05-08T21:10:36.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.143+0000 7f1d68830700 1 --2- 172.21.15.80:0/653955525 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1d640c7420 0x7f1d640c2230 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.143+0000 7f1d68830700 1 --2- 172.21.15.80:0/653955525 >> v2:172.21.15.106:3300/0 conn(0x7f1d640c8180 0x7f1d640c6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.143+0000 7f1d68830700 1 -- 172.21.15.80:0/653955525 >> 172.21.15.80:0/653955525 conn(0x7f1d640c8980 msgr2=0x7f1d640c8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:36.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.143+0000 7f87dcdb0700 1 -- 172.21.15.80:0/1271350981 shutdown_connections 2024-05-08T21:10:36.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.143+0000 7f87dcdb0700 1 --2- 172.21.15.80:0/1271350981 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f87d80c8180 0x7f87d80c6880 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.143+0000 7f87dcdb0700 1 --2- 172.21.15.80:0/1271350981 >> v2:172.21.15.80:3300/0 conn(0x7f87d806b0d0 0x7f87d80c2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.143+0000 7f87dcdb0700 1 -- 172.21.15.80:0/1271350981 >> 172.21.15.80:0/1271350981 conn(0x7f87d80c8980 msgr2=0x7f87d80c8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:36.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.143+0000 7f87dcdb0700 1 -- 172.21.15.80:0/1271350981 shutdown_connections 2024-05-08T21:10:36.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.143+0000 7f87dcdb0700 1 -- 172.21.15.80:0/1271350981 wait complete. 2024-05-08T21:10:36.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.144+0000 7f1d68830700 1 -- 172.21.15.80:0/653955525 shutdown_connections 2024-05-08T21:10:36.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.144+0000 7f1d68830700 1 -- 172.21.15.80:0/653955525 wait complete. 2024-05-08T21:10:36.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.145+0000 7f1d68830700 1 Processor -- start 2024-05-08T21:10:36.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.145+0000 7f87dcdb0700 1 Processor -- start 2024-05-08T21:10:36.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.145+0000 7f87dcdb0700 1 -- start start 2024-05-08T21:10:36.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.145+0000 7f1d68830700 1 -- start start 2024-05-08T21:10:36.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.146+0000 7f1d68830700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1d640c7420 0x7f1d6415f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:36.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.146+0000 7f1d68830700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1d640c7800 0x7f1d64072250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:36.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.146+0000 7f1d68830700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d640c8180 0x7f1d641f4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:36.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.146+0000 7f1d68830700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d641628b0 con 0x7f1d640c8180 2024-05-08T21:10:36.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.146+0000 7f1d68830700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d641625d0 con 0x7f1d640c7800 2024-05-08T21:10:36.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.146+0000 7f1d68830700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6415ffd0 con 0x7f1d640c7420 2024-05-08T21:10:36.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.146+0000 7f1d62d9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d640c8180 0x7f1d641f4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:36.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.146+0000 7f1d62d9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d640c8180 0x7f1d641f4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42632/0 (socket says 172.21.15.80:42632) 2024-05-08T21:10:36.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.146+0000 7f1d62d9d700 1 -- 172.21.15.80:0/1267815510 learned_addr learned my addr 172.21.15.80:0/1267815510 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:36.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.146+0000 7f1d61d9b700 1 --2- 172.21.15.80:0/1267815510 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1d640c7800 0x7f1d64072250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:36.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.146+0000 7f1d62d9d700 1 -- 172.21.15.80:0/1267815510 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1d640c7420 msgr2=0x7f1d6415f820 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T21:10:36.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.146+0000 7f1d62d9d700 1 --2- 172.21.15.80:0/1267815510 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1d640c7420 0x7f1d6415f820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.146+0000 7f1d62d9d700 1 -- 172.21.15.80:0/1267815510 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1d640c7800 msgr2=0x7f1d64072250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:36.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.146+0000 7f1d62d9d700 1 --2- 172.21.15.80:0/1267815510 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1d640c7800 0x7f1d64072250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.146+0000 7f1d62d9d700 1 -- 172.21.15.80:0/1267815510 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d58009550 con 0x7f1d640c8180 2024-05-08T21:10:36.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.146+0000 7f1d61d9b700 1 --2- 172.21.15.80:0/1267815510 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1d640c7800 0x7f1d64072250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:10:36.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.147+0000 7f1d62d9d700 1 --2- 172.21.15.80:0/1267815510 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d640c8180 0x7f1d641f4710 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c00cbf0 tx=0x7f1d5c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:36.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.147+0000 7f87dcdb0700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87d806b0d0 0x7f87d81623f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:36.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.147+0000 7f87dcdb0700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f87d80c7420 0x7f87d81f8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:36.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.147+0000 7f87dcdb0700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f87d80c8180 0x7f87d81574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:36.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.147+0000 7f87dcdb0700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87d8158460 con 0x7f87d80c8180 2024-05-08T21:10:36.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.147+0000 7f87dcdb0700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87d8160910 con 0x7f87d806b0d0 2024-05-08T21:10:36.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.147+0000 7f87dcdb0700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87d81f8600 con 0x7f87d80c7420 2024-05-08T21:10:36.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.147+0000 7f87d6d9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f87d80c8180 0x7f87d81574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:36.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.147+0000 7f87d6d9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f87d80c8180 0x7f87d81574e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42648/0 (socket says 172.21.15.80:42648) 2024-05-08T21:10:36.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.147+0000 7f87d6d9d700 1 -- 172.21.15.80:0/140495573 learned_addr learned my addr 172.21.15.80:0/140495573 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:36.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.147+0000 7f87d659c700 1 --2- 172.21.15.80:0/140495573 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87d806b0d0 0x7f87d81623f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:36.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.147+0000 7f87d5d9b700 1 --2- 172.21.15.80:0/140495573 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f87d80c7420 0x7f87d81f8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:36.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.147+0000 7f87d6d9d700 1 -- 172.21.15.80:0/140495573 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f87d80c7420 msgr2=0x7f87d81f8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:36.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.147+0000 7f87d6d9d700 1 --2- 172.21.15.80:0/140495573 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f87d80c7420 0x7f87d81f8a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.147+0000 7f87d6d9d700 1 -- 172.21.15.80:0/140495573 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87d806b0d0 msgr2=0x7f87d81623f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:36.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.147+0000 7f87d6d9d700 1 --2- 172.21.15.80:0/140495573 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87d806b0d0 0x7f87d81623f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.147+0000 7f87d6d9d700 1 -- 172.21.15.80:0/140495573 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87d0009a70 con 0x7f87d80c8180 2024-05-08T21:10:36.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.148+0000 7f87d6d9d700 1 --2- 172.21.15.80:0/140495573 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f87d80c8180 0x7f87d81574e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f87d0004560 tx=0x7f87d0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:36.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.148+0000 7f87c6ffd700 1 -- 172.21.15.80:0/140495573 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d0012430 con 0x7f87d80c8180 2024-05-08T21:10:36.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.148+0000 7f87c6ffd700 1 -- 172.21.15.80:0/140495573 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d0012590 con 0x7f87d80c8180 2024-05-08T21:10:36.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.148+0000 7f87c6ffd700 1 -- 172.21.15.80:0/140495573 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d0012920 con 0x7f87d80c8180 2024-05-08T21:10:36.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.148+0000 7f87dcdb0700 1 -- 172.21.15.80:0/140495573 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87d81f82d0 con 0x7f87d80c8180 2024-05-08T21:10:36.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.148+0000 7f87dcdb0700 1 -- 172.21.15.80:0/140495573 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87d8160350 con 0x7f87d80c8180 2024-05-08T21:10:36.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.147+0000 7f1d52ffd700 1 -- 172.21.15.80:0/1267815510 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5c003c00 con 0x7f1d640c8180 2024-05-08T21:10:36.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.147+0000 7f1d52ffd700 1 -- 172.21.15.80:0/1267815510 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d5c003d60 con 0x7f1d640c8180 2024-05-08T21:10:36.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.147+0000 7f1d52ffd700 1 -- 172.21.15.80:0/1267815510 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5c00ab60 con 0x7f1d640c8180 2024-05-08T21:10:36.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.147+0000 7f1d68830700 1 -- 172.21.15.80:0/1267815510 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d6415fd60 con 0x7f1d640c8180 2024-05-08T21:10:36.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.147+0000 7f1d68830700 1 -- 172.21.15.80:0/1267815510 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d64161f80 con 0x7f1d640c8180 2024-05-08T21:10:36.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.151+0000 7f1d68830700 1 -- 172.21.15.80:0/1267815510 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d480052f0 con 0x7f1d640c8180 2024-05-08T21:10:36.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.151+0000 7f1d52ffd700 1 -- 172.21.15.80:0/1267815510 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1d5c00acc0 con 0x7f1d640c8180 2024-05-08T21:10:36.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.152+0000 7f1d52ffd700 1 --2- 172.21.15.80:0/1267815510 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f1d4406ad60 0x7f1d4406d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:36.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.152+0000 7f1d52ffd700 1 -- 172.21.15.80:0/1267815510 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1d5c0896f0 con 0x7f1d640c8180 2024-05-08T21:10:36.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.159+0000 7f1d6259c700 1 --2- 172.21.15.80:0/1267815510 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f1d4406ad60 0x7f1d4406d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:36.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.159+0000 7f1d6259c700 1 --2- 172.21.15.80:0/1267815510 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f1d4406ad60 0x7f1d4406d220 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1d58014040 tx=0x7f1d58008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:36.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.153+0000 7f8f3a471700 1 Processor -- start 2024-05-08T21:10:36.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.153+0000 7f8f3a471700 1 -- start start 2024-05-08T21:10:36.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.153+0000 7f8f3a471700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8f340c6680 0x7f8f34162160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:36.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.153+0000 7f8f3a471700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8f341626a0 0x7f8f34169110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:36.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.153+0000 7f8f3a471700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f3415e980 con 0x7f8f34158760 2024-05-08T21:10:36.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.153+0000 7f8f3a471700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f3415e790 con 0x7f8f341626a0 2024-05-08T21:10:36.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.153+0000 7f8f3a471700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f3415ec60 con 0x7f8f340c6680 2024-05-08T21:10:36.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.154+0000 7f8f38a0e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8f341626a0 0x7f8f34169110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:36.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.154+0000 7f8f33fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f8f34158760 0x7f8f340c8050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41828/0 (socket says 172.21.15.80:41828) 2024-05-08T21:10:36.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.154+0000 7f8f33fff700 1 -- 172.21.15.80:0/3918754950 learned_addr learned my addr 172.21.15.80:0/3918754950 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:10:36.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.154+0000 7f8f38a0e700 1 -- 172.21.15.80:0/3918754950 >> v2:172.21.15.106:3300/0 conn(0x7f8f340c6680 msgr2=0x7f8f34162160 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T21:10:36.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.154+0000 7f8f38a0e700 1 --2- 172.21.15.80:0/3918754950 >> v2:172.21.15.106:3300/0 conn(0x7f8f340c6680 0x7f8f34162160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.154+0000 7f8f38a0e700 1 -- 172.21.15.80:0/3918754950 >> v1:172.21.15.80:6789/0 conn(0x7f8f34158760 legacy=0x7f8f340c8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:36.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.154+0000 7f8f38a0e700 1 -- 172.21.15.80:0/3918754950 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f3415ef40 con 0x7f8f341626a0 2024-05-08T21:10:36.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.154+0000 7f8f38a0e700 1 --2- 172.21.15.80:0/3918754950 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f341626a0 0x7f8f34169110 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8f340c7520 tx=0x7f8f24009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2842dc71da4c46a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:36.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.149+0000 7f87dcdb0700 1 -- 172.21.15.80:0/140495573 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87bc0052f0 con 0x7f87d80c8180 2024-05-08T21:10:36.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.152+0000 7f87c6ffd700 1 -- 172.21.15.80:0/140495573 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f87d0012a80 con 0x7f87d80c8180 2024-05-08T21:10:36.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.152+0000 7f87c6ffd700 1 --2- 172.21.15.80:0/140495573 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f87b806ad60 0x7f87b806d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:36.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.152+0000 7f87c6ffd700 1 -- 172.21.15.80:0/140495573 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f87d008bbf0 con 0x7f87d80c8180 2024-05-08T21:10:36.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.159+0000 7f87c6ffd700 1 -- 172.21.15.80:0/140495573 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f87d005a670 con 0x7f87d80c8180 2024-05-08T21:10:36.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.160+0000 7f87d659c700 1 --2- 172.21.15.80:0/140495573 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f87b806ad60 0x7f87b806d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:36.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.140+0000 7f25c622b700 1 Processor -- start 2024-05-08T21:10:36.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.140+0000 7f25c622b700 1 -- start start 2024-05-08T21:10:36.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.142+0000 7f25c622b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f25c00c2230 0x7f25c00c6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:36.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.142+0000 7f25c622b700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f25c016af60 0x7f25c00cb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:36.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.142+0000 7f25c622b700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25c0167f40 con 0x7f25c00cb570 2024-05-08T21:10:36.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.142+0000 7f25c622b700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25c00c6bc0 con 0x7f25c00c2230 2024-05-08T21:10:36.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.142+0000 7f25c622b700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25c0167330 con 0x7f25c016af60 2024-05-08T21:10:36.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.142+0000 7f25beffd700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f25c00cb570 0x7f25c016a850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41822/0 (socket says 172.21.15.80:41822) 2024-05-08T21:10:36.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.142+0000 7f25beffd700 1 -- 172.21.15.80:0/1069032043 learned_addr learned my addr 172.21.15.80:0/1069032043 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:10:36.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.142+0000 7f25bffff700 1 --2- 172.21.15.80:0/1069032043 >> v2:172.21.15.106:3300/0 conn(0x7f25c016af60 0x7f25c00cb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:36.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.143+0000 7f25be7fc700 1 -- 172.21.15.80:0/1069032043 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3315618499 0 0) 0x7f25c0167f40 con 0x7f25c00cb570 2024-05-08T21:10:36.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.142+0000 7f25bf7fe700 1 --2- 172.21.15.80:0/1069032043 >> v2:172.21.15.80:3300/0 conn(0x7f25c00c2230 0x7f25c00c6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:36.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.159+0000 7f25be7fc700 1 -- 172.21.15.80:0/1069032043 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25a8003590 con 0x7f25c00cb570 2024-05-08T21:10:36.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.159+0000 7f25bf7fe700 1 -- 172.21.15.80:0/1069032043 >> v2:172.21.15.106:3300/0 conn(0x7f25c016af60 msgr2=0x7f25c00cb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:36.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.159+0000 7f25bf7fe700 1 --2- 172.21.15.80:0/1069032043 >> v2:172.21.15.106:3300/0 conn(0x7f25c016af60 0x7f25c00cb9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.159+0000 7f25bf7fe700 1 -- 172.21.15.80:0/1069032043 >> v1:172.21.15.80:6789/0 conn(0x7f25c00cb570 legacy=0x7f25c016a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:36.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.159+0000 7f25bf7fe700 1 -- 172.21.15.80:0/1069032043 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c0167610 con 0x7f25c00c2230 2024-05-08T21:10:36.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.160+0000 7f25bf7fe700 1 --2- 172.21.15.80:0/1069032043 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25c00c2230 0x7f25c00c6680 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f25c006d460 tx=0x7f25b4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35cbbc3f4e39a356 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:36.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.161+0000 7f87d659c700 1 --2- 172.21.15.80:0/140495573 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f87b806ad60 0x7f87b806d220 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f87c80013c0 tx=0x7f87c8001350 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:36.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.168+0000 7f1d52ffd700 1 -- 172.21.15.80:0/1267815510 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f1d5c054530 con 0x7f1d640c8180 2024-05-08T21:10:36.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.168+0000 7f25be7fc700 1 -- 172.21.15.80:0/1069032043 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b400f8a0 con 0x7f25c00c2230 2024-05-08T21:10:36.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.168+0000 7f25be7fc700 1 -- 172.21.15.80:0/1069032043 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b400fa00 con 0x7f25c00c2230 2024-05-08T21:10:36.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.168+0000 7f25be7fc700 1 -- 172.21.15.80:0/1069032043 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b400fd70 con 0x7f25c00c2230 2024-05-08T21:10:36.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.169+0000 7f25c622b700 1 -- 172.21.15.80:0/1069032043 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25c00c2230 msgr2=0x7f25c00c6680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:36.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.169+0000 7f25c622b700 1 --2- 172.21.15.80:0/1069032043 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25c00c2230 0x7f25c00c6680 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f25c006d460 tx=0x7f25b4009b20 comp rx=0 tx=0).stop 2024-05-08T21:10:36.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.169+0000 7f8f32ffd700 1 -- 172.21.15.80:0/3918754950 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f24011830 con 0x7f8f341626a0 2024-05-08T21:10:36.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.169+0000 7f8f32ffd700 1 -- 172.21.15.80:0/3918754950 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f24011990 con 0x7f8f341626a0 2024-05-08T21:10:36.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.169+0000 7f8f32ffd700 1 -- 172.21.15.80:0/3918754950 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f24011d20 con 0x7f8f341626a0 2024-05-08T21:10:36.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.170+0000 7f8f3a471700 1 -- 172.21.15.80:0/3918754950 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f341626a0 msgr2=0x7f8f34169110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:36.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.170+0000 7f8f3a471700 1 --2- 172.21.15.80:0/3918754950 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f341626a0 0x7f8f34169110 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8f340c7520 tx=0x7f8f24009b20 comp rx=0 tx=0).stop 2024-05-08T21:10:36.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.170+0000 7f25c622b700 1 -- 172.21.15.80:0/1069032043 shutdown_connections 2024-05-08T21:10:36.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.170+0000 7f25c622b700 1 --2- 172.21.15.80:0/1069032043 >> v2:172.21.15.106:3300/0 conn(0x7f25c016af60 0x7f25c00cb9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.170+0000 7f25c622b700 1 --2- 172.21.15.80:0/1069032043 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25c00c2230 0x7f25c00c6680 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.170+0000 7f25c622b700 1 -- 172.21.15.80:0/1069032043 >> 172.21.15.80:0/1069032043 conn(0x7f25c006a9c0 msgr2=0x7f25c006ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:36.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.170+0000 7f25c622b700 1 -- 172.21.15.80:0/1069032043 shutdown_connections 2024-05-08T21:10:36.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.170+0000 7f25c622b700 1 -- 172.21.15.80:0/1069032043 wait complete. 2024-05-08T21:10:36.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.171+0000 7f8f3a471700 1 -- 172.21.15.80:0/3918754950 shutdown_connections 2024-05-08T21:10:36.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.171+0000 7f8f3a471700 1 --2- 172.21.15.80:0/3918754950 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f341626a0 0x7f8f34169110 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.171+0000 7f8f3a471700 1 --2- 172.21.15.80:0/3918754950 >> v2:172.21.15.106:3300/0 conn(0x7f8f340c6680 0x7f8f34162160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.171+0000 7f8f3a471700 1 -- 172.21.15.80:0/3918754950 >> 172.21.15.80:0/3918754950 conn(0x7f8f3406a9c0 msgr2=0x7f8f3406ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:36.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.172+0000 7f8f3a471700 1 -- 172.21.15.80:0/3918754950 shutdown_connections 2024-05-08T21:10:36.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.172+0000 7f25c622b700 1 Processor -- start 2024-05-08T21:10:36.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.172+0000 7f25c622b700 1 -- start start 2024-05-08T21:10:36.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.173+0000 7f25c622b700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f25c00c2230 0x7f25c00730d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:36.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.173+0000 7f25c622b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25c00cb570 0x7f25c015bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:36.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.173+0000 7f25c622b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25c016af60 0x7f25c015c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:36.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.173+0000 7f25c622b700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c0205db0 con 0x7f25c016af60 2024-05-08T21:10:36.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.173+0000 7f25c622b700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c0205210 con 0x7f25c00cb570 2024-05-08T21:10:36.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.173+0000 7f25c622b700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25c0206090 con 0x7f25c00c2230 2024-05-08T21:10:36.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.174+0000 7f25beffd700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25c00cb570 0x7f25c015bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:36.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.174+0000 7f25beffd700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25c00cb570 0x7f25c015bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.80:45484/0 (socket says 172.21.15.80:45484) 2024-05-08T21:10:36.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.174+0000 7f25beffd700 1 -- 172.21.15.80:0/2552633982 learned_addr learned my addr 172.21.15.80:0/2552633982 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:36.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.174+0000 7f25bf7fe700 1 --2- 172.21.15.80:0/2552633982 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f25c00c2230 0x7f25c00730d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:36.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.172+0000 7f8f3a471700 1 -- 172.21.15.80:0/3918754950 wait complete. 2024-05-08T21:10:36.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.174+0000 7f8f3a471700 1 Processor -- start 2024-05-08T21:10:36.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.174+0000 7f25beffd700 1 -- 172.21.15.80:0/2552633982 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f25c00c2230 msgr2=0x7f25c00730d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:36.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.174+0000 7f25beffd700 1 --2- 172.21.15.80:0/2552633982 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f25c00c2230 0x7f25c00730d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.174+0000 7f25beffd700 1 -- 172.21.15.80:0/2552633982 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25c016af60 msgr2=0x7f25c015c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:36.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.174+0000 7f25beffd700 1 --2- 172.21.15.80:0/2552633982 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25c016af60 0x7f25c015c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.174+0000 7f25beffd700 1 -- 172.21.15.80:0/2552633982 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b40094a0 con 0x7f25c00cb570 2024-05-08T21:10:36.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.175+0000 7f25beffd700 1 --2- 172.21.15.80:0/2552633982 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25c00cb570 0x7f25c015bdf0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f25b800cbf0 tx=0x7f25b800a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:36.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.174+0000 7f8f3a471700 1 -- start start 2024-05-08T21:10:36.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.175+0000 7f8f3a471700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f340c6680 0x7f8f34070ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:36.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.175+0000 7f8f3a471700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8f34158760 0x7f8f34138a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:36.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.175+0000 7f8f3a471700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8f341626a0 0x7f8f340c9e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:36.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.175+0000 7f8f3a471700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f34071580 con 0x7f8f340c6680 2024-05-08T21:10:36.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.176+0000 7f8f3a471700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f34071220 con 0x7f8f341626a0 2024-05-08T21:10:36.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.176+0000 7f8f3a471700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f34138600 con 0x7f8f34158760 2024-05-08T21:10:36.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.176+0000 7f8f337fe700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8f34158760 0x7f8f34138a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:36.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.176+0000 7f8f337fe700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8f34158760 0x7f8f34138a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:52170/0 (socket says 172.21.15.80:52170) 2024-05-08T21:10:36.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.176+0000 7f8f337fe700 1 -- 172.21.15.80:0/2595151555 learned_addr learned my addr 172.21.15.80:0/2595151555 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:36.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.176+0000 7f8f38a0e700 1 --2- 172.21.15.80:0/2595151555 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8f341626a0 0x7f8f340c9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:36.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.176+0000 7f8f33fff700 1 --2- 172.21.15.80:0/2595151555 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f340c6680 0x7f8f34070ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:36.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.176+0000 7f8f38a0e700 1 -- 172.21.15.80:0/2595151555 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8f34158760 msgr2=0x7f8f34138a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:36.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.177+0000 7f8f38a0e700 1 --2- 172.21.15.80:0/2595151555 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8f34158760 0x7f8f34138a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.177+0000 7f8f38a0e700 1 -- 172.21.15.80:0/2595151555 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f340c6680 msgr2=0x7f8f34070ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:36.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.177+0000 7f8f38a0e700 1 --2- 172.21.15.80:0/2595151555 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f340c6680 0x7f8f34070ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.177+0000 7f8f38a0e700 1 -- 172.21.15.80:0/2595151555 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f240094a0 con 0x7f8f341626a0 2024-05-08T21:10:36.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.177+0000 7f8f38a0e700 1 --2- 172.21.15.80:0/2595151555 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8f341626a0 0x7f8f340c9e90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8f24016000 tx=0x7f8f24004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:36.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.177+0000 7f8f30ff9700 1 -- 172.21.15.80:0/2595151555 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f240036a0 con 0x7f8f341626a0 2024-05-08T21:10:36.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.177+0000 7f8f30ff9700 1 -- 172.21.15.80:0/2595151555 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f2401f070 con 0x7f8f341626a0 2024-05-08T21:10:36.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.177+0000 7f8f30ff9700 1 -- 172.21.15.80:0/2595151555 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f24003a60 con 0x7f8f341626a0 2024-05-08T21:10:36.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.177+0000 7f8f3a471700 1 -- 172.21.15.80:0/2595151555 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f340726d0 con 0x7f8f341626a0 2024-05-08T21:10:36.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.178+0000 7f8f3a471700 1 -- 172.21.15.80:0/2595151555 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f341382b0 con 0x7f8f341626a0 2024-05-08T21:10:36.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.179+0000 7f8f3a471700 1 -- 172.21.15.80:0/2595151555 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f3404ec60 con 0x7f8f341626a0 2024-05-08T21:10:36.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.179+0000 7f25a7fff700 1 -- 172.21.15.80:0/2552633982 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b800abe0 con 0x7f25c00cb570 2024-05-08T21:10:36.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.179+0000 7f25a7fff700 1 -- 172.21.15.80:0/2552633982 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b800ad40 con 0x7f25c00cb570 2024-05-08T21:10:36.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.179+0000 7f25a7fff700 1 -- 172.21.15.80:0/2552633982 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b8012620 con 0x7f25c00cb570 2024-05-08T21:10:36.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.182+0000 7f8f30ff9700 1 -- 172.21.15.80:0/2595151555 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8f24003bc0 con 0x7f8f341626a0 2024-05-08T21:10:36.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.182+0000 7f8f30ff9700 1 --2- 172.21.15.80:0/2595151555 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f8f1c06ae40 0x7f8f1c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:36.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.182+0000 7f8f30ff9700 1 -- 172.21.15.80:0/2595151555 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8f24021070 con 0x7f8f341626a0 2024-05-08T21:10:36.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.179+0000 7f25c622b700 1 -- 172.21.15.80:0/2552633982 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25c0205480 con 0x7f25c00cb570 2024-05-08T21:10:36.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.179+0000 7f25c622b700 1 -- 172.21.15.80:0/2552633982 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25c0205a40 con 0x7f25c00cb570 2024-05-08T21:10:36.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.183+0000 7f8f33fff700 1 --2- 172.21.15.80:0/2595151555 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f8f1c06ae40 0x7f8f1c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:36.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.183+0000 7f25c622b700 1 -- 172.21.15.80:0/2552633982 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25a00052f0 con 0x7f25c00cb570 2024-05-08T21:10:36.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.184+0000 7f8f33fff700 1 --2- 172.21.15.80:0/2595151555 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f8f1c06ae40 0x7f8f1c06d300 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c005c90 tx=0x7f8f2c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:36.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.185+0000 7f8f30ff9700 1 -- 172.21.15.80:0/2595151555 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f8f24056270 con 0x7f8f341626a0 2024-05-08T21:10:36.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.186+0000 7f25a7fff700 1 -- 172.21.15.80:0/2552633982 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f25b801b3b0 con 0x7f25c00cb570 2024-05-08T21:10:36.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.187+0000 7f25a7fff700 1 --2- 172.21.15.80:0/2552633982 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f25ac06ad60 0x7f25ac06d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:36.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.187+0000 7f25a7fff700 1 -- 172.21.15.80:0/2552633982 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f25b8089910 con 0x7f25c00cb570 2024-05-08T21:10:36.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.190+0000 7f25a7fff700 1 -- 172.21.15.80:0/2552633982 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f25b80547e0 con 0x7f25c00cb570 2024-05-08T21:10:36.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.190+0000 7f25bf7fe700 1 --2- 172.21.15.80:0/2552633982 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f25ac06ad60 0x7f25ac06d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:36.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.191+0000 7f25bf7fe700 1 --2- 172.21.15.80:0/2552633982 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f25ac06ad60 0x7f25ac06d220 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f25b4000c00 tx=0x7f25b4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:36.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.228+0000 7f26ec7ad700 1 Processor -- start 2024-05-08T21:10:36.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.229+0000 7f26ec7ad700 1 -- start start 2024-05-08T21:10:36.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.230+0000 7f26ec7ad700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f26e40c6af0 0x7f26e40c3100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:36.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.230+0000 7f26ec7ad700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f26e40c3640 0x7f26e40cb960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:36.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.230+0000 7f26ec7ad700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26e41507f0 con 0x7f26e4150410 2024-05-08T21:10:36.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.230+0000 7f26ec7ad700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26e40c3a50 con 0x7f26e40c6af0 2024-05-08T21:10:36.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.230+0000 7f26ec7ad700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26e40c2bf0 con 0x7f26e40c3640 2024-05-08T21:10:36.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.231+0000 7f26e9d48700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f26e40c6af0 0x7f26e40c3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:36.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.232+0000 7f26e9d48700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f26e40c6af0 0x7f26e40c3100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42674/0 (socket says 172.21.15.80:42674) 2024-05-08T21:10:36.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.232+0000 7f26e9d48700 1 -- 172.21.15.80:0/2126290562 learned_addr learned my addr 172.21.15.80:0/2126290562 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:36.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.232+0000 7f26e9d48700 1 -- 172.21.15.80:0/2126290562 >> v2:172.21.15.106:3300/0 conn(0x7f26e40c3640 msgr2=0x7f26e40cb960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:36.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.232+0000 7f26e9d48700 1 --2- 172.21.15.80:0/2126290562 >> v2:172.21.15.106:3300/0 conn(0x7f26e40c3640 0x7f26e40cb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.232+0000 7f26e9d48700 1 -- 172.21.15.80:0/2126290562 >> v1:172.21.15.106:6789/0 conn(0x7f26e4150410 legacy=0x7f26e4156dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:36.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.232+0000 7f26e9d48700 1 -- 172.21.15.80:0/2126290562 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26e40c7010 con 0x7f26e40c6af0 2024-05-08T21:10:36.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.232+0000 7f26e9d48700 1 --2- 172.21.15.80:0/2126290562 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f26e40c6af0 0x7f26e40c3100 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f26e40c6a30 tx=0x7f26d400d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfed22965341d510 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:36.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.233+0000 7f26e9547700 1 -- 172.21.15.80:0/2126290562 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d4010070 con 0x7f26e40c6af0 2024-05-08T21:10:36.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.233+0000 7f26e9547700 1 -- 172.21.15.80:0/2126290562 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26d400da00 con 0x7f26e40c6af0 2024-05-08T21:10:36.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.233+0000 7f26e9547700 1 -- 172.21.15.80:0/2126290562 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d400dd90 con 0x7f26e40c6af0 2024-05-08T21:10:36.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.234+0000 7f26ec7ad700 1 -- 172.21.15.80:0/2126290562 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f26e40c6af0 msgr2=0x7f26e40c3100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:36.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.234+0000 7f26ec7ad700 1 --2- 172.21.15.80:0/2126290562 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f26e40c6af0 0x7f26e40c3100 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f26e40c6a30 tx=0x7f26d400d330 comp rx=0 tx=0).stop 2024-05-08T21:10:36.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.234+0000 7f26ec7ad700 1 -- 172.21.15.80:0/2126290562 shutdown_connections 2024-05-08T21:10:36.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.234+0000 7f26ec7ad700 1 --2- 172.21.15.80:0/2126290562 >> v2:172.21.15.106:3300/0 conn(0x7f26e40c3640 0x7f26e40cb960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.234+0000 7f26ec7ad700 1 --2- 172.21.15.80:0/2126290562 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f26e40c6af0 0x7f26e40c3100 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.234+0000 7f26ec7ad700 1 -- 172.21.15.80:0/2126290562 >> 172.21.15.80:0/2126290562 conn(0x7f26e406a9c0 msgr2=0x7f26e406ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:36.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.235+0000 7f26ec7ad700 1 -- 172.21.15.80:0/2126290562 shutdown_connections 2024-05-08T21:10:36.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.235+0000 7f26ec7ad700 1 -- 172.21.15.80:0/2126290562 wait complete. 2024-05-08T21:10:36.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.236+0000 7f26ec7ad700 1 Processor -- start 2024-05-08T21:10:36.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.237+0000 7fcbc87d2700 1 Processor -- start 2024-05-08T21:10:36.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.237+0000 7f26ec7ad700 1 -- start start 2024-05-08T21:10:36.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.238+0000 7f26ec7ad700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f26e40c3640 0x7f26e4153730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:36.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.238+0000 7f26ec7ad700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f26e40c6af0 0x7f26e4147310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:36.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.238+0000 7f26ec7ad700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26e4150410 0x7f26e41f5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:36.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.238+0000 7f26ec7ad700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e4148cc0 con 0x7f26e40c3640 2024-05-08T21:10:36.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.238+0000 7f26ec7ad700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e4153d70 con 0x7f26e4150410 2024-05-08T21:10:36.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.238+0000 7f26ec7ad700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26e41493b0 con 0x7f26e40c6af0 2024-05-08T21:10:36.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.238+0000 7f26ea549700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f26e40c3640 0x7f26e4153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:36.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.238+0000 7f26ea549700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f26e40c3640 0x7f26e4153730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42688/0 (socket says 172.21.15.80:42688) 2024-05-08T21:10:36.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.238+0000 7f26ea549700 1 -- 172.21.15.80:0/415682818 learned_addr learned my addr 172.21.15.80:0/415682818 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:36.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.239+0000 7f26ead4a700 1 --2- 172.21.15.80:0/415682818 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26e4150410 0x7f26e41f5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:36.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.237+0000 7fcbc87d2700 1 -- start start 2024-05-08T21:10:36.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.239+0000 7fcbc87d2700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcbc00c6af0 0x7fcbc00c3100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:36.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.239+0000 7fcbc87d2700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbc01507f0 con 0x7fcbc0150410 2024-05-08T21:10:36.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.239+0000 7fcbc87d2700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbc00c7010 con 0x7fcbc00c3640 2024-05-08T21:10:36.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.239+0000 7fcbc87d2700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc00c2bf0 con 0x7fcbc00c6af0 2024-05-08T21:10:36.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.239+0000 7f26ea549700 1 -- 172.21.15.80:0/415682818 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f26e40c6af0 msgr2=0x7f26e4147310 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T21:10:36.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.239+0000 7f26ea549700 1 --2- 172.21.15.80:0/415682818 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f26e40c6af0 0x7f26e4147310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.239+0000 7f26ea549700 1 -- 172.21.15.80:0/415682818 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26e4150410 msgr2=0x7f26e41f5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:36.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.239+0000 7f26ea549700 1 --2- 172.21.15.80:0/415682818 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26e4150410 0x7f26e41f5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.239+0000 7f26ea549700 1 -- 172.21.15.80:0/415682818 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26d40085d0 con 0x7f26e40c3640 2024-05-08T21:10:36.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.239+0000 7fcbc656e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fcbc0150410 0x7fcbc0156dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41830/0 (socket says 172.21.15.80:41830) 2024-05-08T21:10:36.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.240+0000 7fcbc656e700 1 -- 172.21.15.80:0/3014541759 learned_addr learned my addr 172.21.15.80:0/3014541759 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:10:36.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.240+0000 7f26ea549700 1 --2- 172.21.15.80:0/415682818 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f26e40c3640 0x7f26e4153730 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f26e000c4d0 tx=0x7f26e000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:36.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.240+0000 7f26daffd700 1 -- 172.21.15.80:0/415682818 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e0011790 con 0x7f26e40c3640 2024-05-08T21:10:36.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.240+0000 7f26daffd700 1 -- 172.21.15.80:0/415682818 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26e00118f0 con 0x7f26e40c3640 2024-05-08T21:10:36.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.240+0000 7f26daffd700 1 -- 172.21.15.80:0/415682818 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e0011ca0 con 0x7f26e40c3640 2024-05-08T21:10:36.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.241+0000 7f26ec7ad700 1 -- 172.21.15.80:0/415682818 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26e4145a80 con 0x7f26e40c3640 2024-05-08T21:10:36.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.241+0000 7f26ec7ad700 1 -- 172.21.15.80:0/415682818 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26e41457a0 con 0x7f26e40c3640 2024-05-08T21:10:36.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.242+0000 7fcbc5d6d700 1 --2- 172.21.15.80:0/3014541759 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcbc00c6af0 0x7fcbc00c3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:36.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.242+0000 7fcbc556c700 1 -- 172.21.15.80:0/3014541759 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1175275675 0 0) 0x7fcbc00c7010 con 0x7fcbc00c3640 2024-05-08T21:10:36.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.242+0000 7fcbc556c700 1 -- 172.21.15.80:0/3014541759 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbac0034d0 con 0x7fcbc00c3640 2024-05-08T21:10:36.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.242+0000 7fcbc556c700 1 -- 172.21.15.80:0/3014541759 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 38361795 0 0) 0x7fcbc01507f0 con 0x7fcbc0150410 2024-05-08T21:10:36.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.242+0000 7fcbc556c700 1 -- 172.21.15.80:0/3014541759 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbc00c7010 con 0x7fcbc0150410 2024-05-08T21:10:36.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.243+0000 7f26ec7ad700 1 -- 172.21.15.80:0/415682818 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26e40c8200 con 0x7f26e40c3640 2024-05-08T21:10:36.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.244+0000 7f26daffd700 1 -- 172.21.15.80:0/415682818 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f26e001c460 con 0x7f26e40c3640 2024-05-08T21:10:36.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.244+0000 7f26daffd700 1 --2- 172.21.15.80:0/415682818 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f26c806acc0 0x7f26c806d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:36.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.244+0000 7f26daffd700 1 -- 172.21.15.80:0/415682818 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f26e00894b0 con 0x7f26e40c3640 2024-05-08T21:10:36.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.245+0000 7f26e9d48700 1 --2- 172.21.15.80:0/415682818 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f26c806acc0 0x7f26c806d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:36.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.245+0000 7f26e9d48700 1 --2- 172.21.15.80:0/415682818 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f26c806acc0 0x7f26c806d180 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f26e40c6f40 tx=0x7f26d4012000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:36.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.247+0000 7fcbc556c700 1 -- 172.21.15.80:0/3014541759 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1682624892 0 0) 0x7fcbac0034d0 con 0x7fcbc00c3640 2024-05-08T21:10:36.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.247+0000 7fcbc5d6d700 1 -- 172.21.15.80:0/3014541759 >> v1:172.21.15.106:6789/0 conn(0x7fcbc00c3640 legacy=0x7fcbc00cb960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:36.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.247+0000 7fcbc5d6d700 1 -- 172.21.15.80:0/3014541759 >> v1:172.21.15.80:6789/0 conn(0x7fcbc0150410 legacy=0x7fcbc0156dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:36.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.247+0000 7fcbc5d6d700 1 -- 172.21.15.80:0/3014541759 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc00c7f40 con 0x7fcbc00c6af0 2024-05-08T21:10:36.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.249+0000 7fcbc5d6d700 1 --2- 172.21.15.80:0/3014541759 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcbc00c6af0 0x7fcbc00c3100 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc0097f0 tx=0x7fcbbc009b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9accdad1935c6a7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:36.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.250+0000 7fcbc556c700 1 -- 172.21.15.80:0/3014541759 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb8001a30 con 0x7fcbc00c6af0 2024-05-08T21:10:36.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.250+0000 7fcbc556c700 1 -- 172.21.15.80:0/3014541759 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbbc004030 con 0x7fcbc00c6af0 2024-05-08T21:10:36.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.250+0000 7fcbc556c700 1 -- 172.21.15.80:0/3014541759 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbbc0043c0 con 0x7fcbc00c6af0 2024-05-08T21:10:36.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.250+0000 7fcbc87d2700 1 -- 172.21.15.80:0/3014541759 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcbc00c6af0 msgr2=0x7fcbc00c3100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:36.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.250+0000 7fcbc87d2700 1 --2- 172.21.15.80:0/3014541759 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcbc00c6af0 0x7fcbc00c3100 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc0097f0 tx=0x7fcbbc009b00 comp rx=0 tx=0).stop 2024-05-08T21:10:36.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.251+0000 7fcbc87d2700 1 -- 172.21.15.80:0/3014541759 shutdown_connections 2024-05-08T21:10:36.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.251+0000 7fcbc87d2700 1 --2- 172.21.15.80:0/3014541759 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcbc00c6af0 0x7fcbc00c3100 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.251+0000 7fcbc87d2700 1 -- 172.21.15.80:0/3014541759 >> 172.21.15.80:0/3014541759 conn(0x7fcbc006a9c0 msgr2=0x7fcbc006ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:36.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.251+0000 7fcbc87d2700 1 -- 172.21.15.80:0/3014541759 shutdown_connections 2024-05-08T21:10:36.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.251+0000 7fcbc87d2700 1 -- 172.21.15.80:0/3014541759 wait complete. 2024-05-08T21:10:36.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.252+0000 7fcbc87d2700 1 Processor -- start 2024-05-08T21:10:36.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.252+0000 7fcbc87d2700 1 -- start start 2024-05-08T21:10:36.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.253+0000 7fcbc87d2700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcbc00c3640 0x7fcbc01e1000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:36.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.253+0000 7fcbc87d2700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbc00c6af0 0x7fcbc01f3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:36.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.253+0000 7fcbc87d2700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcbc014db00 0x7fcbc01f3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:36.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.253+0000 7fcbc87d2700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc01e5040 con 0x7fcbc00c6af0 2024-05-08T21:10:36.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.253+0000 7fcbc87d2700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc00c9a90 con 0x7fcbc00c3640 2024-05-08T21:10:36.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.253+0000 7fcbc87d2700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc00c9560 con 0x7fcbc014db00 2024-05-08T21:10:36.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.253+0000 7fcbc5d6d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbc00c6af0 0x7fcbc01f3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:36.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.253+0000 7fcbc5d6d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbc00c6af0 0x7fcbc01f3a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42702/0 (socket says 172.21.15.80:42702) 2024-05-08T21:10:36.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.253+0000 7fcbc5d6d700 1 -- 172.21.15.80:0/1282490448 learned_addr learned my addr 172.21.15.80:0/1282490448 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:36.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.253+0000 7fcbc6d6f700 1 --2- 172.21.15.80:0/1282490448 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcbc014db00 0x7fcbc01f3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:36.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.253+0000 7f26daffd700 1 -- 172.21.15.80:0/415682818 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f26e40c8200 con 0x7f26e40c3640 2024-05-08T21:10:36.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.254+0000 7fcbc5d6d700 1 -- 172.21.15.80:0/1282490448 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcbc014db00 msgr2=0x7fcbc01f3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:36.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.254+0000 7fcbc5d6d700 1 --2- 172.21.15.80:0/1282490448 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcbc014db00 0x7fcbc01f3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.254+0000 7fcbc5d6d700 1 -- 172.21.15.80:0/1282490448 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcbc00c3640 msgr2=0x7fcbc01e1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:36.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.254+0000 7fcbc5d6d700 1 --2- 172.21.15.80:0/1282490448 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcbc00c3640 0x7fcbc01e1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.254+0000 7fcbc5d6d700 1 -- 172.21.15.80:0/1282490448 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbbc0094a0 con 0x7fcbc00c6af0 2024-05-08T21:10:36.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.254+0000 7fcbc5d6d700 1 --2- 172.21.15.80:0/1282490448 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbc00c6af0 0x7fcbc01f3a50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc0097c0 tx=0x7fcbbc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:36.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.256+0000 7f539df34700 1 Processor -- start 2024-05-08T21:10:36.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.256+0000 7f539df34700 1 -- start start 2024-05-08T21:10:36.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.257+0000 7f539df34700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f5398150410 0x7f5398156dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:36.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.257+0000 7f539df34700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f53980c6af0 0x7f53980c3100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:36.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.257+0000 7f539df34700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5398157300 con 0x7f53980c3640 2024-05-08T21:10:36.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.257+0000 7f539df34700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53980c2bf0 con 0x7f5398150410 2024-05-08T21:10:36.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.257+0000 7f539df34700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53981507f0 con 0x7f53980c6af0 2024-05-08T21:10:36.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.258+0000 7f53977fe700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f5398150410 0x7f5398156dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:36.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.258+0000 7f53977fe700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f5398150410 0x7f5398156dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.80:45526/0 (socket says 172.21.15.80:45526) 2024-05-08T21:10:36.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.258+0000 7f53977fe700 1 -- 172.21.15.80:0/2374856270 learned_addr learned my addr 172.21.15.80:0/2374856270 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:36.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.258+0000 7f5396ffd700 1 --2- 172.21.15.80:0/2374856270 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f53980c6af0 0x7f53980c3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:36.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.258+0000 7f53977fe700 1 -- 172.21.15.80:0/2374856270 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f53980c6af0 msgr2=0x7f53980c3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:36.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.258+0000 7f53977fe700 1 --2- 172.21.15.80:0/2374856270 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f53980c6af0 0x7f53980c3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.258+0000 7f53977fe700 1 -- 172.21.15.80:0/2374856270 >> v1:172.21.15.80:6789/0 conn(0x7f53980c3640 legacy=0x7f53980cb960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:36.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.258+0000 7f53977fe700 1 -- 172.21.15.80:0/2374856270 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53980c7010 con 0x7f5398150410 2024-05-08T21:10:36.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.259+0000 7f53977fe700 1 --2- 172.21.15.80:0/2374856270 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5398150410 0x7f5398156dc0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5390007980 tx=0x7f539000d650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18d22cf939c507bc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:36.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.259+0000 7fcbb6ffd700 1 -- 172.21.15.80:0/1282490448 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbbc003ad0 con 0x7fcbc00c6af0 2024-05-08T21:10:36.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.259+0000 7fcbb6ffd700 1 -- 172.21.15.80:0/1282490448 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbbc01f070 con 0x7fcbc00c6af0 2024-05-08T21:10:36.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.259+0000 7fcbb6ffd700 1 -- 172.21.15.80:0/1282490448 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbbc003e70 con 0x7fcbc00c6af0 2024-05-08T21:10:36.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.259+0000 7fcbc87d2700 1 -- 172.21.15.80:0/1282490448 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbc00c97b0 con 0x7fcbc00c6af0 2024-05-08T21:10:36.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.259+0000 7fcbc87d2700 1 -- 172.21.15.80:0/1282490448 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbc01e4d60 con 0x7fcbc00c6af0 2024-05-08T21:10:36.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.259+0000 7f53967fc700 1 -- 172.21.15.80:0/2374856270 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5390003c20 con 0x7f5398150410 2024-05-08T21:10:36.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.259+0000 7f53967fc700 1 -- 172.21.15.80:0/2374856270 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5390003d80 con 0x7f5398150410 2024-05-08T21:10:36.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.259+0000 7f53967fc700 1 -- 172.21.15.80:0/2374856270 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5390004270 con 0x7f5398150410 2024-05-08T21:10:36.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.260+0000 7f539df34700 1 -- 172.21.15.80:0/2374856270 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5398150410 msgr2=0x7f5398156dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:36.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.260+0000 7f539df34700 1 --2- 172.21.15.80:0/2374856270 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5398150410 0x7f5398156dc0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5390007980 tx=0x7f539000d650 comp rx=0 tx=0).stop 2024-05-08T21:10:36.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.261+0000 7f539df34700 1 -- 172.21.15.80:0/2374856270 shutdown_connections 2024-05-08T21:10:36.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.261+0000 7f539df34700 1 --2- 172.21.15.80:0/2374856270 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5398150410 0x7f5398156dc0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.261+0000 7f539df34700 1 --2- 172.21.15.80:0/2374856270 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f53980c6af0 0x7f53980c3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.261+0000 7f539df34700 1 -- 172.21.15.80:0/2374856270 >> 172.21.15.80:0/2374856270 conn(0x7f539806a9c0 msgr2=0x7f539806ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:36.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.261+0000 7f539df34700 1 -- 172.21.15.80:0/2374856270 shutdown_connections 2024-05-08T21:10:36.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.261+0000 7f539df34700 1 -- 172.21.15.80:0/2374856270 wait complete. 2024-05-08T21:10:36.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.263+0000 7f539df34700 1 Processor -- start 2024-05-08T21:10:36.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.263+0000 7f539df34700 1 -- start start 2024-05-08T21:10:36.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.264+0000 7f539df34700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f53980c3640 0x7f53981ee680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:36.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.264+0000 7f539df34700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53980c6af0 0x7f53981fcf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:36.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.264+0000 7f539df34700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5398150410 0x7f53981ff150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:36.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.264+0000 7f539df34700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53981f0ab0 con 0x7f53980c6af0 2024-05-08T21:10:36.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.264+0000 7f539df34700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f539814cb10 con 0x7f53980c3640 2024-05-08T21:10:36.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.264+0000 7f539df34700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53981fdcc0 con 0x7f5398150410 2024-05-08T21:10:36.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.264+0000 7fcbb6ffd700 1 -- 172.21.15.80:0/1282490448 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fcbbc021030 con 0x7fcbc00c6af0 2024-05-08T21:10:36.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.264+0000 7fcbb6ffd700 1 --2- 172.21.15.80:0/1282490448 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fcba406ad90 0x7fcba406d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:36.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.264+0000 7fcbb6ffd700 1 -- 172.21.15.80:0/1282490448 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcbbc08a970 con 0x7fcbc00c6af0 2024-05-08T21:10:36.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.265+0000 7fcbc656e700 1 --2- 172.21.15.80:0/1282490448 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fcba406ad90 0x7fcba406d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:36.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.264+0000 7f5397fff700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5398150410 0x7f53981ff150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:36.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.264+0000 7f5397fff700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5398150410 0x7f53981ff150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:52202/0 (socket says 172.21.15.80:52202) 2024-05-08T21:10:36.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.264+0000 7f5397fff700 1 -- 172.21.15.80:0/1607576796 learned_addr learned my addr 172.21.15.80:0/1607576796 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:36.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.265+0000 7f53977fe700 1 --2- 172.21.15.80:0/1607576796 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f53980c3640 0x7f53981ee680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:36.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.265+0000 7f5397fff700 1 -- 172.21.15.80:0/1607576796 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f53980c3640 msgr2=0x7f53981ee680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:36.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.265+0000 7f5397fff700 1 --2- 172.21.15.80:0/1607576796 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f53980c3640 0x7f53981ee680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.265+0000 7f5397fff700 1 -- 172.21.15.80:0/1607576796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53980c6af0 msgr2=0x7f53981fcf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:36.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.265+0000 7f5397fff700 1 --2- 172.21.15.80:0/1607576796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53980c6af0 0x7f53981fcf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.265+0000 7f5397fff700 1 -- 172.21.15.80:0/1607576796 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f539000d050 con 0x7f5398150410 2024-05-08T21:10:36.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.265+0000 7fcbc656e700 1 --2- 172.21.15.80:0/1282490448 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fcba406ad90 0x7fcba406d250 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcbb0004960 tx=0x7fcbb0005c70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:36.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.265+0000 7f5397fff700 1 --2- 172.21.15.80:0/1607576796 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5398150410 0x7f53981ff150 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f538800c4c0 tx=0x7f5388001e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:36.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.266+0000 7fcbc87d2700 1 -- 172.21.15.80:0/1282490448 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcba80052f0 con 0x7fcbc00c6af0 2024-05-08T21:10:36.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.266+0000 7f537ffff700 1 -- 172.21.15.80:0/1607576796 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53880054e0 con 0x7f5398150410 2024-05-08T21:10:36.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.266+0000 7f537ffff700 1 -- 172.21.15.80:0/1607576796 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f538800ce70 con 0x7f5398150410 2024-05-08T21:10:36.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.266+0000 7f537ffff700 1 -- 172.21.15.80:0/1607576796 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53880038a0 con 0x7f5398150410 2024-05-08T21:10:36.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.266+0000 7f539df34700 1 -- 172.21.15.80:0/1607576796 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5398153a00 con 0x7f5398150410 2024-05-08T21:10:36.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.266+0000 7f539df34700 1 -- 172.21.15.80:0/1607576796 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53981f0530 con 0x7f5398150410 2024-05-08T21:10:36.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.268+0000 7f537ffff700 1 -- 172.21.15.80:0/1607576796 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5388003a00 con 0x7f5398150410 2024-05-08T21:10:36.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.269+0000 7f537ffff700 1 --2- 172.21.15.80:0/1607576796 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f538006aef0 0x7f538006d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:36.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.269+0000 7f537ffff700 1 -- 172.21.15.80:0/1607576796 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5388088900 con 0x7f5398150410 2024-05-08T21:10:36.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.269+0000 7f53977fe700 1 --2- 172.21.15.80:0/1607576796 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f538006aef0 0x7f538006d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:36.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.270+0000 7f53977fe700 1 --2- 172.21.15.80:0/1607576796 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f538006aef0 0x7f538006d3b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5390000f80 tx=0x7f5390010040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:36.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.273+0000 7fcbb6ffd700 1 -- 172.21.15.80:0/1282490448 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fcbbc055880 con 0x7fcbc00c6af0 2024-05-08T21:10:36.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.273+0000 7f539df34700 1 -- 172.21.15.80:0/1607576796 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53780052f0 con 0x7f5398150410 2024-05-08T21:10:36.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.279+0000 7f537ffff700 1 -- 172.21.15.80:0/1607576796 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f5388053860 con 0x7f5398150410 2024-05-08T21:10:36.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.542+0000 7fc5ecdf6700 1 -- 172.21.15.80:0/3139221928 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc5e815b5b0 con 0x7fc5e80cbc00 2024-05-08T21:10:36.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.543+0000 7fc5d6ffd700 1 -- 172.21.15.80:0/3139221928 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc5e815b5b0 con 0x7fc5e80cbc00 2024-05-08T21:10:36.550 INFO:teuthology.orchestra.run.smithi080.stdout:60129542154 2024-05-08T21:10:36.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.547+0000 7fc5ecdf6700 1 -- 172.21.15.80:0/3139221928 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fc5c806ad60 msgr2=0x7fc5c806d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:36.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.547+0000 7fc5ecdf6700 1 --2- 172.21.15.80:0/3139221928 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fc5c806ad60 0x7fc5c806d220 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc009b90 tx=0x7fc5dc008030 comp rx=0 tx=0).stop 2024-05-08T21:10:36.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.547+0000 7fc5ecdf6700 1 -- 172.21.15.80:0/3139221928 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc5e80cbc00 msgr2=0x7fc5e813ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:36.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.547+0000 7fc5ecdf6700 1 --2- 172.21.15.80:0/3139221928 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc5e80cbc00 0x7fc5e813ce20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc5e000ca70 tx=0x7fc5e000cd80 comp rx=0 tx=0).stop 2024-05-08T21:10:36.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.548+0000 7fc5ecdf6700 1 -- 172.21.15.80:0/3139221928 shutdown_connections 2024-05-08T21:10:36.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.548+0000 7fc5ecdf6700 1 --2- 172.21.15.80:0/3139221928 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fc5c806ad60 0x7fc5c806d220 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.548+0000 7fc5ecdf6700 1 --2- 172.21.15.80:0/3139221928 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc5e80cbc00 0x7fc5e813ce20 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.548+0000 7fc5ecdf6700 1 --2- 172.21.15.80:0/3139221928 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc5e80c0ad0 0x7fc5e815a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.548+0000 7fc5ecdf6700 1 --2- 172.21.15.80:0/3139221928 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc5e80cb820 0x7fc5e81f7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.548+0000 7fc5ecdf6700 1 -- 172.21.15.80:0/3139221928 >> 172.21.15.80:0/3139221928 conn(0x7fc5e806a9c0 msgr2=0x7fc5e80c9400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:36.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.548+0000 7fc5ecdf6700 1 -- 172.21.15.80:0/3139221928 shutdown_connections 2024-05-08T21:10:36.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.548+0000 7fc5ecdf6700 1 -- 172.21.15.80:0/3139221928 wait complete. 2024-05-08T21:10:36.570 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.3 2024-05-08T21:10:36.570 DEBUG:teuthology.parallel:result is None 2024-05-08T21:10:36.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.576+0000 7f87dcdb0700 1 -- 172.21.15.80:0/140495573 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f87bc005870 con 0x7f87d80c8180 2024-05-08T21:10:36.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.576+0000 7f87c6ffd700 1 -- 172.21.15.80:0/140495573 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f87d005a200 con 0x7f87d80c8180 2024-05-08T21:10:36.581 INFO:teuthology.orchestra.run.smithi080.stdout:64424509450 2024-05-08T21:10:36.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.580+0000 7f87dcdb0700 1 -- 172.21.15.80:0/140495573 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f87b806ad60 msgr2=0x7f87b806d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:36.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.580+0000 7f87dcdb0700 1 --2- 172.21.15.80:0/140495573 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f87b806ad60 0x7f87b806d220 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f87c80013c0 tx=0x7f87c8001350 comp rx=0 tx=0).stop 2024-05-08T21:10:36.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.580+0000 7f87dcdb0700 1 -- 172.21.15.80:0/140495573 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f87d80c8180 msgr2=0x7f87d81574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:36.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.580+0000 7f87dcdb0700 1 --2- 172.21.15.80:0/140495573 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f87d80c8180 0x7f87d81574e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f87d0004560 tx=0x7f87d0004ad0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.580+0000 7f87dcdb0700 1 -- 172.21.15.80:0/140495573 shutdown_connections 2024-05-08T21:10:36.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.580+0000 7f87dcdb0700 1 --2- 172.21.15.80:0/140495573 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f87b806ad60 0x7f87b806d220 secure :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f87c80013c0 tx=0x7f87c8001350 comp rx=0 tx=0).stop 2024-05-08T21:10:36.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.580+0000 7f87dcdb0700 1 --2- 172.21.15.80:0/140495573 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f87d80c8180 0x7f87d81574e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.580+0000 7f87dcdb0700 1 --2- 172.21.15.80:0/140495573 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87d806b0d0 0x7f87d81623f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.580+0000 7f87dcdb0700 1 --2- 172.21.15.80:0/140495573 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f87d80c7420 0x7f87d81f8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.580+0000 7f87dcdb0700 1 -- 172.21.15.80:0/140495573 >> 172.21.15.80:0/140495573 conn(0x7f87d80c8980 msgr2=0x7f87d815dc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:36.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.580+0000 7f87dcdb0700 1 -- 172.21.15.80:0/140495573 shutdown_connections 2024-05-08T21:10:36.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.580+0000 7f87dcdb0700 1 -- 172.21.15.80:0/140495573 wait complete. 2024-05-08T21:10:36.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.585+0000 7f1d68830700 1 -- 172.21.15.80:0/1267815510 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f1d480055a0 con 0x7f1d640c8180 2024-05-08T21:10:36.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.585+0000 7f1d52ffd700 1 -- 172.21.15.80:0/1267815510 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1d5c057b50 con 0x7f1d640c8180 2024-05-08T21:10:36.590 INFO:teuthology.orchestra.run.smithi080.stdout:64424509450 2024-05-08T21:10:36.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.587+0000 7f8f3a471700 1 -- 172.21.15.80:0/2595151555 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f8f34138740 con 0x7f8f341626a0 2024-05-08T21:10:36.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.589+0000 7f1d68830700 1 -- 172.21.15.80:0/1267815510 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f1d4406ad60 msgr2=0x7f1d4406d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:36.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.589+0000 7f1d68830700 1 --2- 172.21.15.80:0/1267815510 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f1d4406ad60 0x7f1d4406d220 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1d58014040 tx=0x7f1d58008030 comp rx=0 tx=0).stop 2024-05-08T21:10:36.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.589+0000 7f1d68830700 1 -- 172.21.15.80:0/1267815510 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d640c8180 msgr2=0x7f1d641f4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:36.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.589+0000 7f1d68830700 1 --2- 172.21.15.80:0/1267815510 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d640c8180 0x7f1d641f4710 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c00cbf0 tx=0x7f1d5c00a060 comp rx=0 tx=0).stop 2024-05-08T21:10:36.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.589+0000 7f1d68830700 1 -- 172.21.15.80:0/1267815510 shutdown_connections 2024-05-08T21:10:36.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.589+0000 7f1d68830700 1 --2- 172.21.15.80:0/1267815510 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f1d4406ad60 0x7f1d4406d220 secure :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1d58014040 tx=0x7f1d58008030 comp rx=0 tx=0).stop 2024-05-08T21:10:36.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.589+0000 7f1d68830700 1 --2- 172.21.15.80:0/1267815510 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1d640c8180 0x7f1d641f4710 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.589+0000 7f1d68830700 1 --2- 172.21.15.80:0/1267815510 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1d640c7420 0x7f1d6415f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.589+0000 7f1d68830700 1 --2- 172.21.15.80:0/1267815510 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1d640c7800 0x7f1d64072250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.589+0000 7f1d68830700 1 -- 172.21.15.80:0/1267815510 >> 172.21.15.80:0/1267815510 conn(0x7f1d640c8980 msgr2=0x7f1d64071310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:36.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.589+0000 7f8f30ff9700 1 -- 172.21.15.80:0/2595151555 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8f24015020 con 0x7f8f341626a0 2024-05-08T21:10:36.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.590+0000 7f1d68830700 1 -- 172.21.15.80:0/1267815510 shutdown_connections 2024-05-08T21:10:36.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.590+0000 7f1d68830700 1 -- 172.21.15.80:0/1267815510 wait complete. 2024-05-08T21:10:36.596 INFO:teuthology.orchestra.run.smithi080.stdout:64424509450 2024-05-08T21:10:36.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.592+0000 7f25c622b700 1 -- 172.21.15.80:0/2552633982 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f25a0005870 con 0x7f25c00cb570 2024-05-08T21:10:36.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.593+0000 7f25a7fff700 1 -- 172.21.15.80:0/2552633982 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f25b8001c80 con 0x7f25c00cb570 2024-05-08T21:10:36.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.595+0000 7f8f3a471700 1 -- 172.21.15.80:0/2595151555 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f8f1c06ae40 msgr2=0x7f8f1c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:36.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.595+0000 7f8f3a471700 1 --2- 172.21.15.80:0/2595151555 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f8f1c06ae40 0x7f8f1c06d300 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c005c90 tx=0x7f8f2c009040 comp rx=0 tx=0).stop 2024-05-08T21:10:36.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.595+0000 7f8f3a471700 1 -- 172.21.15.80:0/2595151555 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8f341626a0 msgr2=0x7f8f340c9e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:36.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.595+0000 7f8f3a471700 1 --2- 172.21.15.80:0/2595151555 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8f341626a0 0x7f8f340c9e90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8f24016000 tx=0x7f8f24004750 comp rx=0 tx=0).stop 2024-05-08T21:10:36.599 INFO:teuthology.orchestra.run.smithi080.stdout:60129542155 2024-05-08T21:10:36.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.595+0000 7f8f3a471700 1 -- 172.21.15.80:0/2595151555 shutdown_connections 2024-05-08T21:10:36.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.595+0000 7f8f3a471700 1 --2- 172.21.15.80:0/2595151555 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f8f1c06ae40 0x7f8f1c06d300 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.595+0000 7f8f3a471700 1 --2- 172.21.15.80:0/2595151555 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8f340c6680 0x7f8f34070ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.595+0000 7f8f3a471700 1 --2- 172.21.15.80:0/2595151555 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8f341626a0 0x7f8f340c9e90 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.595+0000 7f8f3a471700 1 --2- 172.21.15.80:0/2595151555 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8f34158760 0x7f8f34138a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.595+0000 7f8f3a471700 1 -- 172.21.15.80:0/2595151555 >> 172.21.15.80:0/2595151555 conn(0x7f8f3406a9c0 msgr2=0x7f8f3406ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:36.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.596+0000 7f25c622b700 1 -- 172.21.15.80:0/2552633982 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f25ac06ad60 msgr2=0x7f25ac06d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:36.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.596+0000 7f25c622b700 1 --2- 172.21.15.80:0/2552633982 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f25ac06ad60 0x7f25ac06d220 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f25b4000c00 tx=0x7f25b4008030 comp rx=0 tx=0).stop 2024-05-08T21:10:36.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.596+0000 7f25c622b700 1 -- 172.21.15.80:0/2552633982 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25c00cb570 msgr2=0x7f25c015bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:36.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.596+0000 7f25c622b700 1 --2- 172.21.15.80:0/2552633982 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25c00cb570 0x7f25c015bdf0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f25b800cbf0 tx=0x7f25b800a060 comp rx=0 tx=0).stop 2024-05-08T21:10:36.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.596+0000 7f8f3a471700 1 -- 172.21.15.80:0/2595151555 shutdown_connections 2024-05-08T21:10:36.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.596+0000 7f8f3a471700 1 -- 172.21.15.80:0/2595151555 wait complete. 2024-05-08T21:10:36.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.596+0000 7f25c622b700 1 -- 172.21.15.80:0/2552633982 shutdown_connections 2024-05-08T21:10:36.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.596+0000 7f25c622b700 1 --2- 172.21.15.80:0/2552633982 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f25ac06ad60 0x7f25ac06d220 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.596+0000 7f25c622b700 1 --2- 172.21.15.80:0/2552633982 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25c016af60 0x7f25c015c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.596+0000 7f25c622b700 1 --2- 172.21.15.80:0/2552633982 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f25c00c2230 0x7f25c00730d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.596+0000 7f25c622b700 1 --2- 172.21.15.80:0/2552633982 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25c00cb570 0x7f25c015bdf0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.596+0000 7f25c622b700 1 -- 172.21.15.80:0/2552633982 >> 172.21.15.80:0/2552633982 conn(0x7f25c006a9c0 msgr2=0x7f25c015d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:36.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.597+0000 7f25c622b700 1 -- 172.21.15.80:0/2552633982 shutdown_connections 2024-05-08T21:10:36.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.597+0000 7f25c622b700 1 -- 172.21.15.80:0/2552633982 wait complete. 2024-05-08T21:10:36.603 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.1 2024-05-08T21:10:36.603 DEBUG:teuthology.parallel:result is None 2024-05-08T21:10:36.614 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.6 2024-05-08T21:10:36.614 DEBUG:teuthology.parallel:result is None 2024-05-08T21:10:36.616 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.4 2024-05-08T21:10:36.616 DEBUG:teuthology.parallel:result is None 2024-05-08T21:10:36.618 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542155 for osd.0 2024-05-08T21:10:36.618 DEBUG:teuthology.parallel:result is None 2024-05-08T21:10:36.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.638+0000 7f26ec7ad700 1 -- 172.21.15.80:0/415682818 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f26e40c8200 con 0x7f26e40c3640 2024-05-08T21:10:36.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.638+0000 7f26daffd700 1 -- 172.21.15.80:0/415682818 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f26e40c8200 con 0x7f26e40c3640 2024-05-08T21:10:36.642 INFO:teuthology.orchestra.run.smithi080.stdout:64424509451 2024-05-08T21:10:36.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.640+0000 7f26ec7ad700 1 -- 172.21.15.80:0/415682818 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f26c806acc0 msgr2=0x7f26c806d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:36.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.640+0000 7f26ec7ad700 1 --2- 172.21.15.80:0/415682818 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f26c806acc0 0x7f26c806d180 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f26e40c6f40 tx=0x7f26d4012000 comp rx=0 tx=0).stop 2024-05-08T21:10:36.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.641+0000 7f26ec7ad700 1 -- 172.21.15.80:0/415682818 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f26e40c3640 msgr2=0x7f26e4153730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:36.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.641+0000 7f26ec7ad700 1 --2- 172.21.15.80:0/415682818 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f26e40c3640 0x7f26e4153730 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f26e000c4d0 tx=0x7f26e000c7e0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.641+0000 7f26ec7ad700 1 -- 172.21.15.80:0/415682818 shutdown_connections 2024-05-08T21:10:36.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.641+0000 7f26ec7ad700 1 --2- 172.21.15.80:0/415682818 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f26c806acc0 0x7f26c806d180 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.641+0000 7f26ec7ad700 1 --2- 172.21.15.80:0/415682818 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f26e40c3640 0x7f26e4153730 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.641+0000 7f26ec7ad700 1 --2- 172.21.15.80:0/415682818 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26e4150410 0x7f26e41f5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.641+0000 7f26ec7ad700 1 --2- 172.21.15.80:0/415682818 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f26e40c6af0 0x7f26e4147310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.641+0000 7f26ec7ad700 1 -- 172.21.15.80:0/415682818 >> 172.21.15.80:0/415682818 conn(0x7f26e406a9c0 msgr2=0x7f26e41466e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:36.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.641+0000 7f26ec7ad700 1 -- 172.21.15.80:0/415682818 shutdown_connections 2024-05-08T21:10:36.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.641+0000 7f26ec7ad700 1 -- 172.21.15.80:0/415682818 wait complete. 2024-05-08T21:10:36.656 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509451 for osd.5 2024-05-08T21:10:36.656 DEBUG:teuthology.parallel:result is None 2024-05-08T21:10:36.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.660+0000 7fcbc87d2700 1 -- 172.21.15.80:0/1282490448 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcba80055a0 con 0x7fcbc00c6af0 2024-05-08T21:10:36.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.660+0000 7fcbb6ffd700 1 -- 172.21.15.80:0/1282490448 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcbbc058ea0 con 0x7fcbc00c6af0 2024-05-08T21:10:36.664 INFO:teuthology.orchestra.run.smithi080.stdout:55834574858 2024-05-08T21:10:36.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.662+0000 7fcbc87d2700 1 -- 172.21.15.80:0/1282490448 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fcba406ad90 msgr2=0x7fcba406d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:36.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.662+0000 7fcbc87d2700 1 --2- 172.21.15.80:0/1282490448 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fcba406ad90 0x7fcba406d250 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcbb0004960 tx=0x7fcbb0005c70 comp rx=0 tx=0).stop 2024-05-08T21:10:36.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.662+0000 7fcbc87d2700 1 -- 172.21.15.80:0/1282490448 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbc00c6af0 msgr2=0x7fcbc01f3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:36.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.662+0000 7fcbc87d2700 1 --2- 172.21.15.80:0/1282490448 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbc00c6af0 0x7fcbc01f3a50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc0097c0 tx=0x7fcbbc004750 comp rx=0 tx=0).stop 2024-05-08T21:10:36.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.662+0000 7fcbc87d2700 1 -- 172.21.15.80:0/1282490448 shutdown_connections 2024-05-08T21:10:36.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.662+0000 7fcbc87d2700 1 --2- 172.21.15.80:0/1282490448 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fcba406ad90 0x7fcba406d250 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.662+0000 7fcbc87d2700 1 --2- 172.21.15.80:0/1282490448 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcbc014db00 0x7fcbc01f3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.662+0000 7fcbc87d2700 1 --2- 172.21.15.80:0/1282490448 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcbc00c3640 0x7fcbc01e1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.662+0000 7fcbc87d2700 1 --2- 172.21.15.80:0/1282490448 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbc00c6af0 0x7fcbc01f3a50 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.662+0000 7fcbc87d2700 1 -- 172.21.15.80:0/1282490448 >> 172.21.15.80:0/1282490448 conn(0x7fcbc006a9c0 msgr2=0x7fcbc01e53d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:36.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.662+0000 7fcbc87d2700 1 -- 172.21.15.80:0/1282490448 shutdown_connections 2024-05-08T21:10:36.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.662+0000 7fcbc87d2700 1 -- 172.21.15.80:0/1282490448 wait complete. 2024-05-08T21:10:36.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.668+0000 7f539df34700 1 -- 172.21.15.80:0/1607576796 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f53780055a0 con 0x7f5398150410 2024-05-08T21:10:36.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.669+0000 7f537ffff700 1 -- 172.21.15.80:0/1607576796 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5388017070 con 0x7f5398150410 2024-05-08T21:10:36.672 INFO:teuthology.orchestra.run.smithi080.stdout:60129542154 2024-05-08T21:10:36.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.671+0000 7f539df34700 1 -- 172.21.15.80:0/1607576796 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f538006aef0 msgr2=0x7f538006d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:36.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.671+0000 7f539df34700 1 --2- 172.21.15.80:0/1607576796 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f538006aef0 0x7f538006d3b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5390000f80 tx=0x7f5390010040 comp rx=0 tx=0).stop 2024-05-08T21:10:36.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.671+0000 7f539df34700 1 -- 172.21.15.80:0/1607576796 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5398150410 msgr2=0x7f53981ff150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:36.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.671+0000 7f539df34700 1 --2- 172.21.15.80:0/1607576796 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5398150410 0x7f53981ff150 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f538800c4c0 tx=0x7f5388001e70 comp rx=0 tx=0).stop 2024-05-08T21:10:36.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.671+0000 7f539df34700 1 -- 172.21.15.80:0/1607576796 shutdown_connections 2024-05-08T21:10:36.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.671+0000 7f539df34700 1 --2- 172.21.15.80:0/1607576796 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f538006aef0 0x7f538006d3b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.671+0000 7f539df34700 1 --2- 172.21.15.80:0/1607576796 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5398150410 0x7f53981ff150 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.671+0000 7f539df34700 1 --2- 172.21.15.80:0/1607576796 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f53980c3640 0x7f53981ee680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.671+0000 7f539df34700 1 --2- 172.21.15.80:0/1607576796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53980c6af0 0x7f53981fcf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.676 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.671+0000 7f539df34700 1 -- 172.21.15.80:0/1607576796 >> 172.21.15.80:0/1607576796 conn(0x7f539806a9c0 msgr2=0x7f53980cb830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:36.676 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.672+0000 7f539df34700 1 -- 172.21.15.80:0/1607576796 shutdown_connections 2024-05-08T21:10:36.676 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.672+0000 7f539df34700 1 -- 172.21.15.80:0/1607576796 wait complete. 2024-05-08T21:10:36.678 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574858 for osd.2 2024-05-08T21:10:36.679 DEBUG:teuthology.parallel:result is None 2024-05-08T21:10:36.687 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.7 2024-05-08T21:10:36.687 DEBUG:teuthology.parallel:result is None 2024-05-08T21:10:36.687 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-08T21:10:36.687 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T21:10:36.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.845+0000 7f09821b1700 1 Processor -- start 2024-05-08T21:10:36.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.845+0000 7f09821b1700 1 -- start start 2024-05-08T21:10:36.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.846+0000 7f09821b1700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f097c1513f0 0x7f097c0c2340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:36.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.846+0000 7f09821b1700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f097c0c85a0 0x7f097c0c0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:36.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.846+0000 7f09821b1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f097c070b00 0x7f097c072cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:36.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.846+0000 7f09821b1700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f097c070f90 con 0x7f097c070b00 2024-05-08T21:10:36.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.846+0000 7f09821b1700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f097c0c1560 con 0x7f097c1513f0 2024-05-08T21:10:36.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.846+0000 7f09821b1700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f097c072500 con 0x7f097c0c85a0 2024-05-08T21:10:36.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.846+0000 7f097bfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f097c070b00 0x7f097c072cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:36.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.846+0000 7f097bfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f097c070b00 0x7f097c072cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42720/0 (socket says 172.21.15.80:42720) 2024-05-08T21:10:36.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.846+0000 7f097bfff700 1 -- 172.21.15.80:0/1904897759 learned_addr learned my addr 172.21.15.80:0/1904897759 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:36.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.846+0000 7f097b7fe700 1 --2- 172.21.15.80:0/1904897759 >> v2:172.21.15.106:3300/0 conn(0x7f097c1513f0 0x7f097c0c2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:36.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.846+0000 7f097affd700 1 --2- 172.21.15.80:0/1904897759 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f097c0c85a0 0x7f097c0c0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:36.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.846+0000 7f097bfff700 1 -- 172.21.15.80:0/1904897759 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f097c0c85a0 msgr2=0x7f097c0c0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:36.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.846+0000 7f097bfff700 1 --2- 172.21.15.80:0/1904897759 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f097c0c85a0 0x7f097c0c0ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.846+0000 7f097bfff700 1 -- 172.21.15.80:0/1904897759 >> v2:172.21.15.106:3300/0 conn(0x7f097c1513f0 msgr2=0x7f097c0c2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:36.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.846+0000 7f097bfff700 1 --2- 172.21.15.80:0/1904897759 >> v2:172.21.15.106:3300/0 conn(0x7f097c1513f0 0x7f097c0c2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.846+0000 7f097bfff700 1 -- 172.21.15.80:0/1904897759 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f097c0c1800 con 0x7f097c070b00 2024-05-08T21:10:36.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.846+0000 7f097b7fe700 1 --2- 172.21.15.80:0/1904897759 >> v2:172.21.15.106:3300/0 conn(0x7f097c1513f0 0x7f097c0c2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:10:36.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.846+0000 7f097affd700 1 --2- 172.21.15.80:0/1904897759 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f097c0c85a0 0x7f097c0c0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:10:36.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.846+0000 7f097bfff700 1 --2- 172.21.15.80:0/1904897759 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f097c070b00 0x7f097c072cc0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f097c066bf0 tx=0x7f097400d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9246d5ca07e28bfa server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:36.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.846+0000 7f097a7fc700 1 -- 172.21.15.80:0/1904897759 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0974010070 con 0x7f097c070b00 2024-05-08T21:10:36.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.846+0000 7f097a7fc700 1 -- 172.21.15.80:0/1904897759 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f097400dd90 con 0x7f097c070b00 2024-05-08T21:10:36.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.846+0000 7f097a7fc700 1 -- 172.21.15.80:0/1904897759 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097400b310 con 0x7f097c070b00 2024-05-08T21:10:36.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.847+0000 7f09821b1700 1 -- 172.21.15.80:0/1904897759 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f097c070b00 msgr2=0x7f097c072cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:36.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.847+0000 7f09821b1700 1 --2- 172.21.15.80:0/1904897759 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f097c070b00 0x7f097c072cc0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f097c066bf0 tx=0x7f097400d430 comp rx=0 tx=0).stop 2024-05-08T21:10:36.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.847+0000 7f09821b1700 1 -- 172.21.15.80:0/1904897759 shutdown_connections 2024-05-08T21:10:36.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.847+0000 7f09821b1700 1 --2- 172.21.15.80:0/1904897759 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f097c070b00 0x7f097c072cc0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.847+0000 7f09821b1700 1 --2- 172.21.15.80:0/1904897759 >> v2:172.21.15.106:3300/0 conn(0x7f097c1513f0 0x7f097c0c2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.847+0000 7f09821b1700 1 --2- 172.21.15.80:0/1904897759 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f097c0c85a0 0x7f097c0c0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.847+0000 7f09821b1700 1 -- 172.21.15.80:0/1904897759 >> 172.21.15.80:0/1904897759 conn(0x7f097c0c8980 msgr2=0x7f097c0c8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:36.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.847+0000 7f09821b1700 1 -- 172.21.15.80:0/1904897759 shutdown_connections 2024-05-08T21:10:36.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.847+0000 7f09821b1700 1 -- 172.21.15.80:0/1904897759 wait complete. 2024-05-08T21:10:36.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.848+0000 7f09821b1700 1 Processor -- start 2024-05-08T21:10:36.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.848+0000 7f09821b1700 1 -- start start 2024-05-08T21:10:36.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.849+0000 7f09821b1700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f097c070b00 0x7f097c151aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:36.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.849+0000 7f09821b1700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f097c0c85a0 0x7f097c0cac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:36.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.849+0000 7f09821b1700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f097c1513f0 0x7f097c0cb190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:36.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.849+0000 7f09821b1700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f097c152860 con 0x7f097c0c85a0 2024-05-08T21:10:36.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.849+0000 7f09821b1700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f097c0c9c80 con 0x7f097c1513f0 2024-05-08T21:10:36.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.849+0000 7f09821b1700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f097c0ca7c0 con 0x7f097c070b00 2024-05-08T21:10:36.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.849+0000 7f097affd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f097c0c85a0 0x7f097c0cac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:36.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.849+0000 7f097affd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f097c0c85a0 0x7f097c0cac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42736/0 (socket says 172.21.15.80:42736) 2024-05-08T21:10:36.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.849+0000 7f097affd700 1 -- 172.21.15.80:0/1296461491 learned_addr learned my addr 172.21.15.80:0/1296461491 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:36.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.849+0000 7f097affd700 1 -- 172.21.15.80:0/1296461491 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f097c070b00 msgr2=0x7f097c151aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:36.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.849+0000 7f097affd700 1 --2- 172.21.15.80:0/1296461491 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f097c070b00 0x7f097c151aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.849+0000 7f097bfff700 1 --2- 172.21.15.80:0/1296461491 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f097c1513f0 0x7f097c0cb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:36.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.849+0000 7f097affd700 1 -- 172.21.15.80:0/1296461491 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f097c1513f0 msgr2=0x7f097c0cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:36.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.849+0000 7f097affd700 1 --2- 172.21.15.80:0/1296461491 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f097c1513f0 0x7f097c0cb190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:36.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.849+0000 7f097affd700 1 -- 172.21.15.80:0/1296461491 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f097400bd40 con 0x7f097c0c85a0 2024-05-08T21:10:36.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.849+0000 7f097affd700 1 --2- 172.21.15.80:0/1296461491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f097c0c85a0 0x7f097c0cac50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f096400c740 tx=0x7f096400cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:36.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.850+0000 7f0973fff700 1 -- 172.21.15.80:0/1296461491 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0964011800 con 0x7f097c0c85a0 2024-05-08T21:10:36.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.850+0000 7f0973fff700 1 -- 172.21.15.80:0/1296461491 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0964011960 con 0x7f097c0c85a0 2024-05-08T21:10:36.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.850+0000 7f09821b1700 1 -- 172.21.15.80:0/1296461491 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f097c1533d0 con 0x7f097c0c85a0 2024-05-08T21:10:36.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.850+0000 7f0973fff700 1 -- 172.21.15.80:0/1296461491 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0964011cd0 con 0x7f097c0c85a0 2024-05-08T21:10:36.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.850+0000 7f09821b1700 1 -- 172.21.15.80:0/1296461491 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f097c0c9e90 con 0x7f097c0c85a0 2024-05-08T21:10:36.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.850+0000 7f09821b1700 1 -- 172.21.15.80:0/1296461491 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f097c0caaa0 con 0x7f097c0c85a0 2024-05-08T21:10:36.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.851+0000 7f0973fff700 1 -- 172.21.15.80:0/1296461491 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0964021350 con 0x7f097c0c85a0 2024-05-08T21:10:36.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.851+0000 7f0973fff700 1 --2- 172.21.15.80:0/1296461491 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f095c06ac90 0x7f095c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:36.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.852+0000 7f0973fff700 1 -- 172.21.15.80:0/1296461491 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0964089500 con 0x7f097c0c85a0 2024-05-08T21:10:36.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.852+0000 7f097b7fe700 1 --2- 172.21.15.80:0/1296461491 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f095c06ac90 0x7f095c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:36.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.852+0000 7f097b7fe700 1 --2- 172.21.15.80:0/1296461491 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f095c06ac90 0x7f095c06d150 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f096c007920 tx=0x7f096c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:36.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:36.856+0000 7f0973fff700 1 -- 172.21.15.80:0/1296461491 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f0964054400 con 0x7f097c0c85a0 2024-05-08T21:10:37.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.046+0000 7f09821b1700 1 -- 172.21.15.80:0/1296461491 --> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f097c0ca930 con 0x7f095c06ac90 2024-05-08T21:10:37.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.054+0000 7f0973fff700 1 -- 172.21.15.80:0/1296461491 <== mgr.4100 v2:172.21.15.80:6832/46731 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345350 (secure 0 0 0) 0x7f097c0ca930 con 0x7f095c06ac90 2024-05-08T21:10:37.062 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:10:37.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.058+0000 7f09821b1700 1 -- 172.21.15.80:0/1296461491 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f095c06ac90 msgr2=0x7f095c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:37.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.058+0000 7f09821b1700 1 --2- 172.21.15.80:0/1296461491 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f095c06ac90 0x7f095c06d150 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f096c007920 tx=0x7f096c008040 comp rx=0 tx=0).stop 2024-05-08T21:10:37.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.058+0000 7f09821b1700 1 -- 172.21.15.80:0/1296461491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f097c0c85a0 msgr2=0x7f097c0cac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:37.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.058+0000 7f09821b1700 1 --2- 172.21.15.80:0/1296461491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f097c0c85a0 0x7f097c0cac50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f096400c740 tx=0x7f096400cb00 comp rx=0 tx=0).stop 2024-05-08T21:10:37.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.058+0000 7f09821b1700 1 -- 172.21.15.80:0/1296461491 shutdown_connections 2024-05-08T21:10:37.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.058+0000 7f09821b1700 1 --2- 172.21.15.80:0/1296461491 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f095c06ac90 0x7f095c06d150 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:37.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.058+0000 7f09821b1700 1 --2- 172.21.15.80:0/1296461491 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f097c1513f0 0x7f097c0cb190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:37.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.058+0000 7f09821b1700 1 --2- 172.21.15.80:0/1296461491 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f097c070b00 0x7f097c151aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:37.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.058+0000 7f09821b1700 1 --2- 172.21.15.80:0/1296461491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f097c0c85a0 0x7f097c0cac50 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:37.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.058+0000 7f09821b1700 1 -- 172.21.15.80:0/1296461491 >> 172.21.15.80:0/1296461491 conn(0x7f097c0c8980 msgr2=0x7f097c072b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:37.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.058+0000 7f09821b1700 1 -- 172.21.15.80:0/1296461491 shutdown_connections 2024-05-08T21:10:37.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.058+0000 7f09821b1700 1 -- 172.21.15.80:0/1296461491 wait complete. 2024-05-08T21:10:37.066 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-05-08T21:10:37.074 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2024-05-08T21:10:36.205596+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594962,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218452,"kb_used_data":2304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756268,"statfs":{"total":773094113280,"available":772870418432,"internally_reserved":0,"allocated":2359296,"data_stored":2039860,"data_compressed":64612,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003239"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.048091+0000","last_change":"2024-05-08T21:10:03.747477+0000","last_active":"2024-05-08T21:10:08.048091+0000","last_peered":"2024-05-08T21:10:08.048091+0000","last_clean":"2024-05-08T21:10:08.048091+0000","last_became_active":"2024-05-08T21:10:03.747059+0000","last_became_peered":"2024-05-08T21:10:03.747059+0000","last_unstale":"2024-05-08T21:10:08.048091+0000","last_undegraded":"2024-05-08T21:10:08.048091+0000","last_fullsized":"2024-05-08T21:10:08.048091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:15:24.340135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.187600+0000","last_change":"2024-05-08T21:10:03.738974+0000","last_active":"2024-05-08T21:10:08.187600+0000","last_peered":"2024-05-08T21:10:08.187600+0000","last_clean":"2024-05-08T21:10:08.187600+0000","last_became_active":"2024-05-08T21:10:03.738466+0000","last_became_peered":"2024-05-08T21:10:03.738466+0000","last_unstale":"2024-05-08T21:10:08.187600+0000","last_undegraded":"2024-05-08T21:10:08.187600+0000","last_fullsized":"2024-05-08T21:10:08.187600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:59.683039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.753636+0000","last_change":"2024-05-08T21:10:03.740146+0000","last_active":"2024-05-08T21:10:07.753636+0000","last_peered":"2024-05-08T21:10:07.753636+0000","last_clean":"2024-05-08T21:10:07.753636+0000","last_became_active":"2024-05-08T21:10:03.739884+0000","last_became_peered":"2024-05-08T21:10:03.739884+0000","last_unstale":"2024-05-08T21:10:07.753636+0000","last_undegraded":"2024-05-08T21:10:07.753636+0000","last_fullsized":"2024-05-08T21:10:07.753636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:51:44.301305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.168400+0000","last_change":"2024-05-08T21:10:03.754159+0000","last_active":"2024-05-08T21:10:08.168400+0000","last_peered":"2024-05-08T21:10:08.168400+0000","last_clean":"2024-05-08T21:10:08.168400+0000","last_became_active":"2024-05-08T21:10:03.753800+0000","last_became_peered":"2024-05-08T21:10:03.753800+0000","last_unstale":"2024-05-08T21:10:08.168400+0000","last_undegraded":"2024-05-08T21:10:08.168400+0000","last_fullsized":"2024-05-08T21:10:08.168400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:41:02.625080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046322+0000","last_change":"2024-05-08T21:10:03.750051+0000","last_active":"2024-05-08T21:10:08.046322+0000","last_peered":"2024-05-08T21:10:08.046322+0000","last_clean":"2024-05-08T21:10:08.046322+0000","last_became_active":"2024-05-08T21:10:03.749730+0000","last_became_peered":"2024-05-08T21:10:03.749730+0000","last_unstale":"2024-05-08T21:10:08.046322+0000","last_undegraded":"2024-05-08T21:10:08.046322+0000","last_fullsized":"2024-05-08T21:10:08.046322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:49.402253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.168597+0000","last_change":"2024-05-08T21:10:03.746043+0000","last_active":"2024-05-08T21:10:08.168597+0000","last_peered":"2024-05-08T21:10:08.168597+0000","last_clean":"2024-05-08T21:10:08.168597+0000","last_became_active":"2024-05-08T21:10:03.745747+0000","last_became_peered":"2024-05-08T21:10:03.745747+0000","last_unstale":"2024-05-08T21:10:08.168597+0000","last_undegraded":"2024-05-08T21:10:08.168597+0000","last_fullsized":"2024-05-08T21:10:08.168597+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:05:49.465405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046256+0000","last_change":"2024-05-08T21:10:03.743802+0000","last_active":"2024-05-08T21:10:08.046256+0000","last_peered":"2024-05-08T21:10:08.046256+0000","last_clean":"2024-05-08T21:10:08.046256+0000","last_became_active":"2024-05-08T21:10:03.743349+0000","last_became_peered":"2024-05-08T21:10:03.743349+0000","last_unstale":"2024-05-08T21:10:08.046256+0000","last_undegraded":"2024-05-08T21:10:08.046256+0000","last_fullsized":"2024-05-08T21:10:08.046256+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:08:06.408724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.757451+0000","last_change":"2024-05-08T21:10:03.747558+0000","last_active":"2024-05-08T21:10:07.757451+0000","last_peered":"2024-05-08T21:10:07.757451+0000","last_clean":"2024-05-08T21:10:07.757451+0000","last_became_active":"2024-05-08T21:10:03.747300+0000","last_became_peered":"2024-05-08T21:10:03.747300+0000","last_unstale":"2024-05-08T21:10:07.757451+0000","last_undegraded":"2024-05-08T21:10:07.757451+0000","last_fullsized":"2024-05-08T21:10:07.757451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:07:50.266894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046942+0000","last_change":"2024-05-08T21:10:03.748221+0000","last_active":"2024-05-08T21:10:08.046942+0000","last_peered":"2024-05-08T21:10:08.046942+0000","last_clean":"2024-05-08T21:10:08.046942+0000","last_became_active":"2024-05-08T21:10:03.747956+0000","last_became_peered":"2024-05-08T21:10:03.747956+0000","last_unstale":"2024-05-08T21:10:08.046942+0000","last_undegraded":"2024-05-08T21:10:08.046942+0000","last_fullsized":"2024-05-08T21:10:08.046942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:27:35.947884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.271333+0000","last_change":"2024-05-08T21:10:03.745291+0000","last_active":"2024-05-08T21:10:08.271333+0000","last_peered":"2024-05-08T21:10:08.271333+0000","last_clean":"2024-05-08T21:10:08.271333+0000","last_became_active":"2024-05-08T21:10:03.744976+0000","last_became_peered":"2024-05-08T21:10:03.744976+0000","last_unstale":"2024-05-08T21:10:08.271333+0000","last_undegraded":"2024-05-08T21:10:08.271333+0000","last_fullsized":"2024-05-08T21:10:08.271333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:36:54.983642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.271323+0000","last_change":"2024-05-08T21:10:03.748518+0000","last_active":"2024-05-08T21:10:08.271323+0000","last_peered":"2024-05-08T21:10:08.271323+0000","last_clean":"2024-05-08T21:10:08.271323+0000","last_became_active":"2024-05-08T21:10:03.748253+0000","last_became_peered":"2024-05-08T21:10:03.748253+0000","last_unstale":"2024-05-08T21:10:08.271323+0000","last_undegraded":"2024-05-08T21:10:08.271323+0000","last_fullsized":"2024-05-08T21:10:08.271323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:03:26.013122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.170038+0000","last_change":"2024-05-08T21:10:03.745985+0000","last_active":"2024-05-08T21:10:08.170038+0000","last_peered":"2024-05-08T21:10:08.170038+0000","last_clean":"2024-05-08T21:10:08.170038+0000","last_became_active":"2024-05-08T21:10:03.745247+0000","last_became_peered":"2024-05-08T21:10:03.745247+0000","last_unstale":"2024-05-08T21:10:08.170038+0000","last_undegraded":"2024-05-08T21:10:08.170038+0000","last_fullsized":"2024-05-08T21:10:08.170038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:59:42.506304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.761196+0000","last_change":"2024-05-08T21:10:03.747016+0000","last_active":"2024-05-08T21:10:07.761196+0000","last_peered":"2024-05-08T21:10:07.761196+0000","last_clean":"2024-05-08T21:10:07.761196+0000","last_became_active":"2024-05-08T21:10:03.746848+0000","last_became_peered":"2024-05-08T21:10:03.746848+0000","last_unstale":"2024-05-08T21:10:07.761196+0000","last_undegraded":"2024-05-08T21:10:07.761196+0000","last_fullsized":"2024-05-08T21:10:07.761196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:41:21.081035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.753493+0000","last_change":"2024-05-08T21:10:03.737984+0000","last_active":"2024-05-08T21:10:07.753493+0000","last_peered":"2024-05-08T21:10:07.753493+0000","last_clean":"2024-05-08T21:10:07.753493+0000","last_became_active":"2024-05-08T21:10:03.737716+0000","last_became_peered":"2024-05-08T21:10:03.737716+0000","last_unstale":"2024-05-08T21:10:07.753493+0000","last_undegraded":"2024-05-08T21:10:07.753493+0000","last_fullsized":"2024-05-08T21:10:07.753493+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:09:47.758272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.186816+0000","last_change":"2024-05-08T21:10:03.744543+0000","last_active":"2024-05-08T21:10:08.186816+0000","last_peered":"2024-05-08T21:10:08.186816+0000","last_clean":"2024-05-08T21:10:08.186816+0000","last_became_active":"2024-05-08T21:10:03.744276+0000","last_became_peered":"2024-05-08T21:10:03.744276+0000","last_unstale":"2024-05-08T21:10:08.186816+0000","last_undegraded":"2024-05-08T21:10:08.186816+0000","last_fullsized":"2024-05-08T21:10:08.186816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:25:04.113297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.167751+0000","last_change":"2024-05-08T21:10:03.746547+0000","last_active":"2024-05-08T21:10:08.167751+0000","last_peered":"2024-05-08T21:10:08.167751+0000","last_clean":"2024-05-08T21:10:08.167751+0000","last_became_active":"2024-05-08T21:10:03.745862+0000","last_became_peered":"2024-05-08T21:10:03.745862+0000","last_unstale":"2024-05-08T21:10:08.167751+0000","last_undegraded":"2024-05-08T21:10:08.167751+0000","last_fullsized":"2024-05-08T21:10:08.167751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:12.776310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169108+0000","last_change":"2024-05-08T21:10:03.754230+0000","last_active":"2024-05-08T21:10:08.169108+0000","last_peered":"2024-05-08T21:10:08.169108+0000","last_clean":"2024-05-08T21:10:08.169108+0000","last_became_active":"2024-05-08T21:10:03.753895+0000","last_became_peered":"2024-05-08T21:10:03.753895+0000","last_unstale":"2024-05-08T21:10:08.169108+0000","last_undegraded":"2024-05-08T21:10:08.169108+0000","last_fullsized":"2024-05-08T21:10:08.169108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:41:47.214215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.751781+0000","last_change":"2024-05-08T21:10:03.743889+0000","last_active":"2024-05-08T21:10:07.751781+0000","last_peered":"2024-05-08T21:10:07.751781+0000","last_clean":"2024-05-08T21:10:07.751781+0000","last_became_active":"2024-05-08T21:10:03.743596+0000","last_became_peered":"2024-05-08T21:10:03.743596+0000","last_unstale":"2024-05-08T21:10:07.751781+0000","last_undegraded":"2024-05-08T21:10:07.751781+0000","last_fullsized":"2024-05-08T21:10:07.751781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:53.981781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046658+0000","last_change":"2024-05-08T21:10:03.743893+0000","last_active":"2024-05-08T21:10:08.046658+0000","last_peered":"2024-05-08T21:10:08.046658+0000","last_clean":"2024-05-08T21:10:08.046658+0000","last_became_active":"2024-05-08T21:10:03.743580+0000","last_became_peered":"2024-05-08T21:10:03.743580+0000","last_unstale":"2024-05-08T21:10:08.046658+0000","last_undegraded":"2024-05-08T21:10:08.046658+0000","last_fullsized":"2024-05-08T21:10:08.046658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:44:21.747625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.059425+0000","last_change":"2024-05-08T21:10:08.052394+0000","last_active":"2024-05-08T21:10:08.059425+0000","last_peered":"2024-05-08T21:10:08.059425+0000","last_clean":"2024-05-08T21:10:08.059425+0000","last_became_active":"2024-05-08T21:10:08.052009+0000","last_became_peered":"2024-05-08T21:10:08.052009+0000","last_unstale":"2024-05-08T21:10:08.059425+0000","last_undegraded":"2024-05-08T21:10:08.059425+0000","last_fullsized":"2024-05-08T21:10:08.059425+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:47:20.148683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"25'4","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.741230+0000","last_change":"2024-05-08T21:10:03.340118+0000","last_active":"2024-05-08T21:10:08.741230+0000","last_peered":"2024-05-08T21:10:08.741230+0000","last_clean":"2024-05-08T21:10:08.741230+0000","last_became_active":"2024-05-08T21:10:03.339847+0000","last_became_peered":"2024-05-08T21:10:03.339847+0000","last_unstale":"2024-05-08T21:10:08.741230+0000","last_undegraded":"2024-05-08T21:10:08.741230+0000","last_fullsized":"2024-05-08T21:10:08.741230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:05:56.369631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.768418+0000","last_change":"2024-05-08T21:10:03.746516+0000","last_active":"2024-05-08T21:10:07.768418+0000","last_peered":"2024-05-08T21:10:07.768418+0000","last_clean":"2024-05-08T21:10:07.768418+0000","last_became_active":"2024-05-08T21:10:03.746383+0000","last_became_peered":"2024-05-08T21:10:03.746383+0000","last_unstale":"2024-05-08T21:10:07.768418+0000","last_undegraded":"2024-05-08T21:10:07.768418+0000","last_fullsized":"2024-05-08T21:10:07.768418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:29:05.305134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169483+0000","last_change":"2024-05-08T21:10:07.766498+0000","last_active":"2024-05-08T21:10:08.169483+0000","last_peered":"2024-05-08T21:10:08.169483+0000","last_clean":"2024-05-08T21:10:08.169483+0000","last_became_active":"2024-05-08T21:10:07.766119+0000","last_became_peered":"2024-05-08T21:10:07.766119+0000","last_unstale":"2024-05-08T21:10:08.169483+0000","last_undegraded":"2024-05-08T21:10:08.169483+0000","last_fullsized":"2024-05-08T21:10:08.169483+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:58:38.720848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"26'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.508429+0000","last_change":"2024-05-08T21:10:03.329414+0000","last_active":"2024-05-08T21:10:08.508429+0000","last_peered":"2024-05-08T21:10:08.508429+0000","last_clean":"2024-05-08T21:10:08.508429+0000","last_became_active":"2024-05-08T21:10:03.328970+0000","last_became_peered":"2024-05-08T21:10:03.328970+0000","last_unstale":"2024-05-08T21:10:08.508429+0000","last_undegraded":"2024-05-08T21:10:08.508429+0000","last_fullsized":"2024-05-08T21:10:08.508429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:34:32.820755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.753820+0000","last_change":"2024-05-08T21:10:03.748566+0000","last_active":"2024-05-08T21:10:07.753820+0000","last_peered":"2024-05-08T21:10:07.753820+0000","last_clean":"2024-05-08T21:10:07.753820+0000","last_became_active":"2024-05-08T21:10:03.747989+0000","last_became_peered":"2024-05-08T21:10:03.747989+0000","last_unstale":"2024-05-08T21:10:07.753820+0000","last_undegraded":"2024-05-08T21:10:07.753820+0000","last_fullsized":"2024-05-08T21:10:07.753820+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:19:03.468394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169607+0000","last_change":"2024-05-08T21:10:07.770390+0000","last_active":"2024-05-08T21:10:08.169607+0000","last_peered":"2024-05-08T21:10:08.169607+0000","last_clean":"2024-05-08T21:10:08.169607+0000","last_became_active":"2024-05-08T21:10:07.770017+0000","last_became_peered":"2024-05-08T21:10:07.770017+0000","last_unstale":"2024-05-08T21:10:08.169607+0000","last_undegraded":"2024-05-08T21:10:08.169607+0000","last_fullsized":"2024-05-08T21:10:08.169607+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:12:00.200848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.738243+0000","last_change":"2024-05-08T21:10:03.339207+0000","last_active":"2024-05-08T21:10:08.738243+0000","last_peered":"2024-05-08T21:10:08.738243+0000","last_clean":"2024-05-08T21:10:08.738243+0000","last_became_active":"2024-05-08T21:10:03.338917+0000","last_became_peered":"2024-05-08T21:10:03.338917+0000","last_unstale":"2024-05-08T21:10:08.738243+0000","last_undegraded":"2024-05-08T21:10:08.738243+0000","last_fullsized":"2024-05-08T21:10:08.738243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:20.676853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.168481+0000","last_change":"2024-05-08T21:10:03.753998+0000","last_active":"2024-05-08T21:10:08.168481+0000","last_peered":"2024-05-08T21:10:08.168481+0000","last_clean":"2024-05-08T21:10:08.168481+0000","last_became_active":"2024-05-08T21:10:03.753720+0000","last_became_peered":"2024-05-08T21:10:03.753720+0000","last_unstale":"2024-05-08T21:10:08.168481+0000","last_undegraded":"2024-05-08T21:10:08.168481+0000","last_fullsized":"2024-05-08T21:10:08.168481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:00:38.531282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169599+0000","last_change":"2024-05-08T21:10:07.776367+0000","last_active":"2024-05-08T21:10:08.169599+0000","last_peered":"2024-05-08T21:10:08.169599+0000","last_clean":"2024-05-08T21:10:08.169599+0000","last_became_active":"2024-05-08T21:10:07.775998+0000","last_became_peered":"2024-05-08T21:10:07.775998+0000","last_unstale":"2024-05-08T21:10:08.169599+0000","last_undegraded":"2024-05-08T21:10:08.169599+0000","last_fullsized":"2024-05-08T21:10:08.169599+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:24:18.845560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.740209+0000","last_change":"2024-05-08T21:10:03.339182+0000","last_active":"2024-05-08T21:10:08.740209+0000","last_peered":"2024-05-08T21:10:08.740209+0000","last_clean":"2024-05-08T21:10:08.740209+0000","last_became_active":"2024-05-08T21:10:03.338899+0000","last_became_peered":"2024-05-08T21:10:03.338899+0000","last_unstale":"2024-05-08T21:10:08.740209+0000","last_undegraded":"2024-05-08T21:10:08.740209+0000","last_fullsized":"2024-05-08T21:10:08.740209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:55:53.368546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.168672+0000","last_change":"2024-05-08T21:10:03.750724+0000","last_active":"2024-05-08T21:10:08.168672+0000","last_peered":"2024-05-08T21:10:08.168672+0000","last_clean":"2024-05-08T21:10:08.168672+0000","last_became_active":"2024-05-08T21:10:03.750371+0000","last_became_peered":"2024-05-08T21:10:03.750371+0000","last_unstale":"2024-05-08T21:10:08.168672+0000","last_undegraded":"2024-05-08T21:10:08.168672+0000","last_fullsized":"2024-05-08T21:10:08.168672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:14:01.935211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.775704+0000","last_change":"2024-05-08T21:10:07.767604+0000","last_active":"2024-05-08T21:10:07.775704+0000","last_peered":"2024-05-08T21:10:07.775704+0000","last_clean":"2024-05-08T21:10:07.775704+0000","last_became_active":"2024-05-08T21:10:07.767234+0000","last_became_peered":"2024-05-08T21:10:07.767234+0000","last_unstale":"2024-05-08T21:10:07.775704+0000","last_undegraded":"2024-05-08T21:10:07.775704+0000","last_fullsized":"2024-05-08T21:10:07.775704+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:30:21.411491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"26'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.508102+0000","last_change":"2024-05-08T21:10:03.338149+0000","last_active":"2024-05-08T21:10:08.508102+0000","last_peered":"2024-05-08T21:10:08.508102+0000","last_clean":"2024-05-08T21:10:08.508102+0000","last_became_active":"2024-05-08T21:10:03.337860+0000","last_became_peered":"2024-05-08T21:10:03.337860+0000","last_unstale":"2024-05-08T21:10:08.508102+0000","last_undegraded":"2024-05-08T21:10:08.508102+0000","last_fullsized":"2024-05-08T21:10:08.508102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:07:39.052625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169664+0000","last_change":"2024-05-08T21:10:03.743506+0000","last_active":"2024-05-08T21:10:08.169664+0000","last_peered":"2024-05-08T21:10:08.169664+0000","last_clean":"2024-05-08T21:10:08.169664+0000","last_became_active":"2024-05-08T21:10:03.743227+0000","last_became_peered":"2024-05-08T21:10:03.743227+0000","last_unstale":"2024-05-08T21:10:08.169664+0000","last_undegraded":"2024-05-08T21:10:08.169664+0000","last_fullsized":"2024-05-08T21:10:08.169664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:45:47.977619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.741849+0000","last_change":"2024-05-08T21:10:07.768424+0000","last_active":"2024-05-08T21:10:08.741849+0000","last_peered":"2024-05-08T21:10:08.741849+0000","last_clean":"2024-05-08T21:10:08.741849+0000","last_became_active":"2024-05-08T21:10:07.768160+0000","last_became_peered":"2024-05-08T21:10:07.768160+0000","last_unstale":"2024-05-08T21:10:08.741849+0000","last_undegraded":"2024-05-08T21:10:08.741849+0000","last_fullsized":"2024-05-08T21:10:08.741849+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:42:44.327080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"26'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.606664+0000","last_change":"2024-05-08T21:10:03.333647+0000","last_active":"2024-05-08T21:10:08.606664+0000","last_peered":"2024-05-08T21:10:08.606664+0000","last_clean":"2024-05-08T21:10:08.606664+0000","last_became_active":"2024-05-08T21:10:03.332844+0000","last_became_peered":"2024-05-08T21:10:03.332844+0000","last_unstale":"2024-05-08T21:10:08.606664+0000","last_undegraded":"2024-05-08T21:10:08.606664+0000","last_fullsized":"2024-05-08T21:10:08.606664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:47:40.344808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.753370+0000","last_change":"2024-05-08T21:10:03.743003+0000","last_active":"2024-05-08T21:10:07.753370+0000","last_peered":"2024-05-08T21:10:07.753370+0000","last_clean":"2024-05-08T21:10:07.753370+0000","last_became_active":"2024-05-08T21:10:03.742753+0000","last_became_peered":"2024-05-08T21:10:03.742753+0000","last_unstale":"2024-05-08T21:10:07.753370+0000","last_undegraded":"2024-05-08T21:10:07.753370+0000","last_fullsized":"2024-05-08T21:10:07.753370+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:45:49.575877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.271366+0000","last_change":"2024-05-08T21:10:07.770105+0000","last_active":"2024-05-08T21:10:08.271366+0000","last_peered":"2024-05-08T21:10:08.271366+0000","last_clean":"2024-05-08T21:10:08.271366+0000","last_became_active":"2024-05-08T21:10:07.769668+0000","last_became_peered":"2024-05-08T21:10:07.769668+0000","last_unstale":"2024-05-08T21:10:08.271366+0000","last_undegraded":"2024-05-08T21:10:08.271366+0000","last_fullsized":"2024-05-08T21:10:08.271366+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:07:21.560031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.766792+0000","last_change":"2024-05-08T21:10:03.333025+0000","last_active":"2024-05-08T21:10:07.766792+0000","last_peered":"2024-05-08T21:10:07.766792+0000","last_clean":"2024-05-08T21:10:07.766792+0000","last_became_active":"2024-05-08T21:10:03.332750+0000","last_became_peered":"2024-05-08T21:10:03.332750+0000","last_unstale":"2024-05-08T21:10:07.766792+0000","last_undegraded":"2024-05-08T21:10:07.766792+0000","last_fullsized":"2024-05-08T21:10:07.766792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:20:50.134647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.756963+0000","last_change":"2024-05-08T21:10:03.744023+0000","last_active":"2024-05-08T21:10:07.756963+0000","last_peered":"2024-05-08T21:10:07.756963+0000","last_clean":"2024-05-08T21:10:07.756963+0000","last_became_active":"2024-05-08T21:10:03.743724+0000","last_became_peered":"2024-05-08T21:10:03.743724+0000","last_unstale":"2024-05-08T21:10:07.756963+0000","last_undegraded":"2024-05-08T21:10:07.756963+0000","last_fullsized":"2024-05-08T21:10:07.756963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:50:36.857245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.059558+0000","last_change":"2024-05-08T21:10:08.052307+0000","last_active":"2024-05-08T21:10:08.059558+0000","last_peered":"2024-05-08T21:10:08.059558+0000","last_clean":"2024-05-08T21:10:08.059558+0000","last_became_active":"2024-05-08T21:10:08.051924+0000","last_became_peered":"2024-05-08T21:10:08.051924+0000","last_unstale":"2024-05-08T21:10:08.059558+0000","last_undegraded":"2024-05-08T21:10:08.059558+0000","last_fullsized":"2024-05-08T21:10:08.059558+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:56:37.264246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.750197+0000","last_change":"2024-05-08T21:10:03.330304+0000","last_active":"2024-05-08T21:10:07.750197+0000","last_peered":"2024-05-08T21:10:07.750197+0000","last_clean":"2024-05-08T21:10:07.750197+0000","last_became_active":"2024-05-08T21:10:03.330054+0000","last_became_peered":"2024-05-08T21:10:03.330054+0000","last_unstale":"2024-05-08T21:10:07.750197+0000","last_undegraded":"2024-05-08T21:10:07.750197+0000","last_fullsized":"2024-05-08T21:10:07.750197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:30.518935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.186997+0000","last_change":"2024-05-08T21:10:03.739687+0000","last_active":"2024-05-08T21:10:08.186997+0000","last_peered":"2024-05-08T21:10:08.186997+0000","last_clean":"2024-05-08T21:10:08.186997+0000","last_became_active":"2024-05-08T21:10:03.739425+0000","last_became_peered":"2024-05-08T21:10:03.739425+0000","last_unstale":"2024-05-08T21:10:08.186997+0000","last_undegraded":"2024-05-08T21:10:08.186997+0000","last_fullsized":"2024-05-08T21:10:08.186997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:45:59.295081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.054235+0000","last_change":"2024-05-08T21:10:08.050980+0000","last_active":"2024-05-08T21:10:08.054235+0000","last_peered":"2024-05-08T21:10:08.054235+0000","last_clean":"2024-05-08T21:10:08.054235+0000","last_became_active":"2024-05-08T21:10:08.050625+0000","last_became_peered":"2024-05-08T21:10:08.050625+0000","last_unstale":"2024-05-08T21:10:08.054235+0000","last_undegraded":"2024-05-08T21:10:08.054235+0000","last_fullsized":"2024-05-08T21:10:08.054235+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:39:43.917363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.755963+0000","last_change":"2024-05-08T21:10:03.331297+0000","last_active":"2024-05-08T21:10:07.755963+0000","last_peered":"2024-05-08T21:10:07.755963+0000","last_clean":"2024-05-08T21:10:07.755963+0000","last_became_active":"2024-05-08T21:10:03.330973+0000","last_became_peered":"2024-05-08T21:10:03.330973+0000","last_unstale":"2024-05-08T21:10:07.755963+0000","last_undegraded":"2024-05-08T21:10:07.755963+0000","last_fullsized":"2024-05-08T21:10:07.755963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:57:26.190186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.168346+0000","last_change":"2024-05-08T21:10:03.751746+0000","last_active":"2024-05-08T21:10:08.168346+0000","last_peered":"2024-05-08T21:10:08.168346+0000","last_clean":"2024-05-08T21:10:08.168346+0000","last_became_active":"2024-05-08T21:10:03.751426+0000","last_became_peered":"2024-05-08T21:10:03.751426+0000","last_unstale":"2024-05-08T21:10:08.168346+0000","last_undegraded":"2024-05-08T21:10:08.168346+0000","last_fullsized":"2024-05-08T21:10:08.168346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:00:23.529543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.778416+0000","last_change":"2024-05-08T21:10:07.771834+0000","last_active":"2024-05-08T21:10:07.778416+0000","last_peered":"2024-05-08T21:10:07.778416+0000","last_clean":"2024-05-08T21:10:07.778416+0000","last_became_active":"2024-05-08T21:10:07.771324+0000","last_became_peered":"2024-05-08T21:10:07.771324+0000","last_unstale":"2024-05-08T21:10:07.778416+0000","last_undegraded":"2024-05-08T21:10:07.778416+0000","last_fullsized":"2024-05-08T21:10:07.778416+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:35.948317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.749656+0000","last_change":"2024-05-08T21:10:03.332049+0000","last_active":"2024-05-08T21:10:07.749656+0000","last_peered":"2024-05-08T21:10:07.749656+0000","last_clean":"2024-05-08T21:10:07.749656+0000","last_became_active":"2024-05-08T21:10:03.331712+0000","last_became_peered":"2024-05-08T21:10:03.331712+0000","last_unstale":"2024-05-08T21:10:07.749656+0000","last_undegraded":"2024-05-08T21:10:07.749656+0000","last_fullsized":"2024-05-08T21:10:07.749656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:30:16.135672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.753983+0000","last_change":"2024-05-08T21:10:03.748728+0000","last_active":"2024-05-08T21:10:07.753983+0000","last_peered":"2024-05-08T21:10:07.753983+0000","last_clean":"2024-05-08T21:10:07.753983+0000","last_became_active":"2024-05-08T21:10:03.748315+0000","last_became_peered":"2024-05-08T21:10:03.748315+0000","last_unstale":"2024-05-08T21:10:07.753983+0000","last_undegraded":"2024-05-08T21:10:07.753983+0000","last_fullsized":"2024-05-08T21:10:07.753983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:14:15.224603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.170061+0000","last_change":"2024-05-08T21:10:07.761559+0000","last_active":"2024-05-08T21:10:08.170061+0000","last_peered":"2024-05-08T21:10:08.170061+0000","last_clean":"2024-05-08T21:10:08.170061+0000","last_became_active":"2024-05-08T21:10:07.761129+0000","last_became_peered":"2024-05-08T21:10:07.761129+0000","last_unstale":"2024-05-08T21:10:08.170061+0000","last_undegraded":"2024-05-08T21:10:08.170061+0000","last_fullsized":"2024-05-08T21:10:08.170061+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:29:03.444853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'3","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.737377+0000","last_change":"2024-05-08T21:10:03.333077+0000","last_active":"2024-05-08T21:10:08.737377+0000","last_peered":"2024-05-08T21:10:08.737377+0000","last_clean":"2024-05-08T21:10:08.737377+0000","last_became_active":"2024-05-08T21:10:03.332796+0000","last_became_peered":"2024-05-08T21:10:03.332796+0000","last_unstale":"2024-05-08T21:10:08.737377+0000","last_undegraded":"2024-05-08T21:10:08.737377+0000","last_fullsized":"2024-05-08T21:10:08.737377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:30:16.135672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169929+0000","last_change":"2024-05-08T21:10:03.751370+0000","last_active":"2024-05-08T21:10:08.169929+0000","last_peered":"2024-05-08T21:10:08.169929+0000","last_clean":"2024-05-08T21:10:08.169929+0000","last_became_active":"2024-05-08T21:10:03.750394+0000","last_became_peered":"2024-05-08T21:10:03.750394+0000","last_unstale":"2024-05-08T21:10:08.169929+0000","last_undegraded":"2024-05-08T21:10:08.169929+0000","last_fullsized":"2024-05-08T21:10:08.169929+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:31:06.682543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.187439+0000","last_change":"2024-05-08T21:10:07.764815+0000","last_active":"2024-05-08T21:10:08.187439+0000","last_peered":"2024-05-08T21:10:08.187439+0000","last_clean":"2024-05-08T21:10:08.187439+0000","last_became_active":"2024-05-08T21:10:07.763591+0000","last_became_peered":"2024-05-08T21:10:07.763591+0000","last_unstale":"2024-05-08T21:10:08.187439+0000","last_undegraded":"2024-05-08T21:10:08.187439+0000","last_fullsized":"2024-05-08T21:10:08.187439+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:47.977517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:17.506385+0000","last_change":"2024-05-08T21:10:03.342400+0000","last_active":"2024-05-08T21:10:17.506385+0000","last_peered":"2024-05-08T21:10:17.506385+0000","last_clean":"2024-05-08T21:10:17.506385+0000","last_became_active":"2024-05-08T21:10:03.342202+0000","last_became_peered":"2024-05-08T21:10:03.342202+0000","last_unstale":"2024-05-08T21:10:17.506385+0000","last_undegraded":"2024-05-08T21:10:17.506385+0000","last_fullsized":"2024-05-08T21:10:17.506385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:10:04.668029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3796,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046564+0000","last_change":"2024-05-08T21:10:03.752144+0000","last_active":"2024-05-08T21:10:08.046564+0000","last_peered":"2024-05-08T21:10:08.046564+0000","last_clean":"2024-05-08T21:10:08.046564+0000","last_became_active":"2024-05-08T21:10:03.751868+0000","last_became_peered":"2024-05-08T21:10:03.751868+0000","last_unstale":"2024-05-08T21:10:08.046564+0000","last_undegraded":"2024-05-08T21:10:08.046564+0000","last_fullsized":"2024-05-08T21:10:08.046564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:40:43.168591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.168406+0000","last_change":"2024-05-08T21:10:08.052390+0000","last_active":"2024-05-08T21:10:08.168406+0000","last_peered":"2024-05-08T21:10:08.168406+0000","last_clean":"2024-05-08T21:10:08.168406+0000","last_became_active":"2024-05-08T21:10:08.051967+0000","last_became_peered":"2024-05-08T21:10:08.051967+0000","last_unstale":"2024-05-08T21:10:08.168406+0000","last_undegraded":"2024-05-08T21:10:08.168406+0000","last_fullsized":"2024-05-08T21:10:08.168406+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:40:07.127492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.739991+0000","last_change":"2024-05-08T21:10:03.330102+0000","last_active":"2024-05-08T21:10:08.739991+0000","last_peered":"2024-05-08T21:10:08.739991+0000","last_clean":"2024-05-08T21:10:08.739991+0000","last_became_active":"2024-05-08T21:10:03.329761+0000","last_became_peered":"2024-05-08T21:10:03.329761+0000","last_unstale":"2024-05-08T21:10:08.739991+0000","last_undegraded":"2024-05-08T21:10:08.739991+0000","last_fullsized":"2024-05-08T21:10:08.739991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:37:14.930549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.753579+0000","last_change":"2024-05-08T21:10:03.749332+0000","last_active":"2024-05-08T21:10:07.753579+0000","last_peered":"2024-05-08T21:10:07.753579+0000","last_clean":"2024-05-08T21:10:07.753579+0000","last_became_active":"2024-05-08T21:10:03.749094+0000","last_became_peered":"2024-05-08T21:10:03.749094+0000","last_unstale":"2024-05-08T21:10:07.753579+0000","last_undegraded":"2024-05-08T21:10:07.753579+0000","last_fullsized":"2024-05-08T21:10:07.753579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:25.969085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.048813+0000","last_change":"2024-05-08T21:10:08.048331+0000","last_active":"2024-05-08T21:10:08.048813+0000","last_peered":"2024-05-08T21:10:08.048813+0000","last_clean":"2024-05-08T21:10:08.048813+0000","last_became_active":"2024-05-08T21:10:08.047505+0000","last_became_peered":"2024-05-08T21:10:08.047505+0000","last_unstale":"2024-05-08T21:10:08.048813+0000","last_undegraded":"2024-05-08T21:10:08.048813+0000","last_fullsized":"2024-05-08T21:10:08.048813+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:18:39.268730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.749622+0000","last_change":"2024-05-08T21:10:03.328021+0000","last_active":"2024-05-08T21:10:07.749622+0000","last_peered":"2024-05-08T21:10:07.749622+0000","last_clean":"2024-05-08T21:10:07.749622+0000","last_became_active":"2024-05-08T21:10:03.327648+0000","last_became_peered":"2024-05-08T21:10:03.327648+0000","last_unstale":"2024-05-08T21:10:07.749622+0000","last_undegraded":"2024-05-08T21:10:07.749622+0000","last_fullsized":"2024-05-08T21:10:07.749622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:37:54.491930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046495+0000","last_change":"2024-05-08T21:10:03.750560+0000","last_active":"2024-05-08T21:10:08.046495+0000","last_peered":"2024-05-08T21:10:08.046495+0000","last_clean":"2024-05-08T21:10:08.046495+0000","last_became_active":"2024-05-08T21:10:03.750294+0000","last_became_peered":"2024-05-08T21:10:03.750294+0000","last_unstale":"2024-05-08T21:10:08.046495+0000","last_undegraded":"2024-05-08T21:10:08.046495+0000","last_fullsized":"2024-05-08T21:10:08.046495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:30:47.937326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.059433+0000","last_change":"2024-05-08T21:10:08.052318+0000","last_active":"2024-05-08T21:10:08.059433+0000","last_peered":"2024-05-08T21:10:08.059433+0000","last_clean":"2024-05-08T21:10:08.059433+0000","last_became_active":"2024-05-08T21:10:08.051920+0000","last_became_peered":"2024-05-08T21:10:08.051920+0000","last_unstale":"2024-05-08T21:10:08.059433+0000","last_undegraded":"2024-05-08T21:10:08.059433+0000","last_fullsized":"2024-05-08T21:10:08.059433+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:25:27.669768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.754124+0000","last_change":"2024-05-08T21:10:03.332390+0000","last_active":"2024-05-08T21:10:07.754124+0000","last_peered":"2024-05-08T21:10:07.754124+0000","last_clean":"2024-05-08T21:10:07.754124+0000","last_became_active":"2024-05-08T21:10:03.332105+0000","last_became_peered":"2024-05-08T21:10:03.332105+0000","last_unstale":"2024-05-08T21:10:07.754124+0000","last_undegraded":"2024-05-08T21:10:07.754124+0000","last_fullsized":"2024-05-08T21:10:07.754124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:32:44.705682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.271145+0000","last_change":"2024-05-08T21:10:03.742100+0000","last_active":"2024-05-08T21:10:08.271145+0000","last_peered":"2024-05-08T21:10:08.271145+0000","last_clean":"2024-05-08T21:10:08.271145+0000","last_became_active":"2024-05-08T21:10:03.741742+0000","last_became_peered":"2024-05-08T21:10:03.741742+0000","last_unstale":"2024-05-08T21:10:08.271145+0000","last_undegraded":"2024-05-08T21:10:08.271145+0000","last_fullsized":"2024-05-08T21:10:08.271145+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:53:19.394126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.775032+0000","last_change":"2024-05-08T21:10:07.769850+0000","last_active":"2024-05-08T21:10:07.775032+0000","last_peered":"2024-05-08T21:10:07.775032+0000","last_clean":"2024-05-08T21:10:07.775032+0000","last_became_active":"2024-05-08T21:10:07.769016+0000","last_became_peered":"2024-05-08T21:10:07.769016+0000","last_unstale":"2024-05-08T21:10:07.775032+0000","last_undegraded":"2024-05-08T21:10:07.775032+0000","last_fullsized":"2024-05-08T21:10:07.775032+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:31:52.621418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"25'8","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.741624+0000","last_change":"2024-05-08T21:10:03.331783+0000","last_active":"2024-05-08T21:10:08.741624+0000","last_peered":"2024-05-08T21:10:08.741624+0000","last_clean":"2024-05-08T21:10:08.741624+0000","last_became_active":"2024-05-08T21:10:03.331501+0000","last_became_peered":"2024-05-08T21:10:03.331501+0000","last_unstale":"2024-05-08T21:10:08.741624+0000","last_undegraded":"2024-05-08T21:10:08.741624+0000","last_fullsized":"2024-05-08T21:10:08.741624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:41:28.137295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046481+0000","last_change":"2024-05-08T21:10:03.744007+0000","last_active":"2024-05-08T21:10:08.046481+0000","last_peered":"2024-05-08T21:10:08.046481+0000","last_clean":"2024-05-08T21:10:08.046481+0000","last_became_active":"2024-05-08T21:10:03.743557+0000","last_became_peered":"2024-05-08T21:10:03.743557+0000","last_unstale":"2024-05-08T21:10:08.046481+0000","last_undegraded":"2024-05-08T21:10:08.046481+0000","last_fullsized":"2024-05-08T21:10:08.046481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:45:26.458377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169408+0000","last_change":"2024-05-08T21:10:07.777283+0000","last_active":"2024-05-08T21:10:08.169408+0000","last_peered":"2024-05-08T21:10:08.169408+0000","last_clean":"2024-05-08T21:10:08.169408+0000","last_became_active":"2024-05-08T21:10:07.776858+0000","last_became_peered":"2024-05-08T21:10:07.776858+0000","last_unstale":"2024-05-08T21:10:08.169408+0000","last_undegraded":"2024-05-08T21:10:08.169408+0000","last_fullsized":"2024-05-08T21:10:08.169408+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:51.725885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"26'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.170185+0000","last_change":"2024-05-08T21:10:03.326892+0000","last_active":"2024-05-08T21:10:08.170185+0000","last_peered":"2024-05-08T21:10:08.170185+0000","last_clean":"2024-05-08T21:10:08.170185+0000","last_became_active":"2024-05-08T21:10:03.326608+0000","last_became_peered":"2024-05-08T21:10:03.326608+0000","last_unstale":"2024-05-08T21:10:08.170185+0000","last_undegraded":"2024-05-08T21:10:08.170185+0000","last_fullsized":"2024-05-08T21:10:08.170185+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:33.441985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046649+0000","last_change":"2024-05-08T21:10:03.749221+0000","last_active":"2024-05-08T21:10:08.046649+0000","last_peered":"2024-05-08T21:10:08.046649+0000","last_clean":"2024-05-08T21:10:08.046649+0000","last_became_active":"2024-05-08T21:10:03.748915+0000","last_became_peered":"2024-05-08T21:10:03.748915+0000","last_unstale":"2024-05-08T21:10:08.046649+0000","last_undegraded":"2024-05-08T21:10:08.046649+0000","last_fullsized":"2024-05-08T21:10:08.046649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:03:10.791535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.187371+0000","last_change":"2024-05-08T21:10:07.759492+0000","last_active":"2024-05-08T21:10:08.187371+0000","last_peered":"2024-05-08T21:10:08.187371+0000","last_clean":"2024-05-08T21:10:08.187371+0000","last_became_active":"2024-05-08T21:10:07.759139+0000","last_became_peered":"2024-05-08T21:10:07.759139+0000","last_unstale":"2024-05-08T21:10:08.187371+0000","last_undegraded":"2024-05-08T21:10:08.187371+0000","last_fullsized":"2024-05-08T21:10:08.187371+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:10.579105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.743655+0000","last_change":"2024-05-08T21:10:03.329020+0000","last_active":"2024-05-08T21:10:07.743655+0000","last_peered":"2024-05-08T21:10:07.743655+0000","last_clean":"2024-05-08T21:10:07.743655+0000","last_became_active":"2024-05-08T21:10:03.328739+0000","last_became_peered":"2024-05-08T21:10:03.328739+0000","last_unstale":"2024-05-08T21:10:07.743655+0000","last_undegraded":"2024-05-08T21:10:07.743655+0000","last_fullsized":"2024-05-08T21:10:07.743655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:27:11.168780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.168756+0000","last_change":"2024-05-08T21:10:03.744662+0000","last_active":"2024-05-08T21:10:08.168756+0000","last_peered":"2024-05-08T21:10:08.168756+0000","last_clean":"2024-05-08T21:10:08.168756+0000","last_became_active":"2024-05-08T21:10:03.744398+0000","last_became_peered":"2024-05-08T21:10:03.744398+0000","last_unstale":"2024-05-08T21:10:08.168756+0000","last_undegraded":"2024-05-08T21:10:08.168756+0000","last_fullsized":"2024-05-08T21:10:08.168756+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:05:28.046055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.187253+0000","last_change":"2024-05-08T21:10:07.776566+0000","last_active":"2024-05-08T21:10:08.187253+0000","last_peered":"2024-05-08T21:10:08.187253+0000","last_clean":"2024-05-08T21:10:08.187253+0000","last_became_active":"2024-05-08T21:10:07.776080+0000","last_became_peered":"2024-05-08T21:10:07.776080+0000","last_unstale":"2024-05-08T21:10:08.187253+0000","last_undegraded":"2024-05-08T21:10:08.187253+0000","last_fullsized":"2024-05-08T21:10:08.187253+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:26:09.323466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.749542+0000","last_change":"2024-05-08T21:10:03.332953+0000","last_active":"2024-05-08T21:10:07.749542+0000","last_peered":"2024-05-08T21:10:07.749542+0000","last_clean":"2024-05-08T21:10:07.749542+0000","last_became_active":"2024-05-08T21:10:03.332689+0000","last_became_peered":"2024-05-08T21:10:03.332689+0000","last_unstale":"2024-05-08T21:10:07.749542+0000","last_undegraded":"2024-05-08T21:10:07.749542+0000","last_fullsized":"2024-05-08T21:10:07.749542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:15:32.058369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169816+0000","last_change":"2024-05-08T21:10:03.745651+0000","last_active":"2024-05-08T21:10:08.169816+0000","last_peered":"2024-05-08T21:10:08.169816+0000","last_clean":"2024-05-08T21:10:08.169816+0000","last_became_active":"2024-05-08T21:10:03.742744+0000","last_became_peered":"2024-05-08T21:10:03.742744+0000","last_unstale":"2024-05-08T21:10:08.169816+0000","last_undegraded":"2024-05-08T21:10:08.169816+0000","last_fullsized":"2024-05-08T21:10:08.169816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:32:31.689490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.187096+0000","last_change":"2024-05-08T21:10:07.776527+0000","last_active":"2024-05-08T21:10:08.187096+0000","last_peered":"2024-05-08T21:10:08.187096+0000","last_clean":"2024-05-08T21:10:08.187096+0000","last_became_active":"2024-05-08T21:10:07.776053+0000","last_became_peered":"2024-05-08T21:10:07.776053+0000","last_unstale":"2024-05-08T21:10:08.187096+0000","last_undegraded":"2024-05-08T21:10:08.187096+0000","last_fullsized":"2024-05-08T21:10:08.187096+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:08:26.401358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.186861+0000","last_change":"2024-05-08T21:10:03.738421+0000","last_active":"2024-05-08T21:10:08.186861+0000","last_peered":"2024-05-08T21:10:08.186861+0000","last_clean":"2024-05-08T21:10:08.186861+0000","last_became_active":"2024-05-08T21:10:03.738000+0000","last_became_peered":"2024-05-08T21:10:03.738000+0000","last_unstale":"2024-05-08T21:10:08.186861+0000","last_undegraded":"2024-05-08T21:10:08.186861+0000","last_fullsized":"2024-05-08T21:10:08.186861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:38:05.948755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.751476+0000","last_change":"2024-05-08T21:10:03.331141+0000","last_active":"2024-05-08T21:10:07.751476+0000","last_peered":"2024-05-08T21:10:07.751476+0000","last_clean":"2024-05-08T21:10:07.751476+0000","last_became_active":"2024-05-08T21:10:03.330842+0000","last_became_peered":"2024-05-08T21:10:03.330842+0000","last_unstale":"2024-05-08T21:10:07.751476+0000","last_undegraded":"2024-05-08T21:10:07.751476+0000","last_fullsized":"2024-05-08T21:10:07.751476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:42:52.648932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.271310+0000","last_change":"2024-05-08T21:10:08.049274+0000","last_active":"2024-05-08T21:10:08.271310+0000","last_peered":"2024-05-08T21:10:08.271310+0000","last_clean":"2024-05-08T21:10:08.271310+0000","last_became_active":"2024-05-08T21:10:08.048763+0000","last_became_peered":"2024-05-08T21:10:08.048763+0000","last_unstale":"2024-05-08T21:10:08.271310+0000","last_undegraded":"2024-05-08T21:10:08.271310+0000","last_fullsized":"2024-05-08T21:10:08.271310+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:00:41.257040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.754546+0000","last_change":"2024-05-08T21:10:03.747594+0000","last_active":"2024-05-08T21:10:07.754546+0000","last_peered":"2024-05-08T21:10:07.754546+0000","last_clean":"2024-05-08T21:10:07.754546+0000","last_became_active":"2024-05-08T21:10:03.747360+0000","last_became_peered":"2024-05-08T21:10:03.747360+0000","last_unstale":"2024-05-08T21:10:07.754546+0000","last_undegraded":"2024-05-08T21:10:07.754546+0000","last_fullsized":"2024-05-08T21:10:07.754546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:31:12.357348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.749455+0000","last_change":"2024-05-08T21:10:03.327847+0000","last_active":"2024-05-08T21:10:07.749455+0000","last_peered":"2024-05-08T21:10:07.749455+0000","last_clean":"2024-05-08T21:10:07.749455+0000","last_became_active":"2024-05-08T21:10:03.327530+0000","last_became_peered":"2024-05-08T21:10:03.327530+0000","last_unstale":"2024-05-08T21:10:07.749455+0000","last_undegraded":"2024-05-08T21:10:07.749455+0000","last_fullsized":"2024-05-08T21:10:07.749455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:46.232166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":168,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046147+0000","last_change":"2024-05-08T21:09:59.333990+0000","last_active":"2024-05-08T21:10:08.046147+0000","last_peered":"2024-05-08T21:10:08.046147+0000","last_clean":"2024-05-08T21:10:08.046147+0000","last_became_active":"2024-05-08T21:09:59.332929+0000","last_became_peered":"2024-05-08T21:09:59.332929+0000","last_unstale":"2024-05-08T21:10:08.046147+0000","last_undegraded":"2024-05-08T21:10:08.046147+0000","last_fullsized":"2024-05-08T21:10:08.046147+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:09:58.287675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:09:58.287675+0000","last_clean_scrub_stamp":"2024-05-08T21:09:58.287675+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:47.595380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.052138+0000","last_change":"2024-05-08T21:10:08.049848+0000","last_active":"2024-05-08T21:10:08.052138+0000","last_peered":"2024-05-08T21:10:08.052138+0000","last_clean":"2024-05-08T21:10:08.052138+0000","last_became_active":"2024-05-08T21:10:08.049153+0000","last_became_peered":"2024-05-08T21:10:08.049153+0000","last_unstale":"2024-05-08T21:10:08.052138+0000","last_undegraded":"2024-05-08T21:10:08.052138+0000","last_fullsized":"2024-05-08T21:10:08.052138+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:23.704112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.753311+0000","last_change":"2024-05-08T21:10:03.743094+0000","last_active":"2024-05-08T21:10:07.753311+0000","last_peered":"2024-05-08T21:10:07.753311+0000","last_clean":"2024-05-08T21:10:07.753311+0000","last_became_active":"2024-05-08T21:10:03.742819+0000","last_became_peered":"2024-05-08T21:10:03.742819+0000","last_unstale":"2024-05-08T21:10:07.753311+0000","last_undegraded":"2024-05-08T21:10:07.753311+0000","last_fullsized":"2024-05-08T21:10:07.753311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:41:25.593884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046341+0000","last_change":"2024-05-08T21:10:03.340259+0000","last_active":"2024-05-08T21:10:08.046341+0000","last_peered":"2024-05-08T21:10:08.046341+0000","last_clean":"2024-05-08T21:10:08.046341+0000","last_became_active":"2024-05-08T21:10:03.339957+0000","last_became_peered":"2024-05-08T21:10:03.339957+0000","last_unstale":"2024-05-08T21:10:08.046341+0000","last_undegraded":"2024-05-08T21:10:08.046341+0000","last_fullsized":"2024-05-08T21:10:08.046341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:38:36.535689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.051520+0000","last_change":"2024-05-08T21:10:08.050370+0000","last_active":"2024-05-08T21:10:08.051520+0000","last_peered":"2024-05-08T21:10:08.051520+0000","last_clean":"2024-05-08T21:10:08.051520+0000","last_became_active":"2024-05-08T21:10:08.049962+0000","last_became_peered":"2024-05-08T21:10:08.049962+0000","last_unstale":"2024-05-08T21:10:08.051520+0000","last_undegraded":"2024-05-08T21:10:08.051520+0000","last_fullsized":"2024-05-08T21:10:08.051520+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:11:35.394334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046359+0000","last_change":"2024-05-08T21:10:03.337949+0000","last_active":"2024-05-08T21:10:08.046359+0000","last_peered":"2024-05-08T21:10:08.046359+0000","last_clean":"2024-05-08T21:10:08.046359+0000","last_became_active":"2024-05-08T21:10:03.337627+0000","last_became_peered":"2024-05-08T21:10:03.337627+0000","last_unstale":"2024-05-08T21:10:08.046359+0000","last_undegraded":"2024-05-08T21:10:08.046359+0000","last_fullsized":"2024-05-08T21:10:08.046359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:17:36.792731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.187476+0000","last_change":"2024-05-08T21:10:03.738212+0000","last_active":"2024-05-08T21:10:08.187476+0000","last_peered":"2024-05-08T21:10:08.187476+0000","last_clean":"2024-05-08T21:10:08.187476+0000","last_became_active":"2024-05-08T21:10:03.737927+0000","last_became_peered":"2024-05-08T21:10:03.737927+0000","last_unstale":"2024-05-08T21:10:08.187476+0000","last_undegraded":"2024-05-08T21:10:08.187476+0000","last_fullsized":"2024-05-08T21:10:08.187476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:03:08.031584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.059425+0000","last_change":"2024-05-08T21:10:08.052270+0000","last_active":"2024-05-08T21:10:08.059425+0000","last_peered":"2024-05-08T21:10:08.059425+0000","last_clean":"2024-05-08T21:10:08.059425+0000","last_became_active":"2024-05-08T21:10:08.051881+0000","last_became_peered":"2024-05-08T21:10:08.051881+0000","last_unstale":"2024-05-08T21:10:08.059425+0000","last_undegraded":"2024-05-08T21:10:08.059425+0000","last_fullsized":"2024-05-08T21:10:08.059425+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:39:07.929942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.187471+0000","last_change":"2024-05-08T21:10:03.333696+0000","last_active":"2024-05-08T21:10:08.187471+0000","last_peered":"2024-05-08T21:10:08.187471+0000","last_clean":"2024-05-08T21:10:08.187471+0000","last_became_active":"2024-05-08T21:10:03.333368+0000","last_became_peered":"2024-05-08T21:10:03.333368+0000","last_unstale":"2024-05-08T21:10:08.187471+0000","last_undegraded":"2024-05-08T21:10:08.187471+0000","last_fullsized":"2024-05-08T21:10:08.187471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:00:08.459270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.762624+0000","last_change":"2024-05-08T21:10:03.752578+0000","last_active":"2024-05-08T21:10:07.762624+0000","last_peered":"2024-05-08T21:10:07.762624+0000","last_clean":"2024-05-08T21:10:07.762624+0000","last_became_active":"2024-05-08T21:10:03.752389+0000","last_became_peered":"2024-05-08T21:10:03.752389+0000","last_unstale":"2024-05-08T21:10:07.762624+0000","last_undegraded":"2024-05-08T21:10:07.762624+0000","last_fullsized":"2024-05-08T21:10:07.762624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:54:02.318162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169418+0000","last_change":"2024-05-08T21:10:08.048081+0000","last_active":"2024-05-08T21:10:08.169418+0000","last_peered":"2024-05-08T21:10:08.169418+0000","last_clean":"2024-05-08T21:10:08.169418+0000","last_became_active":"2024-05-08T21:10:08.047632+0000","last_became_peered":"2024-05-08T21:10:08.047632+0000","last_unstale":"2024-05-08T21:10:08.169418+0000","last_undegraded":"2024-05-08T21:10:08.169418+0000","last_fullsized":"2024-05-08T21:10:08.169418+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:26:05.857718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"26'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.738320+0000","last_change":"2024-05-08T21:10:03.340553+0000","last_active":"2024-05-08T21:10:08.738320+0000","last_peered":"2024-05-08T21:10:08.738320+0000","last_clean":"2024-05-08T21:10:08.738320+0000","last_became_active":"2024-05-08T21:10:03.340280+0000","last_became_peered":"2024-05-08T21:10:03.340280+0000","last_unstale":"2024-05-08T21:10:08.738320+0000","last_undegraded":"2024-05-08T21:10:08.738320+0000","last_fullsized":"2024-05-08T21:10:08.738320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:36:24.866220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.754313+0000","last_change":"2024-05-08T21:10:03.736316+0000","last_active":"2024-05-08T21:10:07.754313+0000","last_peered":"2024-05-08T21:10:07.754313+0000","last_clean":"2024-05-08T21:10:07.754313+0000","last_became_active":"2024-05-08T21:10:03.736049+0000","last_became_peered":"2024-05-08T21:10:03.736049+0000","last_unstale":"2024-05-08T21:10:07.754313+0000","last_undegraded":"2024-05-08T21:10:07.754313+0000","last_fullsized":"2024-05-08T21:10:07.754313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:09:48.973609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.170097+0000","last_change":"2024-05-08T21:10:07.777357+0000","last_active":"2024-05-08T21:10:08.170097+0000","last_peered":"2024-05-08T21:10:08.170097+0000","last_clean":"2024-05-08T21:10:08.170097+0000","last_became_active":"2024-05-08T21:10:07.776848+0000","last_became_peered":"2024-05-08T21:10:07.776848+0000","last_unstale":"2024-05-08T21:10:08.170097+0000","last_undegraded":"2024-05-08T21:10:08.170097+0000","last_fullsized":"2024-05-08T21:10:08.170097+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:51:47.727804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046274+0000","last_change":"2024-05-08T21:10:03.340078+0000","last_active":"2024-05-08T21:10:08.046274+0000","last_peered":"2024-05-08T21:10:08.046274+0000","last_clean":"2024-05-08T21:10:08.046274+0000","last_became_active":"2024-05-08T21:10:03.339690+0000","last_became_peered":"2024-05-08T21:10:03.339690+0000","last_unstale":"2024-05-08T21:10:08.046274+0000","last_undegraded":"2024-05-08T21:10:08.046274+0000","last_fullsized":"2024-05-08T21:10:08.046274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:01:33.991878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169765+0000","last_change":"2024-05-08T21:10:03.744606+0000","last_active":"2024-05-08T21:10:08.169765+0000","last_peered":"2024-05-08T21:10:08.169765+0000","last_clean":"2024-05-08T21:10:08.169765+0000","last_became_active":"2024-05-08T21:10:03.744160+0000","last_became_peered":"2024-05-08T21:10:03.744160+0000","last_unstale":"2024-05-08T21:10:08.169765+0000","last_undegraded":"2024-05-08T21:10:08.169765+0000","last_fullsized":"2024-05-08T21:10:08.169765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:10:25.144058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.187244+0000","last_change":"2024-05-08T21:10:08.049224+0000","last_active":"2024-05-08T21:10:08.187244+0000","last_peered":"2024-05-08T21:10:08.187244+0000","last_clean":"2024-05-08T21:10:08.187244+0000","last_became_active":"2024-05-08T21:10:08.048866+0000","last_became_peered":"2024-05-08T21:10:08.048866+0000","last_unstale":"2024-05-08T21:10:08.187244+0000","last_undegraded":"2024-05-08T21:10:08.187244+0000","last_fullsized":"2024-05-08T21:10:08.187244+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:38:20.601167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.743199+0000","last_change":"2024-05-08T21:10:03.339344+0000","last_active":"2024-05-08T21:10:07.743199+0000","last_peered":"2024-05-08T21:10:07.743199+0000","last_clean":"2024-05-08T21:10:07.743199+0000","last_became_active":"2024-05-08T21:10:03.339136+0000","last_became_peered":"2024-05-08T21:10:03.339136+0000","last_unstale":"2024-05-08T21:10:07.743199+0000","last_undegraded":"2024-05-08T21:10:07.743199+0000","last_fullsized":"2024-05-08T21:10:07.743199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:02:55.623727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.757429+0000","last_change":"2024-05-08T21:10:03.737684+0000","last_active":"2024-05-08T21:10:07.757429+0000","last_peered":"2024-05-08T21:10:07.757429+0000","last_clean":"2024-05-08T21:10:07.757429+0000","last_became_active":"2024-05-08T21:10:03.737459+0000","last_became_peered":"2024-05-08T21:10:03.737459+0000","last_unstale":"2024-05-08T21:10:07.757429+0000","last_undegraded":"2024-05-08T21:10:07.757429+0000","last_fullsized":"2024-05-08T21:10:07.757429+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:39.662018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169949+0000","last_change":"2024-05-08T21:10:07.776483+0000","last_active":"2024-05-08T21:10:08.169949+0000","last_peered":"2024-05-08T21:10:08.169949+0000","last_clean":"2024-05-08T21:10:08.169949+0000","last_became_active":"2024-05-08T21:10:07.775956+0000","last_became_peered":"2024-05-08T21:10:07.775956+0000","last_unstale":"2024-05-08T21:10:08.169949+0000","last_undegraded":"2024-05-08T21:10:08.169949+0000","last_fullsized":"2024-05-08T21:10:08.169949+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:28:17.332488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.743317+0000","last_change":"2024-05-08T21:10:03.331695+0000","last_active":"2024-05-08T21:10:07.743317+0000","last_peered":"2024-05-08T21:10:07.743317+0000","last_clean":"2024-05-08T21:10:07.743317+0000","last_became_active":"2024-05-08T21:10:03.331198+0000","last_became_peered":"2024-05-08T21:10:03.331198+0000","last_unstale":"2024-05-08T21:10:07.743317+0000","last_undegraded":"2024-05-08T21:10:07.743317+0000","last_fullsized":"2024-05-08T21:10:07.743317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:37:54.491930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.761445+0000","last_change":"2024-05-08T21:10:03.744562+0000","last_active":"2024-05-08T21:10:07.761445+0000","last_peered":"2024-05-08T21:10:07.761445+0000","last_clean":"2024-05-08T21:10:07.761445+0000","last_became_active":"2024-05-08T21:10:03.744326+0000","last_became_peered":"2024-05-08T21:10:03.744326+0000","last_unstale":"2024-05-08T21:10:07.761445+0000","last_undegraded":"2024-05-08T21:10:07.761445+0000","last_fullsized":"2024-05-08T21:10:07.761445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:21:52.947209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.170163+0000","last_change":"2024-05-08T21:10:07.763204+0000","last_active":"2024-05-08T21:10:08.170163+0000","last_peered":"2024-05-08T21:10:08.170163+0000","last_clean":"2024-05-08T21:10:08.170163+0000","last_became_active":"2024-05-08T21:10:07.762886+0000","last_became_peered":"2024-05-08T21:10:07.762886+0000","last_unstale":"2024-05-08T21:10:08.170163+0000","last_undegraded":"2024-05-08T21:10:08.170163+0000","last_fullsized":"2024-05-08T21:10:08.170163+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:01.599700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.740037+0000","last_change":"2024-05-08T21:10:03.337993+0000","last_active":"2024-05-08T21:10:08.740037+0000","last_peered":"2024-05-08T21:10:08.740037+0000","last_clean":"2024-05-08T21:10:08.740037+0000","last_became_active":"2024-05-08T21:10:03.337654+0000","last_became_peered":"2024-05-08T21:10:03.337654+0000","last_unstale":"2024-05-08T21:10:08.740037+0000","last_undegraded":"2024-05-08T21:10:08.740037+0000","last_fullsized":"2024-05-08T21:10:08.740037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:23:20.536178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.271247+0000","last_change":"2024-05-08T21:10:03.744871+0000","last_active":"2024-05-08T21:10:08.271247+0000","last_peered":"2024-05-08T21:10:08.271247+0000","last_clean":"2024-05-08T21:10:08.271247+0000","last_became_active":"2024-05-08T21:10:03.744589+0000","last_became_peered":"2024-05-08T21:10:03.744589+0000","last_unstale":"2024-05-08T21:10:08.271247+0000","last_undegraded":"2024-05-08T21:10:08.271247+0000","last_fullsized":"2024-05-08T21:10:08.271247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:41.090204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.271212+0000","last_change":"2024-05-08T21:10:08.047735+0000","last_active":"2024-05-08T21:10:08.271212+0000","last_peered":"2024-05-08T21:10:08.271212+0000","last_clean":"2024-05-08T21:10:08.271212+0000","last_became_active":"2024-05-08T21:10:08.047331+0000","last_became_peered":"2024-05-08T21:10:08.047331+0000","last_unstale":"2024-05-08T21:10:08.271212+0000","last_undegraded":"2024-05-08T21:10:08.271212+0000","last_fullsized":"2024-05-08T21:10:08.271212+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:44:22.797154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.751739+0000","last_change":"2024-05-08T21:10:03.333117+0000","last_active":"2024-05-08T21:10:07.751739+0000","last_peered":"2024-05-08T21:10:07.751739+0000","last_clean":"2024-05-08T21:10:07.751739+0000","last_became_active":"2024-05-08T21:10:03.332790+0000","last_became_peered":"2024-05-08T21:10:03.332790+0000","last_unstale":"2024-05-08T21:10:07.751739+0000","last_undegraded":"2024-05-08T21:10:07.751739+0000","last_fullsized":"2024-05-08T21:10:07.751739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:52:36.355804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046458+0000","last_change":"2024-05-08T21:10:03.748047+0000","last_active":"2024-05-08T21:10:08.046458+0000","last_peered":"2024-05-08T21:10:08.046458+0000","last_clean":"2024-05-08T21:10:08.046458+0000","last_became_active":"2024-05-08T21:10:03.747759+0000","last_became_peered":"2024-05-08T21:10:03.747759+0000","last_unstale":"2024-05-08T21:10:08.046458+0000","last_undegraded":"2024-05-08T21:10:08.046458+0000","last_fullsized":"2024-05-08T21:10:08.046458+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:11:05.309278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.775292+0000","last_change":"2024-05-08T21:10:07.761000+0000","last_active":"2024-05-08T21:10:07.775292+0000","last_peered":"2024-05-08T21:10:07.775292+0000","last_clean":"2024-05-08T21:10:07.775292+0000","last_became_active":"2024-05-08T21:10:07.760566+0000","last_became_peered":"2024-05-08T21:10:07.760566+0000","last_unstale":"2024-05-08T21:10:07.775292+0000","last_undegraded":"2024-05-08T21:10:07.775292+0000","last_fullsized":"2024-05-08T21:10:07.775292+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:48:27.435678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"26'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.187152+0000","last_change":"2024-05-08T21:10:03.331358+0000","last_active":"2024-05-08T21:10:08.187152+0000","last_peered":"2024-05-08T21:10:08.187152+0000","last_clean":"2024-05-08T21:10:08.187152+0000","last_became_active":"2024-05-08T21:10:03.331028+0000","last_became_peered":"2024-05-08T21:10:03.331028+0000","last_unstale":"2024-05-08T21:10:08.187152+0000","last_undegraded":"2024-05-08T21:10:08.187152+0000","last_fullsized":"2024-05-08T21:10:08.187152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:18:47.922157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.168527+0000","last_change":"2024-05-08T21:10:03.751285+0000","last_active":"2024-05-08T21:10:08.168527+0000","last_peered":"2024-05-08T21:10:08.168527+0000","last_clean":"2024-05-08T21:10:08.168527+0000","last_became_active":"2024-05-08T21:10:03.746557+0000","last_became_peered":"2024-05-08T21:10:03.746557+0000","last_unstale":"2024-05-08T21:10:08.168527+0000","last_undegraded":"2024-05-08T21:10:08.168527+0000","last_fullsized":"2024-05-08T21:10:08.168527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:50:27.241404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.167816+0000","last_change":"2024-05-08T21:10:08.048830+0000","last_active":"2024-05-08T21:10:08.167816+0000","last_peered":"2024-05-08T21:10:08.167816+0000","last_clean":"2024-05-08T21:10:08.167816+0000","last_became_active":"2024-05-08T21:10:08.048453+0000","last_became_peered":"2024-05-08T21:10:08.048453+0000","last_unstale":"2024-05-08T21:10:08.167816+0000","last_undegraded":"2024-05-08T21:10:08.167816+0000","last_fullsized":"2024-05-08T21:10:08.167816+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:19:28.758712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.737384+0000","last_change":"2024-05-08T21:10:03.330419+0000","last_active":"2024-05-08T21:10:08.737384+0000","last_peered":"2024-05-08T21:10:08.737384+0000","last_clean":"2024-05-08T21:10:08.737384+0000","last_became_active":"2024-05-08T21:10:03.330082+0000","last_became_peered":"2024-05-08T21:10:03.330082+0000","last_unstale":"2024-05-08T21:10:08.737384+0000","last_undegraded":"2024-05-08T21:10:08.737384+0000","last_fullsized":"2024-05-08T21:10:08.737384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:09:20.516386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046810+0000","last_change":"2024-05-08T21:10:03.747306+0000","last_active":"2024-05-08T21:10:08.046810+0000","last_peered":"2024-05-08T21:10:08.046810+0000","last_clean":"2024-05-08T21:10:08.046810+0000","last_became_active":"2024-05-08T21:10:03.746755+0000","last_became_peered":"2024-05-08T21:10:03.746755+0000","last_unstale":"2024-05-08T21:10:08.046810+0000","last_undegraded":"2024-05-08T21:10:08.046810+0000","last_fullsized":"2024-05-08T21:10:08.046810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:17:51.344821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.271171+0000","last_change":"2024-05-08T21:10:03.738627+0000","last_active":"2024-05-08T21:10:08.271171+0000","last_peered":"2024-05-08T21:10:08.271171+0000","last_clean":"2024-05-08T21:10:08.271171+0000","last_became_active":"2024-05-08T21:10:03.738338+0000","last_became_peered":"2024-05-08T21:10:03.738338+0000","last_unstale":"2024-05-08T21:10:08.271171+0000","last_undegraded":"2024-05-08T21:10:08.271171+0000","last_fullsized":"2024-05-08T21:10:08.271171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:34.088831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.751564+0000","last_change":"2024-05-08T21:10:03.745607+0000","last_active":"2024-05-08T21:10:07.751564+0000","last_peered":"2024-05-08T21:10:07.751564+0000","last_clean":"2024-05-08T21:10:07.751564+0000","last_became_active":"2024-05-08T21:10:03.745362+0000","last_became_peered":"2024-05-08T21:10:03.745362+0000","last_unstale":"2024-05-08T21:10:07.751564+0000","last_undegraded":"2024-05-08T21:10:07.751564+0000","last_fullsized":"2024-05-08T21:10:07.751564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:54.399930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.168448+0000","last_change":"2024-05-08T21:10:03.745137+0000","last_active":"2024-05-08T21:10:08.168448+0000","last_peered":"2024-05-08T21:10:08.168448+0000","last_clean":"2024-05-08T21:10:08.168448+0000","last_became_active":"2024-05-08T21:10:03.744844+0000","last_became_peered":"2024-05-08T21:10:03.744844+0000","last_unstale":"2024-05-08T21:10:08.168448+0000","last_undegraded":"2024-05-08T21:10:08.168448+0000","last_fullsized":"2024-05-08T21:10:08.168448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:06.853429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.753792+0000","last_change":"2024-05-08T21:10:03.745163+0000","last_active":"2024-05-08T21:10:07.753792+0000","last_peered":"2024-05-08T21:10:07.753792+0000","last_clean":"2024-05-08T21:10:07.753792+0000","last_became_active":"2024-05-08T21:10:03.744908+0000","last_became_peered":"2024-05-08T21:10:03.744908+0000","last_unstale":"2024-05-08T21:10:07.753792+0000","last_undegraded":"2024-05-08T21:10:07.753792+0000","last_fullsized":"2024-05-08T21:10:07.753792+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:06.593989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.762986+0000","last_change":"2024-05-08T21:10:03.748542+0000","last_active":"2024-05-08T21:10:07.762986+0000","last_peered":"2024-05-08T21:10:07.762986+0000","last_clean":"2024-05-08T21:10:07.762986+0000","last_became_active":"2024-05-08T21:10:03.748284+0000","last_became_peered":"2024-05-08T21:10:03.748284+0000","last_unstale":"2024-05-08T21:10:07.762986+0000","last_undegraded":"2024-05-08T21:10:07.762986+0000","last_fullsized":"2024-05-08T21:10:07.762986+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:49:10.430406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.187090+0000","last_change":"2024-05-08T21:10:03.739778+0000","last_active":"2024-05-08T21:10:08.187090+0000","last_peered":"2024-05-08T21:10:08.187090+0000","last_clean":"2024-05-08T21:10:08.187090+0000","last_became_active":"2024-05-08T21:10:03.739522+0000","last_became_peered":"2024-05-08T21:10:03.739522+0000","last_unstale":"2024-05-08T21:10:08.187090+0000","last_undegraded":"2024-05-08T21:10:08.187090+0000","last_fullsized":"2024-05-08T21:10:08.187090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:07:42.115999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.271345+0000","last_change":"2024-05-08T21:10:03.746126+0000","last_active":"2024-05-08T21:10:08.271345+0000","last_peered":"2024-05-08T21:10:08.271345+0000","last_clean":"2024-05-08T21:10:08.271345+0000","last_became_active":"2024-05-08T21:10:03.745842+0000","last_became_peered":"2024-05-08T21:10:03.745842+0000","last_unstale":"2024-05-08T21:10:08.271345+0000","last_undegraded":"2024-05-08T21:10:08.271345+0000","last_fullsized":"2024-05-08T21:10:08.271345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:51:06.176371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.762738+0000","last_change":"2024-05-08T21:10:03.745007+0000","last_active":"2024-05-08T21:10:07.762738+0000","last_peered":"2024-05-08T21:10:07.762738+0000","last_clean":"2024-05-08T21:10:07.762738+0000","last_became_active":"2024-05-08T21:10:03.744709+0000","last_became_peered":"2024-05-08T21:10:03.744709+0000","last_unstale":"2024-05-08T21:10:07.762738+0000","last_undegraded":"2024-05-08T21:10:07.762738+0000","last_fullsized":"2024-05-08T21:10:07.762738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:12:20.712861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.167909+0000","last_change":"2024-05-08T21:10:03.751111+0000","last_active":"2024-05-08T21:10:08.167909+0000","last_peered":"2024-05-08T21:10:08.167909+0000","last_clean":"2024-05-08T21:10:08.167909+0000","last_became_active":"2024-05-08T21:10:03.747059+0000","last_became_peered":"2024-05-08T21:10:03.747059+0000","last_unstale":"2024-05-08T21:10:08.167909+0000","last_undegraded":"2024-05-08T21:10:08.167909+0000","last_fullsized":"2024-05-08T21:10:08.167909+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:43.254221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.766689+0000","last_change":"2024-05-08T21:10:03.747207+0000","last_active":"2024-05-08T21:10:07.766689+0000","last_peered":"2024-05-08T21:10:07.766689+0000","last_clean":"2024-05-08T21:10:07.766689+0000","last_became_active":"2024-05-08T21:10:03.746942+0000","last_became_peered":"2024-05-08T21:10:03.746942+0000","last_unstale":"2024-05-08T21:10:07.766689+0000","last_undegraded":"2024-05-08T21:10:07.766689+0000","last_fullsized":"2024-05-08T21:10:07.766689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:33:52.317273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.168575+0000","last_change":"2024-05-08T21:10:03.753663+0000","last_active":"2024-05-08T21:10:08.168575+0000","last_peered":"2024-05-08T21:10:08.168575+0000","last_clean":"2024-05-08T21:10:08.168575+0000","last_became_active":"2024-05-08T21:10:03.752486+0000","last_became_peered":"2024-05-08T21:10:03.752486+0000","last_unstale":"2024-05-08T21:10:08.168575+0000","last_undegraded":"2024-05-08T21:10:08.168575+0000","last_fullsized":"2024-05-08T21:10:08.168575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:21:45.895154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.753497+0000","last_change":"2024-05-08T21:10:03.753849+0000","last_active":"2024-05-08T21:10:07.753497+0000","last_peered":"2024-05-08T21:10:07.753497+0000","last_clean":"2024-05-08T21:10:07.753497+0000","last_became_active":"2024-05-08T21:10:03.753616+0000","last_became_peered":"2024-05-08T21:10:03.753616+0000","last_unstale":"2024-05-08T21:10:07.753497+0000","last_undegraded":"2024-05-08T21:10:07.753497+0000","last_fullsized":"2024-05-08T21:10:07.753497+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:02:58.650310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.271297+0000","last_change":"2024-05-08T21:10:03.744906+0000","last_active":"2024-05-08T21:10:08.271297+0000","last_peered":"2024-05-08T21:10:08.271297+0000","last_clean":"2024-05-08T21:10:08.271297+0000","last_became_active":"2024-05-08T21:10:03.744562+0000","last_became_peered":"2024-05-08T21:10:03.744562+0000","last_unstale":"2024-05-08T21:10:08.271297+0000","last_undegraded":"2024-05-08T21:10:08.271297+0000","last_fullsized":"2024-05-08T21:10:08.271297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:21:30.416392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64612,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4594,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509450,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":110038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]}]},{"osd":5,"up_from":15,"seq":64424509451,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":106332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]}]},{"osd":0,"up_from":14,"seq":60129542155,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":348160,"data_stored":697248,"data_compressed":32306,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.307}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]}]},{"osd":7,"up_from":14,"seq":60129542154,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":339968,"data_stored":697192,"data_compressed":32306,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":106242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.245}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]}]},{"osd":3,"up_from":14,"seq":60129542154,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":110038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]}]},{"osd":1,"up_from":15,"seq":64424509450,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":106402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]}]},{"osd":4,"up_from":15,"seq":64424509450,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":106368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32306,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32306,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T21:10:37.079 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T21:10:37.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.231+0000 7f54b409b700 1 Processor -- start 2024-05-08T21:10:37.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.232+0000 7f54b409b700 1 -- start start 2024-05-08T21:10:37.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.232+0000 7f54b409b700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f54ac06aac0 0x7f54ac06af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:37.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.232+0000 7f54b409b700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54ac0c1a00 con 0x7f54ac15a9c0 2024-05-08T21:10:37.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.232+0000 7f54b409b700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54ac06b440 con 0x7f54ac15a5e0 2024-05-08T21:10:37.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.232+0000 7f54b409b700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54ac0710b0 con 0x7f54ac06aac0 2024-05-08T21:10:37.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.232+0000 7f54b2638700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f54ac15a9c0 0x7f54ac15ae50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41842/0 (socket says 172.21.15.80:41842) 2024-05-08T21:10:37.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.233+0000 7f54b2638700 1 -- 172.21.15.80:0/551488703 learned_addr learned my addr 172.21.15.80:0/551488703 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:10:37.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.233+0000 7f54b1636700 1 --2- 172.21.15.80:0/551488703 >> v2:172.21.15.106:3300/0 conn(0x7f54ac06aac0 0x7f54ac06af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:37.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.233+0000 7f54b0e35700 1 -- 172.21.15.80:0/551488703 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3792765578 0 0) 0x7f54ac0c1a00 con 0x7f54ac15a9c0 2024-05-08T21:10:37.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.233+0000 7f54b0e35700 1 -- 172.21.15.80:0/551488703 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54980035b0 con 0x7f54ac15a9c0 2024-05-08T21:10:37.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.233+0000 7f54b1636700 1 -- 172.21.15.80:0/551488703 >> v1:172.21.15.106:6789/0 conn(0x7f54ac15a5e0 legacy=0x7f54ac0c7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:37.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.233+0000 7f54b1636700 1 -- 172.21.15.80:0/551488703 >> v1:172.21.15.80:6789/0 conn(0x7f54ac15a9c0 legacy=0x7f54ac15ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:37.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.233+0000 7f54b1636700 1 -- 172.21.15.80:0/551488703 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54ac0c1ca0 con 0x7f54ac06aac0 2024-05-08T21:10:37.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.233+0000 7f54b1636700 1 --2- 172.21.15.80:0/551488703 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f54ac06aac0 0x7f54ac06af00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f549c009840 tx=0x7f549c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f5d9f4ed997d870 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:37.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.233+0000 7f54b0e35700 1 -- 172.21.15.80:0/551488703 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549c011830 con 0x7f54ac06aac0 2024-05-08T21:10:37.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.233+0000 7f54b0e35700 1 -- 172.21.15.80:0/551488703 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f549c011990 con 0x7f54ac06aac0 2024-05-08T21:10:37.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.233+0000 7f54b0e35700 1 -- 172.21.15.80:0/551488703 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549c011d20 con 0x7f54ac06aac0 2024-05-08T21:10:37.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.234+0000 7f54b409b700 1 -- 172.21.15.80:0/551488703 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f54ac06aac0 msgr2=0x7f54ac06af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:37.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.234+0000 7f54b409b700 1 --2- 172.21.15.80:0/551488703 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f54ac06aac0 0x7f54ac06af00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f549c009840 tx=0x7f549c009b50 comp rx=0 tx=0).stop 2024-05-08T21:10:37.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.234+0000 7f54b409b700 1 -- 172.21.15.80:0/551488703 shutdown_connections 2024-05-08T21:10:37.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.234+0000 7f54b409b700 1 --2- 172.21.15.80:0/551488703 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f54ac06aac0 0x7f54ac06af00 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:37.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.234+0000 7f54b409b700 1 -- 172.21.15.80:0/551488703 >> 172.21.15.80:0/551488703 conn(0x7f54ac0cbe80 msgr2=0x7f54ac0cc290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:37.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.234+0000 7f54b409b700 1 -- 172.21.15.80:0/551488703 shutdown_connections 2024-05-08T21:10:37.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.234+0000 7f54b409b700 1 -- 172.21.15.80:0/551488703 wait complete. 2024-05-08T21:10:37.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.235+0000 7f54b409b700 1 Processor -- start 2024-05-08T21:10:37.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.235+0000 7f54b409b700 1 -- start start 2024-05-08T21:10:37.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.236+0000 7f54b409b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f54ac06aac0 0x7f54ac0afde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:37.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.236+0000 7f54b409b700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f54ac15a5e0 0x7f54ac14ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:37.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.236+0000 7f54b409b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f54ac15a9c0 0x7f54ac06e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:37.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.236+0000 7f54b409b700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54ac0b1500 con 0x7f54ac15a9c0 2024-05-08T21:10:37.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.236+0000 7f54b409b700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54ac0af480 con 0x7f54ac06aac0 2024-05-08T21:10:37.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.236+0000 7f54b409b700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54ac0ae9c0 con 0x7f54ac15a5e0 2024-05-08T21:10:37.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.236+0000 7f54b2638700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f54ac15a9c0 0x7f54ac06e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:37.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.236+0000 7f54b2638700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f54ac15a9c0 0x7f54ac06e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42750/0 (socket says 172.21.15.80:42750) 2024-05-08T21:10:37.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.236+0000 7f54b2638700 1 -- 172.21.15.80:0/1729964397 learned_addr learned my addr 172.21.15.80:0/1729964397 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:37.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.236+0000 7f54b1636700 1 --2- 172.21.15.80:0/1729964397 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f54ac15a5e0 0x7f54ac14ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:37.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.236+0000 7f54b1e37700 1 --2- 172.21.15.80:0/1729964397 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f54ac06aac0 0x7f54ac0afde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:37.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.236+0000 7f54b2638700 1 -- 172.21.15.80:0/1729964397 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f54ac15a5e0 msgr2=0x7f54ac14ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:37.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.236+0000 7f54b2638700 1 --2- 172.21.15.80:0/1729964397 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f54ac15a5e0 0x7f54ac14ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:37.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.236+0000 7f54b2638700 1 -- 172.21.15.80:0/1729964397 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f54ac06aac0 msgr2=0x7f54ac0afde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:37.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.236+0000 7f54b2638700 1 --2- 172.21.15.80:0/1729964397 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f54ac06aac0 0x7f54ac0afde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:37.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.236+0000 7f54b2638700 1 -- 172.21.15.80:0/1729964397 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f549c0094a0 con 0x7f54ac15a9c0 2024-05-08T21:10:37.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.236+0000 7f54b1636700 1 --2- 172.21.15.80:0/1729964397 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f54ac15a5e0 0x7f54ac14ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:10:37.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.236+0000 7f54b1e37700 1 --2- 172.21.15.80:0/1729964397 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f54ac06aac0 0x7f54ac0afde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:10:37.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.236+0000 7f54b2638700 1 --2- 172.21.15.80:0/1729964397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f54ac15a9c0 0x7f54ac06e780 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f54a400caa0 tx=0x7f54a400ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:37.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.236+0000 7f54a27fc700 1 -- 172.21.15.80:0/1729964397 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a400aa80 con 0x7f54ac15a9c0 2024-05-08T21:10:37.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.237+0000 7f54a27fc700 1 -- 172.21.15.80:0/1729964397 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a400abe0 con 0x7f54ac15a9c0 2024-05-08T21:10:37.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.237+0000 7f54a27fc700 1 -- 172.21.15.80:0/1729964397 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a4012400 con 0x7f54ac15a9c0 2024-05-08T21:10:37.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.237+0000 7f54b409b700 1 -- 172.21.15.80:0/1729964397 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54ac0aec80 con 0x7f54ac15a9c0 2024-05-08T21:10:37.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.237+0000 7f54b409b700 1 -- 172.21.15.80:0/1729964397 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54ac1f0c10 con 0x7f54ac15a9c0 2024-05-08T21:10:37.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.238+0000 7f54b409b700 1 -- 172.21.15.80:0/1729964397 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54ac1f0e00 con 0x7f54ac15a9c0 2024-05-08T21:10:37.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.238+0000 7f54a27fc700 1 -- 172.21.15.80:0/1729964397 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f54a401b3b0 con 0x7f54ac15a9c0 2024-05-08T21:10:37.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.238+0000 7f54a27fc700 1 --2- 172.21.15.80:0/1729964397 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f549006ac90 0x7f549006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:37.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.238+0000 7f54a27fc700 1 -- 172.21.15.80:0/1729964397 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f54a4089480 con 0x7f54ac15a9c0 2024-05-08T21:10:37.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.238+0000 7f54b1e37700 1 --2- 172.21.15.80:0/1729964397 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f549006ac90 0x7f549006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:37.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.239+0000 7f54b1e37700 1 --2- 172.21.15.80:0/1729964397 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f549006ac90 0x7f549006d150 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f54a8000f60 tx=0x7f54a8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:37.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.243+0000 7f54a27fc700 1 -- 172.21.15.80:0/1729964397 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f54a4054240 con 0x7f54ac15a9c0 2024-05-08T21:10:37.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.433+0000 7f54b409b700 1 -- 172.21.15.80:0/1729964397 --> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f54ac070bc0 con 0x7f549006ac90 2024-05-08T21:10:37.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.442+0000 7f54a27fc700 1 -- 172.21.15.80:0/1729964397 <== mgr.4100 v2:172.21.15.80:6832/46731 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345350 (secure 0 0 0) 0x7f54ac070bc0 con 0x7f549006ac90 2024-05-08T21:10:37.450 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:10:37.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.446+0000 7f54b409b700 1 -- 172.21.15.80:0/1729964397 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f549006ac90 msgr2=0x7f549006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:37.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.446+0000 7f54b409b700 1 --2- 172.21.15.80:0/1729964397 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f549006ac90 0x7f549006d150 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f54a8000f60 tx=0x7f54a8009040 comp rx=0 tx=0).stop 2024-05-08T21:10:37.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.446+0000 7f54b409b700 1 -- 172.21.15.80:0/1729964397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f54ac15a9c0 msgr2=0x7f54ac06e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:37.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.446+0000 7f54b409b700 1 --2- 172.21.15.80:0/1729964397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f54ac15a9c0 0x7f54ac06e780 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f54a400caa0 tx=0x7f54a400ce60 comp rx=0 tx=0).stop 2024-05-08T21:10:37.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.446+0000 7f54b409b700 1 -- 172.21.15.80:0/1729964397 shutdown_connections 2024-05-08T21:10:37.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.446+0000 7f54b409b700 1 --2- 172.21.15.80:0/1729964397 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f549006ac90 0x7f549006d150 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:37.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.446+0000 7f54b409b700 1 --2- 172.21.15.80:0/1729964397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f54ac15a9c0 0x7f54ac06e780 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:37.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.446+0000 7f54b409b700 1 --2- 172.21.15.80:0/1729964397 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f54ac06aac0 0x7f54ac0afde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:37.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.446+0000 7f54b409b700 1 --2- 172.21.15.80:0/1729964397 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f54ac15a5e0 0x7f54ac14ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:37.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.446+0000 7f54b409b700 1 -- 172.21.15.80:0/1729964397 >> 172.21.15.80:0/1729964397 conn(0x7f54ac0cbe80 msgr2=0x7f54ac066780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:37.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.446+0000 7f54b409b700 1 -- 172.21.15.80:0/1729964397 shutdown_connections 2024-05-08T21:10:37.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.446+0000 7f54b409b700 1 -- 172.21.15.80:0/1729964397 wait complete. 2024-05-08T21:10:37.454 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-05-08T21:10:37.462 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2024-05-08T21:10:36.205596+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594962,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218452,"kb_used_data":2304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756268,"statfs":{"total":773094113280,"available":772870418432,"internally_reserved":0,"allocated":2359296,"data_stored":2039860,"data_compressed":64612,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003239"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.048091+0000","last_change":"2024-05-08T21:10:03.747477+0000","last_active":"2024-05-08T21:10:08.048091+0000","last_peered":"2024-05-08T21:10:08.048091+0000","last_clean":"2024-05-08T21:10:08.048091+0000","last_became_active":"2024-05-08T21:10:03.747059+0000","last_became_peered":"2024-05-08T21:10:03.747059+0000","last_unstale":"2024-05-08T21:10:08.048091+0000","last_undegraded":"2024-05-08T21:10:08.048091+0000","last_fullsized":"2024-05-08T21:10:08.048091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:15:24.340135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.187600+0000","last_change":"2024-05-08T21:10:03.738974+0000","last_active":"2024-05-08T21:10:08.187600+0000","last_peered":"2024-05-08T21:10:08.187600+0000","last_clean":"2024-05-08T21:10:08.187600+0000","last_became_active":"2024-05-08T21:10:03.738466+0000","last_became_peered":"2024-05-08T21:10:03.738466+0000","last_unstale":"2024-05-08T21:10:08.187600+0000","last_undegraded":"2024-05-08T21:10:08.187600+0000","last_fullsized":"2024-05-08T21:10:08.187600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:59.683039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.753636+0000","last_change":"2024-05-08T21:10:03.740146+0000","last_active":"2024-05-08T21:10:07.753636+0000","last_peered":"2024-05-08T21:10:07.753636+0000","last_clean":"2024-05-08T21:10:07.753636+0000","last_became_active":"2024-05-08T21:10:03.739884+0000","last_became_peered":"2024-05-08T21:10:03.739884+0000","last_unstale":"2024-05-08T21:10:07.753636+0000","last_undegraded":"2024-05-08T21:10:07.753636+0000","last_fullsized":"2024-05-08T21:10:07.753636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:51:44.301305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.168400+0000","last_change":"2024-05-08T21:10:03.754159+0000","last_active":"2024-05-08T21:10:08.168400+0000","last_peered":"2024-05-08T21:10:08.168400+0000","last_clean":"2024-05-08T21:10:08.168400+0000","last_became_active":"2024-05-08T21:10:03.753800+0000","last_became_peered":"2024-05-08T21:10:03.753800+0000","last_unstale":"2024-05-08T21:10:08.168400+0000","last_undegraded":"2024-05-08T21:10:08.168400+0000","last_fullsized":"2024-05-08T21:10:08.168400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:41:02.625080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046322+0000","last_change":"2024-05-08T21:10:03.750051+0000","last_active":"2024-05-08T21:10:08.046322+0000","last_peered":"2024-05-08T21:10:08.046322+0000","last_clean":"2024-05-08T21:10:08.046322+0000","last_became_active":"2024-05-08T21:10:03.749730+0000","last_became_peered":"2024-05-08T21:10:03.749730+0000","last_unstale":"2024-05-08T21:10:08.046322+0000","last_undegraded":"2024-05-08T21:10:08.046322+0000","last_fullsized":"2024-05-08T21:10:08.046322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:49.402253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.168597+0000","last_change":"2024-05-08T21:10:03.746043+0000","last_active":"2024-05-08T21:10:08.168597+0000","last_peered":"2024-05-08T21:10:08.168597+0000","last_clean":"2024-05-08T21:10:08.168597+0000","last_became_active":"2024-05-08T21:10:03.745747+0000","last_became_peered":"2024-05-08T21:10:03.745747+0000","last_unstale":"2024-05-08T21:10:08.168597+0000","last_undegraded":"2024-05-08T21:10:08.168597+0000","last_fullsized":"2024-05-08T21:10:08.168597+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:05:49.465405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046256+0000","last_change":"2024-05-08T21:10:03.743802+0000","last_active":"2024-05-08T21:10:08.046256+0000","last_peered":"2024-05-08T21:10:08.046256+0000","last_clean":"2024-05-08T21:10:08.046256+0000","last_became_active":"2024-05-08T21:10:03.743349+0000","last_became_peered":"2024-05-08T21:10:03.743349+0000","last_unstale":"2024-05-08T21:10:08.046256+0000","last_undegraded":"2024-05-08T21:10:08.046256+0000","last_fullsized":"2024-05-08T21:10:08.046256+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:08:06.408724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.757451+0000","last_change":"2024-05-08T21:10:03.747558+0000","last_active":"2024-05-08T21:10:07.757451+0000","last_peered":"2024-05-08T21:10:07.757451+0000","last_clean":"2024-05-08T21:10:07.757451+0000","last_became_active":"2024-05-08T21:10:03.747300+0000","last_became_peered":"2024-05-08T21:10:03.747300+0000","last_unstale":"2024-05-08T21:10:07.757451+0000","last_undegraded":"2024-05-08T21:10:07.757451+0000","last_fullsized":"2024-05-08T21:10:07.757451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:07:50.266894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046942+0000","last_change":"2024-05-08T21:10:03.748221+0000","last_active":"2024-05-08T21:10:08.046942+0000","last_peered":"2024-05-08T21:10:08.046942+0000","last_clean":"2024-05-08T21:10:08.046942+0000","last_became_active":"2024-05-08T21:10:03.747956+0000","last_became_peered":"2024-05-08T21:10:03.747956+0000","last_unstale":"2024-05-08T21:10:08.046942+0000","last_undegraded":"2024-05-08T21:10:08.046942+0000","last_fullsized":"2024-05-08T21:10:08.046942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:27:35.947884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.271333+0000","last_change":"2024-05-08T21:10:03.745291+0000","last_active":"2024-05-08T21:10:08.271333+0000","last_peered":"2024-05-08T21:10:08.271333+0000","last_clean":"2024-05-08T21:10:08.271333+0000","last_became_active":"2024-05-08T21:10:03.744976+0000","last_became_peered":"2024-05-08T21:10:03.744976+0000","last_unstale":"2024-05-08T21:10:08.271333+0000","last_undegraded":"2024-05-08T21:10:08.271333+0000","last_fullsized":"2024-05-08T21:10:08.271333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:36:54.983642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.271323+0000","last_change":"2024-05-08T21:10:03.748518+0000","last_active":"2024-05-08T21:10:08.271323+0000","last_peered":"2024-05-08T21:10:08.271323+0000","last_clean":"2024-05-08T21:10:08.271323+0000","last_became_active":"2024-05-08T21:10:03.748253+0000","last_became_peered":"2024-05-08T21:10:03.748253+0000","last_unstale":"2024-05-08T21:10:08.271323+0000","last_undegraded":"2024-05-08T21:10:08.271323+0000","last_fullsized":"2024-05-08T21:10:08.271323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:03:26.013122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.170038+0000","last_change":"2024-05-08T21:10:03.745985+0000","last_active":"2024-05-08T21:10:08.170038+0000","last_peered":"2024-05-08T21:10:08.170038+0000","last_clean":"2024-05-08T21:10:08.170038+0000","last_became_active":"2024-05-08T21:10:03.745247+0000","last_became_peered":"2024-05-08T21:10:03.745247+0000","last_unstale":"2024-05-08T21:10:08.170038+0000","last_undegraded":"2024-05-08T21:10:08.170038+0000","last_fullsized":"2024-05-08T21:10:08.170038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:59:42.506304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.761196+0000","last_change":"2024-05-08T21:10:03.747016+0000","last_active":"2024-05-08T21:10:07.761196+0000","last_peered":"2024-05-08T21:10:07.761196+0000","last_clean":"2024-05-08T21:10:07.761196+0000","last_became_active":"2024-05-08T21:10:03.746848+0000","last_became_peered":"2024-05-08T21:10:03.746848+0000","last_unstale":"2024-05-08T21:10:07.761196+0000","last_undegraded":"2024-05-08T21:10:07.761196+0000","last_fullsized":"2024-05-08T21:10:07.761196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:41:21.081035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.753493+0000","last_change":"2024-05-08T21:10:03.737984+0000","last_active":"2024-05-08T21:10:07.753493+0000","last_peered":"2024-05-08T21:10:07.753493+0000","last_clean":"2024-05-08T21:10:07.753493+0000","last_became_active":"2024-05-08T21:10:03.737716+0000","last_became_peered":"2024-05-08T21:10:03.737716+0000","last_unstale":"2024-05-08T21:10:07.753493+0000","last_undegraded":"2024-05-08T21:10:07.753493+0000","last_fullsized":"2024-05-08T21:10:07.753493+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:09:47.758272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.186816+0000","last_change":"2024-05-08T21:10:03.744543+0000","last_active":"2024-05-08T21:10:08.186816+0000","last_peered":"2024-05-08T21:10:08.186816+0000","last_clean":"2024-05-08T21:10:08.186816+0000","last_became_active":"2024-05-08T21:10:03.744276+0000","last_became_peered":"2024-05-08T21:10:03.744276+0000","last_unstale":"2024-05-08T21:10:08.186816+0000","last_undegraded":"2024-05-08T21:10:08.186816+0000","last_fullsized":"2024-05-08T21:10:08.186816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:25:04.113297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.167751+0000","last_change":"2024-05-08T21:10:03.746547+0000","last_active":"2024-05-08T21:10:08.167751+0000","last_peered":"2024-05-08T21:10:08.167751+0000","last_clean":"2024-05-08T21:10:08.167751+0000","last_became_active":"2024-05-08T21:10:03.745862+0000","last_became_peered":"2024-05-08T21:10:03.745862+0000","last_unstale":"2024-05-08T21:10:08.167751+0000","last_undegraded":"2024-05-08T21:10:08.167751+0000","last_fullsized":"2024-05-08T21:10:08.167751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:12.776310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169108+0000","last_change":"2024-05-08T21:10:03.754230+0000","last_active":"2024-05-08T21:10:08.169108+0000","last_peered":"2024-05-08T21:10:08.169108+0000","last_clean":"2024-05-08T21:10:08.169108+0000","last_became_active":"2024-05-08T21:10:03.753895+0000","last_became_peered":"2024-05-08T21:10:03.753895+0000","last_unstale":"2024-05-08T21:10:08.169108+0000","last_undegraded":"2024-05-08T21:10:08.169108+0000","last_fullsized":"2024-05-08T21:10:08.169108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:41:47.214215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.751781+0000","last_change":"2024-05-08T21:10:03.743889+0000","last_active":"2024-05-08T21:10:07.751781+0000","last_peered":"2024-05-08T21:10:07.751781+0000","last_clean":"2024-05-08T21:10:07.751781+0000","last_became_active":"2024-05-08T21:10:03.743596+0000","last_became_peered":"2024-05-08T21:10:03.743596+0000","last_unstale":"2024-05-08T21:10:07.751781+0000","last_undegraded":"2024-05-08T21:10:07.751781+0000","last_fullsized":"2024-05-08T21:10:07.751781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:53.981781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046658+0000","last_change":"2024-05-08T21:10:03.743893+0000","last_active":"2024-05-08T21:10:08.046658+0000","last_peered":"2024-05-08T21:10:08.046658+0000","last_clean":"2024-05-08T21:10:08.046658+0000","last_became_active":"2024-05-08T21:10:03.743580+0000","last_became_peered":"2024-05-08T21:10:03.743580+0000","last_unstale":"2024-05-08T21:10:08.046658+0000","last_undegraded":"2024-05-08T21:10:08.046658+0000","last_fullsized":"2024-05-08T21:10:08.046658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:44:21.747625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.059425+0000","last_change":"2024-05-08T21:10:08.052394+0000","last_active":"2024-05-08T21:10:08.059425+0000","last_peered":"2024-05-08T21:10:08.059425+0000","last_clean":"2024-05-08T21:10:08.059425+0000","last_became_active":"2024-05-08T21:10:08.052009+0000","last_became_peered":"2024-05-08T21:10:08.052009+0000","last_unstale":"2024-05-08T21:10:08.059425+0000","last_undegraded":"2024-05-08T21:10:08.059425+0000","last_fullsized":"2024-05-08T21:10:08.059425+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:47:20.148683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"25'4","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.741230+0000","last_change":"2024-05-08T21:10:03.340118+0000","last_active":"2024-05-08T21:10:08.741230+0000","last_peered":"2024-05-08T21:10:08.741230+0000","last_clean":"2024-05-08T21:10:08.741230+0000","last_became_active":"2024-05-08T21:10:03.339847+0000","last_became_peered":"2024-05-08T21:10:03.339847+0000","last_unstale":"2024-05-08T21:10:08.741230+0000","last_undegraded":"2024-05-08T21:10:08.741230+0000","last_fullsized":"2024-05-08T21:10:08.741230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:05:56.369631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.768418+0000","last_change":"2024-05-08T21:10:03.746516+0000","last_active":"2024-05-08T21:10:07.768418+0000","last_peered":"2024-05-08T21:10:07.768418+0000","last_clean":"2024-05-08T21:10:07.768418+0000","last_became_active":"2024-05-08T21:10:03.746383+0000","last_became_peered":"2024-05-08T21:10:03.746383+0000","last_unstale":"2024-05-08T21:10:07.768418+0000","last_undegraded":"2024-05-08T21:10:07.768418+0000","last_fullsized":"2024-05-08T21:10:07.768418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:29:05.305134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169483+0000","last_change":"2024-05-08T21:10:07.766498+0000","last_active":"2024-05-08T21:10:08.169483+0000","last_peered":"2024-05-08T21:10:08.169483+0000","last_clean":"2024-05-08T21:10:08.169483+0000","last_became_active":"2024-05-08T21:10:07.766119+0000","last_became_peered":"2024-05-08T21:10:07.766119+0000","last_unstale":"2024-05-08T21:10:08.169483+0000","last_undegraded":"2024-05-08T21:10:08.169483+0000","last_fullsized":"2024-05-08T21:10:08.169483+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:58:38.720848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"26'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.508429+0000","last_change":"2024-05-08T21:10:03.329414+0000","last_active":"2024-05-08T21:10:08.508429+0000","last_peered":"2024-05-08T21:10:08.508429+0000","last_clean":"2024-05-08T21:10:08.508429+0000","last_became_active":"2024-05-08T21:10:03.328970+0000","last_became_peered":"2024-05-08T21:10:03.328970+0000","last_unstale":"2024-05-08T21:10:08.508429+0000","last_undegraded":"2024-05-08T21:10:08.508429+0000","last_fullsized":"2024-05-08T21:10:08.508429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:34:32.820755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.753820+0000","last_change":"2024-05-08T21:10:03.748566+0000","last_active":"2024-05-08T21:10:07.753820+0000","last_peered":"2024-05-08T21:10:07.753820+0000","last_clean":"2024-05-08T21:10:07.753820+0000","last_became_active":"2024-05-08T21:10:03.747989+0000","last_became_peered":"2024-05-08T21:10:03.747989+0000","last_unstale":"2024-05-08T21:10:07.753820+0000","last_undegraded":"2024-05-08T21:10:07.753820+0000","last_fullsized":"2024-05-08T21:10:07.753820+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:19:03.468394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169607+0000","last_change":"2024-05-08T21:10:07.770390+0000","last_active":"2024-05-08T21:10:08.169607+0000","last_peered":"2024-05-08T21:10:08.169607+0000","last_clean":"2024-05-08T21:10:08.169607+0000","last_became_active":"2024-05-08T21:10:07.770017+0000","last_became_peered":"2024-05-08T21:10:07.770017+0000","last_unstale":"2024-05-08T21:10:08.169607+0000","last_undegraded":"2024-05-08T21:10:08.169607+0000","last_fullsized":"2024-05-08T21:10:08.169607+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:12:00.200848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.738243+0000","last_change":"2024-05-08T21:10:03.339207+0000","last_active":"2024-05-08T21:10:08.738243+0000","last_peered":"2024-05-08T21:10:08.738243+0000","last_clean":"2024-05-08T21:10:08.738243+0000","last_became_active":"2024-05-08T21:10:03.338917+0000","last_became_peered":"2024-05-08T21:10:03.338917+0000","last_unstale":"2024-05-08T21:10:08.738243+0000","last_undegraded":"2024-05-08T21:10:08.738243+0000","last_fullsized":"2024-05-08T21:10:08.738243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:20.676853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.168481+0000","last_change":"2024-05-08T21:10:03.753998+0000","last_active":"2024-05-08T21:10:08.168481+0000","last_peered":"2024-05-08T21:10:08.168481+0000","last_clean":"2024-05-08T21:10:08.168481+0000","last_became_active":"2024-05-08T21:10:03.753720+0000","last_became_peered":"2024-05-08T21:10:03.753720+0000","last_unstale":"2024-05-08T21:10:08.168481+0000","last_undegraded":"2024-05-08T21:10:08.168481+0000","last_fullsized":"2024-05-08T21:10:08.168481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:00:38.531282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169599+0000","last_change":"2024-05-08T21:10:07.776367+0000","last_active":"2024-05-08T21:10:08.169599+0000","last_peered":"2024-05-08T21:10:08.169599+0000","last_clean":"2024-05-08T21:10:08.169599+0000","last_became_active":"2024-05-08T21:10:07.775998+0000","last_became_peered":"2024-05-08T21:10:07.775998+0000","last_unstale":"2024-05-08T21:10:08.169599+0000","last_undegraded":"2024-05-08T21:10:08.169599+0000","last_fullsized":"2024-05-08T21:10:08.169599+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:24:18.845560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.740209+0000","last_change":"2024-05-08T21:10:03.339182+0000","last_active":"2024-05-08T21:10:08.740209+0000","last_peered":"2024-05-08T21:10:08.740209+0000","last_clean":"2024-05-08T21:10:08.740209+0000","last_became_active":"2024-05-08T21:10:03.338899+0000","last_became_peered":"2024-05-08T21:10:03.338899+0000","last_unstale":"2024-05-08T21:10:08.740209+0000","last_undegraded":"2024-05-08T21:10:08.740209+0000","last_fullsized":"2024-05-08T21:10:08.740209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:55:53.368546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.168672+0000","last_change":"2024-05-08T21:10:03.750724+0000","last_active":"2024-05-08T21:10:08.168672+0000","last_peered":"2024-05-08T21:10:08.168672+0000","last_clean":"2024-05-08T21:10:08.168672+0000","last_became_active":"2024-05-08T21:10:03.750371+0000","last_became_peered":"2024-05-08T21:10:03.750371+0000","last_unstale":"2024-05-08T21:10:08.168672+0000","last_undegraded":"2024-05-08T21:10:08.168672+0000","last_fullsized":"2024-05-08T21:10:08.168672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:14:01.935211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.775704+0000","last_change":"2024-05-08T21:10:07.767604+0000","last_active":"2024-05-08T21:10:07.775704+0000","last_peered":"2024-05-08T21:10:07.775704+0000","last_clean":"2024-05-08T21:10:07.775704+0000","last_became_active":"2024-05-08T21:10:07.767234+0000","last_became_peered":"2024-05-08T21:10:07.767234+0000","last_unstale":"2024-05-08T21:10:07.775704+0000","last_undegraded":"2024-05-08T21:10:07.775704+0000","last_fullsized":"2024-05-08T21:10:07.775704+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:30:21.411491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"26'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.508102+0000","last_change":"2024-05-08T21:10:03.338149+0000","last_active":"2024-05-08T21:10:08.508102+0000","last_peered":"2024-05-08T21:10:08.508102+0000","last_clean":"2024-05-08T21:10:08.508102+0000","last_became_active":"2024-05-08T21:10:03.337860+0000","last_became_peered":"2024-05-08T21:10:03.337860+0000","last_unstale":"2024-05-08T21:10:08.508102+0000","last_undegraded":"2024-05-08T21:10:08.508102+0000","last_fullsized":"2024-05-08T21:10:08.508102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:07:39.052625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169664+0000","last_change":"2024-05-08T21:10:03.743506+0000","last_active":"2024-05-08T21:10:08.169664+0000","last_peered":"2024-05-08T21:10:08.169664+0000","last_clean":"2024-05-08T21:10:08.169664+0000","last_became_active":"2024-05-08T21:10:03.743227+0000","last_became_peered":"2024-05-08T21:10:03.743227+0000","last_unstale":"2024-05-08T21:10:08.169664+0000","last_undegraded":"2024-05-08T21:10:08.169664+0000","last_fullsized":"2024-05-08T21:10:08.169664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:45:47.977619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.741849+0000","last_change":"2024-05-08T21:10:07.768424+0000","last_active":"2024-05-08T21:10:08.741849+0000","last_peered":"2024-05-08T21:10:08.741849+0000","last_clean":"2024-05-08T21:10:08.741849+0000","last_became_active":"2024-05-08T21:10:07.768160+0000","last_became_peered":"2024-05-08T21:10:07.768160+0000","last_unstale":"2024-05-08T21:10:08.741849+0000","last_undegraded":"2024-05-08T21:10:08.741849+0000","last_fullsized":"2024-05-08T21:10:08.741849+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:42:44.327080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"26'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.606664+0000","last_change":"2024-05-08T21:10:03.333647+0000","last_active":"2024-05-08T21:10:08.606664+0000","last_peered":"2024-05-08T21:10:08.606664+0000","last_clean":"2024-05-08T21:10:08.606664+0000","last_became_active":"2024-05-08T21:10:03.332844+0000","last_became_peered":"2024-05-08T21:10:03.332844+0000","last_unstale":"2024-05-08T21:10:08.606664+0000","last_undegraded":"2024-05-08T21:10:08.606664+0000","last_fullsized":"2024-05-08T21:10:08.606664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:47:40.344808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.753370+0000","last_change":"2024-05-08T21:10:03.743003+0000","last_active":"2024-05-08T21:10:07.753370+0000","last_peered":"2024-05-08T21:10:07.753370+0000","last_clean":"2024-05-08T21:10:07.753370+0000","last_became_active":"2024-05-08T21:10:03.742753+0000","last_became_peered":"2024-05-08T21:10:03.742753+0000","last_unstale":"2024-05-08T21:10:07.753370+0000","last_undegraded":"2024-05-08T21:10:07.753370+0000","last_fullsized":"2024-05-08T21:10:07.753370+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:45:49.575877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.271366+0000","last_change":"2024-05-08T21:10:07.770105+0000","last_active":"2024-05-08T21:10:08.271366+0000","last_peered":"2024-05-08T21:10:08.271366+0000","last_clean":"2024-05-08T21:10:08.271366+0000","last_became_active":"2024-05-08T21:10:07.769668+0000","last_became_peered":"2024-05-08T21:10:07.769668+0000","last_unstale":"2024-05-08T21:10:08.271366+0000","last_undegraded":"2024-05-08T21:10:08.271366+0000","last_fullsized":"2024-05-08T21:10:08.271366+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:07:21.560031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.766792+0000","last_change":"2024-05-08T21:10:03.333025+0000","last_active":"2024-05-08T21:10:07.766792+0000","last_peered":"2024-05-08T21:10:07.766792+0000","last_clean":"2024-05-08T21:10:07.766792+0000","last_became_active":"2024-05-08T21:10:03.332750+0000","last_became_peered":"2024-05-08T21:10:03.332750+0000","last_unstale":"2024-05-08T21:10:07.766792+0000","last_undegraded":"2024-05-08T21:10:07.766792+0000","last_fullsized":"2024-05-08T21:10:07.766792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:20:50.134647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.756963+0000","last_change":"2024-05-08T21:10:03.744023+0000","last_active":"2024-05-08T21:10:07.756963+0000","last_peered":"2024-05-08T21:10:07.756963+0000","last_clean":"2024-05-08T21:10:07.756963+0000","last_became_active":"2024-05-08T21:10:03.743724+0000","last_became_peered":"2024-05-08T21:10:03.743724+0000","last_unstale":"2024-05-08T21:10:07.756963+0000","last_undegraded":"2024-05-08T21:10:07.756963+0000","last_fullsized":"2024-05-08T21:10:07.756963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:50:36.857245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.059558+0000","last_change":"2024-05-08T21:10:08.052307+0000","last_active":"2024-05-08T21:10:08.059558+0000","last_peered":"2024-05-08T21:10:08.059558+0000","last_clean":"2024-05-08T21:10:08.059558+0000","last_became_active":"2024-05-08T21:10:08.051924+0000","last_became_peered":"2024-05-08T21:10:08.051924+0000","last_unstale":"2024-05-08T21:10:08.059558+0000","last_undegraded":"2024-05-08T21:10:08.059558+0000","last_fullsized":"2024-05-08T21:10:08.059558+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:56:37.264246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.750197+0000","last_change":"2024-05-08T21:10:03.330304+0000","last_active":"2024-05-08T21:10:07.750197+0000","last_peered":"2024-05-08T21:10:07.750197+0000","last_clean":"2024-05-08T21:10:07.750197+0000","last_became_active":"2024-05-08T21:10:03.330054+0000","last_became_peered":"2024-05-08T21:10:03.330054+0000","last_unstale":"2024-05-08T21:10:07.750197+0000","last_undegraded":"2024-05-08T21:10:07.750197+0000","last_fullsized":"2024-05-08T21:10:07.750197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:30.518935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.186997+0000","last_change":"2024-05-08T21:10:03.739687+0000","last_active":"2024-05-08T21:10:08.186997+0000","last_peered":"2024-05-08T21:10:08.186997+0000","last_clean":"2024-05-08T21:10:08.186997+0000","last_became_active":"2024-05-08T21:10:03.739425+0000","last_became_peered":"2024-05-08T21:10:03.739425+0000","last_unstale":"2024-05-08T21:10:08.186997+0000","last_undegraded":"2024-05-08T21:10:08.186997+0000","last_fullsized":"2024-05-08T21:10:08.186997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:45:59.295081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.054235+0000","last_change":"2024-05-08T21:10:08.050980+0000","last_active":"2024-05-08T21:10:08.054235+0000","last_peered":"2024-05-08T21:10:08.054235+0000","last_clean":"2024-05-08T21:10:08.054235+0000","last_became_active":"2024-05-08T21:10:08.050625+0000","last_became_peered":"2024-05-08T21:10:08.050625+0000","last_unstale":"2024-05-08T21:10:08.054235+0000","last_undegraded":"2024-05-08T21:10:08.054235+0000","last_fullsized":"2024-05-08T21:10:08.054235+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:39:43.917363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.755963+0000","last_change":"2024-05-08T21:10:03.331297+0000","last_active":"2024-05-08T21:10:07.755963+0000","last_peered":"2024-05-08T21:10:07.755963+0000","last_clean":"2024-05-08T21:10:07.755963+0000","last_became_active":"2024-05-08T21:10:03.330973+0000","last_became_peered":"2024-05-08T21:10:03.330973+0000","last_unstale":"2024-05-08T21:10:07.755963+0000","last_undegraded":"2024-05-08T21:10:07.755963+0000","last_fullsized":"2024-05-08T21:10:07.755963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:57:26.190186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.168346+0000","last_change":"2024-05-08T21:10:03.751746+0000","last_active":"2024-05-08T21:10:08.168346+0000","last_peered":"2024-05-08T21:10:08.168346+0000","last_clean":"2024-05-08T21:10:08.168346+0000","last_became_active":"2024-05-08T21:10:03.751426+0000","last_became_peered":"2024-05-08T21:10:03.751426+0000","last_unstale":"2024-05-08T21:10:08.168346+0000","last_undegraded":"2024-05-08T21:10:08.168346+0000","last_fullsized":"2024-05-08T21:10:08.168346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:00:23.529543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.778416+0000","last_change":"2024-05-08T21:10:07.771834+0000","last_active":"2024-05-08T21:10:07.778416+0000","last_peered":"2024-05-08T21:10:07.778416+0000","last_clean":"2024-05-08T21:10:07.778416+0000","last_became_active":"2024-05-08T21:10:07.771324+0000","last_became_peered":"2024-05-08T21:10:07.771324+0000","last_unstale":"2024-05-08T21:10:07.778416+0000","last_undegraded":"2024-05-08T21:10:07.778416+0000","last_fullsized":"2024-05-08T21:10:07.778416+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:35.948317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.749656+0000","last_change":"2024-05-08T21:10:03.332049+0000","last_active":"2024-05-08T21:10:07.749656+0000","last_peered":"2024-05-08T21:10:07.749656+0000","last_clean":"2024-05-08T21:10:07.749656+0000","last_became_active":"2024-05-08T21:10:03.331712+0000","last_became_peered":"2024-05-08T21:10:03.331712+0000","last_unstale":"2024-05-08T21:10:07.749656+0000","last_undegraded":"2024-05-08T21:10:07.749656+0000","last_fullsized":"2024-05-08T21:10:07.749656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:30:16.135672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.753983+0000","last_change":"2024-05-08T21:10:03.748728+0000","last_active":"2024-05-08T21:10:07.753983+0000","last_peered":"2024-05-08T21:10:07.753983+0000","last_clean":"2024-05-08T21:10:07.753983+0000","last_became_active":"2024-05-08T21:10:03.748315+0000","last_became_peered":"2024-05-08T21:10:03.748315+0000","last_unstale":"2024-05-08T21:10:07.753983+0000","last_undegraded":"2024-05-08T21:10:07.753983+0000","last_fullsized":"2024-05-08T21:10:07.753983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:14:15.224603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.170061+0000","last_change":"2024-05-08T21:10:07.761559+0000","last_active":"2024-05-08T21:10:08.170061+0000","last_peered":"2024-05-08T21:10:08.170061+0000","last_clean":"2024-05-08T21:10:08.170061+0000","last_became_active":"2024-05-08T21:10:07.761129+0000","last_became_peered":"2024-05-08T21:10:07.761129+0000","last_unstale":"2024-05-08T21:10:08.170061+0000","last_undegraded":"2024-05-08T21:10:08.170061+0000","last_fullsized":"2024-05-08T21:10:08.170061+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:29:03.444853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'3","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.737377+0000","last_change":"2024-05-08T21:10:03.333077+0000","last_active":"2024-05-08T21:10:08.737377+0000","last_peered":"2024-05-08T21:10:08.737377+0000","last_clean":"2024-05-08T21:10:08.737377+0000","last_became_active":"2024-05-08T21:10:03.332796+0000","last_became_peered":"2024-05-08T21:10:03.332796+0000","last_unstale":"2024-05-08T21:10:08.737377+0000","last_undegraded":"2024-05-08T21:10:08.737377+0000","last_fullsized":"2024-05-08T21:10:08.737377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:30:16.135672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169929+0000","last_change":"2024-05-08T21:10:03.751370+0000","last_active":"2024-05-08T21:10:08.169929+0000","last_peered":"2024-05-08T21:10:08.169929+0000","last_clean":"2024-05-08T21:10:08.169929+0000","last_became_active":"2024-05-08T21:10:03.750394+0000","last_became_peered":"2024-05-08T21:10:03.750394+0000","last_unstale":"2024-05-08T21:10:08.169929+0000","last_undegraded":"2024-05-08T21:10:08.169929+0000","last_fullsized":"2024-05-08T21:10:08.169929+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:31:06.682543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.187439+0000","last_change":"2024-05-08T21:10:07.764815+0000","last_active":"2024-05-08T21:10:08.187439+0000","last_peered":"2024-05-08T21:10:08.187439+0000","last_clean":"2024-05-08T21:10:08.187439+0000","last_became_active":"2024-05-08T21:10:07.763591+0000","last_became_peered":"2024-05-08T21:10:07.763591+0000","last_unstale":"2024-05-08T21:10:08.187439+0000","last_undegraded":"2024-05-08T21:10:08.187439+0000","last_fullsized":"2024-05-08T21:10:08.187439+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:47.977517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:17.506385+0000","last_change":"2024-05-08T21:10:03.342400+0000","last_active":"2024-05-08T21:10:17.506385+0000","last_peered":"2024-05-08T21:10:17.506385+0000","last_clean":"2024-05-08T21:10:17.506385+0000","last_became_active":"2024-05-08T21:10:03.342202+0000","last_became_peered":"2024-05-08T21:10:03.342202+0000","last_unstale":"2024-05-08T21:10:17.506385+0000","last_undegraded":"2024-05-08T21:10:17.506385+0000","last_fullsized":"2024-05-08T21:10:17.506385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:10:04.668029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3796,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046564+0000","last_change":"2024-05-08T21:10:03.752144+0000","last_active":"2024-05-08T21:10:08.046564+0000","last_peered":"2024-05-08T21:10:08.046564+0000","last_clean":"2024-05-08T21:10:08.046564+0000","last_became_active":"2024-05-08T21:10:03.751868+0000","last_became_peered":"2024-05-08T21:10:03.751868+0000","last_unstale":"2024-05-08T21:10:08.046564+0000","last_undegraded":"2024-05-08T21:10:08.046564+0000","last_fullsized":"2024-05-08T21:10:08.046564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:40:43.168591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.168406+0000","last_change":"2024-05-08T21:10:08.052390+0000","last_active":"2024-05-08T21:10:08.168406+0000","last_peered":"2024-05-08T21:10:08.168406+0000","last_clean":"2024-05-08T21:10:08.168406+0000","last_became_active":"2024-05-08T21:10:08.051967+0000","last_became_peered":"2024-05-08T21:10:08.051967+0000","last_unstale":"2024-05-08T21:10:08.168406+0000","last_undegraded":"2024-05-08T21:10:08.168406+0000","last_fullsized":"2024-05-08T21:10:08.168406+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:40:07.127492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.739991+0000","last_change":"2024-05-08T21:10:03.330102+0000","last_active":"2024-05-08T21:10:08.739991+0000","last_peered":"2024-05-08T21:10:08.739991+0000","last_clean":"2024-05-08T21:10:08.739991+0000","last_became_active":"2024-05-08T21:10:03.329761+0000","last_became_peered":"2024-05-08T21:10:03.329761+0000","last_unstale":"2024-05-08T21:10:08.739991+0000","last_undegraded":"2024-05-08T21:10:08.739991+0000","last_fullsized":"2024-05-08T21:10:08.739991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:37:14.930549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.753579+0000","last_change":"2024-05-08T21:10:03.749332+0000","last_active":"2024-05-08T21:10:07.753579+0000","last_peered":"2024-05-08T21:10:07.753579+0000","last_clean":"2024-05-08T21:10:07.753579+0000","last_became_active":"2024-05-08T21:10:03.749094+0000","last_became_peered":"2024-05-08T21:10:03.749094+0000","last_unstale":"2024-05-08T21:10:07.753579+0000","last_undegraded":"2024-05-08T21:10:07.753579+0000","last_fullsized":"2024-05-08T21:10:07.753579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:25.969085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.048813+0000","last_change":"2024-05-08T21:10:08.048331+0000","last_active":"2024-05-08T21:10:08.048813+0000","last_peered":"2024-05-08T21:10:08.048813+0000","last_clean":"2024-05-08T21:10:08.048813+0000","last_became_active":"2024-05-08T21:10:08.047505+0000","last_became_peered":"2024-05-08T21:10:08.047505+0000","last_unstale":"2024-05-08T21:10:08.048813+0000","last_undegraded":"2024-05-08T21:10:08.048813+0000","last_fullsized":"2024-05-08T21:10:08.048813+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:18:39.268730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.749622+0000","last_change":"2024-05-08T21:10:03.328021+0000","last_active":"2024-05-08T21:10:07.749622+0000","last_peered":"2024-05-08T21:10:07.749622+0000","last_clean":"2024-05-08T21:10:07.749622+0000","last_became_active":"2024-05-08T21:10:03.327648+0000","last_became_peered":"2024-05-08T21:10:03.327648+0000","last_unstale":"2024-05-08T21:10:07.749622+0000","last_undegraded":"2024-05-08T21:10:07.749622+0000","last_fullsized":"2024-05-08T21:10:07.749622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:37:54.491930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046495+0000","last_change":"2024-05-08T21:10:03.750560+0000","last_active":"2024-05-08T21:10:08.046495+0000","last_peered":"2024-05-08T21:10:08.046495+0000","last_clean":"2024-05-08T21:10:08.046495+0000","last_became_active":"2024-05-08T21:10:03.750294+0000","last_became_peered":"2024-05-08T21:10:03.750294+0000","last_unstale":"2024-05-08T21:10:08.046495+0000","last_undegraded":"2024-05-08T21:10:08.046495+0000","last_fullsized":"2024-05-08T21:10:08.046495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:30:47.937326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.059433+0000","last_change":"2024-05-08T21:10:08.052318+0000","last_active":"2024-05-08T21:10:08.059433+0000","last_peered":"2024-05-08T21:10:08.059433+0000","last_clean":"2024-05-08T21:10:08.059433+0000","last_became_active":"2024-05-08T21:10:08.051920+0000","last_became_peered":"2024-05-08T21:10:08.051920+0000","last_unstale":"2024-05-08T21:10:08.059433+0000","last_undegraded":"2024-05-08T21:10:08.059433+0000","last_fullsized":"2024-05-08T21:10:08.059433+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:25:27.669768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.754124+0000","last_change":"2024-05-08T21:10:03.332390+0000","last_active":"2024-05-08T21:10:07.754124+0000","last_peered":"2024-05-08T21:10:07.754124+0000","last_clean":"2024-05-08T21:10:07.754124+0000","last_became_active":"2024-05-08T21:10:03.332105+0000","last_became_peered":"2024-05-08T21:10:03.332105+0000","last_unstale":"2024-05-08T21:10:07.754124+0000","last_undegraded":"2024-05-08T21:10:07.754124+0000","last_fullsized":"2024-05-08T21:10:07.754124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:32:44.705682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.271145+0000","last_change":"2024-05-08T21:10:03.742100+0000","last_active":"2024-05-08T21:10:08.271145+0000","last_peered":"2024-05-08T21:10:08.271145+0000","last_clean":"2024-05-08T21:10:08.271145+0000","last_became_active":"2024-05-08T21:10:03.741742+0000","last_became_peered":"2024-05-08T21:10:03.741742+0000","last_unstale":"2024-05-08T21:10:08.271145+0000","last_undegraded":"2024-05-08T21:10:08.271145+0000","last_fullsized":"2024-05-08T21:10:08.271145+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:53:19.394126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.775032+0000","last_change":"2024-05-08T21:10:07.769850+0000","last_active":"2024-05-08T21:10:07.775032+0000","last_peered":"2024-05-08T21:10:07.775032+0000","last_clean":"2024-05-08T21:10:07.775032+0000","last_became_active":"2024-05-08T21:10:07.769016+0000","last_became_peered":"2024-05-08T21:10:07.769016+0000","last_unstale":"2024-05-08T21:10:07.775032+0000","last_undegraded":"2024-05-08T21:10:07.775032+0000","last_fullsized":"2024-05-08T21:10:07.775032+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:31:52.621418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"25'8","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.741624+0000","last_change":"2024-05-08T21:10:03.331783+0000","last_active":"2024-05-08T21:10:08.741624+0000","last_peered":"2024-05-08T21:10:08.741624+0000","last_clean":"2024-05-08T21:10:08.741624+0000","last_became_active":"2024-05-08T21:10:03.331501+0000","last_became_peered":"2024-05-08T21:10:03.331501+0000","last_unstale":"2024-05-08T21:10:08.741624+0000","last_undegraded":"2024-05-08T21:10:08.741624+0000","last_fullsized":"2024-05-08T21:10:08.741624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:41:28.137295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046481+0000","last_change":"2024-05-08T21:10:03.744007+0000","last_active":"2024-05-08T21:10:08.046481+0000","last_peered":"2024-05-08T21:10:08.046481+0000","last_clean":"2024-05-08T21:10:08.046481+0000","last_became_active":"2024-05-08T21:10:03.743557+0000","last_became_peered":"2024-05-08T21:10:03.743557+0000","last_unstale":"2024-05-08T21:10:08.046481+0000","last_undegraded":"2024-05-08T21:10:08.046481+0000","last_fullsized":"2024-05-08T21:10:08.046481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:45:26.458377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169408+0000","last_change":"2024-05-08T21:10:07.777283+0000","last_active":"2024-05-08T21:10:08.169408+0000","last_peered":"2024-05-08T21:10:08.169408+0000","last_clean":"2024-05-08T21:10:08.169408+0000","last_became_active":"2024-05-08T21:10:07.776858+0000","last_became_peered":"2024-05-08T21:10:07.776858+0000","last_unstale":"2024-05-08T21:10:08.169408+0000","last_undegraded":"2024-05-08T21:10:08.169408+0000","last_fullsized":"2024-05-08T21:10:08.169408+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:51.725885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"26'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.170185+0000","last_change":"2024-05-08T21:10:03.326892+0000","last_active":"2024-05-08T21:10:08.170185+0000","last_peered":"2024-05-08T21:10:08.170185+0000","last_clean":"2024-05-08T21:10:08.170185+0000","last_became_active":"2024-05-08T21:10:03.326608+0000","last_became_peered":"2024-05-08T21:10:03.326608+0000","last_unstale":"2024-05-08T21:10:08.170185+0000","last_undegraded":"2024-05-08T21:10:08.170185+0000","last_fullsized":"2024-05-08T21:10:08.170185+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:33.441985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046649+0000","last_change":"2024-05-08T21:10:03.749221+0000","last_active":"2024-05-08T21:10:08.046649+0000","last_peered":"2024-05-08T21:10:08.046649+0000","last_clean":"2024-05-08T21:10:08.046649+0000","last_became_active":"2024-05-08T21:10:03.748915+0000","last_became_peered":"2024-05-08T21:10:03.748915+0000","last_unstale":"2024-05-08T21:10:08.046649+0000","last_undegraded":"2024-05-08T21:10:08.046649+0000","last_fullsized":"2024-05-08T21:10:08.046649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:03:10.791535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.187371+0000","last_change":"2024-05-08T21:10:07.759492+0000","last_active":"2024-05-08T21:10:08.187371+0000","last_peered":"2024-05-08T21:10:08.187371+0000","last_clean":"2024-05-08T21:10:08.187371+0000","last_became_active":"2024-05-08T21:10:07.759139+0000","last_became_peered":"2024-05-08T21:10:07.759139+0000","last_unstale":"2024-05-08T21:10:08.187371+0000","last_undegraded":"2024-05-08T21:10:08.187371+0000","last_fullsized":"2024-05-08T21:10:08.187371+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:10.579105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.743655+0000","last_change":"2024-05-08T21:10:03.329020+0000","last_active":"2024-05-08T21:10:07.743655+0000","last_peered":"2024-05-08T21:10:07.743655+0000","last_clean":"2024-05-08T21:10:07.743655+0000","last_became_active":"2024-05-08T21:10:03.328739+0000","last_became_peered":"2024-05-08T21:10:03.328739+0000","last_unstale":"2024-05-08T21:10:07.743655+0000","last_undegraded":"2024-05-08T21:10:07.743655+0000","last_fullsized":"2024-05-08T21:10:07.743655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:27:11.168780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.168756+0000","last_change":"2024-05-08T21:10:03.744662+0000","last_active":"2024-05-08T21:10:08.168756+0000","last_peered":"2024-05-08T21:10:08.168756+0000","last_clean":"2024-05-08T21:10:08.168756+0000","last_became_active":"2024-05-08T21:10:03.744398+0000","last_became_peered":"2024-05-08T21:10:03.744398+0000","last_unstale":"2024-05-08T21:10:08.168756+0000","last_undegraded":"2024-05-08T21:10:08.168756+0000","last_fullsized":"2024-05-08T21:10:08.168756+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:05:28.046055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.187253+0000","last_change":"2024-05-08T21:10:07.776566+0000","last_active":"2024-05-08T21:10:08.187253+0000","last_peered":"2024-05-08T21:10:08.187253+0000","last_clean":"2024-05-08T21:10:08.187253+0000","last_became_active":"2024-05-08T21:10:07.776080+0000","last_became_peered":"2024-05-08T21:10:07.776080+0000","last_unstale":"2024-05-08T21:10:08.187253+0000","last_undegraded":"2024-05-08T21:10:08.187253+0000","last_fullsized":"2024-05-08T21:10:08.187253+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:26:09.323466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.749542+0000","last_change":"2024-05-08T21:10:03.332953+0000","last_active":"2024-05-08T21:10:07.749542+0000","last_peered":"2024-05-08T21:10:07.749542+0000","last_clean":"2024-05-08T21:10:07.749542+0000","last_became_active":"2024-05-08T21:10:03.332689+0000","last_became_peered":"2024-05-08T21:10:03.332689+0000","last_unstale":"2024-05-08T21:10:07.749542+0000","last_undegraded":"2024-05-08T21:10:07.749542+0000","last_fullsized":"2024-05-08T21:10:07.749542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:15:32.058369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169816+0000","last_change":"2024-05-08T21:10:03.745651+0000","last_active":"2024-05-08T21:10:08.169816+0000","last_peered":"2024-05-08T21:10:08.169816+0000","last_clean":"2024-05-08T21:10:08.169816+0000","last_became_active":"2024-05-08T21:10:03.742744+0000","last_became_peered":"2024-05-08T21:10:03.742744+0000","last_unstale":"2024-05-08T21:10:08.169816+0000","last_undegraded":"2024-05-08T21:10:08.169816+0000","last_fullsized":"2024-05-08T21:10:08.169816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:32:31.689490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.187096+0000","last_change":"2024-05-08T21:10:07.776527+0000","last_active":"2024-05-08T21:10:08.187096+0000","last_peered":"2024-05-08T21:10:08.187096+0000","last_clean":"2024-05-08T21:10:08.187096+0000","last_became_active":"2024-05-08T21:10:07.776053+0000","last_became_peered":"2024-05-08T21:10:07.776053+0000","last_unstale":"2024-05-08T21:10:08.187096+0000","last_undegraded":"2024-05-08T21:10:08.187096+0000","last_fullsized":"2024-05-08T21:10:08.187096+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:08:26.401358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.186861+0000","last_change":"2024-05-08T21:10:03.738421+0000","last_active":"2024-05-08T21:10:08.186861+0000","last_peered":"2024-05-08T21:10:08.186861+0000","last_clean":"2024-05-08T21:10:08.186861+0000","last_became_active":"2024-05-08T21:10:03.738000+0000","last_became_peered":"2024-05-08T21:10:03.738000+0000","last_unstale":"2024-05-08T21:10:08.186861+0000","last_undegraded":"2024-05-08T21:10:08.186861+0000","last_fullsized":"2024-05-08T21:10:08.186861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:38:05.948755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.751476+0000","last_change":"2024-05-08T21:10:03.331141+0000","last_active":"2024-05-08T21:10:07.751476+0000","last_peered":"2024-05-08T21:10:07.751476+0000","last_clean":"2024-05-08T21:10:07.751476+0000","last_became_active":"2024-05-08T21:10:03.330842+0000","last_became_peered":"2024-05-08T21:10:03.330842+0000","last_unstale":"2024-05-08T21:10:07.751476+0000","last_undegraded":"2024-05-08T21:10:07.751476+0000","last_fullsized":"2024-05-08T21:10:07.751476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:42:52.648932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.271310+0000","last_change":"2024-05-08T21:10:08.049274+0000","last_active":"2024-05-08T21:10:08.271310+0000","last_peered":"2024-05-08T21:10:08.271310+0000","last_clean":"2024-05-08T21:10:08.271310+0000","last_became_active":"2024-05-08T21:10:08.048763+0000","last_became_peered":"2024-05-08T21:10:08.048763+0000","last_unstale":"2024-05-08T21:10:08.271310+0000","last_undegraded":"2024-05-08T21:10:08.271310+0000","last_fullsized":"2024-05-08T21:10:08.271310+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:00:41.257040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.754546+0000","last_change":"2024-05-08T21:10:03.747594+0000","last_active":"2024-05-08T21:10:07.754546+0000","last_peered":"2024-05-08T21:10:07.754546+0000","last_clean":"2024-05-08T21:10:07.754546+0000","last_became_active":"2024-05-08T21:10:03.747360+0000","last_became_peered":"2024-05-08T21:10:03.747360+0000","last_unstale":"2024-05-08T21:10:07.754546+0000","last_undegraded":"2024-05-08T21:10:07.754546+0000","last_fullsized":"2024-05-08T21:10:07.754546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:31:12.357348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.749455+0000","last_change":"2024-05-08T21:10:03.327847+0000","last_active":"2024-05-08T21:10:07.749455+0000","last_peered":"2024-05-08T21:10:07.749455+0000","last_clean":"2024-05-08T21:10:07.749455+0000","last_became_active":"2024-05-08T21:10:03.327530+0000","last_became_peered":"2024-05-08T21:10:03.327530+0000","last_unstale":"2024-05-08T21:10:07.749455+0000","last_undegraded":"2024-05-08T21:10:07.749455+0000","last_fullsized":"2024-05-08T21:10:07.749455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:46.232166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":168,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046147+0000","last_change":"2024-05-08T21:09:59.333990+0000","last_active":"2024-05-08T21:10:08.046147+0000","last_peered":"2024-05-08T21:10:08.046147+0000","last_clean":"2024-05-08T21:10:08.046147+0000","last_became_active":"2024-05-08T21:09:59.332929+0000","last_became_peered":"2024-05-08T21:09:59.332929+0000","last_unstale":"2024-05-08T21:10:08.046147+0000","last_undegraded":"2024-05-08T21:10:08.046147+0000","last_fullsized":"2024-05-08T21:10:08.046147+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:09:58.287675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:09:58.287675+0000","last_clean_scrub_stamp":"2024-05-08T21:09:58.287675+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:47.595380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.052138+0000","last_change":"2024-05-08T21:10:08.049848+0000","last_active":"2024-05-08T21:10:08.052138+0000","last_peered":"2024-05-08T21:10:08.052138+0000","last_clean":"2024-05-08T21:10:08.052138+0000","last_became_active":"2024-05-08T21:10:08.049153+0000","last_became_peered":"2024-05-08T21:10:08.049153+0000","last_unstale":"2024-05-08T21:10:08.052138+0000","last_undegraded":"2024-05-08T21:10:08.052138+0000","last_fullsized":"2024-05-08T21:10:08.052138+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:23.704112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.753311+0000","last_change":"2024-05-08T21:10:03.743094+0000","last_active":"2024-05-08T21:10:07.753311+0000","last_peered":"2024-05-08T21:10:07.753311+0000","last_clean":"2024-05-08T21:10:07.753311+0000","last_became_active":"2024-05-08T21:10:03.742819+0000","last_became_peered":"2024-05-08T21:10:03.742819+0000","last_unstale":"2024-05-08T21:10:07.753311+0000","last_undegraded":"2024-05-08T21:10:07.753311+0000","last_fullsized":"2024-05-08T21:10:07.753311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:41:25.593884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046341+0000","last_change":"2024-05-08T21:10:03.340259+0000","last_active":"2024-05-08T21:10:08.046341+0000","last_peered":"2024-05-08T21:10:08.046341+0000","last_clean":"2024-05-08T21:10:08.046341+0000","last_became_active":"2024-05-08T21:10:03.339957+0000","last_became_peered":"2024-05-08T21:10:03.339957+0000","last_unstale":"2024-05-08T21:10:08.046341+0000","last_undegraded":"2024-05-08T21:10:08.046341+0000","last_fullsized":"2024-05-08T21:10:08.046341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:38:36.535689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.051520+0000","last_change":"2024-05-08T21:10:08.050370+0000","last_active":"2024-05-08T21:10:08.051520+0000","last_peered":"2024-05-08T21:10:08.051520+0000","last_clean":"2024-05-08T21:10:08.051520+0000","last_became_active":"2024-05-08T21:10:08.049962+0000","last_became_peered":"2024-05-08T21:10:08.049962+0000","last_unstale":"2024-05-08T21:10:08.051520+0000","last_undegraded":"2024-05-08T21:10:08.051520+0000","last_fullsized":"2024-05-08T21:10:08.051520+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:11:35.394334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046359+0000","last_change":"2024-05-08T21:10:03.337949+0000","last_active":"2024-05-08T21:10:08.046359+0000","last_peered":"2024-05-08T21:10:08.046359+0000","last_clean":"2024-05-08T21:10:08.046359+0000","last_became_active":"2024-05-08T21:10:03.337627+0000","last_became_peered":"2024-05-08T21:10:03.337627+0000","last_unstale":"2024-05-08T21:10:08.046359+0000","last_undegraded":"2024-05-08T21:10:08.046359+0000","last_fullsized":"2024-05-08T21:10:08.046359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:17:36.792731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.187476+0000","last_change":"2024-05-08T21:10:03.738212+0000","last_active":"2024-05-08T21:10:08.187476+0000","last_peered":"2024-05-08T21:10:08.187476+0000","last_clean":"2024-05-08T21:10:08.187476+0000","last_became_active":"2024-05-08T21:10:03.737927+0000","last_became_peered":"2024-05-08T21:10:03.737927+0000","last_unstale":"2024-05-08T21:10:08.187476+0000","last_undegraded":"2024-05-08T21:10:08.187476+0000","last_fullsized":"2024-05-08T21:10:08.187476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:03:08.031584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.059425+0000","last_change":"2024-05-08T21:10:08.052270+0000","last_active":"2024-05-08T21:10:08.059425+0000","last_peered":"2024-05-08T21:10:08.059425+0000","last_clean":"2024-05-08T21:10:08.059425+0000","last_became_active":"2024-05-08T21:10:08.051881+0000","last_became_peered":"2024-05-08T21:10:08.051881+0000","last_unstale":"2024-05-08T21:10:08.059425+0000","last_undegraded":"2024-05-08T21:10:08.059425+0000","last_fullsized":"2024-05-08T21:10:08.059425+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:39:07.929942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.187471+0000","last_change":"2024-05-08T21:10:03.333696+0000","last_active":"2024-05-08T21:10:08.187471+0000","last_peered":"2024-05-08T21:10:08.187471+0000","last_clean":"2024-05-08T21:10:08.187471+0000","last_became_active":"2024-05-08T21:10:03.333368+0000","last_became_peered":"2024-05-08T21:10:03.333368+0000","last_unstale":"2024-05-08T21:10:08.187471+0000","last_undegraded":"2024-05-08T21:10:08.187471+0000","last_fullsized":"2024-05-08T21:10:08.187471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:00:08.459270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.762624+0000","last_change":"2024-05-08T21:10:03.752578+0000","last_active":"2024-05-08T21:10:07.762624+0000","last_peered":"2024-05-08T21:10:07.762624+0000","last_clean":"2024-05-08T21:10:07.762624+0000","last_became_active":"2024-05-08T21:10:03.752389+0000","last_became_peered":"2024-05-08T21:10:03.752389+0000","last_unstale":"2024-05-08T21:10:07.762624+0000","last_undegraded":"2024-05-08T21:10:07.762624+0000","last_fullsized":"2024-05-08T21:10:07.762624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:54:02.318162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169418+0000","last_change":"2024-05-08T21:10:08.048081+0000","last_active":"2024-05-08T21:10:08.169418+0000","last_peered":"2024-05-08T21:10:08.169418+0000","last_clean":"2024-05-08T21:10:08.169418+0000","last_became_active":"2024-05-08T21:10:08.047632+0000","last_became_peered":"2024-05-08T21:10:08.047632+0000","last_unstale":"2024-05-08T21:10:08.169418+0000","last_undegraded":"2024-05-08T21:10:08.169418+0000","last_fullsized":"2024-05-08T21:10:08.169418+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:26:05.857718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"26'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.738320+0000","last_change":"2024-05-08T21:10:03.340553+0000","last_active":"2024-05-08T21:10:08.738320+0000","last_peered":"2024-05-08T21:10:08.738320+0000","last_clean":"2024-05-08T21:10:08.738320+0000","last_became_active":"2024-05-08T21:10:03.340280+0000","last_became_peered":"2024-05-08T21:10:03.340280+0000","last_unstale":"2024-05-08T21:10:08.738320+0000","last_undegraded":"2024-05-08T21:10:08.738320+0000","last_fullsized":"2024-05-08T21:10:08.738320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:36:24.866220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.754313+0000","last_change":"2024-05-08T21:10:03.736316+0000","last_active":"2024-05-08T21:10:07.754313+0000","last_peered":"2024-05-08T21:10:07.754313+0000","last_clean":"2024-05-08T21:10:07.754313+0000","last_became_active":"2024-05-08T21:10:03.736049+0000","last_became_peered":"2024-05-08T21:10:03.736049+0000","last_unstale":"2024-05-08T21:10:07.754313+0000","last_undegraded":"2024-05-08T21:10:07.754313+0000","last_fullsized":"2024-05-08T21:10:07.754313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:09:48.973609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.170097+0000","last_change":"2024-05-08T21:10:07.777357+0000","last_active":"2024-05-08T21:10:08.170097+0000","last_peered":"2024-05-08T21:10:08.170097+0000","last_clean":"2024-05-08T21:10:08.170097+0000","last_became_active":"2024-05-08T21:10:07.776848+0000","last_became_peered":"2024-05-08T21:10:07.776848+0000","last_unstale":"2024-05-08T21:10:08.170097+0000","last_undegraded":"2024-05-08T21:10:08.170097+0000","last_fullsized":"2024-05-08T21:10:08.170097+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:51:47.727804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046274+0000","last_change":"2024-05-08T21:10:03.340078+0000","last_active":"2024-05-08T21:10:08.046274+0000","last_peered":"2024-05-08T21:10:08.046274+0000","last_clean":"2024-05-08T21:10:08.046274+0000","last_became_active":"2024-05-08T21:10:03.339690+0000","last_became_peered":"2024-05-08T21:10:03.339690+0000","last_unstale":"2024-05-08T21:10:08.046274+0000","last_undegraded":"2024-05-08T21:10:08.046274+0000","last_fullsized":"2024-05-08T21:10:08.046274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:01:33.991878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169765+0000","last_change":"2024-05-08T21:10:03.744606+0000","last_active":"2024-05-08T21:10:08.169765+0000","last_peered":"2024-05-08T21:10:08.169765+0000","last_clean":"2024-05-08T21:10:08.169765+0000","last_became_active":"2024-05-08T21:10:03.744160+0000","last_became_peered":"2024-05-08T21:10:03.744160+0000","last_unstale":"2024-05-08T21:10:08.169765+0000","last_undegraded":"2024-05-08T21:10:08.169765+0000","last_fullsized":"2024-05-08T21:10:08.169765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:10:25.144058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.187244+0000","last_change":"2024-05-08T21:10:08.049224+0000","last_active":"2024-05-08T21:10:08.187244+0000","last_peered":"2024-05-08T21:10:08.187244+0000","last_clean":"2024-05-08T21:10:08.187244+0000","last_became_active":"2024-05-08T21:10:08.048866+0000","last_became_peered":"2024-05-08T21:10:08.048866+0000","last_unstale":"2024-05-08T21:10:08.187244+0000","last_undegraded":"2024-05-08T21:10:08.187244+0000","last_fullsized":"2024-05-08T21:10:08.187244+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:38:20.601167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.743199+0000","last_change":"2024-05-08T21:10:03.339344+0000","last_active":"2024-05-08T21:10:07.743199+0000","last_peered":"2024-05-08T21:10:07.743199+0000","last_clean":"2024-05-08T21:10:07.743199+0000","last_became_active":"2024-05-08T21:10:03.339136+0000","last_became_peered":"2024-05-08T21:10:03.339136+0000","last_unstale":"2024-05-08T21:10:07.743199+0000","last_undegraded":"2024-05-08T21:10:07.743199+0000","last_fullsized":"2024-05-08T21:10:07.743199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:02:55.623727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.757429+0000","last_change":"2024-05-08T21:10:03.737684+0000","last_active":"2024-05-08T21:10:07.757429+0000","last_peered":"2024-05-08T21:10:07.757429+0000","last_clean":"2024-05-08T21:10:07.757429+0000","last_became_active":"2024-05-08T21:10:03.737459+0000","last_became_peered":"2024-05-08T21:10:03.737459+0000","last_unstale":"2024-05-08T21:10:07.757429+0000","last_undegraded":"2024-05-08T21:10:07.757429+0000","last_fullsized":"2024-05-08T21:10:07.757429+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:39.662018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169949+0000","last_change":"2024-05-08T21:10:07.776483+0000","last_active":"2024-05-08T21:10:08.169949+0000","last_peered":"2024-05-08T21:10:08.169949+0000","last_clean":"2024-05-08T21:10:08.169949+0000","last_became_active":"2024-05-08T21:10:07.775956+0000","last_became_peered":"2024-05-08T21:10:07.775956+0000","last_unstale":"2024-05-08T21:10:08.169949+0000","last_undegraded":"2024-05-08T21:10:08.169949+0000","last_fullsized":"2024-05-08T21:10:08.169949+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:28:17.332488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.743317+0000","last_change":"2024-05-08T21:10:03.331695+0000","last_active":"2024-05-08T21:10:07.743317+0000","last_peered":"2024-05-08T21:10:07.743317+0000","last_clean":"2024-05-08T21:10:07.743317+0000","last_became_active":"2024-05-08T21:10:03.331198+0000","last_became_peered":"2024-05-08T21:10:03.331198+0000","last_unstale":"2024-05-08T21:10:07.743317+0000","last_undegraded":"2024-05-08T21:10:07.743317+0000","last_fullsized":"2024-05-08T21:10:07.743317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:37:54.491930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.761445+0000","last_change":"2024-05-08T21:10:03.744562+0000","last_active":"2024-05-08T21:10:07.761445+0000","last_peered":"2024-05-08T21:10:07.761445+0000","last_clean":"2024-05-08T21:10:07.761445+0000","last_became_active":"2024-05-08T21:10:03.744326+0000","last_became_peered":"2024-05-08T21:10:03.744326+0000","last_unstale":"2024-05-08T21:10:07.761445+0000","last_undegraded":"2024-05-08T21:10:07.761445+0000","last_fullsized":"2024-05-08T21:10:07.761445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:21:52.947209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.170163+0000","last_change":"2024-05-08T21:10:07.763204+0000","last_active":"2024-05-08T21:10:08.170163+0000","last_peered":"2024-05-08T21:10:08.170163+0000","last_clean":"2024-05-08T21:10:08.170163+0000","last_became_active":"2024-05-08T21:10:07.762886+0000","last_became_peered":"2024-05-08T21:10:07.762886+0000","last_unstale":"2024-05-08T21:10:08.170163+0000","last_undegraded":"2024-05-08T21:10:08.170163+0000","last_fullsized":"2024-05-08T21:10:08.170163+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:01.599700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.740037+0000","last_change":"2024-05-08T21:10:03.337993+0000","last_active":"2024-05-08T21:10:08.740037+0000","last_peered":"2024-05-08T21:10:08.740037+0000","last_clean":"2024-05-08T21:10:08.740037+0000","last_became_active":"2024-05-08T21:10:03.337654+0000","last_became_peered":"2024-05-08T21:10:03.337654+0000","last_unstale":"2024-05-08T21:10:08.740037+0000","last_undegraded":"2024-05-08T21:10:08.740037+0000","last_fullsized":"2024-05-08T21:10:08.740037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:23:20.536178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.271247+0000","last_change":"2024-05-08T21:10:03.744871+0000","last_active":"2024-05-08T21:10:08.271247+0000","last_peered":"2024-05-08T21:10:08.271247+0000","last_clean":"2024-05-08T21:10:08.271247+0000","last_became_active":"2024-05-08T21:10:03.744589+0000","last_became_peered":"2024-05-08T21:10:03.744589+0000","last_unstale":"2024-05-08T21:10:08.271247+0000","last_undegraded":"2024-05-08T21:10:08.271247+0000","last_fullsized":"2024-05-08T21:10:08.271247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:41.090204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.271212+0000","last_change":"2024-05-08T21:10:08.047735+0000","last_active":"2024-05-08T21:10:08.271212+0000","last_peered":"2024-05-08T21:10:08.271212+0000","last_clean":"2024-05-08T21:10:08.271212+0000","last_became_active":"2024-05-08T21:10:08.047331+0000","last_became_peered":"2024-05-08T21:10:08.047331+0000","last_unstale":"2024-05-08T21:10:08.271212+0000","last_undegraded":"2024-05-08T21:10:08.271212+0000","last_fullsized":"2024-05-08T21:10:08.271212+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:44:22.797154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.751739+0000","last_change":"2024-05-08T21:10:03.333117+0000","last_active":"2024-05-08T21:10:07.751739+0000","last_peered":"2024-05-08T21:10:07.751739+0000","last_clean":"2024-05-08T21:10:07.751739+0000","last_became_active":"2024-05-08T21:10:03.332790+0000","last_became_peered":"2024-05-08T21:10:03.332790+0000","last_unstale":"2024-05-08T21:10:07.751739+0000","last_undegraded":"2024-05-08T21:10:07.751739+0000","last_fullsized":"2024-05-08T21:10:07.751739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:52:36.355804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046458+0000","last_change":"2024-05-08T21:10:03.748047+0000","last_active":"2024-05-08T21:10:08.046458+0000","last_peered":"2024-05-08T21:10:08.046458+0000","last_clean":"2024-05-08T21:10:08.046458+0000","last_became_active":"2024-05-08T21:10:03.747759+0000","last_became_peered":"2024-05-08T21:10:03.747759+0000","last_unstale":"2024-05-08T21:10:08.046458+0000","last_undegraded":"2024-05-08T21:10:08.046458+0000","last_fullsized":"2024-05-08T21:10:08.046458+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:11:05.309278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.775292+0000","last_change":"2024-05-08T21:10:07.761000+0000","last_active":"2024-05-08T21:10:07.775292+0000","last_peered":"2024-05-08T21:10:07.775292+0000","last_clean":"2024-05-08T21:10:07.775292+0000","last_became_active":"2024-05-08T21:10:07.760566+0000","last_became_peered":"2024-05-08T21:10:07.760566+0000","last_unstale":"2024-05-08T21:10:07.775292+0000","last_undegraded":"2024-05-08T21:10:07.775292+0000","last_fullsized":"2024-05-08T21:10:07.775292+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:48:27.435678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"26'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.187152+0000","last_change":"2024-05-08T21:10:03.331358+0000","last_active":"2024-05-08T21:10:08.187152+0000","last_peered":"2024-05-08T21:10:08.187152+0000","last_clean":"2024-05-08T21:10:08.187152+0000","last_became_active":"2024-05-08T21:10:03.331028+0000","last_became_peered":"2024-05-08T21:10:03.331028+0000","last_unstale":"2024-05-08T21:10:08.187152+0000","last_undegraded":"2024-05-08T21:10:08.187152+0000","last_fullsized":"2024-05-08T21:10:08.187152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:18:47.922157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.168527+0000","last_change":"2024-05-08T21:10:03.751285+0000","last_active":"2024-05-08T21:10:08.168527+0000","last_peered":"2024-05-08T21:10:08.168527+0000","last_clean":"2024-05-08T21:10:08.168527+0000","last_became_active":"2024-05-08T21:10:03.746557+0000","last_became_peered":"2024-05-08T21:10:03.746557+0000","last_unstale":"2024-05-08T21:10:08.168527+0000","last_undegraded":"2024-05-08T21:10:08.168527+0000","last_fullsized":"2024-05-08T21:10:08.168527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:50:27.241404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.167816+0000","last_change":"2024-05-08T21:10:08.048830+0000","last_active":"2024-05-08T21:10:08.167816+0000","last_peered":"2024-05-08T21:10:08.167816+0000","last_clean":"2024-05-08T21:10:08.167816+0000","last_became_active":"2024-05-08T21:10:08.048453+0000","last_became_peered":"2024-05-08T21:10:08.048453+0000","last_unstale":"2024-05-08T21:10:08.167816+0000","last_undegraded":"2024-05-08T21:10:08.167816+0000","last_fullsized":"2024-05-08T21:10:08.167816+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:19:28.758712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.737384+0000","last_change":"2024-05-08T21:10:03.330419+0000","last_active":"2024-05-08T21:10:08.737384+0000","last_peered":"2024-05-08T21:10:08.737384+0000","last_clean":"2024-05-08T21:10:08.737384+0000","last_became_active":"2024-05-08T21:10:03.330082+0000","last_became_peered":"2024-05-08T21:10:03.330082+0000","last_unstale":"2024-05-08T21:10:08.737384+0000","last_undegraded":"2024-05-08T21:10:08.737384+0000","last_fullsized":"2024-05-08T21:10:08.737384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:09:20.516386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046810+0000","last_change":"2024-05-08T21:10:03.747306+0000","last_active":"2024-05-08T21:10:08.046810+0000","last_peered":"2024-05-08T21:10:08.046810+0000","last_clean":"2024-05-08T21:10:08.046810+0000","last_became_active":"2024-05-08T21:10:03.746755+0000","last_became_peered":"2024-05-08T21:10:03.746755+0000","last_unstale":"2024-05-08T21:10:08.046810+0000","last_undegraded":"2024-05-08T21:10:08.046810+0000","last_fullsized":"2024-05-08T21:10:08.046810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:17:51.344821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.271171+0000","last_change":"2024-05-08T21:10:03.738627+0000","last_active":"2024-05-08T21:10:08.271171+0000","last_peered":"2024-05-08T21:10:08.271171+0000","last_clean":"2024-05-08T21:10:08.271171+0000","last_became_active":"2024-05-08T21:10:03.738338+0000","last_became_peered":"2024-05-08T21:10:03.738338+0000","last_unstale":"2024-05-08T21:10:08.271171+0000","last_undegraded":"2024-05-08T21:10:08.271171+0000","last_fullsized":"2024-05-08T21:10:08.271171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:34.088831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.751564+0000","last_change":"2024-05-08T21:10:03.745607+0000","last_active":"2024-05-08T21:10:07.751564+0000","last_peered":"2024-05-08T21:10:07.751564+0000","last_clean":"2024-05-08T21:10:07.751564+0000","last_became_active":"2024-05-08T21:10:03.745362+0000","last_became_peered":"2024-05-08T21:10:03.745362+0000","last_unstale":"2024-05-08T21:10:07.751564+0000","last_undegraded":"2024-05-08T21:10:07.751564+0000","last_fullsized":"2024-05-08T21:10:07.751564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:54.399930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.168448+0000","last_change":"2024-05-08T21:10:03.745137+0000","last_active":"2024-05-08T21:10:08.168448+0000","last_peered":"2024-05-08T21:10:08.168448+0000","last_clean":"2024-05-08T21:10:08.168448+0000","last_became_active":"2024-05-08T21:10:03.744844+0000","last_became_peered":"2024-05-08T21:10:03.744844+0000","last_unstale":"2024-05-08T21:10:08.168448+0000","last_undegraded":"2024-05-08T21:10:08.168448+0000","last_fullsized":"2024-05-08T21:10:08.168448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:06.853429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.753792+0000","last_change":"2024-05-08T21:10:03.745163+0000","last_active":"2024-05-08T21:10:07.753792+0000","last_peered":"2024-05-08T21:10:07.753792+0000","last_clean":"2024-05-08T21:10:07.753792+0000","last_became_active":"2024-05-08T21:10:03.744908+0000","last_became_peered":"2024-05-08T21:10:03.744908+0000","last_unstale":"2024-05-08T21:10:07.753792+0000","last_undegraded":"2024-05-08T21:10:07.753792+0000","last_fullsized":"2024-05-08T21:10:07.753792+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:06.593989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.762986+0000","last_change":"2024-05-08T21:10:03.748542+0000","last_active":"2024-05-08T21:10:07.762986+0000","last_peered":"2024-05-08T21:10:07.762986+0000","last_clean":"2024-05-08T21:10:07.762986+0000","last_became_active":"2024-05-08T21:10:03.748284+0000","last_became_peered":"2024-05-08T21:10:03.748284+0000","last_unstale":"2024-05-08T21:10:07.762986+0000","last_undegraded":"2024-05-08T21:10:07.762986+0000","last_fullsized":"2024-05-08T21:10:07.762986+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:49:10.430406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.187090+0000","last_change":"2024-05-08T21:10:03.739778+0000","last_active":"2024-05-08T21:10:08.187090+0000","last_peered":"2024-05-08T21:10:08.187090+0000","last_clean":"2024-05-08T21:10:08.187090+0000","last_became_active":"2024-05-08T21:10:03.739522+0000","last_became_peered":"2024-05-08T21:10:03.739522+0000","last_unstale":"2024-05-08T21:10:08.187090+0000","last_undegraded":"2024-05-08T21:10:08.187090+0000","last_fullsized":"2024-05-08T21:10:08.187090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:07:42.115999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.271345+0000","last_change":"2024-05-08T21:10:03.746126+0000","last_active":"2024-05-08T21:10:08.271345+0000","last_peered":"2024-05-08T21:10:08.271345+0000","last_clean":"2024-05-08T21:10:08.271345+0000","last_became_active":"2024-05-08T21:10:03.745842+0000","last_became_peered":"2024-05-08T21:10:03.745842+0000","last_unstale":"2024-05-08T21:10:08.271345+0000","last_undegraded":"2024-05-08T21:10:08.271345+0000","last_fullsized":"2024-05-08T21:10:08.271345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:51:06.176371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.762738+0000","last_change":"2024-05-08T21:10:03.745007+0000","last_active":"2024-05-08T21:10:07.762738+0000","last_peered":"2024-05-08T21:10:07.762738+0000","last_clean":"2024-05-08T21:10:07.762738+0000","last_became_active":"2024-05-08T21:10:03.744709+0000","last_became_peered":"2024-05-08T21:10:03.744709+0000","last_unstale":"2024-05-08T21:10:07.762738+0000","last_undegraded":"2024-05-08T21:10:07.762738+0000","last_fullsized":"2024-05-08T21:10:07.762738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:12:20.712861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.167909+0000","last_change":"2024-05-08T21:10:03.751111+0000","last_active":"2024-05-08T21:10:08.167909+0000","last_peered":"2024-05-08T21:10:08.167909+0000","last_clean":"2024-05-08T21:10:08.167909+0000","last_became_active":"2024-05-08T21:10:03.747059+0000","last_became_peered":"2024-05-08T21:10:03.747059+0000","last_unstale":"2024-05-08T21:10:08.167909+0000","last_undegraded":"2024-05-08T21:10:08.167909+0000","last_fullsized":"2024-05-08T21:10:08.167909+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:43.254221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.766689+0000","last_change":"2024-05-08T21:10:03.747207+0000","last_active":"2024-05-08T21:10:07.766689+0000","last_peered":"2024-05-08T21:10:07.766689+0000","last_clean":"2024-05-08T21:10:07.766689+0000","last_became_active":"2024-05-08T21:10:03.746942+0000","last_became_peered":"2024-05-08T21:10:03.746942+0000","last_unstale":"2024-05-08T21:10:07.766689+0000","last_undegraded":"2024-05-08T21:10:07.766689+0000","last_fullsized":"2024-05-08T21:10:07.766689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:33:52.317273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.168575+0000","last_change":"2024-05-08T21:10:03.753663+0000","last_active":"2024-05-08T21:10:08.168575+0000","last_peered":"2024-05-08T21:10:08.168575+0000","last_clean":"2024-05-08T21:10:08.168575+0000","last_became_active":"2024-05-08T21:10:03.752486+0000","last_became_peered":"2024-05-08T21:10:03.752486+0000","last_unstale":"2024-05-08T21:10:08.168575+0000","last_undegraded":"2024-05-08T21:10:08.168575+0000","last_fullsized":"2024-05-08T21:10:08.168575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:21:45.895154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.753497+0000","last_change":"2024-05-08T21:10:03.753849+0000","last_active":"2024-05-08T21:10:07.753497+0000","last_peered":"2024-05-08T21:10:07.753497+0000","last_clean":"2024-05-08T21:10:07.753497+0000","last_became_active":"2024-05-08T21:10:03.753616+0000","last_became_peered":"2024-05-08T21:10:03.753616+0000","last_unstale":"2024-05-08T21:10:07.753497+0000","last_undegraded":"2024-05-08T21:10:07.753497+0000","last_fullsized":"2024-05-08T21:10:07.753497+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:02:58.650310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.271297+0000","last_change":"2024-05-08T21:10:03.744906+0000","last_active":"2024-05-08T21:10:08.271297+0000","last_peered":"2024-05-08T21:10:08.271297+0000","last_clean":"2024-05-08T21:10:08.271297+0000","last_became_active":"2024-05-08T21:10:03.744562+0000","last_became_peered":"2024-05-08T21:10:03.744562+0000","last_unstale":"2024-05-08T21:10:08.271297+0000","last_undegraded":"2024-05-08T21:10:08.271297+0000","last_fullsized":"2024-05-08T21:10:08.271297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:21:30.416392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64612,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4594,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509450,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":110038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]}]},{"osd":5,"up_from":15,"seq":64424509451,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":106332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]}]},{"osd":0,"up_from":14,"seq":60129542155,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":348160,"data_stored":697248,"data_compressed":32306,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.307}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]}]},{"osd":7,"up_from":14,"seq":60129542154,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":339968,"data_stored":697192,"data_compressed":32306,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":106242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.245}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]}]},{"osd":3,"up_from":14,"seq":60129542154,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":110038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]}]},{"osd":1,"up_from":15,"seq":64424509450,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":106402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]}]},{"osd":4,"up_from":15,"seq":64424509450,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":106368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32306,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32306,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T21:10:37.467 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-08T21:10:37.467 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-08T21:10:37.467 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-05-08T21:10:37.467 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-08T21:10:37.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.618+0000 7f4ede13d700 1 Processor -- start 2024-05-08T21:10:37.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.618+0000 7f4ede13d700 1 -- start start 2024-05-08T21:10:37.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.619+0000 7f4ede13d700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4ed8141450 0x7f4ed806dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:37.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.619+0000 7f4ede13d700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4ed806eff0 0x7f4ed8158ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:37.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.619+0000 7f4ede13d700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ed80c57f0 con 0x7f4ed80c7120 2024-05-08T21:10:37.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.619+0000 7f4ede13d700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed80c5a40 con 0x7f4ed806eff0 2024-05-08T21:10:37.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.619+0000 7f4ede13d700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed80cae60 con 0x7f4ed8141450 2024-05-08T21:10:37.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.619+0000 7f4ed77fe700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4ed8141450 0x7f4ed806dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:37.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.619+0000 7f4ed6ffd700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4ed806eff0 0x7f4ed8158ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:37.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.619+0000 7f4ed7fff700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f4ed80c7120 0x7f4ed815b550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.80:50972/0 (socket says 172.21.15.80:50972) 2024-05-08T21:10:37.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.619+0000 7f4ed7fff700 1 -- 172.21.15.80:0/25266231 learned_addr learned my addr 172.21.15.80:0/25266231 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:10:37.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.620+0000 7f4ed6ffd700 1 -- 172.21.15.80:0/25266231 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4ed8141450 msgr2=0x7f4ed806dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:37.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.620+0000 7f4ed6ffd700 1 --2- 172.21.15.80:0/25266231 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4ed8141450 0x7f4ed806dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:37.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.620+0000 7f4ed6ffd700 1 -- 172.21.15.80:0/25266231 >> v1:172.21.15.106:6789/0 conn(0x7f4ed80c7120 legacy=0x7f4ed815b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:37.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.620+0000 7f4ed6ffd700 1 -- 172.21.15.80:0/25266231 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed80cb140 con 0x7f4ed806eff0 2024-05-08T21:10:37.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.620+0000 7f4ed67fc700 1 -- 172.21.15.80:0/25266231 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 151557698 0 0) 0x7f4ed80c57f0 con 0x7f4ed80c7120 2024-05-08T21:10:37.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.620+0000 7f4ed6ffd700 1 --2- 172.21.15.80:0/25266231 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ed806eff0 0x7f4ed8158ab0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4ec8009840 tx=0x7f4ec8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ebb60b504a756f7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:37.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.620+0000 7f4ed67fc700 1 -- 172.21.15.80:0/25266231 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec8011830 con 0x7f4ed806eff0 2024-05-08T21:10:37.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.620+0000 7f4ed67fc700 1 -- 172.21.15.80:0/25266231 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ec8011990 con 0x7f4ed806eff0 2024-05-08T21:10:37.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.620+0000 7f4ed67fc700 1 -- 172.21.15.80:0/25266231 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec8011d20 con 0x7f4ed806eff0 2024-05-08T21:10:37.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.620+0000 7f4ede13d700 1 -- 172.21.15.80:0/25266231 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ed806eff0 msgr2=0x7f4ed8158ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:37.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.620+0000 7f4ede13d700 1 --2- 172.21.15.80:0/25266231 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ed806eff0 0x7f4ed8158ab0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4ec8009840 tx=0x7f4ec8009b50 comp rx=0 tx=0).stop 2024-05-08T21:10:37.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.621+0000 7f4ede13d700 1 -- 172.21.15.80:0/25266231 shutdown_connections 2024-05-08T21:10:37.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.621+0000 7f4ede13d700 1 --2- 172.21.15.80:0/25266231 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4ed8141450 0x7f4ed806dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:37.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.621+0000 7f4ede13d700 1 --2- 172.21.15.80:0/25266231 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ed806eff0 0x7f4ed8158ab0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:37.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.621+0000 7f4ede13d700 1 -- 172.21.15.80:0/25266231 >> 172.21.15.80:0/25266231 conn(0x7f4ed80ca340 msgr2=0x7f4ed80ca750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:37.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.621+0000 7f4ede13d700 1 -- 172.21.15.80:0/25266231 shutdown_connections 2024-05-08T21:10:37.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.621+0000 7f4ede13d700 1 -- 172.21.15.80:0/25266231 wait complete. 2024-05-08T21:10:37.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.622+0000 7f4ede13d700 1 Processor -- start 2024-05-08T21:10:37.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.622+0000 7f4ede13d700 1 -- start start 2024-05-08T21:10:37.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.623+0000 7f4ede13d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ed806eff0 0x7f4ed81f1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:37.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.623+0000 7f4ede13d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ed80c7120 0x7f4ed8155ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:37.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.623+0000 7f4ede13d700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4ed8141450 0x7f4ed81df890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:37.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.623+0000 7f4ede13d700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed81e4ac0 con 0x7f4ed806eff0 2024-05-08T21:10:37.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.623+0000 7f4ede13d700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed81df400 con 0x7f4ed80c7120 2024-05-08T21:10:37.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.623+0000 7f4ede13d700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed81f1ba0 con 0x7f4ed8141450 2024-05-08T21:10:37.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.623+0000 7f4ed77fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ed806eff0 0x7f4ed81f1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:37.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.623+0000 7f4ed77fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ed806eff0 0x7f4ed81f1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42752/0 (socket says 172.21.15.80:42752) 2024-05-08T21:10:37.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.623+0000 7f4ed77fe700 1 -- 172.21.15.80:0/3993898290 learned_addr learned my addr 172.21.15.80:0/3993898290 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:37.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.623+0000 7f4ed6ffd700 1 --2- 172.21.15.80:0/3993898290 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ed80c7120 0x7f4ed8155ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:37.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.623+0000 7f4ed7fff700 1 --2- 172.21.15.80:0/3993898290 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4ed8141450 0x7f4ed81df890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:37.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.623+0000 7f4ed77fe700 1 -- 172.21.15.80:0/3993898290 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4ed8141450 msgr2=0x7f4ed81df890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:37.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.623+0000 7f4ed77fe700 1 --2- 172.21.15.80:0/3993898290 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4ed8141450 0x7f4ed81df890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:37.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.623+0000 7f4ed77fe700 1 -- 172.21.15.80:0/3993898290 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ed80c7120 msgr2=0x7f4ed8155ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:37.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.623+0000 7f4ed77fe700 1 --2- 172.21.15.80:0/3993898290 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ed80c7120 0x7f4ed8155ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:37.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.623+0000 7f4ed77fe700 1 -- 172.21.15.80:0/3993898290 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ec80094a0 con 0x7f4ed806eff0 2024-05-08T21:10:37.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.623+0000 7f4ed77fe700 1 --2- 172.21.15.80:0/3993898290 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ed806eff0 0x7f4ed81f1660 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc00e9b0 tx=0x7f4ecc00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:37.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.623+0000 7f4ebffff700 1 -- 172.21.15.80:0/3993898290 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ecc009710 con 0x7f4ed806eff0 2024-05-08T21:10:37.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.623+0000 7f4ebffff700 1 -- 172.21.15.80:0/3993898290 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ecc00ee50 con 0x7f4ed806eff0 2024-05-08T21:10:37.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.623+0000 7f4ede13d700 1 -- 172.21.15.80:0/3993898290 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ed81e24c0 con 0x7f4ed806eff0 2024-05-08T21:10:37.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.623+0000 7f4ebffff700 1 -- 172.21.15.80:0/3993898290 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ecc00ca50 con 0x7f4ed806eff0 2024-05-08T21:10:37.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.623+0000 7f4ede13d700 1 -- 172.21.15.80:0/3993898290 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ed81e2a80 con 0x7f4ed806eff0 2024-05-08T21:10:37.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.624+0000 7f4ede13d700 1 -- 172.21.15.80:0/3993898290 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ed806e430 con 0x7f4ed806eff0 2024-05-08T21:10:37.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.625+0000 7f4ebffff700 1 -- 172.21.15.80:0/3993898290 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4ecc00cbb0 con 0x7f4ed806eff0 2024-05-08T21:10:37.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.625+0000 7f4ebffff700 1 --2- 172.21.15.80:0/3993898290 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f4ec406ac90 0x7f4ec406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:37.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.625+0000 7f4ebffff700 1 -- 172.21.15.80:0/3993898290 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4ecc0896a0 con 0x7f4ed806eff0 2024-05-08T21:10:37.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.625+0000 7f4ed6ffd700 1 --2- 172.21.15.80:0/3993898290 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f4ec406ac90 0x7f4ec406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:37.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.626+0000 7f4ed6ffd700 1 --2- 172.21.15.80:0/3993898290 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f4ec406ac90 0x7f4ec406d150 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4ec80090b0 tx=0x7f4ec801c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:37.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.629+0000 7f4ebffff700 1 -- 172.21.15.80:0/3993898290 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f4ecc054510 con 0x7f4ed806eff0 2024-05-08T21:10:37.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.873+0000 7f4ede13d700 1 -- 172.21.15.80:0/3993898290 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f4ed804ec60 con 0x7f4ed806eff0 2024-05-08T21:10:37.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.873+0000 7f4ebffff700 1 -- 172.21.15.80:0/3993898290 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f4ecc00ce60 con 0x7f4ed806eff0 2024-05-08T21:10:37.877 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:10:37.877 INFO:teuthology.orchestra.run.smithi080.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-08T21:10:37.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.875+0000 7f4ede13d700 1 -- 172.21.15.80:0/3993898290 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f4ec406ac90 msgr2=0x7f4ec406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:37.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.875+0000 7f4ede13d700 1 --2- 172.21.15.80:0/3993898290 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f4ec406ac90 0x7f4ec406d150 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4ec80090b0 tx=0x7f4ec801c040 comp rx=0 tx=0).stop 2024-05-08T21:10:37.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.875+0000 7f4ede13d700 1 -- 172.21.15.80:0/3993898290 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ed806eff0 msgr2=0x7f4ed81f1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:37.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.875+0000 7f4ede13d700 1 --2- 172.21.15.80:0/3993898290 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ed806eff0 0x7f4ed81f1660 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc00e9b0 tx=0x7f4ecc00ecc0 comp rx=0 tx=0).stop 2024-05-08T21:10:37.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.875+0000 7f4ede13d700 1 -- 172.21.15.80:0/3993898290 shutdown_connections 2024-05-08T21:10:37.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.875+0000 7f4ede13d700 1 --2- 172.21.15.80:0/3993898290 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f4ec406ac90 0x7f4ec406d150 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:37.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.875+0000 7f4ede13d700 1 --2- 172.21.15.80:0/3993898290 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ed806eff0 0x7f4ed81f1660 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:37.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.875+0000 7f4ede13d700 1 --2- 172.21.15.80:0/3993898290 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4ed8141450 0x7f4ed81df890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:37.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.875+0000 7f4ede13d700 1 --2- 172.21.15.80:0/3993898290 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ed80c7120 0x7f4ed8155ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:37.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.875+0000 7f4ede13d700 1 -- 172.21.15.80:0/3993898290 >> 172.21.15.80:0/3993898290 conn(0x7f4ed80ca340 msgr2=0x7f4ed81589b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:37.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.876+0000 7f4ede13d700 1 -- 172.21.15.80:0/3993898290 shutdown_connections 2024-05-08T21:10:37.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:37.876+0000 7f4ede13d700 1 -- 172.21.15.80:0/3993898290 wait complete. 2024-05-08T21:10:37.891 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-05-08T21:10:37.891 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T21:10:38.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.008+0000 7f168d8ef700 1 Processor -- start 2024-05-08T21:10:38.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.008+0000 7f168d8ef700 1 -- start start 2024-05-08T21:10:38.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.009+0000 7f168d8ef700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1688141450 0x7f168806dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:38.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.009+0000 7f168d8ef700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f168806eff0 0x7f1688158ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:38.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.009+0000 7f168d8ef700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16880c57f0 con 0x7f16880c7120 2024-05-08T21:10:38.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.009+0000 7f168d8ef700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16880c5a40 con 0x7f168806eff0 2024-05-08T21:10:38.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.009+0000 7f168d8ef700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16880cae60 con 0x7f1688141450 2024-05-08T21:10:38.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.009+0000 7f16867fc700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f168806eff0 0x7f1688158ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:38.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.009+0000 7f16877fe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f16880c7120 0x7f168815b550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41852/0 (socket says 172.21.15.80:41852) 2024-05-08T21:10:38.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.009+0000 7f16877fe700 1 -- 172.21.15.80:0/2433730366 learned_addr learned my addr 172.21.15.80:0/2433730366 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:10:38.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.009+0000 7f1686ffd700 1 --2- 172.21.15.80:0/2433730366 >> v2:172.21.15.106:3300/0 conn(0x7f1688141450 0x7f168806dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:38.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.009+0000 7f16867fc700 1 -- 172.21.15.80:0/2433730366 >> v2:172.21.15.106:3300/0 conn(0x7f1688141450 msgr2=0x7f168806dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:38.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.009+0000 7f16867fc700 1 --2- 172.21.15.80:0/2433730366 >> v2:172.21.15.106:3300/0 conn(0x7f1688141450 0x7f168806dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:38.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.009+0000 7f16867fc700 1 -- 172.21.15.80:0/2433730366 >> v1:172.21.15.80:6789/0 conn(0x7f16880c7120 legacy=0x7f168815b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:38.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.009+0000 7f16867fc700 1 -- 172.21.15.80:0/2433730366 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16880cb140 con 0x7f168806eff0 2024-05-08T21:10:38.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.009+0000 7f1685ffb700 1 -- 172.21.15.80:0/2433730366 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2331819582 0 0) 0x7f16880c57f0 con 0x7f16880c7120 2024-05-08T21:10:38.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.010+0000 7f16867fc700 1 --2- 172.21.15.80:0/2433730366 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f168806eff0 0x7f1688158ab0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1688070080 tx=0x7f1678009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dad538e9ddc5a299 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:38.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.010+0000 7f1685ffb700 1 -- 172.21.15.80:0/2433730366 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1678011830 con 0x7f168806eff0 2024-05-08T21:10:38.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.010+0000 7f1685ffb700 1 -- 172.21.15.80:0/2433730366 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1678011990 con 0x7f168806eff0 2024-05-08T21:10:38.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.010+0000 7f1685ffb700 1 -- 172.21.15.80:0/2433730366 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1678011d20 con 0x7f168806eff0 2024-05-08T21:10:38.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.010+0000 7f168d8ef700 1 -- 172.21.15.80:0/2433730366 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f168806eff0 msgr2=0x7f1688158ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:38.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.010+0000 7f168d8ef700 1 --2- 172.21.15.80:0/2433730366 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f168806eff0 0x7f1688158ab0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1688070080 tx=0x7f1678009b20 comp rx=0 tx=0).stop 2024-05-08T21:10:38.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.010+0000 7f168d8ef700 1 -- 172.21.15.80:0/2433730366 shutdown_connections 2024-05-08T21:10:38.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.010+0000 7f168d8ef700 1 --2- 172.21.15.80:0/2433730366 >> v2:172.21.15.106:3300/0 conn(0x7f1688141450 0x7f168806dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:38.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.010+0000 7f168d8ef700 1 --2- 172.21.15.80:0/2433730366 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f168806eff0 0x7f1688158ab0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:38.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.010+0000 7f168d8ef700 1 -- 172.21.15.80:0/2433730366 >> 172.21.15.80:0/2433730366 conn(0x7f16880ca340 msgr2=0x7f16880ca750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:38.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.010+0000 7f168d8ef700 1 -- 172.21.15.80:0/2433730366 shutdown_connections 2024-05-08T21:10:38.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.010+0000 7f168d8ef700 1 -- 172.21.15.80:0/2433730366 wait complete. 2024-05-08T21:10:38.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.011+0000 7f168d8ef700 1 Processor -- start 2024-05-08T21:10:38.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.012+0000 7f168d8ef700 1 -- start start 2024-05-08T21:10:38.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.012+0000 7f168d8ef700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f168806eff0 0x7f16881ee680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:38.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.012+0000 7f168d8ef700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f16880c7120 0x7f168813d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:38.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.012+0000 7f168d8ef700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1688141450 0x7f16881e22c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:38.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.012+0000 7f168d8ef700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16881e38f0 con 0x7f1688141450 2024-05-08T21:10:38.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.012+0000 7f168d8ef700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16881eebc0 con 0x7f168806eff0 2024-05-08T21:10:38.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.012+0000 7f168d8ef700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16881e1c50 con 0x7f16880c7120 2024-05-08T21:10:38.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.013+0000 7f16877fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1688141450 0x7f16881e22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:38.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.013+0000 7f16877fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1688141450 0x7f16881e22c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42782/0 (socket says 172.21.15.80:42782) 2024-05-08T21:10:38.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.013+0000 7f16877fe700 1 -- 172.21.15.80:0/3776976277 learned_addr learned my addr 172.21.15.80:0/3776976277 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:38.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.013+0000 7f16867fc700 1 --2- 172.21.15.80:0/3776976277 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f16880c7120 0x7f168813d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:38.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.013+0000 7f1686ffd700 1 --2- 172.21.15.80:0/3776976277 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f168806eff0 0x7f16881ee680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:38.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.013+0000 7f16877fe700 1 -- 172.21.15.80:0/3776976277 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f16880c7120 msgr2=0x7f168813d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:38.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.013+0000 7f16877fe700 1 --2- 172.21.15.80:0/3776976277 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f16880c7120 0x7f168813d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:38.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.013+0000 7f16877fe700 1 -- 172.21.15.80:0/3776976277 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f168806eff0 msgr2=0x7f16881ee680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:38.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.013+0000 7f16877fe700 1 --2- 172.21.15.80:0/3776976277 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f168806eff0 0x7f16881ee680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:38.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.013+0000 7f16877fe700 1 -- 172.21.15.80:0/3776976277 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16780094a0 con 0x7f1688141450 2024-05-08T21:10:38.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.013+0000 7f16877fe700 1 --2- 172.21.15.80:0/3776976277 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1688141450 0x7f16881e22c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1680002230 tx=0x7f168000cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:38.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.013+0000 7f166ffff700 1 -- 172.21.15.80:0/3776976277 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168000aac0 con 0x7f1688141450 2024-05-08T21:10:38.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.013+0000 7f166ffff700 1 -- 172.21.15.80:0/3776976277 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f168000ac40 con 0x7f1688141450 2024-05-08T21:10:38.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.013+0000 7f166ffff700 1 -- 172.21.15.80:0/3776976277 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16800070d0 con 0x7f1688141450 2024-05-08T21:10:38.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.013+0000 7f168d8ef700 1 -- 172.21.15.80:0/3776976277 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16881e1ef0 con 0x7f1688141450 2024-05-08T21:10:38.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.013+0000 7f168d8ef700 1 -- 172.21.15.80:0/3776976277 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16881e3de0 con 0x7f1688141450 2024-05-08T21:10:38.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.014+0000 7f168d8ef700 1 -- 172.21.15.80:0/3776976277 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16880c6150 con 0x7f1688141450 2024-05-08T21:10:38.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.014+0000 7f166ffff700 1 -- 172.21.15.80:0/3776976277 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1680007250 con 0x7f1688141450 2024-05-08T21:10:38.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.015+0000 7f166ffff700 1 --2- 172.21.15.80:0/3776976277 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f167406ac90 0x7f167406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:38.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.015+0000 7f166ffff700 1 -- 172.21.15.80:0/3776976277 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1680089070 con 0x7f1688141450 2024-05-08T21:10:38.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.015+0000 7f1686ffd700 1 --2- 172.21.15.80:0/3776976277 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f167406ac90 0x7f167406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:38.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.015+0000 7f1686ffd700 1 --2- 172.21.15.80:0/3776976277 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f167406ac90 0x7f167406d150 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f167c006b20 tx=0x7f167c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:38.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.019+0000 7f166ffff700 1 -- 172.21.15.80:0/3776976277 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f1680053f60 con 0x7f1688141450 2024-05-08T21:10:38.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.215+0000 7f168d8ef700 1 -- 172.21.15.80:0/3776976277 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1688156d00 con 0x7f1688141450 2024-05-08T21:10:38.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.216+0000 7f166ffff700 1 -- 172.21.15.80:0/3776976277 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+17878 (secure 0 0 0) 0x7f1680018090 con 0x7f1688141450 2024-05-08T21:10:38.220 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:10:38.220 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":26,"fsid":"44d31c1e-aad3-47ca-a4fa-85a63d4a60aa","created":"2024-05-08T21:09:46.467038+0000","modified":"2024-05-08T21:10:08.163735+0000","last_up_change":"2024-05-08T21:09:57.284675+0000","last_in_change":"2024-05-08T21:09:49.125444+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T21:09:58.238951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T21:10:02.177476+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T21:10:02.685535+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-08T21:10:05.753779+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c3f9d93e-ed6d-4a0c-b5c0-0e8d44c65fdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":47011},{"type":"v1","addr":"172.21.15.80:6817","nonce":47011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":47011},{"type":"v1","addr":"172.21.15.80:6819","nonce":47011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":47011},{"type":"v1","addr":"172.21.15.80:6823","nonce":47011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":47011},{"type":"v1","addr":"172.21.15.80:6821","nonce":47011}]},"public_addr":"172.21.15.80:6817/47011","cluster_addr":"172.21.15.80:6819/47011","heartbeat_back_addr":"172.21.15.80:6823/47011","heartbeat_front_addr":"172.21.15.80:6821/47011","state":["exists","up"]},{"osd":1,"uuid":"4ce2b4d6-6c40-43aa-8dd1-743fef8915df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":47010},{"type":"v1","addr":"172.21.15.80:6809","nonce":47010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":47010},{"type":"v1","addr":"172.21.15.80:6811","nonce":47010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":47010},{"type":"v1","addr":"172.21.15.80:6815","nonce":47010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":47010},{"type":"v1","addr":"172.21.15.80:6813","nonce":47010}]},"public_addr":"172.21.15.80:6809/47010","cluster_addr":"172.21.15.80:6811/47010","heartbeat_back_addr":"172.21.15.80:6815/47010","heartbeat_front_addr":"172.21.15.80:6813/47010","state":["exists","up"]},{"osd":2,"uuid":"e30cc3bc-6461-4fac-960a-de00c9488d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":47009},{"type":"v1","addr":"172.21.15.80:6801","nonce":47009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":47009},{"type":"v1","addr":"172.21.15.80:6803","nonce":47009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":47009},{"type":"v1","addr":"172.21.15.80:6807","nonce":47009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":47009},{"type":"v1","addr":"172.21.15.80:6805","nonce":47009}]},"public_addr":"172.21.15.80:6801/47009","cluster_addr":"172.21.15.80:6803/47009","heartbeat_back_addr":"172.21.15.80:6807/47009","heartbeat_front_addr":"172.21.15.80:6805/47009","state":["exists","up"]},{"osd":3,"uuid":"a415c099-9ea6-40be-98ed-f2932f98dfd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":47012},{"type":"v1","addr":"172.21.15.80:6825","nonce":47012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":47012},{"type":"v1","addr":"172.21.15.80:6827","nonce":47012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":47012},{"type":"v1","addr":"172.21.15.80:6831","nonce":47012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":47012},{"type":"v1","addr":"172.21.15.80:6829","nonce":47012}]},"public_addr":"172.21.15.80:6825/47012","cluster_addr":"172.21.15.80:6827/47012","heartbeat_back_addr":"172.21.15.80:6831/47012","heartbeat_front_addr":"172.21.15.80:6829/47012","state":["exists","up"]},{"osd":4,"uuid":"5ae1d51f-0918-4571-b79b-154308d46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6823","nonce":47114},{"type":"v1","addr":"172.21.15.106:6825","nonce":47114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":47114},{"type":"v1","addr":"172.21.15.106:6827","nonce":47114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":47114},{"type":"v1","addr":"172.21.15.106:6831","nonce":47114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":47114},{"type":"v1","addr":"172.21.15.106:6829","nonce":47114}]},"public_addr":"172.21.15.106:6825/47114","cluster_addr":"172.21.15.106:6827/47114","heartbeat_back_addr":"172.21.15.106:6831/47114","heartbeat_front_addr":"172.21.15.106:6829/47114","state":["exists","up"]},{"osd":5,"uuid":"a19ac74e-4282-4428-b167-26ba6b92f732","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6807","nonce":47111},{"type":"v1","addr":"172.21.15.106:6809","nonce":47111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":47111},{"type":"v1","addr":"172.21.15.106:6811","nonce":47111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":47111},{"type":"v1","addr":"172.21.15.106:6815","nonce":47111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":47111},{"type":"v1","addr":"172.21.15.106:6813","nonce":47111}]},"public_addr":"172.21.15.106:6809/47111","cluster_addr":"172.21.15.106:6811/47111","heartbeat_back_addr":"172.21.15.106:6815/47111","heartbeat_front_addr":"172.21.15.106:6813/47111","state":["exists","up"]},{"osd":6,"uuid":"bfe72edd-7acc-4805-807d-2000e76f2feb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":47112},{"type":"v1","addr":"172.21.15.106:6817","nonce":47112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":47112},{"type":"v1","addr":"172.21.15.106:6819","nonce":47112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":47112},{"type":"v1","addr":"172.21.15.106:6824","nonce":47112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":47112},{"type":"v1","addr":"172.21.15.106:6821","nonce":47112}]},"public_addr":"172.21.15.106:6817/47112","cluster_addr":"172.21.15.106:6819/47112","heartbeat_back_addr":"172.21.15.106:6824/47112","heartbeat_front_addr":"172.21.15.106:6821/47112","state":["exists","up"]},{"osd":7,"uuid":"99897f22-ed17-4c7c-9088-cc0c4a51f786","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":47113},{"type":"v1","addr":"172.21.15.106:6801","nonce":47113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":47113},{"type":"v1","addr":"172.21.15.106:6803","nonce":47113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":47113},{"type":"v1","addr":"172.21.15.106:6808","nonce":47113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":47113},{"type":"v1","addr":"172.21.15.106:6805","nonce":47113}]},"public_addr":"172.21.15.106:6801/47113","cluster_addr":"172.21.15.106:6803/47113","heartbeat_back_addr":"172.21.15.106:6808/47113","heartbeat_front_addr":"172.21.15.106:6805/47113","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.232670+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.277753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.050087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.349312+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.344080+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.348781+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.352539+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.275013+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T21:10:38.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.218+0000 7f168d8ef700 1 -- 172.21.15.80:0/3776976277 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f167406ac90 msgr2=0x7f167406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:38.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.218+0000 7f168d8ef700 1 --2- 172.21.15.80:0/3776976277 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f167406ac90 0x7f167406d150 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f167c006b20 tx=0x7f167c008040 comp rx=0 tx=0).stop 2024-05-08T21:10:38.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.218+0000 7f168d8ef700 1 -- 172.21.15.80:0/3776976277 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1688141450 msgr2=0x7f16881e22c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:38.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.218+0000 7f168d8ef700 1 --2- 172.21.15.80:0/3776976277 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1688141450 0x7f16881e22c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1680002230 tx=0x7f168000cf50 comp rx=0 tx=0).stop 2024-05-08T21:10:38.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.218+0000 7f168d8ef700 1 -- 172.21.15.80:0/3776976277 shutdown_connections 2024-05-08T21:10:38.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.218+0000 7f168d8ef700 1 --2- 172.21.15.80:0/3776976277 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f167406ac90 0x7f167406d150 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:38.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.218+0000 7f168d8ef700 1 --2- 172.21.15.80:0/3776976277 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1688141450 0x7f16881e22c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:38.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.218+0000 7f168d8ef700 1 --2- 172.21.15.80:0/3776976277 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f168806eff0 0x7f16881ee680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:38.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.218+0000 7f168d8ef700 1 --2- 172.21.15.80:0/3776976277 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f16880c7120 0x7f168813d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:38.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.218+0000 7f168d8ef700 1 -- 172.21.15.80:0/3776976277 >> 172.21.15.80:0/3776976277 conn(0x7f16880ca340 msgr2=0x7f168806dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:38.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.219+0000 7f168d8ef700 1 -- 172.21.15.80:0/3776976277 shutdown_connections 2024-05-08T21:10:38.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.219+0000 7f168d8ef700 1 -- 172.21.15.80:0/3776976277 wait complete. 2024-05-08T21:10:38.234 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T21:09:58.238951+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T21:10:02.177476+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T21:10:02.685535+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-08T21:10:05.753779+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-08T21:10:38.235 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T21:10:38.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.356+0000 7f956f3a1700 1 Processor -- start 2024-05-08T21:10:38.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.356+0000 7f956f3a1700 1 -- start start 2024-05-08T21:10:38.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.357+0000 7f956f3a1700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f95680c6db0 0x7f956815a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:38.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.357+0000 7f956f3a1700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95680c56d0 con 0x7f95681544f0 2024-05-08T21:10:38.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.357+0000 7f956f3a1700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95680c6920 con 0x7f95680c5890 2024-05-08T21:10:38.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.357+0000 7f956f3a1700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95680c4ae0 con 0x7f95680c6db0 2024-05-08T21:10:38.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.357+0000 7f956d13d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f95681544f0 0x7f95680c8240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41858/0 (socket says 172.21.15.80:41858) 2024-05-08T21:10:38.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.357+0000 7f956d13d700 1 -- 172.21.15.80:0/2936136175 learned_addr learned my addr 172.21.15.80:0/2936136175 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:10:38.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.357+0000 7f955ffff700 1 -- 172.21.15.80:0/2936136175 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3351284189 0 0) 0x7f9564001110 con 0x7f95681544f0 2024-05-08T21:10:38.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.357+0000 7f955ffff700 1 -- 172.21.15.80:0/2936136175 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95540035b0 con 0x7f95681544f0 2024-05-08T21:10:38.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.357+0000 7f956c93c700 1 --2- 172.21.15.80:0/2936136175 >> v2:172.21.15.106:3300/0 conn(0x7f95680c6db0 0x7f956815a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:38.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.357+0000 7f955ffff700 1 -- 172.21.15.80:0/2936136175 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2360739923 0 0) 0x7f95540035b0 con 0x7f95681544f0 2024-05-08T21:10:38.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.357+0000 7f955ffff700 1 -- 172.21.15.80:0/2936136175 >> v2:172.21.15.106:3300/0 conn(0x7f95680c6db0 msgr2=0x7f956815a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:38.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.357+0000 7f955ffff700 1 --2- 172.21.15.80:0/2936136175 >> v2:172.21.15.106:3300/0 conn(0x7f95680c6db0 0x7f956815a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:38.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.357+0000 7f955ffff700 1 -- 172.21.15.80:0/2936136175 >> v1:172.21.15.106:6789/0 conn(0x7f95680c5890 legacy=0x7f9568164b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:38.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.357+0000 7f955ffff700 1 -- 172.21.15.80:0/2936136175 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95680cb270 con 0x7f95681544f0 2024-05-08T21:10:38.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.357+0000 7f955ffff700 1 -- 172.21.15.80:0/2936136175 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3520646302 0 0) 0x7f9564001800 con 0x7f95681544f0 2024-05-08T21:10:38.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.357+0000 7f955ffff700 1 -- 172.21.15.80:0/2936136175 >> v1:172.21.15.80:6789/0 conn(0x7f95681544f0 legacy=0x7f95680c8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:38.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.357+0000 7f955ffff700 1 --2- 172.21.15.80:0/2936136175 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9554003a00 0x7f9554003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:38.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.357+0000 7f955ffff700 1 --2- 172.21.15.80:0/2936136175 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9554004850 0x7f9554004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:38.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.357+0000 7f955ffff700 1 --2- 172.21.15.80:0/2936136175 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9554005210 0x7f955400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:38.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.357+0000 7f955ffff700 1 -- 172.21.15.80:0/2936136175 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95680c4ae0 con 0x7f9554003a00 2024-05-08T21:10:38.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.357+0000 7f955ffff700 1 -- 172.21.15.80:0/2936136175 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f955400c160 con 0x7f9554005210 2024-05-08T21:10:38.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.357+0000 7f955ffff700 1 -- 172.21.15.80:0/2936136175 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f955400c320 con 0x7f9554004850 2024-05-08T21:10:38.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.357+0000 7f956d13d700 1 --2- 172.21.15.80:0/2936136175 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9554003a00 0x7f9554003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:38.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.358+0000 7f956d93e700 1 --2- 172.21.15.80:0/2936136175 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9554005210 0x7f955400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:38.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.358+0000 7f956c93c700 1 --2- 172.21.15.80:0/2936136175 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9554004850 0x7f9554004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:38.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.358+0000 7f956d13d700 1 -- 172.21.15.80:0/2936136175 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9554004850 msgr2=0x7f9554004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:38.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.358+0000 7f956d13d700 1 --2- 172.21.15.80:0/2936136175 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9554004850 0x7f9554004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:38.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.358+0000 7f956d13d700 1 -- 172.21.15.80:0/2936136175 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9554005210 msgr2=0x7f955400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:38.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.358+0000 7f956d13d700 1 --2- 172.21.15.80:0/2936136175 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9554005210 0x7f955400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:38.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.358+0000 7f956d93e700 1 -- 172.21.15.80:0/2936136175 reap_dead start 2024-05-08T21:10:38.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.358+0000 7f956d13d700 1 -- 172.21.15.80:0/2936136175 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95540035b0 con 0x7f9554003a00 2024-05-08T21:10:38.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.358+0000 7f956c93c700 1 --2- 172.21.15.80:0/2936136175 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9554004850 0x7f9554004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:10:38.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.358+0000 7f956d13d700 1 --2- 172.21.15.80:0/2936136175 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9554003a00 0x7f9554003e20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f956400c210 tx=0x7f9554005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45db2198d38a0dd5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:38.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.358+0000 7f955ffff700 1 -- 172.21.15.80:0/2936136175 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9564007d90 con 0x7f9554003a00 2024-05-08T21:10:38.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.358+0000 7f955ffff700 1 -- 172.21.15.80:0/2936136175 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f956400cdd0 con 0x7f9554003a00 2024-05-08T21:10:38.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.358+0000 7f955ffff700 1 -- 172.21.15.80:0/2936136175 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9564005ba0 con 0x7f9554003a00 2024-05-08T21:10:38.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.358+0000 7f956f3a1700 1 -- 172.21.15.80:0/2936136175 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9554003a00 msgr2=0x7f9554003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:38.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.358+0000 7f956f3a1700 1 --2- 172.21.15.80:0/2936136175 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9554003a00 0x7f9554003e20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f956400c210 tx=0x7f9554005880 comp rx=0 tx=0).stop 2024-05-08T21:10:38.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.359+0000 7f956f3a1700 1 -- 172.21.15.80:0/2936136175 shutdown_connections 2024-05-08T21:10:38.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.359+0000 7f956f3a1700 1 --2- 172.21.15.80:0/2936136175 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9554003a00 0x7f9554003e20 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:38.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.359+0000 7f956f3a1700 1 -- 172.21.15.80:0/2936136175 >> 172.21.15.80:0/2936136175 conn(0x7f95680ca340 msgr2=0x7f95680ca750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:38.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.359+0000 7f956f3a1700 1 -- 172.21.15.80:0/2936136175 shutdown_connections 2024-05-08T21:10:38.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.359+0000 7f956f3a1700 1 -- 172.21.15.80:0/2936136175 wait complete. 2024-05-08T21:10:38.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.360+0000 7f956f3a1700 1 Processor -- start 2024-05-08T21:10:38.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.360+0000 7f956f3a1700 1 -- start start 2024-05-08T21:10:38.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.361+0000 7f956f3a1700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9554003a00 0x7f9568150f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:38.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.361+0000 7f956f3a1700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f95681521e0 0x7f9568145bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:38.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.361+0000 7f956f3a1700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95681460f0 0x7f9568147fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:38.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.361+0000 7f956f3a1700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f956814e470 con 0x7f95681460f0 2024-05-08T21:10:38.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.361+0000 7f956f3a1700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95681f3ba0 con 0x7f9554003a00 2024-05-08T21:10:38.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.361+0000 7f956f3a1700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95681f2f90 con 0x7f95681521e0 2024-05-08T21:10:38.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.361+0000 7f956d93e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95681460f0 0x7f9568147fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:38.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.361+0000 7f956d93e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95681460f0 0x7f9568147fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42790/0 (socket says 172.21.15.80:42790) 2024-05-08T21:10:38.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.361+0000 7f956d93e700 1 -- 172.21.15.80:0/4216185243 learned_addr learned my addr 172.21.15.80:0/4216185243 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:38.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.361+0000 7f956d13d700 1 --2- 172.21.15.80:0/4216185243 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9554003a00 0x7f9568150f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:38.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.361+0000 7f956c93c700 1 --2- 172.21.15.80:0/4216185243 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f95681521e0 0x7f9568145bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:38.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.361+0000 7f956d93e700 1 -- 172.21.15.80:0/4216185243 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f95681521e0 msgr2=0x7f9568145bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:38.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.361+0000 7f956d93e700 1 --2- 172.21.15.80:0/4216185243 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f95681521e0 0x7f9568145bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:38.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.361+0000 7f956d93e700 1 -- 172.21.15.80:0/4216185243 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9554003a00 msgr2=0x7f9568150f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:38.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.361+0000 7f956d93e700 1 --2- 172.21.15.80:0/4216185243 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9554003a00 0x7f9568150f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:38.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.361+0000 7f956d93e700 1 -- 172.21.15.80:0/4216185243 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95681f3270 con 0x7f95681460f0 2024-05-08T21:10:38.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.361+0000 7f956d93e700 1 --2- 172.21.15.80:0/4216185243 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95681460f0 0x7f9568147fd0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9568071c30 tx=0x7f95600021e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:38.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.361+0000 7f955dffb700 1 -- 172.21.15.80:0/4216185243 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9560003cd0 con 0x7f95681460f0 2024-05-08T21:10:38.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.361+0000 7f955dffb700 1 -- 172.21.15.80:0/4216185243 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9560003e30 con 0x7f95681460f0 2024-05-08T21:10:38.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.361+0000 7f956f3a1700 1 -- 172.21.15.80:0/4216185243 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95681f3550 con 0x7f95681460f0 2024-05-08T21:10:38.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.361+0000 7f955dffb700 1 -- 172.21.15.80:0/4216185243 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9560005310 con 0x7f95681460f0 2024-05-08T21:10:38.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.362+0000 7f956f3a1700 1 -- 172.21.15.80:0/4216185243 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f956814e110 con 0x7f95681460f0 2024-05-08T21:10:38.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.362+0000 7f956f3a1700 1 -- 172.21.15.80:0/4216185243 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f956804ec60 con 0x7f95681460f0 2024-05-08T21:10:38.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.363+0000 7f955dffb700 1 -- 172.21.15.80:0/4216185243 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9560005470 con 0x7f95681460f0 2024-05-08T21:10:38.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.363+0000 7f955dffb700 1 --2- 172.21.15.80:0/4216185243 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f954c06ac90 0x7f954c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:38.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.363+0000 7f955dffb700 1 -- 172.21.15.80:0/4216185243 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9560089730 con 0x7f95681460f0 2024-05-08T21:10:38.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.363+0000 7f956d13d700 1 --2- 172.21.15.80:0/4216185243 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f954c06ac90 0x7f954c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:38.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.364+0000 7f956d13d700 1 --2- 172.21.15.80:0/4216185243 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f954c06ac90 0x7f954c06d150 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9564015040 tx=0x7f9564007000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:38.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.368+0000 7f955dffb700 1 -- 172.21.15.80:0/4216185243 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f9560054620 con 0x7f95681460f0 2024-05-08T21:10:38.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.563+0000 7f956f3a1700 1 -- 172.21.15.80:0/4216185243 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f95680c8ae0 con 0x7f95681460f0 2024-05-08T21:10:38.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.563+0000 7f955dffb700 1 -- 172.21.15.80:0/4216185243 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9560057c40 con 0x7f95681460f0 2024-05-08T21:10:38.567 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-05-08T21:10:38.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.566+0000 7f956f3a1700 1 -- 172.21.15.80:0/4216185243 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f954c06ac90 msgr2=0x7f954c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:38.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.566+0000 7f956f3a1700 1 --2- 172.21.15.80:0/4216185243 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f954c06ac90 0x7f954c06d150 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9564015040 tx=0x7f9564007000 comp rx=0 tx=0).stop 2024-05-08T21:10:38.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.566+0000 7f956f3a1700 1 -- 172.21.15.80:0/4216185243 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95681460f0 msgr2=0x7f9568147fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:38.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.566+0000 7f956f3a1700 1 --2- 172.21.15.80:0/4216185243 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95681460f0 0x7f9568147fd0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9568071c30 tx=0x7f95600021e0 comp rx=0 tx=0).stop 2024-05-08T21:10:38.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.566+0000 7f956f3a1700 1 -- 172.21.15.80:0/4216185243 shutdown_connections 2024-05-08T21:10:38.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.566+0000 7f956f3a1700 1 --2- 172.21.15.80:0/4216185243 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f954c06ac90 0x7f954c06d150 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:38.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.566+0000 7f956f3a1700 1 --2- 172.21.15.80:0/4216185243 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95681460f0 0x7f9568147fd0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:38.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.566+0000 7f956f3a1700 1 --2- 172.21.15.80:0/4216185243 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9554003a00 0x7f9568150f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:38.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.566+0000 7f956f3a1700 1 --2- 172.21.15.80:0/4216185243 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f95681521e0 0x7f9568145bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:38.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.566+0000 7f956f3a1700 1 -- 172.21.15.80:0/4216185243 >> 172.21.15.80:0/4216185243 conn(0x7f95680ca340 msgr2=0x7f95680c4ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:38.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.566+0000 7f956f3a1700 1 -- 172.21.15.80:0/4216185243 shutdown_connections 2024-05-08T21:10:38.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.566+0000 7f956f3a1700 1 -- 172.21.15.80:0/4216185243 wait complete. 2024-05-08T21:10:38.581 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T21:10:38.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.702+0000 7fb9ee25a700 1 Processor -- start 2024-05-08T21:10:38.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.702+0000 7fb9ee25a700 1 -- start start 2024-05-08T21:10:38.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.703+0000 7fb9ee25a700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb9e8154390 0x7fb9e815ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:38.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.703+0000 7fb9ee25a700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9e80732b0 con 0x7fb9e80ca400 2024-05-08T21:10:38.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.703+0000 7fb9ee25a700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9e80c49a0 con 0x7fb9e80ca840 2024-05-08T21:10:38.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.703+0000 7fb9ee25a700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e815b1b0 con 0x7fb9e8154390 2024-05-08T21:10:38.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.703+0000 7fb9e6ffd700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb9e80ca400 0x7fb9e80cff30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41862/0 (socket says 172.21.15.80:41862) 2024-05-08T21:10:38.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.703+0000 7fb9e6ffd700 1 -- 172.21.15.80:0/443620800 learned_addr learned my addr 172.21.15.80:0/443620800 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:10:38.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.703+0000 7fb9e77fe700 1 --2- 172.21.15.80:0/443620800 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb9e8154390 0x7fb9e815ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:38.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.703+0000 7fb9e67fc700 1 -- 172.21.15.80:0/443620800 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4137987641 0 0) 0x7fb9e80732b0 con 0x7fb9e80ca400 2024-05-08T21:10:38.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.703+0000 7fb9e67fc700 1 -- 172.21.15.80:0/443620800 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9d40035b0 con 0x7fb9e80ca400 2024-05-08T21:10:38.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.704+0000 7fb9e67fc700 1 -- 172.21.15.80:0/443620800 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3174437552 0 0) 0x7fb9e80c49a0 con 0x7fb9e80ca840 2024-05-08T21:10:38.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.704+0000 7fb9e67fc700 1 -- 172.21.15.80:0/443620800 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9e80732b0 con 0x7fb9e80ca840 2024-05-08T21:10:38.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.704+0000 7fb9e67fc700 1 -- 172.21.15.80:0/443620800 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3612755353 0 0) 0x7fb9d40035b0 con 0x7fb9e80ca400 2024-05-08T21:10:38.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.704+0000 7fb9e67fc700 1 -- 172.21.15.80:0/443620800 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb9e8154390 msgr2=0x7fb9e815ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:38.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.704+0000 7fb9e67fc700 1 --2- 172.21.15.80:0/443620800 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb9e8154390 0x7fb9e815ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:38.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.704+0000 7fb9e67fc700 1 -- 172.21.15.80:0/443620800 >> v1:172.21.15.106:6789/0 conn(0x7fb9e80ca840 legacy=0x7fb9e815b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:38.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.704+0000 7fb9e67fc700 1 -- 172.21.15.80:0/443620800 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e80c4c80 con 0x7fb9e80ca400 2024-05-08T21:10:38.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.704+0000 7fb9e67fc700 1 -- 172.21.15.80:0/443620800 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3520646302 0 0) 0x7fb9d80017f0 con 0x7fb9e80ca400 2024-05-08T21:10:38.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.704+0000 7fb9e67fc700 1 -- 172.21.15.80:0/443620800 >> v1:172.21.15.80:6789/0 conn(0x7fb9e80ca400 legacy=0x7fb9e80cff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:38.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.704+0000 7fb9e67fc700 1 --2- 172.21.15.80:0/443620800 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb9d4003bc0 0x7fb9d4003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:38.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.704+0000 7fb9e67fc700 1 --2- 172.21.15.80:0/443620800 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9d4004850 0x7fb9d4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:38.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.704+0000 7fb9e67fc700 1 --2- 172.21.15.80:0/443620800 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb9e8154390 0x7fb9d4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:38.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.704+0000 7fb9e67fc700 1 -- 172.21.15.80:0/443620800 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d400bac0 con 0x7fb9d4004850 2024-05-08T21:10:38.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.704+0000 7fb9e67fc700 1 -- 172.21.15.80:0/443620800 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d400bc00 con 0x7fb9d4003bc0 2024-05-08T21:10:38.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.704+0000 7fb9e67fc700 1 -- 172.21.15.80:0/443620800 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d400bd90 con 0x7fb9e8154390 2024-05-08T21:10:38.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.704+0000 7fb9e6ffd700 1 --2- 172.21.15.80:0/443620800 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9d4004850 0x7fb9d4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:38.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.704+0000 7fb9e77fe700 1 --2- 172.21.15.80:0/443620800 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb9d4003bc0 0x7fb9d4003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:38.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.704+0000 7fb9e7fff700 1 --2- 172.21.15.80:0/443620800 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb9e8154390 0x7fb9d4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:38.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.704+0000 7fb9e6ffd700 1 -- 172.21.15.80:0/443620800 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb9e8154390 msgr2=0x7fb9d4005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:38.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.704+0000 7fb9e6ffd700 1 --2- 172.21.15.80:0/443620800 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb9e8154390 0x7fb9d4005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:38.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.704+0000 7fb9e6ffd700 1 -- 172.21.15.80:0/443620800 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb9d4003bc0 msgr2=0x7fb9d4003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:38.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.704+0000 7fb9e6ffd700 1 --2- 172.21.15.80:0/443620800 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb9d4003bc0 0x7fb9d4003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:38.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.704+0000 7fb9e6ffd700 1 -- 172.21.15.80:0/443620800 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d40035b0 con 0x7fb9d4004850 2024-05-08T21:10:38.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.704+0000 7fb9e6ffd700 1 --2- 172.21.15.80:0/443620800 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9d4004850 0x7fb9d4004cd0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb9d800c210 tx=0x7fb9d4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23862511e9bf534b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:38.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.704+0000 7fb9e67fc700 1 -- 172.21.15.80:0/443620800 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d800cd10 con 0x7fb9d4004850 2024-05-08T21:10:38.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.704+0000 7fb9e67fc700 1 -- 172.21.15.80:0/443620800 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d80070d0 con 0x7fb9d4004850 2024-05-08T21:10:38.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.705+0000 7fb9e67fc700 1 -- 172.21.15.80:0/443620800 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d8007480 con 0x7fb9d4004850 2024-05-08T21:10:38.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.705+0000 7fb9ee25a700 1 -- 172.21.15.80:0/443620800 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9d4004850 msgr2=0x7fb9d4004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:38.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.705+0000 7fb9ee25a700 1 --2- 172.21.15.80:0/443620800 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9d4004850 0x7fb9d4004cd0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb9d800c210 tx=0x7fb9d4005880 comp rx=0 tx=0).stop 2024-05-08T21:10:38.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.705+0000 7fb9e7fff700 1 -- 172.21.15.80:0/443620800 reap_dead start 2024-05-08T21:10:38.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.705+0000 7fb9ee25a700 1 -- 172.21.15.80:0/443620800 shutdown_connections 2024-05-08T21:10:38.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.705+0000 7fb9ee25a700 1 -- 172.21.15.80:0/443620800 >> 172.21.15.80:0/443620800 conn(0x7fb9e806ab90 msgr2=0x7fb9e806afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:38.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.705+0000 7fb9ee25a700 1 -- 172.21.15.80:0/443620800 shutdown_connections 2024-05-08T21:10:38.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.705+0000 7fb9ee25a700 1 -- 172.21.15.80:0/443620800 wait complete. 2024-05-08T21:10:38.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.706+0000 7fb9ee25a700 1 Processor -- start 2024-05-08T21:10:38.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.706+0000 7fb9ee25a700 1 -- start start 2024-05-08T21:10:38.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.707+0000 7fb9ee25a700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb9d4004850 0x7fb9e80b41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:38.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.707+0000 7fb9ee25a700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb9e80ccb80 0x7fb9e80c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:38.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.707+0000 7fb9ee25a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9e80c91c0 0x7fb9e8144520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:38.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.707+0000 7fb9ee25a700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e80cb230 con 0x7fb9e80c91c0 2024-05-08T21:10:38.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.707+0000 7fb9ee25a700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e80c89c0 con 0x7fb9e80ccb80 2024-05-08T21:10:38.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.707+0000 7fb9ee25a700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e815c970 con 0x7fb9d4004850 2024-05-08T21:10:38.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.707+0000 7fb9e7fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9e80c91c0 0x7fb9e8144520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:38.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.707+0000 7fb9e7fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9e80c91c0 0x7fb9e8144520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42804/0 (socket says 172.21.15.80:42804) 2024-05-08T21:10:38.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.707+0000 7fb9e7fff700 1 -- 172.21.15.80:0/1163526407 learned_addr learned my addr 172.21.15.80:0/1163526407 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:38.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.707+0000 7fb9e6ffd700 1 --2- 172.21.15.80:0/1163526407 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb9e80ccb80 0x7fb9e80c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:38.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.707+0000 7fb9e77fe700 1 --2- 172.21.15.80:0/1163526407 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb9d4004850 0x7fb9e80b41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:38.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.708+0000 7fb9e7fff700 1 -- 172.21.15.80:0/1163526407 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb9d4004850 msgr2=0x7fb9e80b41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:38.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.708+0000 7fb9e7fff700 1 --2- 172.21.15.80:0/1163526407 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb9d4004850 0x7fb9e80b41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:38.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.708+0000 7fb9e7fff700 1 -- 172.21.15.80:0/1163526407 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb9e80ccb80 msgr2=0x7fb9e80c8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:38.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.708+0000 7fb9e7fff700 1 --2- 172.21.15.80:0/1163526407 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb9e80ccb80 0x7fb9e80c8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:38.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.708+0000 7fb9e7fff700 1 -- 172.21.15.80:0/1163526407 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e815d460 con 0x7fb9e80c91c0 2024-05-08T21:10:38.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.708+0000 7fb9e7fff700 1 --2- 172.21.15.80:0/1163526407 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9e80c91c0 0x7fb9e8144520 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb9e8072570 tx=0x7fb9e000d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:38.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.708+0000 7fb9dffff700 1 -- 172.21.15.80:0/1163526407 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e000fe70 con 0x7fb9e80c91c0 2024-05-08T21:10:38.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.708+0000 7fb9dffff700 1 -- 172.21.15.80:0/1163526407 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9e0003c10 con 0x7fb9e80c91c0 2024-05-08T21:10:38.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.708+0000 7fb9ee25a700 1 -- 172.21.15.80:0/1163526407 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9e815cbc0 con 0x7fb9e80c91c0 2024-05-08T21:10:38.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.708+0000 7fb9dffff700 1 -- 172.21.15.80:0/1163526407 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e000d990 con 0x7fb9e80c91c0 2024-05-08T21:10:38.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.708+0000 7fb9ee25a700 1 -- 172.21.15.80:0/1163526407 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9e815d180 con 0x7fb9e80c91c0 2024-05-08T21:10:38.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.709+0000 7fb9ee25a700 1 -- 172.21.15.80:0/1163526407 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9e80cd230 con 0x7fb9e80c91c0 2024-05-08T21:10:38.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.710+0000 7fb9dffff700 1 -- 172.21.15.80:0/1163526407 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb9e000daf0 con 0x7fb9e80c91c0 2024-05-08T21:10:38.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.710+0000 7fb9dffff700 1 --2- 172.21.15.80:0/1163526407 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fb9c806ac90 0x7fb9c806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:38.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.710+0000 7fb9e77fe700 1 --2- 172.21.15.80:0/1163526407 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fb9c806ac90 0x7fb9c806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:38.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.710+0000 7fb9dffff700 1 -- 172.21.15.80:0/1163526407 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb9e008a380 con 0x7fb9e80c91c0 2024-05-08T21:10:38.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.711+0000 7fb9e77fe700 1 --2- 172.21.15.80:0/1163526407 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fb9c806ac90 0x7fb9c806d150 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0009b00 tx=0x7fb9d0009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:38.718 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.714+0000 7fb9dffff700 1 -- 172.21.15.80:0/1163526407 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fb9e0055290 con 0x7fb9e80c91c0 2024-05-08T21:10:38.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.911+0000 7fb9ee25a700 1 -- 172.21.15.80:0/1163526407 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb9e804ec60 con 0x7fb9e80c91c0 2024-05-08T21:10:38.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.911+0000 7fb9dffff700 1 -- 172.21.15.80:0/1163526407 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb9e00588b0 con 0x7fb9e80c91c0 2024-05-08T21:10:38.915 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-05-08T21:10:38.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.913+0000 7fb9ee25a700 1 -- 172.21.15.80:0/1163526407 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fb9c806ac90 msgr2=0x7fb9c806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:38.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.913+0000 7fb9ee25a700 1 --2- 172.21.15.80:0/1163526407 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fb9c806ac90 0x7fb9c806d150 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0009b00 tx=0x7fb9d0009210 comp rx=0 tx=0).stop 2024-05-08T21:10:38.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.913+0000 7fb9ee25a700 1 -- 172.21.15.80:0/1163526407 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9e80c91c0 msgr2=0x7fb9e8144520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:38.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.913+0000 7fb9ee25a700 1 --2- 172.21.15.80:0/1163526407 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9e80c91c0 0x7fb9e8144520 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb9e8072570 tx=0x7fb9e000d430 comp rx=0 tx=0).stop 2024-05-08T21:10:38.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.913+0000 7fb9ee25a700 1 -- 172.21.15.80:0/1163526407 shutdown_connections 2024-05-08T21:10:38.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.913+0000 7fb9ee25a700 1 --2- 172.21.15.80:0/1163526407 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fb9c806ac90 0x7fb9c806d150 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:38.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.913+0000 7fb9ee25a700 1 --2- 172.21.15.80:0/1163526407 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9e80c91c0 0x7fb9e8144520 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:38.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.913+0000 7fb9ee25a700 1 --2- 172.21.15.80:0/1163526407 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb9d4004850 0x7fb9e80b41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:38.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.913+0000 7fb9ee25a700 1 --2- 172.21.15.80:0/1163526407 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb9e80ccb80 0x7fb9e80c8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:38.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.913+0000 7fb9ee25a700 1 -- 172.21.15.80:0/1163526407 >> 172.21.15.80:0/1163526407 conn(0x7fb9e806ab90 msgr2=0x7fb9e814e610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:38.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.913+0000 7fb9ee25a700 1 -- 172.21.15.80:0/1163526407 shutdown_connections 2024-05-08T21:10:38.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:38.913+0000 7fb9ee25a700 1 -- 172.21.15.80:0/1163526407 wait complete. 2024-05-08T21:10:38.929 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T21:10:39.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.049+0000 7f7d0c895700 1 Processor -- start 2024-05-08T21:10:39.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.049+0000 7f7d0c895700 1 -- start start 2024-05-08T21:10:39.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.050+0000 7f7d0c895700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7d080c8380 0x7f7d08071be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:39.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.050+0000 7f7d0c895700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d080c9150 con 0x7f7d080ccfe0 2024-05-08T21:10:39.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.050+0000 7f7d0c895700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d080c99f0 con 0x7f7d080ccc00 2024-05-08T21:10:39.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.050+0000 7f7d0c895700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d081579c0 con 0x7f7d080c8380 2024-05-08T21:10:39.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.050+0000 7f7d05d9b700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f7d080ccfe0 0x7f7d0814d840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41874/0 (socket says 172.21.15.80:41874) 2024-05-08T21:10:39.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.050+0000 7f7d05d9b700 1 -- 172.21.15.80:0/2262863660 learned_addr learned my addr 172.21.15.80:0/2262863660 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:10:39.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.051+0000 7f7d06d9d700 1 --2- 172.21.15.80:0/2262863660 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7d080c8380 0x7f7d08071be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:39.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.051+0000 7f7d0559a700 1 -- 172.21.15.80:0/2262863660 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2188744012 0 0) 0x7f7d080c9150 con 0x7f7d080ccfe0 2024-05-08T21:10:39.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.051+0000 7f7d0559a700 1 -- 172.21.15.80:0/2262863660 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7cf00035b0 con 0x7f7d080ccfe0 2024-05-08T21:10:39.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.051+0000 7f7d0559a700 1 -- 172.21.15.80:0/2262863660 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 19140992 0 0) 0x7f7d080c99f0 con 0x7f7d080ccc00 2024-05-08T21:10:39.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.051+0000 7f7d0559a700 1 -- 172.21.15.80:0/2262863660 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d080c9150 con 0x7f7d080ccc00 2024-05-08T21:10:39.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.051+0000 7f7d06d9d700 1 -- 172.21.15.80:0/2262863660 >> v1:172.21.15.106:6789/0 conn(0x7f7d080ccc00 legacy=0x7f7d08156ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:39.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.051+0000 7f7d06d9d700 1 -- 172.21.15.80:0/2262863660 >> v1:172.21.15.80:6789/0 conn(0x7f7d080ccfe0 legacy=0x7f7d0814d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:39.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.051+0000 7f7d06d9d700 1 -- 172.21.15.80:0/2262863660 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d08157ca0 con 0x7f7d080c8380 2024-05-08T21:10:39.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.051+0000 7f7d06d9d700 1 --2- 172.21.15.80:0/2262863660 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7d080c8380 0x7f7d08071be0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7d00009dc0 tx=0x7f7d0000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=844ed74996f72b01 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:39.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.051+0000 7f7d0559a700 1 -- 172.21.15.80:0/2262863660 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0000e070 con 0x7f7d080c8380 2024-05-08T21:10:39.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.051+0000 7f7d0559a700 1 -- 172.21.15.80:0/2262863660 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d0000bb20 con 0x7f7d080c8380 2024-05-08T21:10:39.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.051+0000 7f7d0559a700 1 -- 172.21.15.80:0/2262863660 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0000be90 con 0x7f7d080c8380 2024-05-08T21:10:39.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.052+0000 7f7d0c895700 1 -- 172.21.15.80:0/2262863660 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7d080c8380 msgr2=0x7f7d08071be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:39.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.052+0000 7f7d0c895700 1 --2- 172.21.15.80:0/2262863660 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7d080c8380 0x7f7d08071be0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7d00009dc0 tx=0x7f7d0000b330 comp rx=0 tx=0).stop 2024-05-08T21:10:39.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.052+0000 7f7d0c895700 1 -- 172.21.15.80:0/2262863660 shutdown_connections 2024-05-08T21:10:39.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.052+0000 7f7d0c895700 1 --2- 172.21.15.80:0/2262863660 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7d080c8380 0x7f7d08071be0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:39.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.052+0000 7f7d0c895700 1 -- 172.21.15.80:0/2262863660 >> 172.21.15.80:0/2262863660 conn(0x7f7d0806f140 msgr2=0x7f7d0806f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:39.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.052+0000 7f7d0c895700 1 -- 172.21.15.80:0/2262863660 shutdown_connections 2024-05-08T21:10:39.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.052+0000 7f7d0c895700 1 -- 172.21.15.80:0/2262863660 wait complete. 2024-05-08T21:10:39.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.054+0000 7f7d0c895700 1 Processor -- start 2024-05-08T21:10:39.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.054+0000 7f7d0c895700 1 -- start start 2024-05-08T21:10:39.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.054+0000 7f7d0c895700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7d080c8380 0x7f7d0814ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:39.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.054+0000 7f7d0c895700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7d080ccc00 0x7f7d081f0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:39.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.054+0000 7f7d0c895700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7d080ccfe0 0x7f7d081ec490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:39.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.054+0000 7f7d0c895700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d081ec9d0 con 0x7f7d080c8380 2024-05-08T21:10:39.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.054+0000 7f7d0c895700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d08155860 con 0x7f7d080ccfe0 2024-05-08T21:10:39.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.055+0000 7f7d0c895700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d081560e0 con 0x7f7d080ccc00 2024-05-08T21:10:39.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.055+0000 7f7d0659c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7d080c8380 0x7f7d0814ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:39.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.055+0000 7f7d0659c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7d080c8380 0x7f7d0814ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42806/0 (socket says 172.21.15.80:42806) 2024-05-08T21:10:39.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.055+0000 7f7d0659c700 1 -- 172.21.15.80:0/3454216430 learned_addr learned my addr 172.21.15.80:0/3454216430 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:39.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.055+0000 7f7d05d9b700 1 --2- 172.21.15.80:0/3454216430 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7d080ccc00 0x7f7d081f0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:39.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.055+0000 7f7d06d9d700 1 --2- 172.21.15.80:0/3454216430 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7d080ccfe0 0x7f7d081ec490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:39.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.055+0000 7f7d0659c700 1 -- 172.21.15.80:0/3454216430 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7d080ccc00 msgr2=0x7f7d081f0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:39.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.055+0000 7f7d0659c700 1 --2- 172.21.15.80:0/3454216430 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7d080ccc00 0x7f7d081f0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:39.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.055+0000 7f7d0659c700 1 -- 172.21.15.80:0/3454216430 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7d080ccfe0 msgr2=0x7f7d081ec490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:39.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.055+0000 7f7d0659c700 1 --2- 172.21.15.80:0/3454216430 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7d080ccfe0 0x7f7d081ec490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:39.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.055+0000 7f7d0659c700 1 -- 172.21.15.80:0/3454216430 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d00009a70 con 0x7f7d080c8380 2024-05-08T21:10:39.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.055+0000 7f7d06d9d700 1 --2- 172.21.15.80:0/3454216430 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7d080ccfe0 0x7f7d081ec490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:10:39.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.055+0000 7f7d0659c700 1 --2- 172.21.15.80:0/3454216430 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7d080c8380 0x7f7d0814ab70 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc00e940 tx=0x7f7cfc00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:39.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.055+0000 7f7cf6ffd700 1 -- 172.21.15.80:0/3454216430 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc0052d0 con 0x7f7d080c8380 2024-05-08T21:10:39.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.055+0000 7f7cf6ffd700 1 -- 172.21.15.80:0/3454216430 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cfc005430 con 0x7f7d080c8380 2024-05-08T21:10:39.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.055+0000 7f7d0c895700 1 -- 172.21.15.80:0/3454216430 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d08155b20 con 0x7f7d080c8380 2024-05-08T21:10:39.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.055+0000 7f7cf6ffd700 1 -- 172.21.15.80:0/3454216430 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc00cbf0 con 0x7f7d080c8380 2024-05-08T21:10:39.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.055+0000 7f7d0c895700 1 -- 172.21.15.80:0/3454216430 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d081efaa0 con 0x7f7d080c8380 2024-05-08T21:10:39.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.056+0000 7f7d0c895700 1 -- 172.21.15.80:0/3454216430 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d0804ec60 con 0x7f7d080c8380 2024-05-08T21:10:39.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.057+0000 7f7cf6ffd700 1 -- 172.21.15.80:0/3454216430 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7cfc00cd50 con 0x7f7d080c8380 2024-05-08T21:10:39.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.057+0000 7f7cf6ffd700 1 --2- 172.21.15.80:0/3454216430 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f7ce806ac90 0x7f7ce806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:39.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.057+0000 7f7cf6ffd700 1 -- 172.21.15.80:0/3454216430 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7cfc08b840 con 0x7f7d080c8380 2024-05-08T21:10:39.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.057+0000 7f7d05d9b700 1 --2- 172.21.15.80:0/3454216430 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f7ce806ac90 0x7f7ce806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:39.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.057+0000 7f7d05d9b700 1 --2- 172.21.15.80:0/3454216430 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f7ce806ac90 0x7f7ce806d150 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7d080c78b0 tx=0x7f7cf8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:39.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.062+0000 7f7cf6ffd700 1 -- 172.21.15.80:0/3454216430 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f7cfc056620 con 0x7f7d080c8380 2024-05-08T21:10:39.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.256+0000 7f7d0c895700 1 -- 172.21.15.80:0/3454216430 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7d08147ec0 con 0x7f7d080c8380 2024-05-08T21:10:39.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.257+0000 7f7cf6ffd700 1 -- 172.21.15.80:0/3454216430 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7cfc01f0a0 con 0x7f7d080c8380 2024-05-08T21:10:39.260 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-05-08T21:10:39.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.258+0000 7f7d0c895700 1 -- 172.21.15.80:0/3454216430 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f7ce806ac90 msgr2=0x7f7ce806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:39.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.258+0000 7f7d0c895700 1 --2- 172.21.15.80:0/3454216430 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f7ce806ac90 0x7f7ce806d150 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7d080c78b0 tx=0x7f7cf8009040 comp rx=0 tx=0).stop 2024-05-08T21:10:39.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.258+0000 7f7d0c895700 1 -- 172.21.15.80:0/3454216430 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7d080c8380 msgr2=0x7f7d0814ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:39.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.258+0000 7f7d0c895700 1 --2- 172.21.15.80:0/3454216430 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7d080c8380 0x7f7d0814ab70 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc00e940 tx=0x7f7cfc00ed00 comp rx=0 tx=0).stop 2024-05-08T21:10:39.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.259+0000 7f7d0c895700 1 -- 172.21.15.80:0/3454216430 shutdown_connections 2024-05-08T21:10:39.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.259+0000 7f7d0c895700 1 --2- 172.21.15.80:0/3454216430 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f7ce806ac90 0x7f7ce806d150 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:39.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.259+0000 7f7d0c895700 1 --2- 172.21.15.80:0/3454216430 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7d080c8380 0x7f7d0814ab70 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:39.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.259+0000 7f7d0c895700 1 --2- 172.21.15.80:0/3454216430 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7d080ccfe0 0x7f7d081ec490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:39.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.259+0000 7f7d0c895700 1 --2- 172.21.15.80:0/3454216430 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7d080ccc00 0x7f7d081f0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:39.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.259+0000 7f7d0c895700 1 -- 172.21.15.80:0/3454216430 >> 172.21.15.80:0/3454216430 conn(0x7f7d0806f140 msgr2=0x7f7d0806f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:39.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.259+0000 7f7d0c895700 1 -- 172.21.15.80:0/3454216430 shutdown_connections 2024-05-08T21:10:39.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.259+0000 7f7d0c895700 1 -- 172.21.15.80:0/3454216430 wait complete. 2024-05-08T21:10:39.274 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-08T21:10:39.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.395+0000 7f456c18e700 1 Processor -- start 2024-05-08T21:10:39.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.395+0000 7f456c18e700 1 -- start start 2024-05-08T21:10:39.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.396+0000 7f456c18e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f45641541a0 0x7f456415a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:39.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.396+0000 7f456c18e700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f45640c95b0 0x7f4564072d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:39.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.396+0000 7f456c18e700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45640c8cc0 con 0x7f45640c9150 2024-05-08T21:10:39.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.396+0000 7f456c18e700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f456406c5a0 con 0x7f45641541a0 2024-05-08T21:10:39.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.396+0000 7f456c18e700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f456406ce60 con 0x7f45640c95b0 2024-05-08T21:10:39.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.396+0000 7f4569f2a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f45641541a0 0x7f456415a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:39.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.396+0000 7f4569f2a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f45641541a0 0x7f456415a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42816/0 (socket says 172.21.15.80:42816) 2024-05-08T21:10:39.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.396+0000 7f4569f2a700 1 -- 172.21.15.80:0/1735217386 learned_addr learned my addr 172.21.15.80:0/1735217386 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:39.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.396+0000 7f456a72b700 1 --2- 172.21.15.80:0/1735217386 >> v2:172.21.15.106:3300/0 conn(0x7f45640c95b0 0x7f4564072d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:39.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.396+0000 7f4569f2a700 1 -- 172.21.15.80:0/1735217386 >> v2:172.21.15.106:3300/0 conn(0x7f45640c95b0 msgr2=0x7f4564072d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:39.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.396+0000 7f4569f2a700 1 --2- 172.21.15.80:0/1735217386 >> v2:172.21.15.106:3300/0 conn(0x7f45640c95b0 0x7f4564072d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:39.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.396+0000 7f4569f2a700 1 -- 172.21.15.80:0/1735217386 >> v1:172.21.15.106:6789/0 conn(0x7f45640c9150 legacy=0x7f4564072600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:39.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.397+0000 7f4569f2a700 1 -- 172.21.15.80:0/1735217386 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f456415e710 con 0x7f45641541a0 2024-05-08T21:10:39.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.397+0000 7f4569f2a700 1 --2- 172.21.15.80:0/1735217386 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f45641541a0 0x7f456415a1a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f456406bfe0 tx=0x7f4554009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15960d2a861ce594 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:39.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.397+0000 7f4568f28700 1 -- 172.21.15.80:0/1735217386 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4554011830 con 0x7f45641541a0 2024-05-08T21:10:39.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.397+0000 7f4568f28700 1 -- 172.21.15.80:0/1735217386 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4554011990 con 0x7f45641541a0 2024-05-08T21:10:39.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.397+0000 7f4568f28700 1 -- 172.21.15.80:0/1735217386 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4554011d20 con 0x7f45641541a0 2024-05-08T21:10:39.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.397+0000 7f456c18e700 1 -- 172.21.15.80:0/1735217386 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f45641541a0 msgr2=0x7f456415a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:39.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.397+0000 7f456c18e700 1 --2- 172.21.15.80:0/1735217386 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f45641541a0 0x7f456415a1a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f456406bfe0 tx=0x7f4554009bd0 comp rx=0 tx=0).stop 2024-05-08T21:10:39.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.397+0000 7f456c18e700 1 -- 172.21.15.80:0/1735217386 shutdown_connections 2024-05-08T21:10:39.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.397+0000 7f456c18e700 1 --2- 172.21.15.80:0/1735217386 >> v2:172.21.15.106:3300/0 conn(0x7f45640c95b0 0x7f4564072d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:39.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.397+0000 7f456c18e700 1 --2- 172.21.15.80:0/1735217386 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f45641541a0 0x7f456415a1a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:39.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.397+0000 7f456c18e700 1 -- 172.21.15.80:0/1735217386 >> 172.21.15.80:0/1735217386 conn(0x7f456406ef80 msgr2=0x7f456406f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:39.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.397+0000 7f456c18e700 1 -- 172.21.15.80:0/1735217386 shutdown_connections 2024-05-08T21:10:39.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.397+0000 7f456c18e700 1 -- 172.21.15.80:0/1735217386 wait complete. 2024-05-08T21:10:39.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.399+0000 7f456c18e700 1 Processor -- start 2024-05-08T21:10:39.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.399+0000 7f456c18e700 1 -- start start 2024-05-08T21:10:39.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.399+0000 7f456c18e700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f45640c9150 0x7f45641f3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:39.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.399+0000 7f456c18e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f45640c95b0 0x7f45640c42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:39.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.399+0000 7f456c18e700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f45641541a0 0x7f45640c4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:39.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.399+0000 7f456c18e700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45640c3eb0 con 0x7f45640c95b0 2024-05-08T21:10:39.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.399+0000 7f456c18e700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45641f4420 con 0x7f45640c9150 2024-05-08T21:10:39.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.399+0000 7f456c18e700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45641f4140 con 0x7f45641541a0 2024-05-08T21:10:39.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.399+0000 7f4569729700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f45640c95b0 0x7f45640c42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:39.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.399+0000 7f4569729700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f45640c95b0 0x7f45640c42d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42822/0 (socket says 172.21.15.80:42822) 2024-05-08T21:10:39.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.399+0000 7f4569729700 1 -- 172.21.15.80:0/1107549007 learned_addr learned my addr 172.21.15.80:0/1107549007 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:39.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.399+0000 7f4569f2a700 1 --2- 172.21.15.80:0/1107549007 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f45640c9150 0x7f45641f3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:39.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.399+0000 7f456a72b700 1 --2- 172.21.15.80:0/1107549007 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f45641541a0 0x7f45640c4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:39.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.400+0000 7f4569729700 1 -- 172.21.15.80:0/1107549007 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f45641541a0 msgr2=0x7f45640c4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:39.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.400+0000 7f4569729700 1 --2- 172.21.15.80:0/1107549007 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f45641541a0 0x7f45640c4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:39.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.400+0000 7f4569729700 1 -- 172.21.15.80:0/1107549007 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f45640c9150 msgr2=0x7f45641f3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:39.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.400+0000 7f4569729700 1 --2- 172.21.15.80:0/1107549007 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f45640c9150 0x7f45641f3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:39.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.400+0000 7f4569729700 1 -- 172.21.15.80:0/1107549007 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4554009550 con 0x7f45640c95b0 2024-05-08T21:10:39.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.400+0000 7f4569729700 1 --2- 172.21.15.80:0/1107549007 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f45640c95b0 0x7f45640c42d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f456000c4e0 tx=0x7f456000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:39.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.400+0000 7f455a7fc700 1 -- 172.21.15.80:0/1107549007 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45600052d0 con 0x7f45640c95b0 2024-05-08T21:10:39.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.400+0000 7f455a7fc700 1 -- 172.21.15.80:0/1107549007 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4560005430 con 0x7f45640c95b0 2024-05-08T21:10:39.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.400+0000 7f455a7fc700 1 -- 172.21.15.80:0/1107549007 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45600038c0 con 0x7f45640c95b0 2024-05-08T21:10:39.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.400+0000 7f456c18e700 1 -- 172.21.15.80:0/1107549007 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45640c63a0 con 0x7f45640c95b0 2024-05-08T21:10:39.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.400+0000 7f456c18e700 1 -- 172.21.15.80:0/1107549007 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45640c6960 con 0x7f45640c95b0 2024-05-08T21:10:39.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.401+0000 7f456c18e700 1 -- 172.21.15.80:0/1107549007 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45640c6b80 con 0x7f45640c95b0 2024-05-08T21:10:39.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.401+0000 7f455a7fc700 1 -- 172.21.15.80:0/1107549007 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4560003a20 con 0x7f45640c95b0 2024-05-08T21:10:39.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.402+0000 7f455a7fc700 1 --2- 172.21.15.80:0/1107549007 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f454806acc0 0x7f454806d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:39.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.402+0000 7f455a7fc700 1 -- 172.21.15.80:0/1107549007 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f45600888d0 con 0x7f45640c95b0 2024-05-08T21:10:39.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.402+0000 7f4569f2a700 1 --2- 172.21.15.80:0/1107549007 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f454806acc0 0x7f454806d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:39.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.402+0000 7f4569f2a700 1 --2- 172.21.15.80:0/1107549007 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f454806acc0 0x7f454806d180 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4554014040 tx=0x7f4554008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:39.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.406+0000 7f455a7fc700 1 -- 172.21.15.80:0/1107549007 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f45640c6b80 con 0x7f45640c95b0 2024-05-08T21:10:39.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.603+0000 7f456c18e700 1 -- 172.21.15.80:0/1107549007 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f45640c3c10 con 0x7f45640c95b0 2024-05-08T21:10:39.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.603+0000 7f455a7fc700 1 -- 172.21.15.80:0/1107549007 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f4560017020 con 0x7f45640c95b0 2024-05-08T21:10:39.607 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-05-08T21:10:39.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.605+0000 7f456c18e700 1 -- 172.21.15.80:0/1107549007 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f454806acc0 msgr2=0x7f454806d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:39.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.605+0000 7f456c18e700 1 --2- 172.21.15.80:0/1107549007 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f454806acc0 0x7f454806d180 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4554014040 tx=0x7f4554008030 comp rx=0 tx=0).stop 2024-05-08T21:10:39.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.605+0000 7f456c18e700 1 -- 172.21.15.80:0/1107549007 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f45640c95b0 msgr2=0x7f45640c42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:39.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.605+0000 7f456c18e700 1 --2- 172.21.15.80:0/1107549007 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f45640c95b0 0x7f45640c42d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f456000c4e0 tx=0x7f456000c7f0 comp rx=0 tx=0).stop 2024-05-08T21:10:39.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.605+0000 7f456c18e700 1 -- 172.21.15.80:0/1107549007 shutdown_connections 2024-05-08T21:10:39.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.605+0000 7f456c18e700 1 --2- 172.21.15.80:0/1107549007 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f454806acc0 0x7f454806d180 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:39.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.605+0000 7f456c18e700 1 --2- 172.21.15.80:0/1107549007 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f45641541a0 0x7f45640c4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:39.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.605+0000 7f456c18e700 1 --2- 172.21.15.80:0/1107549007 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f45640c9150 0x7f45641f3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:39.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.605+0000 7f456c18e700 1 --2- 172.21.15.80:0/1107549007 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f45640c95b0 0x7f45640c42d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:39.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.605+0000 7f456c18e700 1 -- 172.21.15.80:0/1107549007 >> 172.21.15.80:0/1107549007 conn(0x7f456406ef80 msgr2=0x7f4564153230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:39.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.605+0000 7f456c18e700 1 -- 172.21.15.80:0/1107549007 shutdown_connections 2024-05-08T21:10:39.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.605+0000 7f456c18e700 1 -- 172.21.15.80:0/1107549007 wait complete. 2024-05-08T21:10:39.621 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:10:39.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.738+0000 7f6caa4ff700 1 Processor -- start 2024-05-08T21:10:39.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.738+0000 7f6caa4ff700 1 -- start start 2024-05-08T21:10:39.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.738+0000 7f6caa4ff700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6ca40ccfe0 0x7f6ca4071be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:39.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.738+0000 7f6caa4ff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6ca40c8380 0x7f6ca40c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:39.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.738+0000 7f6caa4ff700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ca40c9150 con 0x7f6ca40ccc00 2024-05-08T21:10:39.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.738+0000 7f6caa4ff700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ca40c99f0 con 0x7f6ca40c8380 2024-05-08T21:10:39.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.738+0000 7f6caa4ff700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca41579c0 con 0x7f6ca40ccfe0 2024-05-08T21:10:39.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.739+0000 7f6ca8a9c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6ca40c8380 0x7f6ca40c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:39.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.739+0000 7f6ca3fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f6ca40ccc00 0x7f6ca4156ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41880/0 (socket says 172.21.15.80:41880) 2024-05-08T21:10:39.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.739+0000 7f6ca3fff700 1 -- 172.21.15.80:0/257719590 learned_addr learned my addr 172.21.15.80:0/257719590 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:10:39.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.739+0000 7f6ca2ffd700 1 -- 172.21.15.80:0/257719590 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 658891624 0 0) 0x7f6ca40c9150 con 0x7f6ca40ccc00 2024-05-08T21:10:39.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.739+0000 7f6ca37fe700 1 --2- 172.21.15.80:0/257719590 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6ca40ccfe0 0x7f6ca4071be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:39.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.739+0000 7f6ca2ffd700 1 -- 172.21.15.80:0/257719590 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c8c0035b0 con 0x7f6ca40ccc00 2024-05-08T21:10:39.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.739+0000 7f6ca8a9c700 1 -- 172.21.15.80:0/257719590 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6ca40ccfe0 msgr2=0x7f6ca4071be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:39.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.739+0000 7f6ca8a9c700 1 --2- 172.21.15.80:0/257719590 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6ca40ccfe0 0x7f6ca4071be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:39.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.739+0000 7f6ca8a9c700 1 -- 172.21.15.80:0/257719590 >> v1:172.21.15.80:6789/0 conn(0x7f6ca40ccc00 legacy=0x7f6ca4156ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:39.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.739+0000 7f6ca8a9c700 1 -- 172.21.15.80:0/257719590 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca4157ca0 con 0x7f6ca40c8380 2024-05-08T21:10:39.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.739+0000 7f6ca8a9c700 1 --2- 172.21.15.80:0/257719590 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ca40c8380 0x7f6ca40c9e80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c009d90 tx=0x7f6c9c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5f0013fa80746ca server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:39.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.739+0000 7f6ca2ffd700 1 -- 172.21.15.80:0/257719590 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9c00e070 con 0x7f6ca40c8380 2024-05-08T21:10:39.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.739+0000 7f6ca2ffd700 1 -- 172.21.15.80:0/257719590 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c9c00bb20 con 0x7f6ca40c8380 2024-05-08T21:10:39.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.739+0000 7f6ca2ffd700 1 -- 172.21.15.80:0/257719590 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9c012430 con 0x7f6ca40c8380 2024-05-08T21:10:39.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.740+0000 7f6caa4ff700 1 -- 172.21.15.80:0/257719590 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ca40c8380 msgr2=0x7f6ca40c9e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:39.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.740+0000 7f6caa4ff700 1 --2- 172.21.15.80:0/257719590 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ca40c8380 0x7f6ca40c9e80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c009d90 tx=0x7f6c9c00b330 comp rx=0 tx=0).stop 2024-05-08T21:10:39.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.740+0000 7f6caa4ff700 1 -- 172.21.15.80:0/257719590 shutdown_connections 2024-05-08T21:10:39.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.740+0000 7f6caa4ff700 1 --2- 172.21.15.80:0/257719590 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ca40c8380 0x7f6ca40c9e80 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:39.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.740+0000 7f6caa4ff700 1 --2- 172.21.15.80:0/257719590 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6ca40ccfe0 0x7f6ca4071be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:39.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.740+0000 7f6caa4ff700 1 -- 172.21.15.80:0/257719590 >> 172.21.15.80:0/257719590 conn(0x7f6ca406f140 msgr2=0x7f6ca406f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:39.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.740+0000 7f6caa4ff700 1 -- 172.21.15.80:0/257719590 shutdown_connections 2024-05-08T21:10:39.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.740+0000 7f6caa4ff700 1 -- 172.21.15.80:0/257719590 wait complete. 2024-05-08T21:10:39.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.741+0000 7f6caa4ff700 1 Processor -- start 2024-05-08T21:10:39.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.742+0000 7f6caa4ff700 1 -- start start 2024-05-08T21:10:39.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.742+0000 7f6caa4ff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ca40c8380 0x7f6ca4155f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:39.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.742+0000 7f6caa4ff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ca40ccc00 0x7f6ca4154250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:39.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.742+0000 7f6caa4ff700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6ca40ccfe0 0x7f6ca41efb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:39.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.742+0000 7f6caa4ff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca41ef950 con 0x7f6ca40ccc00 2024-05-08T21:10:39.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.742+0000 7f6caa4ff700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca4155b00 con 0x7f6ca40c8380 2024-05-08T21:10:39.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.742+0000 7f6caa4ff700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca414e960 con 0x7f6ca40ccfe0 2024-05-08T21:10:39.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.742+0000 7f6ca37fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ca40ccc00 0x7f6ca4154250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:39.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.742+0000 7f6ca37fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ca40ccc00 0x7f6ca4154250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42832/0 (socket says 172.21.15.80:42832) 2024-05-08T21:10:39.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.742+0000 7f6ca37fe700 1 -- 172.21.15.80:0/3023293323 learned_addr learned my addr 172.21.15.80:0/3023293323 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:39.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.743+0000 7f6ca8a9c700 1 --2- 172.21.15.80:0/3023293323 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6ca40ccfe0 0x7f6ca41efb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:39.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.743+0000 7f6ca3fff700 1 --2- 172.21.15.80:0/3023293323 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ca40c8380 0x7f6ca4155f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:39.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.743+0000 7f6ca37fe700 1 -- 172.21.15.80:0/3023293323 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6ca40ccfe0 msgr2=0x7f6ca41efb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:39.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.743+0000 7f6ca37fe700 1 --2- 172.21.15.80:0/3023293323 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6ca40ccfe0 0x7f6ca41efb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:39.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.743+0000 7f6ca37fe700 1 -- 172.21.15.80:0/3023293323 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ca40c8380 msgr2=0x7f6ca4155f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:39.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.743+0000 7f6ca37fe700 1 --2- 172.21.15.80:0/3023293323 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ca40c8380 0x7f6ca4155f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:39.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.743+0000 7f6ca37fe700 1 -- 172.21.15.80:0/3023293323 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c9c009a70 con 0x7f6ca40ccc00 2024-05-08T21:10:39.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.743+0000 7f6ca37fe700 1 --2- 172.21.15.80:0/3023293323 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ca40ccc00 0x7f6ca4154250 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6c9800d800 tx=0x7f6c9800db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:39.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.743+0000 7f6ca0ff9700 1 -- 172.21.15.80:0/3023293323 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c980125f0 con 0x7f6ca40ccc00 2024-05-08T21:10:39.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.743+0000 7f6ca0ff9700 1 -- 172.21.15.80:0/3023293323 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c98012750 con 0x7f6ca40ccc00 2024-05-08T21:10:39.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.743+0000 7f6caa4ff700 1 -- 172.21.15.80:0/3023293323 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ca4158100 con 0x7f6ca40ccc00 2024-05-08T21:10:39.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.743+0000 7f6ca0ff9700 1 -- 172.21.15.80:0/3023293323 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c98012b00 con 0x7f6ca40ccc00 2024-05-08T21:10:39.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.743+0000 7f6caa4ff700 1 -- 172.21.15.80:0/3023293323 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ca41554f0 con 0x7f6ca40ccc00 2024-05-08T21:10:39.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.744+0000 7f6caa4ff700 1 -- 172.21.15.80:0/3023293323 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ca41564d0 con 0x7f6ca40ccc00 2024-05-08T21:10:39.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.744+0000 7f6ca0ff9700 1 -- 172.21.15.80:0/3023293323 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6c98012c60 con 0x7f6ca40ccc00 2024-05-08T21:10:39.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.745+0000 7f6ca0ff9700 1 --2- 172.21.15.80:0/3023293323 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f6c9006ac90 0x7f6c9006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:39.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.745+0000 7f6ca0ff9700 1 -- 172.21.15.80:0/3023293323 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6c98089680 con 0x7f6ca40ccc00 2024-05-08T21:10:39.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.745+0000 7f6ca3fff700 1 --2- 172.21.15.80:0/3023293323 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f6c9006ac90 0x7f6c9006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:39.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.745+0000 7f6ca3fff700 1 --2- 172.21.15.80:0/3023293323 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f6c9006ac90 0x7f6c9006d150 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6c94007fd0 tx=0x7f6c94007dc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:39.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.749+0000 7f6ca0ff9700 1 -- 172.21.15.80:0/3023293323 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f6c980544e0 con 0x7f6ca40ccc00 2024-05-08T21:10:39.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.993+0000 7f6caa4ff700 1 -- 172.21.15.80:0/3023293323 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6ca40c7490 con 0x7f6ca40ccc00 2024-05-08T21:10:39.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.994+0000 7f6ca0ff9700 1 -- 172.21.15.80:0/3023293323 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6254 (secure 0 0 0) 0x7f6c98057b00 con 0x7f6ca40ccc00 2024-05-08T21:10:39.997 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:10:39.997 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/2289230272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":2289230272},{"type":"v1","addr":"172.21.15.106:6833","nonce":2289230272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:10:31.304591+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.106:6836/1949999190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1949999190},{"type":"v1","addr":"172.21.15.106:6836","nonce":1949999190}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:10:39.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.996+0000 7f6caa4ff700 1 -- 172.21.15.80:0/3023293323 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f6c9006ac90 msgr2=0x7f6c9006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:39.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.996+0000 7f6caa4ff700 1 --2- 172.21.15.80:0/3023293323 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f6c9006ac90 0x7f6c9006d150 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6c94007fd0 tx=0x7f6c94007dc0 comp rx=0 tx=0).stop 2024-05-08T21:10:40.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.996+0000 7f6caa4ff700 1 -- 172.21.15.80:0/3023293323 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ca40ccc00 msgr2=0x7f6ca4154250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:40.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.996+0000 7f6caa4ff700 1 --2- 172.21.15.80:0/3023293323 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ca40ccc00 0x7f6ca4154250 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6c9800d800 tx=0x7f6c9800db10 comp rx=0 tx=0).stop 2024-05-08T21:10:40.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.996+0000 7f6caa4ff700 1 -- 172.21.15.80:0/3023293323 shutdown_connections 2024-05-08T21:10:40.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.996+0000 7f6caa4ff700 1 --2- 172.21.15.80:0/3023293323 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f6c9006ac90 0x7f6c9006d150 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:40.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.996+0000 7f6caa4ff700 1 --2- 172.21.15.80:0/3023293323 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6ca40ccfe0 0x7f6ca41efb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:40.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.996+0000 7f6caa4ff700 1 --2- 172.21.15.80:0/3023293323 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ca40c8380 0x7f6ca4155f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:40.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.996+0000 7f6caa4ff700 1 --2- 172.21.15.80:0/3023293323 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ca40ccc00 0x7f6ca4154250 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:40.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.996+0000 7f6caa4ff700 1 -- 172.21.15.80:0/3023293323 >> 172.21.15.80:0/3023293323 conn(0x7f6ca406f140 msgr2=0x7f6ca41485b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:40.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.996+0000 7f6caa4ff700 1 -- 172.21.15.80:0/3023293323 shutdown_connections 2024-05-08T21:10:40.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:39.996+0000 7f6caa4ff700 1 -- 172.21.15.80:0/3023293323 wait complete. 2024-05-08T21:10:40.000 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 10 2024-05-08T21:10:40.012 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T21:10:40.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.130+0000 7f1294391700 1 Processor -- start 2024-05-08T21:10:40.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.130+0000 7f1294391700 1 -- start start 2024-05-08T21:10:40.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.131+0000 7f1294391700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f128c141450 0x7f128c06dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:40.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.131+0000 7f1294391700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f128c06eff0 0x7f128c158ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:40.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.131+0000 7f1294391700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f128c0c7120 0x7f128c0c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:40.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.131+0000 7f1294391700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f128c0c57f0 con 0x7f128c06eff0 2024-05-08T21:10:40.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.131+0000 7f1294391700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f128c0c5a40 con 0x7f128c141450 2024-05-08T21:10:40.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.131+0000 7f1294391700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f128c0cae60 con 0x7f128c0c7120 2024-05-08T21:10:40.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.131+0000 7f129192c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f128c06eff0 0x7f128c158ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:40.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.131+0000 7f129192c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f128c06eff0 0x7f128c158ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42836/0 (socket says 172.21.15.80:42836) 2024-05-08T21:10:40.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.131+0000 7f129192c700 1 -- 172.21.15.80:0/4283568312 learned_addr learned my addr 172.21.15.80:0/4283568312 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:40.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.131+0000 7f129292e700 1 --2- 172.21.15.80:0/4283568312 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f128c0c7120 0x7f128c0c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:40.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.131+0000 7f129212d700 1 --2- 172.21.15.80:0/4283568312 >> v2:172.21.15.106:3300/0 conn(0x7f128c141450 0x7f128c06dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:40.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.131+0000 7f129192c700 1 -- 172.21.15.80:0/4283568312 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f128c0c7120 msgr2=0x7f128c0c75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:40.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.131+0000 7f129192c700 1 --2- 172.21.15.80:0/4283568312 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f128c0c7120 0x7f128c0c75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:40.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.131+0000 7f129192c700 1 -- 172.21.15.80:0/4283568312 >> v2:172.21.15.106:3300/0 conn(0x7f128c141450 msgr2=0x7f128c06dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:40.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.131+0000 7f129192c700 1 --2- 172.21.15.80:0/4283568312 >> v2:172.21.15.106:3300/0 conn(0x7f128c141450 0x7f128c06dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:40.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.131+0000 7f129192c700 1 -- 172.21.15.80:0/4283568312 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f128c0cb140 con 0x7f128c06eff0 2024-05-08T21:10:40.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.131+0000 7f129292e700 1 --2- 172.21.15.80:0/4283568312 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f128c0c7120 0x7f128c0c75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:10:40.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.131+0000 7f129212d700 1 --2- 172.21.15.80:0/4283568312 >> v2:172.21.15.106:3300/0 conn(0x7f128c141450 0x7f128c06dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:10:40.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.132+0000 7f129192c700 1 --2- 172.21.15.80:0/4283568312 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f128c06eff0 0x7f128c158ab0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f128c070080 tx=0x7f1288009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80371b0c42c74487 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:40.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.132+0000 7f129112b700 1 -- 172.21.15.80:0/4283568312 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128800b870 con 0x7f128c06eff0 2024-05-08T21:10:40.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.132+0000 7f129112b700 1 -- 172.21.15.80:0/4283568312 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f128800b9d0 con 0x7f128c06eff0 2024-05-08T21:10:40.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.132+0000 7f129112b700 1 -- 172.21.15.80:0/4283568312 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128800bd60 con 0x7f128c06eff0 2024-05-08T21:10:40.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.132+0000 7f1294391700 1 -- 172.21.15.80:0/4283568312 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f128c06eff0 msgr2=0x7f128c158ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:40.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.132+0000 7f1294391700 1 --2- 172.21.15.80:0/4283568312 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f128c06eff0 0x7f128c158ab0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f128c070080 tx=0x7f1288009bd0 comp rx=0 tx=0).stop 2024-05-08T21:10:40.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.132+0000 7f1294391700 1 -- 172.21.15.80:0/4283568312 shutdown_connections 2024-05-08T21:10:40.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.132+0000 7f1294391700 1 --2- 172.21.15.80:0/4283568312 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f128c0c7120 0x7f128c0c75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:40.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.132+0000 7f1294391700 1 --2- 172.21.15.80:0/4283568312 >> v2:172.21.15.106:3300/0 conn(0x7f128c141450 0x7f128c06dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:40.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.132+0000 7f1294391700 1 --2- 172.21.15.80:0/4283568312 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f128c06eff0 0x7f128c158ab0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:40.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.132+0000 7f1294391700 1 -- 172.21.15.80:0/4283568312 >> 172.21.15.80:0/4283568312 conn(0x7f128c0ca340 msgr2=0x7f128c0ca750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:40.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.132+0000 7f1294391700 1 -- 172.21.15.80:0/4283568312 shutdown_connections 2024-05-08T21:10:40.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.132+0000 7f1294391700 1 -- 172.21.15.80:0/4283568312 wait complete. 2024-05-08T21:10:40.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.133+0000 7f1294391700 1 Processor -- start 2024-05-08T21:10:40.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.134+0000 7f1294391700 1 -- start start 2024-05-08T21:10:40.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.134+0000 7f1294391700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f128c06eff0 0x7f128c152700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:40.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.134+0000 7f1294391700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f128c0c7120 0x7f128c15ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:40.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.134+0000 7f1294391700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f128c141450 0x7f128c13cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:40.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.134+0000 7f1294391700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f128c15a800 con 0x7f128c0c7120 2024-05-08T21:10:40.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.134+0000 7f1294391700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f128c1ed9c0 con 0x7f128c141450 2024-05-08T21:10:40.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.134+0000 7f1294391700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f128c1ee500 con 0x7f128c06eff0 2024-05-08T21:10:40.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.134+0000 7f129192c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f128c0c7120 0x7f128c15ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:40.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.134+0000 7f129192c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f128c0c7120 0x7f128c15ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42852/0 (socket says 172.21.15.80:42852) 2024-05-08T21:10:40.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.134+0000 7f129192c700 1 -- 172.21.15.80:0/2575079389 learned_addr learned my addr 172.21.15.80:0/2575079389 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:40.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.134+0000 7f129212d700 1 --2- 172.21.15.80:0/2575079389 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f128c06eff0 0x7f128c152700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:40.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.134+0000 7f129292e700 1 --2- 172.21.15.80:0/2575079389 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f128c141450 0x7f128c13cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:40.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.135+0000 7f129192c700 1 -- 172.21.15.80:0/2575079389 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f128c06eff0 msgr2=0x7f128c152700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:40.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.135+0000 7f129192c700 1 --2- 172.21.15.80:0/2575079389 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f128c06eff0 0x7f128c152700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:40.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.135+0000 7f129192c700 1 -- 172.21.15.80:0/2575079389 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f128c141450 msgr2=0x7f128c13cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:40.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.135+0000 7f129192c700 1 --2- 172.21.15.80:0/2575079389 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f128c141450 0x7f128c13cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:40.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.135+0000 7f129192c700 1 -- 172.21.15.80:0/2575079389 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1288009550 con 0x7f128c0c7120 2024-05-08T21:10:40.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.135+0000 7f129192c700 1 --2- 172.21.15.80:0/2575079389 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f128c0c7120 0x7f128c15ac20 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1288014040 tx=0x7f1288004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:40.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.135+0000 7f1282ffd700 1 -- 172.21.15.80:0/2575079389 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1288004500 con 0x7f128c0c7120 2024-05-08T21:10:40.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.135+0000 7f1282ffd700 1 -- 172.21.15.80:0/2575079389 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12880036a0 con 0x7f128c0c7120 2024-05-08T21:10:40.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.135+0000 7f1282ffd700 1 -- 172.21.15.80:0/2575079389 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1288003a30 con 0x7f128c0c7120 2024-05-08T21:10:40.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.135+0000 7f1294391700 1 -- 172.21.15.80:0/2575079389 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f128c152c40 con 0x7f128c0c7120 2024-05-08T21:10:40.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.135+0000 7f1294391700 1 -- 172.21.15.80:0/2575079389 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f128c1edf40 con 0x7f128c0c7120 2024-05-08T21:10:40.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.136+0000 7f1294391700 1 -- 172.21.15.80:0/2575079389 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f128c04ec60 con 0x7f128c0c7120 2024-05-08T21:10:40.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.136+0000 7f1282ffd700 1 -- 172.21.15.80:0/2575079389 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1288003b90 con 0x7f128c0c7120 2024-05-08T21:10:40.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.137+0000 7f1282ffd700 1 --2- 172.21.15.80:0/2575079389 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f127006ac90 0x7f127006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:40.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.137+0000 7f1282ffd700 1 -- 172.21.15.80:0/2575079389 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1288020030 con 0x7f128c0c7120 2024-05-08T21:10:40.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.137+0000 7f129212d700 1 --2- 172.21.15.80:0/2575079389 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f127006ac90 0x7f127006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:40.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.137+0000 7f129212d700 1 --2- 172.21.15.80:0/2575079389 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f127006ac90 0x7f127006d150 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f127c006fd0 tx=0x7f127c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:40.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.141+0000 7f1282ffd700 1 -- 172.21.15.80:0/2575079389 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f1288055760 con 0x7f128c0c7120 2024-05-08T21:10:40.221 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:10:40.224 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:10:40.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.342+0000 7f1294391700 1 -- 172.21.15.80:0/2575079389 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f128c157a90 con 0x7f128c0c7120 2024-05-08T21:10:40.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.343+0000 7f1282ffd700 1 -- 172.21.15.80:0/2575079389 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+17878 (secure 0 0 0) 0x7f128805f070 con 0x7f128c0c7120 2024-05-08T21:10:40.347 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:10:40.347 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":26,"fsid":"44d31c1e-aad3-47ca-a4fa-85a63d4a60aa","created":"2024-05-08T21:09:46.467038+0000","modified":"2024-05-08T21:10:08.163735+0000","last_up_change":"2024-05-08T21:09:57.284675+0000","last_in_change":"2024-05-08T21:09:49.125444+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T21:09:58.238951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T21:10:02.177476+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T21:10:02.685535+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-08T21:10:05.753779+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c3f9d93e-ed6d-4a0c-b5c0-0e8d44c65fdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":47011},{"type":"v1","addr":"172.21.15.80:6817","nonce":47011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":47011},{"type":"v1","addr":"172.21.15.80:6819","nonce":47011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":47011},{"type":"v1","addr":"172.21.15.80:6823","nonce":47011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":47011},{"type":"v1","addr":"172.21.15.80:6821","nonce":47011}]},"public_addr":"172.21.15.80:6817/47011","cluster_addr":"172.21.15.80:6819/47011","heartbeat_back_addr":"172.21.15.80:6823/47011","heartbeat_front_addr":"172.21.15.80:6821/47011","state":["exists","up"]},{"osd":1,"uuid":"4ce2b4d6-6c40-43aa-8dd1-743fef8915df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":47010},{"type":"v1","addr":"172.21.15.80:6809","nonce":47010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":47010},{"type":"v1","addr":"172.21.15.80:6811","nonce":47010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":47010},{"type":"v1","addr":"172.21.15.80:6815","nonce":47010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":47010},{"type":"v1","addr":"172.21.15.80:6813","nonce":47010}]},"public_addr":"172.21.15.80:6809/47010","cluster_addr":"172.21.15.80:6811/47010","heartbeat_back_addr":"172.21.15.80:6815/47010","heartbeat_front_addr":"172.21.15.80:6813/47010","state":["exists","up"]},{"osd":2,"uuid":"e30cc3bc-6461-4fac-960a-de00c9488d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":47009},{"type":"v1","addr":"172.21.15.80:6801","nonce":47009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":47009},{"type":"v1","addr":"172.21.15.80:6803","nonce":47009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":47009},{"type":"v1","addr":"172.21.15.80:6807","nonce":47009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":47009},{"type":"v1","addr":"172.21.15.80:6805","nonce":47009}]},"public_addr":"172.21.15.80:6801/47009","cluster_addr":"172.21.15.80:6803/47009","heartbeat_back_addr":"172.21.15.80:6807/47009","heartbeat_front_addr":"172.21.15.80:6805/47009","state":["exists","up"]},{"osd":3,"uuid":"a415c099-9ea6-40be-98ed-f2932f98dfd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":47012},{"type":"v1","addr":"172.21.15.80:6825","nonce":47012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":47012},{"type":"v1","addr":"172.21.15.80:6827","nonce":47012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":47012},{"type":"v1","addr":"172.21.15.80:6831","nonce":47012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":47012},{"type":"v1","addr":"172.21.15.80:6829","nonce":47012}]},"public_addr":"172.21.15.80:6825/47012","cluster_addr":"172.21.15.80:6827/47012","heartbeat_back_addr":"172.21.15.80:6831/47012","heartbeat_front_addr":"172.21.15.80:6829/47012","state":["exists","up"]},{"osd":4,"uuid":"5ae1d51f-0918-4571-b79b-154308d46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6823","nonce":47114},{"type":"v1","addr":"172.21.15.106:6825","nonce":47114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":47114},{"type":"v1","addr":"172.21.15.106:6827","nonce":47114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":47114},{"type":"v1","addr":"172.21.15.106:6831","nonce":47114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":47114},{"type":"v1","addr":"172.21.15.106:6829","nonce":47114}]},"public_addr":"172.21.15.106:6825/47114","cluster_addr":"172.21.15.106:6827/47114","heartbeat_back_addr":"172.21.15.106:6831/47114","heartbeat_front_addr":"172.21.15.106:6829/47114","state":["exists","up"]},{"osd":5,"uuid":"a19ac74e-4282-4428-b167-26ba6b92f732","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6807","nonce":47111},{"type":"v1","addr":"172.21.15.106:6809","nonce":47111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":47111},{"type":"v1","addr":"172.21.15.106:6811","nonce":47111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":47111},{"type":"v1","addr":"172.21.15.106:6815","nonce":47111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":47111},{"type":"v1","addr":"172.21.15.106:6813","nonce":47111}]},"public_addr":"172.21.15.106:6809/47111","cluster_addr":"172.21.15.106:6811/47111","heartbeat_back_addr":"172.21.15.106:6815/47111","heartbeat_front_addr":"172.21.15.106:6813/47111","state":["exists","up"]},{"osd":6,"uuid":"bfe72edd-7acc-4805-807d-2000e76f2feb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":47112},{"type":"v1","addr":"172.21.15.106:6817","nonce":47112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":47112},{"type":"v1","addr":"172.21.15.106:6819","nonce":47112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":47112},{"type":"v1","addr":"172.21.15.106:6824","nonce":47112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":47112},{"type":"v1","addr":"172.21.15.106:6821","nonce":47112}]},"public_addr":"172.21.15.106:6817/47112","cluster_addr":"172.21.15.106:6819/47112","heartbeat_back_addr":"172.21.15.106:6824/47112","heartbeat_front_addr":"172.21.15.106:6821/47112","state":["exists","up"]},{"osd":7,"uuid":"99897f22-ed17-4c7c-9088-cc0c4a51f786","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":47113},{"type":"v1","addr":"172.21.15.106:6801","nonce":47113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":47113},{"type":"v1","addr":"172.21.15.106:6803","nonce":47113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":47113},{"type":"v1","addr":"172.21.15.106:6808","nonce":47113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":47113},{"type":"v1","addr":"172.21.15.106:6805","nonce":47113}]},"public_addr":"172.21.15.106:6801/47113","cluster_addr":"172.21.15.106:6803/47113","heartbeat_back_addr":"172.21.15.106:6808/47113","heartbeat_front_addr":"172.21.15.106:6805/47113","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.232670+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.277753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.050087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.349312+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.344080+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.348781+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.352539+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.275013+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T21:10:40.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.345+0000 7f1294391700 1 -- 172.21.15.80:0/2575079389 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f127006ac90 msgr2=0x7f127006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:40.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.345+0000 7f1294391700 1 --2- 172.21.15.80:0/2575079389 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f127006ac90 0x7f127006d150 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f127c006fd0 tx=0x7f127c008040 comp rx=0 tx=0).stop 2024-05-08T21:10:40.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.345+0000 7f1294391700 1 -- 172.21.15.80:0/2575079389 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f128c0c7120 msgr2=0x7f128c15ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:40.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.345+0000 7f1294391700 1 --2- 172.21.15.80:0/2575079389 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f128c0c7120 0x7f128c15ac20 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1288014040 tx=0x7f1288004750 comp rx=0 tx=0).stop 2024-05-08T21:10:40.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.345+0000 7f1294391700 1 -- 172.21.15.80:0/2575079389 shutdown_connections 2024-05-08T21:10:40.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.345+0000 7f1294391700 1 --2- 172.21.15.80:0/2575079389 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f127006ac90 0x7f127006d150 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:40.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.345+0000 7f1294391700 1 --2- 172.21.15.80:0/2575079389 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f128c141450 0x7f128c13cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:40.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.345+0000 7f1294391700 1 --2- 172.21.15.80:0/2575079389 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f128c06eff0 0x7f128c152700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:40.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.345+0000 7f1294391700 1 --2- 172.21.15.80:0/2575079389 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f128c0c7120 0x7f128c15ac20 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:40.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.345+0000 7f1294391700 1 -- 172.21.15.80:0/2575079389 >> 172.21.15.80:0/2575079389 conn(0x7f128c0ca340 msgr2=0x7f128c1589b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:40.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.346+0000 7f1294391700 1 -- 172.21.15.80:0/2575079389 shutdown_connections 2024-05-08T21:10:40.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.346+0000 7f1294391700 1 -- 172.21.15.80:0/2575079389 wait complete. 2024-05-08T21:10:40.361 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T21:09:58.238951+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T21:10:02.177476+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T21:10:02.685535+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-08T21:10:05.753779+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-08T21:10:40.362 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T21:10:40.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.484+0000 7f4eafc2e700 1 Processor -- start 2024-05-08T21:10:40.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.484+0000 7f4eafc2e700 1 -- start start 2024-05-08T21:10:40.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.485+0000 7f4eafc2e700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4ea8150dd0 0x7f4ea8071390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:40.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.485+0000 7f4eafc2e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4ea80c97f0 0x7f4ea8157940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:40.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.485+0000 7f4eafc2e700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ea8157e80 con 0x7f4ea806bad0 2024-05-08T21:10:40.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.485+0000 7f4eafc2e700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ea80c93d0 con 0x7f4ea80c97f0 2024-05-08T21:10:40.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.485+0000 7f4eafc2e700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea80c7c30 con 0x7f4ea8150dd0 2024-05-08T21:10:40.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.485+0000 7f4ead1c9700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4ea80c97f0 0x7f4ea8157940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:40.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.485+0000 7f4ead1c9700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4ea80c97f0 0x7f4ea8157940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42866/0 (socket says 172.21.15.80:42866) 2024-05-08T21:10:40.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.485+0000 7f4ead1c9700 1 -- 172.21.15.80:0/2473961139 learned_addr learned my addr 172.21.15.80:0/2473961139 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:40.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.486+0000 7f4ead9ca700 1 --2- 172.21.15.80:0/2473961139 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4ea8150dd0 0x7f4ea8071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:40.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.486+0000 7f4ead1c9700 1 -- 172.21.15.80:0/2473961139 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4ea8150dd0 msgr2=0x7f4ea8071390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:40.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.486+0000 7f4ead1c9700 1 --2- 172.21.15.80:0/2473961139 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4ea8150dd0 0x7f4ea8071390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:40.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.486+0000 7f4ead1c9700 1 -- 172.21.15.80:0/2473961139 >> v1:172.21.15.106:6789/0 conn(0x7f4ea806bad0 legacy=0x7f4ea806bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:40.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.486+0000 7f4ead1c9700 1 -- 172.21.15.80:0/2473961139 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ea80c7950 con 0x7f4ea80c97f0 2024-05-08T21:10:40.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.486+0000 7f4ead1c9700 1 --2- 172.21.15.80:0/2473961139 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ea80c97f0 0x7f4ea8157940 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4ea400bb90 tx=0x7f4ea400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=423bfe30586b5469 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:40.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.486+0000 7f4eac9c8700 1 -- 172.21.15.80:0/2473961139 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea400dd10 con 0x7f4ea80c97f0 2024-05-08T21:10:40.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.486+0000 7f4eac9c8700 1 -- 172.21.15.80:0/2473961139 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ea400de70 con 0x7f4ea80c97f0 2024-05-08T21:10:40.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.486+0000 7f4eac9c8700 1 -- 172.21.15.80:0/2473961139 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea4004230 con 0x7f4ea80c97f0 2024-05-08T21:10:40.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.486+0000 7f4eafc2e700 1 -- 172.21.15.80:0/2473961139 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ea80c97f0 msgr2=0x7f4ea8157940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:40.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.486+0000 7f4eafc2e700 1 --2- 172.21.15.80:0/2473961139 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ea80c97f0 0x7f4ea8157940 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4ea400bb90 tx=0x7f4ea400bea0 comp rx=0 tx=0).stop 2024-05-08T21:10:40.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.487+0000 7f4eafc2e700 1 -- 172.21.15.80:0/2473961139 shutdown_connections 2024-05-08T21:10:40.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.487+0000 7f4eafc2e700 1 --2- 172.21.15.80:0/2473961139 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4ea8150dd0 0x7f4ea8071390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:40.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.487+0000 7f4eafc2e700 1 --2- 172.21.15.80:0/2473961139 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ea80c97f0 0x7f4ea8157940 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:40.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.487+0000 7f4eafc2e700 1 -- 172.21.15.80:0/2473961139 >> 172.21.15.80:0/2473961139 conn(0x7f4ea806ef80 msgr2=0x7f4ea806f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:40.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.487+0000 7f4eafc2e700 1 -- 172.21.15.80:0/2473961139 shutdown_connections 2024-05-08T21:10:40.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.487+0000 7f4eafc2e700 1 -- 172.21.15.80:0/2473961139 wait complete. 2024-05-08T21:10:40.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.488+0000 7f4eafc2e700 1 Processor -- start 2024-05-08T21:10:40.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.488+0000 7f4eafc2e700 1 -- start start 2024-05-08T21:10:40.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.488+0000 7f4eafc2e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ea806bad0 0x7f4ea814b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:40.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.488+0000 7f4eafc2e700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4ea80c97f0 0x7f4ea8153950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:40.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.489+0000 7f4eafc2e700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ea8150dd0 0x7f4ea8153e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:40.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.489+0000 7f4eafc2e700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea8151d30 con 0x7f4ea806bad0 2024-05-08T21:10:40.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.489+0000 7f4eafc2e700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea8152610 con 0x7f4ea8150dd0 2024-05-08T21:10:40.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.489+0000 7f4eafc2e700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea81e0cd0 con 0x7f4ea80c97f0 2024-05-08T21:10:40.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.489+0000 7f4ead9ca700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ea806bad0 0x7f4ea814b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:40.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.489+0000 7f4ead9ca700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ea806bad0 0x7f4ea814b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42870/0 (socket says 172.21.15.80:42870) 2024-05-08T21:10:40.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.489+0000 7f4ead9ca700 1 -- 172.21.15.80:0/1046348110 learned_addr learned my addr 172.21.15.80:0/1046348110 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:40.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.489+0000 7f4ead1c9700 1 --2- 172.21.15.80:0/1046348110 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4ea80c97f0 0x7f4ea8153950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:40.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.489+0000 7f4eae1cb700 1 --2- 172.21.15.80:0/1046348110 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ea8150dd0 0x7f4ea8153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:40.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.489+0000 7f4ead9ca700 1 -- 172.21.15.80:0/1046348110 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4ea80c97f0 msgr2=0x7f4ea8153950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:40.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.489+0000 7f4ead9ca700 1 --2- 172.21.15.80:0/1046348110 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4ea80c97f0 0x7f4ea8153950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:40.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.489+0000 7f4ead9ca700 1 -- 172.21.15.80:0/1046348110 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ea8150dd0 msgr2=0x7f4ea8153e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:40.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.489+0000 7f4ead9ca700 1 --2- 172.21.15.80:0/1046348110 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ea8150dd0 0x7f4ea8153e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:40.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.489+0000 7f4ead9ca700 1 -- 172.21.15.80:0/1046348110 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ea400b7f0 con 0x7f4ea806bad0 2024-05-08T21:10:40.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.489+0000 7f4ead1c9700 1 --2- 172.21.15.80:0/1046348110 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4ea80c97f0 0x7f4ea8153950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:10:40.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.489+0000 7f4ead9ca700 1 --2- 172.21.15.80:0/1046348110 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ea806bad0 0x7f4ea814b5a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4e9800c7f0 tx=0x7f4e9800cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:40.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.489+0000 7f4e9e7fc700 1 -- 172.21.15.80:0/1046348110 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e98011800 con 0x7f4ea806bad0 2024-05-08T21:10:40.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.489+0000 7f4e9e7fc700 1 -- 172.21.15.80:0/1046348110 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e98011960 con 0x7f4ea806bad0 2024-05-08T21:10:40.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.489+0000 7f4eafc2e700 1 -- 172.21.15.80:0/1046348110 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ea81e1200 con 0x7f4ea806bad0 2024-05-08T21:10:40.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.489+0000 7f4e9e7fc700 1 -- 172.21.15.80:0/1046348110 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e98011cf0 con 0x7f4ea806bad0 2024-05-08T21:10:40.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.489+0000 7f4eafc2e700 1 -- 172.21.15.80:0/1046348110 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ea81534c0 con 0x7f4ea806bad0 2024-05-08T21:10:40.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.490+0000 7f4eafc2e700 1 -- 172.21.15.80:0/1046348110 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ea81537a0 con 0x7f4ea806bad0 2024-05-08T21:10:40.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.491+0000 7f4e9e7fc700 1 -- 172.21.15.80:0/1046348110 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4e98018360 con 0x7f4ea806bad0 2024-05-08T21:10:40.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.491+0000 7f4e9e7fc700 1 --2- 172.21.15.80:0/1046348110 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f4e8c06ac90 0x7f4e8c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:40.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.491+0000 7f4ead1c9700 1 --2- 172.21.15.80:0/1046348110 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f4e8c06ac90 0x7f4e8c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:40.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.491+0000 7f4e9e7fc700 1 -- 172.21.15.80:0/1046348110 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4e98089520 con 0x7f4ea806bad0 2024-05-08T21:10:40.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.491+0000 7f4ead1c9700 1 --2- 172.21.15.80:0/1046348110 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f4e8c06ac90 0x7f4e8c06d150 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4ea400b340 tx=0x7f4ea4013000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:40.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.496+0000 7f4e9e7fc700 1 -- 172.21.15.80:0/1046348110 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f4e98054410 con 0x7f4ea806bad0 2024-05-08T21:10:40.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.689+0000 7f4eafc2e700 1 -- 172.21.15.80:0/1046348110 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4ea804ec60 con 0x7f4ea806bad0 2024-05-08T21:10:40.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.690+0000 7f4e9e7fc700 1 -- 172.21.15.80:0/1046348110 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4e98057a30 con 0x7f4ea806bad0 2024-05-08T21:10:40.693 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-05-08T21:10:40.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.691+0000 7f4eafc2e700 1 -- 172.21.15.80:0/1046348110 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f4e8c06ac90 msgr2=0x7f4e8c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:40.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.691+0000 7f4eafc2e700 1 --2- 172.21.15.80:0/1046348110 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f4e8c06ac90 0x7f4e8c06d150 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4ea400b340 tx=0x7f4ea4013000 comp rx=0 tx=0).stop 2024-05-08T21:10:40.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.691+0000 7f4eafc2e700 1 -- 172.21.15.80:0/1046348110 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ea806bad0 msgr2=0x7f4ea814b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:40.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.691+0000 7f4eafc2e700 1 --2- 172.21.15.80:0/1046348110 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ea806bad0 0x7f4ea814b5a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4e9800c7f0 tx=0x7f4e9800cbb0 comp rx=0 tx=0).stop 2024-05-08T21:10:40.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.692+0000 7f4eafc2e700 1 -- 172.21.15.80:0/1046348110 shutdown_connections 2024-05-08T21:10:40.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.692+0000 7f4eafc2e700 1 --2- 172.21.15.80:0/1046348110 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f4e8c06ac90 0x7f4e8c06d150 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:40.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.692+0000 7f4eafc2e700 1 --2- 172.21.15.80:0/1046348110 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ea806bad0 0x7f4ea814b5a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:40.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.692+0000 7f4eafc2e700 1 --2- 172.21.15.80:0/1046348110 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ea8150dd0 0x7f4ea8153e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:40.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.692+0000 7f4eafc2e700 1 --2- 172.21.15.80:0/1046348110 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4ea80c97f0 0x7f4ea8153950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:40.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.692+0000 7f4eafc2e700 1 -- 172.21.15.80:0/1046348110 >> 172.21.15.80:0/1046348110 conn(0x7f4ea806ef80 msgr2=0x7f4ea806f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:40.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.692+0000 7f4eafc2e700 1 -- 172.21.15.80:0/1046348110 shutdown_connections 2024-05-08T21:10:40.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.692+0000 7f4eafc2e700 1 -- 172.21.15.80:0/1046348110 wait complete. 2024-05-08T21:10:40.707 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T21:10:40.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.827+0000 7f07bd3eb700 1 Processor -- start 2024-05-08T21:10:40.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.827+0000 7f07bd3eb700 1 -- start start 2024-05-08T21:10:40.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.828+0000 7f07bd3eb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f07b81544e0 0x7f07b80cb640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:40.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.828+0000 7f07bd3eb700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f07b81548c0 0x7f07b80ca850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:40.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.828+0000 7f07bd3eb700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07b815e610 con 0x7f07b80c7270 2024-05-08T21:10:40.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.828+0000 7f07bd3eb700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07b80cbe80 con 0x7f07b81544e0 2024-05-08T21:10:40.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.828+0000 7f07bd3eb700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07b815da00 con 0x7f07b81548c0 2024-05-08T21:10:40.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.828+0000 7f07b6ffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f07b81544e0 0x7f07b80cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:40.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.828+0000 7f07b77fe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f07b80c7270 0x7f07b80cc160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41894/0 (socket says 172.21.15.80:41894) 2024-05-08T21:10:40.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.828+0000 7f07b77fe700 1 -- 172.21.15.80:0/23958908 learned_addr learned my addr 172.21.15.80:0/23958908 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:10:40.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.828+0000 7f07b67fc700 1 --2- 172.21.15.80:0/23958908 >> v2:172.21.15.106:3300/0 conn(0x7f07b81548c0 0x7f07b80ca850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:40.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.828+0000 7f07b5ffb700 1 -- 172.21.15.80:0/23958908 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3867543970 0 0) 0x7f07b815e610 con 0x7f07b80c7270 2024-05-08T21:10:40.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.828+0000 7f07b5ffb700 1 -- 172.21.15.80:0/23958908 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07a00035b0 con 0x7f07b80c7270 2024-05-08T21:10:40.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.828+0000 7f07b6ffd700 1 -- 172.21.15.80:0/23958908 >> v2:172.21.15.106:3300/0 conn(0x7f07b81548c0 msgr2=0x7f07b80ca850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:40.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.828+0000 7f07b6ffd700 1 --2- 172.21.15.80:0/23958908 >> v2:172.21.15.106:3300/0 conn(0x7f07b81548c0 0x7f07b80ca850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:40.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.828+0000 7f07b6ffd700 1 -- 172.21.15.80:0/23958908 >> v1:172.21.15.80:6789/0 conn(0x7f07b80c7270 legacy=0x7f07b80cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:40.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.828+0000 7f07b6ffd700 1 -- 172.21.15.80:0/23958908 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b815dce0 con 0x7f07b81544e0 2024-05-08T21:10:40.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.828+0000 7f07b6ffd700 1 --2- 172.21.15.80:0/23958908 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07b81544e0 0x7f07b80cb640 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f07b806c2e0 tx=0x7f07a8009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89dc3d3d0d024396 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:40.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.828+0000 7f07b5ffb700 1 -- 172.21.15.80:0/23958908 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a8011830 con 0x7f07b81544e0 2024-05-08T21:10:40.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.828+0000 7f07b5ffb700 1 -- 172.21.15.80:0/23958908 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07a8011990 con 0x7f07b81544e0 2024-05-08T21:10:40.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.828+0000 7f07b5ffb700 1 -- 172.21.15.80:0/23958908 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a8011d20 con 0x7f07b81544e0 2024-05-08T21:10:40.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.829+0000 7f07bd3eb700 1 -- 172.21.15.80:0/23958908 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07b81544e0 msgr2=0x7f07b80cb640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:40.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.829+0000 7f07bd3eb700 1 --2- 172.21.15.80:0/23958908 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07b81544e0 0x7f07b80cb640 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f07b806c2e0 tx=0x7f07a8009b20 comp rx=0 tx=0).stop 2024-05-08T21:10:40.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.829+0000 7f07bd3eb700 1 -- 172.21.15.80:0/23958908 shutdown_connections 2024-05-08T21:10:40.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.829+0000 7f07bd3eb700 1 --2- 172.21.15.80:0/23958908 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07b81544e0 0x7f07b80cb640 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:40.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.829+0000 7f07bd3eb700 1 --2- 172.21.15.80:0/23958908 >> v2:172.21.15.106:3300/0 conn(0x7f07b81548c0 0x7f07b80ca850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:40.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.829+0000 7f07bd3eb700 1 -- 172.21.15.80:0/23958908 >> 172.21.15.80:0/23958908 conn(0x7f07b806c810 msgr2=0x7f07b806cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:40.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.829+0000 7f07bd3eb700 1 -- 172.21.15.80:0/23958908 shutdown_connections 2024-05-08T21:10:40.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.829+0000 7f07bd3eb700 1 -- 172.21.15.80:0/23958908 wait complete. 2024-05-08T21:10:40.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.830+0000 7f07bd3eb700 1 Processor -- start 2024-05-08T21:10:40.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.830+0000 7f07bd3eb700 1 -- start start 2024-05-08T21:10:40.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.831+0000 7f07bd3eb700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07b80c7270 0x7f07b81f0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:40.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.831+0000 7f07bd3eb700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f07b81544e0 0x7f07b814ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:40.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.831+0000 7f07bd3eb700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f07b81548c0 0x7f07b81ef820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:40.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.831+0000 7f07bd3eb700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b81525b0 con 0x7f07b80c7270 2024-05-08T21:10:40.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.831+0000 7f07bd3eb700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b8151ca0 con 0x7f07b81548c0 2024-05-08T21:10:40.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.831+0000 7f07bd3eb700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07b81f0400 con 0x7f07b81544e0 2024-05-08T21:10:40.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.831+0000 7f07b6ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07b80c7270 0x7f07b81f0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:40.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.831+0000 7f07b6ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07b80c7270 0x7f07b81f0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42892/0 (socket says 172.21.15.80:42892) 2024-05-08T21:10:40.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.831+0000 7f07b6ffd700 1 -- 172.21.15.80:0/3909078772 learned_addr learned my addr 172.21.15.80:0/3909078772 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:40.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.831+0000 7f07b67fc700 1 --2- 172.21.15.80:0/3909078772 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f07b81544e0 0x7f07b814ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:40.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.831+0000 7f07b77fe700 1 --2- 172.21.15.80:0/3909078772 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f07b81548c0 0x7f07b81ef820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:40.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.831+0000 7f07b6ffd700 1 -- 172.21.15.80:0/3909078772 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f07b81544e0 msgr2=0x7f07b814ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:40.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.831+0000 7f07b6ffd700 1 --2- 172.21.15.80:0/3909078772 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f07b81544e0 0x7f07b814ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:40.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.831+0000 7f07b6ffd700 1 -- 172.21.15.80:0/3909078772 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f07b81548c0 msgr2=0x7f07b81ef820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:40.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.831+0000 7f07b6ffd700 1 --2- 172.21.15.80:0/3909078772 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f07b81548c0 0x7f07b81ef820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:40.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.831+0000 7f07b6ffd700 1 -- 172.21.15.80:0/3909078772 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a80094a0 con 0x7f07b80c7270 2024-05-08T21:10:40.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.832+0000 7f07b6ffd700 1 --2- 172.21.15.80:0/3909078772 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07b80c7270 0x7f07b81f0d10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f07a8009b60 tx=0x7f07a8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:40.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.832+0000 7f079f7fe700 1 -- 172.21.15.80:0/3909078772 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a80036a0 con 0x7f07b80c7270 2024-05-08T21:10:40.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.832+0000 7f079f7fe700 1 -- 172.21.15.80:0/3909078772 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07a801f070 con 0x7f07b80c7270 2024-05-08T21:10:40.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.832+0000 7f07bd3eb700 1 -- 172.21.15.80:0/3909078772 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07b81f06e0 con 0x7f07b80c7270 2024-05-08T21:10:40.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.832+0000 7f079f7fe700 1 -- 172.21.15.80:0/3909078772 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a8003a40 con 0x7f07b80c7270 2024-05-08T21:10:40.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.832+0000 7f07bd3eb700 1 -- 172.21.15.80:0/3909078772 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07b8152240 con 0x7f07b80c7270 2024-05-08T21:10:40.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.833+0000 7f07bd3eb700 1 -- 172.21.15.80:0/3909078772 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07b8068080 con 0x7f07b80c7270 2024-05-08T21:10:40.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.833+0000 7f079f7fe700 1 -- 172.21.15.80:0/3909078772 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f07a8003ba0 con 0x7f07b80c7270 2024-05-08T21:10:40.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.833+0000 7f079f7fe700 1 --2- 172.21.15.80:0/3909078772 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f07a406acc0 0x7f07a406d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:40.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.834+0000 7f079f7fe700 1 -- 172.21.15.80:0/3909078772 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f07a8021070 con 0x7f07b80c7270 2024-05-08T21:10:40.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.834+0000 7f07b67fc700 1 --2- 172.21.15.80:0/3909078772 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f07a406acc0 0x7f07a406d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:40.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.834+0000 7f07b67fc700 1 --2- 172.21.15.80:0/3909078772 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f07a406acc0 0x7f07a406d180 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f07b81ea140 tx=0x7f07ac008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:40.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:40.838+0000 7f079f7fe700 1 -- 172.21.15.80:0/3909078772 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f07a8055df0 con 0x7f07b80c7270 2024-05-08T21:10:41.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.033+0000 7f07bd3eb700 1 -- 172.21.15.80:0/3909078772 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f07b80c6eb0 con 0x7f07b80c7270 2024-05-08T21:10:41.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.034+0000 7f079f7fe700 1 -- 172.21.15.80:0/3909078772 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f07a802b020 con 0x7f07b80c7270 2024-05-08T21:10:41.038 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-05-08T21:10:41.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.036+0000 7f07bd3eb700 1 -- 172.21.15.80:0/3909078772 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f07a406acc0 msgr2=0x7f07a406d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:41.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.036+0000 7f07bd3eb700 1 --2- 172.21.15.80:0/3909078772 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f07a406acc0 0x7f07a406d180 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f07b81ea140 tx=0x7f07ac008040 comp rx=0 tx=0).stop 2024-05-08T21:10:41.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.036+0000 7f07bd3eb700 1 -- 172.21.15.80:0/3909078772 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07b80c7270 msgr2=0x7f07b81f0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:41.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.036+0000 7f07bd3eb700 1 --2- 172.21.15.80:0/3909078772 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07b80c7270 0x7f07b81f0d10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f07a8009b60 tx=0x7f07a8004750 comp rx=0 tx=0).stop 2024-05-08T21:10:41.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.036+0000 7f07bd3eb700 1 -- 172.21.15.80:0/3909078772 shutdown_connections 2024-05-08T21:10:41.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.036+0000 7f07bd3eb700 1 --2- 172.21.15.80:0/3909078772 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f07a406acc0 0x7f07a406d180 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:41.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.036+0000 7f07bd3eb700 1 --2- 172.21.15.80:0/3909078772 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f07b80c7270 0x7f07b81f0d10 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:41.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.036+0000 7f07bd3eb700 1 --2- 172.21.15.80:0/3909078772 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f07b81548c0 0x7f07b81ef820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:41.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.036+0000 7f07bd3eb700 1 --2- 172.21.15.80:0/3909078772 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f07b81544e0 0x7f07b814ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:41.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.036+0000 7f07bd3eb700 1 -- 172.21.15.80:0/3909078772 >> 172.21.15.80:0/3909078772 conn(0x7f07b806c810 msgr2=0x7f07b80cc160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:41.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.036+0000 7f07bd3eb700 1 -- 172.21.15.80:0/3909078772 shutdown_connections 2024-05-08T21:10:41.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.036+0000 7f07bd3eb700 1 -- 172.21.15.80:0/3909078772 wait complete. 2024-05-08T21:10:41.051 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T21:10:41.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.172+0000 7f4910e14700 1 Processor -- start 2024-05-08T21:10:41.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.172+0000 7f4910e14700 1 -- start start 2024-05-08T21:10:41.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.173+0000 7f4910e14700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f490c0c7980 0x7f490c157ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:41.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.173+0000 7f4910e14700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f490c15bb10 con 0x7f490c06c0d0 2024-05-08T21:10:41.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.173+0000 7f4910e14700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f490c06c670 con 0x7f490c152140 2024-05-08T21:10:41.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.173+0000 7f4910e14700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f490c06c930 con 0x7f490c0c7980 2024-05-08T21:10:41.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.173+0000 7f4909d9b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f490c0c7980 0x7f490c157ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:41.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.173+0000 7f490ad9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f490c06c0d0 0x7f490c162850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41902/0 (socket says 172.21.15.80:41902) 2024-05-08T21:10:41.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.173+0000 7f490ad9d700 1 -- 172.21.15.80:0/1141844919 learned_addr learned my addr 172.21.15.80:0/1141844919 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:10:41.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.173+0000 7f4909d9b700 1 -- 172.21.15.80:0/1141844919 >> v1:172.21.15.106:6789/0 conn(0x7f490c152140 legacy=0x7f490c0c5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:41.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.173+0000 7f4909d9b700 1 -- 172.21.15.80:0/1141844919 >> v1:172.21.15.80:6789/0 conn(0x7f490c06c0d0 legacy=0x7f490c162850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:41.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.173+0000 7f4909d9b700 1 -- 172.21.15.80:0/1141844919 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f490c06cc10 con 0x7f490c0c7980 2024-05-08T21:10:41.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.173+0000 7f490959a700 1 -- 172.21.15.80:0/1141844919 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2443440506 0 0) 0x7f490c15bb10 con 0x7f490c06c0d0 2024-05-08T21:10:41.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.173+0000 7f4909d9b700 1 --2- 172.21.15.80:0/1141844919 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f490c0c7980 0x7f490c157ed0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f48fc009840 tx=0x7f48fc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b472edb4f8df1b9b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:41.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.173+0000 7f490959a700 1 -- 172.21.15.80:0/1141844919 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48fc011830 con 0x7f490c0c7980 2024-05-08T21:10:41.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.173+0000 7f490959a700 1 -- 172.21.15.80:0/1141844919 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48fc011990 con 0x7f490c0c7980 2024-05-08T21:10:41.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.173+0000 7f490959a700 1 -- 172.21.15.80:0/1141844919 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48fc011d20 con 0x7f490c0c7980 2024-05-08T21:10:41.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.174+0000 7f4910e14700 1 -- 172.21.15.80:0/1141844919 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f490c0c7980 msgr2=0x7f490c157ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:41.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.174+0000 7f4910e14700 1 --2- 172.21.15.80:0/1141844919 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f490c0c7980 0x7f490c157ed0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f48fc009840 tx=0x7f48fc009b50 comp rx=0 tx=0).stop 2024-05-08T21:10:41.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.174+0000 7f4910e14700 1 -- 172.21.15.80:0/1141844919 shutdown_connections 2024-05-08T21:10:41.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.174+0000 7f4910e14700 1 --2- 172.21.15.80:0/1141844919 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f490c0c7980 0x7f490c157ed0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:41.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.174+0000 7f4910e14700 1 -- 172.21.15.80:0/1141844919 >> 172.21.15.80:0/1141844919 conn(0x7f490c0c9310 msgr2=0x7f490c0c9720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:41.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.174+0000 7f4910e14700 1 -- 172.21.15.80:0/1141844919 shutdown_connections 2024-05-08T21:10:41.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.174+0000 7f4910e14700 1 -- 172.21.15.80:0/1141844919 wait complete. 2024-05-08T21:10:41.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.175+0000 7f4910e14700 1 Processor -- start 2024-05-08T21:10:41.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.175+0000 7f4910e14700 1 -- start start 2024-05-08T21:10:41.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.176+0000 7f4910e14700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f490c06c0d0 0x7f490c15aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:41.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.176+0000 7f4910e14700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f490c0c7980 0x7f490c150610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:41.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.176+0000 7f4910e14700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f490c152140 0x7f490c0c3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:41.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.176+0000 7f4910e14700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f490c1e1350 con 0x7f490c06c0d0 2024-05-08T21:10:41.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.176+0000 7f4910e14700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f490c0c5220 con 0x7f490c0c7980 2024-05-08T21:10:41.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.176+0000 7f4910e14700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f490c0c5500 con 0x7f490c152140 2024-05-08T21:10:41.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.176+0000 7f490a59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f490c06c0d0 0x7f490c15aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:41.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.176+0000 7f490a59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f490c06c0d0 0x7f490c15aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42904/0 (socket says 172.21.15.80:42904) 2024-05-08T21:10:41.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.176+0000 7f490a59c700 1 -- 172.21.15.80:0/3020534482 learned_addr learned my addr 172.21.15.80:0/3020534482 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:41.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.176+0000 7f490ad9d700 1 --2- 172.21.15.80:0/3020534482 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f490c152140 0x7f490c0c3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:41.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.176+0000 7f4909d9b700 1 --2- 172.21.15.80:0/3020534482 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f490c0c7980 0x7f490c150610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:41.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.176+0000 7f490a59c700 1 -- 172.21.15.80:0/3020534482 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f490c152140 msgr2=0x7f490c0c3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:41.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.176+0000 7f490a59c700 1 --2- 172.21.15.80:0/3020534482 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f490c152140 0x7f490c0c3b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:41.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.176+0000 7f490a59c700 1 -- 172.21.15.80:0/3020534482 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f490c0c7980 msgr2=0x7f490c150610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:41.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.176+0000 7f490a59c700 1 --2- 172.21.15.80:0/3020534482 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f490c0c7980 0x7f490c150610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:41.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.176+0000 7f490a59c700 1 -- 172.21.15.80:0/3020534482 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48fc0094a0 con 0x7f490c06c0d0 2024-05-08T21:10:41.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.176+0000 7f4909d9b700 1 --2- 172.21.15.80:0/3020534482 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f490c0c7980 0x7f490c150610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:10:41.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.176+0000 7f490ad9d700 1 --2- 172.21.15.80:0/3020534482 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f490c152140 0x7f490c0c3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:10:41.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.177+0000 7f490a59c700 1 --2- 172.21.15.80:0/3020534482 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f490c06c0d0 0x7f490c15aef0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f490000c4e0 tx=0x7f490000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:41.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.177+0000 7f48faffd700 1 -- 172.21.15.80:0/3020534482 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49000052d0 con 0x7f490c06c0d0 2024-05-08T21:10:41.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.177+0000 7f48faffd700 1 -- 172.21.15.80:0/3020534482 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4900005430 con 0x7f490c06c0d0 2024-05-08T21:10:41.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.177+0000 7f4910e14700 1 -- 172.21.15.80:0/3020534482 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f490c0c57e0 con 0x7f490c06c0d0 2024-05-08T21:10:41.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.177+0000 7f48faffd700 1 -- 172.21.15.80:0/3020534482 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49000038c0 con 0x7f490c06c0d0 2024-05-08T21:10:41.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.177+0000 7f4910e14700 1 -- 172.21.15.80:0/3020534482 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f490c159290 con 0x7f490c06c0d0 2024-05-08T21:10:41.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.178+0000 7f4910e14700 1 -- 172.21.15.80:0/3020534482 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f490c04ec60 con 0x7f490c06c0d0 2024-05-08T21:10:41.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.178+0000 7f48faffd700 1 -- 172.21.15.80:0/3020534482 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4900003a20 con 0x7f490c06c0d0 2024-05-08T21:10:41.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.178+0000 7f48faffd700 1 --2- 172.21.15.80:0/3020534482 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f48ec06ac90 0x7f48ec06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:41.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.179+0000 7f48faffd700 1 -- 172.21.15.80:0/3020534482 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4900088ae0 con 0x7f490c06c0d0 2024-05-08T21:10:41.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.179+0000 7f4909d9b700 1 --2- 172.21.15.80:0/3020534482 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f48ec06ac90 0x7f48ec06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:41.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.179+0000 7f4909d9b700 1 --2- 172.21.15.80:0/3020534482 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f48ec06ac90 0x7f48ec06d150 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f490c074690 tx=0x7f48fc01c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:41.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.183+0000 7f48faffd700 1 -- 172.21.15.80:0/3020534482 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f49000539d0 con 0x7f490c06c0d0 2024-05-08T21:10:41.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.377+0000 7f4910e14700 1 -- 172.21.15.80:0/3020534482 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f490c06aa30 con 0x7f490c06c0d0 2024-05-08T21:10:41.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.377+0000 7f48faffd700 1 -- 172.21.15.80:0/3020534482 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f49000170a0 con 0x7f490c06c0d0 2024-05-08T21:10:41.381 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-05-08T21:10:41.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.379+0000 7f4910e14700 1 -- 172.21.15.80:0/3020534482 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f48ec06ac90 msgr2=0x7f48ec06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:41.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.379+0000 7f4910e14700 1 --2- 172.21.15.80:0/3020534482 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f48ec06ac90 0x7f48ec06d150 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f490c074690 tx=0x7f48fc01c040 comp rx=0 tx=0).stop 2024-05-08T21:10:41.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.379+0000 7f4910e14700 1 -- 172.21.15.80:0/3020534482 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f490c06c0d0 msgr2=0x7f490c15aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:41.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.379+0000 7f4910e14700 1 --2- 172.21.15.80:0/3020534482 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f490c06c0d0 0x7f490c15aef0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f490000c4e0 tx=0x7f490000c8a0 comp rx=0 tx=0).stop 2024-05-08T21:10:41.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.379+0000 7f4910e14700 1 -- 172.21.15.80:0/3020534482 shutdown_connections 2024-05-08T21:10:41.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.379+0000 7f4910e14700 1 --2- 172.21.15.80:0/3020534482 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f48ec06ac90 0x7f48ec06d150 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:41.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.379+0000 7f4910e14700 1 --2- 172.21.15.80:0/3020534482 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f490c06c0d0 0x7f490c15aef0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:41.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.379+0000 7f4910e14700 1 --2- 172.21.15.80:0/3020534482 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f490c152140 0x7f490c0c3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:41.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.379+0000 7f4910e14700 1 --2- 172.21.15.80:0/3020534482 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f490c0c7980 0x7f490c150610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:41.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.379+0000 7f4910e14700 1 -- 172.21.15.80:0/3020534482 >> 172.21.15.80:0/3020534482 conn(0x7f490c0c9310 msgr2=0x7f490c0c96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:41.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.379+0000 7f4910e14700 1 -- 172.21.15.80:0/3020534482 shutdown_connections 2024-05-08T21:10:41.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.379+0000 7f4910e14700 1 -- 172.21.15.80:0/3020534482 wait complete. 2024-05-08T21:10:41.395 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-08T21:10:41.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.517+0000 7eff68235700 1 Processor -- start 2024-05-08T21:10:41.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.517+0000 7eff68235700 1 -- start start 2024-05-08T21:10:41.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.518+0000 7eff68235700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7eff600ccc00 0x7eff60071be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:41.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.518+0000 7eff68235700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7eff600c8380 0x7eff600c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:41.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.518+0000 7eff68235700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff600c9150 con 0x7eff600ccfe0 2024-05-08T21:10:41.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.518+0000 7eff68235700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff600c99f0 con 0x7eff600ccc00 2024-05-08T21:10:41.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.518+0000 7eff68235700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff601579c0 con 0x7eff600c8380 2024-05-08T21:10:41.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.518+0000 7eff65fd1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7eff600ccc00 0x7eff60071be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:41.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.518+0000 7eff657d0700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7eff600ccfe0 0x7eff60156ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41908/0 (socket says 172.21.15.80:41908) 2024-05-08T21:10:41.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.518+0000 7eff657d0700 1 -- 172.21.15.80:0/3788352072 learned_addr learned my addr 172.21.15.80:0/3788352072 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:10:41.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.518+0000 7eff65fd1700 1 -- 172.21.15.80:0/3788352072 >> v2:172.21.15.106:3300/0 conn(0x7eff600c8380 msgr2=0x7eff600c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:41.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.518+0000 7eff65fd1700 1 --2- 172.21.15.80:0/3788352072 >> v2:172.21.15.106:3300/0 conn(0x7eff600c8380 0x7eff600c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:41.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.518+0000 7eff65fd1700 1 -- 172.21.15.80:0/3788352072 >> v1:172.21.15.80:6789/0 conn(0x7eff600ccfe0 legacy=0x7eff60156ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:41.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.518+0000 7eff64fcf700 1 -- 172.21.15.80:0/3788352072 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1045669418 0 0) 0x7eff600c9150 con 0x7eff600ccfe0 2024-05-08T21:10:41.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.518+0000 7eff65fd1700 1 -- 172.21.15.80:0/3788352072 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff60157ca0 con 0x7eff600ccc00 2024-05-08T21:10:41.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.518+0000 7eff65fd1700 1 --2- 172.21.15.80:0/3788352072 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff600ccc00 0x7eff60071be0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7eff60070060 tx=0x7eff5c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3938a16184f448ad server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:41.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.518+0000 7eff64fcf700 1 -- 172.21.15.80:0/3788352072 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5c011830 con 0x7eff600ccc00 2024-05-08T21:10:41.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.518+0000 7eff64fcf700 1 -- 172.21.15.80:0/3788352072 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff5c011990 con 0x7eff600ccc00 2024-05-08T21:10:41.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.518+0000 7eff64fcf700 1 -- 172.21.15.80:0/3788352072 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5c011d20 con 0x7eff600ccc00 2024-05-08T21:10:41.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.519+0000 7eff68235700 1 -- 172.21.15.80:0/3788352072 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff600ccc00 msgr2=0x7eff60071be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:41.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.519+0000 7eff68235700 1 --2- 172.21.15.80:0/3788352072 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff600ccc00 0x7eff60071be0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7eff60070060 tx=0x7eff5c009b20 comp rx=0 tx=0).stop 2024-05-08T21:10:41.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.519+0000 7eff68235700 1 -- 172.21.15.80:0/3788352072 shutdown_connections 2024-05-08T21:10:41.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.519+0000 7eff68235700 1 --2- 172.21.15.80:0/3788352072 >> v2:172.21.15.106:3300/0 conn(0x7eff600c8380 0x7eff600c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:41.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.519+0000 7eff68235700 1 --2- 172.21.15.80:0/3788352072 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff600ccc00 0x7eff60071be0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:41.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.519+0000 7eff68235700 1 -- 172.21.15.80:0/3788352072 >> 172.21.15.80:0/3788352072 conn(0x7eff6006f140 msgr2=0x7eff6006f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:41.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.519+0000 7eff68235700 1 -- 172.21.15.80:0/3788352072 shutdown_connections 2024-05-08T21:10:41.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.519+0000 7eff68235700 1 -- 172.21.15.80:0/3788352072 wait complete. 2024-05-08T21:10:41.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.521+0000 7eff68235700 1 Processor -- start 2024-05-08T21:10:41.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.521+0000 7eff68235700 1 -- start start 2024-05-08T21:10:41.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.521+0000 7eff68235700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7eff600c8380 0x7eff600c36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:41.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.521+0000 7eff68235700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff600ccc00 0x7eff60158960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:41.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.521+0000 7eff68235700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7eff600ccfe0 0x7eff600caf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:41.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.522+0000 7eff68235700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff601593b0 con 0x7eff600ccc00 2024-05-08T21:10:41.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.522+0000 7eff68235700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff6014b160 con 0x7eff600c8380 2024-05-08T21:10:41.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.522+0000 7eff68235700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff6014b400 con 0x7eff600ccfe0 2024-05-08T21:10:41.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.522+0000 7eff657d0700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff600ccc00 0x7eff60158960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:41.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.522+0000 7eff657d0700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff600ccc00 0x7eff60158960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42914/0 (socket says 172.21.15.80:42914) 2024-05-08T21:10:41.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.522+0000 7eff657d0700 1 -- 172.21.15.80:0/1947636975 learned_addr learned my addr 172.21.15.80:0/1947636975 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:41.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.522+0000 7eff65fd1700 1 --2- 172.21.15.80:0/1947636975 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7eff600c8380 0x7eff600c36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:41.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.522+0000 7eff667d2700 1 --2- 172.21.15.80:0/1947636975 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7eff600ccfe0 0x7eff600caf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:41.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.522+0000 7eff657d0700 1 -- 172.21.15.80:0/1947636975 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7eff600ccfe0 msgr2=0x7eff600caf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:41.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.522+0000 7eff657d0700 1 --2- 172.21.15.80:0/1947636975 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7eff600ccfe0 0x7eff600caf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:41.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.522+0000 7eff657d0700 1 -- 172.21.15.80:0/1947636975 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7eff600c8380 msgr2=0x7eff600c36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:41.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.522+0000 7eff657d0700 1 --2- 172.21.15.80:0/1947636975 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7eff600c8380 0x7eff600c36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:41.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.522+0000 7eff657d0700 1 -- 172.21.15.80:0/1947636975 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff5c0094a0 con 0x7eff600ccc00 2024-05-08T21:10:41.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.522+0000 7eff65fd1700 1 --2- 172.21.15.80:0/1947636975 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7eff600c8380 0x7eff600c36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:10:41.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.522+0000 7eff657d0700 1 --2- 172.21.15.80:0/1947636975 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff600ccc00 0x7eff60158960 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7eff5000c550 tx=0x7eff5000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:41.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.522+0000 7eff567fc700 1 -- 172.21.15.80:0/1947636975 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff50004c80 con 0x7eff600ccc00 2024-05-08T21:10:41.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.522+0000 7eff567fc700 1 -- 172.21.15.80:0/1947636975 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff50004e00 con 0x7eff600ccc00 2024-05-08T21:10:41.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.522+0000 7eff68235700 1 -- 172.21.15.80:0/1947636975 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff6014b6e0 con 0x7eff600ccc00 2024-05-08T21:10:41.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.522+0000 7eff567fc700 1 -- 172.21.15.80:0/1947636975 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff50007310 con 0x7eff600ccc00 2024-05-08T21:10:41.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.522+0000 7eff68235700 1 -- 172.21.15.80:0/1947636975 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff6014bca0 con 0x7eff600ccc00 2024-05-08T21:10:41.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.523+0000 7eff68235700 1 -- 172.21.15.80:0/1947636975 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff60074670 con 0x7eff600ccc00 2024-05-08T21:10:41.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.524+0000 7eff567fc700 1 -- 172.21.15.80:0/1947636975 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7eff50007470 con 0x7eff600ccc00 2024-05-08T21:10:41.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.524+0000 7eff567fc700 1 --2- 172.21.15.80:0/1947636975 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7eff4406ac90 0x7eff4406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:41.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.524+0000 7eff567fc700 1 -- 172.21.15.80:0/1947636975 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7eff50089320 con 0x7eff600ccc00 2024-05-08T21:10:41.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.524+0000 7eff65fd1700 1 --2- 172.21.15.80:0/1947636975 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7eff4406ac90 0x7eff4406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:41.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.524+0000 7eff65fd1700 1 --2- 172.21.15.80:0/1947636975 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7eff4406ac90 0x7eff4406d150 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7eff5c000c00 tx=0x7eff5c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:41.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.528+0000 7eff567fc700 1 -- 172.21.15.80:0/1947636975 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7eff60074670 con 0x7eff600ccc00 2024-05-08T21:10:41.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.723+0000 7eff68235700 1 -- 172.21.15.80:0/1947636975 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7eff60074670 con 0x7eff600ccc00 2024-05-08T21:10:41.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.723+0000 7eff567fc700 1 -- 172.21.15.80:0/1947636975 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7eff60074670 con 0x7eff600ccc00 2024-05-08T21:10:41.727 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-05-08T21:10:41.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.725+0000 7eff68235700 1 -- 172.21.15.80:0/1947636975 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7eff4406ac90 msgr2=0x7eff4406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:41.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.725+0000 7eff68235700 1 --2- 172.21.15.80:0/1947636975 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7eff4406ac90 0x7eff4406d150 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7eff5c000c00 tx=0x7eff5c008030 comp rx=0 tx=0).stop 2024-05-08T21:10:41.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.725+0000 7eff68235700 1 -- 172.21.15.80:0/1947636975 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff600ccc00 msgr2=0x7eff60158960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:41.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.725+0000 7eff68235700 1 --2- 172.21.15.80:0/1947636975 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff600ccc00 0x7eff60158960 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7eff5000c550 tx=0x7eff5000c910 comp rx=0 tx=0).stop 2024-05-08T21:10:41.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.725+0000 7eff68235700 1 -- 172.21.15.80:0/1947636975 shutdown_connections 2024-05-08T21:10:41.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.725+0000 7eff68235700 1 --2- 172.21.15.80:0/1947636975 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7eff4406ac90 0x7eff4406d150 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:41.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.725+0000 7eff68235700 1 --2- 172.21.15.80:0/1947636975 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7eff600ccfe0 0x7eff600caf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:41.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.725+0000 7eff68235700 1 --2- 172.21.15.80:0/1947636975 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7eff600c8380 0x7eff600c36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:41.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.725+0000 7eff68235700 1 --2- 172.21.15.80:0/1947636975 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff600ccc00 0x7eff60158960 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:41.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.725+0000 7eff68235700 1 -- 172.21.15.80:0/1947636975 >> 172.21.15.80:0/1947636975 conn(0x7eff6006f140 msgr2=0x7eff600c56d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:41.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.725+0000 7eff68235700 1 -- 172.21.15.80:0/1947636975 shutdown_connections 2024-05-08T21:10:41.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.725+0000 7eff68235700 1 -- 172.21.15.80:0/1947636975 wait complete. 2024-05-08T21:10:41.741 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:10:41.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.858+0000 7fcc32728700 1 Processor -- start 2024-05-08T21:10:41.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.859+0000 7fcc32728700 1 -- start start 2024-05-08T21:10:41.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.860+0000 7fcc32728700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcc2c072f10 0x7fcc2c1586a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:41.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.860+0000 7fcc32728700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcc2c0732f0 0x7fcc2c158be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:41.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.860+0000 7fcc32728700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc2c158210 con 0x7fcc2c0cd8a0 2024-05-08T21:10:41.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.860+0000 7fcc32728700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc2c0c5010 con 0x7fcc2c0732f0 2024-05-08T21:10:41.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.860+0000 7fcc32728700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2c0c52d0 con 0x7fcc2c072f10 2024-05-08T21:10:41.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.860+0000 7fcc2b7fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcc2c0732f0 0x7fcc2c158be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:41.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.860+0000 7fcc30cc5700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fcc2c0cd8a0 0x7fcc2c151bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41924/0 (socket says 172.21.15.80:41924) 2024-05-08T21:10:41.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.860+0000 7fcc30cc5700 1 -- 172.21.15.80:0/1983785544 learned_addr learned my addr 172.21.15.80:0/1983785544 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:10:41.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.860+0000 7fcc2bfff700 1 --2- 172.21.15.80:0/1983785544 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcc2c072f10 0x7fcc2c1586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:41.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.860+0000 7fcc2b7fe700 1 -- 172.21.15.80:0/1983785544 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcc2c072f10 msgr2=0x7fcc2c1586a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:41.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.860+0000 7fcc2b7fe700 1 --2- 172.21.15.80:0/1983785544 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcc2c072f10 0x7fcc2c1586a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:41.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.860+0000 7fcc2b7fe700 1 -- 172.21.15.80:0/1983785544 >> v1:172.21.15.80:6789/0 conn(0x7fcc2c0cd8a0 legacy=0x7fcc2c151bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:41.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.860+0000 7fcc2b7fe700 1 -- 172.21.15.80:0/1983785544 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc2c0c55b0 con 0x7fcc2c0732f0 2024-05-08T21:10:41.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.860+0000 7fcc2affd700 1 -- 172.21.15.80:0/1983785544 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3095904969 0 0) 0x7fcc2c158210 con 0x7fcc2c0cd8a0 2024-05-08T21:10:41.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.860+0000 7fcc2b7fe700 1 --2- 172.21.15.80:0/1983785544 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc2c0732f0 0x7fcc2c158be0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c009840 tx=0x7fcc1c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdf89947a05145c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:41.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.860+0000 7fcc2affd700 1 -- 172.21.15.80:0/1983785544 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c011830 con 0x7fcc2c0732f0 2024-05-08T21:10:41.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.861+0000 7fcc2affd700 1 -- 172.21.15.80:0/1983785544 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc1c011990 con 0x7fcc2c0732f0 2024-05-08T21:10:41.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.861+0000 7fcc2affd700 1 -- 172.21.15.80:0/1983785544 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c011d20 con 0x7fcc2c0732f0 2024-05-08T21:10:41.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.861+0000 7fcc32728700 1 -- 172.21.15.80:0/1983785544 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc2c0732f0 msgr2=0x7fcc2c158be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:41.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.861+0000 7fcc32728700 1 --2- 172.21.15.80:0/1983785544 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc2c0732f0 0x7fcc2c158be0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c009840 tx=0x7fcc1c009b50 comp rx=0 tx=0).stop 2024-05-08T21:10:41.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.861+0000 7fcc32728700 1 -- 172.21.15.80:0/1983785544 shutdown_connections 2024-05-08T21:10:41.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.861+0000 7fcc32728700 1 --2- 172.21.15.80:0/1983785544 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcc2c072f10 0x7fcc2c1586a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:41.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.861+0000 7fcc32728700 1 --2- 172.21.15.80:0/1983785544 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc2c0732f0 0x7fcc2c158be0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:41.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.861+0000 7fcc32728700 1 -- 172.21.15.80:0/1983785544 >> 172.21.15.80:0/1983785544 conn(0x7fcc2c066780 msgr2=0x7fcc2c066b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:41.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.861+0000 7fcc32728700 1 -- 172.21.15.80:0/1983785544 shutdown_connections 2024-05-08T21:10:41.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.861+0000 7fcc32728700 1 -- 172.21.15.80:0/1983785544 wait complete. 2024-05-08T21:10:41.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.862+0000 7fcc32728700 1 Processor -- start 2024-05-08T21:10:41.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.862+0000 7fcc32728700 1 -- start start 2024-05-08T21:10:41.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.863+0000 7fcc32728700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc2c072f10 0x7fcc2c0ccfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:41.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.863+0000 7fcc32728700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc2c0732f0 0x7fcc2c06c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:41.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.863+0000 7fcc32728700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcc2c0cd8a0 0x7fcc2c06c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:41.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.863+0000 7fcc32728700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2c1579f0 con 0x7fcc2c0732f0 2024-05-08T21:10:41.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.863+0000 7fcc32728700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2c145d50 con 0x7fcc2c072f10 2024-05-08T21:10:41.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.863+0000 7fcc32728700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2c06bc00 con 0x7fcc2c0cd8a0 2024-05-08T21:10:41.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.863+0000 7fcc2b7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc2c0732f0 0x7fcc2c06c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:41.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.863+0000 7fcc2b7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc2c0732f0 0x7fcc2c06c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42924/0 (socket says 172.21.15.80:42924) 2024-05-08T21:10:41.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.863+0000 7fcc2b7fe700 1 -- 172.21.15.80:0/3974416729 learned_addr learned my addr 172.21.15.80:0/3974416729 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:41.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.863+0000 7fcc30cc5700 1 --2- 172.21.15.80:0/3974416729 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcc2c0cd8a0 0x7fcc2c06c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:41.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.863+0000 7fcc2bfff700 1 --2- 172.21.15.80:0/3974416729 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc2c072f10 0x7fcc2c0ccfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:41.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.864+0000 7fcc2b7fe700 1 -- 172.21.15.80:0/3974416729 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcc2c0cd8a0 msgr2=0x7fcc2c06c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:41.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.864+0000 7fcc2b7fe700 1 --2- 172.21.15.80:0/3974416729 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcc2c0cd8a0 0x7fcc2c06c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:41.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.864+0000 7fcc2b7fe700 1 -- 172.21.15.80:0/3974416729 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc2c072f10 msgr2=0x7fcc2c0ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:41.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.864+0000 7fcc2b7fe700 1 --2- 172.21.15.80:0/3974416729 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc2c072f10 0x7fcc2c0ccfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:41.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.864+0000 7fcc2b7fe700 1 -- 172.21.15.80:0/3974416729 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc1c0094a0 con 0x7fcc2c0732f0 2024-05-08T21:10:41.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.864+0000 7fcc2bfff700 1 --2- 172.21.15.80:0/3974416729 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc2c072f10 0x7fcc2c0ccfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:10:41.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.864+0000 7fcc2b7fe700 1 --2- 172.21.15.80:0/3974416729 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc2c0732f0 0x7fcc2c06c090 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c009fd0 tx=0x7fcc1c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:41.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.864+0000 7fcc28ff9700 1 -- 172.21.15.80:0/3974416729 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c0036a0 con 0x7fcc2c0732f0 2024-05-08T21:10:41.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.864+0000 7fcc28ff9700 1 -- 172.21.15.80:0/3974416729 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc1c01f070 con 0x7fcc2c0732f0 2024-05-08T21:10:41.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.864+0000 7fcc28ff9700 1 -- 172.21.15.80:0/3974416729 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c003a20 con 0x7fcc2c0732f0 2024-05-08T21:10:41.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.864+0000 7fcc32728700 1 -- 172.21.15.80:0/3974416729 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc2c06dad0 con 0x7fcc2c0732f0 2024-05-08T21:10:41.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.864+0000 7fcc32728700 1 -- 172.21.15.80:0/3974416729 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc2c06d510 con 0x7fcc2c0732f0 2024-05-08T21:10:41.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.865+0000 7fcc32728700 1 -- 172.21.15.80:0/3974416729 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc2c0c6260 con 0x7fcc2c0732f0 2024-05-08T21:10:41.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.865+0000 7fcc28ff9700 1 -- 172.21.15.80:0/3974416729 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fcc1c003b80 con 0x7fcc2c0732f0 2024-05-08T21:10:41.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.866+0000 7fcc28ff9700 1 --2- 172.21.15.80:0/3974416729 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fcc1806ac90 0x7fcc1806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:41.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.866+0000 7fcc28ff9700 1 -- 172.21.15.80:0/3974416729 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcc1c021070 con 0x7fcc2c0732f0 2024-05-08T21:10:41.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.866+0000 7fcc2bfff700 1 --2- 172.21.15.80:0/3974416729 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fcc1806ac90 0x7fcc1806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:41.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.866+0000 7fcc2bfff700 1 --2- 172.21.15.80:0/3974416729 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fcc1806ac90 0x7fcc1806d150 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcc20009c30 tx=0x7fcc20008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:41.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:41.870+0000 7fcc28ff9700 1 -- 172.21.15.80:0/3974416729 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fcc1c055e60 con 0x7fcc2c0732f0 2024-05-08T21:10:42.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.108+0000 7fcc32728700 1 -- 172.21.15.80:0/3974416729 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcc2c04ec60 con 0x7fcc2c0732f0 2024-05-08T21:10:42.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.109+0000 7fcc28ff9700 1 -- 172.21.15.80:0/3974416729 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6254 (secure 0 0 0) 0x7fcc1c015090 con 0x7fcc2c0732f0 2024-05-08T21:10:42.112 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:10:42.113 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/2289230272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":2289230272},{"type":"v1","addr":"172.21.15.106:6833","nonce":2289230272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:10:31.304591+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.106:6836/1949999190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1949999190},{"type":"v1","addr":"172.21.15.106:6836","nonce":1949999190}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:10:42.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.111+0000 7fcc32728700 1 -- 172.21.15.80:0/3974416729 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fcc1806ac90 msgr2=0x7fcc1806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:42.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.111+0000 7fcc32728700 1 --2- 172.21.15.80:0/3974416729 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fcc1806ac90 0x7fcc1806d150 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcc20009c30 tx=0x7fcc20008040 comp rx=0 tx=0).stop 2024-05-08T21:10:42.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.111+0000 7fcc32728700 1 -- 172.21.15.80:0/3974416729 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc2c0732f0 msgr2=0x7fcc2c06c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:42.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.111+0000 7fcc32728700 1 --2- 172.21.15.80:0/3974416729 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc2c0732f0 0x7fcc2c06c090 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c009fd0 tx=0x7fcc1c004750 comp rx=0 tx=0).stop 2024-05-08T21:10:42.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.111+0000 7fcc32728700 1 -- 172.21.15.80:0/3974416729 shutdown_connections 2024-05-08T21:10:42.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.111+0000 7fcc32728700 1 --2- 172.21.15.80:0/3974416729 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fcc1806ac90 0x7fcc1806d150 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:42.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.111+0000 7fcc32728700 1 --2- 172.21.15.80:0/3974416729 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcc2c0cd8a0 0x7fcc2c06c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:42.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.111+0000 7fcc32728700 1 --2- 172.21.15.80:0/3974416729 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc2c072f10 0x7fcc2c0ccfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:42.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.111+0000 7fcc32728700 1 --2- 172.21.15.80:0/3974416729 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc2c0732f0 0x7fcc2c06c090 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:42.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.111+0000 7fcc32728700 1 -- 172.21.15.80:0/3974416729 >> 172.21.15.80:0/3974416729 conn(0x7fcc2c066780 msgr2=0x7fcc2c150120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:42.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.111+0000 7fcc32728700 1 -- 172.21.15.80:0/3974416729 shutdown_connections 2024-05-08T21:10:42.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.111+0000 7fcc32728700 1 -- 172.21.15.80:0/3974416729 wait complete. 2024-05-08T21:10:42.116 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 10 2024-05-08T21:10:42.127 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T21:10:42.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.246+0000 7fd88e7cf700 1 Processor -- start 2024-05-08T21:10:42.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.246+0000 7fd88e7cf700 1 -- start start 2024-05-08T21:10:42.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.247+0000 7fd88e7cf700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd8881541a0 0x7fd88815a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:42.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.247+0000 7fd88e7cf700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd8880c95b0 0x7fd888072d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:42.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.247+0000 7fd88e7cf700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8880c8cc0 con 0x7fd8880c9150 2024-05-08T21:10:42.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.247+0000 7fd88e7cf700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd88806c5a0 con 0x7fd8880c95b0 2024-05-08T21:10:42.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.247+0000 7fd88e7cf700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd88806ce60 con 0x7fd8881541a0 2024-05-08T21:10:42.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.247+0000 7fd88cd6c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd8880c95b0 0x7fd888072d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:42.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.247+0000 7fd8877fe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd8880c9150 0x7fd888072600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:53128/0 (socket says 172.21.15.80:53128) 2024-05-08T21:10:42.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.247+0000 7fd8877fe700 1 -- 172.21.15.80:0/3175840435 learned_addr learned my addr 172.21.15.80:0/3175840435 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:10:42.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.247+0000 7fd887fff700 1 --2- 172.21.15.80:0/3175840435 >> v2:172.21.15.106:3300/0 conn(0x7fd8881541a0 0x7fd88815a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:42.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.247+0000 7fd88cd6c700 1 -- 172.21.15.80:0/3175840435 >> v2:172.21.15.106:3300/0 conn(0x7fd8881541a0 msgr2=0x7fd88815a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:42.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.247+0000 7fd88cd6c700 1 --2- 172.21.15.80:0/3175840435 >> v2:172.21.15.106:3300/0 conn(0x7fd8881541a0 0x7fd88815a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:42.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.247+0000 7fd88cd6c700 1 -- 172.21.15.80:0/3175840435 >> v1:172.21.15.80:6789/0 conn(0x7fd8880c9150 legacy=0x7fd888072600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:42.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.247+0000 7fd88cd6c700 1 -- 172.21.15.80:0/3175840435 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd88815e710 con 0x7fd8880c95b0 2024-05-08T21:10:42.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.247+0000 7fd88cd6c700 1 --2- 172.21.15.80:0/3175840435 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd8880c95b0 0x7fd888072d10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd8880c8210 tx=0x7fd88000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8784f386354a0d6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:42.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.247+0000 7fd886ffd700 1 -- 172.21.15.80:0/3175840435 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88000e070 con 0x7fd8880c95b0 2024-05-08T21:10:42.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.247+0000 7fd886ffd700 1 -- 172.21.15.80:0/3175840435 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd88000bbd0 con 0x7fd8880c95b0 2024-05-08T21:10:42.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.247+0000 7fd886ffd700 1 -- 172.21.15.80:0/3175840435 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd880012430 con 0x7fd8880c95b0 2024-05-08T21:10:42.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.248+0000 7fd88e7cf700 1 -- 172.21.15.80:0/3175840435 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd8880c95b0 msgr2=0x7fd888072d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:42.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.248+0000 7fd88e7cf700 1 --2- 172.21.15.80:0/3175840435 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd8880c95b0 0x7fd888072d10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd8880c8210 tx=0x7fd88000b330 comp rx=0 tx=0).stop 2024-05-08T21:10:42.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.248+0000 7fd88e7cf700 1 -- 172.21.15.80:0/3175840435 shutdown_connections 2024-05-08T21:10:42.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.248+0000 7fd88e7cf700 1 --2- 172.21.15.80:0/3175840435 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd8880c95b0 0x7fd888072d10 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:42.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.248+0000 7fd88e7cf700 1 --2- 172.21.15.80:0/3175840435 >> v2:172.21.15.106:3300/0 conn(0x7fd8881541a0 0x7fd88815a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:42.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.248+0000 7fd88e7cf700 1 -- 172.21.15.80:0/3175840435 >> 172.21.15.80:0/3175840435 conn(0x7fd88806ef80 msgr2=0x7fd88806f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:42.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.248+0000 7fd88e7cf700 1 -- 172.21.15.80:0/3175840435 shutdown_connections 2024-05-08T21:10:42.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.248+0000 7fd88e7cf700 1 -- 172.21.15.80:0/3175840435 wait complete. 2024-05-08T21:10:42.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.249+0000 7fd88e7cf700 1 Processor -- start 2024-05-08T21:10:42.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.249+0000 7fd88e7cf700 1 -- start start 2024-05-08T21:10:42.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.250+0000 7fd88e7cf700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd8880c9150 0x7fd888158180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:42.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.250+0000 7fd88e7cf700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd8880c95b0 0x7fd8881586c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:42.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.250+0000 7fd88e7cf700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd8881541a0 0x7fd888149fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:42.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.250+0000 7fd88e7cf700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd88814ea80 con 0x7fd8880c9150 2024-05-08T21:10:42.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.250+0000 7fd88e7cf700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8880ccd60 con 0x7fd8881541a0 2024-05-08T21:10:42.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.250+0000 7fd88e7cf700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd88815ae50 con 0x7fd8880c95b0 2024-05-08T21:10:42.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.250+0000 7fd887fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd8880c9150 0x7fd888158180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:42.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.250+0000 7fd887fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd8880c9150 0x7fd888158180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34556/0 (socket says 172.21.15.80:34556) 2024-05-08T21:10:42.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.250+0000 7fd887fff700 1 -- 172.21.15.80:0/3852821137 learned_addr learned my addr 172.21.15.80:0/3852821137 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:42.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.250+0000 7fd887fff700 1 -- 172.21.15.80:0/3852821137 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd8880c95b0 msgr2=0x7fd8881586c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:42.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.250+0000 7fd8877fe700 1 --2- 172.21.15.80:0/3852821137 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd8880c95b0 0x7fd8881586c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:42.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.250+0000 7fd88cd6c700 1 --2- 172.21.15.80:0/3852821137 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd8881541a0 0x7fd888149fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:42.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.250+0000 7fd887fff700 1 --2- 172.21.15.80:0/3852821137 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd8880c95b0 0x7fd8881586c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:42.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.250+0000 7fd887fff700 1 -- 172.21.15.80:0/3852821137 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd8881541a0 msgr2=0x7fd888149fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:42.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.250+0000 7fd887fff700 1 --2- 172.21.15.80:0/3852821137 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd8881541a0 0x7fd888149fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:42.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.250+0000 7fd887fff700 1 -- 172.21.15.80:0/3852821137 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd880009a70 con 0x7fd8880c9150 2024-05-08T21:10:42.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.250+0000 7fd88cd6c700 1 --2- 172.21.15.80:0/3852821137 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd8881541a0 0x7fd888149fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:10:42.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.250+0000 7fd8877fe700 1 --2- 172.21.15.80:0/3852821137 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd8880c95b0 0x7fd8881586c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:10:42.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.251+0000 7fd887fff700 1 --2- 172.21.15.80:0/3852821137 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd8880c9150 0x7fd888158180 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd87c00c820 tx=0x7fd87c00cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:42.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.251+0000 7fd884ff9700 1 -- 172.21.15.80:0/3852821137 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd87c011800 con 0x7fd8880c9150 2024-05-08T21:10:42.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.251+0000 7fd884ff9700 1 -- 172.21.15.80:0/3852821137 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd87c011960 con 0x7fd8880c9150 2024-05-08T21:10:42.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.251+0000 7fd88e7cf700 1 -- 172.21.15.80:0/3852821137 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8880cd3a0 con 0x7fd8880c9150 2024-05-08T21:10:42.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.251+0000 7fd884ff9700 1 -- 172.21.15.80:0/3852821137 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd87c011cf0 con 0x7fd8880c9150 2024-05-08T21:10:42.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.251+0000 7fd88e7cf700 1 -- 172.21.15.80:0/3852821137 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd88814e7a0 con 0x7fd8880c9150 2024-05-08T21:10:42.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.252+0000 7fd88e7cf700 1 -- 172.21.15.80:0/3852821137 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd88815afc0 con 0x7fd8880c9150 2024-05-08T21:10:42.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.252+0000 7fd884ff9700 1 -- 172.21.15.80:0/3852821137 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd87c018360 con 0x7fd8880c9150 2024-05-08T21:10:42.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.252+0000 7fd884ff9700 1 --2- 172.21.15.80:0/3852821137 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fd87406ac90 0x7fd87406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:42.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.252+0000 7fd884ff9700 1 -- 172.21.15.80:0/3852821137 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd87c0894e0 con 0x7fd8880c9150 2024-05-08T21:10:42.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.252+0000 7fd8877fe700 1 --2- 172.21.15.80:0/3852821137 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fd87406ac90 0x7fd87406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:42.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.253+0000 7fd8877fe700 1 --2- 172.21.15.80:0/3852821137 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fd87406ac90 0x7fd87406d150 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd88815d0d0 tx=0x7fd878009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:42.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.257+0000 7fd884ff9700 1 -- 172.21.15.80:0/3852821137 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fd87c054460 con 0x7fd8880c9150 2024-05-08T21:10:42.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.455+0000 7fd88e7cf700 1 -- 172.21.15.80:0/3852821137 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd88804ec60 con 0x7fd8880c9150 2024-05-08T21:10:42.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.456+0000 7fd884ff9700 1 -- 172.21.15.80:0/3852821137 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+17878 (secure 0 0 0) 0x7fd87c057a80 con 0x7fd8880c9150 2024-05-08T21:10:42.459 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:10:42.459 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":26,"fsid":"44d31c1e-aad3-47ca-a4fa-85a63d4a60aa","created":"2024-05-08T21:09:46.467038+0000","modified":"2024-05-08T21:10:08.163735+0000","last_up_change":"2024-05-08T21:09:57.284675+0000","last_in_change":"2024-05-08T21:09:49.125444+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T21:09:58.238951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T21:10:02.177476+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T21:10:02.685535+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-08T21:10:05.753779+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c3f9d93e-ed6d-4a0c-b5c0-0e8d44c65fdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":47011},{"type":"v1","addr":"172.21.15.80:6817","nonce":47011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":47011},{"type":"v1","addr":"172.21.15.80:6819","nonce":47011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":47011},{"type":"v1","addr":"172.21.15.80:6823","nonce":47011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":47011},{"type":"v1","addr":"172.21.15.80:6821","nonce":47011}]},"public_addr":"172.21.15.80:6817/47011","cluster_addr":"172.21.15.80:6819/47011","heartbeat_back_addr":"172.21.15.80:6823/47011","heartbeat_front_addr":"172.21.15.80:6821/47011","state":["exists","up"]},{"osd":1,"uuid":"4ce2b4d6-6c40-43aa-8dd1-743fef8915df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":47010},{"type":"v1","addr":"172.21.15.80:6809","nonce":47010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":47010},{"type":"v1","addr":"172.21.15.80:6811","nonce":47010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":47010},{"type":"v1","addr":"172.21.15.80:6815","nonce":47010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":47010},{"type":"v1","addr":"172.21.15.80:6813","nonce":47010}]},"public_addr":"172.21.15.80:6809/47010","cluster_addr":"172.21.15.80:6811/47010","heartbeat_back_addr":"172.21.15.80:6815/47010","heartbeat_front_addr":"172.21.15.80:6813/47010","state":["exists","up"]},{"osd":2,"uuid":"e30cc3bc-6461-4fac-960a-de00c9488d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":47009},{"type":"v1","addr":"172.21.15.80:6801","nonce":47009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":47009},{"type":"v1","addr":"172.21.15.80:6803","nonce":47009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":47009},{"type":"v1","addr":"172.21.15.80:6807","nonce":47009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":47009},{"type":"v1","addr":"172.21.15.80:6805","nonce":47009}]},"public_addr":"172.21.15.80:6801/47009","cluster_addr":"172.21.15.80:6803/47009","heartbeat_back_addr":"172.21.15.80:6807/47009","heartbeat_front_addr":"172.21.15.80:6805/47009","state":["exists","up"]},{"osd":3,"uuid":"a415c099-9ea6-40be-98ed-f2932f98dfd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":47012},{"type":"v1","addr":"172.21.15.80:6825","nonce":47012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":47012},{"type":"v1","addr":"172.21.15.80:6827","nonce":47012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":47012},{"type":"v1","addr":"172.21.15.80:6831","nonce":47012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":47012},{"type":"v1","addr":"172.21.15.80:6829","nonce":47012}]},"public_addr":"172.21.15.80:6825/47012","cluster_addr":"172.21.15.80:6827/47012","heartbeat_back_addr":"172.21.15.80:6831/47012","heartbeat_front_addr":"172.21.15.80:6829/47012","state":["exists","up"]},{"osd":4,"uuid":"5ae1d51f-0918-4571-b79b-154308d46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6823","nonce":47114},{"type":"v1","addr":"172.21.15.106:6825","nonce":47114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":47114},{"type":"v1","addr":"172.21.15.106:6827","nonce":47114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":47114},{"type":"v1","addr":"172.21.15.106:6831","nonce":47114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":47114},{"type":"v1","addr":"172.21.15.106:6829","nonce":47114}]},"public_addr":"172.21.15.106:6825/47114","cluster_addr":"172.21.15.106:6827/47114","heartbeat_back_addr":"172.21.15.106:6831/47114","heartbeat_front_addr":"172.21.15.106:6829/47114","state":["exists","up"]},{"osd":5,"uuid":"a19ac74e-4282-4428-b167-26ba6b92f732","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6807","nonce":47111},{"type":"v1","addr":"172.21.15.106:6809","nonce":47111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":47111},{"type":"v1","addr":"172.21.15.106:6811","nonce":47111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":47111},{"type":"v1","addr":"172.21.15.106:6815","nonce":47111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":47111},{"type":"v1","addr":"172.21.15.106:6813","nonce":47111}]},"public_addr":"172.21.15.106:6809/47111","cluster_addr":"172.21.15.106:6811/47111","heartbeat_back_addr":"172.21.15.106:6815/47111","heartbeat_front_addr":"172.21.15.106:6813/47111","state":["exists","up"]},{"osd":6,"uuid":"bfe72edd-7acc-4805-807d-2000e76f2feb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":47112},{"type":"v1","addr":"172.21.15.106:6817","nonce":47112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":47112},{"type":"v1","addr":"172.21.15.106:6819","nonce":47112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":47112},{"type":"v1","addr":"172.21.15.106:6824","nonce":47112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":47112},{"type":"v1","addr":"172.21.15.106:6821","nonce":47112}]},"public_addr":"172.21.15.106:6817/47112","cluster_addr":"172.21.15.106:6819/47112","heartbeat_back_addr":"172.21.15.106:6824/47112","heartbeat_front_addr":"172.21.15.106:6821/47112","state":["exists","up"]},{"osd":7,"uuid":"99897f22-ed17-4c7c-9088-cc0c4a51f786","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":47113},{"type":"v1","addr":"172.21.15.106:6801","nonce":47113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":47113},{"type":"v1","addr":"172.21.15.106:6803","nonce":47113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":47113},{"type":"v1","addr":"172.21.15.106:6808","nonce":47113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":47113},{"type":"v1","addr":"172.21.15.106:6805","nonce":47113}]},"public_addr":"172.21.15.106:6801/47113","cluster_addr":"172.21.15.106:6803/47113","heartbeat_back_addr":"172.21.15.106:6808/47113","heartbeat_front_addr":"172.21.15.106:6805/47113","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.232670+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.277753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.050087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.349312+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.344080+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.348781+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.352539+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.275013+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T21:10:42.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.458+0000 7fd88e7cf700 1 -- 172.21.15.80:0/3852821137 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fd87406ac90 msgr2=0x7fd87406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:42.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.458+0000 7fd88e7cf700 1 --2- 172.21.15.80:0/3852821137 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fd87406ac90 0x7fd87406d150 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd88815d0d0 tx=0x7fd878009040 comp rx=0 tx=0).stop 2024-05-08T21:10:42.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.458+0000 7fd88e7cf700 1 -- 172.21.15.80:0/3852821137 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd8880c9150 msgr2=0x7fd888158180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:42.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.458+0000 7fd88e7cf700 1 --2- 172.21.15.80:0/3852821137 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd8880c9150 0x7fd888158180 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd87c00c820 tx=0x7fd87c00cbe0 comp rx=0 tx=0).stop 2024-05-08T21:10:42.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.458+0000 7fd88e7cf700 1 -- 172.21.15.80:0/3852821137 shutdown_connections 2024-05-08T21:10:42.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.458+0000 7fd88e7cf700 1 --2- 172.21.15.80:0/3852821137 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fd87406ac90 0x7fd87406d150 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:42.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.458+0000 7fd88e7cf700 1 --2- 172.21.15.80:0/3852821137 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd8880c9150 0x7fd888158180 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:42.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.458+0000 7fd88e7cf700 1 --2- 172.21.15.80:0/3852821137 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd8881541a0 0x7fd888149fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:42.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.458+0000 7fd88e7cf700 1 --2- 172.21.15.80:0/3852821137 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd8880c95b0 0x7fd8881586c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:42.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.458+0000 7fd88e7cf700 1 -- 172.21.15.80:0/3852821137 >> 172.21.15.80:0/3852821137 conn(0x7fd88806ef80 msgr2=0x7fd888150e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:42.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.458+0000 7fd88e7cf700 1 -- 172.21.15.80:0/3852821137 shutdown_connections 2024-05-08T21:10:42.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.458+0000 7fd88e7cf700 1 -- 172.21.15.80:0/3852821137 wait complete. 2024-05-08T21:10:42.474 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:10:42.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.591+0000 7f8fcee80700 1 Processor -- start 2024-05-08T21:10:42.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.591+0000 7f8fcee80700 1 -- start start 2024-05-08T21:10:42.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.592+0000 7f8fcee80700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8fc81543b0 0x7f8fc806a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:42.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.592+0000 7f8fcee80700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8fc815e4d0 0x7f8fc806bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:42.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.592+0000 7f8fcee80700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fc815d7a0 con 0x7f8fc8154790 2024-05-08T21:10:42.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.592+0000 7f8fcee80700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fc8066780 con 0x7f8fc815e4d0 2024-05-08T21:10:42.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.592+0000 7f8fcee80700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc815e040 con 0x7f8fc81543b0 2024-05-08T21:10:42.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.592+0000 7f8fccc1c700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8fc81543b0 0x7f8fc806a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:42.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.592+0000 7f8fcd41d700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8fc815e4d0 0x7f8fc806bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:42.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.592+0000 7f8fc7fff700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f8fc8154790 0x7f8fc8070cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.80:45320/0 (socket says 172.21.15.80:45320) 2024-05-08T21:10:42.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.592+0000 7f8fcd41d700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8fc815e4d0 0x7f8fc806bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.80:51372/0 (socket says 172.21.15.80:51372) 2024-05-08T21:10:42.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.592+0000 7f8fc7fff700 1 -- 172.21.15.80:0/1645153492 learned_addr learned my addr 172.21.15.80:0/1645153492 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:10:42.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.592+0000 7f8fccc1c700 1 -- 172.21.15.80:0/1645153492 >> v2:172.21.15.106:3300/0 conn(0x7f8fc815e4d0 msgr2=0x7f8fc806bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:42.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.592+0000 7f8fccc1c700 1 --2- 172.21.15.80:0/1645153492 >> v2:172.21.15.106:3300/0 conn(0x7f8fc815e4d0 0x7f8fc806bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:42.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.592+0000 7f8fccc1c700 1 -- 172.21.15.80:0/1645153492 >> v1:172.21.15.106:6789/0 conn(0x7f8fc8154790 legacy=0x7f8fc8070cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:42.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.592+0000 7f8fccc1c700 1 -- 172.21.15.80:0/1645153492 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc806af00 con 0x7f8fc81543b0 2024-05-08T21:10:42.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.592+0000 7f8fcd41d700 1 --2- 172.21.15.80:0/1645153492 >> v2:172.21.15.106:3300/0 conn(0x7f8fc815e4d0 0x7f8fc806bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:10:42.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.592+0000 7f8fc77fe700 1 -- 172.21.15.80:0/1645153492 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1614040591 0 0) 0x7f8fc815d7a0 con 0x7f8fc8154790 2024-05-08T21:10:42.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.592+0000 7f8fccc1c700 1 --2- 172.21.15.80:0/1645153492 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8fc81543b0 0x7f8fc806a9c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc009840 tx=0x7f8fbc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8fc078f90b8e8d9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:42.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.593+0000 7f8fc77fe700 1 -- 172.21.15.80:0/1645153492 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fbc011830 con 0x7f8fc81543b0 2024-05-08T21:10:42.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.593+0000 7f8fc77fe700 1 -- 172.21.15.80:0/1645153492 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fbc011990 con 0x7f8fc81543b0 2024-05-08T21:10:42.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.593+0000 7f8fc77fe700 1 -- 172.21.15.80:0/1645153492 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fbc011d20 con 0x7f8fc81543b0 2024-05-08T21:10:42.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.593+0000 7f8fcee80700 1 -- 172.21.15.80:0/1645153492 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8fc81543b0 msgr2=0x7f8fc806a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:42.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.593+0000 7f8fcee80700 1 --2- 172.21.15.80:0/1645153492 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8fc81543b0 0x7f8fc806a9c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc009840 tx=0x7f8fbc009b50 comp rx=0 tx=0).stop 2024-05-08T21:10:42.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.593+0000 7f8fcee80700 1 -- 172.21.15.80:0/1645153492 shutdown_connections 2024-05-08T21:10:42.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.593+0000 7f8fcee80700 1 --2- 172.21.15.80:0/1645153492 >> v2:172.21.15.106:3300/0 conn(0x7f8fc815e4d0 0x7f8fc806bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:42.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.593+0000 7f8fcee80700 1 --2- 172.21.15.80:0/1645153492 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8fc81543b0 0x7f8fc806a9c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:42.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.593+0000 7f8fcee80700 1 -- 172.21.15.80:0/1645153492 >> 172.21.15.80:0/1645153492 conn(0x7f8fc80cc260 msgr2=0x7f8fc80cc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:42.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.593+0000 7f8fcee80700 1 -- 172.21.15.80:0/1645153492 shutdown_connections 2024-05-08T21:10:42.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.593+0000 7f8fcee80700 1 -- 172.21.15.80:0/1645153492 wait complete. 2024-05-08T21:10:42.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.594+0000 7f8fcee80700 1 Processor -- start 2024-05-08T21:10:42.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.594+0000 7f8fcee80700 1 -- start start 2024-05-08T21:10:42.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.595+0000 7f8fcee80700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8fc81543b0 0x7f8fc81f0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:42.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.595+0000 7f8fcee80700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fc8154790 0x7f8fc815aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:42.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.595+0000 7f8fcee80700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8fc815e4d0 0x7f8fc8156650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:42.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.595+0000 7f8fcee80700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc81f0c40 con 0x7f8fc8154790 2024-05-08T21:10:42.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.595+0000 7f8fcee80700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc81561c0 con 0x7f8fc81543b0 2024-05-08T21:10:42.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.595+0000 7f8fcee80700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc81519a0 con 0x7f8fc815e4d0 2024-05-08T21:10:42.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.595+0000 7f8fc7fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fc8154790 0x7f8fc815aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:42.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.595+0000 7f8fc7fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fc8154790 0x7f8fc815aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34562/0 (socket says 172.21.15.80:34562) 2024-05-08T21:10:42.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.595+0000 7f8fc7fff700 1 -- 172.21.15.80:0/4019516829 learned_addr learned my addr 172.21.15.80:0/4019516829 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:42.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.595+0000 7f8fcd41d700 1 --2- 172.21.15.80:0/4019516829 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8fc815e4d0 0x7f8fc8156650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:42.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.595+0000 7f8fccc1c700 1 --2- 172.21.15.80:0/4019516829 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8fc81543b0 0x7f8fc81f0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:42.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.596+0000 7f8fc7fff700 1 -- 172.21.15.80:0/4019516829 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8fc815e4d0 msgr2=0x7f8fc8156650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:42.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.596+0000 7f8fc7fff700 1 --2- 172.21.15.80:0/4019516829 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8fc815e4d0 0x7f8fc8156650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:42.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.596+0000 7f8fc7fff700 1 -- 172.21.15.80:0/4019516829 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8fc81543b0 msgr2=0x7f8fc81f0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:42.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.596+0000 7f8fc7fff700 1 --2- 172.21.15.80:0/4019516829 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8fc81543b0 0x7f8fc81f0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:42.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.596+0000 7f8fc7fff700 1 -- 172.21.15.80:0/4019516829 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc0009a70 con 0x7f8fc8154790 2024-05-08T21:10:42.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.596+0000 7f8fc7fff700 1 --2- 172.21.15.80:0/4019516829 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fc8154790 0x7f8fc815aa50 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8fb400c540 tx=0x7f8fb400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:42.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.596+0000 7f8fc57fa700 1 -- 172.21.15.80:0/4019516829 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb4004c80 con 0x7f8fc8154790 2024-05-08T21:10:42.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.596+0000 7f8fc57fa700 1 -- 172.21.15.80:0/4019516829 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb4004de0 con 0x7f8fc8154790 2024-05-08T21:10:42.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.596+0000 7f8fc57fa700 1 -- 172.21.15.80:0/4019516829 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb4007310 con 0x7f8fc8154790 2024-05-08T21:10:42.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.596+0000 7f8fcee80700 1 -- 172.21.15.80:0/4019516829 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fbc0094a0 con 0x7f8fc8154790 2024-05-08T21:10:42.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.596+0000 7f8fcee80700 1 -- 172.21.15.80:0/4019516829 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fc8154cc0 con 0x7f8fc8154790 2024-05-08T21:10:42.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.597+0000 7f8fcee80700 1 -- 172.21.15.80:0/4019516829 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fc804ec60 con 0x7f8fc8154790 2024-05-08T21:10:42.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.598+0000 7f8fc57fa700 1 -- 172.21.15.80:0/4019516829 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8fb4007470 con 0x7f8fc8154790 2024-05-08T21:10:42.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.598+0000 7f8fc57fa700 1 --2- 172.21.15.80:0/4019516829 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f8fac06ac90 0x7f8fac06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:42.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.599+0000 7f8fccc1c700 1 --2- 172.21.15.80:0/4019516829 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f8fac06ac90 0x7f8fac06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:42.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.599+0000 7f8fc57fa700 1 -- 172.21.15.80:0/4019516829 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8fb4089830 con 0x7f8fc8154790 2024-05-08T21:10:42.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.599+0000 7f8fccc1c700 1 --2- 172.21.15.80:0/4019516829 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f8fac06ac90 0x7f8fac06d150 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc000c00 tx=0x7f8fbc008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:42.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.602+0000 7f8fc57fa700 1 -- 172.21.15.80:0/4019516829 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f8fb40548c0 con 0x7f8fc8154790 2024-05-08T21:10:42.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.839+0000 7f8fcee80700 1 -- 172.21.15.80:0/4019516829 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8fc806c600 con 0x7f8fc8154790 2024-05-08T21:10:42.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.839+0000 7f8fc57fa700 1 -- 172.21.15.80:0/4019516829 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6254 (secure 0 0 0) 0x7f8fb4057ee0 con 0x7f8fc8154790 2024-05-08T21:10:42.843 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:10:42.843 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/2289230272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":2289230272},{"type":"v1","addr":"172.21.15.106:6833","nonce":2289230272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:10:31.304591+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.106:6836/1949999190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1949999190},{"type":"v1","addr":"172.21.15.106:6836","nonce":1949999190}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:10:42.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.841+0000 7f8fcee80700 1 -- 172.21.15.80:0/4019516829 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f8fac06ac90 msgr2=0x7f8fac06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:42.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.841+0000 7f8fcee80700 1 --2- 172.21.15.80:0/4019516829 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f8fac06ac90 0x7f8fac06d150 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc000c00 tx=0x7f8fbc008030 comp rx=0 tx=0).stop 2024-05-08T21:10:42.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.841+0000 7f8fcee80700 1 -- 172.21.15.80:0/4019516829 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fc8154790 msgr2=0x7f8fc815aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:42.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.841+0000 7f8fcee80700 1 --2- 172.21.15.80:0/4019516829 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fc8154790 0x7f8fc815aa50 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8fb400c540 tx=0x7f8fb400c850 comp rx=0 tx=0).stop 2024-05-08T21:10:42.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.842+0000 7f8fcee80700 1 -- 172.21.15.80:0/4019516829 shutdown_connections 2024-05-08T21:10:42.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.842+0000 7f8fcee80700 1 --2- 172.21.15.80:0/4019516829 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f8fac06ac90 0x7f8fac06d150 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:42.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.842+0000 7f8fcee80700 1 --2- 172.21.15.80:0/4019516829 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8fc815e4d0 0x7f8fc8156650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:42.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.842+0000 7f8fcee80700 1 --2- 172.21.15.80:0/4019516829 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8fc81543b0 0x7f8fc81f0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:42.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.842+0000 7f8fcee80700 1 --2- 172.21.15.80:0/4019516829 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8fc8154790 0x7f8fc815aa50 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:42.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.842+0000 7f8fcee80700 1 -- 172.21.15.80:0/4019516829 >> 172.21.15.80:0/4019516829 conn(0x7f8fc80cc260 msgr2=0x7f8fc80c72b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:42.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.842+0000 7f8fcee80700 1 -- 172.21.15.80:0/4019516829 shutdown_connections 2024-05-08T21:10:42.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:42.842+0000 7f8fcee80700 1 -- 172.21.15.80:0/4019516829 wait complete. 2024-05-08T21:10:42.846 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 10 2024-05-08T21:10:43.461 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 10, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-08T21:10:03.725481+0000', 'modified': '2024-05-08T21:10:31.304591+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4291}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4291': {'gid': 4291, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.106:6836/1949999190', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.106:6834', 'nonce': 1949999190}, {'type': 'v1', 'addr': '172.21.15.106:6836', 'nonce': 1949999190}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-05-08T21:10:43.461 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-08T21:10:43.462 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-05-08T21:10:43.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.583+0000 7fe56ab13700 1 Processor -- start 2024-05-08T21:10:43.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.583+0000 7fe56ab13700 1 -- start start 2024-05-08T21:10:43.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.584+0000 7fe56ab13700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe5641520b0 0x7fe564158810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:43.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.584+0000 7fe56ab13700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe5640cbba0 0x7fe5640cbff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:43.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.584+0000 7fe56ab13700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe56415b6d0 con 0x7fe564158d50 2024-05-08T21:10:43.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.584+0000 7fe56ab13700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5640cc530 con 0x7fe5641520b0 2024-05-08T21:10:43.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.584+0000 7fe56ab13700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5641580e0 con 0x7fe5640cbba0 2024-05-08T21:10:43.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.584+0000 7fe563fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe564158d50 0x7fe564072d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:53142/0 (socket says 172.21.15.80:53142) 2024-05-08T21:10:43.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.584+0000 7fe563fff700 1 -- 172.21.15.80:0/3461787440 learned_addr learned my addr 172.21.15.80:0/3461787440 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:10:43.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.584+0000 7fe5690b0700 1 --2- 172.21.15.80:0/3461787440 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe5640cbba0 0x7fe5640cbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:43.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.584+0000 7fe5637fe700 1 -- 172.21.15.80:0/3461787440 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1607169349 0 0) 0x7fe56415b6d0 con 0x7fe564158d50 2024-05-08T21:10:43.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.584+0000 7fe5688af700 1 --2- 172.21.15.80:0/3461787440 >> v2:172.21.15.106:3300/0 conn(0x7fe5641520b0 0x7fe564158810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:43.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.584+0000 7fe5637fe700 1 -- 172.21.15.80:0/3461787440 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5540035b0 con 0x7fe564158d50 2024-05-08T21:10:43.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.584+0000 7fe5637fe700 1 -- 172.21.15.80:0/3461787440 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2086793800 0 0) 0x7fe5540035b0 con 0x7fe564158d50 2024-05-08T21:10:43.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.584+0000 7fe5637fe700 1 -- 172.21.15.80:0/3461787440 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe5640cbba0 msgr2=0x7fe5640cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:43.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.584+0000 7fe5637fe700 1 --2- 172.21.15.80:0/3461787440 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe5640cbba0 0x7fe5640cbff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:43.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.584+0000 7fe5637fe700 1 -- 172.21.15.80:0/3461787440 >> v2:172.21.15.106:3300/0 conn(0x7fe5641520b0 msgr2=0x7fe564158810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:43.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.584+0000 7fe5637fe700 1 --2- 172.21.15.80:0/3461787440 >> v2:172.21.15.106:3300/0 conn(0x7fe5641520b0 0x7fe564158810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:43.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.584+0000 7fe5637fe700 1 -- 172.21.15.80:0/3461787440 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe56415c650 con 0x7fe564158d50 2024-05-08T21:10:43.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.584+0000 7fe5637fe700 1 -- 172.21.15.80:0/3461787440 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3520646302 0 0) 0x7fe550001670 con 0x7fe564158d50 2024-05-08T21:10:43.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.584+0000 7fe5637fe700 1 -- 172.21.15.80:0/3461787440 >> v1:172.21.15.80:6789/0 conn(0x7fe564158d50 legacy=0x7fe564072d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:43.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.584+0000 7fe5637fe700 1 --2- 172.21.15.80:0/3461787440 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe554003a00 0x7fe554003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:43.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.584+0000 7fe5637fe700 1 --2- 172.21.15.80:0/3461787440 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe5640cbba0 0x7fe554004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:43.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.584+0000 7fe5637fe700 1 --2- 172.21.15.80:0/3461787440 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe554004d90 0x7fe554005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:43.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.584+0000 7fe5637fe700 1 -- 172.21.15.80:0/3461787440 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5641580e0 con 0x7fe554003a00 2024-05-08T21:10:43.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.584+0000 7fe5637fe700 1 -- 172.21.15.80:0/3461787440 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe55400ba10 con 0x7fe554004d90 2024-05-08T21:10:43.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.584+0000 7fe5637fe700 1 -- 172.21.15.80:0/3461787440 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe55400bb50 con 0x7fe5640cbba0 2024-05-08T21:10:43.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.584+0000 7fe5688af700 1 --2- 172.21.15.80:0/3461787440 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe554003a00 0x7fe554003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:43.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.585+0000 7fe563fff700 1 --2- 172.21.15.80:0/3461787440 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe5640cbba0 0x7fe554004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:43.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.585+0000 7fe5690b0700 1 --2- 172.21.15.80:0/3461787440 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe554004d90 0x7fe554005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:43.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.585+0000 7fe5688af700 1 -- 172.21.15.80:0/3461787440 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe5640cbba0 msgr2=0x7fe554004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:43.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.585+0000 7fe5688af700 1 --2- 172.21.15.80:0/3461787440 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe5640cbba0 0x7fe554004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:43.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.585+0000 7fe5688af700 1 -- 172.21.15.80:0/3461787440 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe554004d90 msgr2=0x7fe554005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:43.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.585+0000 7fe5688af700 1 --2- 172.21.15.80:0/3461787440 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe554004d90 0x7fe554005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:43.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.585+0000 7fe5688af700 1 -- 172.21.15.80:0/3461787440 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5540035b0 con 0x7fe554003a00 2024-05-08T21:10:43.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.585+0000 7fe5688af700 1 --2- 172.21.15.80:0/3461787440 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe554003a00 0x7fe554003e20 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe558009b60 tx=0x7fe554005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=222ad158498131c8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:43.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.585+0000 7fe5637fe700 1 -- 172.21.15.80:0/3461787440 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55800e6c0 con 0x7fe554003a00 2024-05-08T21:10:43.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.585+0000 7fe5637fe700 1 -- 172.21.15.80:0/3461787440 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe55800e820 con 0x7fe554003a00 2024-05-08T21:10:43.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.585+0000 7fe5637fe700 1 -- 172.21.15.80:0/3461787440 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55800eb90 con 0x7fe554003a00 2024-05-08T21:10:43.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.586+0000 7fe56ab13700 1 -- 172.21.15.80:0/3461787440 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe554003a00 msgr2=0x7fe554003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:43.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.586+0000 7fe56ab13700 1 --2- 172.21.15.80:0/3461787440 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe554003a00 0x7fe554003e20 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe558009b60 tx=0x7fe554005880 comp rx=0 tx=0).stop 2024-05-08T21:10:43.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.586+0000 7fe5690b0700 1 -- 172.21.15.80:0/3461787440 reap_dead start 2024-05-08T21:10:43.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.586+0000 7fe56ab13700 1 -- 172.21.15.80:0/3461787440 shutdown_connections 2024-05-08T21:10:43.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.586+0000 7fe56ab13700 1 -- 172.21.15.80:0/3461787440 >> 172.21.15.80:0/3461787440 conn(0x7fe564066780 msgr2=0x7fe564066b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:43.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.586+0000 7fe56ab13700 1 -- 172.21.15.80:0/3461787440 shutdown_connections 2024-05-08T21:10:43.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.586+0000 7fe56ab13700 1 -- 172.21.15.80:0/3461787440 wait complete. 2024-05-08T21:10:43.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.587+0000 7fe56ab13700 1 Processor -- start 2024-05-08T21:10:43.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.587+0000 7fe56ab13700 1 -- start start 2024-05-08T21:10:43.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.588+0000 7fe56ab13700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe554003a00 0x7fe5641f0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:43.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.588+0000 7fe56ab13700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5640c3c90 0x7fe564072fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:43.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.588+0000 7fe56ab13700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe56415b180 0x7fe56414d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:43.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.588+0000 7fe56ab13700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe56415a730 con 0x7fe5640c3c90 2024-05-08T21:10:43.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.588+0000 7fe56ab13700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe56415acf0 con 0x7fe56415b180 2024-05-08T21:10:43.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.588+0000 7fe56ab13700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5641f1270 con 0x7fe554003a00 2024-05-08T21:10:43.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.588+0000 7fe563fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5640c3c90 0x7fe564072fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:43.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.588+0000 7fe563fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5640c3c90 0x7fe564072fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34578/0 (socket says 172.21.15.80:34578) 2024-05-08T21:10:43.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.588+0000 7fe563fff700 1 -- 172.21.15.80:0/3613532087 learned_addr learned my addr 172.21.15.80:0/3613532087 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:43.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.588+0000 7fe5688af700 1 --2- 172.21.15.80:0/3613532087 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe554003a00 0x7fe5641f0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:43.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.588+0000 7fe5690b0700 1 --2- 172.21.15.80:0/3613532087 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe56415b180 0x7fe56414d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:43.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.588+0000 7fe563fff700 1 -- 172.21.15.80:0/3613532087 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe554003a00 msgr2=0x7fe5641f0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:43.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.588+0000 7fe563fff700 1 --2- 172.21.15.80:0/3613532087 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe554003a00 0x7fe5641f0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:43.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.588+0000 7fe563fff700 1 -- 172.21.15.80:0/3613532087 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe56415b180 msgr2=0x7fe56414d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:43.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.588+0000 7fe563fff700 1 --2- 172.21.15.80:0/3613532087 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe56415b180 0x7fe56414d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:43.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.588+0000 7fe563fff700 1 -- 172.21.15.80:0/3613532087 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5641f1550 con 0x7fe5640c3c90 2024-05-08T21:10:43.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.588+0000 7fe563fff700 1 --2- 172.21.15.80:0/3613532087 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5640c3c90 0x7fe564072fb0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe550007a60 tx=0x7fe5500075f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:43.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.588+0000 7fe5617fa700 1 -- 172.21.15.80:0/3613532087 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55000f660 con 0x7fe5640c3c90 2024-05-08T21:10:43.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.588+0000 7fe5617fa700 1 -- 172.21.15.80:0/3613532087 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe55000f800 con 0x7fe5640c3c90 2024-05-08T21:10:43.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.588+0000 7fe56ab13700 1 -- 172.21.15.80:0/3613532087 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5641f1830 con 0x7fe5640c3c90 2024-05-08T21:10:43.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.588+0000 7fe5617fa700 1 -- 172.21.15.80:0/3613532087 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55000fbb0 con 0x7fe5640c3c90 2024-05-08T21:10:43.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.588+0000 7fe56ab13700 1 -- 172.21.15.80:0/3613532087 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5641f0f70 con 0x7fe5640c3c90 2024-05-08T21:10:43.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.590+0000 7fe5617fa700 1 -- 172.21.15.80:0/3613532087 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe55000fd10 con 0x7fe5640c3c90 2024-05-08T21:10:43.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.590+0000 7fe5617fa700 1 --2- 172.21.15.80:0/3613532087 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe54806ac90 0x7fe54806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:43.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.590+0000 7fe5617fa700 1 -- 172.21.15.80:0/3613532087 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe550089590 con 0x7fe5640c3c90 2024-05-08T21:10:43.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.590+0000 7fe5688af700 1 --2- 172.21.15.80:0/3613532087 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe54806ac90 0x7fe54806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:43.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.591+0000 7fe5688af700 1 --2- 172.21.15.80:0/3613532087 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe54806ac90 0x7fe54806d150 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe5580090b0 tx=0x7fe558008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:43.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.592+0000 7fe576ccdb80 1 Processor -- start 2024-05-08T21:10:43.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.592+0000 7fe576ccdb80 1 -- start start 2024-05-08T21:10:43.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.593+0000 7fe576ccdb80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561c8b040ab0 0x561c8b03c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:43.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.593+0000 7fe576ccdb80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561c8affe930 0x561c8b03c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:43.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.593+0000 7fe576ccdb80 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561c8b040e90 0x561c8b025670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:43.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.593+0000 7fe576ccdb80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c8af53100 con 0x561c8b040ab0 2024-05-08T21:10:43.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.593+0000 7fe576ccdb80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c8af50ac0 con 0x561c8affe930 2024-05-08T21:10:43.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.593+0000 7fe576ccdb80 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x561c8af4c3b0 con 0x561c8b040e90 2024-05-08T21:10:43.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.593+0000 7fe5688af700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561c8b040ab0 0x561c8b03c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:43.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.593+0000 7fe5688af700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561c8b040ab0 0x561c8b03c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34584/0 (socket says 172.21.15.80:34584) 2024-05-08T21:10:43.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.593+0000 7fe5688af700 1 -- 172.21.15.80:0/1545498232 learned_addr learned my addr 172.21.15.80:0/1545498232 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:43.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.593+0000 7fe563fff700 1 --2- 172.21.15.80:0/1545498232 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561c8affe930 0x561c8b03c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:43.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.593+0000 7fe5688af700 1 -- 172.21.15.80:0/1545498232 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561c8b040e90 msgr2=0x561c8b025670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:43.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.593+0000 7fe5690b0700 1 --2- 172.21.15.80:0/1545498232 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561c8b040e90 0x561c8b025670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:43.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.593+0000 7fe5688af700 1 --2- 172.21.15.80:0/1545498232 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561c8b040e90 0x561c8b025670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:43.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.593+0000 7fe5688af700 1 -- 172.21.15.80:0/1545498232 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561c8affe930 msgr2=0x561c8b03c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:43.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.593+0000 7fe5688af700 1 --2- 172.21.15.80:0/1545498232 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561c8affe930 0x561c8b03c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:43.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.593+0000 7fe5688af700 1 -- 172.21.15.80:0/1545498232 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561c8adcd360 con 0x561c8b040ab0 2024-05-08T21:10:43.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.593+0000 7fe5688af700 1 --2- 172.21.15.80:0/1545498232 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561c8b040ab0 0x561c8b03c010 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe55800e990 tx=0x7fe558013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29a6bf39de0ea2ca server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:43.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.593+0000 7fe54e7fc700 1 -- 172.21.15.80:0/1545498232 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe558022070 con 0x561c8b040ab0 2024-05-08T21:10:43.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.594+0000 7fe54e7fc700 1 -- 172.21.15.80:0/1545498232 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe558004030 con 0x561c8b040ab0 2024-05-08T21:10:43.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.594+0000 7fe54e7fc700 1 -- 172.21.15.80:0/1545498232 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5580043a0 con 0x561c8b040ab0 2024-05-08T21:10:43.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.594+0000 7fe576ccdb80 1 -- 172.21.15.80:0/1545498232 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561c8b040ab0 msgr2=0x561c8b03c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:43.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.594+0000 7fe576ccdb80 1 --2- 172.21.15.80:0/1545498232 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561c8b040ab0 0x561c8b03c010 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe55800e990 tx=0x7fe558013000 comp rx=0 tx=0).stop 2024-05-08T21:10:43.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.594+0000 7fe576ccdb80 1 -- 172.21.15.80:0/1545498232 shutdown_connections 2024-05-08T21:10:43.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.594+0000 7fe576ccdb80 1 --2- 172.21.15.80:0/1545498232 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561c8b040ab0 0x561c8b03c010 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:43.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.594+0000 7fe576ccdb80 1 --2- 172.21.15.80:0/1545498232 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561c8b040e90 0x561c8b025670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:43.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.594+0000 7fe576ccdb80 1 --2- 172.21.15.80:0/1545498232 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561c8affe930 0x561c8b03c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:43.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.594+0000 7fe576ccdb80 1 -- 172.21.15.80:0/1545498232 >> 172.21.15.80:0/1545498232 conn(0x561c8af5a1c0 msgr2=0x561c8affa300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:43.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.594+0000 7fe576ccdb80 1 -- 172.21.15.80:0/1545498232 shutdown_connections 2024-05-08T21:10:43.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.594+0000 7fe576ccdb80 1 -- 172.21.15.80:0/1545498232 wait complete. 2024-05-08T21:10:43.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.595+0000 7fe576ccdb80 1 -- start start 2024-05-08T21:10:43.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.595+0000 7fe576ccdb80 1 Processor -- start 2024-05-08T21:10:43.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.596+0000 7fe576ccdb80 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561c8b040ab0 0x561c8b03fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:43.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.596+0000 7fe576ccdb80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561c8b040e90 0x561c8b0230d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:43.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.596+0000 7fe576ccdb80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561c8b0516b0 0x561c8b03d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:43.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.596+0000 7fe576ccdb80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c8aee8510 con 0x561c8b0516b0 2024-05-08T21:10:43.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.596+0000 7fe576ccdb80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c8aee81b0 con 0x561c8b040e90 2024-05-08T21:10:43.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.596+0000 7fe576ccdb80 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x561c8adcf650 con 0x561c8b040ab0 2024-05-08T21:10:43.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.596+0000 7fe576ccdb80 10 client.0 _ll_register_callbacks cb 0x561c8aef1ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T21:10:43.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.596+0000 7fe5690b0700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561c8b0516b0 0x561c8b03d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:43.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.596+0000 7fe5690b0700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561c8b0516b0 0x561c8b03d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34594/0 (socket says 172.21.15.80:34594) 2024-05-08T21:10:43.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.596+0000 7fe5690b0700 1 -- 172.21.15.80:0/1066275506 learned_addr learned my addr 172.21.15.80:0/1066275506 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:43.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.596+0000 7fe563fff700 1 --2- 172.21.15.80:0/1066275506 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561c8b040e90 0x561c8b0230d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:43.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.596+0000 7fe5688af700 1 --2- 172.21.15.80:0/1066275506 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561c8b040ab0 0x561c8b03fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:43.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.596+0000 7fe5690b0700 1 -- 172.21.15.80:0/1066275506 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561c8b040ab0 msgr2=0x561c8b03fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:43.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.596+0000 7fe5690b0700 1 --2- 172.21.15.80:0/1066275506 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561c8b040ab0 0x561c8b03fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:43.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.596+0000 7fe5690b0700 1 -- 172.21.15.80:0/1066275506 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561c8b040e90 msgr2=0x561c8b0230d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:43.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.596+0000 7fe5690b0700 1 --2- 172.21.15.80:0/1066275506 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561c8b040e90 0x561c8b0230d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:43.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.596+0000 7fe5690b0700 1 -- 172.21.15.80:0/1066275506 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5540035b0 con 0x561c8b0516b0 2024-05-08T21:10:43.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.596+0000 7fe5688af700 1 --2- 172.21.15.80:0/1066275506 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561c8b040ab0 0x561c8b03fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:10:43.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.596+0000 7fe5690b0700 1 --2- 172.21.15.80:0/1066275506 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561c8b0516b0 0x561c8b03d1c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe5640c43a0 tx=0x7fe55c004550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4acf5385b7de46a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:43.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.596+0000 7fe5437fe700 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-05-08T21:10:43.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.596+0000 7fe5437fe700 1 -- 172.21.15.80:0/1066275506 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55c00e040 con 0x561c8b0516b0 2024-05-08T21:10:43.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.596+0000 7fe576ccdb80 1 -- 172.21.15.80:0/1066275506 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561c8aea5220 con 0x561c8b0516b0 2024-05-08T21:10:43.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.596+0000 7fe5437fe700 1 -- 172.21.15.80:0/1066275506 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe55c016870 con 0x561c8b0516b0 2024-05-08T21:10:43.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.597+0000 7fe5437fe700 1 -- 172.21.15.80:0/1066275506 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=10) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe55c009be0 con 0x561c8b0516b0 2024-05-08T21:10:43.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.597+0000 7fe576ccdb80 10 client.4830 fetch_fsmap learned FSMap version 10 2024-05-08T21:10:43.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.597+0000 7fe576ccdb80 1 -- 172.21.15.80:0/1066275506 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=10,monmap=2+}) v3 -- 0x561c8ad79b10 con 0x561c8b0516b0 2024-05-08T21:10:43.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.597+0000 7fe5437fe700 1 -- 172.21.15.80:0/1066275506 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561c8aea5220 con 0x561c8b0516b0 2024-05-08T21:10:43.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.597+0000 7fe5437fe700 1 -- 172.21.15.80:0/1066275506 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 10) v1 ==== 4212+0+0 (secure 0 0 0) 0x7fe55c014050 con 0x561c8b0516b0 2024-05-08T21:10:43.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.597+0000 7fe576ccdb80 10 client.4830 fetch_fsmap finished waiting for FSMap version 10 2024-05-08T21:10:43.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.597+0000 7fe576ccdb80 10 client.4830 resolve_mds: resolved name 'd' to daemon mds.d 2024-05-08T21:10:43.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.597+0000 7fe576ccdb80 20 client.4830 populate_metadata read hostname 'smithi080' 2024-05-08T21:10:43.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.597+0000 7fe576ccdb80 1 --2- 172.21.15.80:0/1066275506 >> [v2:172.21.15.106:6834/1949999190,v1:172.21.15.106:6836/1949999190] conn(0x561c8b0548f0 0x561c8b05f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:43.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.597+0000 7fe576ccdb80 4 client.4830 mds_command: new command op to 4291 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T21:10:43.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.597+0000 7fe576ccdb80 1 -- 172.21.15.80:0/1066275506 --> [v2:172.21.15.106:6834/1949999190,v1:172.21.15.106:6836/1949999190] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561c8afcb790 con 0x561c8b0548f0 2024-05-08T21:10:43.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.597+0000 7fe5688af700 1 --2- 172.21.15.80:0/1066275506 >> [v2:172.21.15.106:6834/1949999190,v1:172.21.15.106:6836/1949999190] conn(0x561c8b0548f0 0x561c8b05f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:43.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.598+0000 7fe5437fe700 10 client.4830 ms_handle_connect on v2:172.21.15.106:6834/1949999190 2024-05-08T21:10:43.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.598+0000 7fe5688af700 1 --2- 172.21.15.80:0/1066275506 >> [v2:172.21.15.106:6834/1949999190,v1:172.21.15.106:6836/1949999190] conn(0x561c8b0548f0 0x561c8b05f7e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49799110f260f3e1 server_cookie=c314dbb41077f6a0 in_seq=0 out_seq=0 2024-05-08T21:10:43.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.598+0000 7fe5437fe700 1 -- 172.21.15.80:0/1066275506 <== mds.0 v2:172.21.15.106:6834/1949999190 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x561c8afcb790 con 0x561c8b0548f0 2024-05-08T21:10:43.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.598+0000 7fe5437fe700 10 client.4830 handle_command_reply: tid=0 2024-05-08T21:10:43.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.598+0000 7fe576ccdb80 1 client.4830 shutdown 2024-05-08T21:10:43.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.598+0000 7fe576ccdb80 1 -- 172.21.15.80:0/1066275506 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561c8b0516b0 msgr2=0x561c8b03d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:43.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.598+0000 7fe576ccdb80 1 --2- 172.21.15.80:0/1066275506 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561c8b0516b0 0x561c8b03d1c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe5640c43a0 tx=0x7fe55c004550 comp rx=0 tx=0).stop 2024-05-08T21:10:43.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.598+0000 7fe576ccdb80 1 -- 172.21.15.80:0/1066275506 shutdown_connections 2024-05-08T21:10:43.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.598+0000 7fe576ccdb80 1 --2- 172.21.15.80:0/1066275506 >> [v2:172.21.15.106:6834/1949999190,v1:172.21.15.106:6836/1949999190] conn(0x561c8b0548f0 0x561c8b05f7e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:43.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.598+0000 7fe576ccdb80 1 --2- 172.21.15.80:0/1066275506 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561c8b0516b0 0x561c8b03d1c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:43.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.598+0000 7fe576ccdb80 1 --2- 172.21.15.80:0/1066275506 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561c8b040ab0 0x561c8b03fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:43.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.598+0000 7fe5437fe700 0 client.4830 ms_handle_reset on v2:172.21.15.106:6834/1949999190 2024-05-08T21:10:43.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.598+0000 7fe576ccdb80 1 --2- 172.21.15.80:0/1066275506 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561c8b040e90 0x561c8b0230d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:43.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.598+0000 7fe576ccdb80 1 -- 172.21.15.80:0/1066275506 >> 172.21.15.80:0/1066275506 conn(0x561c8af5a1c0 msgr2=0x561c8b025320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:43.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.599+0000 7fe576ccdb80 1 -- 172.21.15.80:0/1066275506 shutdown_connections 2024-05-08T21:10:43.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.599+0000 7fe576ccdb80 1 -- 172.21.15.80:0/1066275506 wait complete. 2024-05-08T21:10:43.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.599+0000 7fe576ccdb80 20 client.4830 trim_cache size 0 max 16384 2024-05-08T21:10:43.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.616+0000 7fe576ccdb80 1 Processor -- start 2024-05-08T21:10:43.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.616+0000 7fe576ccdb80 1 -- start start 2024-05-08T21:10:43.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.617+0000 7fe576ccdb80 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561c8b040ab0 0x561c8b026010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:43.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.617+0000 7fe576ccdb80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561c8b040e90 0x561c8b026550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:43.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.617+0000 7fe576ccdb80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561c8b0516b0 0x561c8b01be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:43.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.617+0000 7fe576ccdb80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c8b026dd0 con 0x561c8b0516b0 2024-05-08T21:10:43.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.617+0000 7fe576ccdb80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c8b023080 con 0x561c8b040e90 2024-05-08T21:10:43.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.617+0000 7fe576ccdb80 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x561c8aff9840 con 0x561c8b040ab0 2024-05-08T21:10:43.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.617+0000 7fe5690b0700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561c8b0516b0 0x561c8b01be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:43.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.617+0000 7fe5690b0700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561c8b0516b0 0x561c8b01be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34598/0 (socket says 172.21.15.80:34598) 2024-05-08T21:10:43.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.617+0000 7fe5690b0700 1 -- 172.21.15.80:0/3230237961 learned_addr learned my addr 172.21.15.80:0/3230237961 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:43.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.617+0000 7fe5688af700 1 --2- 172.21.15.80:0/3230237961 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561c8b040ab0 0x561c8b026010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:43.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.617+0000 7fe563fff700 1 --2- 172.21.15.80:0/3230237961 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561c8b040e90 0x561c8b026550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:43.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.617+0000 7fe5690b0700 1 -- 172.21.15.80:0/3230237961 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561c8b040ab0 msgr2=0x561c8b026010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:43.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.617+0000 7fe5690b0700 1 --2- 172.21.15.80:0/3230237961 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561c8b040ab0 0x561c8b026010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:43.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.617+0000 7fe5690b0700 1 -- 172.21.15.80:0/3230237961 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561c8b040e90 msgr2=0x561c8b026550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:43.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.617+0000 7fe5690b0700 1 --2- 172.21.15.80:0/3230237961 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561c8b040e90 0x561c8b026550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:43.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.618+0000 7fe5690b0700 1 -- 172.21.15.80:0/3230237961 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561c8af12510 con 0x561c8b0516b0 2024-05-08T21:10:43.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.618+0000 7fe5690b0700 1 --2- 172.21.15.80:0/3230237961 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561c8b0516b0 0x561c8b01be10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe55c009c40 tx=0x7fe55c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4673e790ad013022 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:43.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.618+0000 7fe54effd700 1 -- 172.21.15.80:0/3230237961 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55c00e050 con 0x561c8b0516b0 2024-05-08T21:10:43.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.618+0000 7fe54effd700 1 -- 172.21.15.80:0/3230237961 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe55c00f040 con 0x561c8b0516b0 2024-05-08T21:10:43.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.618+0000 7fe54effd700 1 -- 172.21.15.80:0/3230237961 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55c009750 con 0x561c8b0516b0 2024-05-08T21:10:43.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.618+0000 7fe576ccdb80 1 -- 172.21.15.80:0/3230237961 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561c8b0516b0 msgr2=0x561c8b01be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:43.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.618+0000 7fe576ccdb80 1 --2- 172.21.15.80:0/3230237961 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561c8b0516b0 0x561c8b01be10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe55c009c40 tx=0x7fe55c018000 comp rx=0 tx=0).stop 2024-05-08T21:10:43.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.618+0000 7fe576ccdb80 1 -- 172.21.15.80:0/3230237961 shutdown_connections 2024-05-08T21:10:43.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.618+0000 7fe576ccdb80 1 --2- 172.21.15.80:0/3230237961 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561c8b0516b0 0x561c8b01be10 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:43.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.618+0000 7fe576ccdb80 1 --2- 172.21.15.80:0/3230237961 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561c8b040ab0 0x561c8b026010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:43.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.618+0000 7fe576ccdb80 1 --2- 172.21.15.80:0/3230237961 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561c8b040e90 0x561c8b026550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:43.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.618+0000 7fe576ccdb80 1 -- 172.21.15.80:0/3230237961 >> 172.21.15.80:0/3230237961 conn(0x561c8af5a1c0 msgr2=0x561c8aff3190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:43.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.618+0000 7fe576ccdb80 1 -- 172.21.15.80:0/3230237961 shutdown_connections 2024-05-08T21:10:43.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.618+0000 7fe576ccdb80 1 -- 172.21.15.80:0/3230237961 wait complete. 2024-05-08T21:10:43.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.619+0000 7fe576ccdb80 1 -- start start 2024-05-08T21:10:43.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.619+0000 7fe576ccdb80 1 Processor -- start 2024-05-08T21:10:43.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.620+0000 7fe576ccdb80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561c8b040ab0 0x561c8b03ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:43.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.620+0000 7fe576ccdb80 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561c8b040e90 0x561c8b0ab4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:43.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.620+0000 7fe576ccdb80 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561c8b0516b0 0x561c8b01dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:43.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.620+0000 7fe576ccdb80 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c8b049f10 con 0x561c8b040e90 2024-05-08T21:10:43.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.620+0000 7fe576ccdb80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c8b0aade0 con 0x561c8b040ab0 2024-05-08T21:10:43.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.620+0000 7fe576ccdb80 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x561c8b03f490 con 0x561c8b0516b0 2024-05-08T21:10:43.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.620+0000 7fe576ccdb80 10 client.0 _ll_register_callbacks cb 0x561c8aef1ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T21:10:43.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.620+0000 7fe563fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561c8b040e90 0x561c8b0ab4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:43.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.620+0000 7fe563fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561c8b040e90 0x561c8b0ab4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34612/0 (socket says 172.21.15.80:34612) 2024-05-08T21:10:43.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.620+0000 7fe563fff700 1 -- 172.21.15.80:0/2096746415 learned_addr learned my addr 172.21.15.80:0/2096746415 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:43.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.620+0000 7fe5688af700 1 --2- 172.21.15.80:0/2096746415 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561c8b040ab0 0x561c8b03ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:43.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.620+0000 7fe5690b0700 1 --2- 172.21.15.80:0/2096746415 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561c8b0516b0 0x561c8b01dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:43.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.620+0000 7fe563fff700 1 -- 172.21.15.80:0/2096746415 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561c8b0516b0 msgr2=0x561c8b01dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:43.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.620+0000 7fe563fff700 1 --2- 172.21.15.80:0/2096746415 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561c8b0516b0 0x561c8b01dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:43.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.620+0000 7fe563fff700 1 -- 172.21.15.80:0/2096746415 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561c8b040ab0 msgr2=0x561c8b03ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:43.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.620+0000 7fe563fff700 1 --2- 172.21.15.80:0/2096746415 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561c8b040ab0 0x561c8b03ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:43.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.620+0000 7fe563fff700 1 -- 172.21.15.80:0/2096746415 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561c8ad79b10 con 0x561c8b040e90 2024-05-08T21:10:43.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.620+0000 7fe563fff700 1 --2- 172.21.15.80:0/2096746415 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561c8b040e90 0x561c8b0ab4f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe550007c30 tx=0x7fe550007d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66ffec753bfbeab7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:43.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.620+0000 7fe5437fe700 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-05-08T21:10:43.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.620+0000 7fe5437fe700 1 -- 172.21.15.80:0/2096746415 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe550058650 con 0x561c8b040e90 2024-05-08T21:10:43.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.620+0000 7fe5437fe700 1 -- 172.21.15.80:0/2096746415 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe550060530 con 0x561c8b040e90 2024-05-08T21:10:43.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.620+0000 7fe576ccdb80 1 -- 172.21.15.80:0/2096746415 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe558004030 con 0x561c8b040e90 2024-05-08T21:10:43.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.621+0000 7fe5437fe700 1 -- 172.21.15.80:0/2096746415 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=10) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe5500576e0 con 0x561c8b040e90 2024-05-08T21:10:43.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.621+0000 7fe576ccdb80 10 client.4836 fetch_fsmap learned FSMap version 10 2024-05-08T21:10:43.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.621+0000 7fe576ccdb80 1 -- 172.21.15.80:0/2096746415 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=10,monmap=2+}) v3 -- 0x561c8add1c80 con 0x561c8b040e90 2024-05-08T21:10:43.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.621+0000 7fe5437fe700 1 -- 172.21.15.80:0/2096746415 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe550076e90 con 0x561c8b040e90 2024-05-08T21:10:43.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.621+0000 7fe5437fe700 1 -- 172.21.15.80:0/2096746415 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 10) v1 ==== 4212+0+0 (secure 0 0 0) 0x7fe550087270 con 0x561c8b040e90 2024-05-08T21:10:43.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.621+0000 7fe576ccdb80 10 client.4836 fetch_fsmap finished waiting for FSMap version 10 2024-05-08T21:10:43.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.621+0000 7fe576ccdb80 10 client.4836 resolve_mds: resolved name 'd' to daemon mds.d 2024-05-08T21:10:43.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.621+0000 7fe576ccdb80 20 client.4836 populate_metadata read hostname 'smithi080' 2024-05-08T21:10:43.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.621+0000 7fe576ccdb80 1 --2- 172.21.15.80:0/2096746415 >> [v2:172.21.15.106:6834/1949999190,v1:172.21.15.106:6836/1949999190] conn(0x561c8b0a45a0 0x561c8b0a4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:43.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.621+0000 7fe576ccdb80 4 client.4836 mds_command: new command op to 4291 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-08T21:10:43.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.621+0000 7fe576ccdb80 1 -- 172.21.15.80:0/2096746415 --> [v2:172.21.15.106:6834/1949999190,v1:172.21.15.106:6836/1949999190] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561c8af44e70 con 0x561c8b0a45a0 2024-05-08T21:10:43.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.621+0000 7fe5688af700 1 --2- 172.21.15.80:0/2096746415 >> [v2:172.21.15.106:6834/1949999190,v1:172.21.15.106:6836/1949999190] conn(0x561c8b0a45a0 0x561c8b0a4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:43.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.621+0000 7fe5437fe700 10 client.4836 ms_handle_connect on v2:172.21.15.106:6834/1949999190 2024-05-08T21:10:43.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.621+0000 7fe5688af700 1 --2- 172.21.15.80:0/2096746415 >> [v2:172.21.15.106:6834/1949999190,v1:172.21.15.106:6836/1949999190] conn(0x561c8b0a45a0 0x561c8b0a4980 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49ae19ce6389735e server_cookie=5400ad54a0e5b4b0 in_seq=0 out_seq=0 2024-05-08T21:10:43.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.622+0000 7fe5437fe700 1 -- 172.21.15.80:0/2096746415 <== mds.0 v2:172.21.15.106:6834/1949999190 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x561c8af44e70 con 0x561c8b0a45a0 2024-05-08T21:10:43.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.622+0000 7fe5437fe700 10 client.4836 handle_command_reply: tid=0 2024-05-08T21:10:43.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.622+0000 7fe576ccdb80 1 client.4836 shutdown 2024-05-08T21:10:43.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.622+0000 7fe576ccdb80 1 -- 172.21.15.80:0/2096746415 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561c8b040e90 msgr2=0x561c8b0ab4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:43.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.622+0000 7fe576ccdb80 1 --2- 172.21.15.80:0/2096746415 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561c8b040e90 0x561c8b0ab4f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe550007c30 tx=0x7fe550007d40 comp rx=0 tx=0).stop 2024-05-08T21:10:43.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.622+0000 7fe576ccdb80 1 -- 172.21.15.80:0/2096746415 shutdown_connections 2024-05-08T21:10:43.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.622+0000 7fe576ccdb80 1 --2- 172.21.15.80:0/2096746415 >> [v2:172.21.15.106:6834/1949999190,v1:172.21.15.106:6836/1949999190] conn(0x561c8b0a45a0 0x561c8b0a4980 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:43.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.622+0000 7fe576ccdb80 1 --2- 172.21.15.80:0/2096746415 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561c8b0516b0 0x561c8b01dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:43.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.622+0000 7fe576ccdb80 1 --2- 172.21.15.80:0/2096746415 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561c8b040ab0 0x561c8b03ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:43.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.622+0000 7fe5437fe700 0 client.4836 ms_handle_reset on v2:172.21.15.106:6834/1949999190 2024-05-08T21:10:43.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.622+0000 7fe576ccdb80 1 --2- 172.21.15.80:0/2096746415 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x561c8b040e90 0x561c8b0ab4f0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:43.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.622+0000 7fe576ccdb80 1 -- 172.21.15.80:0/2096746415 >> 172.21.15.80:0/2096746415 conn(0x561c8af5a1c0 msgr2=0x561c8b05ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:43.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.622+0000 7fe576ccdb80 1 -- 172.21.15.80:0/2096746415 shutdown_connections 2024-05-08T21:10:43.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.622+0000 7fe576ccdb80 1 -- 172.21.15.80:0/2096746415 wait complete. 2024-05-08T21:10:43.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.622+0000 7fe576ccdb80 20 client.4836 trim_cache size 0 max 16384 2024-05-08T21:10:43.632 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T21:10:43.632 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_fsid": "44d31c1e-aad3-47ca-a4fa-85a63d4a60aa", 2024-05-08T21:10:43.632 INFO:teuthology.orchestra.run.smithi080.stdout: "whoami": 0, 2024-05-08T21:10:43.632 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 4291, 2024-05-08T21:10:43.632 INFO:teuthology.orchestra.run.smithi080.stdout: "want_state": "up:active", 2024-05-08T21:10:43.632 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "up:active", 2024-05-08T21:10:43.632 INFO:teuthology.orchestra.run.smithi080.stdout: "fs_name": "cephfs", 2024-05-08T21:10:43.633 INFO:teuthology.orchestra.run.smithi080.stdout: "rank_uptime": 39.895232073000003, 2024-05-08T21:10:43.633 INFO:teuthology.orchestra.run.smithi080.stdout: "mdsmap_epoch": 10, 2024-05-08T21:10:43.633 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch": 26, 2024-05-08T21:10:43.633 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch_barrier": 26, 2024-05-08T21:10:43.633 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 45.899519955999999 2024-05-08T21:10:43.633 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T21:10:43.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.622+0000 7fe56ab13700 1 -- 172.21.15.80:0/3613532087 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe54806ac90 msgr2=0x7fe54806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:43.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.622+0000 7fe56ab13700 1 --2- 172.21.15.80:0/3613532087 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe54806ac90 0x7fe54806d150 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe5580090b0 tx=0x7fe558008030 comp rx=0 tx=0).stop 2024-05-08T21:10:43.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.622+0000 7fe56ab13700 1 -- 172.21.15.80:0/3613532087 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5640c3c90 msgr2=0x7fe564072fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:43.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.622+0000 7fe56ab13700 1 --2- 172.21.15.80:0/3613532087 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5640c3c90 0x7fe564072fb0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe550007a60 tx=0x7fe5500075f0 comp rx=0 tx=0).stop 2024-05-08T21:10:43.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.623+0000 7fe56ab13700 1 -- 172.21.15.80:0/3613532087 shutdown_connections 2024-05-08T21:10:43.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.623+0000 7fe56ab13700 1 --2- 172.21.15.80:0/3613532087 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe54806ac90 0x7fe54806d150 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:43.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.623+0000 7fe56ab13700 1 --2- 172.21.15.80:0/3613532087 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe56415b180 0x7fe56414d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:43.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.623+0000 7fe56ab13700 1 --2- 172.21.15.80:0/3613532087 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe554003a00 0x7fe5641f0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:43.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.623+0000 7fe56ab13700 1 --2- 172.21.15.80:0/3613532087 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe5640c3c90 0x7fe564072fb0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:43.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.623+0000 7fe56ab13700 1 -- 172.21.15.80:0/3613532087 >> 172.21.15.80:0/3613532087 conn(0x7fe564066780 msgr2=0x7fe564155ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:43.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.623+0000 7fe56ab13700 1 -- 172.21.15.80:0/3613532087 shutdown_connections 2024-05-08T21:10:43.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.623+0000 7fe56ab13700 1 -- 172.21.15.80:0/3613532087 wait complete. 2024-05-08T21:10:43.638 INFO:teuthology.run_tasks:Running task sequential... 2024-05-08T21:10:43.647 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-05-08T21:10:43.647 INFO:teuthology.task.sequential:In sequential, running task print... 2024-05-08T21:10:43.647 INFO:teuthology.task.print:Enabling mgr modules 2024-05-08T21:10:43.648 INFO:teuthology.run_tasks:Running task kclient... 2024-05-08T21:10:43.681 INFO:tasks.kclient:Mounting kernel clients... 2024-05-08T21:10:43.682 INFO:tasks.kclient:config is {'client.0': {}} 2024-05-08T21:10:43.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:10:43.682 DEBUG:teuthology.orchestra.run.smithi080:> ip netns list 2024-05-08T21:10:43.699 INFO:teuthology.orchestra.run.smithi080.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-05-08T21:10:43.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:10:43.700 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-08T21:10:43.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:10:43.783 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link delete ceph-brx 2024-05-08T21:10:43.878 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-05-08T21:10:43.878 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-08T21:10:43.878 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-08T21:10:43.878 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-08T21:10:44.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.997+0000 7ff5da959700 1 Processor -- start 2024-05-08T21:10:44.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.997+0000 7ff5da959700 1 -- start start 2024-05-08T21:10:44.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.998+0000 7ff5da959700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff5d4141290 0x7ff5d40c60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:44.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.998+0000 7ff5da959700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff5d40bfa60 0x7ff5d40bfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:44.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.998+0000 7ff5da959700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5d40c65e0 con 0x7ff5d40cbe20 2024-05-08T21:10:44.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.998+0000 7ff5da959700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5d40c03f0 con 0x7ff5d40bfa60 2024-05-08T21:10:44.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.998+0000 7ff5da959700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d4158480 con 0x7ff5d4141290 2024-05-08T21:10:44.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.998+0000 7ff5d37fe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff5d40cbe20 0x7ff5d40c4c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:53150/0 (socket says 172.21.15.80:53150) 2024-05-08T21:10:44.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.998+0000 7ff5d37fe700 1 -- 172.21.15.80:0/3760436961 learned_addr learned my addr 172.21.15.80:0/3760436961 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:10:44.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.998+0000 7ff5d3fff700 1 --2- 172.21.15.80:0/3760436961 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff5d4141290 0x7ff5d40c60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:44.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.999+0000 7ff5d8ef6700 1 --2- 172.21.15.80:0/3760436961 >> v2:172.21.15.106:3300/0 conn(0x7ff5d40bfa60 0x7ff5d40bfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:44.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.999+0000 7ff5d2ffd700 1 -- 172.21.15.80:0/3760436961 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2331495658 0 0) 0x7ff5d40c65e0 con 0x7ff5d40cbe20 2024-05-08T21:10:44.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.999+0000 7ff5d2ffd700 1 -- 172.21.15.80:0/3760436961 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5bc0035b0 con 0x7ff5d40cbe20 2024-05-08T21:10:44.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.999+0000 7ff5d2ffd700 1 -- 172.21.15.80:0/3760436961 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2565658197 0 0) 0x7ff5bc0035b0 con 0x7ff5d40cbe20 2024-05-08T21:10:44.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.999+0000 7ff5d2ffd700 1 -- 172.21.15.80:0/3760436961 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff5d4141290 msgr2=0x7ff5d40c60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:44.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.999+0000 7ff5d2ffd700 1 --2- 172.21.15.80:0/3760436961 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff5d4141290 0x7ff5d40c60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:44.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.999+0000 7ff5d2ffd700 1 -- 172.21.15.80:0/3760436961 >> v2:172.21.15.106:3300/0 conn(0x7ff5d40bfa60 msgr2=0x7ff5d40bfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:44.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.999+0000 7ff5d2ffd700 1 --2- 172.21.15.80:0/3760436961 >> v2:172.21.15.106:3300/0 conn(0x7ff5d40bfa60 0x7ff5d40bfeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:44.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.999+0000 7ff5d2ffd700 1 -- 172.21.15.80:0/3760436961 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d4158760 con 0x7ff5d40cbe20 2024-05-08T21:10:44.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.999+0000 7ff5d2ffd700 1 -- 172.21.15.80:0/3760436961 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3520646302 0 0) 0x7ff5c4001670 con 0x7ff5d40cbe20 2024-05-08T21:10:44.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.999+0000 7ff5d2ffd700 1 -- 172.21.15.80:0/3760436961 >> v1:172.21.15.80:6789/0 conn(0x7ff5d40cbe20 legacy=0x7ff5d40c4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:44.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.999+0000 7ff5d2ffd700 1 --2- 172.21.15.80:0/3760436961 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5bc003a00 0x7ff5bc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:44.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.999+0000 7ff5d2ffd700 1 --2- 172.21.15.80:0/3760436961 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff5bc004850 0x7ff5bc004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:44.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.999+0000 7ff5d2ffd700 1 --2- 172.21.15.80:0/3760436961 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff5bc005210 0x7ff5bc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:44.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.999+0000 7ff5d2ffd700 1 -- 172.21.15.80:0/3760436961 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d40c03f0 con 0x7ff5bc003a00 2024-05-08T21:10:44.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.999+0000 7ff5d2ffd700 1 -- 172.21.15.80:0/3760436961 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d4158480 con 0x7ff5bc005210 2024-05-08T21:10:44.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.999+0000 7ff5d2ffd700 1 -- 172.21.15.80:0/3760436961 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5bc00bf50 con 0x7ff5bc004850 2024-05-08T21:10:44.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.999+0000 7ff5d3fff700 1 --2- 172.21.15.80:0/3760436961 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff5d4141290 0x7ff5d40c60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:10:44.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.999+0000 7ff5d3fff700 1 --2- 172.21.15.80:0/3760436961 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5bc003a00 0x7ff5bc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:44.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.999+0000 7ff5d37fe700 1 --2- 172.21.15.80:0/3760436961 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff5bc004850 0x7ff5bc004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:44.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.999+0000 7ff5d8ef6700 1 --2- 172.21.15.80:0/3760436961 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff5bc005210 0x7ff5bc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:44.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.999+0000 7ff5d3fff700 1 -- 172.21.15.80:0/3760436961 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff5bc004850 msgr2=0x7ff5bc004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:44.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.999+0000 7ff5d3fff700 1 --2- 172.21.15.80:0/3760436961 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff5bc004850 0x7ff5bc004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:44.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.999+0000 7ff5d3fff700 1 -- 172.21.15.80:0/3760436961 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff5bc005210 msgr2=0x7ff5bc00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:44.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.999+0000 7ff5d3fff700 1 --2- 172.21.15.80:0/3760436961 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff5bc005210 0x7ff5bc00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:44.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.999+0000 7ff5d3fff700 1 -- 172.21.15.80:0/3760436961 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5bc0035b0 con 0x7ff5bc003a00 2024-05-08T21:10:44.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:43.999+0000 7ff5d3fff700 1 --2- 172.21.15.80:0/3760436961 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5bc003a00 0x7ff5bc003e20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff5d40c9160 tx=0x7ff5bc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f36f93e3f6f237bf server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:44.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:44.000+0000 7ff5d2ffd700 1 -- 172.21.15.80:0/3760436961 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c8004030 con 0x7ff5bc003a00 2024-05-08T21:10:44.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:44.000+0000 7ff5d2ffd700 1 -- 172.21.15.80:0/3760436961 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5c8004190 con 0x7ff5bc003a00 2024-05-08T21:10:44.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:44.000+0000 7ff5d2ffd700 1 -- 172.21.15.80:0/3760436961 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c8004540 con 0x7ff5bc003a00 2024-05-08T21:10:44.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:44.000+0000 7ff5da959700 1 -- 172.21.15.80:0/3760436961 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5bc003a00 msgr2=0x7ff5bc003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:44.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:44.000+0000 7ff5da959700 1 --2- 172.21.15.80:0/3760436961 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5bc003a00 0x7ff5bc003e20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff5d40c9160 tx=0x7ff5bc005880 comp rx=0 tx=0).stop 2024-05-08T21:10:44.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:44.000+0000 7ff5d8ef6700 1 -- 172.21.15.80:0/3760436961 reap_dead start 2024-05-08T21:10:44.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:44.000+0000 7ff5da959700 1 -- 172.21.15.80:0/3760436961 shutdown_connections 2024-05-08T21:10:44.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:44.000+0000 7ff5da959700 1 -- 172.21.15.80:0/3760436961 >> 172.21.15.80:0/3760436961 conn(0x7ff5d406a9c0 msgr2=0x7ff5d406ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:44.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:44.000+0000 7ff5da959700 1 -- 172.21.15.80:0/3760436961 shutdown_connections 2024-05-08T21:10:44.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:44.000+0000 7ff5da959700 1 -- 172.21.15.80:0/3760436961 wait complete. 2024-05-08T21:10:44.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:44.001+0000 7ff5da959700 1 Processor -- start 2024-05-08T21:10:44.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:44.002+0000 7ff5da959700 1 -- start start 2024-05-08T21:10:44.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:44.002+0000 7ff5da959700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff5bc003a00 0x7ff5d41565a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:44.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:44.002+0000 7ff5da959700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5d40733a0 0x7ff5d4072660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:44.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:44.002+0000 7ff5da959700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff5d41f1020 0x7ff5d413bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:44.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:44.002+0000 7ff5da959700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d4156290 con 0x7ff5d40733a0 2024-05-08T21:10:44.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:44.002+0000 7ff5da959700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d4152aa0 con 0x7ff5bc003a00 2024-05-08T21:10:44.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:44.002+0000 7ff5da959700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d4152fd0 con 0x7ff5d41f1020 2024-05-08T21:10:44.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:44.003+0000 7ff5d37fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5d40733a0 0x7ff5d4072660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:44.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:44.003+0000 7ff5d37fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5d40733a0 0x7ff5d4072660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34628/0 (socket says 172.21.15.80:34628) 2024-05-08T21:10:44.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:44.003+0000 7ff5d37fe700 1 -- 172.21.15.80:0/3385038568 learned_addr learned my addr 172.21.15.80:0/3385038568 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:44.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:44.003+0000 7ff5d3fff700 1 --2- 172.21.15.80:0/3385038568 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff5bc003a00 0x7ff5d41565a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:44.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:44.003+0000 7ff5d8ef6700 1 --2- 172.21.15.80:0/3385038568 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff5d41f1020 0x7ff5d413bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:44.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:44.003+0000 7ff5d37fe700 1 -- 172.21.15.80:0/3385038568 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff5d41f1020 msgr2=0x7ff5d413bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:44.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:44.003+0000 7ff5d37fe700 1 --2- 172.21.15.80:0/3385038568 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff5d41f1020 0x7ff5d413bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:44.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:44.003+0000 7ff5d37fe700 1 -- 172.21.15.80:0/3385038568 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff5bc003a00 msgr2=0x7ff5d41565a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:44.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:44.003+0000 7ff5d37fe700 1 --2- 172.21.15.80:0/3385038568 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff5bc003a00 0x7ff5d41565a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:44.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:44.003+0000 7ff5d37fe700 1 -- 172.21.15.80:0/3385038568 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d40721d0 con 0x7ff5d40733a0 2024-05-08T21:10:44.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:44.003+0000 7ff5d8ef6700 1 --2- 172.21.15.80:0/3385038568 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff5d41f1020 0x7ff5d413bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:10:44.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:44.003+0000 7ff5d37fe700 1 --2- 172.21.15.80:0/3385038568 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5d40733a0 0x7ff5d4072660 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff5c4007310 tx=0x7ff5c4007620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:44.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:44.003+0000 7ff5d0ff9700 1 -- 172.21.15.80:0/3385038568 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c4011580 con 0x7ff5d40733a0 2024-05-08T21:10:44.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:44.003+0000 7ff5d0ff9700 1 -- 172.21.15.80:0/3385038568 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5c4011740 con 0x7ff5d40733a0 2024-05-08T21:10:44.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:44.003+0000 7ff5da959700 1 -- 172.21.15.80:0/3385038568 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5d4156ae0 con 0x7ff5d40733a0 2024-05-08T21:10:44.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:44.003+0000 7ff5d0ff9700 1 -- 172.21.15.80:0/3385038568 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c4011af0 con 0x7ff5d40733a0 2024-05-08T21:10:44.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:44.003+0000 7ff5da959700 1 -- 172.21.15.80:0/3385038568 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5d4152cf0 con 0x7ff5d40733a0 2024-05-08T21:10:44.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:44.004+0000 7ff5da959700 1 -- 172.21.15.80:0/3385038568 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5d4072360 con 0x7ff5d40733a0 2024-05-08T21:10:44.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:44.004+0000 7ff5d0ff9700 1 -- 172.21.15.80:0/3385038568 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff5c4011c50 con 0x7ff5d40733a0 2024-05-08T21:10:44.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:44.005+0000 7ff5d0ff9700 1 --2- 172.21.15.80:0/3385038568 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7ff5c006acc0 0x7ff5c006d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:44.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:44.005+0000 7ff5d0ff9700 1 -- 172.21.15.80:0/3385038568 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff5c40894d0 con 0x7ff5d40733a0 2024-05-08T21:10:44.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:44.005+0000 7ff5d3fff700 1 --2- 172.21.15.80:0/3385038568 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7ff5c006acc0 0x7ff5c006d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:44.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:44.005+0000 7ff5d3fff700 1 --2- 172.21.15.80:0/3385038568 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7ff5c006acc0 0x7ff5c006d180 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff5c8016040 tx=0x7ff5c801f040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:44.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:44.009+0000 7ff5d0ff9700 1 -- 172.21.15.80:0/3385038568 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7ff5c4054450 con 0x7ff5d40733a0 2024-05-08T21:10:44.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:44.252+0000 7ff5da959700 1 -- 172.21.15.80:0/3385038568 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff5d40c6770 con 0x7ff5d40733a0 2024-05-08T21:10:44.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:44.253+0000 7ff5d0ff9700 1 -- 172.21.15.80:0/3385038568 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v10) v1 ==== 53+0+88 (secure 0 0 0) 0x7ff5c405ce60 con 0x7ff5d40733a0 2024-05-08T21:10:44.256 INFO:teuthology.orchestra.run.smithi080.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-08T21:10:44.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:44.255+0000 7ff5da959700 1 -- 172.21.15.80:0/3385038568 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7ff5c006acc0 msgr2=0x7ff5c006d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:44.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:44.255+0000 7ff5da959700 1 --2- 172.21.15.80:0/3385038568 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7ff5c006acc0 0x7ff5c006d180 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff5c8016040 tx=0x7ff5c801f040 comp rx=0 tx=0).stop 2024-05-08T21:10:44.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:44.255+0000 7ff5da959700 1 -- 172.21.15.80:0/3385038568 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5d40733a0 msgr2=0x7ff5d4072660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:44.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:44.255+0000 7ff5da959700 1 --2- 172.21.15.80:0/3385038568 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5d40733a0 0x7ff5d4072660 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff5c4007310 tx=0x7ff5c4007620 comp rx=0 tx=0).stop 2024-05-08T21:10:44.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:44.255+0000 7ff5da959700 1 -- 172.21.15.80:0/3385038568 shutdown_connections 2024-05-08T21:10:44.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:44.255+0000 7ff5da959700 1 --2- 172.21.15.80:0/3385038568 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7ff5c006acc0 0x7ff5c006d180 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:44.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:44.255+0000 7ff5da959700 1 --2- 172.21.15.80:0/3385038568 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff5d41f1020 0x7ff5d413bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:44.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:44.255+0000 7ff5da959700 1 --2- 172.21.15.80:0/3385038568 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff5bc003a00 0x7ff5d41565a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:44.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:44.255+0000 7ff5da959700 1 --2- 172.21.15.80:0/3385038568 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff5d40733a0 0x7ff5d4072660 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:44.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:44.255+0000 7ff5da959700 1 -- 172.21.15.80:0/3385038568 >> 172.21.15.80:0/3385038568 conn(0x7ff5d406a9c0 msgr2=0x7ff5d40c6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:44.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:44.255+0000 7ff5da959700 1 -- 172.21.15.80:0/3385038568 shutdown_connections 2024-05-08T21:10:44.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:44.255+0000 7ff5da959700 1 -- 172.21.15.80:0/3385038568 wait complete. 2024-05-08T21:10:44.270 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-08T21:10:44.271 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-08T21:10:44.271 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi080.front.sepia.ceph.com 2024-05-08T21:10:44.271 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-08T21:10:44.271 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-08T21:10:44.271 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-08T21:10:44.271 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-08T21:10:44.271 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-08T21:10:44.271 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-08T21:10:44.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:10:44.272 DEBUG:teuthology.orchestra.run.smithi080:> ip addr 2024-05-08T21:10:44.290 INFO:teuthology.orchestra.run.smithi080.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-08T21:10:44.290 INFO:teuthology.orchestra.run.smithi080.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-08T21:10:44.290 INFO:teuthology.orchestra.run.smithi080.stdout: inet 127.0.0.1/8 scope host lo 2024-05-08T21:10:44.290 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-05-08T21:10:44.290 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 ::1/128 scope host 2024-05-08T21:10:44.290 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-05-08T21:10:44.290 INFO:teuthology.orchestra.run.smithi080.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T21:10:44.290 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:d8:d9:b2 brd ff:ff:ff:ff:ff:ff 2024-05-08T21:10:44.290 INFO:teuthology.orchestra.run.smithi080.stdout: altname enp7s0f0 2024-05-08T21:10:44.291 INFO:teuthology.orchestra.run.smithi080.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T21:10:44.291 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:d8:d9:b3 brd ff:ff:ff:ff:ff:ff 2024-05-08T21:10:44.291 INFO:teuthology.orchestra.run.smithi080.stdout: altname enp7s0f1 2024-05-08T21:10:44.291 INFO:teuthology.orchestra.run.smithi080.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T21:10:44.291 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:8f:cb:a8 brd ff:ff:ff:ff:ff:ff 2024-05-08T21:10:44.291 INFO:teuthology.orchestra.run.smithi080.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-08T21:10:44.291 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:8f:cb:a9 brd ff:ff:ff:ff:ff:ff 2024-05-08T21:10:44.291 INFO:teuthology.orchestra.run.smithi080.stdout: inet 172.21.15.80/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-08T21:10:44.291 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft 42278sec preferred_lft 42278sec 2024-05-08T21:10:44.291 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 fe80::69a5:2970:53c:897f/64 scope link noprefixroute 2024-05-08T21:10:44.291 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-05-08T21:10:44.291 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-08T21:10:44.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:10:44.292 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec bash -c ' 2024-05-08T21:10:44.292 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-05-08T21:10:44.292 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link add name ceph-brx type bridge 2024-05-08T21:10:44.292 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip addr flush dev ceph-brx 2024-05-08T21:10:44.292 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link set ceph-brx up 2024-05-08T21:10:44.292 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-08T21:10:44.292 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-05-08T21:10:44.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:10:44.408 DEBUG:teuthology.orchestra.run.smithi080:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-08T21:10:44.435 INFO:teuthology.orchestra.run.smithi080.stdout:1 2024-05-08T21:10:44.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:10:44.436 DEBUG:teuthology.orchestra.run.smithi080:> route 2024-05-08T21:10:44.496 INFO:teuthology.orchestra.run.smithi080.stdout:Kernel IP routing table 2024-05-08T21:10:44.496 INFO:teuthology.orchestra.run.smithi080.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-08T21:10:44.496 INFO:teuthology.orchestra.run.smithi080.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-08T21:10:44.496 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-08T21:10:44.496 INFO:teuthology.orchestra.run.smithi080.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-08T21:10:44.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:10:44.496 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec bash -c ' 2024-05-08T21:10:44.496 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-05-08T21:10:44.497 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-08T21:10:44.497 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-08T21:10:44.497 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-08T21:10:44.497 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-05-08T21:10:44.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:10:44.603 DEBUG:teuthology.orchestra.run.smithi080:> ip netns list 2024-05-08T21:10:44.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:10:44.620 DEBUG:teuthology.orchestra.run.smithi080:> ip netns list-id 2024-05-08T21:10:44.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:10:44.677 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec bash -c ' 2024-05-08T21:10:44.677 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-05-08T21:10:44.677 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-08T21:10:44.678 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-08T21:10:44.678 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-05-08T21:10:44.772 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-08T21:10:44.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:10:44.772 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec bash -c ' 2024-05-08T21:10:44.772 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-05-08T21:10:44.772 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-08T21:10:44.772 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-08T21:10:44.772 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-08T21:10:44.772 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-08T21:10:44.772 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-08T21:10:44.772 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-05-08T21:10:44.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:10:44.945 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec bash -c ' 2024-05-08T21:10:44.945 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-05-08T21:10:44.945 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link set brx.0 up 2024-05-08T21:10:44.945 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link set dev brx.0 master ceph-brx 2024-05-08T21:10:44.945 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-05-08T21:10:45.043 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T21:10:45.043 DEBUG:teuthology.orchestra.run.smithi080:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-08T21:10:45.059 INFO:teuthology.orchestra.run.smithi080.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-08T21:10:45.059 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T21:10:45.059 DEBUG:teuthology.orchestra.run.smithi080:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-08T21:10:45.116 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-08T21:10:45.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:10:45.116 DEBUG:teuthology.orchestra.run.smithi080:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-08T21:10:45.201 INFO:teuthology.orchestra.run.smithi080.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-08T21:10:45.202 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-08T21:10:45.202 INFO:teuthology.orchestra.run.smithi080.stdout:invalid new device string format 2024-05-08T21:10:45.297 INFO:teuthology.orchestra.run.smithi080.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-08T21:10:45.405 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-08T21:10:45.405 INFO:teuthology.orchestra.run.smithi080.stdout:invalid new device string format 2024-05-08T21:10:45.405 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: resolved to: "172.21.15.80:3300,172.21.15.106:3300,172.21.15.106:3301" 2024-05-08T21:10:45.405 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-08T21:10:45.406 INFO:teuthology.orchestra.run.smithi080.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-08T21:10:45.406 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-08T21:10:45.406 INFO:teuthology.orchestra.run.smithi080.stdout:invalid new device string format 2024-05-08T21:10:45.407 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: resolved to: "172.21.15.80:3300,172.21.15.106:3300,172.21.15.106:3301" 2024-05-08T21:10:45.407 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-08T21:10:45.407 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: resolved to: "172.21.15.80:6789,172.21.15.106:6789,172.21.15.106:6790" 2024-05-08T21:10:45.407 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.80:6789,172.21.15.106:6789,172.21.15.106:6790:/ 2024-05-08T21:10:45.407 INFO:teuthology.orchestra.run.smithi080.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=44d31c1e-aad3-47ca-a4fa-85a63d4a60aa" will pass to kernel 2024-05-08T21:10:45.407 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-08T21:10:45.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:10:45.407 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-08T21:10:45.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:10:45.441 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-08T21:10:45.520 INFO:teuthology.orchestra.run.smithi080.stdout:client4771 2024-05-08T21:10:45.521 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T21:10:45.521 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T21:10:45.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:10:45.587 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-08T21:10:45.662 INFO:teuthology.orchestra.run.smithi080.stdout:client4771 2024-05-08T21:10:45.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:10:45.663 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-08T21:10:45.738 INFO:teuthology.orchestra.run.smithi080.stdout:client4771 2024-05-08T21:10:45.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:10:45.739 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/44d31c1e-aad3-47ca-a4fa-85a63d4a60aa.client4771/status') 2024-05-08T21:10:45.821 INFO:teuthology.orchestra.run.smithi080.stdout:instance: client.4771 (3)172.21.15.80:0/4171181205 2024-05-08T21:10:45.822 INFO:teuthology.orchestra.run.smithi080.stdout:blocklisted: false 2024-05-08T21:10:45.823 INFO:teuthology.orchestra.run.smithi080.stderr:0+1 records in 2024-05-08T21:10:45.823 INFO:teuthology.orchestra.run.smithi080.stderr:0+1 records out 2024-05-08T21:10:45.823 INFO:teuthology.orchestra.run.smithi080.stderr:70 bytes copied, 3.5769e-05 s, 2.0 MB/s 2024-05-08T21:10:45.824 INFO:teuthology.run_tasks:Running task mds_thrash... 2024-05-08T21:10:45.847 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T21:10:45.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:45.982+0000 7feeb6e04700 1 Processor -- start 2024-05-08T21:10:45.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:45.982+0000 7feeb6e04700 1 -- start start 2024-05-08T21:10:45.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:45.983+0000 7feeb6e04700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feeb01541a0 0x7feeb015a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:45.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:45.983+0000 7feeb6e04700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7feeb00c9150 0x7feeb00c95b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:45.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:45.983+0000 7feeb6e04700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7feeb0072600 0x7feeb0072a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:45.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:45.983+0000 7feeb6e04700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeb006c5a0 con 0x7feeb0072600 2024-05-08T21:10:45.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:45.983+0000 7feeb6e04700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeb006ce60 con 0x7feeb00c9150 2024-05-08T21:10:45.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:45.983+0000 7feeb6e04700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb00c9af0 con 0x7feeb01541a0 2024-05-08T21:10:45.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:45.983+0000 7feeb53a1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7feeb0072600 0x7feeb0072a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:45.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:45.983+0000 7feeb53a1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7feeb0072600 0x7feeb0072a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34644/0 (socket says 172.21.15.80:34644) 2024-05-08T21:10:45.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:45.983+0000 7feeb53a1700 1 -- 172.21.15.80:0/4255938258 learned_addr learned my addr 172.21.15.80:0/4255938258 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:45.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:45.983+0000 7feeaffff700 1 --2- 172.21.15.80:0/4255938258 >> v2:172.21.15.106:3300/0 conn(0x7feeb00c9150 0x7feeb00c95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:45.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:45.983+0000 7feeb4ba0700 1 --2- 172.21.15.80:0/4255938258 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feeb01541a0 0x7feeb015a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:45.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:45.983+0000 7feeb53a1700 1 -- 172.21.15.80:0/4255938258 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feeb01541a0 msgr2=0x7feeb015a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:45.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:45.983+0000 7feeb53a1700 1 --2- 172.21.15.80:0/4255938258 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feeb01541a0 0x7feeb015a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:45.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:45.983+0000 7feeb53a1700 1 -- 172.21.15.80:0/4255938258 >> v2:172.21.15.106:3300/0 conn(0x7feeb00c9150 msgr2=0x7feeb00c95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:45.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:45.983+0000 7feeb53a1700 1 --2- 172.21.15.80:0/4255938258 >> v2:172.21.15.106:3300/0 conn(0x7feeb00c9150 0x7feeb00c95b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:45.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:45.983+0000 7feeb53a1700 1 -- 172.21.15.80:0/4255938258 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb00c8cc0 con 0x7feeb0072600 2024-05-08T21:10:45.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:45.984+0000 7feeb53a1700 1 --2- 172.21.15.80:0/4255938258 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feeb0072600 0x7feeb0072a70 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7feeb00c9d60 tx=0x7feea0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0bf54a77fa581f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:45.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:45.984+0000 7feeaf7fe700 1 -- 172.21.15.80:0/4255938258 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea000b860 con 0x7feeb0072600 2024-05-08T21:10:45.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:45.984+0000 7feeaf7fe700 1 -- 172.21.15.80:0/4255938258 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea000b9c0 con 0x7feeb0072600 2024-05-08T21:10:45.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:45.984+0000 7feeaf7fe700 1 -- 172.21.15.80:0/4255938258 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea000bd50 con 0x7feeb0072600 2024-05-08T21:10:45.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:45.984+0000 7feeb6e04700 1 -- 172.21.15.80:0/4255938258 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feeb0072600 msgr2=0x7feeb0072a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:45.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:45.984+0000 7feeb6e04700 1 --2- 172.21.15.80:0/4255938258 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feeb0072600 0x7feeb0072a70 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7feeb00c9d60 tx=0x7feea0009c00 comp rx=0 tx=0).stop 2024-05-08T21:10:45.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:45.984+0000 7feeb6e04700 1 -- 172.21.15.80:0/4255938258 shutdown_connections 2024-05-08T21:10:45.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:45.984+0000 7feeb6e04700 1 --2- 172.21.15.80:0/4255938258 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feeb0072600 0x7feeb0072a70 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:45.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:45.984+0000 7feeb6e04700 1 --2- 172.21.15.80:0/4255938258 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feeb01541a0 0x7feeb015a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:45.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:45.984+0000 7feeb6e04700 1 --2- 172.21.15.80:0/4255938258 >> v2:172.21.15.106:3300/0 conn(0x7feeb00c9150 0x7feeb00c95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:45.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:45.984+0000 7feeb6e04700 1 -- 172.21.15.80:0/4255938258 >> 172.21.15.80:0/4255938258 conn(0x7feeb006ef80 msgr2=0x7feeb006f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:45.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:45.984+0000 7feeb6e04700 1 -- 172.21.15.80:0/4255938258 shutdown_connections 2024-05-08T21:10:45.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:45.984+0000 7feeb6e04700 1 -- 172.21.15.80:0/4255938258 wait complete. 2024-05-08T21:10:45.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:45.985+0000 7feeb6e04700 1 Processor -- start 2024-05-08T21:10:45.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:45.985+0000 7feeb6e04700 1 -- start start 2024-05-08T21:10:45.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:45.986+0000 7feeb6e04700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feeb0072600 0x7feeb00cd030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:45.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:45.986+0000 7feeb6e04700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feeb00c9150 0x7feeb0150c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:45.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:45.986+0000 7feeb6e04700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feeb01541a0 0x7feeb01f3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:45.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:45.986+0000 7feeb6e04700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb01f2fa0 con 0x7feeb0072600 2024-05-08T21:10:45.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:45.986+0000 7feeb6e04700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb0144e40 con 0x7feeb00c9150 2024-05-08T21:10:45.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:45.986+0000 7feeb6e04700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb0145100 con 0x7feeb01541a0 2024-05-08T21:10:45.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:45.986+0000 7feeb4ba0700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feeb0072600 0x7feeb00cd030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:45.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:45.986+0000 7feeb4ba0700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feeb0072600 0x7feeb00cd030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34652/0 (socket says 172.21.15.80:34652) 2024-05-08T21:10:45.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:45.986+0000 7feeb4ba0700 1 -- 172.21.15.80:0/1263951525 learned_addr learned my addr 172.21.15.80:0/1263951525 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:45.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:45.987+0000 7feeb53a1700 1 --2- 172.21.15.80:0/1263951525 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feeb01541a0 0x7feeb01f3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:45.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:45.987+0000 7feeaffff700 1 --2- 172.21.15.80:0/1263951525 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feeb00c9150 0x7feeb0150c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:45.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:45.987+0000 7feeb4ba0700 1 -- 172.21.15.80:0/1263951525 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feeb01541a0 msgr2=0x7feeb01f3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:45.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:45.987+0000 7feeb4ba0700 1 --2- 172.21.15.80:0/1263951525 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feeb01541a0 0x7feeb01f3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:45.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:45.987+0000 7feeb4ba0700 1 -- 172.21.15.80:0/1263951525 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feeb00c9150 msgr2=0x7feeb0150c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:45.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:45.987+0000 7feeb4ba0700 1 --2- 172.21.15.80:0/1263951525 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feeb00c9150 0x7feeb0150c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:45.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:45.987+0000 7feeb4ba0700 1 -- 172.21.15.80:0/1263951525 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea0009550 con 0x7feeb0072600 2024-05-08T21:10:45.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:45.987+0000 7feeb4ba0700 1 --2- 172.21.15.80:0/1263951525 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feeb0072600 0x7feeb00cd030 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7feea8007ef0 tx=0x7feea800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:45.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:45.987+0000 7feead7fa700 1 -- 172.21.15.80:0/1263951525 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea800edf0 con 0x7feeb0072600 2024-05-08T21:10:45.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:45.987+0000 7feead7fa700 1 -- 172.21.15.80:0/1263951525 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea8014420 con 0x7feeb0072600 2024-05-08T21:10:45.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:45.987+0000 7feeb6e04700 1 -- 172.21.15.80:0/1263951525 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeb01453e0 con 0x7feeb0072600 2024-05-08T21:10:45.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:45.987+0000 7feead7fa700 1 -- 172.21.15.80:0/1263951525 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea80147d0 con 0x7feeb0072600 2024-05-08T21:10:45.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:45.987+0000 7feeb6e04700 1 -- 172.21.15.80:0/1263951525 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeb01459a0 con 0x7feeb0072600 2024-05-08T21:10:45.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:45.988+0000 7feeb6e04700 1 -- 172.21.15.80:0/1263951525 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeb004ec60 con 0x7feeb0072600 2024-05-08T21:10:45.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:45.988+0000 7feead7fa700 1 -- 172.21.15.80:0/1263951525 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7feea8014930 con 0x7feeb0072600 2024-05-08T21:10:45.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:45.989+0000 7feead7fa700 1 --2- 172.21.15.80:0/1263951525 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fee9c06ac90 0x7fee9c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:45.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:45.989+0000 7feead7fa700 1 -- 172.21.15.80:0/1263951525 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7feea8089de0 con 0x7feeb0072600 2024-05-08T21:10:45.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:45.989+0000 7feeaffff700 1 --2- 172.21.15.80:0/1263951525 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fee9c06ac90 0x7fee9c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:45.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:45.989+0000 7feeaffff700 1 --2- 172.21.15.80:0/1263951525 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fee9c06ac90 0x7fee9c06d150 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7feeb00c8b60 tx=0x7feea4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:45.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:45.993+0000 7feead7fa700 1 -- 172.21.15.80:0/1263951525 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7feea8054c40 con 0x7feeb0072600 2024-05-08T21:10:46.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.191+0000 7feeb6e04700 1 -- 172.21.15.80:0/1263951525 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feeb00718a0 con 0x7feeb0072600 2024-05-08T21:10:46.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.193+0000 7feead7fa700 1 -- 172.21.15.80:0/1263951525 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+17878 (secure 0 0 0) 0x7feea8058260 con 0x7feeb0072600 2024-05-08T21:10:46.195 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:10:46.196 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":26,"fsid":"44d31c1e-aad3-47ca-a4fa-85a63d4a60aa","created":"2024-05-08T21:09:46.467038+0000","modified":"2024-05-08T21:10:08.163735+0000","last_up_change":"2024-05-08T21:09:57.284675+0000","last_in_change":"2024-05-08T21:09:49.125444+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T21:09:58.238951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T21:10:02.177476+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T21:10:02.685535+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-08T21:10:05.753779+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c3f9d93e-ed6d-4a0c-b5c0-0e8d44c65fdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":47011},{"type":"v1","addr":"172.21.15.80:6817","nonce":47011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":47011},{"type":"v1","addr":"172.21.15.80:6819","nonce":47011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":47011},{"type":"v1","addr":"172.21.15.80:6823","nonce":47011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":47011},{"type":"v1","addr":"172.21.15.80:6821","nonce":47011}]},"public_addr":"172.21.15.80:6817/47011","cluster_addr":"172.21.15.80:6819/47011","heartbeat_back_addr":"172.21.15.80:6823/47011","heartbeat_front_addr":"172.21.15.80:6821/47011","state":["exists","up"]},{"osd":1,"uuid":"4ce2b4d6-6c40-43aa-8dd1-743fef8915df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":47010},{"type":"v1","addr":"172.21.15.80:6809","nonce":47010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":47010},{"type":"v1","addr":"172.21.15.80:6811","nonce":47010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":47010},{"type":"v1","addr":"172.21.15.80:6815","nonce":47010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":47010},{"type":"v1","addr":"172.21.15.80:6813","nonce":47010}]},"public_addr":"172.21.15.80:6809/47010","cluster_addr":"172.21.15.80:6811/47010","heartbeat_back_addr":"172.21.15.80:6815/47010","heartbeat_front_addr":"172.21.15.80:6813/47010","state":["exists","up"]},{"osd":2,"uuid":"e30cc3bc-6461-4fac-960a-de00c9488d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":47009},{"type":"v1","addr":"172.21.15.80:6801","nonce":47009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":47009},{"type":"v1","addr":"172.21.15.80:6803","nonce":47009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":47009},{"type":"v1","addr":"172.21.15.80:6807","nonce":47009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":47009},{"type":"v1","addr":"172.21.15.80:6805","nonce":47009}]},"public_addr":"172.21.15.80:6801/47009","cluster_addr":"172.21.15.80:6803/47009","heartbeat_back_addr":"172.21.15.80:6807/47009","heartbeat_front_addr":"172.21.15.80:6805/47009","state":["exists","up"]},{"osd":3,"uuid":"a415c099-9ea6-40be-98ed-f2932f98dfd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":47012},{"type":"v1","addr":"172.21.15.80:6825","nonce":47012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":47012},{"type":"v1","addr":"172.21.15.80:6827","nonce":47012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":47012},{"type":"v1","addr":"172.21.15.80:6831","nonce":47012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":47012},{"type":"v1","addr":"172.21.15.80:6829","nonce":47012}]},"public_addr":"172.21.15.80:6825/47012","cluster_addr":"172.21.15.80:6827/47012","heartbeat_back_addr":"172.21.15.80:6831/47012","heartbeat_front_addr":"172.21.15.80:6829/47012","state":["exists","up"]},{"osd":4,"uuid":"5ae1d51f-0918-4571-b79b-154308d46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6823","nonce":47114},{"type":"v1","addr":"172.21.15.106:6825","nonce":47114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":47114},{"type":"v1","addr":"172.21.15.106:6827","nonce":47114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":47114},{"type":"v1","addr":"172.21.15.106:6831","nonce":47114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":47114},{"type":"v1","addr":"172.21.15.106:6829","nonce":47114}]},"public_addr":"172.21.15.106:6825/47114","cluster_addr":"172.21.15.106:6827/47114","heartbeat_back_addr":"172.21.15.106:6831/47114","heartbeat_front_addr":"172.21.15.106:6829/47114","state":["exists","up"]},{"osd":5,"uuid":"a19ac74e-4282-4428-b167-26ba6b92f732","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6807","nonce":47111},{"type":"v1","addr":"172.21.15.106:6809","nonce":47111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":47111},{"type":"v1","addr":"172.21.15.106:6811","nonce":47111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":47111},{"type":"v1","addr":"172.21.15.106:6815","nonce":47111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":47111},{"type":"v1","addr":"172.21.15.106:6813","nonce":47111}]},"public_addr":"172.21.15.106:6809/47111","cluster_addr":"172.21.15.106:6811/47111","heartbeat_back_addr":"172.21.15.106:6815/47111","heartbeat_front_addr":"172.21.15.106:6813/47111","state":["exists","up"]},{"osd":6,"uuid":"bfe72edd-7acc-4805-807d-2000e76f2feb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":47112},{"type":"v1","addr":"172.21.15.106:6817","nonce":47112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":47112},{"type":"v1","addr":"172.21.15.106:6819","nonce":47112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":47112},{"type":"v1","addr":"172.21.15.106:6824","nonce":47112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":47112},{"type":"v1","addr":"172.21.15.106:6821","nonce":47112}]},"public_addr":"172.21.15.106:6817/47112","cluster_addr":"172.21.15.106:6819/47112","heartbeat_back_addr":"172.21.15.106:6824/47112","heartbeat_front_addr":"172.21.15.106:6821/47112","state":["exists","up"]},{"osd":7,"uuid":"99897f22-ed17-4c7c-9088-cc0c4a51f786","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":47113},{"type":"v1","addr":"172.21.15.106:6801","nonce":47113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":47113},{"type":"v1","addr":"172.21.15.106:6803","nonce":47113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":47113},{"type":"v1","addr":"172.21.15.106:6808","nonce":47113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":47113},{"type":"v1","addr":"172.21.15.106:6805","nonce":47113}]},"public_addr":"172.21.15.106:6801/47113","cluster_addr":"172.21.15.106:6803/47113","heartbeat_back_addr":"172.21.15.106:6808/47113","heartbeat_front_addr":"172.21.15.106:6805/47113","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.232670+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.277753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.050087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.349312+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.344080+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.348781+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.352539+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.275013+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T21:10:46.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.194+0000 7feeb6e04700 1 -- 172.21.15.80:0/1263951525 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fee9c06ac90 msgr2=0x7fee9c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:46.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.194+0000 7feeb6e04700 1 --2- 172.21.15.80:0/1263951525 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fee9c06ac90 0x7fee9c06d150 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7feeb00c8b60 tx=0x7feea4008040 comp rx=0 tx=0).stop 2024-05-08T21:10:46.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.194+0000 7feeb6e04700 1 -- 172.21.15.80:0/1263951525 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feeb0072600 msgr2=0x7feeb00cd030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:46.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.194+0000 7feeb6e04700 1 --2- 172.21.15.80:0/1263951525 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feeb0072600 0x7feeb00cd030 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7feea8007ef0 tx=0x7feea800e3c0 comp rx=0 tx=0).stop 2024-05-08T21:10:46.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.194+0000 7feeb6e04700 1 -- 172.21.15.80:0/1263951525 shutdown_connections 2024-05-08T21:10:46.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.194+0000 7feeb6e04700 1 --2- 172.21.15.80:0/1263951525 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fee9c06ac90 0x7fee9c06d150 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:46.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.194+0000 7feeb6e04700 1 --2- 172.21.15.80:0/1263951525 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feeb0072600 0x7feeb00cd030 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:46.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.194+0000 7feeb6e04700 1 --2- 172.21.15.80:0/1263951525 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feeb01541a0 0x7feeb01f3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:46.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.194+0000 7feeb6e04700 1 --2- 172.21.15.80:0/1263951525 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feeb00c9150 0x7feeb0150c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:46.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.194+0000 7feeb6e04700 1 -- 172.21.15.80:0/1263951525 >> 172.21.15.80:0/1263951525 conn(0x7feeb006ef80 msgr2=0x7feeb0153120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:46.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.194+0000 7feeb6e04700 1 -- 172.21.15.80:0/1263951525 shutdown_connections 2024-05-08T21:10:46.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.194+0000 7feeb6e04700 1 -- 172.21.15.80:0/1263951525 wait complete. 2024-05-08T21:10:46.210 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T21:09:58.238951+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T21:10:02.177476+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T21:10:02.685535+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-08T21:10:05.753779+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-08T21:10:46.210 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T21:10:46.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.333+0000 7f6ffee08700 1 Processor -- start 2024-05-08T21:10:46.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.333+0000 7f6ffee08700 1 -- start start 2024-05-08T21:10:46.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.334+0000 7f6ffee08700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6ff80c8380 0x7f6ff8071be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:46.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.334+0000 7f6ffee08700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ff80c9150 con 0x7f6ff80ccc00 2024-05-08T21:10:46.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.334+0000 7f6ffee08700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ff80c99f0 con 0x7f6ff80ccfe0 2024-05-08T21:10:46.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.334+0000 7f6ffee08700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ff81579c0 con 0x7f6ff80c8380 2024-05-08T21:10:46.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.334+0000 7f6ffcba4700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f6ff80ccc00 0x7f6ff8156ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:53166/0 (socket says 172.21.15.80:53166) 2024-05-08T21:10:46.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.334+0000 7f6ffcba4700 1 -- 172.21.15.80:0/2380602100 learned_addr learned my addr 172.21.15.80:0/2380602100 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:10:46.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.334+0000 7f6ffd3a5700 1 --2- 172.21.15.80:0/2380602100 >> v2:172.21.15.106:3300/0 conn(0x7f6ff80c8380 0x7f6ff8071be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:46.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.335+0000 7f6ff77fe700 1 -- 172.21.15.80:0/2380602100 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3990315070 0 0) 0x7f6ff80c9150 con 0x7f6ff80ccc00 2024-05-08T21:10:46.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.335+0000 7f6ff77fe700 1 -- 172.21.15.80:0/2380602100 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fe80035b0 con 0x7f6ff80ccc00 2024-05-08T21:10:46.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.335+0000 7f6ff77fe700 1 -- 172.21.15.80:0/2380602100 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 168164121 0 0) 0x7f6fe80035b0 con 0x7f6ff80ccc00 2024-05-08T21:10:46.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.335+0000 7f6ffd3a5700 1 -- 172.21.15.80:0/2380602100 >> v1:172.21.15.106:6789/0 conn(0x7f6ff80ccfe0 legacy=0x7f6ff814d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:46.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.335+0000 7f6ffd3a5700 1 -- 172.21.15.80:0/2380602100 >> v1:172.21.15.80:6789/0 conn(0x7f6ff80ccc00 legacy=0x7f6ff8156ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:46.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.335+0000 7f6ffd3a5700 1 -- 172.21.15.80:0/2380602100 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ff8157ca0 con 0x7f6ff80c8380 2024-05-08T21:10:46.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.335+0000 7f6ffd3a5700 1 --2- 172.21.15.80:0/2380602100 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ff80c8380 0x7f6ff8071be0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6ff0009d90 tx=0x7f6ff000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61f4394449e80660 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:46.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.335+0000 7f6ff77fe700 1 -- 172.21.15.80:0/2380602100 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff000e070 con 0x7f6ff80c8380 2024-05-08T21:10:46.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.335+0000 7f6ff77fe700 1 -- 172.21.15.80:0/2380602100 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ff0003a20 con 0x7f6ff80c8380 2024-05-08T21:10:46.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.335+0000 7f6ff77fe700 1 -- 172.21.15.80:0/2380602100 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fec001670 con 0x7f6ff80c8380 2024-05-08T21:10:46.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.336+0000 7f6ffee08700 1 -- 172.21.15.80:0/2380602100 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ff80c8380 msgr2=0x7f6ff8071be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:46.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.336+0000 7f6ffee08700 1 --2- 172.21.15.80:0/2380602100 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ff80c8380 0x7f6ff8071be0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6ff0009d90 tx=0x7f6ff000b330 comp rx=0 tx=0).stop 2024-05-08T21:10:46.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.336+0000 7f6ffee08700 1 -- 172.21.15.80:0/2380602100 shutdown_connections 2024-05-08T21:10:46.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.336+0000 7f6ffee08700 1 --2- 172.21.15.80:0/2380602100 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ff80c8380 0x7f6ff8071be0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:46.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.336+0000 7f6ffee08700 1 -- 172.21.15.80:0/2380602100 >> 172.21.15.80:0/2380602100 conn(0x7f6ff806f140 msgr2=0x7f6ff806f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:46.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.336+0000 7f6ffee08700 1 -- 172.21.15.80:0/2380602100 shutdown_connections 2024-05-08T21:10:46.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.336+0000 7f6ffee08700 1 -- 172.21.15.80:0/2380602100 wait complete. 2024-05-08T21:10:46.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.337+0000 7f6ffee08700 1 Processor -- start 2024-05-08T21:10:46.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.337+0000 7f6ffee08700 1 -- start start 2024-05-08T21:10:46.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.338+0000 7f6ffee08700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ff80c8380 0x7f6ff806c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:46.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.338+0000 7f6ffee08700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ff80ccc00 0x7f6ff814b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:46.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.338+0000 7f6ffee08700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6ff80ccfe0 0x7f6ff814bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:46.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.338+0000 7f6ffee08700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff8143fa0 con 0x7f6ff80c8380 2024-05-08T21:10:46.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.338+0000 7f6ffee08700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff80cc140 con 0x7f6ff80ccc00 2024-05-08T21:10:46.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.338+0000 7f6ffee08700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff8156600 con 0x7f6ff80ccfe0 2024-05-08T21:10:46.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.338+0000 7f6ffcba4700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ff80c8380 0x7f6ff806c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:46.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.338+0000 7f6ffcba4700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ff80c8380 0x7f6ff806c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34666/0 (socket says 172.21.15.80:34666) 2024-05-08T21:10:46.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.338+0000 7f6ffcba4700 1 -- 172.21.15.80:0/547695907 learned_addr learned my addr 172.21.15.80:0/547695907 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:46.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.338+0000 7f6ffcba4700 1 -- 172.21.15.80:0/547695907 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6ff80ccfe0 msgr2=0x7f6ff814bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:46.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.338+0000 7f6ffcba4700 1 --2- 172.21.15.80:0/547695907 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6ff80ccfe0 0x7f6ff814bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:46.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.338+0000 7f6ffcba4700 1 -- 172.21.15.80:0/547695907 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ff80ccc00 msgr2=0x7f6ff814b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:46.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.338+0000 7f6ff7fff700 1 --2- 172.21.15.80:0/547695907 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ff80ccc00 0x7f6ff814b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:46.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.338+0000 7f6ffcba4700 1 --2- 172.21.15.80:0/547695907 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ff80ccc00 0x7f6ff814b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:46.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.338+0000 7f6ffcba4700 1 -- 172.21.15.80:0/547695907 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ff0009a70 con 0x7f6ff80c8380 2024-05-08T21:10:46.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.338+0000 7f6ffcba4700 1 --2- 172.21.15.80:0/547695907 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ff80c8380 0x7f6ff806c3f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6fec00c7a0 tx=0x7f6fec00cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:46.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.338+0000 7f6ff57fa700 1 -- 172.21.15.80:0/547695907 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fec007560 con 0x7f6ff80c8380 2024-05-08T21:10:46.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.338+0000 7f6ff57fa700 1 -- 172.21.15.80:0/547695907 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fec0076c0 con 0x7f6ff80c8380 2024-05-08T21:10:46.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.338+0000 7f6ffee08700 1 -- 172.21.15.80:0/547695907 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ff80c2b30 con 0x7f6ff80c8380 2024-05-08T21:10:46.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.338+0000 7f6ff57fa700 1 -- 172.21.15.80:0/547695907 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fec004a90 con 0x7f6ff80c8380 2024-05-08T21:10:46.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.338+0000 7f6ffee08700 1 -- 172.21.15.80:0/547695907 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ff80cb810 con 0x7f6ff80c8380 2024-05-08T21:10:46.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.339+0000 7f6ffee08700 1 -- 172.21.15.80:0/547695907 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ff804ec60 con 0x7f6ff80c8380 2024-05-08T21:10:46.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.340+0000 7f6ff57fa700 1 -- 172.21.15.80:0/547695907 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6fec004bf0 con 0x7f6ff80c8380 2024-05-08T21:10:46.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.340+0000 7f6ff57fa700 1 --2- 172.21.15.80:0/547695907 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f6fdc06ac90 0x7f6fdc06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:46.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.340+0000 7f6ff57fa700 1 -- 172.21.15.80:0/547695907 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6fec089410 con 0x7f6ff80c8380 2024-05-08T21:10:46.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.340+0000 7f6ff7fff700 1 --2- 172.21.15.80:0/547695907 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f6fdc06ac90 0x7f6fdc06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:46.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.341+0000 7f6ff7fff700 1 --2- 172.21.15.80:0/547695907 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f6fdc06ac90 0x7f6fdc06d150 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8153c60 tx=0x7f6fe4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:46.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.346+0000 7f6ff57fa700 1 -- 172.21.15.80:0/547695907 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f6fec054300 con 0x7f6ff80c8380 2024-05-08T21:10:46.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.542+0000 7f6ffee08700 1 -- 172.21.15.80:0/547695907 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6ff80c3a60 con 0x7f6ff80c8380 2024-05-08T21:10:46.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.542+0000 7f6ff57fa700 1 -- 172.21.15.80:0/547695907 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6fec057920 con 0x7f6ff80c8380 2024-05-08T21:10:46.545 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-05-08T21:10:46.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.544+0000 7f6ffee08700 1 -- 172.21.15.80:0/547695907 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f6fdc06ac90 msgr2=0x7f6fdc06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:46.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.544+0000 7f6ffee08700 1 --2- 172.21.15.80:0/547695907 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f6fdc06ac90 0x7f6fdc06d150 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8153c60 tx=0x7f6fe4009040 comp rx=0 tx=0).stop 2024-05-08T21:10:46.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.544+0000 7f6ffee08700 1 -- 172.21.15.80:0/547695907 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ff80c8380 msgr2=0x7f6ff806c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:46.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.544+0000 7f6ffee08700 1 --2- 172.21.15.80:0/547695907 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ff80c8380 0x7f6ff806c3f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6fec00c7a0 tx=0x7f6fec00cb60 comp rx=0 tx=0).stop 2024-05-08T21:10:46.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.544+0000 7f6ffee08700 1 -- 172.21.15.80:0/547695907 shutdown_connections 2024-05-08T21:10:46.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.544+0000 7f6ffee08700 1 --2- 172.21.15.80:0/547695907 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f6fdc06ac90 0x7f6fdc06d150 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:46.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.544+0000 7f6ffee08700 1 --2- 172.21.15.80:0/547695907 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ff80c8380 0x7f6ff806c3f0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:46.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.544+0000 7f6ffee08700 1 --2- 172.21.15.80:0/547695907 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6ff80ccfe0 0x7f6ff814bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:46.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.544+0000 7f6ffee08700 1 --2- 172.21.15.80:0/547695907 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ff80ccc00 0x7f6ff814b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:46.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.544+0000 7f6ffee08700 1 -- 172.21.15.80:0/547695907 >> 172.21.15.80:0/547695907 conn(0x7f6ff806f140 msgr2=0x7f6ff8147c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:46.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.544+0000 7f6ffee08700 1 -- 172.21.15.80:0/547695907 shutdown_connections 2024-05-08T21:10:46.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.544+0000 7f6ffee08700 1 -- 172.21.15.80:0/547695907 wait complete. 2024-05-08T21:10:46.560 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T21:10:46.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.680+0000 7f6e7d896700 1 Processor -- start 2024-05-08T21:10:46.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.680+0000 7f6e7d896700 1 -- start start 2024-05-08T21:10:46.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.681+0000 7f6e7d896700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e78154580 0x7f6e7815abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:46.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.681+0000 7f6e7d896700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6e780cbe40 0x7f6e780c48c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:46.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.681+0000 7f6e7d896700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e780cad60 con 0x7f6e780c4e00 2024-05-08T21:10:46.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.681+0000 7f6e7d896700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e780b2c60 con 0x7f6e780cbe40 2024-05-08T21:10:46.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.681+0000 7f6e7d896700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7815d750 con 0x7f6e78154580 2024-05-08T21:10:46.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.681+0000 7f6e767fc700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6e780cbe40 0x7f6e780c48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:46.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.681+0000 7f6e767fc700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6e780cbe40 0x7f6e780c48c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34682/0 (socket says 172.21.15.80:34682) 2024-05-08T21:10:46.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.681+0000 7f6e767fc700 1 -- 172.21.15.80:0/805071275 learned_addr learned my addr 172.21.15.80:0/805071275 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:46.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.681+0000 7f6e777fe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f6e780c4e00 0x7f6e780cc3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:53176/0 (socket says 172.21.15.80:53176) 2024-05-08T21:10:46.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.681+0000 7f6e76ffd700 1 --2- 172.21.15.80:0/805071275 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e78154580 0x7f6e7815abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:46.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.681+0000 7f6e767fc700 1 -- 172.21.15.80:0/805071275 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e78154580 msgr2=0x7f6e7815abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:46.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.681+0000 7f6e767fc700 1 --2- 172.21.15.80:0/805071275 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e78154580 0x7f6e7815abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:46.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.681+0000 7f6e767fc700 1 -- 172.21.15.80:0/805071275 >> v1:172.21.15.80:6789/0 conn(0x7f6e780c4e00 legacy=0x7f6e780cc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:46.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.681+0000 7f6e767fc700 1 -- 172.21.15.80:0/805071275 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e7815d930 con 0x7f6e780cbe40 2024-05-08T21:10:46.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.681+0000 7f6e75ffb700 1 -- 172.21.15.80:0/805071275 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3394954532 0 0) 0x7f6e780cad60 con 0x7f6e780c4e00 2024-05-08T21:10:46.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.682+0000 7f6e767fc700 1 --2- 172.21.15.80:0/805071275 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e780cbe40 0x7f6e780c48c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6e680098f0 tx=0x7f6e68009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=523abe3fd4571972 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:46.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.682+0000 7f6e75ffb700 1 -- 172.21.15.80:0/805071275 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6800b8a0 con 0x7f6e780cbe40 2024-05-08T21:10:46.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.682+0000 7f6e75ffb700 1 -- 172.21.15.80:0/805071275 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e6800ba00 con 0x7f6e780cbe40 2024-05-08T21:10:46.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.682+0000 7f6e75ffb700 1 -- 172.21.15.80:0/805071275 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6800bd90 con 0x7f6e780cbe40 2024-05-08T21:10:46.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.682+0000 7f6e7d896700 1 -- 172.21.15.80:0/805071275 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e780cbe40 msgr2=0x7f6e780c48c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:46.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.682+0000 7f6e7d896700 1 --2- 172.21.15.80:0/805071275 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e780cbe40 0x7f6e780c48c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6e680098f0 tx=0x7f6e68009c00 comp rx=0 tx=0).stop 2024-05-08T21:10:46.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.682+0000 7f6e7d896700 1 -- 172.21.15.80:0/805071275 shutdown_connections 2024-05-08T21:10:46.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.682+0000 7f6e7d896700 1 --2- 172.21.15.80:0/805071275 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e78154580 0x7f6e7815abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:46.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.682+0000 7f6e7d896700 1 --2- 172.21.15.80:0/805071275 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e780cbe40 0x7f6e780c48c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:46.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.682+0000 7f6e7d896700 1 -- 172.21.15.80:0/805071275 >> 172.21.15.80:0/805071275 conn(0x7f6e7806c6a0 msgr2=0x7f6e7806cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:46.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.682+0000 7f6e7d896700 1 -- 172.21.15.80:0/805071275 shutdown_connections 2024-05-08T21:10:46.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.682+0000 7f6e7d896700 1 -- 172.21.15.80:0/805071275 wait complete. 2024-05-08T21:10:46.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.683+0000 7f6e7d896700 1 Processor -- start 2024-05-08T21:10:46.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.684+0000 7f6e7d896700 1 -- start start 2024-05-08T21:10:46.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.684+0000 7f6e7d896700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6e780c4e00 0x7f6e780cf960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:46.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.684+0000 7f6e7d896700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e780cbe40 0x7f6e781f0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:46.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.684+0000 7f6e7d896700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e78154580 0x7f6e781f1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:46.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.684+0000 7f6e7d896700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e780cf560 con 0x7f6e78154580 2024-05-08T21:10:46.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.684+0000 7f6e7d896700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e780ce280 con 0x7f6e780c4e00 2024-05-08T21:10:46.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.684+0000 7f6e7d896700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e780ce520 con 0x7f6e780cbe40 2024-05-08T21:10:46.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.684+0000 7f6e777fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e78154580 0x7f6e781f1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:46.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.684+0000 7f6e777fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e78154580 0x7f6e781f1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34690/0 (socket says 172.21.15.80:34690) 2024-05-08T21:10:46.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.684+0000 7f6e777fe700 1 -- 172.21.15.80:0/1294308293 learned_addr learned my addr 172.21.15.80:0/1294308293 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:46.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.685+0000 7f6e767fc700 1 --2- 172.21.15.80:0/1294308293 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e780cbe40 0x7f6e781f0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:46.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.685+0000 7f6e76ffd700 1 --2- 172.21.15.80:0/1294308293 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6e780c4e00 0x7f6e780cf960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:46.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.685+0000 7f6e777fe700 1 -- 172.21.15.80:0/1294308293 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e780cbe40 msgr2=0x7f6e781f0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:46.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.685+0000 7f6e777fe700 1 --2- 172.21.15.80:0/1294308293 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e780cbe40 0x7f6e781f0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:46.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.685+0000 7f6e777fe700 1 -- 172.21.15.80:0/1294308293 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6e780c4e00 msgr2=0x7f6e780cf960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:46.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.685+0000 7f6e777fe700 1 --2- 172.21.15.80:0/1294308293 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6e780c4e00 0x7f6e780cf960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:46.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.685+0000 7f6e777fe700 1 -- 172.21.15.80:0/1294308293 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e68009550 con 0x7f6e78154580 2024-05-08T21:10:46.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.685+0000 7f6e76ffd700 1 --2- 172.21.15.80:0/1294308293 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6e780c4e00 0x7f6e780cf960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:10:46.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.685+0000 7f6e777fe700 1 --2- 172.21.15.80:0/1294308293 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e78154580 0x7f6e781f1340 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6e70002230 tx=0x7f6e7000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:46.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.685+0000 7f6e5ffff700 1 -- 172.21.15.80:0/1294308293 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7000ac20 con 0x7f6e78154580 2024-05-08T21:10:46.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.685+0000 7f6e5ffff700 1 -- 172.21.15.80:0/1294308293 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e7000ada0 con 0x7f6e78154580 2024-05-08T21:10:46.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.685+0000 7f6e7d896700 1 -- 172.21.15.80:0/1294308293 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e780ce800 con 0x7f6e78154580 2024-05-08T21:10:46.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.685+0000 7f6e5ffff700 1 -- 172.21.15.80:0/1294308293 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e70007310 con 0x7f6e78154580 2024-05-08T21:10:46.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.685+0000 7f6e7d896700 1 -- 172.21.15.80:0/1294308293 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e780cedc0 con 0x7f6e78154580 2024-05-08T21:10:46.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.686+0000 7f6e7d896700 1 -- 172.21.15.80:0/1294308293 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e781f0c50 con 0x7f6e78154580 2024-05-08T21:10:46.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.686+0000 7f6e5ffff700 1 -- 172.21.15.80:0/1294308293 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6e70007470 con 0x7f6e78154580 2024-05-08T21:10:46.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.687+0000 7f6e5ffff700 1 --2- 172.21.15.80:0/1294308293 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f6e6406acc0 0x7f6e6406d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:46.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.687+0000 7f6e5ffff700 1 -- 172.21.15.80:0/1294308293 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6e700894e0 con 0x7f6e78154580 2024-05-08T21:10:46.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.687+0000 7f6e76ffd700 1 --2- 172.21.15.80:0/1294308293 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f6e6406acc0 0x7f6e6406d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:46.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.687+0000 7f6e76ffd700 1 --2- 172.21.15.80:0/1294308293 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f6e6406acc0 0x7f6e6406d180 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c006fd0 tx=0x7f6e6c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:46.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.692+0000 7f6e5ffff700 1 -- 172.21.15.80:0/1294308293 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f6e700543d0 con 0x7f6e78154580 2024-05-08T21:10:46.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.888+0000 7f6e7d896700 1 -- 172.21.15.80:0/1294308293 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6e7804ec60 con 0x7f6e78154580 2024-05-08T21:10:46.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.889+0000 7f6e5ffff700 1 -- 172.21.15.80:0/1294308293 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6e700579f0 con 0x7f6e78154580 2024-05-08T21:10:46.891 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-05-08T21:10:46.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.891+0000 7f6e7d896700 1 -- 172.21.15.80:0/1294308293 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f6e6406acc0 msgr2=0x7f6e6406d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:46.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.891+0000 7f6e7d896700 1 --2- 172.21.15.80:0/1294308293 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f6e6406acc0 0x7f6e6406d180 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c006fd0 tx=0x7f6e6c008040 comp rx=0 tx=0).stop 2024-05-08T21:10:46.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.891+0000 7f6e7d896700 1 -- 172.21.15.80:0/1294308293 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e78154580 msgr2=0x7f6e781f1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:46.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.891+0000 7f6e7d896700 1 --2- 172.21.15.80:0/1294308293 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e78154580 0x7f6e781f1340 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6e70002230 tx=0x7f6e7000a060 comp rx=0 tx=0).stop 2024-05-08T21:10:46.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.891+0000 7f6e7d896700 1 -- 172.21.15.80:0/1294308293 shutdown_connections 2024-05-08T21:10:46.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.891+0000 7f6e7d896700 1 --2- 172.21.15.80:0/1294308293 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f6e6406acc0 0x7f6e6406d180 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:46.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.891+0000 7f6e7d896700 1 --2- 172.21.15.80:0/1294308293 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e78154580 0x7f6e781f1340 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:46.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.891+0000 7f6e7d896700 1 --2- 172.21.15.80:0/1294308293 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6e780c4e00 0x7f6e780cf960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:46.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.891+0000 7f6e7d896700 1 --2- 172.21.15.80:0/1294308293 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e780cbe40 0x7f6e781f0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:46.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.891+0000 7f6e7d896700 1 -- 172.21.15.80:0/1294308293 >> 172.21.15.80:0/1294308293 conn(0x7f6e7806c6a0 msgr2=0x7f6e781509b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:46.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.891+0000 7f6e7d896700 1 -- 172.21.15.80:0/1294308293 shutdown_connections 2024-05-08T21:10:46.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:46.891+0000 7f6e7d896700 1 -- 172.21.15.80:0/1294308293 wait complete. 2024-05-08T21:10:46.905 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T21:10:47.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.028+0000 7eff4d1e3700 1 Processor -- start 2024-05-08T21:10:47.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.028+0000 7eff4d1e3700 1 -- start start 2024-05-08T21:10:47.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.028+0000 7eff4d1e3700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7eff481544f0 0x7eff480c8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:47.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.028+0000 7eff4d1e3700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7eff480c6db0 0x7eff4815a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:47.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.028+0000 7eff4d1e3700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff480c56d0 con 0x7eff480c5890 2024-05-08T21:10:47.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.028+0000 7eff4d1e3700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff480c4ae0 con 0x7eff481544f0 2024-05-08T21:10:47.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.028+0000 7eff4d1e3700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff480c6920 con 0x7eff480c6db0 2024-05-08T21:10:47.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.028+0000 7eff4759e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7eff480c5890 0x7eff4815d7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:53184/0 (socket says 172.21.15.80:53184) 2024-05-08T21:10:47.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.029+0000 7eff4759e700 1 -- 172.21.15.80:0/4062278007 learned_addr learned my addr 172.21.15.80:0/4062278007 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:10:47.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.029+0000 7eff4659c700 1 --2- 172.21.15.80:0/4062278007 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7eff480c6db0 0x7eff4815a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:47.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.029+0000 7eff46d9d700 1 --2- 172.21.15.80:0/4062278007 >> v2:172.21.15.106:3300/0 conn(0x7eff481544f0 0x7eff480c8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:47.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.029+0000 7eff45d9b700 1 -- 172.21.15.80:0/4062278007 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 45132219 0 0) 0x7eff40001490 con 0x7eff480c5890 2024-05-08T21:10:47.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.029+0000 7eff45d9b700 1 -- 172.21.15.80:0/4062278007 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff300035b0 con 0x7eff480c5890 2024-05-08T21:10:47.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.029+0000 7eff46d9d700 1 -- 172.21.15.80:0/4062278007 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7eff480c6db0 msgr2=0x7eff4815a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:47.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.029+0000 7eff46d9d700 1 --2- 172.21.15.80:0/4062278007 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7eff480c6db0 0x7eff4815a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:47.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.029+0000 7eff46d9d700 1 -- 172.21.15.80:0/4062278007 >> v1:172.21.15.80:6789/0 conn(0x7eff480c5890 legacy=0x7eff4815d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:47.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.029+0000 7eff45d9b700 1 -- 172.21.15.80:0/4062278007 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 748049586 0 0) 0x7eff300035b0 con 0x7eff480c5890 2024-05-08T21:10:47.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.029+0000 7eff46d9d700 1 -- 172.21.15.80:0/4062278007 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff480cb270 con 0x7eff481544f0 2024-05-08T21:10:47.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.029+0000 7eff4659c700 1 --2- 172.21.15.80:0/4062278007 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7eff480c6db0 0x7eff4815a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:10:47.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.029+0000 7eff46d9d700 1 --2- 172.21.15.80:0/4062278007 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7eff481544f0 0x7eff480c8240 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7eff38009840 tx=0x7eff38009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7c0c700439297ea server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:47.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.029+0000 7eff45d9b700 1 -- 172.21.15.80:0/4062278007 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff40001b80 con 0x7eff481544f0 2024-05-08T21:10:47.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.029+0000 7eff45d9b700 1 -- 172.21.15.80:0/4062278007 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff38004030 con 0x7eff481544f0 2024-05-08T21:10:47.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.029+0000 7eff45d9b700 1 -- 172.21.15.80:0/4062278007 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff380043c0 con 0x7eff481544f0 2024-05-08T21:10:47.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.030+0000 7eff4d1e3700 1 -- 172.21.15.80:0/4062278007 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7eff481544f0 msgr2=0x7eff480c8240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:47.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.030+0000 7eff4d1e3700 1 --2- 172.21.15.80:0/4062278007 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7eff481544f0 0x7eff480c8240 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7eff38009840 tx=0x7eff38009b50 comp rx=0 tx=0).stop 2024-05-08T21:10:47.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.030+0000 7eff4d1e3700 1 -- 172.21.15.80:0/4062278007 shutdown_connections 2024-05-08T21:10:47.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.030+0000 7eff4d1e3700 1 --2- 172.21.15.80:0/4062278007 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7eff481544f0 0x7eff480c8240 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:47.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.030+0000 7eff4d1e3700 1 --2- 172.21.15.80:0/4062278007 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7eff480c6db0 0x7eff4815a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:47.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.030+0000 7eff4d1e3700 1 -- 172.21.15.80:0/4062278007 >> 172.21.15.80:0/4062278007 conn(0x7eff480ca340 msgr2=0x7eff480ca750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:47.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.030+0000 7eff4d1e3700 1 -- 172.21.15.80:0/4062278007 shutdown_connections 2024-05-08T21:10:47.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.030+0000 7eff4d1e3700 1 -- 172.21.15.80:0/4062278007 wait complete. 2024-05-08T21:10:47.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.031+0000 7eff4d1e3700 1 Processor -- start 2024-05-08T21:10:47.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.031+0000 7eff4d1e3700 1 -- start start 2024-05-08T21:10:47.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.032+0000 7eff4d1e3700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff480c5890 0x7eff48148830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:47.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.032+0000 7eff4d1e3700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7eff480c6db0 0x7eff480c91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:47.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.032+0000 7eff4d1e3700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7eff481544f0 0x7eff48147900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:47.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.032+0000 7eff4d1e3700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff48146ec0 con 0x7eff480c5890 2024-05-08T21:10:47.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.032+0000 7eff4d1e3700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff48148d70 con 0x7eff480c6db0 2024-05-08T21:10:47.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.032+0000 7eff4d1e3700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff48145050 con 0x7eff481544f0 2024-05-08T21:10:47.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.032+0000 7eff46d9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff480c5890 0x7eff48148830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:47.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.032+0000 7eff46d9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff480c5890 0x7eff48148830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34692/0 (socket says 172.21.15.80:34692) 2024-05-08T21:10:47.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.032+0000 7eff46d9d700 1 -- 172.21.15.80:0/2272502585 learned_addr learned my addr 172.21.15.80:0/2272502585 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:47.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.032+0000 7eff4759e700 1 --2- 172.21.15.80:0/2272502585 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7eff481544f0 0x7eff48147900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:47.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.032+0000 7eff4659c700 1 --2- 172.21.15.80:0/2272502585 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7eff480c6db0 0x7eff480c91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:47.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.033+0000 7eff46d9d700 1 -- 172.21.15.80:0/2272502585 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7eff481544f0 msgr2=0x7eff48147900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:47.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.033+0000 7eff46d9d700 1 --2- 172.21.15.80:0/2272502585 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7eff481544f0 0x7eff48147900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:47.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.033+0000 7eff46d9d700 1 -- 172.21.15.80:0/2272502585 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7eff480c6db0 msgr2=0x7eff480c91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:47.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.033+0000 7eff46d9d700 1 --2- 172.21.15.80:0/2272502585 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7eff480c6db0 0x7eff480c91f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:47.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.033+0000 7eff46d9d700 1 -- 172.21.15.80:0/2272502585 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff3c0094a0 con 0x7eff480c5890 2024-05-08T21:10:47.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.033+0000 7eff4659c700 1 --2- 172.21.15.80:0/2272502585 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7eff480c6db0 0x7eff480c91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:10:47.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.033+0000 7eff46d9d700 1 --2- 172.21.15.80:0/2272502585 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff480c5890 0x7eff48148830 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7eff38000c00 tx=0x7eff38004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:47.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.033+0000 7eff2f7fe700 1 -- 172.21.15.80:0/2272502585 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff38003ad0 con 0x7eff480c5890 2024-05-08T21:10:47.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.033+0000 7eff2f7fe700 1 -- 172.21.15.80:0/2272502585 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff3801f070 con 0x7eff480c5890 2024-05-08T21:10:47.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.033+0000 7eff2f7fe700 1 -- 172.21.15.80:0/2272502585 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff38003e90 con 0x7eff480c5890 2024-05-08T21:10:47.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.033+0000 7eff4d1e3700 1 -- 172.21.15.80:0/2272502585 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff380094a0 con 0x7eff480c5890 2024-05-08T21:10:47.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.033+0000 7eff4d1e3700 1 -- 172.21.15.80:0/2272502585 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff48145610 con 0x7eff480c5890 2024-05-08T21:10:47.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.034+0000 7eff4d1e3700 1 -- 172.21.15.80:0/2272502585 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff480c7b10 con 0x7eff480c5890 2024-05-08T21:10:47.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.034+0000 7eff2f7fe700 1 -- 172.21.15.80:0/2272502585 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7eff38021030 con 0x7eff480c5890 2024-05-08T21:10:47.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.035+0000 7eff2f7fe700 1 --2- 172.21.15.80:0/2272502585 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7eff3406ac90 0x7eff3406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:47.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.035+0000 7eff2f7fe700 1 -- 172.21.15.80:0/2272502585 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7eff3808a930 con 0x7eff480c5890 2024-05-08T21:10:47.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.035+0000 7eff4659c700 1 --2- 172.21.15.80:0/2272502585 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7eff3406ac90 0x7eff3406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:47.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.035+0000 7eff4659c700 1 --2- 172.21.15.80:0/2272502585 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7eff3406ac90 0x7eff3406d150 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7eff4806f930 tx=0x7eff3c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:47.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.039+0000 7eff2f7fe700 1 -- 172.21.15.80:0/2272502585 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7eff380558b0 con 0x7eff480c5890 2024-05-08T21:10:47.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.234+0000 7eff4d1e3700 1 -- 172.21.15.80:0/2272502585 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7eff4804ec60 con 0x7eff480c5890 2024-05-08T21:10:47.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.234+0000 7eff2f7fe700 1 -- 172.21.15.80:0/2272502585 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7eff38058ed0 con 0x7eff480c5890 2024-05-08T21:10:47.237 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-05-08T21:10:47.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.236+0000 7eff4d1e3700 1 -- 172.21.15.80:0/2272502585 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7eff3406ac90 msgr2=0x7eff3406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:47.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.236+0000 7eff4d1e3700 1 --2- 172.21.15.80:0/2272502585 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7eff3406ac90 0x7eff3406d150 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7eff4806f930 tx=0x7eff3c008040 comp rx=0 tx=0).stop 2024-05-08T21:10:47.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.236+0000 7eff4d1e3700 1 -- 172.21.15.80:0/2272502585 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff480c5890 msgr2=0x7eff48148830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:47.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.236+0000 7eff4d1e3700 1 --2- 172.21.15.80:0/2272502585 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff480c5890 0x7eff48148830 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7eff38000c00 tx=0x7eff38004750 comp rx=0 tx=0).stop 2024-05-08T21:10:47.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.236+0000 7eff4d1e3700 1 -- 172.21.15.80:0/2272502585 shutdown_connections 2024-05-08T21:10:47.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.236+0000 7eff4d1e3700 1 --2- 172.21.15.80:0/2272502585 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7eff3406ac90 0x7eff3406d150 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:47.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.236+0000 7eff4d1e3700 1 --2- 172.21.15.80:0/2272502585 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff480c5890 0x7eff48148830 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:47.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.236+0000 7eff4d1e3700 1 --2- 172.21.15.80:0/2272502585 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7eff481544f0 0x7eff48147900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:47.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.236+0000 7eff4d1e3700 1 --2- 172.21.15.80:0/2272502585 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7eff480c6db0 0x7eff480c91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:47.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.236+0000 7eff4d1e3700 1 -- 172.21.15.80:0/2272502585 >> 172.21.15.80:0/2272502585 conn(0x7eff480ca340 msgr2=0x7eff480cb840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:47.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.236+0000 7eff4d1e3700 1 -- 172.21.15.80:0/2272502585 shutdown_connections 2024-05-08T21:10:47.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.236+0000 7eff4d1e3700 1 -- 172.21.15.80:0/2272502585 wait complete. 2024-05-08T21:10:47.251 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-08T21:10:47.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.373+0000 7f3f11e42700 1 Processor -- start 2024-05-08T21:10:47.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.373+0000 7f3f11e42700 1 -- start start 2024-05-08T21:10:47.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.374+0000 7f3f11e42700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3f0c0c6db0 0x7f3f0c15a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:47.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.374+0000 7f3f11e42700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3f0c0c5890 0x7f3f0c15a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:47.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.374+0000 7f3f11e42700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f0c0c56d0 con 0x7f3f0c1544f0 2024-05-08T21:10:47.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.374+0000 7f3f11e42700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f0c0c4ae0 con 0x7f3f0c0c5890 2024-05-08T21:10:47.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.374+0000 7f3f11e42700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0c0c8950 con 0x7f3f0c0c6db0 2024-05-08T21:10:47.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.374+0000 7f3f0bfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3f0c0c5890 0x7f3f0c15a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:47.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.374+0000 7f3f0b7fe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f3f0c1544f0 0x7f3f0c0c8240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:53188/0 (socket says 172.21.15.80:53188) 2024-05-08T21:10:47.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.374+0000 7f3f0b7fe700 1 -- 172.21.15.80:0/1998403847 learned_addr learned my addr 172.21.15.80:0/1998403847 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:10:47.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.375+0000 7f3f0affd700 1 --2- 172.21.15.80:0/1998403847 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3f0c0c6db0 0x7f3f0c15a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:47.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.375+0000 7f3f0bfff700 1 -- 172.21.15.80:0/1998403847 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3f0c0c6db0 msgr2=0x7f3f0c15a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:47.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.375+0000 7f3f0bfff700 1 --2- 172.21.15.80:0/1998403847 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3f0c0c6db0 0x7f3f0c15a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:47.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.375+0000 7f3f0bfff700 1 -- 172.21.15.80:0/1998403847 >> v1:172.21.15.80:6789/0 conn(0x7f3f0c1544f0 legacy=0x7f3f0c0c8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:47.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.375+0000 7f3f0bfff700 1 -- 172.21.15.80:0/1998403847 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f0c0c6920 con 0x7f3f0c0c5890 2024-05-08T21:10:47.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.375+0000 7f3f0a7fc700 1 -- 172.21.15.80:0/1998403847 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 802931582 0 0) 0x7f3f00001110 con 0x7f3f0c1544f0 2024-05-08T21:10:47.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.375+0000 7f3f0bfff700 1 --2- 172.21.15.80:0/1998403847 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f0c0c5890 0x7f3f0c15a770 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3f04009dc0 tx=0x7f3f0400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e6f6e0371824a71 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:47.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.375+0000 7f3f0a7fc700 1 -- 172.21.15.80:0/1998403847 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0400e070 con 0x7f3f0c0c5890 2024-05-08T21:10:47.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.375+0000 7f3f0a7fc700 1 -- 172.21.15.80:0/1998403847 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f0400bb90 con 0x7f3f0c0c5890 2024-05-08T21:10:47.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.375+0000 7f3f0a7fc700 1 -- 172.21.15.80:0/1998403847 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f04012430 con 0x7f3f0c0c5890 2024-05-08T21:10:47.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.376+0000 7f3f11e42700 1 -- 172.21.15.80:0/1998403847 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f0c0c5890 msgr2=0x7f3f0c15a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:47.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.376+0000 7f3f11e42700 1 --2- 172.21.15.80:0/1998403847 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f0c0c5890 0x7f3f0c15a770 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3f04009dc0 tx=0x7f3f0400b330 comp rx=0 tx=0).stop 2024-05-08T21:10:47.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.376+0000 7f3f11e42700 1 -- 172.21.15.80:0/1998403847 shutdown_connections 2024-05-08T21:10:47.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.376+0000 7f3f11e42700 1 --2- 172.21.15.80:0/1998403847 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f0c0c5890 0x7f3f0c15a770 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:47.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.376+0000 7f3f11e42700 1 --2- 172.21.15.80:0/1998403847 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3f0c0c6db0 0x7f3f0c15a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:47.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.376+0000 7f3f11e42700 1 -- 172.21.15.80:0/1998403847 >> 172.21.15.80:0/1998403847 conn(0x7f3f0c0ca340 msgr2=0x7f3f0c0ca750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:47.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.376+0000 7f3f11e42700 1 -- 172.21.15.80:0/1998403847 shutdown_connections 2024-05-08T21:10:47.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.376+0000 7f3f11e42700 1 -- 172.21.15.80:0/1998403847 wait complete. 2024-05-08T21:10:47.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.377+0000 7f3f11e42700 1 Processor -- start 2024-05-08T21:10:47.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.377+0000 7f3f11e42700 1 -- start start 2024-05-08T21:10:47.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.378+0000 7f3f11e42700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3f0c0c5890 0x7f3f0c15e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:47.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.378+0000 7f3f11e42700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3f0c0c6db0 0x7f3f0c1590f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:47.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.378+0000 7f3f11e42700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f0c1544f0 0x7f3f0c159630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:47.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.378+0000 7f3f11e42700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0c06cc20 con 0x7f3f0c1544f0 2024-05-08T21:10:47.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.378+0000 7f3f11e42700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0c15b5b0 con 0x7f3f0c0c5890 2024-05-08T21:10:47.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.378+0000 7f3f11e42700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0c06c0e0 con 0x7f3f0c0c6db0 2024-05-08T21:10:47.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.378+0000 7f3f0bfff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f0c1544f0 0x7f3f0c159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:47.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.378+0000 7f3f0bfff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f0c1544f0 0x7f3f0c159630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34712/0 (socket says 172.21.15.80:34712) 2024-05-08T21:10:47.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.378+0000 7f3f0bfff700 1 -- 172.21.15.80:0/2527627440 learned_addr learned my addr 172.21.15.80:0/2527627440 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:47.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.378+0000 7f3f0affd700 1 --2- 172.21.15.80:0/2527627440 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3f0c0c6db0 0x7f3f0c1590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:47.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.378+0000 7f3f0b7fe700 1 --2- 172.21.15.80:0/2527627440 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3f0c0c5890 0x7f3f0c15e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:47.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.378+0000 7f3f0bfff700 1 -- 172.21.15.80:0/2527627440 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3f0c0c6db0 msgr2=0x7f3f0c1590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:47.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.378+0000 7f3f0bfff700 1 --2- 172.21.15.80:0/2527627440 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3f0c0c6db0 0x7f3f0c1590f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:47.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.378+0000 7f3f0bfff700 1 -- 172.21.15.80:0/2527627440 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3f0c0c5890 msgr2=0x7f3f0c15e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:47.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.378+0000 7f3f0bfff700 1 --2- 172.21.15.80:0/2527627440 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3f0c0c5890 0x7f3f0c15e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:47.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.378+0000 7f3f0bfff700 1 -- 172.21.15.80:0/2527627440 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f04009a70 con 0x7f3f0c1544f0 2024-05-08T21:10:47.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.378+0000 7f3f0bfff700 1 --2- 172.21.15.80:0/2527627440 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f0c1544f0 0x7f3f0c159630 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c06f660 tx=0x7f3f04004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:47.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.378+0000 7f3ef3fff700 1 -- 172.21.15.80:0/2527627440 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f04012430 con 0x7f3f0c1544f0 2024-05-08T21:10:47.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.378+0000 7f3ef3fff700 1 -- 172.21.15.80:0/2527627440 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f04020070 con 0x7f3f0c1544f0 2024-05-08T21:10:47.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.378+0000 7f3f11e42700 1 -- 172.21.15.80:0/2527627440 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f0c1f0700 con 0x7f3f0c1544f0 2024-05-08T21:10:47.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.378+0000 7f3ef3fff700 1 -- 172.21.15.80:0/2527627440 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f04004280 con 0x7f3f0c1544f0 2024-05-08T21:10:47.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.378+0000 7f3f11e42700 1 -- 172.21.15.80:0/2527627440 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f0c06c660 con 0x7f3f0c1544f0 2024-05-08T21:10:47.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.379+0000 7f3f11e42700 1 -- 172.21.15.80:0/2527627440 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f0c0c77f0 con 0x7f3f0c1544f0 2024-05-08T21:10:47.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.380+0000 7f3ef3fff700 1 -- 172.21.15.80:0/2527627440 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3f040043e0 con 0x7f3f0c1544f0 2024-05-08T21:10:47.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.380+0000 7f3ef3fff700 1 --2- 172.21.15.80:0/2527627440 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f3ef806ac90 0x7f3ef806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:47.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.380+0000 7f3f0b7fe700 1 --2- 172.21.15.80:0/2527627440 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f3ef806ac90 0x7f3ef806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:47.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.380+0000 7f3ef3fff700 1 -- 172.21.15.80:0/2527627440 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3f04022070 con 0x7f3f0c1544f0 2024-05-08T21:10:47.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.381+0000 7f3f0b7fe700 1 --2- 172.21.15.80:0/2527627440 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f3ef806ac90 0x7f3ef806d150 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3f00000f60 tx=0x7f3f00007c90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:47.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.385+0000 7f3ef3fff700 1 -- 172.21.15.80:0/2527627440 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f3f040567b0 con 0x7f3f0c1544f0 2024-05-08T21:10:47.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.581+0000 7f3f11e42700 1 -- 172.21.15.80:0/2527627440 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f3f0c0c7b10 con 0x7f3f0c1544f0 2024-05-08T21:10:47.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.581+0000 7f3ef3fff700 1 -- 172.21.15.80:0/2527627440 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3f0401ae60 con 0x7f3f0c1544f0 2024-05-08T21:10:47.584 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-05-08T21:10:47.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.583+0000 7f3f11e42700 1 -- 172.21.15.80:0/2527627440 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f3ef806ac90 msgr2=0x7f3ef806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:47.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.583+0000 7f3f11e42700 1 --2- 172.21.15.80:0/2527627440 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f3ef806ac90 0x7f3ef806d150 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3f00000f60 tx=0x7f3f00007c90 comp rx=0 tx=0).stop 2024-05-08T21:10:47.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.583+0000 7f3f11e42700 1 -- 172.21.15.80:0/2527627440 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f0c1544f0 msgr2=0x7f3f0c159630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:47.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.583+0000 7f3f11e42700 1 --2- 172.21.15.80:0/2527627440 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f0c1544f0 0x7f3f0c159630 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c06f660 tx=0x7f3f04004ad0 comp rx=0 tx=0).stop 2024-05-08T21:10:47.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.583+0000 7f3f11e42700 1 -- 172.21.15.80:0/2527627440 shutdown_connections 2024-05-08T21:10:47.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.583+0000 7f3f11e42700 1 --2- 172.21.15.80:0/2527627440 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f3ef806ac90 0x7f3ef806d150 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:47.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.583+0000 7f3f11e42700 1 --2- 172.21.15.80:0/2527627440 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f0c1544f0 0x7f3f0c159630 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:47.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.583+0000 7f3f11e42700 1 --2- 172.21.15.80:0/2527627440 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3f0c0c5890 0x7f3f0c15e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:47.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.583+0000 7f3f11e42700 1 --2- 172.21.15.80:0/2527627440 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3f0c0c6db0 0x7f3f0c1590f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:47.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.583+0000 7f3f11e42700 1 -- 172.21.15.80:0/2527627440 >> 172.21.15.80:0/2527627440 conn(0x7f3f0c0ca340 msgr2=0x7f3f0c151c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:47.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.584+0000 7f3f11e42700 1 -- 172.21.15.80:0/2527627440 shutdown_connections 2024-05-08T21:10:47.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.584+0000 7f3f11e42700 1 -- 172.21.15.80:0/2527627440 wait complete. 2024-05-08T21:10:47.598 INFO:tasks.mds_thrash:mds thrasher using random seed: 1715202647 2024-05-08T21:10:47.598 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T21:10:47.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.717+0000 7f739a7dd700 1 Processor -- start 2024-05-08T21:10:47.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.717+0000 7f739a7dd700 1 -- start start 2024-05-08T21:10:47.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.718+0000 7f739a7dd700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f73940c6880 0x7f7394070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:47.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.718+0000 7f739a7dd700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f739415b600 0x7f739415ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:47.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.718+0000 7f739a7dd700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7394158ae0 con 0x7f7394070b20 2024-05-08T21:10:47.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.718+0000 7f739a7dd700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73940730f0 con 0x7f73940c6880 2024-05-08T21:10:47.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.718+0000 7f739a7dd700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7394071440 con 0x7f739415b600 2024-05-08T21:10:47.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.718+0000 7f73937fe700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f73940c6880 0x7f7394070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:47.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.718+0000 7f7398d7a700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f739415b600 0x7f739415ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:47.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.719+0000 7f73937fe700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f73940c6880 0x7f7394070f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.80:51542/0 (socket says 172.21.15.80:51542) 2024-05-08T21:10:47.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.719+0000 7f73937fe700 1 -- 172.21.15.80:0/1746604307 learned_addr learned my addr 172.21.15.80:0/1746604307 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:47.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.719+0000 7f7398d7a700 1 -- 172.21.15.80:0/1746604307 >> v2:172.21.15.106:3300/0 conn(0x7f73940c6880 msgr2=0x7f7394070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:47.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.719+0000 7f7398d7a700 1 --2- 172.21.15.80:0/1746604307 >> v2:172.21.15.106:3300/0 conn(0x7f73940c6880 0x7f7394070f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:47.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.719+0000 7f7398d7a700 1 -- 172.21.15.80:0/1746604307 >> v1:172.21.15.106:6789/0 conn(0x7f7394070b20 legacy=0x7f73940729e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:47.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.719+0000 7f7392ffd700 1 -- 172.21.15.80:0/1746604307 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2097410699 0 0) 0x7f7394158ae0 con 0x7f7394070b20 2024-05-08T21:10:47.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.719+0000 7f7398d7a700 1 -- 172.21.15.80:0/1746604307 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73940735e0 con 0x7f739415b600 2024-05-08T21:10:47.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.719+0000 7f73937fe700 1 --2- 172.21.15.80:0/1746604307 >> v2:172.21.15.106:3300/0 conn(0x7f73940c6880 0x7f7394070f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:10:47.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.719+0000 7f7398d7a700 1 --2- 172.21.15.80:0/1746604307 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f739415b600 0x7f739415ba50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f738c009d90 tx=0x7f738c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb5ce51b321b206c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:47.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.719+0000 7f7392ffd700 1 -- 172.21.15.80:0/1746604307 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738c00e070 con 0x7f739415b600 2024-05-08T21:10:47.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.719+0000 7f7392ffd700 1 -- 172.21.15.80:0/1746604307 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f738c00bb20 con 0x7f739415b600 2024-05-08T21:10:47.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.719+0000 7f7392ffd700 1 -- 172.21.15.80:0/1746604307 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738c012430 con 0x7f739415b600 2024-05-08T21:10:47.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.720+0000 7f739a7dd700 1 -- 172.21.15.80:0/1746604307 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f739415b600 msgr2=0x7f739415ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:47.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.720+0000 7f739a7dd700 1 --2- 172.21.15.80:0/1746604307 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f739415b600 0x7f739415ba50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f738c009d90 tx=0x7f738c00b330 comp rx=0 tx=0).stop 2024-05-08T21:10:47.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.720+0000 7f739a7dd700 1 -- 172.21.15.80:0/1746604307 shutdown_connections 2024-05-08T21:10:47.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.720+0000 7f739a7dd700 1 --2- 172.21.15.80:0/1746604307 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f739415b600 0x7f739415ba50 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:47.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.720+0000 7f739a7dd700 1 --2- 172.21.15.80:0/1746604307 >> v2:172.21.15.106:3300/0 conn(0x7f73940c6880 0x7f7394070f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:47.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.720+0000 7f739a7dd700 1 -- 172.21.15.80:0/1746604307 >> 172.21.15.80:0/1746604307 conn(0x7f73940cbe80 msgr2=0x7f73940cc290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:47.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.720+0000 7f739a7dd700 1 -- 172.21.15.80:0/1746604307 shutdown_connections 2024-05-08T21:10:47.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.720+0000 7f739a7dd700 1 -- 172.21.15.80:0/1746604307 wait complete. 2024-05-08T21:10:47.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.721+0000 7f739a7dd700 1 Processor -- start 2024-05-08T21:10:47.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.721+0000 7f739a7dd700 1 -- start start 2024-05-08T21:10:47.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.722+0000 7f739a7dd700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7394070b20 0x7f73941f1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:47.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.722+0000 7f739a7dd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f73940c6880 0x7f7394157140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:47.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.722+0000 7f739a7dd700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f739415b600 0x7f7394149020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:47.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.722+0000 7f739a7dd700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73940b06c0 con 0x7f73940c6880 2024-05-08T21:10:47.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.722+0000 7f739a7dd700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73940ca450 con 0x7f739415b600 2024-05-08T21:10:47.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.722+0000 7f739a7dd700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73940b0d10 con 0x7f7394070b20 2024-05-08T21:10:47.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.722+0000 7f73937fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f73940c6880 0x7f7394157140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:47.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.722+0000 7f73937fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f73940c6880 0x7f7394157140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34724/0 (socket says 172.21.15.80:34724) 2024-05-08T21:10:47.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.722+0000 7f73937fe700 1 -- 172.21.15.80:0/3873819760 learned_addr learned my addr 172.21.15.80:0/3873819760 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:47.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.722+0000 7f7398d7a700 1 --2- 172.21.15.80:0/3873819760 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f739415b600 0x7f7394149020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:47.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.722+0000 7f7393fff700 1 --2- 172.21.15.80:0/3873819760 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7394070b20 0x7f73941f1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:47.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.722+0000 7f73937fe700 1 -- 172.21.15.80:0/3873819760 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7394070b20 msgr2=0x7f73941f1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:47.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.722+0000 7f73937fe700 1 --2- 172.21.15.80:0/3873819760 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7394070b20 0x7f73941f1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:47.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.722+0000 7f73937fe700 1 -- 172.21.15.80:0/3873819760 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f739415b600 msgr2=0x7f7394149020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:47.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.722+0000 7f73937fe700 1 --2- 172.21.15.80:0/3873819760 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f739415b600 0x7f7394149020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:47.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.722+0000 7f73937fe700 1 -- 172.21.15.80:0/3873819760 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7384009550 con 0x7f73940c6880 2024-05-08T21:10:47.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.722+0000 7f73937fe700 1 --2- 172.21.15.80:0/3873819760 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f73940c6880 0x7f7394157140 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f738400ebe0 tx=0x7f738400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:47.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.723+0000 7f7390ff9700 1 -- 172.21.15.80:0/3873819760 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738400c850 con 0x7f73940c6880 2024-05-08T21:10:47.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.723+0000 7f7390ff9700 1 -- 172.21.15.80:0/3873819760 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f738400c9b0 con 0x7f73940c6880 2024-05-08T21:10:47.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.723+0000 7f739a7dd700 1 -- 172.21.15.80:0/3873819760 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f738c009a70 con 0x7f73940c6880 2024-05-08T21:10:47.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.723+0000 7f7390ff9700 1 -- 172.21.15.80:0/3873819760 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738400cd40 con 0x7f73940c6880 2024-05-08T21:10:47.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.723+0000 7f739a7dd700 1 -- 172.21.15.80:0/3873819760 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73940ca6a0 con 0x7f73940c6880 2024-05-08T21:10:47.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.724+0000 7f739a7dd700 1 -- 172.21.15.80:0/3873819760 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7394071a10 con 0x7f73940c6880 2024-05-08T21:10:47.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.724+0000 7f7390ff9700 1 -- 172.21.15.80:0/3873819760 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7384013470 con 0x7f73940c6880 2024-05-08T21:10:47.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.724+0000 7f7390ff9700 1 --2- 172.21.15.80:0/3873819760 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f737406ac90 0x7f737406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:47.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.725+0000 7f7390ff9700 1 -- 172.21.15.80:0/3873819760 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f73840896e0 con 0x7f73940c6880 2024-05-08T21:10:47.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.725+0000 7f7393fff700 1 --2- 172.21.15.80:0/3873819760 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f737406ac90 0x7f737406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:47.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.725+0000 7f7393fff700 1 --2- 172.21.15.80:0/3873819760 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f737406ac90 0x7f737406d150 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f737c007fd0 tx=0x7f737c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:47.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.729+0000 7f7390ff9700 1 -- 172.21.15.80:0/3873819760 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f7384054660 con 0x7f73940c6880 2024-05-08T21:10:47.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.929+0000 7f739a7dd700 1 -- 172.21.15.80:0/3873819760 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f739404ec60 con 0x7f73940c6880 2024-05-08T21:10:47.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.930+0000 7f7390ff9700 1 -- 172.21.15.80:0/3873819760 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+17878 (secure 0 0 0) 0x7f7384057c80 con 0x7f73940c6880 2024-05-08T21:10:47.932 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:10:47.932 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":26,"fsid":"44d31c1e-aad3-47ca-a4fa-85a63d4a60aa","created":"2024-05-08T21:09:46.467038+0000","modified":"2024-05-08T21:10:08.163735+0000","last_up_change":"2024-05-08T21:09:57.284675+0000","last_in_change":"2024-05-08T21:09:49.125444+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T21:09:58.238951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T21:10:02.177476+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T21:10:02.685535+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-08T21:10:05.753779+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c3f9d93e-ed6d-4a0c-b5c0-0e8d44c65fdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":47011},{"type":"v1","addr":"172.21.15.80:6817","nonce":47011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":47011},{"type":"v1","addr":"172.21.15.80:6819","nonce":47011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":47011},{"type":"v1","addr":"172.21.15.80:6823","nonce":47011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":47011},{"type":"v1","addr":"172.21.15.80:6821","nonce":47011}]},"public_addr":"172.21.15.80:6817/47011","cluster_addr":"172.21.15.80:6819/47011","heartbeat_back_addr":"172.21.15.80:6823/47011","heartbeat_front_addr":"172.21.15.80:6821/47011","state":["exists","up"]},{"osd":1,"uuid":"4ce2b4d6-6c40-43aa-8dd1-743fef8915df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":47010},{"type":"v1","addr":"172.21.15.80:6809","nonce":47010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":47010},{"type":"v1","addr":"172.21.15.80:6811","nonce":47010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":47010},{"type":"v1","addr":"172.21.15.80:6815","nonce":47010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":47010},{"type":"v1","addr":"172.21.15.80:6813","nonce":47010}]},"public_addr":"172.21.15.80:6809/47010","cluster_addr":"172.21.15.80:6811/47010","heartbeat_back_addr":"172.21.15.80:6815/47010","heartbeat_front_addr":"172.21.15.80:6813/47010","state":["exists","up"]},{"osd":2,"uuid":"e30cc3bc-6461-4fac-960a-de00c9488d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":47009},{"type":"v1","addr":"172.21.15.80:6801","nonce":47009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":47009},{"type":"v1","addr":"172.21.15.80:6803","nonce":47009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":47009},{"type":"v1","addr":"172.21.15.80:6807","nonce":47009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":47009},{"type":"v1","addr":"172.21.15.80:6805","nonce":47009}]},"public_addr":"172.21.15.80:6801/47009","cluster_addr":"172.21.15.80:6803/47009","heartbeat_back_addr":"172.21.15.80:6807/47009","heartbeat_front_addr":"172.21.15.80:6805/47009","state":["exists","up"]},{"osd":3,"uuid":"a415c099-9ea6-40be-98ed-f2932f98dfd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":47012},{"type":"v1","addr":"172.21.15.80:6825","nonce":47012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":47012},{"type":"v1","addr":"172.21.15.80:6827","nonce":47012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":47012},{"type":"v1","addr":"172.21.15.80:6831","nonce":47012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":47012},{"type":"v1","addr":"172.21.15.80:6829","nonce":47012}]},"public_addr":"172.21.15.80:6825/47012","cluster_addr":"172.21.15.80:6827/47012","heartbeat_back_addr":"172.21.15.80:6831/47012","heartbeat_front_addr":"172.21.15.80:6829/47012","state":["exists","up"]},{"osd":4,"uuid":"5ae1d51f-0918-4571-b79b-154308d46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6823","nonce":47114},{"type":"v1","addr":"172.21.15.106:6825","nonce":47114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":47114},{"type":"v1","addr":"172.21.15.106:6827","nonce":47114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":47114},{"type":"v1","addr":"172.21.15.106:6831","nonce":47114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":47114},{"type":"v1","addr":"172.21.15.106:6829","nonce":47114}]},"public_addr":"172.21.15.106:6825/47114","cluster_addr":"172.21.15.106:6827/47114","heartbeat_back_addr":"172.21.15.106:6831/47114","heartbeat_front_addr":"172.21.15.106:6829/47114","state":["exists","up"]},{"osd":5,"uuid":"a19ac74e-4282-4428-b167-26ba6b92f732","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6807","nonce":47111},{"type":"v1","addr":"172.21.15.106:6809","nonce":47111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":47111},{"type":"v1","addr":"172.21.15.106:6811","nonce":47111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":47111},{"type":"v1","addr":"172.21.15.106:6815","nonce":47111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":47111},{"type":"v1","addr":"172.21.15.106:6813","nonce":47111}]},"public_addr":"172.21.15.106:6809/47111","cluster_addr":"172.21.15.106:6811/47111","heartbeat_back_addr":"172.21.15.106:6815/47111","heartbeat_front_addr":"172.21.15.106:6813/47111","state":["exists","up"]},{"osd":6,"uuid":"bfe72edd-7acc-4805-807d-2000e76f2feb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":47112},{"type":"v1","addr":"172.21.15.106:6817","nonce":47112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":47112},{"type":"v1","addr":"172.21.15.106:6819","nonce":47112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":47112},{"type":"v1","addr":"172.21.15.106:6824","nonce":47112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":47112},{"type":"v1","addr":"172.21.15.106:6821","nonce":47112}]},"public_addr":"172.21.15.106:6817/47112","cluster_addr":"172.21.15.106:6819/47112","heartbeat_back_addr":"172.21.15.106:6824/47112","heartbeat_front_addr":"172.21.15.106:6821/47112","state":["exists","up"]},{"osd":7,"uuid":"99897f22-ed17-4c7c-9088-cc0c4a51f786","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":47113},{"type":"v1","addr":"172.21.15.106:6801","nonce":47113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":47113},{"type":"v1","addr":"172.21.15.106:6803","nonce":47113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":47113},{"type":"v1","addr":"172.21.15.106:6808","nonce":47113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":47113},{"type":"v1","addr":"172.21.15.106:6805","nonce":47113}]},"public_addr":"172.21.15.106:6801/47113","cluster_addr":"172.21.15.106:6803/47113","heartbeat_back_addr":"172.21.15.106:6808/47113","heartbeat_front_addr":"172.21.15.106:6805/47113","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.232670+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.277753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.050087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.349312+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.344080+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.348781+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.352539+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.275013+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T21:10:47.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.932+0000 7f739a7dd700 1 -- 172.21.15.80:0/3873819760 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f737406ac90 msgr2=0x7f737406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:47.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.932+0000 7f739a7dd700 1 --2- 172.21.15.80:0/3873819760 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f737406ac90 0x7f737406d150 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f737c007fd0 tx=0x7f737c009040 comp rx=0 tx=0).stop 2024-05-08T21:10:47.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.932+0000 7f739a7dd700 1 -- 172.21.15.80:0/3873819760 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f73940c6880 msgr2=0x7f7394157140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:47.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.932+0000 7f739a7dd700 1 --2- 172.21.15.80:0/3873819760 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f73940c6880 0x7f7394157140 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f738400ebe0 tx=0x7f738400eef0 comp rx=0 tx=0).stop 2024-05-08T21:10:47.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.932+0000 7f739a7dd700 1 -- 172.21.15.80:0/3873819760 shutdown_connections 2024-05-08T21:10:47.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.932+0000 7f739a7dd700 1 --2- 172.21.15.80:0/3873819760 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f737406ac90 0x7f737406d150 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:47.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.932+0000 7f739a7dd700 1 --2- 172.21.15.80:0/3873819760 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f739415b600 0x7f7394149020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:47.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.932+0000 7f739a7dd700 1 --2- 172.21.15.80:0/3873819760 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7394070b20 0x7f73941f1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:47.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.932+0000 7f739a7dd700 1 --2- 172.21.15.80:0/3873819760 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f73940c6880 0x7f7394157140 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:47.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.932+0000 7f739a7dd700 1 -- 172.21.15.80:0/3873819760 >> 172.21.15.80:0/3873819760 conn(0x7f73940cbe80 msgr2=0x7f739414b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:47.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.932+0000 7f739a7dd700 1 -- 172.21.15.80:0/3873819760 shutdown_connections 2024-05-08T21:10:47.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:47.932+0000 7f739a7dd700 1 -- 172.21.15.80:0/3873819760 wait complete. 2024-05-08T21:10:47.947 INFO:tasks.mds_thrash.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T21:09:58.238951+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T21:10:02.177476+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T21:10:02.685535+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-08T21:10:05.753779+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-08T21:10:47.948 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T21:10:48.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.071+0000 7f6be9f0d700 1 Processor -- start 2024-05-08T21:10:48.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.071+0000 7f6be9f0d700 1 -- start start 2024-05-08T21:10:48.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.071+0000 7f6be9f0d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6be406dce0 0x7f6be4158ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:48.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.071+0000 7f6be9f0d700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6be40c57f0 con 0x7f6be4141450 2024-05-08T21:10:48.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.071+0000 7f6be9f0d700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6be40c5a40 con 0x7f6be406eff0 2024-05-08T21:10:48.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.071+0000 7f6be9f0d700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6be40cae60 con 0x7f6be406dce0 2024-05-08T21:10:48.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.072+0000 7f6be3fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6be406dce0 0x7f6be4158ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:48.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.072+0000 7f6be37fe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f6be4141450 0x7f6be40c7120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:53198/0 (socket says 172.21.15.80:53198) 2024-05-08T21:10:48.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.072+0000 7f6be37fe700 1 -- 172.21.15.80:0/2720509766 learned_addr learned my addr 172.21.15.80:0/2720509766 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:10:48.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.072+0000 7f6be3fff700 1 -- 172.21.15.80:0/2720509766 >> v1:172.21.15.106:6789/0 conn(0x7f6be406eff0 legacy=0x7f6be41608d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:48.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.072+0000 7f6be3fff700 1 -- 172.21.15.80:0/2720509766 >> v1:172.21.15.80:6789/0 conn(0x7f6be4141450 legacy=0x7f6be40c7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:48.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.072+0000 7f6be3fff700 1 -- 172.21.15.80:0/2720509766 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be40cb140 con 0x7f6be406dce0 2024-05-08T21:10:48.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.072+0000 7f6be27fc700 1 -- 172.21.15.80:0/2720509766 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2679446215 0 0) 0x7f6be40c57f0 con 0x7f6be4141450 2024-05-08T21:10:48.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.072+0000 7f6be3fff700 1 --2- 172.21.15.80:0/2720509766 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6be406dce0 0x7f6be4158ab0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc009d90 tx=0x7f6bdc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f85ae387ccb82e33 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:48.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.072+0000 7f6be27fc700 1 -- 172.21.15.80:0/2720509766 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bdc00e070 con 0x7f6be406dce0 2024-05-08T21:10:48.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.072+0000 7f6be27fc700 1 -- 172.21.15.80:0/2720509766 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bdc00bb90 con 0x7f6be406dce0 2024-05-08T21:10:48.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.072+0000 7f6be27fc700 1 -- 172.21.15.80:0/2720509766 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bdc003a20 con 0x7f6be406dce0 2024-05-08T21:10:48.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.073+0000 7f6be9f0d700 1 -- 172.21.15.80:0/2720509766 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6be406dce0 msgr2=0x7f6be4158ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:48.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.073+0000 7f6be9f0d700 1 --2- 172.21.15.80:0/2720509766 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6be406dce0 0x7f6be4158ab0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc009d90 tx=0x7f6bdc00b330 comp rx=0 tx=0).stop 2024-05-08T21:10:48.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.073+0000 7f6be9f0d700 1 -- 172.21.15.80:0/2720509766 shutdown_connections 2024-05-08T21:10:48.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.073+0000 7f6be9f0d700 1 --2- 172.21.15.80:0/2720509766 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6be406dce0 0x7f6be4158ab0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:48.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.073+0000 7f6be9f0d700 1 -- 172.21.15.80:0/2720509766 >> 172.21.15.80:0/2720509766 conn(0x7f6be40ca340 msgr2=0x7f6be40ca750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:48.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.073+0000 7f6be9f0d700 1 -- 172.21.15.80:0/2720509766 shutdown_connections 2024-05-08T21:10:48.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.073+0000 7f6be9f0d700 1 -- 172.21.15.80:0/2720509766 wait complete. 2024-05-08T21:10:48.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.074+0000 7f6be9f0d700 1 Processor -- start 2024-05-08T21:10:48.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.074+0000 7f6be9f0d700 1 -- start start 2024-05-08T21:10:48.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.075+0000 7f6be9f0d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6be406dce0 0x7f6be4136530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:48.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.075+0000 7f6be9f0d700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6be406eff0 0x7f6be415ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:48.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.075+0000 7f6be9f0d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6be4141450 0x7f6be4156f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:48.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.075+0000 7f6be9f0d700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be41f1320 con 0x7f6be4141450 2024-05-08T21:10:48.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.075+0000 7f6be9f0d700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be413d760 con 0x7f6be406dce0 2024-05-08T21:10:48.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.075+0000 7f6be9f0d700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6be413da00 con 0x7f6be406eff0 2024-05-08T21:10:48.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.075+0000 7f6be3fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6be4141450 0x7f6be4156f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:48.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.075+0000 7f6be3fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6be4141450 0x7f6be4156f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34730/0 (socket says 172.21.15.80:34730) 2024-05-08T21:10:48.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.075+0000 7f6be3fff700 1 -- 172.21.15.80:0/3783766994 learned_addr learned my addr 172.21.15.80:0/3783766994 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:48.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.075+0000 7f6be37fe700 1 --2- 172.21.15.80:0/3783766994 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6be406dce0 0x7f6be4136530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:48.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.075+0000 7f6be2ffd700 1 --2- 172.21.15.80:0/3783766994 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6be406eff0 0x7f6be415ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:48.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.075+0000 7f6be3fff700 1 -- 172.21.15.80:0/3783766994 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6be406eff0 msgr2=0x7f6be415ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:48.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.075+0000 7f6be3fff700 1 --2- 172.21.15.80:0/3783766994 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6be406eff0 0x7f6be415ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:48.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.075+0000 7f6be3fff700 1 -- 172.21.15.80:0/3783766994 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6be406dce0 msgr2=0x7f6be4136530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:48.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.075+0000 7f6be3fff700 1 --2- 172.21.15.80:0/3783766994 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6be406dce0 0x7f6be4136530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:48.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.075+0000 7f6be3fff700 1 -- 172.21.15.80:0/3783766994 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bdc009a70 con 0x7f6be4141450 2024-05-08T21:10:48.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.075+0000 7f6be37fe700 1 --2- 172.21.15.80:0/3783766994 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6be406dce0 0x7f6be4136530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:10:48.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.075+0000 7f6be3fff700 1 --2- 172.21.15.80:0/3783766994 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6be4141450 0x7f6be4156f50 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6be406f660 tx=0x7f6bdc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:48.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.075+0000 7f6bdbfff700 1 -- 172.21.15.80:0/3783766994 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bdc012630 con 0x7f6be4141450 2024-05-08T21:10:48.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.075+0000 7f6bdbfff700 1 -- 172.21.15.80:0/3783766994 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bdc0127b0 con 0x7f6be4141450 2024-05-08T21:10:48.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.075+0000 7f6be9f0d700 1 -- 172.21.15.80:0/3783766994 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6be413dcc0 con 0x7f6be4141450 2024-05-08T21:10:48.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.075+0000 7f6bdbfff700 1 -- 172.21.15.80:0/3783766994 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bdc012b60 con 0x7f6be4141450 2024-05-08T21:10:48.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.075+0000 7f6be9f0d700 1 -- 172.21.15.80:0/3783766994 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6be41f0fb0 con 0x7f6be4141450 2024-05-08T21:10:48.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.076+0000 7f6be9f0d700 1 -- 172.21.15.80:0/3783766994 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6be41f1170 con 0x7f6be4141450 2024-05-08T21:10:48.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.077+0000 7f6bdbfff700 1 -- 172.21.15.80:0/3783766994 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6bdc012cc0 con 0x7f6be4141450 2024-05-08T21:10:48.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.077+0000 7f6bdbfff700 1 --2- 172.21.15.80:0/3783766994 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f6bc406acc0 0x7f6bc406d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:48.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.077+0000 7f6bdbfff700 1 -- 172.21.15.80:0/3783766994 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6bdc08b450 con 0x7f6be4141450 2024-05-08T21:10:48.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.077+0000 7f6be37fe700 1 --2- 172.21.15.80:0/3783766994 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f6bc406acc0 0x7f6bc406d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:48.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.078+0000 7f6be37fe700 1 --2- 172.21.15.80:0/3783766994 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f6bc406acc0 0x7f6bc406d180 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6bd4000f60 tx=0x7f6bd4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:48.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.082+0000 7f6bdbfff700 1 -- 172.21.15.80:0/3783766994 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f6bdc059e60 con 0x7f6be4141450 2024-05-08T21:10:48.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.277+0000 7f6be9f0d700 1 -- 172.21.15.80:0/3783766994 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6be4157ee0 con 0x7f6be4141450 2024-05-08T21:10:48.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.278+0000 7f6bdbfff700 1 -- 172.21.15.80:0/3783766994 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6bdc0599f0 con 0x7f6be4141450 2024-05-08T21:10:48.280 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-05-08T21:10:48.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.280+0000 7f6be9f0d700 1 -- 172.21.15.80:0/3783766994 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f6bc406acc0 msgr2=0x7f6bc406d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:48.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.280+0000 7f6be9f0d700 1 --2- 172.21.15.80:0/3783766994 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f6bc406acc0 0x7f6bc406d180 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6bd4000f60 tx=0x7f6bd4009040 comp rx=0 tx=0).stop 2024-05-08T21:10:48.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.280+0000 7f6be9f0d700 1 -- 172.21.15.80:0/3783766994 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6be4141450 msgr2=0x7f6be4156f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:48.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.280+0000 7f6be9f0d700 1 --2- 172.21.15.80:0/3783766994 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6be4141450 0x7f6be4156f50 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6be406f660 tx=0x7f6bdc004ad0 comp rx=0 tx=0).stop 2024-05-08T21:10:48.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.280+0000 7f6be9f0d700 1 -- 172.21.15.80:0/3783766994 shutdown_connections 2024-05-08T21:10:48.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.280+0000 7f6be9f0d700 1 --2- 172.21.15.80:0/3783766994 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f6bc406acc0 0x7f6bc406d180 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:48.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.280+0000 7f6be9f0d700 1 --2- 172.21.15.80:0/3783766994 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6be4141450 0x7f6be4156f50 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:48.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.280+0000 7f6be9f0d700 1 --2- 172.21.15.80:0/3783766994 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6be406dce0 0x7f6be4136530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:48.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.280+0000 7f6be9f0d700 1 --2- 172.21.15.80:0/3783766994 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6be406eff0 0x7f6be415ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:48.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.280+0000 7f6be9f0d700 1 -- 172.21.15.80:0/3783766994 >> 172.21.15.80:0/3783766994 conn(0x7f6be40ca340 msgr2=0x7f6be40cc540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:48.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.280+0000 7f6be9f0d700 1 -- 172.21.15.80:0/3783766994 shutdown_connections 2024-05-08T21:10:48.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.280+0000 7f6be9f0d700 1 -- 172.21.15.80:0/3783766994 wait complete. 2024-05-08T21:10:48.294 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T21:10:48.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.417+0000 7fe4829a6700 1 Processor -- start 2024-05-08T21:10:48.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.417+0000 7fe4829a6700 1 -- start start 2024-05-08T21:10:48.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.418+0000 7fe4829a6700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe47c0c75e0 0x7fe47c15ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:48.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.418+0000 7fe4829a6700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe47c0c87b0 0x7fe47c071400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:48.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.418+0000 7fe4829a6700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe47c0c79c0 0x7fe47c156d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:48.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.418+0000 7fe4829a6700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe47c0c7e50 con 0x7fe47c0c75e0 2024-05-08T21:10:48.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.418+0000 7fe4829a6700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe47c157550 con 0x7fe47c0c79c0 2024-05-08T21:10:48.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.418+0000 7fe4829a6700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe47c157830 con 0x7fe47c0c87b0 2024-05-08T21:10:48.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.418+0000 7fe47bfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe47c0c75e0 0x7fe47c15ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:48.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.418+0000 7fe47bfff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe47c0c75e0 0x7fe47c15ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34738/0 (socket says 172.21.15.80:34738) 2024-05-08T21:10:48.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.418+0000 7fe47bfff700 1 -- 172.21.15.80:0/4222533300 learned_addr learned my addr 172.21.15.80:0/4222533300 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:48.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.418+0000 7fe47b7fe700 1 --2- 172.21.15.80:0/4222533300 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe47c0c87b0 0x7fe47c071400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:48.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.418+0000 7fe480f43700 1 --2- 172.21.15.80:0/4222533300 >> v2:172.21.15.106:3300/0 conn(0x7fe47c0c79c0 0x7fe47c156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:48.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.418+0000 7fe47bfff700 1 -- 172.21.15.80:0/4222533300 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe47c0c87b0 msgr2=0x7fe47c071400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:48.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.418+0000 7fe47bfff700 1 --2- 172.21.15.80:0/4222533300 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe47c0c87b0 0x7fe47c071400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:48.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.418+0000 7fe47bfff700 1 -- 172.21.15.80:0/4222533300 >> v2:172.21.15.106:3300/0 conn(0x7fe47c0c79c0 msgr2=0x7fe47c156d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:48.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.418+0000 7fe47bfff700 1 --2- 172.21.15.80:0/4222533300 >> v2:172.21.15.106:3300/0 conn(0x7fe47c0c79c0 0x7fe47c156d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:48.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.418+0000 7fe47bfff700 1 -- 172.21.15.80:0/4222533300 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe47c157b10 con 0x7fe47c0c75e0 2024-05-08T21:10:48.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.419+0000 7fe47bfff700 1 --2- 172.21.15.80:0/4222533300 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe47c0c75e0 0x7fe47c15ade0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe47c06e260 tx=0x7fe47000be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77ce40d42ccd3e10 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:48.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.419+0000 7fe47affd700 1 -- 172.21.15.80:0/4222533300 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47000dc70 con 0x7fe47c0c75e0 2024-05-08T21:10:48.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.419+0000 7fe47affd700 1 -- 172.21.15.80:0/4222533300 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe47000ddd0 con 0x7fe47c0c75e0 2024-05-08T21:10:48.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.419+0000 7fe47affd700 1 -- 172.21.15.80:0/4222533300 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe470010690 con 0x7fe47c0c75e0 2024-05-08T21:10:48.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.419+0000 7fe4829a6700 1 -- 172.21.15.80:0/4222533300 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe47c0c75e0 msgr2=0x7fe47c15ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:48.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.419+0000 7fe4829a6700 1 --2- 172.21.15.80:0/4222533300 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe47c0c75e0 0x7fe47c15ade0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe47c06e260 tx=0x7fe47000be70 comp rx=0 tx=0).stop 2024-05-08T21:10:48.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.419+0000 7fe4829a6700 1 -- 172.21.15.80:0/4222533300 shutdown_connections 2024-05-08T21:10:48.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.419+0000 7fe4829a6700 1 --2- 172.21.15.80:0/4222533300 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe47c0c75e0 0x7fe47c15ade0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:48.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.419+0000 7fe4829a6700 1 --2- 172.21.15.80:0/4222533300 >> v2:172.21.15.106:3300/0 conn(0x7fe47c0c79c0 0x7fe47c156d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:48.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.419+0000 7fe4829a6700 1 --2- 172.21.15.80:0/4222533300 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe47c0c87b0 0x7fe47c071400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:48.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.419+0000 7fe4829a6700 1 -- 172.21.15.80:0/4222533300 >> 172.21.15.80:0/4222533300 conn(0x7fe47c06bad0 msgr2=0x7fe47c06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:48.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.419+0000 7fe4829a6700 1 -- 172.21.15.80:0/4222533300 shutdown_connections 2024-05-08T21:10:48.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.419+0000 7fe4829a6700 1 -- 172.21.15.80:0/4222533300 wait complete. 2024-05-08T21:10:48.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.421+0000 7fe4829a6700 1 Processor -- start 2024-05-08T21:10:48.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.421+0000 7fe4829a6700 1 -- start start 2024-05-08T21:10:48.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.421+0000 7fe4829a6700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe47c0c75e0 0x7fe47c144630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:48.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.421+0000 7fe4829a6700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe47c0c79c0 0x7fe47c154b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:48.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.421+0000 7fe4829a6700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe47c0c87b0 0x7fe47c0c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:48.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.422+0000 7fe4829a6700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe47c15a1c0 con 0x7fe47c0c79c0 2024-05-08T21:10:48.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.422+0000 7fe4829a6700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe47c0c2cc0 con 0x7fe47c0c75e0 2024-05-08T21:10:48.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.422+0000 7fe4829a6700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe47c0c3150 con 0x7fe47c0c87b0 2024-05-08T21:10:48.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.422+0000 7fe47b7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe47c0c79c0 0x7fe47c154b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:48.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.422+0000 7fe47b7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe47c0c79c0 0x7fe47c154b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34742/0 (socket says 172.21.15.80:34742) 2024-05-08T21:10:48.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.422+0000 7fe47b7fe700 1 -- 172.21.15.80:0/1247504006 learned_addr learned my addr 172.21.15.80:0/1247504006 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:48.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.422+0000 7fe47bfff700 1 --2- 172.21.15.80:0/1247504006 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe47c0c75e0 0x7fe47c144630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:48.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.422+0000 7fe480f43700 1 --2- 172.21.15.80:0/1247504006 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe47c0c87b0 0x7fe47c0c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:48.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.422+0000 7fe47b7fe700 1 -- 172.21.15.80:0/1247504006 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe47c0c87b0 msgr2=0x7fe47c0c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:48.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.422+0000 7fe47b7fe700 1 --2- 172.21.15.80:0/1247504006 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe47c0c87b0 0x7fe47c0c5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:48.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.422+0000 7fe47b7fe700 1 -- 172.21.15.80:0/1247504006 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe47c0c75e0 msgr2=0x7fe47c144630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:48.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.422+0000 7fe47b7fe700 1 --2- 172.21.15.80:0/1247504006 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe47c0c75e0 0x7fe47c144630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:48.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.422+0000 7fe47b7fe700 1 -- 172.21.15.80:0/1247504006 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe47000b7f0 con 0x7fe47c0c79c0 2024-05-08T21:10:48.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.422+0000 7fe480f43700 1 --2- 172.21.15.80:0/1247504006 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe47c0c87b0 0x7fe47c0c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:10:48.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.422+0000 7fe47b7fe700 1 --2- 172.21.15.80:0/1247504006 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe47c0c79c0 0x7fe47c154b50 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe46c00e870 tx=0x7fe46c00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:48.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.422+0000 7fe478ff9700 1 -- 172.21.15.80:0/1247504006 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46c009590 con 0x7fe47c0c79c0 2024-05-08T21:10:48.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.422+0000 7fe478ff9700 1 -- 172.21.15.80:0/1247504006 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe46c013680 con 0x7fe47c0c79c0 2024-05-08T21:10:48.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.422+0000 7fe4829a6700 1 -- 172.21.15.80:0/1247504006 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe47c159000 con 0x7fe47c0c79c0 2024-05-08T21:10:48.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.422+0000 7fe478ff9700 1 -- 172.21.15.80:0/1247504006 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46c0139f0 con 0x7fe47c0c79c0 2024-05-08T21:10:48.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.422+0000 7fe4829a6700 1 -- 172.21.15.80:0/1247504006 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe47c158a60 con 0x7fe47c0c79c0 2024-05-08T21:10:48.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.423+0000 7fe4829a6700 1 -- 172.21.15.80:0/1247504006 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe47c04ec60 con 0x7fe47c0c79c0 2024-05-08T21:10:48.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.424+0000 7fe478ff9700 1 -- 172.21.15.80:0/1247504006 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe46c013b50 con 0x7fe47c0c79c0 2024-05-08T21:10:48.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.424+0000 7fe478ff9700 1 --2- 172.21.15.80:0/1247504006 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe46806ac90 0x7fe46806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:48.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.424+0000 7fe478ff9700 1 -- 172.21.15.80:0/1247504006 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe46c089800 con 0x7fe47c0c79c0 2024-05-08T21:10:48.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.424+0000 7fe47bfff700 1 --2- 172.21.15.80:0/1247504006 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe46806ac90 0x7fe46806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:48.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.425+0000 7fe47bfff700 1 --2- 172.21.15.80:0/1247504006 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe46806ac90 0x7fe46806d150 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe47000beb0 tx=0x7fe47001c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:48.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.428+0000 7fe478ff9700 1 -- 172.21.15.80:0/1247504006 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fe46c054780 con 0x7fe47c0c79c0 2024-05-08T21:10:48.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.623+0000 7fe4829a6700 1 -- 172.21.15.80:0/1247504006 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe47c0c8120 con 0x7fe47c0c79c0 2024-05-08T21:10:48.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.624+0000 7fe478ff9700 1 -- 172.21.15.80:0/1247504006 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe46c087e60 con 0x7fe47c0c79c0 2024-05-08T21:10:48.626 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-05-08T21:10:48.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.626+0000 7fe4829a6700 1 -- 172.21.15.80:0/1247504006 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe46806ac90 msgr2=0x7fe46806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:48.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.626+0000 7fe4829a6700 1 --2- 172.21.15.80:0/1247504006 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe46806ac90 0x7fe46806d150 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe47000beb0 tx=0x7fe47001c040 comp rx=0 tx=0).stop 2024-05-08T21:10:48.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.626+0000 7fe4829a6700 1 -- 172.21.15.80:0/1247504006 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe47c0c79c0 msgr2=0x7fe47c154b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:48.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.626+0000 7fe4829a6700 1 --2- 172.21.15.80:0/1247504006 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe47c0c79c0 0x7fe47c154b50 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe46c00e870 tx=0x7fe46c00eb80 comp rx=0 tx=0).stop 2024-05-08T21:10:48.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.626+0000 7fe4829a6700 1 -- 172.21.15.80:0/1247504006 shutdown_connections 2024-05-08T21:10:48.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.626+0000 7fe4829a6700 1 --2- 172.21.15.80:0/1247504006 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe46806ac90 0x7fe46806d150 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:48.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.626+0000 7fe4829a6700 1 --2- 172.21.15.80:0/1247504006 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe47c0c87b0 0x7fe47c0c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:48.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.626+0000 7fe4829a6700 1 --2- 172.21.15.80:0/1247504006 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe47c0c75e0 0x7fe47c144630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:48.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.626+0000 7fe4829a6700 1 --2- 172.21.15.80:0/1247504006 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe47c0c79c0 0x7fe47c154b50 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:48.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.626+0000 7fe4829a6700 1 -- 172.21.15.80:0/1247504006 >> 172.21.15.80:0/1247504006 conn(0x7fe47c06bad0 msgr2=0x7fe47c06e920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:48.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.626+0000 7fe4829a6700 1 -- 172.21.15.80:0/1247504006 shutdown_connections 2024-05-08T21:10:48.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.626+0000 7fe4829a6700 1 -- 172.21.15.80:0/1247504006 wait complete. 2024-05-08T21:10:48.640 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T21:10:48.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.762+0000 7f2a83a18700 1 Processor -- start 2024-05-08T21:10:48.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.763+0000 7f2a83a18700 1 -- start start 2024-05-08T21:10:48.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.763+0000 7f2a83a18700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2a7c0c4840 0x7f2a7c0c4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:48.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.763+0000 7f2a83a18700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a7c0c27b0 con 0x7f2a7c0c3cd0 2024-05-08T21:10:48.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.763+0000 7f2a83a18700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a7c0c5210 con 0x7f2a7c150d30 2024-05-08T21:10:48.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.763+0000 7f2a83a18700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a7c1577f0 con 0x7f2a7c0c4840 2024-05-08T21:10:48.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.764+0000 7f2a81fb5700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2a7c0c4840 0x7f2a7c0c4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:48.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.764+0000 7f2a80fb3700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f2a7c0c3cd0 0x7f2a7c0c8050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:53206/0 (socket says 172.21.15.80:53206) 2024-05-08T21:10:48.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.764+0000 7f2a80fb3700 1 -- 172.21.15.80:0/147898290 learned_addr learned my addr 172.21.15.80:0/147898290 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:10:48.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.764+0000 7f2a81fb5700 1 -- 172.21.15.80:0/147898290 >> v1:172.21.15.106:6789/0 conn(0x7f2a7c150d30 legacy=0x7f2a7c0c20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:48.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.764+0000 7f2a81fb5700 1 -- 172.21.15.80:0/147898290 >> v1:172.21.15.80:6789/0 conn(0x7f2a7c0c3cd0 legacy=0x7f2a7c0c8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:48.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.764+0000 7f2a73fff700 1 -- 172.21.15.80:0/147898290 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 380262990 0 0) 0x7f2a7c0c27b0 con 0x7f2a7c0c3cd0 2024-05-08T21:10:48.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.764+0000 7f2a81fb5700 1 -- 172.21.15.80:0/147898290 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a7c156c70 con 0x7f2a7c0c4840 2024-05-08T21:10:48.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.764+0000 7f2a81fb5700 1 --2- 172.21.15.80:0/147898290 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2a7c0c4840 0x7f2a7c0c4cd0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2a74009d90 tx=0x7f2a7400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d37c0dc59cee473 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:48.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.764+0000 7f2a73fff700 1 -- 172.21.15.80:0/147898290 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a7400e070 con 0x7f2a7c0c4840 2024-05-08T21:10:48.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.764+0000 7f2a73fff700 1 -- 172.21.15.80:0/147898290 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a7400bbd0 con 0x7f2a7c0c4840 2024-05-08T21:10:48.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.764+0000 7f2a73fff700 1 -- 172.21.15.80:0/147898290 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a74012430 con 0x7f2a7c0c4840 2024-05-08T21:10:48.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.765+0000 7f2a83a18700 1 -- 172.21.15.80:0/147898290 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2a7c0c4840 msgr2=0x7f2a7c0c4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:48.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.765+0000 7f2a83a18700 1 --2- 172.21.15.80:0/147898290 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2a7c0c4840 0x7f2a7c0c4cd0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2a74009d90 tx=0x7f2a7400b330 comp rx=0 tx=0).stop 2024-05-08T21:10:48.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.765+0000 7f2a83a18700 1 -- 172.21.15.80:0/147898290 shutdown_connections 2024-05-08T21:10:48.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.765+0000 7f2a83a18700 1 --2- 172.21.15.80:0/147898290 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2a7c0c4840 0x7f2a7c0c4cd0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:48.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.765+0000 7f2a83a18700 1 -- 172.21.15.80:0/147898290 >> 172.21.15.80:0/147898290 conn(0x7f2a7c06a9c0 msgr2=0x7f2a7c06ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:48.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.765+0000 7f2a83a18700 1 -- 172.21.15.80:0/147898290 shutdown_connections 2024-05-08T21:10:48.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.765+0000 7f2a83a18700 1 -- 172.21.15.80:0/147898290 wait complete. 2024-05-08T21:10:48.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.766+0000 7f2a83a18700 1 Processor -- start 2024-05-08T21:10:48.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.766+0000 7f2a83a18700 1 -- start start 2024-05-08T21:10:48.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.767+0000 7f2a83a18700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2a7c0c3cd0 0x7f2a7c070540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:48.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.767+0000 7f2a83a18700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2a7c0c4840 0x7f2a7c13f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:48.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.767+0000 7f2a83a18700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2a7c150d30 0x7f2a7c13f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:48.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.767+0000 7f2a83a18700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7c0c2790 con 0x7f2a7c0c4840 2024-05-08T21:10:48.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.767+0000 7f2a83a18700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7c15ab60 con 0x7f2a7c150d30 2024-05-08T21:10:48.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.767+0000 7f2a83a18700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7c0cb3f0 con 0x7f2a7c0c3cd0 2024-05-08T21:10:48.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.767+0000 7f2a80fb3700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2a7c0c4840 0x7f2a7c13f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:48.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.767+0000 7f2a80fb3700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2a7c0c4840 0x7f2a7c13f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34760/0 (socket says 172.21.15.80:34760) 2024-05-08T21:10:48.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.767+0000 7f2a80fb3700 1 -- 172.21.15.80:0/2544081853 learned_addr learned my addr 172.21.15.80:0/2544081853 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:48.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.767+0000 7f2a817b4700 1 --2- 172.21.15.80:0/2544081853 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2a7c0c3cd0 0x7f2a7c070540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:48.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.767+0000 7f2a81fb5700 1 --2- 172.21.15.80:0/2544081853 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2a7c150d30 0x7f2a7c13f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:48.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.767+0000 7f2a80fb3700 1 -- 172.21.15.80:0/2544081853 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2a7c0c3cd0 msgr2=0x7f2a7c070540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:48.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.767+0000 7f2a80fb3700 1 --2- 172.21.15.80:0/2544081853 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2a7c0c3cd0 0x7f2a7c070540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:48.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.767+0000 7f2a80fb3700 1 -- 172.21.15.80:0/2544081853 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2a7c150d30 msgr2=0x7f2a7c13f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:48.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.767+0000 7f2a80fb3700 1 --2- 172.21.15.80:0/2544081853 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2a7c150d30 0x7f2a7c13f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:48.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.767+0000 7f2a80fb3700 1 -- 172.21.15.80:0/2544081853 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a74009a70 con 0x7f2a7c0c4840 2024-05-08T21:10:48.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.767+0000 7f2a80fb3700 1 --2- 172.21.15.80:0/2544081853 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2a7c0c4840 0x7f2a7c13f140 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2a7800c520 tx=0x7f2a7800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:48.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.767+0000 7f2a71ffb700 1 -- 172.21.15.80:0/2544081853 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a78004c80 con 0x7f2a7c0c4840 2024-05-08T21:10:48.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.767+0000 7f2a71ffb700 1 -- 172.21.15.80:0/2544081853 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a78004e20 con 0x7f2a7c0c4840 2024-05-08T21:10:48.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.767+0000 7f2a83a18700 1 -- 172.21.15.80:0/2544081853 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a7c0c24b0 con 0x7f2a7c0c4840 2024-05-08T21:10:48.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.767+0000 7f2a71ffb700 1 -- 172.21.15.80:0/2544081853 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a78007310 con 0x7f2a7c0c4840 2024-05-08T21:10:48.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.768+0000 7f2a83a18700 1 -- 172.21.15.80:0/2544081853 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a7c0cae30 con 0x7f2a7c0c4840 2024-05-08T21:10:48.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.768+0000 7f2a83a18700 1 -- 172.21.15.80:0/2544081853 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a7c13ee60 con 0x7f2a7c0c4840 2024-05-08T21:10:48.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.769+0000 7f2a71ffb700 1 -- 172.21.15.80:0/2544081853 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2a78007470 con 0x7f2a7c0c4840 2024-05-08T21:10:48.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.769+0000 7f2a71ffb700 1 --2- 172.21.15.80:0/2544081853 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f2a6006ac90 0x7f2a6006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:48.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.769+0000 7f2a71ffb700 1 -- 172.21.15.80:0/2544081853 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2a780893a0 con 0x7f2a7c0c4840 2024-05-08T21:10:48.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.769+0000 7f2a817b4700 1 --2- 172.21.15.80:0/2544081853 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f2a6006ac90 0x7f2a6006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:48.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.770+0000 7f2a817b4700 1 --2- 172.21.15.80:0/2544081853 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f2a6006ac90 0x7f2a6006d150 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c000f60 tx=0x7f2a6c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:48.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.774+0000 7f2a71ffb700 1 -- 172.21.15.80:0/2544081853 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f2a7c13ee60 con 0x7f2a7c0c4840 2024-05-08T21:10:48.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.969+0000 7f2a83a18700 1 -- 172.21.15.80:0/2544081853 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2a7c13ee60 con 0x7f2a7c0c4840 2024-05-08T21:10:48.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.969+0000 7f2a71ffb700 1 -- 172.21.15.80:0/2544081853 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2a7c13ee60 con 0x7f2a7c0c4840 2024-05-08T21:10:48.972 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-05-08T21:10:48.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.971+0000 7f2a83a18700 1 -- 172.21.15.80:0/2544081853 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f2a6006ac90 msgr2=0x7f2a6006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:48.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.971+0000 7f2a83a18700 1 --2- 172.21.15.80:0/2544081853 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f2a6006ac90 0x7f2a6006d150 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c000f60 tx=0x7f2a6c009040 comp rx=0 tx=0).stop 2024-05-08T21:10:48.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.971+0000 7f2a83a18700 1 -- 172.21.15.80:0/2544081853 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2a7c0c4840 msgr2=0x7f2a7c13f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:48.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.971+0000 7f2a83a18700 1 --2- 172.21.15.80:0/2544081853 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2a7c0c4840 0x7f2a7c13f140 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2a7800c520 tx=0x7f2a7800c8e0 comp rx=0 tx=0).stop 2024-05-08T21:10:48.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.971+0000 7f2a83a18700 1 -- 172.21.15.80:0/2544081853 shutdown_connections 2024-05-08T21:10:48.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.971+0000 7f2a83a18700 1 --2- 172.21.15.80:0/2544081853 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f2a6006ac90 0x7f2a6006d150 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:48.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.971+0000 7f2a83a18700 1 --2- 172.21.15.80:0/2544081853 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2a7c150d30 0x7f2a7c13f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:48.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.971+0000 7f2a83a18700 1 --2- 172.21.15.80:0/2544081853 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2a7c0c3cd0 0x7f2a7c070540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:48.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.971+0000 7f2a83a18700 1 --2- 172.21.15.80:0/2544081853 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2a7c0c4840 0x7f2a7c13f140 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:48.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.971+0000 7f2a83a18700 1 -- 172.21.15.80:0/2544081853 >> 172.21.15.80:0/2544081853 conn(0x7f2a7c06a9c0 msgr2=0x7f2a7c0c04c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:48.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.972+0000 7f2a83a18700 1 -- 172.21.15.80:0/2544081853 shutdown_connections 2024-05-08T21:10:48.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:48.972+0000 7f2a83a18700 1 -- 172.21.15.80:0/2544081853 wait complete. 2024-05-08T21:10:48.986 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-08T21:10:49.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.108+0000 7fc5d4109700 1 Processor -- start 2024-05-08T21:10:49.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.109+0000 7fc5d4109700 1 -- start start 2024-05-08T21:10:49.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.109+0000 7fc5d4109700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc5cc0ccc00 0x7fc5cc071be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:49.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.109+0000 7fc5d4109700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc5cc0ccfe0 0x7fc5cc0c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:49.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.109+0000 7fc5d4109700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc5cc0c8380 0x7fc5cc156ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:49.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.109+0000 7fc5d4109700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5cc0c9150 con 0x7fc5cc0c8380 2024-05-08T21:10:49.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.109+0000 7fc5d4109700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5cc0c99f0 con 0x7fc5cc0ccc00 2024-05-08T21:10:49.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.109+0000 7fc5d4109700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5cc1579c0 con 0x7fc5cc0ccfe0 2024-05-08T21:10:49.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.110+0000 7fc5d26a6700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc5cc0c8380 0x7fc5cc156ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:49.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.110+0000 7fc5d26a6700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc5cc0c8380 0x7fc5cc156ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34770/0 (socket says 172.21.15.80:34770) 2024-05-08T21:10:49.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.110+0000 7fc5d26a6700 1 -- 172.21.15.80:0/2891978251 learned_addr learned my addr 172.21.15.80:0/2891978251 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:49.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.110+0000 7fc5d16a4700 1 --2- 172.21.15.80:0/2891978251 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc5cc0ccfe0 0x7fc5cc0c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:49.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.110+0000 7fc5d1ea5700 1 --2- 172.21.15.80:0/2891978251 >> v2:172.21.15.106:3300/0 conn(0x7fc5cc0ccc00 0x7fc5cc071be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:49.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.110+0000 7fc5d26a6700 1 -- 172.21.15.80:0/2891978251 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc5cc0ccfe0 msgr2=0x7fc5cc0c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:49.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.110+0000 7fc5d26a6700 1 --2- 172.21.15.80:0/2891978251 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc5cc0ccfe0 0x7fc5cc0c9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:49.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.110+0000 7fc5d26a6700 1 -- 172.21.15.80:0/2891978251 >> v2:172.21.15.106:3300/0 conn(0x7fc5cc0ccc00 msgr2=0x7fc5cc071be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:49.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.110+0000 7fc5d26a6700 1 --2- 172.21.15.80:0/2891978251 >> v2:172.21.15.106:3300/0 conn(0x7fc5cc0ccc00 0x7fc5cc071be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:49.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.110+0000 7fc5d26a6700 1 -- 172.21.15.80:0/2891978251 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5cc157ca0 con 0x7fc5cc0c8380 2024-05-08T21:10:49.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.110+0000 7fc5d26a6700 1 --2- 172.21.15.80:0/2891978251 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc5cc0c8380 0x7fc5cc156ea0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc0c7860 tx=0x7fc5c400d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84ef170d45eaa4a8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:49.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.110+0000 7fc5d0ea3700 1 -- 172.21.15.80:0/2891978251 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c4010070 con 0x7fc5cc0c8380 2024-05-08T21:10:49.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.110+0000 7fc5d0ea3700 1 -- 172.21.15.80:0/2891978251 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5c400dd90 con 0x7fc5cc0c8380 2024-05-08T21:10:49.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.110+0000 7fc5d0ea3700 1 -- 172.21.15.80:0/2891978251 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c400b310 con 0x7fc5cc0c8380 2024-05-08T21:10:49.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.111+0000 7fc5d4109700 1 -- 172.21.15.80:0/2891978251 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc5cc0c8380 msgr2=0x7fc5cc156ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:49.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.111+0000 7fc5d4109700 1 --2- 172.21.15.80:0/2891978251 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc5cc0c8380 0x7fc5cc156ea0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc0c7860 tx=0x7fc5c400d430 comp rx=0 tx=0).stop 2024-05-08T21:10:49.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.111+0000 7fc5d4109700 1 -- 172.21.15.80:0/2891978251 shutdown_connections 2024-05-08T21:10:49.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.111+0000 7fc5d4109700 1 --2- 172.21.15.80:0/2891978251 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc5cc0c8380 0x7fc5cc156ea0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:49.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.111+0000 7fc5d4109700 1 --2- 172.21.15.80:0/2891978251 >> v2:172.21.15.106:3300/0 conn(0x7fc5cc0ccc00 0x7fc5cc071be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:49.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.111+0000 7fc5d4109700 1 --2- 172.21.15.80:0/2891978251 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc5cc0ccfe0 0x7fc5cc0c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:49.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.111+0000 7fc5d4109700 1 -- 172.21.15.80:0/2891978251 >> 172.21.15.80:0/2891978251 conn(0x7fc5cc06f140 msgr2=0x7fc5cc06f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:49.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.111+0000 7fc5d4109700 1 -- 172.21.15.80:0/2891978251 shutdown_connections 2024-05-08T21:10:49.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.111+0000 7fc5d4109700 1 -- 172.21.15.80:0/2891978251 wait complete. 2024-05-08T21:10:49.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.112+0000 7fc5d4109700 1 Processor -- start 2024-05-08T21:10:49.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.112+0000 7fc5d4109700 1 -- start start 2024-05-08T21:10:49.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.113+0000 7fc5d4109700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc5cc0c8380 0x7fc5cc0cbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:49.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.113+0000 7fc5d4109700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc5cc0ccc00 0x7fc5cc06b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:49.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.113+0000 7fc5d4109700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc5cc0ccfe0 0x7fc5cc06b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:49.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.113+0000 7fc5d4109700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5cc06a9c0 con 0x7fc5cc0ccc00 2024-05-08T21:10:49.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.113+0000 7fc5d4109700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5cc06aca0 con 0x7fc5cc0c8380 2024-05-08T21:10:49.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.113+0000 7fc5d4109700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5cc1eba40 con 0x7fc5cc0ccfe0 2024-05-08T21:10:49.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.113+0000 7fc5d16a4700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc5cc0ccc00 0x7fc5cc06b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:49.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.113+0000 7fc5d16a4700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc5cc0ccc00 0x7fc5cc06b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34778/0 (socket says 172.21.15.80:34778) 2024-05-08T21:10:49.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.113+0000 7fc5d16a4700 1 -- 172.21.15.80:0/3852164420 learned_addr learned my addr 172.21.15.80:0/3852164420 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:49.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.113+0000 7fc5d1ea5700 1 --2- 172.21.15.80:0/3852164420 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc5cc0c8380 0x7fc5cc0cbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:49.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.113+0000 7fc5d26a6700 1 --2- 172.21.15.80:0/3852164420 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc5cc0ccfe0 0x7fc5cc06b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:49.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.113+0000 7fc5d16a4700 1 -- 172.21.15.80:0/3852164420 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc5cc0ccfe0 msgr2=0x7fc5cc06b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:49.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.113+0000 7fc5d16a4700 1 --2- 172.21.15.80:0/3852164420 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc5cc0ccfe0 0x7fc5cc06b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:49.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.113+0000 7fc5d16a4700 1 -- 172.21.15.80:0/3852164420 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc5cc0c8380 msgr2=0x7fc5cc0cbbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:49.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.113+0000 7fc5d16a4700 1 --2- 172.21.15.80:0/3852164420 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc5cc0c8380 0x7fc5cc0cbbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:49.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.113+0000 7fc5d16a4700 1 -- 172.21.15.80:0/3852164420 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c400bd40 con 0x7fc5cc0ccc00 2024-05-08T21:10:49.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.113+0000 7fc5d26a6700 1 --2- 172.21.15.80:0/3852164420 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc5cc0ccfe0 0x7fc5cc06b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:10:49.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.113+0000 7fc5d16a4700 1 --2- 172.21.15.80:0/3852164420 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc5cc0ccc00 0x7fc5cc06b0c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc5c800d830 tx=0x7fc5c800db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:49.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.113+0000 7fc5c27fc700 1 -- 172.21.15.80:0/3852164420 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c80125f0 con 0x7fc5cc0ccc00 2024-05-08T21:10:49.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.113+0000 7fc5c27fc700 1 -- 172.21.15.80:0/3852164420 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5c8012750 con 0x7fc5cc0ccc00 2024-05-08T21:10:49.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.113+0000 7fc5c27fc700 1 -- 172.21.15.80:0/3852164420 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c8012b00 con 0x7fc5cc0ccc00 2024-05-08T21:10:49.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.113+0000 7fc5d4109700 1 -- 172.21.15.80:0/3852164420 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5cc1ebd20 con 0x7fc5cc0ccc00 2024-05-08T21:10:49.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.113+0000 7fc5d4109700 1 -- 172.21.15.80:0/3852164420 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5cc1ec2e0 con 0x7fc5cc0ccc00 2024-05-08T21:10:49.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.114+0000 7fc5d4109700 1 -- 172.21.15.80:0/3852164420 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5cc0cd960 con 0x7fc5cc0ccc00 2024-05-08T21:10:49.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.115+0000 7fc5c27fc700 1 -- 172.21.15.80:0/3852164420 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc5c8012c60 con 0x7fc5cc0ccc00 2024-05-08T21:10:49.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.115+0000 7fc5c27fc700 1 --2- 172.21.15.80:0/3852164420 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fc5b006acc0 0x7fc5b006d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:49.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.115+0000 7fc5c27fc700 1 -- 172.21.15.80:0/3852164420 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc5c8089910 con 0x7fc5cc0ccc00 2024-05-08T21:10:49.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.115+0000 7fc5d1ea5700 1 --2- 172.21.15.80:0/3852164420 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fc5b006acc0 0x7fc5b006d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:49.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.116+0000 7fc5d1ea5700 1 --2- 172.21.15.80:0/3852164420 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fc5b006acc0 0x7fc5b006d180 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc009950 tx=0x7fc5bc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:49.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.120+0000 7fc5c27fc700 1 -- 172.21.15.80:0/3852164420 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fc5c8054810 con 0x7fc5cc0ccc00 2024-05-08T21:10:49.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.314+0000 7fc5d4109700 1 -- 172.21.15.80:0/3852164420 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc5cc1ec500 con 0x7fc5cc0ccc00 2024-05-08T21:10:49.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.315+0000 7fc5c27fc700 1 -- 172.21.15.80:0/3852164420 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc5c8057e30 con 0x7fc5cc0ccc00 2024-05-08T21:10:49.317 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-05-08T21:10:49.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.317+0000 7fc5d4109700 1 -- 172.21.15.80:0/3852164420 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fc5b006acc0 msgr2=0x7fc5b006d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:49.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.317+0000 7fc5d4109700 1 --2- 172.21.15.80:0/3852164420 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fc5b006acc0 0x7fc5b006d180 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc009950 tx=0x7fc5bc008040 comp rx=0 tx=0).stop 2024-05-08T21:10:49.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.317+0000 7fc5d4109700 1 -- 172.21.15.80:0/3852164420 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc5cc0ccc00 msgr2=0x7fc5cc06b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:49.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.317+0000 7fc5d4109700 1 --2- 172.21.15.80:0/3852164420 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc5cc0ccc00 0x7fc5cc06b0c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc5c800d830 tx=0x7fc5c800db40 comp rx=0 tx=0).stop 2024-05-08T21:10:49.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.317+0000 7fc5d4109700 1 -- 172.21.15.80:0/3852164420 shutdown_connections 2024-05-08T21:10:49.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.317+0000 7fc5d4109700 1 --2- 172.21.15.80:0/3852164420 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fc5b006acc0 0x7fc5b006d180 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:49.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.317+0000 7fc5d4109700 1 --2- 172.21.15.80:0/3852164420 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc5cc0ccfe0 0x7fc5cc06b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:49.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.317+0000 7fc5d4109700 1 --2- 172.21.15.80:0/3852164420 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc5cc0c8380 0x7fc5cc0cbbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:49.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.317+0000 7fc5d4109700 1 --2- 172.21.15.80:0/3852164420 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc5cc0ccc00 0x7fc5cc06b0c0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:49.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.317+0000 7fc5d4109700 1 -- 172.21.15.80:0/3852164420 >> 172.21.15.80:0/3852164420 conn(0x7fc5cc06f140 msgr2=0x7fc5cc1458a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:49.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.317+0000 7fc5d4109700 1 -- 172.21.15.80:0/3852164420 shutdown_connections 2024-05-08T21:10:49.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.317+0000 7fc5d4109700 1 -- 172.21.15.80:0/3852164420 wait complete. 2024-05-08T21:10:49.331 INFO:tasks.mds_thrash:Wait for all MDSs to reach steady state... 2024-05-08T21:10:49.331 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:10:49.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.450+0000 7fac39e93700 1 Processor -- start 2024-05-08T21:10:49.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.450+0000 7fac39e93700 1 -- start start 2024-05-08T21:10:49.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.451+0000 7fac39e93700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fac340c0ea0 0x7fac340c1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:49.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.451+0000 7fac39e93700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fac34156610 0x7fac340c24c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:49.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.451+0000 7fac39e93700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac340c1810 con 0x7fac341508e0 2024-05-08T21:10:49.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.451+0000 7fac39e93700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac34156b70 con 0x7fac340c0ea0 2024-05-08T21:10:49.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.451+0000 7fac39e93700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac34156e50 con 0x7fac34156610 2024-05-08T21:10:49.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.451+0000 7fac337fe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fac341508e0 0x7fac340c6ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:53216/0 (socket says 172.21.15.80:53216) 2024-05-08T21:10:49.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.451+0000 7fac337fe700 1 -- 172.21.15.80:0/2446052461 learned_addr learned my addr 172.21.15.80:0/2446052461 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:10:49.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.451+0000 7fac32ffd700 1 --2- 172.21.15.80:0/2446052461 >> v2:172.21.15.106:3300/0 conn(0x7fac340c0ea0 0x7fac340c1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:49.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.451+0000 7fac33fff700 1 --2- 172.21.15.80:0/2446052461 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fac34156610 0x7fac340c24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:49.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.451+0000 7fac327fc700 1 -- 172.21.15.80:0/2446052461 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1809942186 0 0) 0x7fac340c1810 con 0x7fac341508e0 2024-05-08T21:10:49.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.451+0000 7fac327fc700 1 -- 172.21.15.80:0/2446052461 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac1c0046c0 con 0x7fac341508e0 2024-05-08T21:10:49.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.451+0000 7fac32ffd700 1 -- 172.21.15.80:0/2446052461 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fac34156610 msgr2=0x7fac340c24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:49.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.451+0000 7fac32ffd700 1 --2- 172.21.15.80:0/2446052461 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fac34156610 0x7fac340c24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:49.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.451+0000 7fac32ffd700 1 -- 172.21.15.80:0/2446052461 >> v1:172.21.15.80:6789/0 conn(0x7fac341508e0 legacy=0x7fac340c6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:49.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.451+0000 7fac32ffd700 1 -- 172.21.15.80:0/2446052461 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac34157130 con 0x7fac340c0ea0 2024-05-08T21:10:49.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.452+0000 7fac32ffd700 1 --2- 172.21.15.80:0/2446052461 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fac340c0ea0 0x7fac340c1f80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fac28009840 tx=0x7fac28009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8be346a63cdbb904 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:49.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.452+0000 7fac327fc700 1 -- 172.21.15.80:0/2446052461 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac28011830 con 0x7fac340c0ea0 2024-05-08T21:10:49.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.452+0000 7fac327fc700 1 -- 172.21.15.80:0/2446052461 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac28011990 con 0x7fac340c0ea0 2024-05-08T21:10:49.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.452+0000 7fac327fc700 1 -- 172.21.15.80:0/2446052461 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac28011d00 con 0x7fac340c0ea0 2024-05-08T21:10:49.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.452+0000 7fac39e93700 1 -- 172.21.15.80:0/2446052461 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fac340c0ea0 msgr2=0x7fac340c1f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:49.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.452+0000 7fac39e93700 1 --2- 172.21.15.80:0/2446052461 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fac340c0ea0 0x7fac340c1f80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fac28009840 tx=0x7fac28009b50 comp rx=0 tx=0).stop 2024-05-08T21:10:49.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.452+0000 7fac39e93700 1 -- 172.21.15.80:0/2446052461 shutdown_connections 2024-05-08T21:10:49.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.452+0000 7fac39e93700 1 --2- 172.21.15.80:0/2446052461 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fac34156610 0x7fac340c24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:49.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.452+0000 7fac39e93700 1 --2- 172.21.15.80:0/2446052461 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fac340c0ea0 0x7fac340c1f80 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:49.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.452+0000 7fac39e93700 1 -- 172.21.15.80:0/2446052461 >> 172.21.15.80:0/2446052461 conn(0x7fac340c8980 msgr2=0x7fac340c8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:49.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.452+0000 7fac39e93700 1 -- 172.21.15.80:0/2446052461 shutdown_connections 2024-05-08T21:10:49.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.453+0000 7fac39e93700 1 -- 172.21.15.80:0/2446052461 wait complete. 2024-05-08T21:10:49.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.454+0000 7fac39e93700 1 Processor -- start 2024-05-08T21:10:49.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.454+0000 7fac39e93700 1 -- start start 2024-05-08T21:10:49.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.455+0000 7fac39e93700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fac340c0ea0 0x7fac341e0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:49.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.455+0000 7fac39e93700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fac341508e0 0x7fac3414b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:49.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.455+0000 7fac39e93700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fac34156610 0x7fac341eebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:49.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.455+0000 7fac39e93700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac341466c0 con 0x7fac341508e0 2024-05-08T21:10:49.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.455+0000 7fac39e93700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac34146980 con 0x7fac34156610 2024-05-08T21:10:49.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.455+0000 7fac39e93700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac3414ddc0 con 0x7fac340c0ea0 2024-05-08T21:10:49.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.455+0000 7fac32ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fac341508e0 0x7fac3414b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:49.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.455+0000 7fac32ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fac341508e0 0x7fac3414b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34780/0 (socket says 172.21.15.80:34780) 2024-05-08T21:10:49.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.455+0000 7fac32ffd700 1 -- 172.21.15.80:0/3118438145 learned_addr learned my addr 172.21.15.80:0/3118438145 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:49.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.455+0000 7fac337fe700 1 --2- 172.21.15.80:0/3118438145 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fac340c0ea0 0x7fac341e0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:49.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.455+0000 7fac33fff700 1 --2- 172.21.15.80:0/3118438145 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fac34156610 0x7fac341eebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:49.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.455+0000 7fac32ffd700 1 -- 172.21.15.80:0/3118438145 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fac340c0ea0 msgr2=0x7fac341e0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:49.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.455+0000 7fac32ffd700 1 --2- 172.21.15.80:0/3118438145 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fac340c0ea0 0x7fac341e0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:49.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.455+0000 7fac32ffd700 1 -- 172.21.15.80:0/3118438145 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fac34156610 msgr2=0x7fac341eebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:49.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.455+0000 7fac32ffd700 1 --2- 172.21.15.80:0/3118438145 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fac34156610 0x7fac341eebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:49.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.455+0000 7fac32ffd700 1 -- 172.21.15.80:0/3118438145 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac280094a0 con 0x7fac341508e0 2024-05-08T21:10:49.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.455+0000 7fac33fff700 1 --2- 172.21.15.80:0/3118438145 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fac34156610 0x7fac341eebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:10:49.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.455+0000 7fac337fe700 1 --2- 172.21.15.80:0/3118438145 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fac340c0ea0 0x7fac341e0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:10:49.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.456+0000 7fac32ffd700 1 --2- 172.21.15.80:0/3118438145 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fac341508e0 0x7fac3414b970 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fac28009fd0 tx=0x7fac28004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:49.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.456+0000 7fac1bfff700 1 -- 172.21.15.80:0/3118438145 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac280043c0 con 0x7fac341508e0 2024-05-08T21:10:49.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.456+0000 7fac1bfff700 1 -- 172.21.15.80:0/3118438145 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac28004520 con 0x7fac341508e0 2024-05-08T21:10:49.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.456+0000 7fac1bfff700 1 -- 172.21.15.80:0/3118438145 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac280038c0 con 0x7fac341508e0 2024-05-08T21:10:49.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.456+0000 7fac39e93700 1 -- 172.21.15.80:0/3118438145 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac3414e0a0 con 0x7fac341508e0 2024-05-08T21:10:49.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.456+0000 7fac39e93700 1 -- 172.21.15.80:0/3118438145 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac3414e660 con 0x7fac341508e0 2024-05-08T21:10:49.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.457+0000 7fac39e93700 1 -- 172.21.15.80:0/3118438145 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac3404ec60 con 0x7fac341508e0 2024-05-08T21:10:49.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.457+0000 7fac1bfff700 1 -- 172.21.15.80:0/3118438145 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fac28023070 con 0x7fac341508e0 2024-05-08T21:10:49.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.458+0000 7fac1bfff700 1 --2- 172.21.15.80:0/3118438145 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fac2006acc0 0x7fac2006d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:49.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.458+0000 7fac1bfff700 1 -- 172.21.15.80:0/3118438145 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fac2808c160 con 0x7fac341508e0 2024-05-08T21:10:49.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.458+0000 7fac337fe700 1 --2- 172.21.15.80:0/3118438145 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fac2006acc0 0x7fac2006d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:49.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.458+0000 7fac337fe700 1 --2- 172.21.15.80:0/3118438145 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fac2006acc0 0x7fac2006d180 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fac24005910 tx=0x7fac24009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:49.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.462+0000 7fac1bfff700 1 -- 172.21.15.80:0/3118438145 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fac28057060 con 0x7fac341508e0 2024-05-08T21:10:49.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.702+0000 7fac39e93700 1 -- 172.21.15.80:0/3118438145 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fac34154340 con 0x7fac341508e0 2024-05-08T21:10:49.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.703+0000 7fac1bfff700 1 -- 172.21.15.80:0/3118438145 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6254 (secure 0 0 0) 0x7fac2805a680 con 0x7fac341508e0 2024-05-08T21:10:49.705 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:10:49.705 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/2289230272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":2289230272},{"type":"v1","addr":"172.21.15.106:6833","nonce":2289230272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:10:31.304591+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.106:6836/1949999190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1949999190},{"type":"v1","addr":"172.21.15.106:6836","nonce":1949999190}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:10:49.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.705+0000 7fac39e93700 1 -- 172.21.15.80:0/3118438145 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fac2006acc0 msgr2=0x7fac2006d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:49.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.705+0000 7fac39e93700 1 --2- 172.21.15.80:0/3118438145 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fac2006acc0 0x7fac2006d180 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fac24005910 tx=0x7fac24009040 comp rx=0 tx=0).stop 2024-05-08T21:10:49.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.705+0000 7fac39e93700 1 -- 172.21.15.80:0/3118438145 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fac341508e0 msgr2=0x7fac3414b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:49.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.705+0000 7fac39e93700 1 --2- 172.21.15.80:0/3118438145 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fac341508e0 0x7fac3414b970 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fac28009fd0 tx=0x7fac28004750 comp rx=0 tx=0).stop 2024-05-08T21:10:49.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.705+0000 7fac39e93700 1 -- 172.21.15.80:0/3118438145 shutdown_connections 2024-05-08T21:10:49.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.705+0000 7fac39e93700 1 --2- 172.21.15.80:0/3118438145 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fac2006acc0 0x7fac2006d180 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:49.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.705+0000 7fac39e93700 1 --2- 172.21.15.80:0/3118438145 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fac34156610 0x7fac341eebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:49.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.705+0000 7fac39e93700 1 --2- 172.21.15.80:0/3118438145 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fac340c0ea0 0x7fac341e0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:49.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.705+0000 7fac39e93700 1 --2- 172.21.15.80:0/3118438145 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fac341508e0 0x7fac3414b970 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:49.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.705+0000 7fac39e93700 1 -- 172.21.15.80:0/3118438145 >> 172.21.15.80:0/3118438145 conn(0x7fac340c8980 msgr2=0x7fac3414ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:49.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.705+0000 7fac39e93700 1 -- 172.21.15.80:0/3118438145 shutdown_connections 2024-05-08T21:10:49.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.705+0000 7fac39e93700 1 -- 172.21.15.80:0/3118438145 wait complete. 2024-05-08T21:10:49.708 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 10 2024-05-08T21:10:49.720 INFO:tasks.mds_thrash:Ready to start thrashing 2024-05-08T21:10:49.720 INFO:tasks.mds_thrash.ceph_manager:waiting for clean 2024-05-08T21:10:49.720 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T21:10:49.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.839+0000 7fc75ce02700 1 Processor -- start 2024-05-08T21:10:49.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.839+0000 7fc75ce02700 1 -- start start 2024-05-08T21:10:49.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.840+0000 7fc75ce02700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc758141450 0x7fc75806dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:49.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.840+0000 7fc75ce02700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc758158ab0 0x7fc7581628e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:49.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.840+0000 7fc75ce02700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc758158f40 con 0x7fc75806eff0 2024-05-08T21:10:49.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.840+0000 7fc75ce02700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7580c57f0 con 0x7fc758158ab0 2024-05-08T21:10:49.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.840+0000 7fc75ce02700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7580c5a40 con 0x7fc758141450 2024-05-08T21:10:49.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.841+0000 7fc756d9d700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc758158ab0 0x7fc7581628e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:49.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.841+0000 7fc75659c700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc758141450 0x7fc75806dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:49.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.841+0000 7fc75659c700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc758141450 0x7fc75806dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:40302/0 (socket says 172.21.15.80:40302) 2024-05-08T21:10:49.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.841+0000 7fc755d9b700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fc75806eff0 0x7fc7580c7120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.80:45384/0 (socket says 172.21.15.80:45384) 2024-05-08T21:10:49.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.841+0000 7fc756d9d700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc758158ab0 0x7fc7581628e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.80:51632/0 (socket says 172.21.15.80:51632) 2024-05-08T21:10:49.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.841+0000 7fc75659c700 1 -- 172.21.15.80:0/3882025546 learned_addr learned my addr 172.21.15.80:0/3882025546 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:49.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.841+0000 7fc75659c700 1 -- 172.21.15.80:0/3882025546 >> v2:172.21.15.106:3300/0 conn(0x7fc758158ab0 msgr2=0x7fc7581628e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:49.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.841+0000 7fc75659c700 1 --2- 172.21.15.80:0/3882025546 >> v2:172.21.15.106:3300/0 conn(0x7fc758158ab0 0x7fc7581628e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:49.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.841+0000 7fc75659c700 1 -- 172.21.15.80:0/3882025546 >> v1:172.21.15.106:6789/0 conn(0x7fc75806eff0 legacy=0x7fc7580c7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:49.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.841+0000 7fc75659c700 1 -- 172.21.15.80:0/3882025546 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7580cae60 con 0x7fc758141450 2024-05-08T21:10:49.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.841+0000 7fc75659c700 1 --2- 172.21.15.80:0/3882025546 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc758141450 0x7fc75806dce0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc7400098f0 tx=0x7fc740009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d175b15e45cc0829 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:49.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.841+0000 7fc75559a700 1 -- 172.21.15.80:0/3882025546 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc740011830 con 0x7fc758141450 2024-05-08T21:10:49.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.841+0000 7fc75559a700 1 -- 172.21.15.80:0/3882025546 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc740011990 con 0x7fc758141450 2024-05-08T21:10:49.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.841+0000 7fc75559a700 1 -- 172.21.15.80:0/3882025546 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc740011d20 con 0x7fc758141450 2024-05-08T21:10:49.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.842+0000 7fc75ce02700 1 -- 172.21.15.80:0/3882025546 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc758141450 msgr2=0x7fc75806dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:49.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.842+0000 7fc75ce02700 1 --2- 172.21.15.80:0/3882025546 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc758141450 0x7fc75806dce0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc7400098f0 tx=0x7fc740009c00 comp rx=0 tx=0).stop 2024-05-08T21:10:49.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.842+0000 7fc75ce02700 1 -- 172.21.15.80:0/3882025546 shutdown_connections 2024-05-08T21:10:49.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.842+0000 7fc75ce02700 1 --2- 172.21.15.80:0/3882025546 >> v2:172.21.15.106:3300/0 conn(0x7fc758158ab0 0x7fc7581628e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:49.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.842+0000 7fc75ce02700 1 --2- 172.21.15.80:0/3882025546 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc758141450 0x7fc75806dce0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:49.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.842+0000 7fc75ce02700 1 -- 172.21.15.80:0/3882025546 >> 172.21.15.80:0/3882025546 conn(0x7fc7580ca340 msgr2=0x7fc7580ca750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:49.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.842+0000 7fc75ce02700 1 -- 172.21.15.80:0/3882025546 shutdown_connections 2024-05-08T21:10:49.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.842+0000 7fc75ce02700 1 -- 172.21.15.80:0/3882025546 wait complete. 2024-05-08T21:10:49.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.843+0000 7fc75ce02700 1 Processor -- start 2024-05-08T21:10:49.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.843+0000 7fc75ce02700 1 -- start start 2024-05-08T21:10:49.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.844+0000 7fc75ce02700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc75806eff0 0x7fc758159390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:49.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.844+0000 7fc75ce02700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc758141450 0x7fc75815b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:49.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.844+0000 7fc75ce02700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc758158ab0 0x7fc758139fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:49.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.844+0000 7fc75ce02700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc75815a280 con 0x7fc75806eff0 2024-05-08T21:10:49.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.844+0000 7fc75ce02700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc75815adc0 con 0x7fc758158ab0 2024-05-08T21:10:49.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.844+0000 7fc75ce02700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc75806d3a0 con 0x7fc758141450 2024-05-08T21:10:49.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.844+0000 7fc75659c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc75806eff0 0x7fc758159390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:49.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.844+0000 7fc75659c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc75806eff0 0x7fc758159390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34782/0 (socket says 172.21.15.80:34782) 2024-05-08T21:10:49.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.844+0000 7fc75659c700 1 -- 172.21.15.80:0/258986420 learned_addr learned my addr 172.21.15.80:0/258986420 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:49.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.844+0000 7fc755d9b700 1 --2- 172.21.15.80:0/258986420 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc758141450 0x7fc75815b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:49.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.844+0000 7fc756d9d700 1 --2- 172.21.15.80:0/258986420 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc758158ab0 0x7fc758139fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:49.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.845+0000 7fc75659c700 1 -- 172.21.15.80:0/258986420 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc758141450 msgr2=0x7fc75815b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:49.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.845+0000 7fc75659c700 1 --2- 172.21.15.80:0/258986420 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc758141450 0x7fc75815b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:49.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.845+0000 7fc75659c700 1 -- 172.21.15.80:0/258986420 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc758158ab0 msgr2=0x7fc758139fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:49.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.845+0000 7fc75659c700 1 --2- 172.21.15.80:0/258986420 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc758158ab0 0x7fc758139fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:49.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.845+0000 7fc75659c700 1 -- 172.21.15.80:0/258986420 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc740009550 con 0x7fc75806eff0 2024-05-08T21:10:49.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.845+0000 7fc75659c700 1 --2- 172.21.15.80:0/258986420 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc75806eff0 0x7fc758159390 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc740009c40 tx=0x7fc740004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:49.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.845+0000 7fc74effd700 1 -- 172.21.15.80:0/258986420 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc740004240 con 0x7fc75806eff0 2024-05-08T21:10:49.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.845+0000 7fc74effd700 1 -- 172.21.15.80:0/258986420 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc74001f070 con 0x7fc75806eff0 2024-05-08T21:10:49.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.845+0000 7fc75ce02700 1 -- 172.21.15.80:0/258986420 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc75815b340 con 0x7fc75806eff0 2024-05-08T21:10:49.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.845+0000 7fc74effd700 1 -- 172.21.15.80:0/258986420 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7400045e0 con 0x7fc75806eff0 2024-05-08T21:10:49.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.845+0000 7fc75ce02700 1 -- 172.21.15.80:0/258986420 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc758157850 con 0x7fc75806eff0 2024-05-08T21:10:49.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.846+0000 7fc75ce02700 1 -- 172.21.15.80:0/258986420 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc75815b620 con 0x7fc75806eff0 2024-05-08T21:10:49.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.847+0000 7fc74effd700 1 -- 172.21.15.80:0/258986420 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc740021030 con 0x7fc75806eff0 2024-05-08T21:10:49.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.847+0000 7fc74effd700 1 --2- 172.21.15.80:0/258986420 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fc73806ac90 0x7fc73806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:49.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.847+0000 7fc74effd700 1 -- 172.21.15.80:0/258986420 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc74008acd0 con 0x7fc75806eff0 2024-05-08T21:10:49.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.847+0000 7fc755d9b700 1 --2- 172.21.15.80:0/258986420 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fc73806ac90 0x7fc73806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:49.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.848+0000 7fc755d9b700 1 --2- 172.21.15.80:0/258986420 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fc73806ac90 0x7fc73806d150 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc7580cbd60 tx=0x7fc748007ed0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:49.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:49.851+0000 7fc74effd700 1 -- 172.21.15.80:0/258986420 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fc740055c30 con 0x7fc75806eff0 2024-05-08T21:10:50.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.042+0000 7fc75ce02700 1 -- 172.21.15.80:0/258986420 --> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc758158590 con 0x7fc73806ac90 2024-05-08T21:10:50.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.051+0000 7fc74effd700 1 -- 172.21.15.80:0/258986420 <== mgr.4100 v2:172.21.15.80:6832/46731 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345334 (secure 0 0 0) 0x7fc748001330 con 0x7fc73806ac90 2024-05-08T21:10:50.058 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:10:50.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.054+0000 7fc75ce02700 1 -- 172.21.15.80:0/258986420 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fc73806ac90 msgr2=0x7fc73806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:50.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.054+0000 7fc75ce02700 1 --2- 172.21.15.80:0/258986420 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fc73806ac90 0x7fc73806d150 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc7580cbd60 tx=0x7fc748007ed0 comp rx=0 tx=0).stop 2024-05-08T21:10:50.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.054+0000 7fc75ce02700 1 -- 172.21.15.80:0/258986420 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc75806eff0 msgr2=0x7fc758159390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:50.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.054+0000 7fc75ce02700 1 --2- 172.21.15.80:0/258986420 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc75806eff0 0x7fc758159390 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc740009c40 tx=0x7fc740004750 comp rx=0 tx=0).stop 2024-05-08T21:10:50.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.054+0000 7fc75ce02700 1 -- 172.21.15.80:0/258986420 shutdown_connections 2024-05-08T21:10:50.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.054+0000 7fc75ce02700 1 --2- 172.21.15.80:0/258986420 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fc73806ac90 0x7fc73806d150 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:50.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.054+0000 7fc75ce02700 1 --2- 172.21.15.80:0/258986420 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc75806eff0 0x7fc758159390 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:50.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.054+0000 7fc75ce02700 1 --2- 172.21.15.80:0/258986420 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc758158ab0 0x7fc758139fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:50.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.054+0000 7fc75ce02700 1 --2- 172.21.15.80:0/258986420 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc758141450 0x7fc75815b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:50.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.054+0000 7fc75ce02700 1 -- 172.21.15.80:0/258986420 >> 172.21.15.80:0/258986420 conn(0x7fc7580ca340 msgr2=0x7fc7580cc520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:50.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.054+0000 7fc75ce02700 1 -- 172.21.15.80:0/258986420 shutdown_connections 2024-05-08T21:10:50.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.054+0000 7fc75ce02700 1 -- 172.21.15.80:0/258986420 wait complete. 2024-05-08T21:10:50.064 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-05-08T21:10:50.069 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":46,"stamp":"2024-05-08T21:10:48.208483+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594962,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218452,"kb_used_data":2304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756268,"statfs":{"total":773094113280,"available":772870418432,"internally_reserved":0,"allocated":2359296,"data_stored":2040122,"data_compressed":64612,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002887"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.048091+0000","last_change":"2024-05-08T21:10:03.747477+0000","last_active":"2024-05-08T21:10:08.048091+0000","last_peered":"2024-05-08T21:10:08.048091+0000","last_clean":"2024-05-08T21:10:08.048091+0000","last_became_active":"2024-05-08T21:10:03.747059+0000","last_became_peered":"2024-05-08T21:10:03.747059+0000","last_unstale":"2024-05-08T21:10:08.048091+0000","last_undegraded":"2024-05-08T21:10:08.048091+0000","last_fullsized":"2024-05-08T21:10:08.048091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:15:24.340135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.187600+0000","last_change":"2024-05-08T21:10:03.738974+0000","last_active":"2024-05-08T21:10:08.187600+0000","last_peered":"2024-05-08T21:10:08.187600+0000","last_clean":"2024-05-08T21:10:08.187600+0000","last_became_active":"2024-05-08T21:10:03.738466+0000","last_became_peered":"2024-05-08T21:10:03.738466+0000","last_unstale":"2024-05-08T21:10:08.187600+0000","last_undegraded":"2024-05-08T21:10:08.187600+0000","last_fullsized":"2024-05-08T21:10:08.187600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:59.683039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.753636+0000","last_change":"2024-05-08T21:10:03.740146+0000","last_active":"2024-05-08T21:10:07.753636+0000","last_peered":"2024-05-08T21:10:07.753636+0000","last_clean":"2024-05-08T21:10:07.753636+0000","last_became_active":"2024-05-08T21:10:03.739884+0000","last_became_peered":"2024-05-08T21:10:03.739884+0000","last_unstale":"2024-05-08T21:10:07.753636+0000","last_undegraded":"2024-05-08T21:10:07.753636+0000","last_fullsized":"2024-05-08T21:10:07.753636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:51:44.301305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.168400+0000","last_change":"2024-05-08T21:10:03.754159+0000","last_active":"2024-05-08T21:10:08.168400+0000","last_peered":"2024-05-08T21:10:08.168400+0000","last_clean":"2024-05-08T21:10:08.168400+0000","last_became_active":"2024-05-08T21:10:03.753800+0000","last_became_peered":"2024-05-08T21:10:03.753800+0000","last_unstale":"2024-05-08T21:10:08.168400+0000","last_undegraded":"2024-05-08T21:10:08.168400+0000","last_fullsized":"2024-05-08T21:10:08.168400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:41:02.625080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046322+0000","last_change":"2024-05-08T21:10:03.750051+0000","last_active":"2024-05-08T21:10:08.046322+0000","last_peered":"2024-05-08T21:10:08.046322+0000","last_clean":"2024-05-08T21:10:08.046322+0000","last_became_active":"2024-05-08T21:10:03.749730+0000","last_became_peered":"2024-05-08T21:10:03.749730+0000","last_unstale":"2024-05-08T21:10:08.046322+0000","last_undegraded":"2024-05-08T21:10:08.046322+0000","last_fullsized":"2024-05-08T21:10:08.046322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:49.402253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.168597+0000","last_change":"2024-05-08T21:10:03.746043+0000","last_active":"2024-05-08T21:10:08.168597+0000","last_peered":"2024-05-08T21:10:08.168597+0000","last_clean":"2024-05-08T21:10:08.168597+0000","last_became_active":"2024-05-08T21:10:03.745747+0000","last_became_peered":"2024-05-08T21:10:03.745747+0000","last_unstale":"2024-05-08T21:10:08.168597+0000","last_undegraded":"2024-05-08T21:10:08.168597+0000","last_fullsized":"2024-05-08T21:10:08.168597+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:05:49.465405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046256+0000","last_change":"2024-05-08T21:10:03.743802+0000","last_active":"2024-05-08T21:10:08.046256+0000","last_peered":"2024-05-08T21:10:08.046256+0000","last_clean":"2024-05-08T21:10:08.046256+0000","last_became_active":"2024-05-08T21:10:03.743349+0000","last_became_peered":"2024-05-08T21:10:03.743349+0000","last_unstale":"2024-05-08T21:10:08.046256+0000","last_undegraded":"2024-05-08T21:10:08.046256+0000","last_fullsized":"2024-05-08T21:10:08.046256+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:08:06.408724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.757451+0000","last_change":"2024-05-08T21:10:03.747558+0000","last_active":"2024-05-08T21:10:07.757451+0000","last_peered":"2024-05-08T21:10:07.757451+0000","last_clean":"2024-05-08T21:10:07.757451+0000","last_became_active":"2024-05-08T21:10:03.747300+0000","last_became_peered":"2024-05-08T21:10:03.747300+0000","last_unstale":"2024-05-08T21:10:07.757451+0000","last_undegraded":"2024-05-08T21:10:07.757451+0000","last_fullsized":"2024-05-08T21:10:07.757451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:07:50.266894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046942+0000","last_change":"2024-05-08T21:10:03.748221+0000","last_active":"2024-05-08T21:10:08.046942+0000","last_peered":"2024-05-08T21:10:08.046942+0000","last_clean":"2024-05-08T21:10:08.046942+0000","last_became_active":"2024-05-08T21:10:03.747956+0000","last_became_peered":"2024-05-08T21:10:03.747956+0000","last_unstale":"2024-05-08T21:10:08.046942+0000","last_undegraded":"2024-05-08T21:10:08.046942+0000","last_fullsized":"2024-05-08T21:10:08.046942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:27:35.947884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.271333+0000","last_change":"2024-05-08T21:10:03.745291+0000","last_active":"2024-05-08T21:10:08.271333+0000","last_peered":"2024-05-08T21:10:08.271333+0000","last_clean":"2024-05-08T21:10:08.271333+0000","last_became_active":"2024-05-08T21:10:03.744976+0000","last_became_peered":"2024-05-08T21:10:03.744976+0000","last_unstale":"2024-05-08T21:10:08.271333+0000","last_undegraded":"2024-05-08T21:10:08.271333+0000","last_fullsized":"2024-05-08T21:10:08.271333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:36:54.983642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.271323+0000","last_change":"2024-05-08T21:10:03.748518+0000","last_active":"2024-05-08T21:10:08.271323+0000","last_peered":"2024-05-08T21:10:08.271323+0000","last_clean":"2024-05-08T21:10:08.271323+0000","last_became_active":"2024-05-08T21:10:03.748253+0000","last_became_peered":"2024-05-08T21:10:03.748253+0000","last_unstale":"2024-05-08T21:10:08.271323+0000","last_undegraded":"2024-05-08T21:10:08.271323+0000","last_fullsized":"2024-05-08T21:10:08.271323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:03:26.013122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.170038+0000","last_change":"2024-05-08T21:10:03.745985+0000","last_active":"2024-05-08T21:10:08.170038+0000","last_peered":"2024-05-08T21:10:08.170038+0000","last_clean":"2024-05-08T21:10:08.170038+0000","last_became_active":"2024-05-08T21:10:03.745247+0000","last_became_peered":"2024-05-08T21:10:03.745247+0000","last_unstale":"2024-05-08T21:10:08.170038+0000","last_undegraded":"2024-05-08T21:10:08.170038+0000","last_fullsized":"2024-05-08T21:10:08.170038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:59:42.506304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.761196+0000","last_change":"2024-05-08T21:10:03.747016+0000","last_active":"2024-05-08T21:10:07.761196+0000","last_peered":"2024-05-08T21:10:07.761196+0000","last_clean":"2024-05-08T21:10:07.761196+0000","last_became_active":"2024-05-08T21:10:03.746848+0000","last_became_peered":"2024-05-08T21:10:03.746848+0000","last_unstale":"2024-05-08T21:10:07.761196+0000","last_undegraded":"2024-05-08T21:10:07.761196+0000","last_fullsized":"2024-05-08T21:10:07.761196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:41:21.081035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.753493+0000","last_change":"2024-05-08T21:10:03.737984+0000","last_active":"2024-05-08T21:10:07.753493+0000","last_peered":"2024-05-08T21:10:07.753493+0000","last_clean":"2024-05-08T21:10:07.753493+0000","last_became_active":"2024-05-08T21:10:03.737716+0000","last_became_peered":"2024-05-08T21:10:03.737716+0000","last_unstale":"2024-05-08T21:10:07.753493+0000","last_undegraded":"2024-05-08T21:10:07.753493+0000","last_fullsized":"2024-05-08T21:10:07.753493+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:09:47.758272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.186816+0000","last_change":"2024-05-08T21:10:03.744543+0000","last_active":"2024-05-08T21:10:08.186816+0000","last_peered":"2024-05-08T21:10:08.186816+0000","last_clean":"2024-05-08T21:10:08.186816+0000","last_became_active":"2024-05-08T21:10:03.744276+0000","last_became_peered":"2024-05-08T21:10:03.744276+0000","last_unstale":"2024-05-08T21:10:08.186816+0000","last_undegraded":"2024-05-08T21:10:08.186816+0000","last_fullsized":"2024-05-08T21:10:08.186816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:25:04.113297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.167751+0000","last_change":"2024-05-08T21:10:03.746547+0000","last_active":"2024-05-08T21:10:08.167751+0000","last_peered":"2024-05-08T21:10:08.167751+0000","last_clean":"2024-05-08T21:10:08.167751+0000","last_became_active":"2024-05-08T21:10:03.745862+0000","last_became_peered":"2024-05-08T21:10:03.745862+0000","last_unstale":"2024-05-08T21:10:08.167751+0000","last_undegraded":"2024-05-08T21:10:08.167751+0000","last_fullsized":"2024-05-08T21:10:08.167751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:12.776310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169108+0000","last_change":"2024-05-08T21:10:03.754230+0000","last_active":"2024-05-08T21:10:08.169108+0000","last_peered":"2024-05-08T21:10:08.169108+0000","last_clean":"2024-05-08T21:10:08.169108+0000","last_became_active":"2024-05-08T21:10:03.753895+0000","last_became_peered":"2024-05-08T21:10:03.753895+0000","last_unstale":"2024-05-08T21:10:08.169108+0000","last_undegraded":"2024-05-08T21:10:08.169108+0000","last_fullsized":"2024-05-08T21:10:08.169108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:41:47.214215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.751781+0000","last_change":"2024-05-08T21:10:03.743889+0000","last_active":"2024-05-08T21:10:07.751781+0000","last_peered":"2024-05-08T21:10:07.751781+0000","last_clean":"2024-05-08T21:10:07.751781+0000","last_became_active":"2024-05-08T21:10:03.743596+0000","last_became_peered":"2024-05-08T21:10:03.743596+0000","last_unstale":"2024-05-08T21:10:07.751781+0000","last_undegraded":"2024-05-08T21:10:07.751781+0000","last_fullsized":"2024-05-08T21:10:07.751781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:53.981781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046658+0000","last_change":"2024-05-08T21:10:03.743893+0000","last_active":"2024-05-08T21:10:08.046658+0000","last_peered":"2024-05-08T21:10:08.046658+0000","last_clean":"2024-05-08T21:10:08.046658+0000","last_became_active":"2024-05-08T21:10:03.743580+0000","last_became_peered":"2024-05-08T21:10:03.743580+0000","last_unstale":"2024-05-08T21:10:08.046658+0000","last_undegraded":"2024-05-08T21:10:08.046658+0000","last_fullsized":"2024-05-08T21:10:08.046658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:44:21.747625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.059425+0000","last_change":"2024-05-08T21:10:08.052394+0000","last_active":"2024-05-08T21:10:08.059425+0000","last_peered":"2024-05-08T21:10:08.059425+0000","last_clean":"2024-05-08T21:10:08.059425+0000","last_became_active":"2024-05-08T21:10:08.052009+0000","last_became_peered":"2024-05-08T21:10:08.052009+0000","last_unstale":"2024-05-08T21:10:08.059425+0000","last_undegraded":"2024-05-08T21:10:08.059425+0000","last_fullsized":"2024-05-08T21:10:08.059425+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:47:20.148683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"25'4","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.741230+0000","last_change":"2024-05-08T21:10:03.340118+0000","last_active":"2024-05-08T21:10:08.741230+0000","last_peered":"2024-05-08T21:10:08.741230+0000","last_clean":"2024-05-08T21:10:08.741230+0000","last_became_active":"2024-05-08T21:10:03.339847+0000","last_became_peered":"2024-05-08T21:10:03.339847+0000","last_unstale":"2024-05-08T21:10:08.741230+0000","last_undegraded":"2024-05-08T21:10:08.741230+0000","last_fullsized":"2024-05-08T21:10:08.741230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:05:56.369631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.768418+0000","last_change":"2024-05-08T21:10:03.746516+0000","last_active":"2024-05-08T21:10:07.768418+0000","last_peered":"2024-05-08T21:10:07.768418+0000","last_clean":"2024-05-08T21:10:07.768418+0000","last_became_active":"2024-05-08T21:10:03.746383+0000","last_became_peered":"2024-05-08T21:10:03.746383+0000","last_unstale":"2024-05-08T21:10:07.768418+0000","last_undegraded":"2024-05-08T21:10:07.768418+0000","last_fullsized":"2024-05-08T21:10:07.768418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:29:05.305134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169483+0000","last_change":"2024-05-08T21:10:07.766498+0000","last_active":"2024-05-08T21:10:08.169483+0000","last_peered":"2024-05-08T21:10:08.169483+0000","last_clean":"2024-05-08T21:10:08.169483+0000","last_became_active":"2024-05-08T21:10:07.766119+0000","last_became_peered":"2024-05-08T21:10:07.766119+0000","last_unstale":"2024-05-08T21:10:08.169483+0000","last_undegraded":"2024-05-08T21:10:08.169483+0000","last_fullsized":"2024-05-08T21:10:08.169483+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:58:38.720848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"26'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.508429+0000","last_change":"2024-05-08T21:10:03.329414+0000","last_active":"2024-05-08T21:10:08.508429+0000","last_peered":"2024-05-08T21:10:08.508429+0000","last_clean":"2024-05-08T21:10:08.508429+0000","last_became_active":"2024-05-08T21:10:03.328970+0000","last_became_peered":"2024-05-08T21:10:03.328970+0000","last_unstale":"2024-05-08T21:10:08.508429+0000","last_undegraded":"2024-05-08T21:10:08.508429+0000","last_fullsized":"2024-05-08T21:10:08.508429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:34:32.820755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.753820+0000","last_change":"2024-05-08T21:10:03.748566+0000","last_active":"2024-05-08T21:10:07.753820+0000","last_peered":"2024-05-08T21:10:07.753820+0000","last_clean":"2024-05-08T21:10:07.753820+0000","last_became_active":"2024-05-08T21:10:03.747989+0000","last_became_peered":"2024-05-08T21:10:03.747989+0000","last_unstale":"2024-05-08T21:10:07.753820+0000","last_undegraded":"2024-05-08T21:10:07.753820+0000","last_fullsized":"2024-05-08T21:10:07.753820+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:19:03.468394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169607+0000","last_change":"2024-05-08T21:10:07.770390+0000","last_active":"2024-05-08T21:10:08.169607+0000","last_peered":"2024-05-08T21:10:08.169607+0000","last_clean":"2024-05-08T21:10:08.169607+0000","last_became_active":"2024-05-08T21:10:07.770017+0000","last_became_peered":"2024-05-08T21:10:07.770017+0000","last_unstale":"2024-05-08T21:10:08.169607+0000","last_undegraded":"2024-05-08T21:10:08.169607+0000","last_fullsized":"2024-05-08T21:10:08.169607+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:12:00.200848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.738243+0000","last_change":"2024-05-08T21:10:03.339207+0000","last_active":"2024-05-08T21:10:08.738243+0000","last_peered":"2024-05-08T21:10:08.738243+0000","last_clean":"2024-05-08T21:10:08.738243+0000","last_became_active":"2024-05-08T21:10:03.338917+0000","last_became_peered":"2024-05-08T21:10:03.338917+0000","last_unstale":"2024-05-08T21:10:08.738243+0000","last_undegraded":"2024-05-08T21:10:08.738243+0000","last_fullsized":"2024-05-08T21:10:08.738243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:20.676853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.168481+0000","last_change":"2024-05-08T21:10:03.753998+0000","last_active":"2024-05-08T21:10:08.168481+0000","last_peered":"2024-05-08T21:10:08.168481+0000","last_clean":"2024-05-08T21:10:08.168481+0000","last_became_active":"2024-05-08T21:10:03.753720+0000","last_became_peered":"2024-05-08T21:10:03.753720+0000","last_unstale":"2024-05-08T21:10:08.168481+0000","last_undegraded":"2024-05-08T21:10:08.168481+0000","last_fullsized":"2024-05-08T21:10:08.168481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:00:38.531282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169599+0000","last_change":"2024-05-08T21:10:07.776367+0000","last_active":"2024-05-08T21:10:08.169599+0000","last_peered":"2024-05-08T21:10:08.169599+0000","last_clean":"2024-05-08T21:10:08.169599+0000","last_became_active":"2024-05-08T21:10:07.775998+0000","last_became_peered":"2024-05-08T21:10:07.775998+0000","last_unstale":"2024-05-08T21:10:08.169599+0000","last_undegraded":"2024-05-08T21:10:08.169599+0000","last_fullsized":"2024-05-08T21:10:08.169599+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:24:18.845560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.740209+0000","last_change":"2024-05-08T21:10:03.339182+0000","last_active":"2024-05-08T21:10:08.740209+0000","last_peered":"2024-05-08T21:10:08.740209+0000","last_clean":"2024-05-08T21:10:08.740209+0000","last_became_active":"2024-05-08T21:10:03.338899+0000","last_became_peered":"2024-05-08T21:10:03.338899+0000","last_unstale":"2024-05-08T21:10:08.740209+0000","last_undegraded":"2024-05-08T21:10:08.740209+0000","last_fullsized":"2024-05-08T21:10:08.740209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:55:53.368546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.168672+0000","last_change":"2024-05-08T21:10:03.750724+0000","last_active":"2024-05-08T21:10:08.168672+0000","last_peered":"2024-05-08T21:10:08.168672+0000","last_clean":"2024-05-08T21:10:08.168672+0000","last_became_active":"2024-05-08T21:10:03.750371+0000","last_became_peered":"2024-05-08T21:10:03.750371+0000","last_unstale":"2024-05-08T21:10:08.168672+0000","last_undegraded":"2024-05-08T21:10:08.168672+0000","last_fullsized":"2024-05-08T21:10:08.168672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:14:01.935211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.775704+0000","last_change":"2024-05-08T21:10:07.767604+0000","last_active":"2024-05-08T21:10:07.775704+0000","last_peered":"2024-05-08T21:10:07.775704+0000","last_clean":"2024-05-08T21:10:07.775704+0000","last_became_active":"2024-05-08T21:10:07.767234+0000","last_became_peered":"2024-05-08T21:10:07.767234+0000","last_unstale":"2024-05-08T21:10:07.775704+0000","last_undegraded":"2024-05-08T21:10:07.775704+0000","last_fullsized":"2024-05-08T21:10:07.775704+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:30:21.411491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"26'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.508102+0000","last_change":"2024-05-08T21:10:03.338149+0000","last_active":"2024-05-08T21:10:08.508102+0000","last_peered":"2024-05-08T21:10:08.508102+0000","last_clean":"2024-05-08T21:10:08.508102+0000","last_became_active":"2024-05-08T21:10:03.337860+0000","last_became_peered":"2024-05-08T21:10:03.337860+0000","last_unstale":"2024-05-08T21:10:08.508102+0000","last_undegraded":"2024-05-08T21:10:08.508102+0000","last_fullsized":"2024-05-08T21:10:08.508102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:07:39.052625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169664+0000","last_change":"2024-05-08T21:10:03.743506+0000","last_active":"2024-05-08T21:10:08.169664+0000","last_peered":"2024-05-08T21:10:08.169664+0000","last_clean":"2024-05-08T21:10:08.169664+0000","last_became_active":"2024-05-08T21:10:03.743227+0000","last_became_peered":"2024-05-08T21:10:03.743227+0000","last_unstale":"2024-05-08T21:10:08.169664+0000","last_undegraded":"2024-05-08T21:10:08.169664+0000","last_fullsized":"2024-05-08T21:10:08.169664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:45:47.977619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.741849+0000","last_change":"2024-05-08T21:10:07.768424+0000","last_active":"2024-05-08T21:10:08.741849+0000","last_peered":"2024-05-08T21:10:08.741849+0000","last_clean":"2024-05-08T21:10:08.741849+0000","last_became_active":"2024-05-08T21:10:07.768160+0000","last_became_peered":"2024-05-08T21:10:07.768160+0000","last_unstale":"2024-05-08T21:10:08.741849+0000","last_undegraded":"2024-05-08T21:10:08.741849+0000","last_fullsized":"2024-05-08T21:10:08.741849+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:42:44.327080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"26'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.606664+0000","last_change":"2024-05-08T21:10:03.333647+0000","last_active":"2024-05-08T21:10:08.606664+0000","last_peered":"2024-05-08T21:10:08.606664+0000","last_clean":"2024-05-08T21:10:08.606664+0000","last_became_active":"2024-05-08T21:10:03.332844+0000","last_became_peered":"2024-05-08T21:10:03.332844+0000","last_unstale":"2024-05-08T21:10:08.606664+0000","last_undegraded":"2024-05-08T21:10:08.606664+0000","last_fullsized":"2024-05-08T21:10:08.606664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:47:40.344808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.753370+0000","last_change":"2024-05-08T21:10:03.743003+0000","last_active":"2024-05-08T21:10:07.753370+0000","last_peered":"2024-05-08T21:10:07.753370+0000","last_clean":"2024-05-08T21:10:07.753370+0000","last_became_active":"2024-05-08T21:10:03.742753+0000","last_became_peered":"2024-05-08T21:10:03.742753+0000","last_unstale":"2024-05-08T21:10:07.753370+0000","last_undegraded":"2024-05-08T21:10:07.753370+0000","last_fullsized":"2024-05-08T21:10:07.753370+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:45:49.575877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.271366+0000","last_change":"2024-05-08T21:10:07.770105+0000","last_active":"2024-05-08T21:10:08.271366+0000","last_peered":"2024-05-08T21:10:08.271366+0000","last_clean":"2024-05-08T21:10:08.271366+0000","last_became_active":"2024-05-08T21:10:07.769668+0000","last_became_peered":"2024-05-08T21:10:07.769668+0000","last_unstale":"2024-05-08T21:10:08.271366+0000","last_undegraded":"2024-05-08T21:10:08.271366+0000","last_fullsized":"2024-05-08T21:10:08.271366+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:07:21.560031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.766792+0000","last_change":"2024-05-08T21:10:03.333025+0000","last_active":"2024-05-08T21:10:07.766792+0000","last_peered":"2024-05-08T21:10:07.766792+0000","last_clean":"2024-05-08T21:10:07.766792+0000","last_became_active":"2024-05-08T21:10:03.332750+0000","last_became_peered":"2024-05-08T21:10:03.332750+0000","last_unstale":"2024-05-08T21:10:07.766792+0000","last_undegraded":"2024-05-08T21:10:07.766792+0000","last_fullsized":"2024-05-08T21:10:07.766792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:20:50.134647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.756963+0000","last_change":"2024-05-08T21:10:03.744023+0000","last_active":"2024-05-08T21:10:07.756963+0000","last_peered":"2024-05-08T21:10:07.756963+0000","last_clean":"2024-05-08T21:10:07.756963+0000","last_became_active":"2024-05-08T21:10:03.743724+0000","last_became_peered":"2024-05-08T21:10:03.743724+0000","last_unstale":"2024-05-08T21:10:07.756963+0000","last_undegraded":"2024-05-08T21:10:07.756963+0000","last_fullsized":"2024-05-08T21:10:07.756963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:50:36.857245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.059558+0000","last_change":"2024-05-08T21:10:08.052307+0000","last_active":"2024-05-08T21:10:08.059558+0000","last_peered":"2024-05-08T21:10:08.059558+0000","last_clean":"2024-05-08T21:10:08.059558+0000","last_became_active":"2024-05-08T21:10:08.051924+0000","last_became_peered":"2024-05-08T21:10:08.051924+0000","last_unstale":"2024-05-08T21:10:08.059558+0000","last_undegraded":"2024-05-08T21:10:08.059558+0000","last_fullsized":"2024-05-08T21:10:08.059558+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:56:37.264246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.750197+0000","last_change":"2024-05-08T21:10:03.330304+0000","last_active":"2024-05-08T21:10:07.750197+0000","last_peered":"2024-05-08T21:10:07.750197+0000","last_clean":"2024-05-08T21:10:07.750197+0000","last_became_active":"2024-05-08T21:10:03.330054+0000","last_became_peered":"2024-05-08T21:10:03.330054+0000","last_unstale":"2024-05-08T21:10:07.750197+0000","last_undegraded":"2024-05-08T21:10:07.750197+0000","last_fullsized":"2024-05-08T21:10:07.750197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:30.518935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.186997+0000","last_change":"2024-05-08T21:10:03.739687+0000","last_active":"2024-05-08T21:10:08.186997+0000","last_peered":"2024-05-08T21:10:08.186997+0000","last_clean":"2024-05-08T21:10:08.186997+0000","last_became_active":"2024-05-08T21:10:03.739425+0000","last_became_peered":"2024-05-08T21:10:03.739425+0000","last_unstale":"2024-05-08T21:10:08.186997+0000","last_undegraded":"2024-05-08T21:10:08.186997+0000","last_fullsized":"2024-05-08T21:10:08.186997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:45:59.295081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.054235+0000","last_change":"2024-05-08T21:10:08.050980+0000","last_active":"2024-05-08T21:10:08.054235+0000","last_peered":"2024-05-08T21:10:08.054235+0000","last_clean":"2024-05-08T21:10:08.054235+0000","last_became_active":"2024-05-08T21:10:08.050625+0000","last_became_peered":"2024-05-08T21:10:08.050625+0000","last_unstale":"2024-05-08T21:10:08.054235+0000","last_undegraded":"2024-05-08T21:10:08.054235+0000","last_fullsized":"2024-05-08T21:10:08.054235+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:39:43.917363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.755963+0000","last_change":"2024-05-08T21:10:03.331297+0000","last_active":"2024-05-08T21:10:07.755963+0000","last_peered":"2024-05-08T21:10:07.755963+0000","last_clean":"2024-05-08T21:10:07.755963+0000","last_became_active":"2024-05-08T21:10:03.330973+0000","last_became_peered":"2024-05-08T21:10:03.330973+0000","last_unstale":"2024-05-08T21:10:07.755963+0000","last_undegraded":"2024-05-08T21:10:07.755963+0000","last_fullsized":"2024-05-08T21:10:07.755963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:57:26.190186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.168346+0000","last_change":"2024-05-08T21:10:03.751746+0000","last_active":"2024-05-08T21:10:08.168346+0000","last_peered":"2024-05-08T21:10:08.168346+0000","last_clean":"2024-05-08T21:10:08.168346+0000","last_became_active":"2024-05-08T21:10:03.751426+0000","last_became_peered":"2024-05-08T21:10:03.751426+0000","last_unstale":"2024-05-08T21:10:08.168346+0000","last_undegraded":"2024-05-08T21:10:08.168346+0000","last_fullsized":"2024-05-08T21:10:08.168346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:00:23.529543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.778416+0000","last_change":"2024-05-08T21:10:07.771834+0000","last_active":"2024-05-08T21:10:07.778416+0000","last_peered":"2024-05-08T21:10:07.778416+0000","last_clean":"2024-05-08T21:10:07.778416+0000","last_became_active":"2024-05-08T21:10:07.771324+0000","last_became_peered":"2024-05-08T21:10:07.771324+0000","last_unstale":"2024-05-08T21:10:07.778416+0000","last_undegraded":"2024-05-08T21:10:07.778416+0000","last_fullsized":"2024-05-08T21:10:07.778416+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:35.948317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.749656+0000","last_change":"2024-05-08T21:10:03.332049+0000","last_active":"2024-05-08T21:10:07.749656+0000","last_peered":"2024-05-08T21:10:07.749656+0000","last_clean":"2024-05-08T21:10:07.749656+0000","last_became_active":"2024-05-08T21:10:03.331712+0000","last_became_peered":"2024-05-08T21:10:03.331712+0000","last_unstale":"2024-05-08T21:10:07.749656+0000","last_undegraded":"2024-05-08T21:10:07.749656+0000","last_fullsized":"2024-05-08T21:10:07.749656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:30:16.135672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.753983+0000","last_change":"2024-05-08T21:10:03.748728+0000","last_active":"2024-05-08T21:10:07.753983+0000","last_peered":"2024-05-08T21:10:07.753983+0000","last_clean":"2024-05-08T21:10:07.753983+0000","last_became_active":"2024-05-08T21:10:03.748315+0000","last_became_peered":"2024-05-08T21:10:03.748315+0000","last_unstale":"2024-05-08T21:10:07.753983+0000","last_undegraded":"2024-05-08T21:10:07.753983+0000","last_fullsized":"2024-05-08T21:10:07.753983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:14:15.224603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.170061+0000","last_change":"2024-05-08T21:10:07.761559+0000","last_active":"2024-05-08T21:10:08.170061+0000","last_peered":"2024-05-08T21:10:08.170061+0000","last_clean":"2024-05-08T21:10:08.170061+0000","last_became_active":"2024-05-08T21:10:07.761129+0000","last_became_peered":"2024-05-08T21:10:07.761129+0000","last_unstale":"2024-05-08T21:10:08.170061+0000","last_undegraded":"2024-05-08T21:10:08.170061+0000","last_fullsized":"2024-05-08T21:10:08.170061+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:29:03.444853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'3","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.737377+0000","last_change":"2024-05-08T21:10:03.333077+0000","last_active":"2024-05-08T21:10:08.737377+0000","last_peered":"2024-05-08T21:10:08.737377+0000","last_clean":"2024-05-08T21:10:08.737377+0000","last_became_active":"2024-05-08T21:10:03.332796+0000","last_became_peered":"2024-05-08T21:10:03.332796+0000","last_unstale":"2024-05-08T21:10:08.737377+0000","last_undegraded":"2024-05-08T21:10:08.737377+0000","last_fullsized":"2024-05-08T21:10:08.737377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:30:16.135672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169929+0000","last_change":"2024-05-08T21:10:03.751370+0000","last_active":"2024-05-08T21:10:08.169929+0000","last_peered":"2024-05-08T21:10:08.169929+0000","last_clean":"2024-05-08T21:10:08.169929+0000","last_became_active":"2024-05-08T21:10:03.750394+0000","last_became_peered":"2024-05-08T21:10:03.750394+0000","last_unstale":"2024-05-08T21:10:08.169929+0000","last_undegraded":"2024-05-08T21:10:08.169929+0000","last_fullsized":"2024-05-08T21:10:08.169929+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:31:06.682543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.187439+0000","last_change":"2024-05-08T21:10:07.764815+0000","last_active":"2024-05-08T21:10:08.187439+0000","last_peered":"2024-05-08T21:10:08.187439+0000","last_clean":"2024-05-08T21:10:08.187439+0000","last_became_active":"2024-05-08T21:10:07.763591+0000","last_became_peered":"2024-05-08T21:10:07.763591+0000","last_unstale":"2024-05-08T21:10:08.187439+0000","last_undegraded":"2024-05-08T21:10:08.187439+0000","last_fullsized":"2024-05-08T21:10:08.187439+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:47.977517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:17.506385+0000","last_change":"2024-05-08T21:10:03.342400+0000","last_active":"2024-05-08T21:10:17.506385+0000","last_peered":"2024-05-08T21:10:17.506385+0000","last_clean":"2024-05-08T21:10:17.506385+0000","last_became_active":"2024-05-08T21:10:03.342202+0000","last_became_peered":"2024-05-08T21:10:03.342202+0000","last_unstale":"2024-05-08T21:10:17.506385+0000","last_undegraded":"2024-05-08T21:10:17.506385+0000","last_fullsized":"2024-05-08T21:10:17.506385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:10:04.668029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3796,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046564+0000","last_change":"2024-05-08T21:10:03.752144+0000","last_active":"2024-05-08T21:10:08.046564+0000","last_peered":"2024-05-08T21:10:08.046564+0000","last_clean":"2024-05-08T21:10:08.046564+0000","last_became_active":"2024-05-08T21:10:03.751868+0000","last_became_peered":"2024-05-08T21:10:03.751868+0000","last_unstale":"2024-05-08T21:10:08.046564+0000","last_undegraded":"2024-05-08T21:10:08.046564+0000","last_fullsized":"2024-05-08T21:10:08.046564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:40:43.168591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.168406+0000","last_change":"2024-05-08T21:10:08.052390+0000","last_active":"2024-05-08T21:10:08.168406+0000","last_peered":"2024-05-08T21:10:08.168406+0000","last_clean":"2024-05-08T21:10:08.168406+0000","last_became_active":"2024-05-08T21:10:08.051967+0000","last_became_peered":"2024-05-08T21:10:08.051967+0000","last_unstale":"2024-05-08T21:10:08.168406+0000","last_undegraded":"2024-05-08T21:10:08.168406+0000","last_fullsized":"2024-05-08T21:10:08.168406+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:40:07.127492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.739991+0000","last_change":"2024-05-08T21:10:03.330102+0000","last_active":"2024-05-08T21:10:08.739991+0000","last_peered":"2024-05-08T21:10:08.739991+0000","last_clean":"2024-05-08T21:10:08.739991+0000","last_became_active":"2024-05-08T21:10:03.329761+0000","last_became_peered":"2024-05-08T21:10:03.329761+0000","last_unstale":"2024-05-08T21:10:08.739991+0000","last_undegraded":"2024-05-08T21:10:08.739991+0000","last_fullsized":"2024-05-08T21:10:08.739991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:37:14.930549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.753579+0000","last_change":"2024-05-08T21:10:03.749332+0000","last_active":"2024-05-08T21:10:07.753579+0000","last_peered":"2024-05-08T21:10:07.753579+0000","last_clean":"2024-05-08T21:10:07.753579+0000","last_became_active":"2024-05-08T21:10:03.749094+0000","last_became_peered":"2024-05-08T21:10:03.749094+0000","last_unstale":"2024-05-08T21:10:07.753579+0000","last_undegraded":"2024-05-08T21:10:07.753579+0000","last_fullsized":"2024-05-08T21:10:07.753579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:25.969085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.048813+0000","last_change":"2024-05-08T21:10:08.048331+0000","last_active":"2024-05-08T21:10:08.048813+0000","last_peered":"2024-05-08T21:10:08.048813+0000","last_clean":"2024-05-08T21:10:08.048813+0000","last_became_active":"2024-05-08T21:10:08.047505+0000","last_became_peered":"2024-05-08T21:10:08.047505+0000","last_unstale":"2024-05-08T21:10:08.048813+0000","last_undegraded":"2024-05-08T21:10:08.048813+0000","last_fullsized":"2024-05-08T21:10:08.048813+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:18:39.268730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.749622+0000","last_change":"2024-05-08T21:10:03.328021+0000","last_active":"2024-05-08T21:10:07.749622+0000","last_peered":"2024-05-08T21:10:07.749622+0000","last_clean":"2024-05-08T21:10:07.749622+0000","last_became_active":"2024-05-08T21:10:03.327648+0000","last_became_peered":"2024-05-08T21:10:03.327648+0000","last_unstale":"2024-05-08T21:10:07.749622+0000","last_undegraded":"2024-05-08T21:10:07.749622+0000","last_fullsized":"2024-05-08T21:10:07.749622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:37:54.491930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046495+0000","last_change":"2024-05-08T21:10:03.750560+0000","last_active":"2024-05-08T21:10:08.046495+0000","last_peered":"2024-05-08T21:10:08.046495+0000","last_clean":"2024-05-08T21:10:08.046495+0000","last_became_active":"2024-05-08T21:10:03.750294+0000","last_became_peered":"2024-05-08T21:10:03.750294+0000","last_unstale":"2024-05-08T21:10:08.046495+0000","last_undegraded":"2024-05-08T21:10:08.046495+0000","last_fullsized":"2024-05-08T21:10:08.046495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:30:47.937326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.059433+0000","last_change":"2024-05-08T21:10:08.052318+0000","last_active":"2024-05-08T21:10:08.059433+0000","last_peered":"2024-05-08T21:10:08.059433+0000","last_clean":"2024-05-08T21:10:08.059433+0000","last_became_active":"2024-05-08T21:10:08.051920+0000","last_became_peered":"2024-05-08T21:10:08.051920+0000","last_unstale":"2024-05-08T21:10:08.059433+0000","last_undegraded":"2024-05-08T21:10:08.059433+0000","last_fullsized":"2024-05-08T21:10:08.059433+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:25:27.669768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.754124+0000","last_change":"2024-05-08T21:10:03.332390+0000","last_active":"2024-05-08T21:10:07.754124+0000","last_peered":"2024-05-08T21:10:07.754124+0000","last_clean":"2024-05-08T21:10:07.754124+0000","last_became_active":"2024-05-08T21:10:03.332105+0000","last_became_peered":"2024-05-08T21:10:03.332105+0000","last_unstale":"2024-05-08T21:10:07.754124+0000","last_undegraded":"2024-05-08T21:10:07.754124+0000","last_fullsized":"2024-05-08T21:10:07.754124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:32:44.705682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.271145+0000","last_change":"2024-05-08T21:10:03.742100+0000","last_active":"2024-05-08T21:10:08.271145+0000","last_peered":"2024-05-08T21:10:08.271145+0000","last_clean":"2024-05-08T21:10:08.271145+0000","last_became_active":"2024-05-08T21:10:03.741742+0000","last_became_peered":"2024-05-08T21:10:03.741742+0000","last_unstale":"2024-05-08T21:10:08.271145+0000","last_undegraded":"2024-05-08T21:10:08.271145+0000","last_fullsized":"2024-05-08T21:10:08.271145+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:53:19.394126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.775032+0000","last_change":"2024-05-08T21:10:07.769850+0000","last_active":"2024-05-08T21:10:07.775032+0000","last_peered":"2024-05-08T21:10:07.775032+0000","last_clean":"2024-05-08T21:10:07.775032+0000","last_became_active":"2024-05-08T21:10:07.769016+0000","last_became_peered":"2024-05-08T21:10:07.769016+0000","last_unstale":"2024-05-08T21:10:07.775032+0000","last_undegraded":"2024-05-08T21:10:07.775032+0000","last_fullsized":"2024-05-08T21:10:07.775032+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:31:52.621418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"25'8","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.741624+0000","last_change":"2024-05-08T21:10:03.331783+0000","last_active":"2024-05-08T21:10:08.741624+0000","last_peered":"2024-05-08T21:10:08.741624+0000","last_clean":"2024-05-08T21:10:08.741624+0000","last_became_active":"2024-05-08T21:10:03.331501+0000","last_became_peered":"2024-05-08T21:10:03.331501+0000","last_unstale":"2024-05-08T21:10:08.741624+0000","last_undegraded":"2024-05-08T21:10:08.741624+0000","last_fullsized":"2024-05-08T21:10:08.741624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:41:28.137295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046481+0000","last_change":"2024-05-08T21:10:03.744007+0000","last_active":"2024-05-08T21:10:08.046481+0000","last_peered":"2024-05-08T21:10:08.046481+0000","last_clean":"2024-05-08T21:10:08.046481+0000","last_became_active":"2024-05-08T21:10:03.743557+0000","last_became_peered":"2024-05-08T21:10:03.743557+0000","last_unstale":"2024-05-08T21:10:08.046481+0000","last_undegraded":"2024-05-08T21:10:08.046481+0000","last_fullsized":"2024-05-08T21:10:08.046481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:45:26.458377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169408+0000","last_change":"2024-05-08T21:10:07.777283+0000","last_active":"2024-05-08T21:10:08.169408+0000","last_peered":"2024-05-08T21:10:08.169408+0000","last_clean":"2024-05-08T21:10:08.169408+0000","last_became_active":"2024-05-08T21:10:07.776858+0000","last_became_peered":"2024-05-08T21:10:07.776858+0000","last_unstale":"2024-05-08T21:10:08.169408+0000","last_undegraded":"2024-05-08T21:10:08.169408+0000","last_fullsized":"2024-05-08T21:10:08.169408+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:51.725885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"26'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.170185+0000","last_change":"2024-05-08T21:10:03.326892+0000","last_active":"2024-05-08T21:10:08.170185+0000","last_peered":"2024-05-08T21:10:08.170185+0000","last_clean":"2024-05-08T21:10:08.170185+0000","last_became_active":"2024-05-08T21:10:03.326608+0000","last_became_peered":"2024-05-08T21:10:03.326608+0000","last_unstale":"2024-05-08T21:10:08.170185+0000","last_undegraded":"2024-05-08T21:10:08.170185+0000","last_fullsized":"2024-05-08T21:10:08.170185+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:33.441985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046649+0000","last_change":"2024-05-08T21:10:03.749221+0000","last_active":"2024-05-08T21:10:08.046649+0000","last_peered":"2024-05-08T21:10:08.046649+0000","last_clean":"2024-05-08T21:10:08.046649+0000","last_became_active":"2024-05-08T21:10:03.748915+0000","last_became_peered":"2024-05-08T21:10:03.748915+0000","last_unstale":"2024-05-08T21:10:08.046649+0000","last_undegraded":"2024-05-08T21:10:08.046649+0000","last_fullsized":"2024-05-08T21:10:08.046649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:03:10.791535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.187371+0000","last_change":"2024-05-08T21:10:07.759492+0000","last_active":"2024-05-08T21:10:08.187371+0000","last_peered":"2024-05-08T21:10:08.187371+0000","last_clean":"2024-05-08T21:10:08.187371+0000","last_became_active":"2024-05-08T21:10:07.759139+0000","last_became_peered":"2024-05-08T21:10:07.759139+0000","last_unstale":"2024-05-08T21:10:08.187371+0000","last_undegraded":"2024-05-08T21:10:08.187371+0000","last_fullsized":"2024-05-08T21:10:08.187371+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:10.579105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.743655+0000","last_change":"2024-05-08T21:10:03.329020+0000","last_active":"2024-05-08T21:10:07.743655+0000","last_peered":"2024-05-08T21:10:07.743655+0000","last_clean":"2024-05-08T21:10:07.743655+0000","last_became_active":"2024-05-08T21:10:03.328739+0000","last_became_peered":"2024-05-08T21:10:03.328739+0000","last_unstale":"2024-05-08T21:10:07.743655+0000","last_undegraded":"2024-05-08T21:10:07.743655+0000","last_fullsized":"2024-05-08T21:10:07.743655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:27:11.168780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.168756+0000","last_change":"2024-05-08T21:10:03.744662+0000","last_active":"2024-05-08T21:10:08.168756+0000","last_peered":"2024-05-08T21:10:08.168756+0000","last_clean":"2024-05-08T21:10:08.168756+0000","last_became_active":"2024-05-08T21:10:03.744398+0000","last_became_peered":"2024-05-08T21:10:03.744398+0000","last_unstale":"2024-05-08T21:10:08.168756+0000","last_undegraded":"2024-05-08T21:10:08.168756+0000","last_fullsized":"2024-05-08T21:10:08.168756+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:05:28.046055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.187253+0000","last_change":"2024-05-08T21:10:07.776566+0000","last_active":"2024-05-08T21:10:08.187253+0000","last_peered":"2024-05-08T21:10:08.187253+0000","last_clean":"2024-05-08T21:10:08.187253+0000","last_became_active":"2024-05-08T21:10:07.776080+0000","last_became_peered":"2024-05-08T21:10:07.776080+0000","last_unstale":"2024-05-08T21:10:08.187253+0000","last_undegraded":"2024-05-08T21:10:08.187253+0000","last_fullsized":"2024-05-08T21:10:08.187253+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:26:09.323466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.749542+0000","last_change":"2024-05-08T21:10:03.332953+0000","last_active":"2024-05-08T21:10:07.749542+0000","last_peered":"2024-05-08T21:10:07.749542+0000","last_clean":"2024-05-08T21:10:07.749542+0000","last_became_active":"2024-05-08T21:10:03.332689+0000","last_became_peered":"2024-05-08T21:10:03.332689+0000","last_unstale":"2024-05-08T21:10:07.749542+0000","last_undegraded":"2024-05-08T21:10:07.749542+0000","last_fullsized":"2024-05-08T21:10:07.749542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:15:32.058369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169816+0000","last_change":"2024-05-08T21:10:03.745651+0000","last_active":"2024-05-08T21:10:08.169816+0000","last_peered":"2024-05-08T21:10:08.169816+0000","last_clean":"2024-05-08T21:10:08.169816+0000","last_became_active":"2024-05-08T21:10:03.742744+0000","last_became_peered":"2024-05-08T21:10:03.742744+0000","last_unstale":"2024-05-08T21:10:08.169816+0000","last_undegraded":"2024-05-08T21:10:08.169816+0000","last_fullsized":"2024-05-08T21:10:08.169816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:32:31.689490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.187096+0000","last_change":"2024-05-08T21:10:07.776527+0000","last_active":"2024-05-08T21:10:08.187096+0000","last_peered":"2024-05-08T21:10:08.187096+0000","last_clean":"2024-05-08T21:10:08.187096+0000","last_became_active":"2024-05-08T21:10:07.776053+0000","last_became_peered":"2024-05-08T21:10:07.776053+0000","last_unstale":"2024-05-08T21:10:08.187096+0000","last_undegraded":"2024-05-08T21:10:08.187096+0000","last_fullsized":"2024-05-08T21:10:08.187096+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:08:26.401358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.186861+0000","last_change":"2024-05-08T21:10:03.738421+0000","last_active":"2024-05-08T21:10:08.186861+0000","last_peered":"2024-05-08T21:10:08.186861+0000","last_clean":"2024-05-08T21:10:08.186861+0000","last_became_active":"2024-05-08T21:10:03.738000+0000","last_became_peered":"2024-05-08T21:10:03.738000+0000","last_unstale":"2024-05-08T21:10:08.186861+0000","last_undegraded":"2024-05-08T21:10:08.186861+0000","last_fullsized":"2024-05-08T21:10:08.186861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:38:05.948755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.751476+0000","last_change":"2024-05-08T21:10:03.331141+0000","last_active":"2024-05-08T21:10:07.751476+0000","last_peered":"2024-05-08T21:10:07.751476+0000","last_clean":"2024-05-08T21:10:07.751476+0000","last_became_active":"2024-05-08T21:10:03.330842+0000","last_became_peered":"2024-05-08T21:10:03.330842+0000","last_unstale":"2024-05-08T21:10:07.751476+0000","last_undegraded":"2024-05-08T21:10:07.751476+0000","last_fullsized":"2024-05-08T21:10:07.751476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:42:52.648932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.271310+0000","last_change":"2024-05-08T21:10:08.049274+0000","last_active":"2024-05-08T21:10:08.271310+0000","last_peered":"2024-05-08T21:10:08.271310+0000","last_clean":"2024-05-08T21:10:08.271310+0000","last_became_active":"2024-05-08T21:10:08.048763+0000","last_became_peered":"2024-05-08T21:10:08.048763+0000","last_unstale":"2024-05-08T21:10:08.271310+0000","last_undegraded":"2024-05-08T21:10:08.271310+0000","last_fullsized":"2024-05-08T21:10:08.271310+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:00:41.257040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.754546+0000","last_change":"2024-05-08T21:10:03.747594+0000","last_active":"2024-05-08T21:10:07.754546+0000","last_peered":"2024-05-08T21:10:07.754546+0000","last_clean":"2024-05-08T21:10:07.754546+0000","last_became_active":"2024-05-08T21:10:03.747360+0000","last_became_peered":"2024-05-08T21:10:03.747360+0000","last_unstale":"2024-05-08T21:10:07.754546+0000","last_undegraded":"2024-05-08T21:10:07.754546+0000","last_fullsized":"2024-05-08T21:10:07.754546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:31:12.357348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.749455+0000","last_change":"2024-05-08T21:10:03.327847+0000","last_active":"2024-05-08T21:10:07.749455+0000","last_peered":"2024-05-08T21:10:07.749455+0000","last_clean":"2024-05-08T21:10:07.749455+0000","last_became_active":"2024-05-08T21:10:03.327530+0000","last_became_peered":"2024-05-08T21:10:03.327530+0000","last_unstale":"2024-05-08T21:10:07.749455+0000","last_undegraded":"2024-05-08T21:10:07.749455+0000","last_fullsized":"2024-05-08T21:10:07.749455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:46.232166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":168,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046147+0000","last_change":"2024-05-08T21:09:59.333990+0000","last_active":"2024-05-08T21:10:08.046147+0000","last_peered":"2024-05-08T21:10:08.046147+0000","last_clean":"2024-05-08T21:10:08.046147+0000","last_became_active":"2024-05-08T21:09:59.332929+0000","last_became_peered":"2024-05-08T21:09:59.332929+0000","last_unstale":"2024-05-08T21:10:08.046147+0000","last_undegraded":"2024-05-08T21:10:08.046147+0000","last_fullsized":"2024-05-08T21:10:08.046147+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:09:58.287675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:09:58.287675+0000","last_clean_scrub_stamp":"2024-05-08T21:09:58.287675+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:47.595380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.052138+0000","last_change":"2024-05-08T21:10:08.049848+0000","last_active":"2024-05-08T21:10:08.052138+0000","last_peered":"2024-05-08T21:10:08.052138+0000","last_clean":"2024-05-08T21:10:08.052138+0000","last_became_active":"2024-05-08T21:10:08.049153+0000","last_became_peered":"2024-05-08T21:10:08.049153+0000","last_unstale":"2024-05-08T21:10:08.052138+0000","last_undegraded":"2024-05-08T21:10:08.052138+0000","last_fullsized":"2024-05-08T21:10:08.052138+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:23.704112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.753311+0000","last_change":"2024-05-08T21:10:03.743094+0000","last_active":"2024-05-08T21:10:07.753311+0000","last_peered":"2024-05-08T21:10:07.753311+0000","last_clean":"2024-05-08T21:10:07.753311+0000","last_became_active":"2024-05-08T21:10:03.742819+0000","last_became_peered":"2024-05-08T21:10:03.742819+0000","last_unstale":"2024-05-08T21:10:07.753311+0000","last_undegraded":"2024-05-08T21:10:07.753311+0000","last_fullsized":"2024-05-08T21:10:07.753311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:41:25.593884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046341+0000","last_change":"2024-05-08T21:10:03.340259+0000","last_active":"2024-05-08T21:10:08.046341+0000","last_peered":"2024-05-08T21:10:08.046341+0000","last_clean":"2024-05-08T21:10:08.046341+0000","last_became_active":"2024-05-08T21:10:03.339957+0000","last_became_peered":"2024-05-08T21:10:03.339957+0000","last_unstale":"2024-05-08T21:10:08.046341+0000","last_undegraded":"2024-05-08T21:10:08.046341+0000","last_fullsized":"2024-05-08T21:10:08.046341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:38:36.535689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.051520+0000","last_change":"2024-05-08T21:10:08.050370+0000","last_active":"2024-05-08T21:10:08.051520+0000","last_peered":"2024-05-08T21:10:08.051520+0000","last_clean":"2024-05-08T21:10:08.051520+0000","last_became_active":"2024-05-08T21:10:08.049962+0000","last_became_peered":"2024-05-08T21:10:08.049962+0000","last_unstale":"2024-05-08T21:10:08.051520+0000","last_undegraded":"2024-05-08T21:10:08.051520+0000","last_fullsized":"2024-05-08T21:10:08.051520+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:11:35.394334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046359+0000","last_change":"2024-05-08T21:10:03.337949+0000","last_active":"2024-05-08T21:10:08.046359+0000","last_peered":"2024-05-08T21:10:08.046359+0000","last_clean":"2024-05-08T21:10:08.046359+0000","last_became_active":"2024-05-08T21:10:03.337627+0000","last_became_peered":"2024-05-08T21:10:03.337627+0000","last_unstale":"2024-05-08T21:10:08.046359+0000","last_undegraded":"2024-05-08T21:10:08.046359+0000","last_fullsized":"2024-05-08T21:10:08.046359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:17:36.792731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.187476+0000","last_change":"2024-05-08T21:10:03.738212+0000","last_active":"2024-05-08T21:10:08.187476+0000","last_peered":"2024-05-08T21:10:08.187476+0000","last_clean":"2024-05-08T21:10:08.187476+0000","last_became_active":"2024-05-08T21:10:03.737927+0000","last_became_peered":"2024-05-08T21:10:03.737927+0000","last_unstale":"2024-05-08T21:10:08.187476+0000","last_undegraded":"2024-05-08T21:10:08.187476+0000","last_fullsized":"2024-05-08T21:10:08.187476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:03:08.031584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.059425+0000","last_change":"2024-05-08T21:10:08.052270+0000","last_active":"2024-05-08T21:10:08.059425+0000","last_peered":"2024-05-08T21:10:08.059425+0000","last_clean":"2024-05-08T21:10:08.059425+0000","last_became_active":"2024-05-08T21:10:08.051881+0000","last_became_peered":"2024-05-08T21:10:08.051881+0000","last_unstale":"2024-05-08T21:10:08.059425+0000","last_undegraded":"2024-05-08T21:10:08.059425+0000","last_fullsized":"2024-05-08T21:10:08.059425+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:39:07.929942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.187471+0000","last_change":"2024-05-08T21:10:03.333696+0000","last_active":"2024-05-08T21:10:08.187471+0000","last_peered":"2024-05-08T21:10:08.187471+0000","last_clean":"2024-05-08T21:10:08.187471+0000","last_became_active":"2024-05-08T21:10:03.333368+0000","last_became_peered":"2024-05-08T21:10:03.333368+0000","last_unstale":"2024-05-08T21:10:08.187471+0000","last_undegraded":"2024-05-08T21:10:08.187471+0000","last_fullsized":"2024-05-08T21:10:08.187471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:00:08.459270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.762624+0000","last_change":"2024-05-08T21:10:03.752578+0000","last_active":"2024-05-08T21:10:07.762624+0000","last_peered":"2024-05-08T21:10:07.762624+0000","last_clean":"2024-05-08T21:10:07.762624+0000","last_became_active":"2024-05-08T21:10:03.752389+0000","last_became_peered":"2024-05-08T21:10:03.752389+0000","last_unstale":"2024-05-08T21:10:07.762624+0000","last_undegraded":"2024-05-08T21:10:07.762624+0000","last_fullsized":"2024-05-08T21:10:07.762624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:54:02.318162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169418+0000","last_change":"2024-05-08T21:10:08.048081+0000","last_active":"2024-05-08T21:10:08.169418+0000","last_peered":"2024-05-08T21:10:08.169418+0000","last_clean":"2024-05-08T21:10:08.169418+0000","last_became_active":"2024-05-08T21:10:08.047632+0000","last_became_peered":"2024-05-08T21:10:08.047632+0000","last_unstale":"2024-05-08T21:10:08.169418+0000","last_undegraded":"2024-05-08T21:10:08.169418+0000","last_fullsized":"2024-05-08T21:10:08.169418+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:26:05.857718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"26'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.738320+0000","last_change":"2024-05-08T21:10:03.340553+0000","last_active":"2024-05-08T21:10:08.738320+0000","last_peered":"2024-05-08T21:10:08.738320+0000","last_clean":"2024-05-08T21:10:08.738320+0000","last_became_active":"2024-05-08T21:10:03.340280+0000","last_became_peered":"2024-05-08T21:10:03.340280+0000","last_unstale":"2024-05-08T21:10:08.738320+0000","last_undegraded":"2024-05-08T21:10:08.738320+0000","last_fullsized":"2024-05-08T21:10:08.738320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:36:24.866220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.754313+0000","last_change":"2024-05-08T21:10:03.736316+0000","last_active":"2024-05-08T21:10:07.754313+0000","last_peered":"2024-05-08T21:10:07.754313+0000","last_clean":"2024-05-08T21:10:07.754313+0000","last_became_active":"2024-05-08T21:10:03.736049+0000","last_became_peered":"2024-05-08T21:10:03.736049+0000","last_unstale":"2024-05-08T21:10:07.754313+0000","last_undegraded":"2024-05-08T21:10:07.754313+0000","last_fullsized":"2024-05-08T21:10:07.754313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:09:48.973609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.170097+0000","last_change":"2024-05-08T21:10:07.777357+0000","last_active":"2024-05-08T21:10:08.170097+0000","last_peered":"2024-05-08T21:10:08.170097+0000","last_clean":"2024-05-08T21:10:08.170097+0000","last_became_active":"2024-05-08T21:10:07.776848+0000","last_became_peered":"2024-05-08T21:10:07.776848+0000","last_unstale":"2024-05-08T21:10:08.170097+0000","last_undegraded":"2024-05-08T21:10:08.170097+0000","last_fullsized":"2024-05-08T21:10:08.170097+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:51:47.727804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046274+0000","last_change":"2024-05-08T21:10:03.340078+0000","last_active":"2024-05-08T21:10:08.046274+0000","last_peered":"2024-05-08T21:10:08.046274+0000","last_clean":"2024-05-08T21:10:08.046274+0000","last_became_active":"2024-05-08T21:10:03.339690+0000","last_became_peered":"2024-05-08T21:10:03.339690+0000","last_unstale":"2024-05-08T21:10:08.046274+0000","last_undegraded":"2024-05-08T21:10:08.046274+0000","last_fullsized":"2024-05-08T21:10:08.046274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:01:33.991878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169765+0000","last_change":"2024-05-08T21:10:03.744606+0000","last_active":"2024-05-08T21:10:08.169765+0000","last_peered":"2024-05-08T21:10:08.169765+0000","last_clean":"2024-05-08T21:10:08.169765+0000","last_became_active":"2024-05-08T21:10:03.744160+0000","last_became_peered":"2024-05-08T21:10:03.744160+0000","last_unstale":"2024-05-08T21:10:08.169765+0000","last_undegraded":"2024-05-08T21:10:08.169765+0000","last_fullsized":"2024-05-08T21:10:08.169765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:10:25.144058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.187244+0000","last_change":"2024-05-08T21:10:08.049224+0000","last_active":"2024-05-08T21:10:08.187244+0000","last_peered":"2024-05-08T21:10:08.187244+0000","last_clean":"2024-05-08T21:10:08.187244+0000","last_became_active":"2024-05-08T21:10:08.048866+0000","last_became_peered":"2024-05-08T21:10:08.048866+0000","last_unstale":"2024-05-08T21:10:08.187244+0000","last_undegraded":"2024-05-08T21:10:08.187244+0000","last_fullsized":"2024-05-08T21:10:08.187244+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:38:20.601167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.743199+0000","last_change":"2024-05-08T21:10:03.339344+0000","last_active":"2024-05-08T21:10:07.743199+0000","last_peered":"2024-05-08T21:10:07.743199+0000","last_clean":"2024-05-08T21:10:07.743199+0000","last_became_active":"2024-05-08T21:10:03.339136+0000","last_became_peered":"2024-05-08T21:10:03.339136+0000","last_unstale":"2024-05-08T21:10:07.743199+0000","last_undegraded":"2024-05-08T21:10:07.743199+0000","last_fullsized":"2024-05-08T21:10:07.743199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:02:55.623727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.757429+0000","last_change":"2024-05-08T21:10:03.737684+0000","last_active":"2024-05-08T21:10:07.757429+0000","last_peered":"2024-05-08T21:10:07.757429+0000","last_clean":"2024-05-08T21:10:07.757429+0000","last_became_active":"2024-05-08T21:10:03.737459+0000","last_became_peered":"2024-05-08T21:10:03.737459+0000","last_unstale":"2024-05-08T21:10:07.757429+0000","last_undegraded":"2024-05-08T21:10:07.757429+0000","last_fullsized":"2024-05-08T21:10:07.757429+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:39.662018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169949+0000","last_change":"2024-05-08T21:10:07.776483+0000","last_active":"2024-05-08T21:10:08.169949+0000","last_peered":"2024-05-08T21:10:08.169949+0000","last_clean":"2024-05-08T21:10:08.169949+0000","last_became_active":"2024-05-08T21:10:07.775956+0000","last_became_peered":"2024-05-08T21:10:07.775956+0000","last_unstale":"2024-05-08T21:10:08.169949+0000","last_undegraded":"2024-05-08T21:10:08.169949+0000","last_fullsized":"2024-05-08T21:10:08.169949+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:28:17.332488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.743317+0000","last_change":"2024-05-08T21:10:03.331695+0000","last_active":"2024-05-08T21:10:07.743317+0000","last_peered":"2024-05-08T21:10:07.743317+0000","last_clean":"2024-05-08T21:10:07.743317+0000","last_became_active":"2024-05-08T21:10:03.331198+0000","last_became_peered":"2024-05-08T21:10:03.331198+0000","last_unstale":"2024-05-08T21:10:07.743317+0000","last_undegraded":"2024-05-08T21:10:07.743317+0000","last_fullsized":"2024-05-08T21:10:07.743317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:37:54.491930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.761445+0000","last_change":"2024-05-08T21:10:03.744562+0000","last_active":"2024-05-08T21:10:07.761445+0000","last_peered":"2024-05-08T21:10:07.761445+0000","last_clean":"2024-05-08T21:10:07.761445+0000","last_became_active":"2024-05-08T21:10:03.744326+0000","last_became_peered":"2024-05-08T21:10:03.744326+0000","last_unstale":"2024-05-08T21:10:07.761445+0000","last_undegraded":"2024-05-08T21:10:07.761445+0000","last_fullsized":"2024-05-08T21:10:07.761445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:21:52.947209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.170163+0000","last_change":"2024-05-08T21:10:07.763204+0000","last_active":"2024-05-08T21:10:08.170163+0000","last_peered":"2024-05-08T21:10:08.170163+0000","last_clean":"2024-05-08T21:10:08.170163+0000","last_became_active":"2024-05-08T21:10:07.762886+0000","last_became_peered":"2024-05-08T21:10:07.762886+0000","last_unstale":"2024-05-08T21:10:08.170163+0000","last_undegraded":"2024-05-08T21:10:08.170163+0000","last_fullsized":"2024-05-08T21:10:08.170163+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:01.599700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.740037+0000","last_change":"2024-05-08T21:10:03.337993+0000","last_active":"2024-05-08T21:10:08.740037+0000","last_peered":"2024-05-08T21:10:08.740037+0000","last_clean":"2024-05-08T21:10:08.740037+0000","last_became_active":"2024-05-08T21:10:03.337654+0000","last_became_peered":"2024-05-08T21:10:03.337654+0000","last_unstale":"2024-05-08T21:10:08.740037+0000","last_undegraded":"2024-05-08T21:10:08.740037+0000","last_fullsized":"2024-05-08T21:10:08.740037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:23:20.536178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.271247+0000","last_change":"2024-05-08T21:10:03.744871+0000","last_active":"2024-05-08T21:10:08.271247+0000","last_peered":"2024-05-08T21:10:08.271247+0000","last_clean":"2024-05-08T21:10:08.271247+0000","last_became_active":"2024-05-08T21:10:03.744589+0000","last_became_peered":"2024-05-08T21:10:03.744589+0000","last_unstale":"2024-05-08T21:10:08.271247+0000","last_undegraded":"2024-05-08T21:10:08.271247+0000","last_fullsized":"2024-05-08T21:10:08.271247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:41.090204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.271212+0000","last_change":"2024-05-08T21:10:08.047735+0000","last_active":"2024-05-08T21:10:08.271212+0000","last_peered":"2024-05-08T21:10:08.271212+0000","last_clean":"2024-05-08T21:10:08.271212+0000","last_became_active":"2024-05-08T21:10:08.047331+0000","last_became_peered":"2024-05-08T21:10:08.047331+0000","last_unstale":"2024-05-08T21:10:08.271212+0000","last_undegraded":"2024-05-08T21:10:08.271212+0000","last_fullsized":"2024-05-08T21:10:08.271212+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:44:22.797154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.751739+0000","last_change":"2024-05-08T21:10:03.333117+0000","last_active":"2024-05-08T21:10:07.751739+0000","last_peered":"2024-05-08T21:10:07.751739+0000","last_clean":"2024-05-08T21:10:07.751739+0000","last_became_active":"2024-05-08T21:10:03.332790+0000","last_became_peered":"2024-05-08T21:10:03.332790+0000","last_unstale":"2024-05-08T21:10:07.751739+0000","last_undegraded":"2024-05-08T21:10:07.751739+0000","last_fullsized":"2024-05-08T21:10:07.751739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:52:36.355804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046458+0000","last_change":"2024-05-08T21:10:03.748047+0000","last_active":"2024-05-08T21:10:08.046458+0000","last_peered":"2024-05-08T21:10:08.046458+0000","last_clean":"2024-05-08T21:10:08.046458+0000","last_became_active":"2024-05-08T21:10:03.747759+0000","last_became_peered":"2024-05-08T21:10:03.747759+0000","last_unstale":"2024-05-08T21:10:08.046458+0000","last_undegraded":"2024-05-08T21:10:08.046458+0000","last_fullsized":"2024-05-08T21:10:08.046458+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:11:05.309278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.775292+0000","last_change":"2024-05-08T21:10:07.761000+0000","last_active":"2024-05-08T21:10:07.775292+0000","last_peered":"2024-05-08T21:10:07.775292+0000","last_clean":"2024-05-08T21:10:07.775292+0000","last_became_active":"2024-05-08T21:10:07.760566+0000","last_became_peered":"2024-05-08T21:10:07.760566+0000","last_unstale":"2024-05-08T21:10:07.775292+0000","last_undegraded":"2024-05-08T21:10:07.775292+0000","last_fullsized":"2024-05-08T21:10:07.775292+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:48:27.435678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"26'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.187152+0000","last_change":"2024-05-08T21:10:03.331358+0000","last_active":"2024-05-08T21:10:08.187152+0000","last_peered":"2024-05-08T21:10:08.187152+0000","last_clean":"2024-05-08T21:10:08.187152+0000","last_became_active":"2024-05-08T21:10:03.331028+0000","last_became_peered":"2024-05-08T21:10:03.331028+0000","last_unstale":"2024-05-08T21:10:08.187152+0000","last_undegraded":"2024-05-08T21:10:08.187152+0000","last_fullsized":"2024-05-08T21:10:08.187152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:18:47.922157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.168527+0000","last_change":"2024-05-08T21:10:03.751285+0000","last_active":"2024-05-08T21:10:08.168527+0000","last_peered":"2024-05-08T21:10:08.168527+0000","last_clean":"2024-05-08T21:10:08.168527+0000","last_became_active":"2024-05-08T21:10:03.746557+0000","last_became_peered":"2024-05-08T21:10:03.746557+0000","last_unstale":"2024-05-08T21:10:08.168527+0000","last_undegraded":"2024-05-08T21:10:08.168527+0000","last_fullsized":"2024-05-08T21:10:08.168527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:50:27.241404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.167816+0000","last_change":"2024-05-08T21:10:08.048830+0000","last_active":"2024-05-08T21:10:08.167816+0000","last_peered":"2024-05-08T21:10:08.167816+0000","last_clean":"2024-05-08T21:10:08.167816+0000","last_became_active":"2024-05-08T21:10:08.048453+0000","last_became_peered":"2024-05-08T21:10:08.048453+0000","last_unstale":"2024-05-08T21:10:08.167816+0000","last_undegraded":"2024-05-08T21:10:08.167816+0000","last_fullsized":"2024-05-08T21:10:08.167816+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:19:28.758712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.737384+0000","last_change":"2024-05-08T21:10:03.330419+0000","last_active":"2024-05-08T21:10:08.737384+0000","last_peered":"2024-05-08T21:10:08.737384+0000","last_clean":"2024-05-08T21:10:08.737384+0000","last_became_active":"2024-05-08T21:10:03.330082+0000","last_became_peered":"2024-05-08T21:10:03.330082+0000","last_unstale":"2024-05-08T21:10:08.737384+0000","last_undegraded":"2024-05-08T21:10:08.737384+0000","last_fullsized":"2024-05-08T21:10:08.737384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:09:20.516386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046810+0000","last_change":"2024-05-08T21:10:03.747306+0000","last_active":"2024-05-08T21:10:08.046810+0000","last_peered":"2024-05-08T21:10:08.046810+0000","last_clean":"2024-05-08T21:10:08.046810+0000","last_became_active":"2024-05-08T21:10:03.746755+0000","last_became_peered":"2024-05-08T21:10:03.746755+0000","last_unstale":"2024-05-08T21:10:08.046810+0000","last_undegraded":"2024-05-08T21:10:08.046810+0000","last_fullsized":"2024-05-08T21:10:08.046810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:17:51.344821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.271171+0000","last_change":"2024-05-08T21:10:03.738627+0000","last_active":"2024-05-08T21:10:08.271171+0000","last_peered":"2024-05-08T21:10:08.271171+0000","last_clean":"2024-05-08T21:10:08.271171+0000","last_became_active":"2024-05-08T21:10:03.738338+0000","last_became_peered":"2024-05-08T21:10:03.738338+0000","last_unstale":"2024-05-08T21:10:08.271171+0000","last_undegraded":"2024-05-08T21:10:08.271171+0000","last_fullsized":"2024-05-08T21:10:08.271171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:34.088831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.751564+0000","last_change":"2024-05-08T21:10:03.745607+0000","last_active":"2024-05-08T21:10:07.751564+0000","last_peered":"2024-05-08T21:10:07.751564+0000","last_clean":"2024-05-08T21:10:07.751564+0000","last_became_active":"2024-05-08T21:10:03.745362+0000","last_became_peered":"2024-05-08T21:10:03.745362+0000","last_unstale":"2024-05-08T21:10:07.751564+0000","last_undegraded":"2024-05-08T21:10:07.751564+0000","last_fullsized":"2024-05-08T21:10:07.751564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:54.399930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.168448+0000","last_change":"2024-05-08T21:10:03.745137+0000","last_active":"2024-05-08T21:10:08.168448+0000","last_peered":"2024-05-08T21:10:08.168448+0000","last_clean":"2024-05-08T21:10:08.168448+0000","last_became_active":"2024-05-08T21:10:03.744844+0000","last_became_peered":"2024-05-08T21:10:03.744844+0000","last_unstale":"2024-05-08T21:10:08.168448+0000","last_undegraded":"2024-05-08T21:10:08.168448+0000","last_fullsized":"2024-05-08T21:10:08.168448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:06.853429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.753792+0000","last_change":"2024-05-08T21:10:03.745163+0000","last_active":"2024-05-08T21:10:07.753792+0000","last_peered":"2024-05-08T21:10:07.753792+0000","last_clean":"2024-05-08T21:10:07.753792+0000","last_became_active":"2024-05-08T21:10:03.744908+0000","last_became_peered":"2024-05-08T21:10:03.744908+0000","last_unstale":"2024-05-08T21:10:07.753792+0000","last_undegraded":"2024-05-08T21:10:07.753792+0000","last_fullsized":"2024-05-08T21:10:07.753792+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:06.593989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.762986+0000","last_change":"2024-05-08T21:10:03.748542+0000","last_active":"2024-05-08T21:10:07.762986+0000","last_peered":"2024-05-08T21:10:07.762986+0000","last_clean":"2024-05-08T21:10:07.762986+0000","last_became_active":"2024-05-08T21:10:03.748284+0000","last_became_peered":"2024-05-08T21:10:03.748284+0000","last_unstale":"2024-05-08T21:10:07.762986+0000","last_undegraded":"2024-05-08T21:10:07.762986+0000","last_fullsized":"2024-05-08T21:10:07.762986+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:49:10.430406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.187090+0000","last_change":"2024-05-08T21:10:03.739778+0000","last_active":"2024-05-08T21:10:08.187090+0000","last_peered":"2024-05-08T21:10:08.187090+0000","last_clean":"2024-05-08T21:10:08.187090+0000","last_became_active":"2024-05-08T21:10:03.739522+0000","last_became_peered":"2024-05-08T21:10:03.739522+0000","last_unstale":"2024-05-08T21:10:08.187090+0000","last_undegraded":"2024-05-08T21:10:08.187090+0000","last_fullsized":"2024-05-08T21:10:08.187090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:07:42.115999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.271345+0000","last_change":"2024-05-08T21:10:03.746126+0000","last_active":"2024-05-08T21:10:08.271345+0000","last_peered":"2024-05-08T21:10:08.271345+0000","last_clean":"2024-05-08T21:10:08.271345+0000","last_became_active":"2024-05-08T21:10:03.745842+0000","last_became_peered":"2024-05-08T21:10:03.745842+0000","last_unstale":"2024-05-08T21:10:08.271345+0000","last_undegraded":"2024-05-08T21:10:08.271345+0000","last_fullsized":"2024-05-08T21:10:08.271345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:51:06.176371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.762738+0000","last_change":"2024-05-08T21:10:03.745007+0000","last_active":"2024-05-08T21:10:07.762738+0000","last_peered":"2024-05-08T21:10:07.762738+0000","last_clean":"2024-05-08T21:10:07.762738+0000","last_became_active":"2024-05-08T21:10:03.744709+0000","last_became_peered":"2024-05-08T21:10:03.744709+0000","last_unstale":"2024-05-08T21:10:07.762738+0000","last_undegraded":"2024-05-08T21:10:07.762738+0000","last_fullsized":"2024-05-08T21:10:07.762738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:12:20.712861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.167909+0000","last_change":"2024-05-08T21:10:03.751111+0000","last_active":"2024-05-08T21:10:08.167909+0000","last_peered":"2024-05-08T21:10:08.167909+0000","last_clean":"2024-05-08T21:10:08.167909+0000","last_became_active":"2024-05-08T21:10:03.747059+0000","last_became_peered":"2024-05-08T21:10:03.747059+0000","last_unstale":"2024-05-08T21:10:08.167909+0000","last_undegraded":"2024-05-08T21:10:08.167909+0000","last_fullsized":"2024-05-08T21:10:08.167909+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:43.254221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.766689+0000","last_change":"2024-05-08T21:10:03.747207+0000","last_active":"2024-05-08T21:10:07.766689+0000","last_peered":"2024-05-08T21:10:07.766689+0000","last_clean":"2024-05-08T21:10:07.766689+0000","last_became_active":"2024-05-08T21:10:03.746942+0000","last_became_peered":"2024-05-08T21:10:03.746942+0000","last_unstale":"2024-05-08T21:10:07.766689+0000","last_undegraded":"2024-05-08T21:10:07.766689+0000","last_fullsized":"2024-05-08T21:10:07.766689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:33:52.317273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.168575+0000","last_change":"2024-05-08T21:10:03.753663+0000","last_active":"2024-05-08T21:10:08.168575+0000","last_peered":"2024-05-08T21:10:08.168575+0000","last_clean":"2024-05-08T21:10:08.168575+0000","last_became_active":"2024-05-08T21:10:03.752486+0000","last_became_peered":"2024-05-08T21:10:03.752486+0000","last_unstale":"2024-05-08T21:10:08.168575+0000","last_undegraded":"2024-05-08T21:10:08.168575+0000","last_fullsized":"2024-05-08T21:10:08.168575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:21:45.895154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.753497+0000","last_change":"2024-05-08T21:10:03.753849+0000","last_active":"2024-05-08T21:10:07.753497+0000","last_peered":"2024-05-08T21:10:07.753497+0000","last_clean":"2024-05-08T21:10:07.753497+0000","last_became_active":"2024-05-08T21:10:03.753616+0000","last_became_peered":"2024-05-08T21:10:03.753616+0000","last_unstale":"2024-05-08T21:10:07.753497+0000","last_undegraded":"2024-05-08T21:10:07.753497+0000","last_fullsized":"2024-05-08T21:10:07.753497+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:02:58.650310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.271297+0000","last_change":"2024-05-08T21:10:03.744906+0000","last_active":"2024-05-08T21:10:08.271297+0000","last_peered":"2024-05-08T21:10:08.271297+0000","last_clean":"2024-05-08T21:10:08.271297+0000","last_became_active":"2024-05-08T21:10:03.744562+0000","last_became_peered":"2024-05-08T21:10:03.744562+0000","last_unstale":"2024-05-08T21:10:08.271297+0000","last_undegraded":"2024-05-08T21:10:08.271297+0000","last_fullsized":"2024-05-08T21:10:08.271297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:21:30.416392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64612,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4594,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509452,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":110038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509453,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":106332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]}]},{"osd":0,"up_from":14,"seq":60129542158,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":348160,"data_stored":697248,"data_compressed":32306,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]}]},{"osd":7,"up_from":14,"seq":60129542157,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":339968,"data_stored":697192,"data_compressed":32306,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":106242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]}]},{"osd":3,"up_from":14,"seq":60129542157,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":110300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]}]},{"osd":1,"up_from":15,"seq":64424509452,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":106402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]}]},{"osd":4,"up_from":15,"seq":64424509452,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":106368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32306,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32306,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":4058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T21:10:50.076 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T21:10:50.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.229+0000 7f9756ba0700 1 Processor -- start 2024-05-08T21:10:50.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.230+0000 7f9756ba0700 1 -- start start 2024-05-08T21:10:50.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.230+0000 7f9756ba0700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f97500c8fd0 0x7f97500c9a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:50.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.230+0000 7f9756ba0700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f97500c6d10 0x7f97500c7140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:50.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.230+0000 7f9756ba0700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97500c9fa0 con 0x7f9750151fa0 2024-05-08T21:10:50.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.230+0000 7f9756ba0700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97500c6060 con 0x7f97500c6d10 2024-05-08T21:10:50.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.230+0000 7f9756ba0700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97500c8830 con 0x7f97500c8fd0 2024-05-08T21:10:50.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.230+0000 7f9755b9e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f9750151fa0 0x7f97500ca480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:53220/0 (socket says 172.21.15.80:53220) 2024-05-08T21:10:50.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.230+0000 7f9755b9e700 1 -- 172.21.15.80:0/364553802 learned_addr learned my addr 172.21.15.80:0/364553802 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:10:50.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.231+0000 7f975639f700 1 --2- 172.21.15.80:0/364553802 >> v2:172.21.15.106:3300/0 conn(0x7f97500c6d10 0x7f97500c7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:50.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.231+0000 7f975539d700 1 --2- 172.21.15.80:0/364553802 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f97500c8fd0 0x7f97500c9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:50.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.231+0000 7f9754b9c700 1 -- 172.21.15.80:0/364553802 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3020162254 0 0) 0x7f9744001110 con 0x7f9750151fa0 2024-05-08T21:10:50.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.231+0000 7f9754b9c700 1 -- 172.21.15.80:0/364553802 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f973c0035b0 con 0x7f9750151fa0 2024-05-08T21:10:50.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.231+0000 7f9754b9c700 1 -- 172.21.15.80:0/364553802 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2295147362 0 0) 0x7f973c0035b0 con 0x7f9750151fa0 2024-05-08T21:10:50.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.231+0000 7f9754b9c700 1 -- 172.21.15.80:0/364553802 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f97500c8fd0 msgr2=0x7f97500c9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:50.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.231+0000 7f9754b9c700 1 --2- 172.21.15.80:0/364553802 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f97500c8fd0 0x7f97500c9a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:50.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.231+0000 7f9754b9c700 1 -- 172.21.15.80:0/364553802 >> v2:172.21.15.106:3300/0 conn(0x7f97500c6d10 msgr2=0x7f97500c7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:50.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.231+0000 7f9754b9c700 1 --2- 172.21.15.80:0/364553802 >> v2:172.21.15.106:3300/0 conn(0x7f97500c6d10 0x7f97500c7140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:50.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.231+0000 7f9754b9c700 1 -- 172.21.15.80:0/364553802 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97500c8d60 con 0x7f9750151fa0 2024-05-08T21:10:50.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.231+0000 7f9754b9c700 1 -- 172.21.15.80:0/364553802 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3520646302 0 0) 0x7f9744001800 con 0x7f9750151fa0 2024-05-08T21:10:50.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.231+0000 7f9754b9c700 1 -- 172.21.15.80:0/364553802 >> v1:172.21.15.80:6789/0 conn(0x7f9750151fa0 legacy=0x7f97500ca480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:50.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.231+0000 7f9754b9c700 1 --2- 172.21.15.80:0/364553802 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f97500c8fd0 0x7f973c003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:50.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.231+0000 7f9754b9c700 1 --2- 172.21.15.80:0/364553802 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f973c003f80 0x7f973c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:50.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.231+0000 7f9754b9c700 1 --2- 172.21.15.80:0/364553802 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f973c004d90 0x7f973c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:50.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.231+0000 7f9754b9c700 1 -- 172.21.15.80:0/364553802 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97500c6060 con 0x7f973c003f80 2024-05-08T21:10:50.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.231+0000 7f9754b9c700 1 -- 172.21.15.80:0/364553802 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97500c8830 con 0x7f973c004d90 2024-05-08T21:10:50.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.231+0000 7f9754b9c700 1 -- 172.21.15.80:0/364553802 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f973c00ba40 con 0x7f97500c8fd0 2024-05-08T21:10:50.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.231+0000 7f975539d700 1 --2- 172.21.15.80:0/364553802 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f973c003f80 0x7f973c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:50.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.231+0000 7f9755b9e700 1 --2- 172.21.15.80:0/364553802 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f97500c8fd0 0x7f973c003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:50.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.231+0000 7f975639f700 1 --2- 172.21.15.80:0/364553802 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f973c004d90 0x7f973c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:50.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.231+0000 7f975539d700 1 -- 172.21.15.80:0/364553802 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f97500c8fd0 msgr2=0x7f973c003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:50.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.231+0000 7f975539d700 1 --2- 172.21.15.80:0/364553802 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f97500c8fd0 0x7f973c003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:50.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.231+0000 7f975539d700 1 -- 172.21.15.80:0/364553802 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f973c004d90 msgr2=0x7f973c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:50.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.231+0000 7f975539d700 1 --2- 172.21.15.80:0/364553802 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f973c004d90 0x7f973c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:50.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.232+0000 7f975539d700 1 -- 172.21.15.80:0/364553802 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f973c0035b0 con 0x7f973c003f80 2024-05-08T21:10:50.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.232+0000 7f975539d700 1 --2- 172.21.15.80:0/364553802 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f973c003f80 0x7f973c004850 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f974c009b60 tx=0x7f973c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dfa980a6640852 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:50.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.232+0000 7f9754b9c700 1 -- 172.21.15.80:0/364553802 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974c00e6c0 con 0x7f973c003f80 2024-05-08T21:10:50.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.232+0000 7f9754b9c700 1 -- 172.21.15.80:0/364553802 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f974c00e820 con 0x7f973c003f80 2024-05-08T21:10:50.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.232+0000 7f9754b9c700 1 -- 172.21.15.80:0/364553802 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974c00eb90 con 0x7f973c003f80 2024-05-08T21:10:50.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.232+0000 7f9756ba0700 1 -- 172.21.15.80:0/364553802 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f973c003f80 msgr2=0x7f973c004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:50.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.232+0000 7f9756ba0700 1 --2- 172.21.15.80:0/364553802 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f973c003f80 0x7f973c004850 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f974c009b60 tx=0x7f973c005880 comp rx=0 tx=0).stop 2024-05-08T21:10:50.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.232+0000 7f975639f700 1 -- 172.21.15.80:0/364553802 reap_dead start 2024-05-08T21:10:50.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.232+0000 7f9756ba0700 1 -- 172.21.15.80:0/364553802 shutdown_connections 2024-05-08T21:10:50.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.232+0000 7f9756ba0700 1 -- 172.21.15.80:0/364553802 >> 172.21.15.80:0/364553802 conn(0x7f9750066960 msgr2=0x7f9750066d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:50.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.232+0000 7f9756ba0700 1 -- 172.21.15.80:0/364553802 shutdown_connections 2024-05-08T21:10:50.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.232+0000 7f9756ba0700 1 -- 172.21.15.80:0/364553802 wait complete. 2024-05-08T21:10:50.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.234+0000 7f9756ba0700 1 Processor -- start 2024-05-08T21:10:50.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.234+0000 7f9756ba0700 1 -- start start 2024-05-08T21:10:50.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.234+0000 7f9756ba0700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f973c003f80 0x7f97500cd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:50.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.234+0000 7f9756ba0700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9750150970 0x7f97501f3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:50.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.234+0000 7f9756ba0700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f97500cdf90 0x7f97501f3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:50.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.234+0000 7f9756ba0700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97501ef840 con 0x7f973c003f80 2024-05-08T21:10:50.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.234+0000 7f9756ba0700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9750154460 con 0x7f97500cdf90 2024-05-08T21:10:50.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.234+0000 7f9756ba0700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9750153940 con 0x7f9750150970 2024-05-08T21:10:50.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.234+0000 7f9755b9e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f973c003f80 0x7f97500cd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:50.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.234+0000 7f9755b9e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f973c003f80 0x7f97500cd6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34804/0 (socket says 172.21.15.80:34804) 2024-05-08T21:10:50.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.234+0000 7f9755b9e700 1 -- 172.21.15.80:0/3090572224 learned_addr learned my addr 172.21.15.80:0/3090572224 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:50.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.234+0000 7f975539d700 1 --2- 172.21.15.80:0/3090572224 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9750150970 0x7f97501f3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:50.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.235+0000 7f975639f700 1 --2- 172.21.15.80:0/3090572224 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f97500cdf90 0x7f97501f3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:50.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.235+0000 7f9755b9e700 1 -- 172.21.15.80:0/3090572224 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9750150970 msgr2=0x7f97501f3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:50.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.235+0000 7f9755b9e700 1 --2- 172.21.15.80:0/3090572224 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9750150970 0x7f97501f3400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:50.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.235+0000 7f9755b9e700 1 -- 172.21.15.80:0/3090572224 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f97500cdf90 msgr2=0x7f97501f3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:50.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.235+0000 7f9755b9e700 1 --2- 172.21.15.80:0/3090572224 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f97500cdf90 0x7f97501f3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:50.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.235+0000 7f9755b9e700 1 -- 172.21.15.80:0/3090572224 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9750153bc0 con 0x7f973c003f80 2024-05-08T21:10:50.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.235+0000 7f9755b9e700 1 --2- 172.21.15.80:0/3090572224 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f973c003f80 0x7f97500cd6c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9744007370 tx=0x7f9744007680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:50.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.235+0000 7f97427fc700 1 -- 172.21.15.80:0/3090572224 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974400f8d0 con 0x7f973c003f80 2024-05-08T21:10:50.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.235+0000 7f97427fc700 1 -- 172.21.15.80:0/3090572224 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f974400fa30 con 0x7f973c003f80 2024-05-08T21:10:50.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.235+0000 7f97427fc700 1 -- 172.21.15.80:0/3090572224 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974400fde0 con 0x7f973c003f80 2024-05-08T21:10:50.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.235+0000 7f9756ba0700 1 -- 172.21.15.80:0/3090572224 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9750153ea0 con 0x7f973c003f80 2024-05-08T21:10:50.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.235+0000 7f9756ba0700 1 -- 172.21.15.80:0/3090572224 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97501f2ee0 con 0x7f973c003f80 2024-05-08T21:10:50.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.236+0000 7f9756ba0700 1 -- 172.21.15.80:0/3090572224 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9750075350 con 0x7f973c003f80 2024-05-08T21:10:50.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.236+0000 7f97427fc700 1 -- 172.21.15.80:0/3090572224 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f974401d360 con 0x7f973c003f80 2024-05-08T21:10:50.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.237+0000 7f97427fc700 1 --2- 172.21.15.80:0/3090572224 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f973406ac90 0x7f973406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:50.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.237+0000 7f97427fc700 1 -- 172.21.15.80:0/3090572224 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9744088b30 con 0x7f973c003f80 2024-05-08T21:10:50.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.237+0000 7f975539d700 1 --2- 172.21.15.80:0/3090572224 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f973406ac90 0x7f973406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:50.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.237+0000 7f975539d700 1 --2- 172.21.15.80:0/3090572224 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f973406ac90 0x7f973406d150 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f974c0090b0 tx=0x7f974c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:50.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.241+0000 7f97427fc700 1 -- 172.21.15.80:0/3090572224 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f9744053ab0 con 0x7f973c003f80 2024-05-08T21:10:50.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.434+0000 7f9756ba0700 1 -- 172.21.15.80:0/3090572224 --> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f975014f7c0 con 0x7f973406ac90 2024-05-08T21:10:50.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.443+0000 7f97427fc700 1 -- 172.21.15.80:0/3090572224 <== mgr.4100 v2:172.21.15.80:6832/46731 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345368 (secure 0 0 0) 0x7f975014f7c0 con 0x7f973406ac90 2024-05-08T21:10:50.450 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:10:50.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.447+0000 7f9756ba0700 1 -- 172.21.15.80:0/3090572224 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f973406ac90 msgr2=0x7f973406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:50.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.447+0000 7f9756ba0700 1 --2- 172.21.15.80:0/3090572224 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f973406ac90 0x7f973406d150 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f974c0090b0 tx=0x7f974c008030 comp rx=0 tx=0).stop 2024-05-08T21:10:50.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.447+0000 7f9756ba0700 1 -- 172.21.15.80:0/3090572224 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f973c003f80 msgr2=0x7f97500cd6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:50.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.447+0000 7f9756ba0700 1 --2- 172.21.15.80:0/3090572224 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f973c003f80 0x7f97500cd6c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9744007370 tx=0x7f9744007680 comp rx=0 tx=0).stop 2024-05-08T21:10:50.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.447+0000 7f9756ba0700 1 -- 172.21.15.80:0/3090572224 shutdown_connections 2024-05-08T21:10:50.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.447+0000 7f9756ba0700 1 --2- 172.21.15.80:0/3090572224 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f973406ac90 0x7f973406d150 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:50.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.447+0000 7f9756ba0700 1 --2- 172.21.15.80:0/3090572224 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f973c003f80 0x7f97500cd6c0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:50.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.447+0000 7f9756ba0700 1 --2- 172.21.15.80:0/3090572224 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f97500cdf90 0x7f97501f3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:50.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.447+0000 7f9756ba0700 1 --2- 172.21.15.80:0/3090572224 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9750150970 0x7f97501f3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:50.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.447+0000 7f9756ba0700 1 -- 172.21.15.80:0/3090572224 >> 172.21.15.80:0/3090572224 conn(0x7f9750066960 msgr2=0x7f975014ec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:50.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.447+0000 7f9756ba0700 1 -- 172.21.15.80:0/3090572224 shutdown_connections 2024-05-08T21:10:50.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.447+0000 7f9756ba0700 1 -- 172.21.15.80:0/3090572224 wait complete. 2024-05-08T21:10:50.454 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-05-08T21:10:50.468 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":47,"stamp":"2024-05-08T21:10:50.208878+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595224,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":209,"num_write_kb":2436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218452,"kb_used_data":2304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756268,"statfs":{"total":773094113280,"available":772870418432,"internally_reserved":0,"allocated":2359296,"data_stored":2040384,"data_compressed":64612,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":262,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002608"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.048091+0000","last_change":"2024-05-08T21:10:03.747477+0000","last_active":"2024-05-08T21:10:08.048091+0000","last_peered":"2024-05-08T21:10:08.048091+0000","last_clean":"2024-05-08T21:10:08.048091+0000","last_became_active":"2024-05-08T21:10:03.747059+0000","last_became_peered":"2024-05-08T21:10:03.747059+0000","last_unstale":"2024-05-08T21:10:08.048091+0000","last_undegraded":"2024-05-08T21:10:08.048091+0000","last_fullsized":"2024-05-08T21:10:08.048091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:15:24.340135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.187600+0000","last_change":"2024-05-08T21:10:03.738974+0000","last_active":"2024-05-08T21:10:08.187600+0000","last_peered":"2024-05-08T21:10:08.187600+0000","last_clean":"2024-05-08T21:10:08.187600+0000","last_became_active":"2024-05-08T21:10:03.738466+0000","last_became_peered":"2024-05-08T21:10:03.738466+0000","last_unstale":"2024-05-08T21:10:08.187600+0000","last_undegraded":"2024-05-08T21:10:08.187600+0000","last_fullsized":"2024-05-08T21:10:08.187600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:59.683039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.753636+0000","last_change":"2024-05-08T21:10:03.740146+0000","last_active":"2024-05-08T21:10:07.753636+0000","last_peered":"2024-05-08T21:10:07.753636+0000","last_clean":"2024-05-08T21:10:07.753636+0000","last_became_active":"2024-05-08T21:10:03.739884+0000","last_became_peered":"2024-05-08T21:10:03.739884+0000","last_unstale":"2024-05-08T21:10:07.753636+0000","last_undegraded":"2024-05-08T21:10:07.753636+0000","last_fullsized":"2024-05-08T21:10:07.753636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:51:44.301305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.168400+0000","last_change":"2024-05-08T21:10:03.754159+0000","last_active":"2024-05-08T21:10:08.168400+0000","last_peered":"2024-05-08T21:10:08.168400+0000","last_clean":"2024-05-08T21:10:08.168400+0000","last_became_active":"2024-05-08T21:10:03.753800+0000","last_became_peered":"2024-05-08T21:10:03.753800+0000","last_unstale":"2024-05-08T21:10:08.168400+0000","last_undegraded":"2024-05-08T21:10:08.168400+0000","last_fullsized":"2024-05-08T21:10:08.168400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:41:02.625080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046322+0000","last_change":"2024-05-08T21:10:03.750051+0000","last_active":"2024-05-08T21:10:08.046322+0000","last_peered":"2024-05-08T21:10:08.046322+0000","last_clean":"2024-05-08T21:10:08.046322+0000","last_became_active":"2024-05-08T21:10:03.749730+0000","last_became_peered":"2024-05-08T21:10:03.749730+0000","last_unstale":"2024-05-08T21:10:08.046322+0000","last_undegraded":"2024-05-08T21:10:08.046322+0000","last_fullsized":"2024-05-08T21:10:08.046322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:49.402253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.168597+0000","last_change":"2024-05-08T21:10:03.746043+0000","last_active":"2024-05-08T21:10:08.168597+0000","last_peered":"2024-05-08T21:10:08.168597+0000","last_clean":"2024-05-08T21:10:08.168597+0000","last_became_active":"2024-05-08T21:10:03.745747+0000","last_became_peered":"2024-05-08T21:10:03.745747+0000","last_unstale":"2024-05-08T21:10:08.168597+0000","last_undegraded":"2024-05-08T21:10:08.168597+0000","last_fullsized":"2024-05-08T21:10:08.168597+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:05:49.465405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046256+0000","last_change":"2024-05-08T21:10:03.743802+0000","last_active":"2024-05-08T21:10:08.046256+0000","last_peered":"2024-05-08T21:10:08.046256+0000","last_clean":"2024-05-08T21:10:08.046256+0000","last_became_active":"2024-05-08T21:10:03.743349+0000","last_became_peered":"2024-05-08T21:10:03.743349+0000","last_unstale":"2024-05-08T21:10:08.046256+0000","last_undegraded":"2024-05-08T21:10:08.046256+0000","last_fullsized":"2024-05-08T21:10:08.046256+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:08:06.408724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.757451+0000","last_change":"2024-05-08T21:10:03.747558+0000","last_active":"2024-05-08T21:10:07.757451+0000","last_peered":"2024-05-08T21:10:07.757451+0000","last_clean":"2024-05-08T21:10:07.757451+0000","last_became_active":"2024-05-08T21:10:03.747300+0000","last_became_peered":"2024-05-08T21:10:03.747300+0000","last_unstale":"2024-05-08T21:10:07.757451+0000","last_undegraded":"2024-05-08T21:10:07.757451+0000","last_fullsized":"2024-05-08T21:10:07.757451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:07:50.266894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046942+0000","last_change":"2024-05-08T21:10:03.748221+0000","last_active":"2024-05-08T21:10:08.046942+0000","last_peered":"2024-05-08T21:10:08.046942+0000","last_clean":"2024-05-08T21:10:08.046942+0000","last_became_active":"2024-05-08T21:10:03.747956+0000","last_became_peered":"2024-05-08T21:10:03.747956+0000","last_unstale":"2024-05-08T21:10:08.046942+0000","last_undegraded":"2024-05-08T21:10:08.046942+0000","last_fullsized":"2024-05-08T21:10:08.046942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:27:35.947884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.271333+0000","last_change":"2024-05-08T21:10:03.745291+0000","last_active":"2024-05-08T21:10:08.271333+0000","last_peered":"2024-05-08T21:10:08.271333+0000","last_clean":"2024-05-08T21:10:08.271333+0000","last_became_active":"2024-05-08T21:10:03.744976+0000","last_became_peered":"2024-05-08T21:10:03.744976+0000","last_unstale":"2024-05-08T21:10:08.271333+0000","last_undegraded":"2024-05-08T21:10:08.271333+0000","last_fullsized":"2024-05-08T21:10:08.271333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:36:54.983642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.271323+0000","last_change":"2024-05-08T21:10:03.748518+0000","last_active":"2024-05-08T21:10:08.271323+0000","last_peered":"2024-05-08T21:10:08.271323+0000","last_clean":"2024-05-08T21:10:08.271323+0000","last_became_active":"2024-05-08T21:10:03.748253+0000","last_became_peered":"2024-05-08T21:10:03.748253+0000","last_unstale":"2024-05-08T21:10:08.271323+0000","last_undegraded":"2024-05-08T21:10:08.271323+0000","last_fullsized":"2024-05-08T21:10:08.271323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:03:26.013122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.170038+0000","last_change":"2024-05-08T21:10:03.745985+0000","last_active":"2024-05-08T21:10:08.170038+0000","last_peered":"2024-05-08T21:10:08.170038+0000","last_clean":"2024-05-08T21:10:08.170038+0000","last_became_active":"2024-05-08T21:10:03.745247+0000","last_became_peered":"2024-05-08T21:10:03.745247+0000","last_unstale":"2024-05-08T21:10:08.170038+0000","last_undegraded":"2024-05-08T21:10:08.170038+0000","last_fullsized":"2024-05-08T21:10:08.170038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:59:42.506304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.761196+0000","last_change":"2024-05-08T21:10:03.747016+0000","last_active":"2024-05-08T21:10:07.761196+0000","last_peered":"2024-05-08T21:10:07.761196+0000","last_clean":"2024-05-08T21:10:07.761196+0000","last_became_active":"2024-05-08T21:10:03.746848+0000","last_became_peered":"2024-05-08T21:10:03.746848+0000","last_unstale":"2024-05-08T21:10:07.761196+0000","last_undegraded":"2024-05-08T21:10:07.761196+0000","last_fullsized":"2024-05-08T21:10:07.761196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:41:21.081035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.753493+0000","last_change":"2024-05-08T21:10:03.737984+0000","last_active":"2024-05-08T21:10:07.753493+0000","last_peered":"2024-05-08T21:10:07.753493+0000","last_clean":"2024-05-08T21:10:07.753493+0000","last_became_active":"2024-05-08T21:10:03.737716+0000","last_became_peered":"2024-05-08T21:10:03.737716+0000","last_unstale":"2024-05-08T21:10:07.753493+0000","last_undegraded":"2024-05-08T21:10:07.753493+0000","last_fullsized":"2024-05-08T21:10:07.753493+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:09:47.758272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.186816+0000","last_change":"2024-05-08T21:10:03.744543+0000","last_active":"2024-05-08T21:10:08.186816+0000","last_peered":"2024-05-08T21:10:08.186816+0000","last_clean":"2024-05-08T21:10:08.186816+0000","last_became_active":"2024-05-08T21:10:03.744276+0000","last_became_peered":"2024-05-08T21:10:03.744276+0000","last_unstale":"2024-05-08T21:10:08.186816+0000","last_undegraded":"2024-05-08T21:10:08.186816+0000","last_fullsized":"2024-05-08T21:10:08.186816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:25:04.113297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.167751+0000","last_change":"2024-05-08T21:10:03.746547+0000","last_active":"2024-05-08T21:10:08.167751+0000","last_peered":"2024-05-08T21:10:08.167751+0000","last_clean":"2024-05-08T21:10:08.167751+0000","last_became_active":"2024-05-08T21:10:03.745862+0000","last_became_peered":"2024-05-08T21:10:03.745862+0000","last_unstale":"2024-05-08T21:10:08.167751+0000","last_undegraded":"2024-05-08T21:10:08.167751+0000","last_fullsized":"2024-05-08T21:10:08.167751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:12.776310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169108+0000","last_change":"2024-05-08T21:10:03.754230+0000","last_active":"2024-05-08T21:10:08.169108+0000","last_peered":"2024-05-08T21:10:08.169108+0000","last_clean":"2024-05-08T21:10:08.169108+0000","last_became_active":"2024-05-08T21:10:03.753895+0000","last_became_peered":"2024-05-08T21:10:03.753895+0000","last_unstale":"2024-05-08T21:10:08.169108+0000","last_undegraded":"2024-05-08T21:10:08.169108+0000","last_fullsized":"2024-05-08T21:10:08.169108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:41:47.214215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.751781+0000","last_change":"2024-05-08T21:10:03.743889+0000","last_active":"2024-05-08T21:10:07.751781+0000","last_peered":"2024-05-08T21:10:07.751781+0000","last_clean":"2024-05-08T21:10:07.751781+0000","last_became_active":"2024-05-08T21:10:03.743596+0000","last_became_peered":"2024-05-08T21:10:03.743596+0000","last_unstale":"2024-05-08T21:10:07.751781+0000","last_undegraded":"2024-05-08T21:10:07.751781+0000","last_fullsized":"2024-05-08T21:10:07.751781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:53.981781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046658+0000","last_change":"2024-05-08T21:10:03.743893+0000","last_active":"2024-05-08T21:10:08.046658+0000","last_peered":"2024-05-08T21:10:08.046658+0000","last_clean":"2024-05-08T21:10:08.046658+0000","last_became_active":"2024-05-08T21:10:03.743580+0000","last_became_peered":"2024-05-08T21:10:03.743580+0000","last_unstale":"2024-05-08T21:10:08.046658+0000","last_undegraded":"2024-05-08T21:10:08.046658+0000","last_fullsized":"2024-05-08T21:10:08.046658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:44:21.747625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.059425+0000","last_change":"2024-05-08T21:10:08.052394+0000","last_active":"2024-05-08T21:10:08.059425+0000","last_peered":"2024-05-08T21:10:08.059425+0000","last_clean":"2024-05-08T21:10:08.059425+0000","last_became_active":"2024-05-08T21:10:08.052009+0000","last_became_peered":"2024-05-08T21:10:08.052009+0000","last_unstale":"2024-05-08T21:10:08.059425+0000","last_undegraded":"2024-05-08T21:10:08.059425+0000","last_fullsized":"2024-05-08T21:10:08.059425+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:47:20.148683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"25'4","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.741230+0000","last_change":"2024-05-08T21:10:03.340118+0000","last_active":"2024-05-08T21:10:08.741230+0000","last_peered":"2024-05-08T21:10:08.741230+0000","last_clean":"2024-05-08T21:10:08.741230+0000","last_became_active":"2024-05-08T21:10:03.339847+0000","last_became_peered":"2024-05-08T21:10:03.339847+0000","last_unstale":"2024-05-08T21:10:08.741230+0000","last_undegraded":"2024-05-08T21:10:08.741230+0000","last_fullsized":"2024-05-08T21:10:08.741230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:05:56.369631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.768418+0000","last_change":"2024-05-08T21:10:03.746516+0000","last_active":"2024-05-08T21:10:07.768418+0000","last_peered":"2024-05-08T21:10:07.768418+0000","last_clean":"2024-05-08T21:10:07.768418+0000","last_became_active":"2024-05-08T21:10:03.746383+0000","last_became_peered":"2024-05-08T21:10:03.746383+0000","last_unstale":"2024-05-08T21:10:07.768418+0000","last_undegraded":"2024-05-08T21:10:07.768418+0000","last_fullsized":"2024-05-08T21:10:07.768418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:29:05.305134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169483+0000","last_change":"2024-05-08T21:10:07.766498+0000","last_active":"2024-05-08T21:10:08.169483+0000","last_peered":"2024-05-08T21:10:08.169483+0000","last_clean":"2024-05-08T21:10:08.169483+0000","last_became_active":"2024-05-08T21:10:07.766119+0000","last_became_peered":"2024-05-08T21:10:07.766119+0000","last_unstale":"2024-05-08T21:10:08.169483+0000","last_undegraded":"2024-05-08T21:10:08.169483+0000","last_fullsized":"2024-05-08T21:10:08.169483+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:58:38.720848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"26'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.508429+0000","last_change":"2024-05-08T21:10:03.329414+0000","last_active":"2024-05-08T21:10:08.508429+0000","last_peered":"2024-05-08T21:10:08.508429+0000","last_clean":"2024-05-08T21:10:08.508429+0000","last_became_active":"2024-05-08T21:10:03.328970+0000","last_became_peered":"2024-05-08T21:10:03.328970+0000","last_unstale":"2024-05-08T21:10:08.508429+0000","last_undegraded":"2024-05-08T21:10:08.508429+0000","last_fullsized":"2024-05-08T21:10:08.508429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:34:32.820755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.753820+0000","last_change":"2024-05-08T21:10:03.748566+0000","last_active":"2024-05-08T21:10:07.753820+0000","last_peered":"2024-05-08T21:10:07.753820+0000","last_clean":"2024-05-08T21:10:07.753820+0000","last_became_active":"2024-05-08T21:10:03.747989+0000","last_became_peered":"2024-05-08T21:10:03.747989+0000","last_unstale":"2024-05-08T21:10:07.753820+0000","last_undegraded":"2024-05-08T21:10:07.753820+0000","last_fullsized":"2024-05-08T21:10:07.753820+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:19:03.468394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169607+0000","last_change":"2024-05-08T21:10:07.770390+0000","last_active":"2024-05-08T21:10:08.169607+0000","last_peered":"2024-05-08T21:10:08.169607+0000","last_clean":"2024-05-08T21:10:08.169607+0000","last_became_active":"2024-05-08T21:10:07.770017+0000","last_became_peered":"2024-05-08T21:10:07.770017+0000","last_unstale":"2024-05-08T21:10:08.169607+0000","last_undegraded":"2024-05-08T21:10:08.169607+0000","last_fullsized":"2024-05-08T21:10:08.169607+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:12:00.200848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.738243+0000","last_change":"2024-05-08T21:10:03.339207+0000","last_active":"2024-05-08T21:10:08.738243+0000","last_peered":"2024-05-08T21:10:08.738243+0000","last_clean":"2024-05-08T21:10:08.738243+0000","last_became_active":"2024-05-08T21:10:03.338917+0000","last_became_peered":"2024-05-08T21:10:03.338917+0000","last_unstale":"2024-05-08T21:10:08.738243+0000","last_undegraded":"2024-05-08T21:10:08.738243+0000","last_fullsized":"2024-05-08T21:10:08.738243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:20.676853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.168481+0000","last_change":"2024-05-08T21:10:03.753998+0000","last_active":"2024-05-08T21:10:08.168481+0000","last_peered":"2024-05-08T21:10:08.168481+0000","last_clean":"2024-05-08T21:10:08.168481+0000","last_became_active":"2024-05-08T21:10:03.753720+0000","last_became_peered":"2024-05-08T21:10:03.753720+0000","last_unstale":"2024-05-08T21:10:08.168481+0000","last_undegraded":"2024-05-08T21:10:08.168481+0000","last_fullsized":"2024-05-08T21:10:08.168481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:00:38.531282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169599+0000","last_change":"2024-05-08T21:10:07.776367+0000","last_active":"2024-05-08T21:10:08.169599+0000","last_peered":"2024-05-08T21:10:08.169599+0000","last_clean":"2024-05-08T21:10:08.169599+0000","last_became_active":"2024-05-08T21:10:07.775998+0000","last_became_peered":"2024-05-08T21:10:07.775998+0000","last_unstale":"2024-05-08T21:10:08.169599+0000","last_undegraded":"2024-05-08T21:10:08.169599+0000","last_fullsized":"2024-05-08T21:10:08.169599+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:24:18.845560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.740209+0000","last_change":"2024-05-08T21:10:03.339182+0000","last_active":"2024-05-08T21:10:08.740209+0000","last_peered":"2024-05-08T21:10:08.740209+0000","last_clean":"2024-05-08T21:10:08.740209+0000","last_became_active":"2024-05-08T21:10:03.338899+0000","last_became_peered":"2024-05-08T21:10:03.338899+0000","last_unstale":"2024-05-08T21:10:08.740209+0000","last_undegraded":"2024-05-08T21:10:08.740209+0000","last_fullsized":"2024-05-08T21:10:08.740209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:55:53.368546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.168672+0000","last_change":"2024-05-08T21:10:03.750724+0000","last_active":"2024-05-08T21:10:08.168672+0000","last_peered":"2024-05-08T21:10:08.168672+0000","last_clean":"2024-05-08T21:10:08.168672+0000","last_became_active":"2024-05-08T21:10:03.750371+0000","last_became_peered":"2024-05-08T21:10:03.750371+0000","last_unstale":"2024-05-08T21:10:08.168672+0000","last_undegraded":"2024-05-08T21:10:08.168672+0000","last_fullsized":"2024-05-08T21:10:08.168672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:14:01.935211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.775704+0000","last_change":"2024-05-08T21:10:07.767604+0000","last_active":"2024-05-08T21:10:07.775704+0000","last_peered":"2024-05-08T21:10:07.775704+0000","last_clean":"2024-05-08T21:10:07.775704+0000","last_became_active":"2024-05-08T21:10:07.767234+0000","last_became_peered":"2024-05-08T21:10:07.767234+0000","last_unstale":"2024-05-08T21:10:07.775704+0000","last_undegraded":"2024-05-08T21:10:07.775704+0000","last_fullsized":"2024-05-08T21:10:07.775704+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:30:21.411491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"26'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.508102+0000","last_change":"2024-05-08T21:10:03.338149+0000","last_active":"2024-05-08T21:10:08.508102+0000","last_peered":"2024-05-08T21:10:08.508102+0000","last_clean":"2024-05-08T21:10:08.508102+0000","last_became_active":"2024-05-08T21:10:03.337860+0000","last_became_peered":"2024-05-08T21:10:03.337860+0000","last_unstale":"2024-05-08T21:10:08.508102+0000","last_undegraded":"2024-05-08T21:10:08.508102+0000","last_fullsized":"2024-05-08T21:10:08.508102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:07:39.052625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169664+0000","last_change":"2024-05-08T21:10:03.743506+0000","last_active":"2024-05-08T21:10:08.169664+0000","last_peered":"2024-05-08T21:10:08.169664+0000","last_clean":"2024-05-08T21:10:08.169664+0000","last_became_active":"2024-05-08T21:10:03.743227+0000","last_became_peered":"2024-05-08T21:10:03.743227+0000","last_unstale":"2024-05-08T21:10:08.169664+0000","last_undegraded":"2024-05-08T21:10:08.169664+0000","last_fullsized":"2024-05-08T21:10:08.169664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:45:47.977619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.741849+0000","last_change":"2024-05-08T21:10:07.768424+0000","last_active":"2024-05-08T21:10:08.741849+0000","last_peered":"2024-05-08T21:10:08.741849+0000","last_clean":"2024-05-08T21:10:08.741849+0000","last_became_active":"2024-05-08T21:10:07.768160+0000","last_became_peered":"2024-05-08T21:10:07.768160+0000","last_unstale":"2024-05-08T21:10:08.741849+0000","last_undegraded":"2024-05-08T21:10:08.741849+0000","last_fullsized":"2024-05-08T21:10:08.741849+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:42:44.327080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"26'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.606664+0000","last_change":"2024-05-08T21:10:03.333647+0000","last_active":"2024-05-08T21:10:08.606664+0000","last_peered":"2024-05-08T21:10:08.606664+0000","last_clean":"2024-05-08T21:10:08.606664+0000","last_became_active":"2024-05-08T21:10:03.332844+0000","last_became_peered":"2024-05-08T21:10:03.332844+0000","last_unstale":"2024-05-08T21:10:08.606664+0000","last_undegraded":"2024-05-08T21:10:08.606664+0000","last_fullsized":"2024-05-08T21:10:08.606664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:47:40.344808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.753370+0000","last_change":"2024-05-08T21:10:03.743003+0000","last_active":"2024-05-08T21:10:07.753370+0000","last_peered":"2024-05-08T21:10:07.753370+0000","last_clean":"2024-05-08T21:10:07.753370+0000","last_became_active":"2024-05-08T21:10:03.742753+0000","last_became_peered":"2024-05-08T21:10:03.742753+0000","last_unstale":"2024-05-08T21:10:07.753370+0000","last_undegraded":"2024-05-08T21:10:07.753370+0000","last_fullsized":"2024-05-08T21:10:07.753370+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:45:49.575877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.271366+0000","last_change":"2024-05-08T21:10:07.770105+0000","last_active":"2024-05-08T21:10:08.271366+0000","last_peered":"2024-05-08T21:10:08.271366+0000","last_clean":"2024-05-08T21:10:08.271366+0000","last_became_active":"2024-05-08T21:10:07.769668+0000","last_became_peered":"2024-05-08T21:10:07.769668+0000","last_unstale":"2024-05-08T21:10:08.271366+0000","last_undegraded":"2024-05-08T21:10:08.271366+0000","last_fullsized":"2024-05-08T21:10:08.271366+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:07:21.560031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.766792+0000","last_change":"2024-05-08T21:10:03.333025+0000","last_active":"2024-05-08T21:10:07.766792+0000","last_peered":"2024-05-08T21:10:07.766792+0000","last_clean":"2024-05-08T21:10:07.766792+0000","last_became_active":"2024-05-08T21:10:03.332750+0000","last_became_peered":"2024-05-08T21:10:03.332750+0000","last_unstale":"2024-05-08T21:10:07.766792+0000","last_undegraded":"2024-05-08T21:10:07.766792+0000","last_fullsized":"2024-05-08T21:10:07.766792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:20:50.134647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.756963+0000","last_change":"2024-05-08T21:10:03.744023+0000","last_active":"2024-05-08T21:10:07.756963+0000","last_peered":"2024-05-08T21:10:07.756963+0000","last_clean":"2024-05-08T21:10:07.756963+0000","last_became_active":"2024-05-08T21:10:03.743724+0000","last_became_peered":"2024-05-08T21:10:03.743724+0000","last_unstale":"2024-05-08T21:10:07.756963+0000","last_undegraded":"2024-05-08T21:10:07.756963+0000","last_fullsized":"2024-05-08T21:10:07.756963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:50:36.857245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.059558+0000","last_change":"2024-05-08T21:10:08.052307+0000","last_active":"2024-05-08T21:10:08.059558+0000","last_peered":"2024-05-08T21:10:08.059558+0000","last_clean":"2024-05-08T21:10:08.059558+0000","last_became_active":"2024-05-08T21:10:08.051924+0000","last_became_peered":"2024-05-08T21:10:08.051924+0000","last_unstale":"2024-05-08T21:10:08.059558+0000","last_undegraded":"2024-05-08T21:10:08.059558+0000","last_fullsized":"2024-05-08T21:10:08.059558+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:56:37.264246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.750197+0000","last_change":"2024-05-08T21:10:03.330304+0000","last_active":"2024-05-08T21:10:07.750197+0000","last_peered":"2024-05-08T21:10:07.750197+0000","last_clean":"2024-05-08T21:10:07.750197+0000","last_became_active":"2024-05-08T21:10:03.330054+0000","last_became_peered":"2024-05-08T21:10:03.330054+0000","last_unstale":"2024-05-08T21:10:07.750197+0000","last_undegraded":"2024-05-08T21:10:07.750197+0000","last_fullsized":"2024-05-08T21:10:07.750197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:30.518935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.186997+0000","last_change":"2024-05-08T21:10:03.739687+0000","last_active":"2024-05-08T21:10:08.186997+0000","last_peered":"2024-05-08T21:10:08.186997+0000","last_clean":"2024-05-08T21:10:08.186997+0000","last_became_active":"2024-05-08T21:10:03.739425+0000","last_became_peered":"2024-05-08T21:10:03.739425+0000","last_unstale":"2024-05-08T21:10:08.186997+0000","last_undegraded":"2024-05-08T21:10:08.186997+0000","last_fullsized":"2024-05-08T21:10:08.186997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:45:59.295081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.054235+0000","last_change":"2024-05-08T21:10:08.050980+0000","last_active":"2024-05-08T21:10:08.054235+0000","last_peered":"2024-05-08T21:10:08.054235+0000","last_clean":"2024-05-08T21:10:08.054235+0000","last_became_active":"2024-05-08T21:10:08.050625+0000","last_became_peered":"2024-05-08T21:10:08.050625+0000","last_unstale":"2024-05-08T21:10:08.054235+0000","last_undegraded":"2024-05-08T21:10:08.054235+0000","last_fullsized":"2024-05-08T21:10:08.054235+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:39:43.917363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.755963+0000","last_change":"2024-05-08T21:10:03.331297+0000","last_active":"2024-05-08T21:10:07.755963+0000","last_peered":"2024-05-08T21:10:07.755963+0000","last_clean":"2024-05-08T21:10:07.755963+0000","last_became_active":"2024-05-08T21:10:03.330973+0000","last_became_peered":"2024-05-08T21:10:03.330973+0000","last_unstale":"2024-05-08T21:10:07.755963+0000","last_undegraded":"2024-05-08T21:10:07.755963+0000","last_fullsized":"2024-05-08T21:10:07.755963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:57:26.190186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.168346+0000","last_change":"2024-05-08T21:10:03.751746+0000","last_active":"2024-05-08T21:10:08.168346+0000","last_peered":"2024-05-08T21:10:08.168346+0000","last_clean":"2024-05-08T21:10:08.168346+0000","last_became_active":"2024-05-08T21:10:03.751426+0000","last_became_peered":"2024-05-08T21:10:03.751426+0000","last_unstale":"2024-05-08T21:10:08.168346+0000","last_undegraded":"2024-05-08T21:10:08.168346+0000","last_fullsized":"2024-05-08T21:10:08.168346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:00:23.529543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.778416+0000","last_change":"2024-05-08T21:10:07.771834+0000","last_active":"2024-05-08T21:10:07.778416+0000","last_peered":"2024-05-08T21:10:07.778416+0000","last_clean":"2024-05-08T21:10:07.778416+0000","last_became_active":"2024-05-08T21:10:07.771324+0000","last_became_peered":"2024-05-08T21:10:07.771324+0000","last_unstale":"2024-05-08T21:10:07.778416+0000","last_undegraded":"2024-05-08T21:10:07.778416+0000","last_fullsized":"2024-05-08T21:10:07.778416+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:35.948317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.749656+0000","last_change":"2024-05-08T21:10:03.332049+0000","last_active":"2024-05-08T21:10:07.749656+0000","last_peered":"2024-05-08T21:10:07.749656+0000","last_clean":"2024-05-08T21:10:07.749656+0000","last_became_active":"2024-05-08T21:10:03.331712+0000","last_became_peered":"2024-05-08T21:10:03.331712+0000","last_unstale":"2024-05-08T21:10:07.749656+0000","last_undegraded":"2024-05-08T21:10:07.749656+0000","last_fullsized":"2024-05-08T21:10:07.749656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:30:16.135672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.753983+0000","last_change":"2024-05-08T21:10:03.748728+0000","last_active":"2024-05-08T21:10:07.753983+0000","last_peered":"2024-05-08T21:10:07.753983+0000","last_clean":"2024-05-08T21:10:07.753983+0000","last_became_active":"2024-05-08T21:10:03.748315+0000","last_became_peered":"2024-05-08T21:10:03.748315+0000","last_unstale":"2024-05-08T21:10:07.753983+0000","last_undegraded":"2024-05-08T21:10:07.753983+0000","last_fullsized":"2024-05-08T21:10:07.753983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:14:15.224603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.170061+0000","last_change":"2024-05-08T21:10:07.761559+0000","last_active":"2024-05-08T21:10:08.170061+0000","last_peered":"2024-05-08T21:10:08.170061+0000","last_clean":"2024-05-08T21:10:08.170061+0000","last_became_active":"2024-05-08T21:10:07.761129+0000","last_became_peered":"2024-05-08T21:10:07.761129+0000","last_unstale":"2024-05-08T21:10:08.170061+0000","last_undegraded":"2024-05-08T21:10:08.170061+0000","last_fullsized":"2024-05-08T21:10:08.170061+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:29:03.444853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'3","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.737377+0000","last_change":"2024-05-08T21:10:03.333077+0000","last_active":"2024-05-08T21:10:08.737377+0000","last_peered":"2024-05-08T21:10:08.737377+0000","last_clean":"2024-05-08T21:10:08.737377+0000","last_became_active":"2024-05-08T21:10:03.332796+0000","last_became_peered":"2024-05-08T21:10:03.332796+0000","last_unstale":"2024-05-08T21:10:08.737377+0000","last_undegraded":"2024-05-08T21:10:08.737377+0000","last_fullsized":"2024-05-08T21:10:08.737377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:30:16.135672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169929+0000","last_change":"2024-05-08T21:10:03.751370+0000","last_active":"2024-05-08T21:10:08.169929+0000","last_peered":"2024-05-08T21:10:08.169929+0000","last_clean":"2024-05-08T21:10:08.169929+0000","last_became_active":"2024-05-08T21:10:03.750394+0000","last_became_peered":"2024-05-08T21:10:03.750394+0000","last_unstale":"2024-05-08T21:10:08.169929+0000","last_undegraded":"2024-05-08T21:10:08.169929+0000","last_fullsized":"2024-05-08T21:10:08.169929+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:31:06.682543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.187439+0000","last_change":"2024-05-08T21:10:07.764815+0000","last_active":"2024-05-08T21:10:08.187439+0000","last_peered":"2024-05-08T21:10:08.187439+0000","last_clean":"2024-05-08T21:10:08.187439+0000","last_became_active":"2024-05-08T21:10:07.763591+0000","last_became_peered":"2024-05-08T21:10:07.763591+0000","last_unstale":"2024-05-08T21:10:08.187439+0000","last_undegraded":"2024-05-08T21:10:08.187439+0000","last_fullsized":"2024-05-08T21:10:08.187439+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:47.977517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"26'11","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:45.312935+0000","last_change":"2024-05-08T21:10:03.342400+0000","last_active":"2024-05-08T21:10:45.312935+0000","last_peered":"2024-05-08T21:10:45.312935+0000","last_clean":"2024-05-08T21:10:45.312935+0000","last_became_active":"2024-05-08T21:10:03.342202+0000","last_became_peered":"2024-05-08T21:10:03.342202+0000","last_unstale":"2024-05-08T21:10:45.312935+0000","last_undegraded":"2024-05-08T21:10:45.312935+0000","last_fullsized":"2024-05-08T21:10:45.312935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:10:04.668029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4058,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046564+0000","last_change":"2024-05-08T21:10:03.752144+0000","last_active":"2024-05-08T21:10:08.046564+0000","last_peered":"2024-05-08T21:10:08.046564+0000","last_clean":"2024-05-08T21:10:08.046564+0000","last_became_active":"2024-05-08T21:10:03.751868+0000","last_became_peered":"2024-05-08T21:10:03.751868+0000","last_unstale":"2024-05-08T21:10:08.046564+0000","last_undegraded":"2024-05-08T21:10:08.046564+0000","last_fullsized":"2024-05-08T21:10:08.046564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:40:43.168591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.168406+0000","last_change":"2024-05-08T21:10:08.052390+0000","last_active":"2024-05-08T21:10:08.168406+0000","last_peered":"2024-05-08T21:10:08.168406+0000","last_clean":"2024-05-08T21:10:08.168406+0000","last_became_active":"2024-05-08T21:10:08.051967+0000","last_became_peered":"2024-05-08T21:10:08.051967+0000","last_unstale":"2024-05-08T21:10:08.168406+0000","last_undegraded":"2024-05-08T21:10:08.168406+0000","last_fullsized":"2024-05-08T21:10:08.168406+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:40:07.127492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.739991+0000","last_change":"2024-05-08T21:10:03.330102+0000","last_active":"2024-05-08T21:10:08.739991+0000","last_peered":"2024-05-08T21:10:08.739991+0000","last_clean":"2024-05-08T21:10:08.739991+0000","last_became_active":"2024-05-08T21:10:03.329761+0000","last_became_peered":"2024-05-08T21:10:03.329761+0000","last_unstale":"2024-05-08T21:10:08.739991+0000","last_undegraded":"2024-05-08T21:10:08.739991+0000","last_fullsized":"2024-05-08T21:10:08.739991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:37:14.930549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.753579+0000","last_change":"2024-05-08T21:10:03.749332+0000","last_active":"2024-05-08T21:10:07.753579+0000","last_peered":"2024-05-08T21:10:07.753579+0000","last_clean":"2024-05-08T21:10:07.753579+0000","last_became_active":"2024-05-08T21:10:03.749094+0000","last_became_peered":"2024-05-08T21:10:03.749094+0000","last_unstale":"2024-05-08T21:10:07.753579+0000","last_undegraded":"2024-05-08T21:10:07.753579+0000","last_fullsized":"2024-05-08T21:10:07.753579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:25.969085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.048813+0000","last_change":"2024-05-08T21:10:08.048331+0000","last_active":"2024-05-08T21:10:08.048813+0000","last_peered":"2024-05-08T21:10:08.048813+0000","last_clean":"2024-05-08T21:10:08.048813+0000","last_became_active":"2024-05-08T21:10:08.047505+0000","last_became_peered":"2024-05-08T21:10:08.047505+0000","last_unstale":"2024-05-08T21:10:08.048813+0000","last_undegraded":"2024-05-08T21:10:08.048813+0000","last_fullsized":"2024-05-08T21:10:08.048813+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:18:39.268730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.749622+0000","last_change":"2024-05-08T21:10:03.328021+0000","last_active":"2024-05-08T21:10:07.749622+0000","last_peered":"2024-05-08T21:10:07.749622+0000","last_clean":"2024-05-08T21:10:07.749622+0000","last_became_active":"2024-05-08T21:10:03.327648+0000","last_became_peered":"2024-05-08T21:10:03.327648+0000","last_unstale":"2024-05-08T21:10:07.749622+0000","last_undegraded":"2024-05-08T21:10:07.749622+0000","last_fullsized":"2024-05-08T21:10:07.749622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:37:54.491930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046495+0000","last_change":"2024-05-08T21:10:03.750560+0000","last_active":"2024-05-08T21:10:08.046495+0000","last_peered":"2024-05-08T21:10:08.046495+0000","last_clean":"2024-05-08T21:10:08.046495+0000","last_became_active":"2024-05-08T21:10:03.750294+0000","last_became_peered":"2024-05-08T21:10:03.750294+0000","last_unstale":"2024-05-08T21:10:08.046495+0000","last_undegraded":"2024-05-08T21:10:08.046495+0000","last_fullsized":"2024-05-08T21:10:08.046495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:30:47.937326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.059433+0000","last_change":"2024-05-08T21:10:08.052318+0000","last_active":"2024-05-08T21:10:08.059433+0000","last_peered":"2024-05-08T21:10:08.059433+0000","last_clean":"2024-05-08T21:10:08.059433+0000","last_became_active":"2024-05-08T21:10:08.051920+0000","last_became_peered":"2024-05-08T21:10:08.051920+0000","last_unstale":"2024-05-08T21:10:08.059433+0000","last_undegraded":"2024-05-08T21:10:08.059433+0000","last_fullsized":"2024-05-08T21:10:08.059433+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:25:27.669768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.754124+0000","last_change":"2024-05-08T21:10:03.332390+0000","last_active":"2024-05-08T21:10:07.754124+0000","last_peered":"2024-05-08T21:10:07.754124+0000","last_clean":"2024-05-08T21:10:07.754124+0000","last_became_active":"2024-05-08T21:10:03.332105+0000","last_became_peered":"2024-05-08T21:10:03.332105+0000","last_unstale":"2024-05-08T21:10:07.754124+0000","last_undegraded":"2024-05-08T21:10:07.754124+0000","last_fullsized":"2024-05-08T21:10:07.754124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:32:44.705682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.271145+0000","last_change":"2024-05-08T21:10:03.742100+0000","last_active":"2024-05-08T21:10:08.271145+0000","last_peered":"2024-05-08T21:10:08.271145+0000","last_clean":"2024-05-08T21:10:08.271145+0000","last_became_active":"2024-05-08T21:10:03.741742+0000","last_became_peered":"2024-05-08T21:10:03.741742+0000","last_unstale":"2024-05-08T21:10:08.271145+0000","last_undegraded":"2024-05-08T21:10:08.271145+0000","last_fullsized":"2024-05-08T21:10:08.271145+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:53:19.394126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.775032+0000","last_change":"2024-05-08T21:10:07.769850+0000","last_active":"2024-05-08T21:10:07.775032+0000","last_peered":"2024-05-08T21:10:07.775032+0000","last_clean":"2024-05-08T21:10:07.775032+0000","last_became_active":"2024-05-08T21:10:07.769016+0000","last_became_peered":"2024-05-08T21:10:07.769016+0000","last_unstale":"2024-05-08T21:10:07.775032+0000","last_undegraded":"2024-05-08T21:10:07.775032+0000","last_fullsized":"2024-05-08T21:10:07.775032+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:31:52.621418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"25'8","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.741624+0000","last_change":"2024-05-08T21:10:03.331783+0000","last_active":"2024-05-08T21:10:08.741624+0000","last_peered":"2024-05-08T21:10:08.741624+0000","last_clean":"2024-05-08T21:10:08.741624+0000","last_became_active":"2024-05-08T21:10:03.331501+0000","last_became_peered":"2024-05-08T21:10:03.331501+0000","last_unstale":"2024-05-08T21:10:08.741624+0000","last_undegraded":"2024-05-08T21:10:08.741624+0000","last_fullsized":"2024-05-08T21:10:08.741624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:41:28.137295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046481+0000","last_change":"2024-05-08T21:10:03.744007+0000","last_active":"2024-05-08T21:10:08.046481+0000","last_peered":"2024-05-08T21:10:08.046481+0000","last_clean":"2024-05-08T21:10:08.046481+0000","last_became_active":"2024-05-08T21:10:03.743557+0000","last_became_peered":"2024-05-08T21:10:03.743557+0000","last_unstale":"2024-05-08T21:10:08.046481+0000","last_undegraded":"2024-05-08T21:10:08.046481+0000","last_fullsized":"2024-05-08T21:10:08.046481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:45:26.458377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169408+0000","last_change":"2024-05-08T21:10:07.777283+0000","last_active":"2024-05-08T21:10:08.169408+0000","last_peered":"2024-05-08T21:10:08.169408+0000","last_clean":"2024-05-08T21:10:08.169408+0000","last_became_active":"2024-05-08T21:10:07.776858+0000","last_became_peered":"2024-05-08T21:10:07.776858+0000","last_unstale":"2024-05-08T21:10:08.169408+0000","last_undegraded":"2024-05-08T21:10:08.169408+0000","last_fullsized":"2024-05-08T21:10:08.169408+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:51.725885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"26'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.170185+0000","last_change":"2024-05-08T21:10:03.326892+0000","last_active":"2024-05-08T21:10:08.170185+0000","last_peered":"2024-05-08T21:10:08.170185+0000","last_clean":"2024-05-08T21:10:08.170185+0000","last_became_active":"2024-05-08T21:10:03.326608+0000","last_became_peered":"2024-05-08T21:10:03.326608+0000","last_unstale":"2024-05-08T21:10:08.170185+0000","last_undegraded":"2024-05-08T21:10:08.170185+0000","last_fullsized":"2024-05-08T21:10:08.170185+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:33.441985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046649+0000","last_change":"2024-05-08T21:10:03.749221+0000","last_active":"2024-05-08T21:10:08.046649+0000","last_peered":"2024-05-08T21:10:08.046649+0000","last_clean":"2024-05-08T21:10:08.046649+0000","last_became_active":"2024-05-08T21:10:03.748915+0000","last_became_peered":"2024-05-08T21:10:03.748915+0000","last_unstale":"2024-05-08T21:10:08.046649+0000","last_undegraded":"2024-05-08T21:10:08.046649+0000","last_fullsized":"2024-05-08T21:10:08.046649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:03:10.791535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.187371+0000","last_change":"2024-05-08T21:10:07.759492+0000","last_active":"2024-05-08T21:10:08.187371+0000","last_peered":"2024-05-08T21:10:08.187371+0000","last_clean":"2024-05-08T21:10:08.187371+0000","last_became_active":"2024-05-08T21:10:07.759139+0000","last_became_peered":"2024-05-08T21:10:07.759139+0000","last_unstale":"2024-05-08T21:10:08.187371+0000","last_undegraded":"2024-05-08T21:10:08.187371+0000","last_fullsized":"2024-05-08T21:10:08.187371+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:10.579105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.743655+0000","last_change":"2024-05-08T21:10:03.329020+0000","last_active":"2024-05-08T21:10:07.743655+0000","last_peered":"2024-05-08T21:10:07.743655+0000","last_clean":"2024-05-08T21:10:07.743655+0000","last_became_active":"2024-05-08T21:10:03.328739+0000","last_became_peered":"2024-05-08T21:10:03.328739+0000","last_unstale":"2024-05-08T21:10:07.743655+0000","last_undegraded":"2024-05-08T21:10:07.743655+0000","last_fullsized":"2024-05-08T21:10:07.743655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:27:11.168780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.168756+0000","last_change":"2024-05-08T21:10:03.744662+0000","last_active":"2024-05-08T21:10:08.168756+0000","last_peered":"2024-05-08T21:10:08.168756+0000","last_clean":"2024-05-08T21:10:08.168756+0000","last_became_active":"2024-05-08T21:10:03.744398+0000","last_became_peered":"2024-05-08T21:10:03.744398+0000","last_unstale":"2024-05-08T21:10:08.168756+0000","last_undegraded":"2024-05-08T21:10:08.168756+0000","last_fullsized":"2024-05-08T21:10:08.168756+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:05:28.046055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.187253+0000","last_change":"2024-05-08T21:10:07.776566+0000","last_active":"2024-05-08T21:10:08.187253+0000","last_peered":"2024-05-08T21:10:08.187253+0000","last_clean":"2024-05-08T21:10:08.187253+0000","last_became_active":"2024-05-08T21:10:07.776080+0000","last_became_peered":"2024-05-08T21:10:07.776080+0000","last_unstale":"2024-05-08T21:10:08.187253+0000","last_undegraded":"2024-05-08T21:10:08.187253+0000","last_fullsized":"2024-05-08T21:10:08.187253+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:26:09.323466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.749542+0000","last_change":"2024-05-08T21:10:03.332953+0000","last_active":"2024-05-08T21:10:07.749542+0000","last_peered":"2024-05-08T21:10:07.749542+0000","last_clean":"2024-05-08T21:10:07.749542+0000","last_became_active":"2024-05-08T21:10:03.332689+0000","last_became_peered":"2024-05-08T21:10:03.332689+0000","last_unstale":"2024-05-08T21:10:07.749542+0000","last_undegraded":"2024-05-08T21:10:07.749542+0000","last_fullsized":"2024-05-08T21:10:07.749542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:15:32.058369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169816+0000","last_change":"2024-05-08T21:10:03.745651+0000","last_active":"2024-05-08T21:10:08.169816+0000","last_peered":"2024-05-08T21:10:08.169816+0000","last_clean":"2024-05-08T21:10:08.169816+0000","last_became_active":"2024-05-08T21:10:03.742744+0000","last_became_peered":"2024-05-08T21:10:03.742744+0000","last_unstale":"2024-05-08T21:10:08.169816+0000","last_undegraded":"2024-05-08T21:10:08.169816+0000","last_fullsized":"2024-05-08T21:10:08.169816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:32:31.689490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.187096+0000","last_change":"2024-05-08T21:10:07.776527+0000","last_active":"2024-05-08T21:10:08.187096+0000","last_peered":"2024-05-08T21:10:08.187096+0000","last_clean":"2024-05-08T21:10:08.187096+0000","last_became_active":"2024-05-08T21:10:07.776053+0000","last_became_peered":"2024-05-08T21:10:07.776053+0000","last_unstale":"2024-05-08T21:10:08.187096+0000","last_undegraded":"2024-05-08T21:10:08.187096+0000","last_fullsized":"2024-05-08T21:10:08.187096+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:08:26.401358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.186861+0000","last_change":"2024-05-08T21:10:03.738421+0000","last_active":"2024-05-08T21:10:08.186861+0000","last_peered":"2024-05-08T21:10:08.186861+0000","last_clean":"2024-05-08T21:10:08.186861+0000","last_became_active":"2024-05-08T21:10:03.738000+0000","last_became_peered":"2024-05-08T21:10:03.738000+0000","last_unstale":"2024-05-08T21:10:08.186861+0000","last_undegraded":"2024-05-08T21:10:08.186861+0000","last_fullsized":"2024-05-08T21:10:08.186861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:38:05.948755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.751476+0000","last_change":"2024-05-08T21:10:03.331141+0000","last_active":"2024-05-08T21:10:07.751476+0000","last_peered":"2024-05-08T21:10:07.751476+0000","last_clean":"2024-05-08T21:10:07.751476+0000","last_became_active":"2024-05-08T21:10:03.330842+0000","last_became_peered":"2024-05-08T21:10:03.330842+0000","last_unstale":"2024-05-08T21:10:07.751476+0000","last_undegraded":"2024-05-08T21:10:07.751476+0000","last_fullsized":"2024-05-08T21:10:07.751476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:42:52.648932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.271310+0000","last_change":"2024-05-08T21:10:08.049274+0000","last_active":"2024-05-08T21:10:08.271310+0000","last_peered":"2024-05-08T21:10:08.271310+0000","last_clean":"2024-05-08T21:10:08.271310+0000","last_became_active":"2024-05-08T21:10:08.048763+0000","last_became_peered":"2024-05-08T21:10:08.048763+0000","last_unstale":"2024-05-08T21:10:08.271310+0000","last_undegraded":"2024-05-08T21:10:08.271310+0000","last_fullsized":"2024-05-08T21:10:08.271310+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:00:41.257040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.754546+0000","last_change":"2024-05-08T21:10:03.747594+0000","last_active":"2024-05-08T21:10:07.754546+0000","last_peered":"2024-05-08T21:10:07.754546+0000","last_clean":"2024-05-08T21:10:07.754546+0000","last_became_active":"2024-05-08T21:10:03.747360+0000","last_became_peered":"2024-05-08T21:10:03.747360+0000","last_unstale":"2024-05-08T21:10:07.754546+0000","last_undegraded":"2024-05-08T21:10:07.754546+0000","last_fullsized":"2024-05-08T21:10:07.754546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:31:12.357348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.749455+0000","last_change":"2024-05-08T21:10:03.327847+0000","last_active":"2024-05-08T21:10:07.749455+0000","last_peered":"2024-05-08T21:10:07.749455+0000","last_clean":"2024-05-08T21:10:07.749455+0000","last_became_active":"2024-05-08T21:10:03.327530+0000","last_became_peered":"2024-05-08T21:10:03.327530+0000","last_unstale":"2024-05-08T21:10:07.749455+0000","last_undegraded":"2024-05-08T21:10:07.749455+0000","last_fullsized":"2024-05-08T21:10:07.749455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:46.232166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":168,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046147+0000","last_change":"2024-05-08T21:09:59.333990+0000","last_active":"2024-05-08T21:10:08.046147+0000","last_peered":"2024-05-08T21:10:08.046147+0000","last_clean":"2024-05-08T21:10:08.046147+0000","last_became_active":"2024-05-08T21:09:59.332929+0000","last_became_peered":"2024-05-08T21:09:59.332929+0000","last_unstale":"2024-05-08T21:10:08.046147+0000","last_undegraded":"2024-05-08T21:10:08.046147+0000","last_fullsized":"2024-05-08T21:10:08.046147+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:09:58.287675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:09:58.287675+0000","last_clean_scrub_stamp":"2024-05-08T21:09:58.287675+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:47.595380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.052138+0000","last_change":"2024-05-08T21:10:08.049848+0000","last_active":"2024-05-08T21:10:08.052138+0000","last_peered":"2024-05-08T21:10:08.052138+0000","last_clean":"2024-05-08T21:10:08.052138+0000","last_became_active":"2024-05-08T21:10:08.049153+0000","last_became_peered":"2024-05-08T21:10:08.049153+0000","last_unstale":"2024-05-08T21:10:08.052138+0000","last_undegraded":"2024-05-08T21:10:08.052138+0000","last_fullsized":"2024-05-08T21:10:08.052138+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:23.704112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.753311+0000","last_change":"2024-05-08T21:10:03.743094+0000","last_active":"2024-05-08T21:10:07.753311+0000","last_peered":"2024-05-08T21:10:07.753311+0000","last_clean":"2024-05-08T21:10:07.753311+0000","last_became_active":"2024-05-08T21:10:03.742819+0000","last_became_peered":"2024-05-08T21:10:03.742819+0000","last_unstale":"2024-05-08T21:10:07.753311+0000","last_undegraded":"2024-05-08T21:10:07.753311+0000","last_fullsized":"2024-05-08T21:10:07.753311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:41:25.593884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046341+0000","last_change":"2024-05-08T21:10:03.340259+0000","last_active":"2024-05-08T21:10:08.046341+0000","last_peered":"2024-05-08T21:10:08.046341+0000","last_clean":"2024-05-08T21:10:08.046341+0000","last_became_active":"2024-05-08T21:10:03.339957+0000","last_became_peered":"2024-05-08T21:10:03.339957+0000","last_unstale":"2024-05-08T21:10:08.046341+0000","last_undegraded":"2024-05-08T21:10:08.046341+0000","last_fullsized":"2024-05-08T21:10:08.046341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:38:36.535689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.051520+0000","last_change":"2024-05-08T21:10:08.050370+0000","last_active":"2024-05-08T21:10:08.051520+0000","last_peered":"2024-05-08T21:10:08.051520+0000","last_clean":"2024-05-08T21:10:08.051520+0000","last_became_active":"2024-05-08T21:10:08.049962+0000","last_became_peered":"2024-05-08T21:10:08.049962+0000","last_unstale":"2024-05-08T21:10:08.051520+0000","last_undegraded":"2024-05-08T21:10:08.051520+0000","last_fullsized":"2024-05-08T21:10:08.051520+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:11:35.394334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046359+0000","last_change":"2024-05-08T21:10:03.337949+0000","last_active":"2024-05-08T21:10:08.046359+0000","last_peered":"2024-05-08T21:10:08.046359+0000","last_clean":"2024-05-08T21:10:08.046359+0000","last_became_active":"2024-05-08T21:10:03.337627+0000","last_became_peered":"2024-05-08T21:10:03.337627+0000","last_unstale":"2024-05-08T21:10:08.046359+0000","last_undegraded":"2024-05-08T21:10:08.046359+0000","last_fullsized":"2024-05-08T21:10:08.046359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:17:36.792731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.187476+0000","last_change":"2024-05-08T21:10:03.738212+0000","last_active":"2024-05-08T21:10:08.187476+0000","last_peered":"2024-05-08T21:10:08.187476+0000","last_clean":"2024-05-08T21:10:08.187476+0000","last_became_active":"2024-05-08T21:10:03.737927+0000","last_became_peered":"2024-05-08T21:10:03.737927+0000","last_unstale":"2024-05-08T21:10:08.187476+0000","last_undegraded":"2024-05-08T21:10:08.187476+0000","last_fullsized":"2024-05-08T21:10:08.187476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:03:08.031584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.059425+0000","last_change":"2024-05-08T21:10:08.052270+0000","last_active":"2024-05-08T21:10:08.059425+0000","last_peered":"2024-05-08T21:10:08.059425+0000","last_clean":"2024-05-08T21:10:08.059425+0000","last_became_active":"2024-05-08T21:10:08.051881+0000","last_became_peered":"2024-05-08T21:10:08.051881+0000","last_unstale":"2024-05-08T21:10:08.059425+0000","last_undegraded":"2024-05-08T21:10:08.059425+0000","last_fullsized":"2024-05-08T21:10:08.059425+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:39:07.929942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.187471+0000","last_change":"2024-05-08T21:10:03.333696+0000","last_active":"2024-05-08T21:10:08.187471+0000","last_peered":"2024-05-08T21:10:08.187471+0000","last_clean":"2024-05-08T21:10:08.187471+0000","last_became_active":"2024-05-08T21:10:03.333368+0000","last_became_peered":"2024-05-08T21:10:03.333368+0000","last_unstale":"2024-05-08T21:10:08.187471+0000","last_undegraded":"2024-05-08T21:10:08.187471+0000","last_fullsized":"2024-05-08T21:10:08.187471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:00:08.459270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.762624+0000","last_change":"2024-05-08T21:10:03.752578+0000","last_active":"2024-05-08T21:10:07.762624+0000","last_peered":"2024-05-08T21:10:07.762624+0000","last_clean":"2024-05-08T21:10:07.762624+0000","last_became_active":"2024-05-08T21:10:03.752389+0000","last_became_peered":"2024-05-08T21:10:03.752389+0000","last_unstale":"2024-05-08T21:10:07.762624+0000","last_undegraded":"2024-05-08T21:10:07.762624+0000","last_fullsized":"2024-05-08T21:10:07.762624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:54:02.318162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169418+0000","last_change":"2024-05-08T21:10:08.048081+0000","last_active":"2024-05-08T21:10:08.169418+0000","last_peered":"2024-05-08T21:10:08.169418+0000","last_clean":"2024-05-08T21:10:08.169418+0000","last_became_active":"2024-05-08T21:10:08.047632+0000","last_became_peered":"2024-05-08T21:10:08.047632+0000","last_unstale":"2024-05-08T21:10:08.169418+0000","last_undegraded":"2024-05-08T21:10:08.169418+0000","last_fullsized":"2024-05-08T21:10:08.169418+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:26:05.857718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"26'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.738320+0000","last_change":"2024-05-08T21:10:03.340553+0000","last_active":"2024-05-08T21:10:08.738320+0000","last_peered":"2024-05-08T21:10:08.738320+0000","last_clean":"2024-05-08T21:10:08.738320+0000","last_became_active":"2024-05-08T21:10:03.340280+0000","last_became_peered":"2024-05-08T21:10:03.340280+0000","last_unstale":"2024-05-08T21:10:08.738320+0000","last_undegraded":"2024-05-08T21:10:08.738320+0000","last_fullsized":"2024-05-08T21:10:08.738320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:36:24.866220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.754313+0000","last_change":"2024-05-08T21:10:03.736316+0000","last_active":"2024-05-08T21:10:07.754313+0000","last_peered":"2024-05-08T21:10:07.754313+0000","last_clean":"2024-05-08T21:10:07.754313+0000","last_became_active":"2024-05-08T21:10:03.736049+0000","last_became_peered":"2024-05-08T21:10:03.736049+0000","last_unstale":"2024-05-08T21:10:07.754313+0000","last_undegraded":"2024-05-08T21:10:07.754313+0000","last_fullsized":"2024-05-08T21:10:07.754313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:09:48.973609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.170097+0000","last_change":"2024-05-08T21:10:07.777357+0000","last_active":"2024-05-08T21:10:08.170097+0000","last_peered":"2024-05-08T21:10:08.170097+0000","last_clean":"2024-05-08T21:10:08.170097+0000","last_became_active":"2024-05-08T21:10:07.776848+0000","last_became_peered":"2024-05-08T21:10:07.776848+0000","last_unstale":"2024-05-08T21:10:08.170097+0000","last_undegraded":"2024-05-08T21:10:08.170097+0000","last_fullsized":"2024-05-08T21:10:08.170097+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:51:47.727804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046274+0000","last_change":"2024-05-08T21:10:03.340078+0000","last_active":"2024-05-08T21:10:08.046274+0000","last_peered":"2024-05-08T21:10:08.046274+0000","last_clean":"2024-05-08T21:10:08.046274+0000","last_became_active":"2024-05-08T21:10:03.339690+0000","last_became_peered":"2024-05-08T21:10:03.339690+0000","last_unstale":"2024-05-08T21:10:08.046274+0000","last_undegraded":"2024-05-08T21:10:08.046274+0000","last_fullsized":"2024-05-08T21:10:08.046274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:01:33.991878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169765+0000","last_change":"2024-05-08T21:10:03.744606+0000","last_active":"2024-05-08T21:10:08.169765+0000","last_peered":"2024-05-08T21:10:08.169765+0000","last_clean":"2024-05-08T21:10:08.169765+0000","last_became_active":"2024-05-08T21:10:03.744160+0000","last_became_peered":"2024-05-08T21:10:03.744160+0000","last_unstale":"2024-05-08T21:10:08.169765+0000","last_undegraded":"2024-05-08T21:10:08.169765+0000","last_fullsized":"2024-05-08T21:10:08.169765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:10:25.144058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.187244+0000","last_change":"2024-05-08T21:10:08.049224+0000","last_active":"2024-05-08T21:10:08.187244+0000","last_peered":"2024-05-08T21:10:08.187244+0000","last_clean":"2024-05-08T21:10:08.187244+0000","last_became_active":"2024-05-08T21:10:08.048866+0000","last_became_peered":"2024-05-08T21:10:08.048866+0000","last_unstale":"2024-05-08T21:10:08.187244+0000","last_undegraded":"2024-05-08T21:10:08.187244+0000","last_fullsized":"2024-05-08T21:10:08.187244+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:38:20.601167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.743199+0000","last_change":"2024-05-08T21:10:03.339344+0000","last_active":"2024-05-08T21:10:07.743199+0000","last_peered":"2024-05-08T21:10:07.743199+0000","last_clean":"2024-05-08T21:10:07.743199+0000","last_became_active":"2024-05-08T21:10:03.339136+0000","last_became_peered":"2024-05-08T21:10:03.339136+0000","last_unstale":"2024-05-08T21:10:07.743199+0000","last_undegraded":"2024-05-08T21:10:07.743199+0000","last_fullsized":"2024-05-08T21:10:07.743199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:02:55.623727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.757429+0000","last_change":"2024-05-08T21:10:03.737684+0000","last_active":"2024-05-08T21:10:07.757429+0000","last_peered":"2024-05-08T21:10:07.757429+0000","last_clean":"2024-05-08T21:10:07.757429+0000","last_became_active":"2024-05-08T21:10:03.737459+0000","last_became_peered":"2024-05-08T21:10:03.737459+0000","last_unstale":"2024-05-08T21:10:07.757429+0000","last_undegraded":"2024-05-08T21:10:07.757429+0000","last_fullsized":"2024-05-08T21:10:07.757429+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:39.662018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169949+0000","last_change":"2024-05-08T21:10:07.776483+0000","last_active":"2024-05-08T21:10:08.169949+0000","last_peered":"2024-05-08T21:10:08.169949+0000","last_clean":"2024-05-08T21:10:08.169949+0000","last_became_active":"2024-05-08T21:10:07.775956+0000","last_became_peered":"2024-05-08T21:10:07.775956+0000","last_unstale":"2024-05-08T21:10:08.169949+0000","last_undegraded":"2024-05-08T21:10:08.169949+0000","last_fullsized":"2024-05-08T21:10:08.169949+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:28:17.332488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.743317+0000","last_change":"2024-05-08T21:10:03.331695+0000","last_active":"2024-05-08T21:10:07.743317+0000","last_peered":"2024-05-08T21:10:07.743317+0000","last_clean":"2024-05-08T21:10:07.743317+0000","last_became_active":"2024-05-08T21:10:03.331198+0000","last_became_peered":"2024-05-08T21:10:03.331198+0000","last_unstale":"2024-05-08T21:10:07.743317+0000","last_undegraded":"2024-05-08T21:10:07.743317+0000","last_fullsized":"2024-05-08T21:10:07.743317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:37:54.491930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.761445+0000","last_change":"2024-05-08T21:10:03.744562+0000","last_active":"2024-05-08T21:10:07.761445+0000","last_peered":"2024-05-08T21:10:07.761445+0000","last_clean":"2024-05-08T21:10:07.761445+0000","last_became_active":"2024-05-08T21:10:03.744326+0000","last_became_peered":"2024-05-08T21:10:03.744326+0000","last_unstale":"2024-05-08T21:10:07.761445+0000","last_undegraded":"2024-05-08T21:10:07.761445+0000","last_fullsized":"2024-05-08T21:10:07.761445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:21:52.947209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.170163+0000","last_change":"2024-05-08T21:10:07.763204+0000","last_active":"2024-05-08T21:10:08.170163+0000","last_peered":"2024-05-08T21:10:08.170163+0000","last_clean":"2024-05-08T21:10:08.170163+0000","last_became_active":"2024-05-08T21:10:07.762886+0000","last_became_peered":"2024-05-08T21:10:07.762886+0000","last_unstale":"2024-05-08T21:10:08.170163+0000","last_undegraded":"2024-05-08T21:10:08.170163+0000","last_fullsized":"2024-05-08T21:10:08.170163+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:01.599700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.740037+0000","last_change":"2024-05-08T21:10:03.337993+0000","last_active":"2024-05-08T21:10:08.740037+0000","last_peered":"2024-05-08T21:10:08.740037+0000","last_clean":"2024-05-08T21:10:08.740037+0000","last_became_active":"2024-05-08T21:10:03.337654+0000","last_became_peered":"2024-05-08T21:10:03.337654+0000","last_unstale":"2024-05-08T21:10:08.740037+0000","last_undegraded":"2024-05-08T21:10:08.740037+0000","last_fullsized":"2024-05-08T21:10:08.740037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:23:20.536178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.271247+0000","last_change":"2024-05-08T21:10:03.744871+0000","last_active":"2024-05-08T21:10:08.271247+0000","last_peered":"2024-05-08T21:10:08.271247+0000","last_clean":"2024-05-08T21:10:08.271247+0000","last_became_active":"2024-05-08T21:10:03.744589+0000","last_became_peered":"2024-05-08T21:10:03.744589+0000","last_unstale":"2024-05-08T21:10:08.271247+0000","last_undegraded":"2024-05-08T21:10:08.271247+0000","last_fullsized":"2024-05-08T21:10:08.271247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:41.090204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.271212+0000","last_change":"2024-05-08T21:10:08.047735+0000","last_active":"2024-05-08T21:10:08.271212+0000","last_peered":"2024-05-08T21:10:08.271212+0000","last_clean":"2024-05-08T21:10:08.271212+0000","last_became_active":"2024-05-08T21:10:08.047331+0000","last_became_peered":"2024-05-08T21:10:08.047331+0000","last_unstale":"2024-05-08T21:10:08.271212+0000","last_undegraded":"2024-05-08T21:10:08.271212+0000","last_fullsized":"2024-05-08T21:10:08.271212+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:44:22.797154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.751739+0000","last_change":"2024-05-08T21:10:03.333117+0000","last_active":"2024-05-08T21:10:07.751739+0000","last_peered":"2024-05-08T21:10:07.751739+0000","last_clean":"2024-05-08T21:10:07.751739+0000","last_became_active":"2024-05-08T21:10:03.332790+0000","last_became_peered":"2024-05-08T21:10:03.332790+0000","last_unstale":"2024-05-08T21:10:07.751739+0000","last_undegraded":"2024-05-08T21:10:07.751739+0000","last_fullsized":"2024-05-08T21:10:07.751739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:52:36.355804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046458+0000","last_change":"2024-05-08T21:10:03.748047+0000","last_active":"2024-05-08T21:10:08.046458+0000","last_peered":"2024-05-08T21:10:08.046458+0000","last_clean":"2024-05-08T21:10:08.046458+0000","last_became_active":"2024-05-08T21:10:03.747759+0000","last_became_peered":"2024-05-08T21:10:03.747759+0000","last_unstale":"2024-05-08T21:10:08.046458+0000","last_undegraded":"2024-05-08T21:10:08.046458+0000","last_fullsized":"2024-05-08T21:10:08.046458+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:11:05.309278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.775292+0000","last_change":"2024-05-08T21:10:07.761000+0000","last_active":"2024-05-08T21:10:07.775292+0000","last_peered":"2024-05-08T21:10:07.775292+0000","last_clean":"2024-05-08T21:10:07.775292+0000","last_became_active":"2024-05-08T21:10:07.760566+0000","last_became_peered":"2024-05-08T21:10:07.760566+0000","last_unstale":"2024-05-08T21:10:07.775292+0000","last_undegraded":"2024-05-08T21:10:07.775292+0000","last_fullsized":"2024-05-08T21:10:07.775292+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:48:27.435678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"26'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.187152+0000","last_change":"2024-05-08T21:10:03.331358+0000","last_active":"2024-05-08T21:10:08.187152+0000","last_peered":"2024-05-08T21:10:08.187152+0000","last_clean":"2024-05-08T21:10:08.187152+0000","last_became_active":"2024-05-08T21:10:03.331028+0000","last_became_peered":"2024-05-08T21:10:03.331028+0000","last_unstale":"2024-05-08T21:10:08.187152+0000","last_undegraded":"2024-05-08T21:10:08.187152+0000","last_fullsized":"2024-05-08T21:10:08.187152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:18:47.922157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.168527+0000","last_change":"2024-05-08T21:10:03.751285+0000","last_active":"2024-05-08T21:10:08.168527+0000","last_peered":"2024-05-08T21:10:08.168527+0000","last_clean":"2024-05-08T21:10:08.168527+0000","last_became_active":"2024-05-08T21:10:03.746557+0000","last_became_peered":"2024-05-08T21:10:03.746557+0000","last_unstale":"2024-05-08T21:10:08.168527+0000","last_undegraded":"2024-05-08T21:10:08.168527+0000","last_fullsized":"2024-05-08T21:10:08.168527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:50:27.241404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.167816+0000","last_change":"2024-05-08T21:10:08.048830+0000","last_active":"2024-05-08T21:10:08.167816+0000","last_peered":"2024-05-08T21:10:08.167816+0000","last_clean":"2024-05-08T21:10:08.167816+0000","last_became_active":"2024-05-08T21:10:08.048453+0000","last_became_peered":"2024-05-08T21:10:08.048453+0000","last_unstale":"2024-05-08T21:10:08.167816+0000","last_undegraded":"2024-05-08T21:10:08.167816+0000","last_fullsized":"2024-05-08T21:10:08.167816+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:19:28.758712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.737384+0000","last_change":"2024-05-08T21:10:03.330419+0000","last_active":"2024-05-08T21:10:08.737384+0000","last_peered":"2024-05-08T21:10:08.737384+0000","last_clean":"2024-05-08T21:10:08.737384+0000","last_became_active":"2024-05-08T21:10:03.330082+0000","last_became_peered":"2024-05-08T21:10:03.330082+0000","last_unstale":"2024-05-08T21:10:08.737384+0000","last_undegraded":"2024-05-08T21:10:08.737384+0000","last_fullsized":"2024-05-08T21:10:08.737384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:09:20.516386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046810+0000","last_change":"2024-05-08T21:10:03.747306+0000","last_active":"2024-05-08T21:10:08.046810+0000","last_peered":"2024-05-08T21:10:08.046810+0000","last_clean":"2024-05-08T21:10:08.046810+0000","last_became_active":"2024-05-08T21:10:03.746755+0000","last_became_peered":"2024-05-08T21:10:03.746755+0000","last_unstale":"2024-05-08T21:10:08.046810+0000","last_undegraded":"2024-05-08T21:10:08.046810+0000","last_fullsized":"2024-05-08T21:10:08.046810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:17:51.344821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.271171+0000","last_change":"2024-05-08T21:10:03.738627+0000","last_active":"2024-05-08T21:10:08.271171+0000","last_peered":"2024-05-08T21:10:08.271171+0000","last_clean":"2024-05-08T21:10:08.271171+0000","last_became_active":"2024-05-08T21:10:03.738338+0000","last_became_peered":"2024-05-08T21:10:03.738338+0000","last_unstale":"2024-05-08T21:10:08.271171+0000","last_undegraded":"2024-05-08T21:10:08.271171+0000","last_fullsized":"2024-05-08T21:10:08.271171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:34.088831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.751564+0000","last_change":"2024-05-08T21:10:03.745607+0000","last_active":"2024-05-08T21:10:07.751564+0000","last_peered":"2024-05-08T21:10:07.751564+0000","last_clean":"2024-05-08T21:10:07.751564+0000","last_became_active":"2024-05-08T21:10:03.745362+0000","last_became_peered":"2024-05-08T21:10:03.745362+0000","last_unstale":"2024-05-08T21:10:07.751564+0000","last_undegraded":"2024-05-08T21:10:07.751564+0000","last_fullsized":"2024-05-08T21:10:07.751564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:54.399930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.168448+0000","last_change":"2024-05-08T21:10:03.745137+0000","last_active":"2024-05-08T21:10:08.168448+0000","last_peered":"2024-05-08T21:10:08.168448+0000","last_clean":"2024-05-08T21:10:08.168448+0000","last_became_active":"2024-05-08T21:10:03.744844+0000","last_became_peered":"2024-05-08T21:10:03.744844+0000","last_unstale":"2024-05-08T21:10:08.168448+0000","last_undegraded":"2024-05-08T21:10:08.168448+0000","last_fullsized":"2024-05-08T21:10:08.168448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:06.853429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.753792+0000","last_change":"2024-05-08T21:10:03.745163+0000","last_active":"2024-05-08T21:10:07.753792+0000","last_peered":"2024-05-08T21:10:07.753792+0000","last_clean":"2024-05-08T21:10:07.753792+0000","last_became_active":"2024-05-08T21:10:03.744908+0000","last_became_peered":"2024-05-08T21:10:03.744908+0000","last_unstale":"2024-05-08T21:10:07.753792+0000","last_undegraded":"2024-05-08T21:10:07.753792+0000","last_fullsized":"2024-05-08T21:10:07.753792+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:06.593989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.762986+0000","last_change":"2024-05-08T21:10:03.748542+0000","last_active":"2024-05-08T21:10:07.762986+0000","last_peered":"2024-05-08T21:10:07.762986+0000","last_clean":"2024-05-08T21:10:07.762986+0000","last_became_active":"2024-05-08T21:10:03.748284+0000","last_became_peered":"2024-05-08T21:10:03.748284+0000","last_unstale":"2024-05-08T21:10:07.762986+0000","last_undegraded":"2024-05-08T21:10:07.762986+0000","last_fullsized":"2024-05-08T21:10:07.762986+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:49:10.430406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.187090+0000","last_change":"2024-05-08T21:10:03.739778+0000","last_active":"2024-05-08T21:10:08.187090+0000","last_peered":"2024-05-08T21:10:08.187090+0000","last_clean":"2024-05-08T21:10:08.187090+0000","last_became_active":"2024-05-08T21:10:03.739522+0000","last_became_peered":"2024-05-08T21:10:03.739522+0000","last_unstale":"2024-05-08T21:10:08.187090+0000","last_undegraded":"2024-05-08T21:10:08.187090+0000","last_fullsized":"2024-05-08T21:10:08.187090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:07:42.115999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.271345+0000","last_change":"2024-05-08T21:10:03.746126+0000","last_active":"2024-05-08T21:10:08.271345+0000","last_peered":"2024-05-08T21:10:08.271345+0000","last_clean":"2024-05-08T21:10:08.271345+0000","last_became_active":"2024-05-08T21:10:03.745842+0000","last_became_peered":"2024-05-08T21:10:03.745842+0000","last_unstale":"2024-05-08T21:10:08.271345+0000","last_undegraded":"2024-05-08T21:10:08.271345+0000","last_fullsized":"2024-05-08T21:10:08.271345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:51:06.176371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.762738+0000","last_change":"2024-05-08T21:10:03.745007+0000","last_active":"2024-05-08T21:10:07.762738+0000","last_peered":"2024-05-08T21:10:07.762738+0000","last_clean":"2024-05-08T21:10:07.762738+0000","last_became_active":"2024-05-08T21:10:03.744709+0000","last_became_peered":"2024-05-08T21:10:03.744709+0000","last_unstale":"2024-05-08T21:10:07.762738+0000","last_undegraded":"2024-05-08T21:10:07.762738+0000","last_fullsized":"2024-05-08T21:10:07.762738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:12:20.712861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.167909+0000","last_change":"2024-05-08T21:10:03.751111+0000","last_active":"2024-05-08T21:10:08.167909+0000","last_peered":"2024-05-08T21:10:08.167909+0000","last_clean":"2024-05-08T21:10:08.167909+0000","last_became_active":"2024-05-08T21:10:03.747059+0000","last_became_peered":"2024-05-08T21:10:03.747059+0000","last_unstale":"2024-05-08T21:10:08.167909+0000","last_undegraded":"2024-05-08T21:10:08.167909+0000","last_fullsized":"2024-05-08T21:10:08.167909+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:43.254221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.766689+0000","last_change":"2024-05-08T21:10:03.747207+0000","last_active":"2024-05-08T21:10:07.766689+0000","last_peered":"2024-05-08T21:10:07.766689+0000","last_clean":"2024-05-08T21:10:07.766689+0000","last_became_active":"2024-05-08T21:10:03.746942+0000","last_became_peered":"2024-05-08T21:10:03.746942+0000","last_unstale":"2024-05-08T21:10:07.766689+0000","last_undegraded":"2024-05-08T21:10:07.766689+0000","last_fullsized":"2024-05-08T21:10:07.766689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:33:52.317273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.168575+0000","last_change":"2024-05-08T21:10:03.753663+0000","last_active":"2024-05-08T21:10:08.168575+0000","last_peered":"2024-05-08T21:10:08.168575+0000","last_clean":"2024-05-08T21:10:08.168575+0000","last_became_active":"2024-05-08T21:10:03.752486+0000","last_became_peered":"2024-05-08T21:10:03.752486+0000","last_unstale":"2024-05-08T21:10:08.168575+0000","last_undegraded":"2024-05-08T21:10:08.168575+0000","last_fullsized":"2024-05-08T21:10:08.168575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:21:45.895154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.753497+0000","last_change":"2024-05-08T21:10:03.753849+0000","last_active":"2024-05-08T21:10:07.753497+0000","last_peered":"2024-05-08T21:10:07.753497+0000","last_clean":"2024-05-08T21:10:07.753497+0000","last_became_active":"2024-05-08T21:10:03.753616+0000","last_became_peered":"2024-05-08T21:10:03.753616+0000","last_unstale":"2024-05-08T21:10:07.753497+0000","last_undegraded":"2024-05-08T21:10:07.753497+0000","last_fullsized":"2024-05-08T21:10:07.753497+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:02:58.650310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.271297+0000","last_change":"2024-05-08T21:10:03.744906+0000","last_active":"2024-05-08T21:10:08.271297+0000","last_peered":"2024-05-08T21:10:08.271297+0000","last_clean":"2024-05-08T21:10:08.271297+0000","last_became_active":"2024-05-08T21:10:03.744562+0000","last_became_peered":"2024-05-08T21:10:03.744562+0000","last_unstale":"2024-05-08T21:10:08.271297+0000","last_undegraded":"2024-05-08T21:10:08.271297+0000","last_fullsized":"2024-05-08T21:10:08.271297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:21:30.416392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64612,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4856,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44,"ondisk_log_size":44,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509453,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":110300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]}]},{"osd":5,"up_from":15,"seq":64424509454,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":106332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]}]},{"osd":0,"up_from":14,"seq":60129542158,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":348160,"data_stored":697248,"data_compressed":32306,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]}]},{"osd":7,"up_from":14,"seq":60129542157,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":339968,"data_stored":697192,"data_compressed":32306,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":106242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]}]},{"osd":3,"up_from":14,"seq":60129542157,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":110300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]}]},{"osd":1,"up_from":15,"seq":64424509453,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":106402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]}]},{"osd":4,"up_from":15,"seq":64424509453,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":106368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32306,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32306,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":4058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":4058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T21:10:50.474 INFO:tasks.mds_thrash.ceph_manager:clean! 2024-05-08T21:10:50.474 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T21:10:50.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.627+0000 7fe7f86ae700 1 Processor -- start 2024-05-08T21:10:50.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.627+0000 7fe7f86ae700 1 -- start start 2024-05-08T21:10:50.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.628+0000 7fe7f86ae700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe7f01544f0 0x7fe7f00c8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:50.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.628+0000 7fe7f86ae700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe7f00c6db0 0x7fe7f015a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:50.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.628+0000 7fe7f86ae700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe7f00c5890 0x7fe7f015a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:50.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.628+0000 7fe7f86ae700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7f00c4ae0 con 0x7fe7f01544f0 2024-05-08T21:10:50.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.628+0000 7fe7f86ae700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7f00c56d0 con 0x7fe7f00c6db0 2024-05-08T21:10:50.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.628+0000 7fe7f86ae700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f00c6920 con 0x7fe7f00c5890 2024-05-08T21:10:50.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.628+0000 7fe7f644a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe7f01544f0 0x7fe7f00c8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:50.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.628+0000 7fe7f644a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe7f01544f0 0x7fe7f00c8240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34812/0 (socket says 172.21.15.80:34812) 2024-05-08T21:10:50.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.628+0000 7fe7f644a700 1 -- 172.21.15.80:0/2927282256 learned_addr learned my addr 172.21.15.80:0/2927282256 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:50.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.628+0000 7fe7f6c4b700 1 --2- 172.21.15.80:0/2927282256 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe7f00c5890 0x7fe7f015a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:50.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.628+0000 7fe7f5c49700 1 --2- 172.21.15.80:0/2927282256 >> v2:172.21.15.106:3300/0 conn(0x7fe7f00c6db0 0x7fe7f015a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:50.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.628+0000 7fe7f644a700 1 -- 172.21.15.80:0/2927282256 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe7f00c5890 msgr2=0x7fe7f015a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:50.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.628+0000 7fe7f644a700 1 --2- 172.21.15.80:0/2927282256 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe7f00c5890 0x7fe7f015a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:50.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.628+0000 7fe7f644a700 1 -- 172.21.15.80:0/2927282256 >> v2:172.21.15.106:3300/0 conn(0x7fe7f00c6db0 msgr2=0x7fe7f015a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:50.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.628+0000 7fe7f644a700 1 --2- 172.21.15.80:0/2927282256 >> v2:172.21.15.106:3300/0 conn(0x7fe7f00c6db0 0x7fe7f015a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:50.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.628+0000 7fe7f644a700 1 -- 172.21.15.80:0/2927282256 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7f00cb270 con 0x7fe7f01544f0 2024-05-08T21:10:50.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.628+0000 7fe7f5c49700 1 --2- 172.21.15.80:0/2927282256 >> v2:172.21.15.106:3300/0 conn(0x7fe7f00c6db0 0x7fe7f015a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:10:50.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.628+0000 7fe7f644a700 1 --2- 172.21.15.80:0/2927282256 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe7f01544f0 0x7fe7f00c8240 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe7f004f3a0 tx=0x7fe7ec009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a99fc9e64c83c9aa server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:50.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.629+0000 7fe7f5448700 1 -- 172.21.15.80:0/2927282256 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ec00b870 con 0x7fe7f01544f0 2024-05-08T21:10:50.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.629+0000 7fe7f5448700 1 -- 172.21.15.80:0/2927282256 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7ec00b9d0 con 0x7fe7f01544f0 2024-05-08T21:10:50.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.629+0000 7fe7f5448700 1 -- 172.21.15.80:0/2927282256 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ec00bd60 con 0x7fe7f01544f0 2024-05-08T21:10:50.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.629+0000 7fe7f86ae700 1 -- 172.21.15.80:0/2927282256 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe7f01544f0 msgr2=0x7fe7f00c8240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:50.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.629+0000 7fe7f86ae700 1 --2- 172.21.15.80:0/2927282256 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe7f01544f0 0x7fe7f00c8240 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe7f004f3a0 tx=0x7fe7ec009bd0 comp rx=0 tx=0).stop 2024-05-08T21:10:50.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.629+0000 7fe7f86ae700 1 -- 172.21.15.80:0/2927282256 shutdown_connections 2024-05-08T21:10:50.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.629+0000 7fe7f86ae700 1 --2- 172.21.15.80:0/2927282256 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe7f01544f0 0x7fe7f00c8240 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:50.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.629+0000 7fe7f86ae700 1 --2- 172.21.15.80:0/2927282256 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe7f00c5890 0x7fe7f015a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:50.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.629+0000 7fe7f86ae700 1 --2- 172.21.15.80:0/2927282256 >> v2:172.21.15.106:3300/0 conn(0x7fe7f00c6db0 0x7fe7f015a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:50.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.629+0000 7fe7f86ae700 1 -- 172.21.15.80:0/2927282256 >> 172.21.15.80:0/2927282256 conn(0x7fe7f00ca340 msgr2=0x7fe7f00ca750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:50.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.629+0000 7fe7f86ae700 1 -- 172.21.15.80:0/2927282256 shutdown_connections 2024-05-08T21:10:50.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.629+0000 7fe7f86ae700 1 -- 172.21.15.80:0/2927282256 wait complete. 2024-05-08T21:10:50.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.630+0000 7fe7f86ae700 1 Processor -- start 2024-05-08T21:10:50.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.630+0000 7fe7f86ae700 1 -- start start 2024-05-08T21:10:50.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.631+0000 7fe7f86ae700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe7f00c5890 0x7fe7f015e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:50.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.631+0000 7fe7f86ae700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe7f00c6db0 0x7fe7f00ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:50.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.631+0000 7fe7f86ae700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe7f01544f0 0x7fe7f01f3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:50.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.631+0000 7fe7f86ae700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f01f3310 con 0x7fe7f00c6db0 2024-05-08T21:10:50.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.631+0000 7fe7f86ae700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f0152fc0 con 0x7fe7f01544f0 2024-05-08T21:10:50.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.631+0000 7fe7f86ae700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f00c4f90 con 0x7fe7f00c5890 2024-05-08T21:10:50.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.631+0000 7fe7f5c49700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe7f00c6db0 0x7fe7f00ccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:50.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.631+0000 7fe7f5c49700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe7f00c6db0 0x7fe7f00ccb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34814/0 (socket says 172.21.15.80:34814) 2024-05-08T21:10:50.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.631+0000 7fe7f5c49700 1 -- 172.21.15.80:0/1336184142 learned_addr learned my addr 172.21.15.80:0/1336184142 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:50.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.631+0000 7fe7f644a700 1 --2- 172.21.15.80:0/1336184142 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe7f00c5890 0x7fe7f015e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:50.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.631+0000 7fe7f6c4b700 1 --2- 172.21.15.80:0/1336184142 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe7f01544f0 0x7fe7f01f3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:50.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.632+0000 7fe7f5c49700 1 -- 172.21.15.80:0/1336184142 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe7f00c5890 msgr2=0x7fe7f015e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:50.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.632+0000 7fe7f5c49700 1 --2- 172.21.15.80:0/1336184142 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe7f00c5890 0x7fe7f015e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:50.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.632+0000 7fe7f5c49700 1 -- 172.21.15.80:0/1336184142 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe7f01544f0 msgr2=0x7fe7f01f3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:50.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.632+0000 7fe7f5c49700 1 --2- 172.21.15.80:0/1336184142 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe7f01544f0 0x7fe7f01f3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:50.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.632+0000 7fe7f5c49700 1 -- 172.21.15.80:0/1336184142 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7ec009550 con 0x7fe7f00c6db0 2024-05-08T21:10:50.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.632+0000 7fe7f5c49700 1 --2- 172.21.15.80:0/1336184142 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe7f00c6db0 0x7fe7f00ccb30 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe7e000c770 tx=0x7fe7e000ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:50.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.632+0000 7fe7e6ffd700 1 -- 172.21.15.80:0/1336184142 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e0004220 con 0x7fe7f00c6db0 2024-05-08T21:10:50.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.632+0000 7fe7e6ffd700 1 -- 172.21.15.80:0/1336184142 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7e0004380 con 0x7fe7f00c6db0 2024-05-08T21:10:50.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.632+0000 7fe7f86ae700 1 -- 172.21.15.80:0/1336184142 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7f0153790 con 0x7fe7f00c6db0 2024-05-08T21:10:50.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.632+0000 7fe7e6ffd700 1 -- 172.21.15.80:0/1336184142 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e00036a0 con 0x7fe7f00c6db0 2024-05-08T21:10:50.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.632+0000 7fe7f86ae700 1 -- 172.21.15.80:0/1336184142 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7f0151a00 con 0x7fe7f00c6db0 2024-05-08T21:10:50.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.633+0000 7fe7f86ae700 1 -- 172.21.15.80:0/1336184142 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7f00c7b10 con 0x7fe7f00c6db0 2024-05-08T21:10:50.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.633+0000 7fe7e6ffd700 1 -- 172.21.15.80:0/1336184142 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe7e0003800 con 0x7fe7f00c6db0 2024-05-08T21:10:50.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.634+0000 7fe7e6ffd700 1 --2- 172.21.15.80:0/1336184142 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe7d406acc0 0x7fe7d406d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:50.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.634+0000 7fe7e6ffd700 1 -- 172.21.15.80:0/1336184142 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe7e0089800 con 0x7fe7f00c6db0 2024-05-08T21:10:50.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.634+0000 7fe7f644a700 1 --2- 172.21.15.80:0/1336184142 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe7d406acc0 0x7fe7d406d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:50.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.634+0000 7fe7f644a700 1 --2- 172.21.15.80:0/1336184142 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe7d406acc0 0x7fe7d406d180 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec014040 tx=0x7fe7ec008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:50.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.638+0000 7fe7e6ffd700 1 -- 172.21.15.80:0/1336184142 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fe7e0054660 con 0x7fe7f00c6db0 2024-05-08T21:10:50.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.829+0000 7fe7f86ae700 1 -- 172.21.15.80:0/1336184142 --> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe7f015ae60 con 0x7fe7d406acc0 2024-05-08T21:10:50.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.838+0000 7fe7e6ffd700 1 -- 172.21.15.80:0/1336184142 <== mgr.4100 v2:172.21.15.80:6832/46731 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345368 (secure 0 0 0) 0x7fe7ec00bc70 con 0x7fe7d406acc0 2024-05-08T21:10:50.845 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:10:50.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.842+0000 7fe7f86ae700 1 -- 172.21.15.80:0/1336184142 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe7d406acc0 msgr2=0x7fe7d406d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:50.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.842+0000 7fe7f86ae700 1 --2- 172.21.15.80:0/1336184142 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe7d406acc0 0x7fe7d406d180 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec014040 tx=0x7fe7ec008030 comp rx=0 tx=0).stop 2024-05-08T21:10:50.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.842+0000 7fe7f86ae700 1 -- 172.21.15.80:0/1336184142 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe7f00c6db0 msgr2=0x7fe7f00ccb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:50.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.842+0000 7fe7f86ae700 1 --2- 172.21.15.80:0/1336184142 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe7f00c6db0 0x7fe7f00ccb30 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe7e000c770 tx=0x7fe7e000ca80 comp rx=0 tx=0).stop 2024-05-08T21:10:50.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.842+0000 7fe7f86ae700 1 -- 172.21.15.80:0/1336184142 shutdown_connections 2024-05-08T21:10:50.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.842+0000 7fe7f86ae700 1 --2- 172.21.15.80:0/1336184142 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe7d406acc0 0x7fe7d406d180 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:50.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.842+0000 7fe7f86ae700 1 --2- 172.21.15.80:0/1336184142 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe7f01544f0 0x7fe7f01f3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:50.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.842+0000 7fe7f86ae700 1 --2- 172.21.15.80:0/1336184142 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe7f00c5890 0x7fe7f015e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:50.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.842+0000 7fe7f86ae700 1 --2- 172.21.15.80:0/1336184142 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe7f00c6db0 0x7fe7f00ccb30 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:50.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.842+0000 7fe7f86ae700 1 -- 172.21.15.80:0/1336184142 >> 172.21.15.80:0/1336184142 conn(0x7fe7f00ca340 msgr2=0x7fe7f01485e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:50.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.842+0000 7fe7f86ae700 1 -- 172.21.15.80:0/1336184142 shutdown_connections 2024-05-08T21:10:50.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:50.842+0000 7fe7f86ae700 1 -- 172.21.15.80:0/1336184142 wait complete. 2024-05-08T21:10:50.848 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-05-08T21:10:50.856 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":47,"stamp":"2024-05-08T21:10:50.208878+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595224,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":209,"num_write_kb":2436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218452,"kb_used_data":2304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756268,"statfs":{"total":773094113280,"available":772870418432,"internally_reserved":0,"allocated":2359296,"data_stored":2040384,"data_compressed":64612,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":262,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002608"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.048091+0000","last_change":"2024-05-08T21:10:03.747477+0000","last_active":"2024-05-08T21:10:08.048091+0000","last_peered":"2024-05-08T21:10:08.048091+0000","last_clean":"2024-05-08T21:10:08.048091+0000","last_became_active":"2024-05-08T21:10:03.747059+0000","last_became_peered":"2024-05-08T21:10:03.747059+0000","last_unstale":"2024-05-08T21:10:08.048091+0000","last_undegraded":"2024-05-08T21:10:08.048091+0000","last_fullsized":"2024-05-08T21:10:08.048091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:15:24.340135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.187600+0000","last_change":"2024-05-08T21:10:03.738974+0000","last_active":"2024-05-08T21:10:08.187600+0000","last_peered":"2024-05-08T21:10:08.187600+0000","last_clean":"2024-05-08T21:10:08.187600+0000","last_became_active":"2024-05-08T21:10:03.738466+0000","last_became_peered":"2024-05-08T21:10:03.738466+0000","last_unstale":"2024-05-08T21:10:08.187600+0000","last_undegraded":"2024-05-08T21:10:08.187600+0000","last_fullsized":"2024-05-08T21:10:08.187600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:59.683039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.753636+0000","last_change":"2024-05-08T21:10:03.740146+0000","last_active":"2024-05-08T21:10:07.753636+0000","last_peered":"2024-05-08T21:10:07.753636+0000","last_clean":"2024-05-08T21:10:07.753636+0000","last_became_active":"2024-05-08T21:10:03.739884+0000","last_became_peered":"2024-05-08T21:10:03.739884+0000","last_unstale":"2024-05-08T21:10:07.753636+0000","last_undegraded":"2024-05-08T21:10:07.753636+0000","last_fullsized":"2024-05-08T21:10:07.753636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:51:44.301305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.168400+0000","last_change":"2024-05-08T21:10:03.754159+0000","last_active":"2024-05-08T21:10:08.168400+0000","last_peered":"2024-05-08T21:10:08.168400+0000","last_clean":"2024-05-08T21:10:08.168400+0000","last_became_active":"2024-05-08T21:10:03.753800+0000","last_became_peered":"2024-05-08T21:10:03.753800+0000","last_unstale":"2024-05-08T21:10:08.168400+0000","last_undegraded":"2024-05-08T21:10:08.168400+0000","last_fullsized":"2024-05-08T21:10:08.168400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:41:02.625080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046322+0000","last_change":"2024-05-08T21:10:03.750051+0000","last_active":"2024-05-08T21:10:08.046322+0000","last_peered":"2024-05-08T21:10:08.046322+0000","last_clean":"2024-05-08T21:10:08.046322+0000","last_became_active":"2024-05-08T21:10:03.749730+0000","last_became_peered":"2024-05-08T21:10:03.749730+0000","last_unstale":"2024-05-08T21:10:08.046322+0000","last_undegraded":"2024-05-08T21:10:08.046322+0000","last_fullsized":"2024-05-08T21:10:08.046322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:49.402253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.168597+0000","last_change":"2024-05-08T21:10:03.746043+0000","last_active":"2024-05-08T21:10:08.168597+0000","last_peered":"2024-05-08T21:10:08.168597+0000","last_clean":"2024-05-08T21:10:08.168597+0000","last_became_active":"2024-05-08T21:10:03.745747+0000","last_became_peered":"2024-05-08T21:10:03.745747+0000","last_unstale":"2024-05-08T21:10:08.168597+0000","last_undegraded":"2024-05-08T21:10:08.168597+0000","last_fullsized":"2024-05-08T21:10:08.168597+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:05:49.465405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046256+0000","last_change":"2024-05-08T21:10:03.743802+0000","last_active":"2024-05-08T21:10:08.046256+0000","last_peered":"2024-05-08T21:10:08.046256+0000","last_clean":"2024-05-08T21:10:08.046256+0000","last_became_active":"2024-05-08T21:10:03.743349+0000","last_became_peered":"2024-05-08T21:10:03.743349+0000","last_unstale":"2024-05-08T21:10:08.046256+0000","last_undegraded":"2024-05-08T21:10:08.046256+0000","last_fullsized":"2024-05-08T21:10:08.046256+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:08:06.408724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.757451+0000","last_change":"2024-05-08T21:10:03.747558+0000","last_active":"2024-05-08T21:10:07.757451+0000","last_peered":"2024-05-08T21:10:07.757451+0000","last_clean":"2024-05-08T21:10:07.757451+0000","last_became_active":"2024-05-08T21:10:03.747300+0000","last_became_peered":"2024-05-08T21:10:03.747300+0000","last_unstale":"2024-05-08T21:10:07.757451+0000","last_undegraded":"2024-05-08T21:10:07.757451+0000","last_fullsized":"2024-05-08T21:10:07.757451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:07:50.266894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046942+0000","last_change":"2024-05-08T21:10:03.748221+0000","last_active":"2024-05-08T21:10:08.046942+0000","last_peered":"2024-05-08T21:10:08.046942+0000","last_clean":"2024-05-08T21:10:08.046942+0000","last_became_active":"2024-05-08T21:10:03.747956+0000","last_became_peered":"2024-05-08T21:10:03.747956+0000","last_unstale":"2024-05-08T21:10:08.046942+0000","last_undegraded":"2024-05-08T21:10:08.046942+0000","last_fullsized":"2024-05-08T21:10:08.046942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:27:35.947884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.271333+0000","last_change":"2024-05-08T21:10:03.745291+0000","last_active":"2024-05-08T21:10:08.271333+0000","last_peered":"2024-05-08T21:10:08.271333+0000","last_clean":"2024-05-08T21:10:08.271333+0000","last_became_active":"2024-05-08T21:10:03.744976+0000","last_became_peered":"2024-05-08T21:10:03.744976+0000","last_unstale":"2024-05-08T21:10:08.271333+0000","last_undegraded":"2024-05-08T21:10:08.271333+0000","last_fullsized":"2024-05-08T21:10:08.271333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:36:54.983642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.271323+0000","last_change":"2024-05-08T21:10:03.748518+0000","last_active":"2024-05-08T21:10:08.271323+0000","last_peered":"2024-05-08T21:10:08.271323+0000","last_clean":"2024-05-08T21:10:08.271323+0000","last_became_active":"2024-05-08T21:10:03.748253+0000","last_became_peered":"2024-05-08T21:10:03.748253+0000","last_unstale":"2024-05-08T21:10:08.271323+0000","last_undegraded":"2024-05-08T21:10:08.271323+0000","last_fullsized":"2024-05-08T21:10:08.271323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:03:26.013122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.170038+0000","last_change":"2024-05-08T21:10:03.745985+0000","last_active":"2024-05-08T21:10:08.170038+0000","last_peered":"2024-05-08T21:10:08.170038+0000","last_clean":"2024-05-08T21:10:08.170038+0000","last_became_active":"2024-05-08T21:10:03.745247+0000","last_became_peered":"2024-05-08T21:10:03.745247+0000","last_unstale":"2024-05-08T21:10:08.170038+0000","last_undegraded":"2024-05-08T21:10:08.170038+0000","last_fullsized":"2024-05-08T21:10:08.170038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:59:42.506304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.761196+0000","last_change":"2024-05-08T21:10:03.747016+0000","last_active":"2024-05-08T21:10:07.761196+0000","last_peered":"2024-05-08T21:10:07.761196+0000","last_clean":"2024-05-08T21:10:07.761196+0000","last_became_active":"2024-05-08T21:10:03.746848+0000","last_became_peered":"2024-05-08T21:10:03.746848+0000","last_unstale":"2024-05-08T21:10:07.761196+0000","last_undegraded":"2024-05-08T21:10:07.761196+0000","last_fullsized":"2024-05-08T21:10:07.761196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:41:21.081035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.753493+0000","last_change":"2024-05-08T21:10:03.737984+0000","last_active":"2024-05-08T21:10:07.753493+0000","last_peered":"2024-05-08T21:10:07.753493+0000","last_clean":"2024-05-08T21:10:07.753493+0000","last_became_active":"2024-05-08T21:10:03.737716+0000","last_became_peered":"2024-05-08T21:10:03.737716+0000","last_unstale":"2024-05-08T21:10:07.753493+0000","last_undegraded":"2024-05-08T21:10:07.753493+0000","last_fullsized":"2024-05-08T21:10:07.753493+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:09:47.758272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.186816+0000","last_change":"2024-05-08T21:10:03.744543+0000","last_active":"2024-05-08T21:10:08.186816+0000","last_peered":"2024-05-08T21:10:08.186816+0000","last_clean":"2024-05-08T21:10:08.186816+0000","last_became_active":"2024-05-08T21:10:03.744276+0000","last_became_peered":"2024-05-08T21:10:03.744276+0000","last_unstale":"2024-05-08T21:10:08.186816+0000","last_undegraded":"2024-05-08T21:10:08.186816+0000","last_fullsized":"2024-05-08T21:10:08.186816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:25:04.113297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.167751+0000","last_change":"2024-05-08T21:10:03.746547+0000","last_active":"2024-05-08T21:10:08.167751+0000","last_peered":"2024-05-08T21:10:08.167751+0000","last_clean":"2024-05-08T21:10:08.167751+0000","last_became_active":"2024-05-08T21:10:03.745862+0000","last_became_peered":"2024-05-08T21:10:03.745862+0000","last_unstale":"2024-05-08T21:10:08.167751+0000","last_undegraded":"2024-05-08T21:10:08.167751+0000","last_fullsized":"2024-05-08T21:10:08.167751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:12.776310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169108+0000","last_change":"2024-05-08T21:10:03.754230+0000","last_active":"2024-05-08T21:10:08.169108+0000","last_peered":"2024-05-08T21:10:08.169108+0000","last_clean":"2024-05-08T21:10:08.169108+0000","last_became_active":"2024-05-08T21:10:03.753895+0000","last_became_peered":"2024-05-08T21:10:03.753895+0000","last_unstale":"2024-05-08T21:10:08.169108+0000","last_undegraded":"2024-05-08T21:10:08.169108+0000","last_fullsized":"2024-05-08T21:10:08.169108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:41:47.214215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.751781+0000","last_change":"2024-05-08T21:10:03.743889+0000","last_active":"2024-05-08T21:10:07.751781+0000","last_peered":"2024-05-08T21:10:07.751781+0000","last_clean":"2024-05-08T21:10:07.751781+0000","last_became_active":"2024-05-08T21:10:03.743596+0000","last_became_peered":"2024-05-08T21:10:03.743596+0000","last_unstale":"2024-05-08T21:10:07.751781+0000","last_undegraded":"2024-05-08T21:10:07.751781+0000","last_fullsized":"2024-05-08T21:10:07.751781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:53.981781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046658+0000","last_change":"2024-05-08T21:10:03.743893+0000","last_active":"2024-05-08T21:10:08.046658+0000","last_peered":"2024-05-08T21:10:08.046658+0000","last_clean":"2024-05-08T21:10:08.046658+0000","last_became_active":"2024-05-08T21:10:03.743580+0000","last_became_peered":"2024-05-08T21:10:03.743580+0000","last_unstale":"2024-05-08T21:10:08.046658+0000","last_undegraded":"2024-05-08T21:10:08.046658+0000","last_fullsized":"2024-05-08T21:10:08.046658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:44:21.747625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.059425+0000","last_change":"2024-05-08T21:10:08.052394+0000","last_active":"2024-05-08T21:10:08.059425+0000","last_peered":"2024-05-08T21:10:08.059425+0000","last_clean":"2024-05-08T21:10:08.059425+0000","last_became_active":"2024-05-08T21:10:08.052009+0000","last_became_peered":"2024-05-08T21:10:08.052009+0000","last_unstale":"2024-05-08T21:10:08.059425+0000","last_undegraded":"2024-05-08T21:10:08.059425+0000","last_fullsized":"2024-05-08T21:10:08.059425+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:47:20.148683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"25'4","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.741230+0000","last_change":"2024-05-08T21:10:03.340118+0000","last_active":"2024-05-08T21:10:08.741230+0000","last_peered":"2024-05-08T21:10:08.741230+0000","last_clean":"2024-05-08T21:10:08.741230+0000","last_became_active":"2024-05-08T21:10:03.339847+0000","last_became_peered":"2024-05-08T21:10:03.339847+0000","last_unstale":"2024-05-08T21:10:08.741230+0000","last_undegraded":"2024-05-08T21:10:08.741230+0000","last_fullsized":"2024-05-08T21:10:08.741230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:05:56.369631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.768418+0000","last_change":"2024-05-08T21:10:03.746516+0000","last_active":"2024-05-08T21:10:07.768418+0000","last_peered":"2024-05-08T21:10:07.768418+0000","last_clean":"2024-05-08T21:10:07.768418+0000","last_became_active":"2024-05-08T21:10:03.746383+0000","last_became_peered":"2024-05-08T21:10:03.746383+0000","last_unstale":"2024-05-08T21:10:07.768418+0000","last_undegraded":"2024-05-08T21:10:07.768418+0000","last_fullsized":"2024-05-08T21:10:07.768418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:29:05.305134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169483+0000","last_change":"2024-05-08T21:10:07.766498+0000","last_active":"2024-05-08T21:10:08.169483+0000","last_peered":"2024-05-08T21:10:08.169483+0000","last_clean":"2024-05-08T21:10:08.169483+0000","last_became_active":"2024-05-08T21:10:07.766119+0000","last_became_peered":"2024-05-08T21:10:07.766119+0000","last_unstale":"2024-05-08T21:10:08.169483+0000","last_undegraded":"2024-05-08T21:10:08.169483+0000","last_fullsized":"2024-05-08T21:10:08.169483+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:58:38.720848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"26'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.508429+0000","last_change":"2024-05-08T21:10:03.329414+0000","last_active":"2024-05-08T21:10:08.508429+0000","last_peered":"2024-05-08T21:10:08.508429+0000","last_clean":"2024-05-08T21:10:08.508429+0000","last_became_active":"2024-05-08T21:10:03.328970+0000","last_became_peered":"2024-05-08T21:10:03.328970+0000","last_unstale":"2024-05-08T21:10:08.508429+0000","last_undegraded":"2024-05-08T21:10:08.508429+0000","last_fullsized":"2024-05-08T21:10:08.508429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:34:32.820755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.753820+0000","last_change":"2024-05-08T21:10:03.748566+0000","last_active":"2024-05-08T21:10:07.753820+0000","last_peered":"2024-05-08T21:10:07.753820+0000","last_clean":"2024-05-08T21:10:07.753820+0000","last_became_active":"2024-05-08T21:10:03.747989+0000","last_became_peered":"2024-05-08T21:10:03.747989+0000","last_unstale":"2024-05-08T21:10:07.753820+0000","last_undegraded":"2024-05-08T21:10:07.753820+0000","last_fullsized":"2024-05-08T21:10:07.753820+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:19:03.468394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169607+0000","last_change":"2024-05-08T21:10:07.770390+0000","last_active":"2024-05-08T21:10:08.169607+0000","last_peered":"2024-05-08T21:10:08.169607+0000","last_clean":"2024-05-08T21:10:08.169607+0000","last_became_active":"2024-05-08T21:10:07.770017+0000","last_became_peered":"2024-05-08T21:10:07.770017+0000","last_unstale":"2024-05-08T21:10:08.169607+0000","last_undegraded":"2024-05-08T21:10:08.169607+0000","last_fullsized":"2024-05-08T21:10:08.169607+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:12:00.200848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.738243+0000","last_change":"2024-05-08T21:10:03.339207+0000","last_active":"2024-05-08T21:10:08.738243+0000","last_peered":"2024-05-08T21:10:08.738243+0000","last_clean":"2024-05-08T21:10:08.738243+0000","last_became_active":"2024-05-08T21:10:03.338917+0000","last_became_peered":"2024-05-08T21:10:03.338917+0000","last_unstale":"2024-05-08T21:10:08.738243+0000","last_undegraded":"2024-05-08T21:10:08.738243+0000","last_fullsized":"2024-05-08T21:10:08.738243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:20.676853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.168481+0000","last_change":"2024-05-08T21:10:03.753998+0000","last_active":"2024-05-08T21:10:08.168481+0000","last_peered":"2024-05-08T21:10:08.168481+0000","last_clean":"2024-05-08T21:10:08.168481+0000","last_became_active":"2024-05-08T21:10:03.753720+0000","last_became_peered":"2024-05-08T21:10:03.753720+0000","last_unstale":"2024-05-08T21:10:08.168481+0000","last_undegraded":"2024-05-08T21:10:08.168481+0000","last_fullsized":"2024-05-08T21:10:08.168481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:00:38.531282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169599+0000","last_change":"2024-05-08T21:10:07.776367+0000","last_active":"2024-05-08T21:10:08.169599+0000","last_peered":"2024-05-08T21:10:08.169599+0000","last_clean":"2024-05-08T21:10:08.169599+0000","last_became_active":"2024-05-08T21:10:07.775998+0000","last_became_peered":"2024-05-08T21:10:07.775998+0000","last_unstale":"2024-05-08T21:10:08.169599+0000","last_undegraded":"2024-05-08T21:10:08.169599+0000","last_fullsized":"2024-05-08T21:10:08.169599+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:24:18.845560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.740209+0000","last_change":"2024-05-08T21:10:03.339182+0000","last_active":"2024-05-08T21:10:08.740209+0000","last_peered":"2024-05-08T21:10:08.740209+0000","last_clean":"2024-05-08T21:10:08.740209+0000","last_became_active":"2024-05-08T21:10:03.338899+0000","last_became_peered":"2024-05-08T21:10:03.338899+0000","last_unstale":"2024-05-08T21:10:08.740209+0000","last_undegraded":"2024-05-08T21:10:08.740209+0000","last_fullsized":"2024-05-08T21:10:08.740209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:55:53.368546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.168672+0000","last_change":"2024-05-08T21:10:03.750724+0000","last_active":"2024-05-08T21:10:08.168672+0000","last_peered":"2024-05-08T21:10:08.168672+0000","last_clean":"2024-05-08T21:10:08.168672+0000","last_became_active":"2024-05-08T21:10:03.750371+0000","last_became_peered":"2024-05-08T21:10:03.750371+0000","last_unstale":"2024-05-08T21:10:08.168672+0000","last_undegraded":"2024-05-08T21:10:08.168672+0000","last_fullsized":"2024-05-08T21:10:08.168672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:14:01.935211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.775704+0000","last_change":"2024-05-08T21:10:07.767604+0000","last_active":"2024-05-08T21:10:07.775704+0000","last_peered":"2024-05-08T21:10:07.775704+0000","last_clean":"2024-05-08T21:10:07.775704+0000","last_became_active":"2024-05-08T21:10:07.767234+0000","last_became_peered":"2024-05-08T21:10:07.767234+0000","last_unstale":"2024-05-08T21:10:07.775704+0000","last_undegraded":"2024-05-08T21:10:07.775704+0000","last_fullsized":"2024-05-08T21:10:07.775704+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:30:21.411491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"26'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.508102+0000","last_change":"2024-05-08T21:10:03.338149+0000","last_active":"2024-05-08T21:10:08.508102+0000","last_peered":"2024-05-08T21:10:08.508102+0000","last_clean":"2024-05-08T21:10:08.508102+0000","last_became_active":"2024-05-08T21:10:03.337860+0000","last_became_peered":"2024-05-08T21:10:03.337860+0000","last_unstale":"2024-05-08T21:10:08.508102+0000","last_undegraded":"2024-05-08T21:10:08.508102+0000","last_fullsized":"2024-05-08T21:10:08.508102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:07:39.052625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169664+0000","last_change":"2024-05-08T21:10:03.743506+0000","last_active":"2024-05-08T21:10:08.169664+0000","last_peered":"2024-05-08T21:10:08.169664+0000","last_clean":"2024-05-08T21:10:08.169664+0000","last_became_active":"2024-05-08T21:10:03.743227+0000","last_became_peered":"2024-05-08T21:10:03.743227+0000","last_unstale":"2024-05-08T21:10:08.169664+0000","last_undegraded":"2024-05-08T21:10:08.169664+0000","last_fullsized":"2024-05-08T21:10:08.169664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:45:47.977619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.741849+0000","last_change":"2024-05-08T21:10:07.768424+0000","last_active":"2024-05-08T21:10:08.741849+0000","last_peered":"2024-05-08T21:10:08.741849+0000","last_clean":"2024-05-08T21:10:08.741849+0000","last_became_active":"2024-05-08T21:10:07.768160+0000","last_became_peered":"2024-05-08T21:10:07.768160+0000","last_unstale":"2024-05-08T21:10:08.741849+0000","last_undegraded":"2024-05-08T21:10:08.741849+0000","last_fullsized":"2024-05-08T21:10:08.741849+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:42:44.327080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"26'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.606664+0000","last_change":"2024-05-08T21:10:03.333647+0000","last_active":"2024-05-08T21:10:08.606664+0000","last_peered":"2024-05-08T21:10:08.606664+0000","last_clean":"2024-05-08T21:10:08.606664+0000","last_became_active":"2024-05-08T21:10:03.332844+0000","last_became_peered":"2024-05-08T21:10:03.332844+0000","last_unstale":"2024-05-08T21:10:08.606664+0000","last_undegraded":"2024-05-08T21:10:08.606664+0000","last_fullsized":"2024-05-08T21:10:08.606664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:47:40.344808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.753370+0000","last_change":"2024-05-08T21:10:03.743003+0000","last_active":"2024-05-08T21:10:07.753370+0000","last_peered":"2024-05-08T21:10:07.753370+0000","last_clean":"2024-05-08T21:10:07.753370+0000","last_became_active":"2024-05-08T21:10:03.742753+0000","last_became_peered":"2024-05-08T21:10:03.742753+0000","last_unstale":"2024-05-08T21:10:07.753370+0000","last_undegraded":"2024-05-08T21:10:07.753370+0000","last_fullsized":"2024-05-08T21:10:07.753370+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:45:49.575877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.271366+0000","last_change":"2024-05-08T21:10:07.770105+0000","last_active":"2024-05-08T21:10:08.271366+0000","last_peered":"2024-05-08T21:10:08.271366+0000","last_clean":"2024-05-08T21:10:08.271366+0000","last_became_active":"2024-05-08T21:10:07.769668+0000","last_became_peered":"2024-05-08T21:10:07.769668+0000","last_unstale":"2024-05-08T21:10:08.271366+0000","last_undegraded":"2024-05-08T21:10:08.271366+0000","last_fullsized":"2024-05-08T21:10:08.271366+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:07:21.560031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.766792+0000","last_change":"2024-05-08T21:10:03.333025+0000","last_active":"2024-05-08T21:10:07.766792+0000","last_peered":"2024-05-08T21:10:07.766792+0000","last_clean":"2024-05-08T21:10:07.766792+0000","last_became_active":"2024-05-08T21:10:03.332750+0000","last_became_peered":"2024-05-08T21:10:03.332750+0000","last_unstale":"2024-05-08T21:10:07.766792+0000","last_undegraded":"2024-05-08T21:10:07.766792+0000","last_fullsized":"2024-05-08T21:10:07.766792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:20:50.134647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.756963+0000","last_change":"2024-05-08T21:10:03.744023+0000","last_active":"2024-05-08T21:10:07.756963+0000","last_peered":"2024-05-08T21:10:07.756963+0000","last_clean":"2024-05-08T21:10:07.756963+0000","last_became_active":"2024-05-08T21:10:03.743724+0000","last_became_peered":"2024-05-08T21:10:03.743724+0000","last_unstale":"2024-05-08T21:10:07.756963+0000","last_undegraded":"2024-05-08T21:10:07.756963+0000","last_fullsized":"2024-05-08T21:10:07.756963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:50:36.857245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.059558+0000","last_change":"2024-05-08T21:10:08.052307+0000","last_active":"2024-05-08T21:10:08.059558+0000","last_peered":"2024-05-08T21:10:08.059558+0000","last_clean":"2024-05-08T21:10:08.059558+0000","last_became_active":"2024-05-08T21:10:08.051924+0000","last_became_peered":"2024-05-08T21:10:08.051924+0000","last_unstale":"2024-05-08T21:10:08.059558+0000","last_undegraded":"2024-05-08T21:10:08.059558+0000","last_fullsized":"2024-05-08T21:10:08.059558+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:56:37.264246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.750197+0000","last_change":"2024-05-08T21:10:03.330304+0000","last_active":"2024-05-08T21:10:07.750197+0000","last_peered":"2024-05-08T21:10:07.750197+0000","last_clean":"2024-05-08T21:10:07.750197+0000","last_became_active":"2024-05-08T21:10:03.330054+0000","last_became_peered":"2024-05-08T21:10:03.330054+0000","last_unstale":"2024-05-08T21:10:07.750197+0000","last_undegraded":"2024-05-08T21:10:07.750197+0000","last_fullsized":"2024-05-08T21:10:07.750197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:30.518935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.186997+0000","last_change":"2024-05-08T21:10:03.739687+0000","last_active":"2024-05-08T21:10:08.186997+0000","last_peered":"2024-05-08T21:10:08.186997+0000","last_clean":"2024-05-08T21:10:08.186997+0000","last_became_active":"2024-05-08T21:10:03.739425+0000","last_became_peered":"2024-05-08T21:10:03.739425+0000","last_unstale":"2024-05-08T21:10:08.186997+0000","last_undegraded":"2024-05-08T21:10:08.186997+0000","last_fullsized":"2024-05-08T21:10:08.186997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:45:59.295081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.054235+0000","last_change":"2024-05-08T21:10:08.050980+0000","last_active":"2024-05-08T21:10:08.054235+0000","last_peered":"2024-05-08T21:10:08.054235+0000","last_clean":"2024-05-08T21:10:08.054235+0000","last_became_active":"2024-05-08T21:10:08.050625+0000","last_became_peered":"2024-05-08T21:10:08.050625+0000","last_unstale":"2024-05-08T21:10:08.054235+0000","last_undegraded":"2024-05-08T21:10:08.054235+0000","last_fullsized":"2024-05-08T21:10:08.054235+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:39:43.917363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.755963+0000","last_change":"2024-05-08T21:10:03.331297+0000","last_active":"2024-05-08T21:10:07.755963+0000","last_peered":"2024-05-08T21:10:07.755963+0000","last_clean":"2024-05-08T21:10:07.755963+0000","last_became_active":"2024-05-08T21:10:03.330973+0000","last_became_peered":"2024-05-08T21:10:03.330973+0000","last_unstale":"2024-05-08T21:10:07.755963+0000","last_undegraded":"2024-05-08T21:10:07.755963+0000","last_fullsized":"2024-05-08T21:10:07.755963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:57:26.190186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.168346+0000","last_change":"2024-05-08T21:10:03.751746+0000","last_active":"2024-05-08T21:10:08.168346+0000","last_peered":"2024-05-08T21:10:08.168346+0000","last_clean":"2024-05-08T21:10:08.168346+0000","last_became_active":"2024-05-08T21:10:03.751426+0000","last_became_peered":"2024-05-08T21:10:03.751426+0000","last_unstale":"2024-05-08T21:10:08.168346+0000","last_undegraded":"2024-05-08T21:10:08.168346+0000","last_fullsized":"2024-05-08T21:10:08.168346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:00:23.529543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.778416+0000","last_change":"2024-05-08T21:10:07.771834+0000","last_active":"2024-05-08T21:10:07.778416+0000","last_peered":"2024-05-08T21:10:07.778416+0000","last_clean":"2024-05-08T21:10:07.778416+0000","last_became_active":"2024-05-08T21:10:07.771324+0000","last_became_peered":"2024-05-08T21:10:07.771324+0000","last_unstale":"2024-05-08T21:10:07.778416+0000","last_undegraded":"2024-05-08T21:10:07.778416+0000","last_fullsized":"2024-05-08T21:10:07.778416+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:35.948317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.749656+0000","last_change":"2024-05-08T21:10:03.332049+0000","last_active":"2024-05-08T21:10:07.749656+0000","last_peered":"2024-05-08T21:10:07.749656+0000","last_clean":"2024-05-08T21:10:07.749656+0000","last_became_active":"2024-05-08T21:10:03.331712+0000","last_became_peered":"2024-05-08T21:10:03.331712+0000","last_unstale":"2024-05-08T21:10:07.749656+0000","last_undegraded":"2024-05-08T21:10:07.749656+0000","last_fullsized":"2024-05-08T21:10:07.749656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:30:16.135672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.753983+0000","last_change":"2024-05-08T21:10:03.748728+0000","last_active":"2024-05-08T21:10:07.753983+0000","last_peered":"2024-05-08T21:10:07.753983+0000","last_clean":"2024-05-08T21:10:07.753983+0000","last_became_active":"2024-05-08T21:10:03.748315+0000","last_became_peered":"2024-05-08T21:10:03.748315+0000","last_unstale":"2024-05-08T21:10:07.753983+0000","last_undegraded":"2024-05-08T21:10:07.753983+0000","last_fullsized":"2024-05-08T21:10:07.753983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:14:15.224603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.170061+0000","last_change":"2024-05-08T21:10:07.761559+0000","last_active":"2024-05-08T21:10:08.170061+0000","last_peered":"2024-05-08T21:10:08.170061+0000","last_clean":"2024-05-08T21:10:08.170061+0000","last_became_active":"2024-05-08T21:10:07.761129+0000","last_became_peered":"2024-05-08T21:10:07.761129+0000","last_unstale":"2024-05-08T21:10:08.170061+0000","last_undegraded":"2024-05-08T21:10:08.170061+0000","last_fullsized":"2024-05-08T21:10:08.170061+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:29:03.444853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'3","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.737377+0000","last_change":"2024-05-08T21:10:03.333077+0000","last_active":"2024-05-08T21:10:08.737377+0000","last_peered":"2024-05-08T21:10:08.737377+0000","last_clean":"2024-05-08T21:10:08.737377+0000","last_became_active":"2024-05-08T21:10:03.332796+0000","last_became_peered":"2024-05-08T21:10:03.332796+0000","last_unstale":"2024-05-08T21:10:08.737377+0000","last_undegraded":"2024-05-08T21:10:08.737377+0000","last_fullsized":"2024-05-08T21:10:08.737377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:30:16.135672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169929+0000","last_change":"2024-05-08T21:10:03.751370+0000","last_active":"2024-05-08T21:10:08.169929+0000","last_peered":"2024-05-08T21:10:08.169929+0000","last_clean":"2024-05-08T21:10:08.169929+0000","last_became_active":"2024-05-08T21:10:03.750394+0000","last_became_peered":"2024-05-08T21:10:03.750394+0000","last_unstale":"2024-05-08T21:10:08.169929+0000","last_undegraded":"2024-05-08T21:10:08.169929+0000","last_fullsized":"2024-05-08T21:10:08.169929+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:31:06.682543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.187439+0000","last_change":"2024-05-08T21:10:07.764815+0000","last_active":"2024-05-08T21:10:08.187439+0000","last_peered":"2024-05-08T21:10:08.187439+0000","last_clean":"2024-05-08T21:10:08.187439+0000","last_became_active":"2024-05-08T21:10:07.763591+0000","last_became_peered":"2024-05-08T21:10:07.763591+0000","last_unstale":"2024-05-08T21:10:08.187439+0000","last_undegraded":"2024-05-08T21:10:08.187439+0000","last_fullsized":"2024-05-08T21:10:08.187439+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:47.977517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"26'11","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:45.312935+0000","last_change":"2024-05-08T21:10:03.342400+0000","last_active":"2024-05-08T21:10:45.312935+0000","last_peered":"2024-05-08T21:10:45.312935+0000","last_clean":"2024-05-08T21:10:45.312935+0000","last_became_active":"2024-05-08T21:10:03.342202+0000","last_became_peered":"2024-05-08T21:10:03.342202+0000","last_unstale":"2024-05-08T21:10:45.312935+0000","last_undegraded":"2024-05-08T21:10:45.312935+0000","last_fullsized":"2024-05-08T21:10:45.312935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:10:04.668029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4058,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046564+0000","last_change":"2024-05-08T21:10:03.752144+0000","last_active":"2024-05-08T21:10:08.046564+0000","last_peered":"2024-05-08T21:10:08.046564+0000","last_clean":"2024-05-08T21:10:08.046564+0000","last_became_active":"2024-05-08T21:10:03.751868+0000","last_became_peered":"2024-05-08T21:10:03.751868+0000","last_unstale":"2024-05-08T21:10:08.046564+0000","last_undegraded":"2024-05-08T21:10:08.046564+0000","last_fullsized":"2024-05-08T21:10:08.046564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:40:43.168591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.168406+0000","last_change":"2024-05-08T21:10:08.052390+0000","last_active":"2024-05-08T21:10:08.168406+0000","last_peered":"2024-05-08T21:10:08.168406+0000","last_clean":"2024-05-08T21:10:08.168406+0000","last_became_active":"2024-05-08T21:10:08.051967+0000","last_became_peered":"2024-05-08T21:10:08.051967+0000","last_unstale":"2024-05-08T21:10:08.168406+0000","last_undegraded":"2024-05-08T21:10:08.168406+0000","last_fullsized":"2024-05-08T21:10:08.168406+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:40:07.127492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.739991+0000","last_change":"2024-05-08T21:10:03.330102+0000","last_active":"2024-05-08T21:10:08.739991+0000","last_peered":"2024-05-08T21:10:08.739991+0000","last_clean":"2024-05-08T21:10:08.739991+0000","last_became_active":"2024-05-08T21:10:03.329761+0000","last_became_peered":"2024-05-08T21:10:03.329761+0000","last_unstale":"2024-05-08T21:10:08.739991+0000","last_undegraded":"2024-05-08T21:10:08.739991+0000","last_fullsized":"2024-05-08T21:10:08.739991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:37:14.930549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.753579+0000","last_change":"2024-05-08T21:10:03.749332+0000","last_active":"2024-05-08T21:10:07.753579+0000","last_peered":"2024-05-08T21:10:07.753579+0000","last_clean":"2024-05-08T21:10:07.753579+0000","last_became_active":"2024-05-08T21:10:03.749094+0000","last_became_peered":"2024-05-08T21:10:03.749094+0000","last_unstale":"2024-05-08T21:10:07.753579+0000","last_undegraded":"2024-05-08T21:10:07.753579+0000","last_fullsized":"2024-05-08T21:10:07.753579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:25.969085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.048813+0000","last_change":"2024-05-08T21:10:08.048331+0000","last_active":"2024-05-08T21:10:08.048813+0000","last_peered":"2024-05-08T21:10:08.048813+0000","last_clean":"2024-05-08T21:10:08.048813+0000","last_became_active":"2024-05-08T21:10:08.047505+0000","last_became_peered":"2024-05-08T21:10:08.047505+0000","last_unstale":"2024-05-08T21:10:08.048813+0000","last_undegraded":"2024-05-08T21:10:08.048813+0000","last_fullsized":"2024-05-08T21:10:08.048813+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:18:39.268730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.749622+0000","last_change":"2024-05-08T21:10:03.328021+0000","last_active":"2024-05-08T21:10:07.749622+0000","last_peered":"2024-05-08T21:10:07.749622+0000","last_clean":"2024-05-08T21:10:07.749622+0000","last_became_active":"2024-05-08T21:10:03.327648+0000","last_became_peered":"2024-05-08T21:10:03.327648+0000","last_unstale":"2024-05-08T21:10:07.749622+0000","last_undegraded":"2024-05-08T21:10:07.749622+0000","last_fullsized":"2024-05-08T21:10:07.749622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:37:54.491930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046495+0000","last_change":"2024-05-08T21:10:03.750560+0000","last_active":"2024-05-08T21:10:08.046495+0000","last_peered":"2024-05-08T21:10:08.046495+0000","last_clean":"2024-05-08T21:10:08.046495+0000","last_became_active":"2024-05-08T21:10:03.750294+0000","last_became_peered":"2024-05-08T21:10:03.750294+0000","last_unstale":"2024-05-08T21:10:08.046495+0000","last_undegraded":"2024-05-08T21:10:08.046495+0000","last_fullsized":"2024-05-08T21:10:08.046495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:30:47.937326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.059433+0000","last_change":"2024-05-08T21:10:08.052318+0000","last_active":"2024-05-08T21:10:08.059433+0000","last_peered":"2024-05-08T21:10:08.059433+0000","last_clean":"2024-05-08T21:10:08.059433+0000","last_became_active":"2024-05-08T21:10:08.051920+0000","last_became_peered":"2024-05-08T21:10:08.051920+0000","last_unstale":"2024-05-08T21:10:08.059433+0000","last_undegraded":"2024-05-08T21:10:08.059433+0000","last_fullsized":"2024-05-08T21:10:08.059433+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:25:27.669768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.754124+0000","last_change":"2024-05-08T21:10:03.332390+0000","last_active":"2024-05-08T21:10:07.754124+0000","last_peered":"2024-05-08T21:10:07.754124+0000","last_clean":"2024-05-08T21:10:07.754124+0000","last_became_active":"2024-05-08T21:10:03.332105+0000","last_became_peered":"2024-05-08T21:10:03.332105+0000","last_unstale":"2024-05-08T21:10:07.754124+0000","last_undegraded":"2024-05-08T21:10:07.754124+0000","last_fullsized":"2024-05-08T21:10:07.754124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:32:44.705682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.271145+0000","last_change":"2024-05-08T21:10:03.742100+0000","last_active":"2024-05-08T21:10:08.271145+0000","last_peered":"2024-05-08T21:10:08.271145+0000","last_clean":"2024-05-08T21:10:08.271145+0000","last_became_active":"2024-05-08T21:10:03.741742+0000","last_became_peered":"2024-05-08T21:10:03.741742+0000","last_unstale":"2024-05-08T21:10:08.271145+0000","last_undegraded":"2024-05-08T21:10:08.271145+0000","last_fullsized":"2024-05-08T21:10:08.271145+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:53:19.394126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.775032+0000","last_change":"2024-05-08T21:10:07.769850+0000","last_active":"2024-05-08T21:10:07.775032+0000","last_peered":"2024-05-08T21:10:07.775032+0000","last_clean":"2024-05-08T21:10:07.775032+0000","last_became_active":"2024-05-08T21:10:07.769016+0000","last_became_peered":"2024-05-08T21:10:07.769016+0000","last_unstale":"2024-05-08T21:10:07.775032+0000","last_undegraded":"2024-05-08T21:10:07.775032+0000","last_fullsized":"2024-05-08T21:10:07.775032+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:31:52.621418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"25'8","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.741624+0000","last_change":"2024-05-08T21:10:03.331783+0000","last_active":"2024-05-08T21:10:08.741624+0000","last_peered":"2024-05-08T21:10:08.741624+0000","last_clean":"2024-05-08T21:10:08.741624+0000","last_became_active":"2024-05-08T21:10:03.331501+0000","last_became_peered":"2024-05-08T21:10:03.331501+0000","last_unstale":"2024-05-08T21:10:08.741624+0000","last_undegraded":"2024-05-08T21:10:08.741624+0000","last_fullsized":"2024-05-08T21:10:08.741624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:41:28.137295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046481+0000","last_change":"2024-05-08T21:10:03.744007+0000","last_active":"2024-05-08T21:10:08.046481+0000","last_peered":"2024-05-08T21:10:08.046481+0000","last_clean":"2024-05-08T21:10:08.046481+0000","last_became_active":"2024-05-08T21:10:03.743557+0000","last_became_peered":"2024-05-08T21:10:03.743557+0000","last_unstale":"2024-05-08T21:10:08.046481+0000","last_undegraded":"2024-05-08T21:10:08.046481+0000","last_fullsized":"2024-05-08T21:10:08.046481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:45:26.458377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169408+0000","last_change":"2024-05-08T21:10:07.777283+0000","last_active":"2024-05-08T21:10:08.169408+0000","last_peered":"2024-05-08T21:10:08.169408+0000","last_clean":"2024-05-08T21:10:08.169408+0000","last_became_active":"2024-05-08T21:10:07.776858+0000","last_became_peered":"2024-05-08T21:10:07.776858+0000","last_unstale":"2024-05-08T21:10:08.169408+0000","last_undegraded":"2024-05-08T21:10:08.169408+0000","last_fullsized":"2024-05-08T21:10:08.169408+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:51.725885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"26'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.170185+0000","last_change":"2024-05-08T21:10:03.326892+0000","last_active":"2024-05-08T21:10:08.170185+0000","last_peered":"2024-05-08T21:10:08.170185+0000","last_clean":"2024-05-08T21:10:08.170185+0000","last_became_active":"2024-05-08T21:10:03.326608+0000","last_became_peered":"2024-05-08T21:10:03.326608+0000","last_unstale":"2024-05-08T21:10:08.170185+0000","last_undegraded":"2024-05-08T21:10:08.170185+0000","last_fullsized":"2024-05-08T21:10:08.170185+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:33.441985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046649+0000","last_change":"2024-05-08T21:10:03.749221+0000","last_active":"2024-05-08T21:10:08.046649+0000","last_peered":"2024-05-08T21:10:08.046649+0000","last_clean":"2024-05-08T21:10:08.046649+0000","last_became_active":"2024-05-08T21:10:03.748915+0000","last_became_peered":"2024-05-08T21:10:03.748915+0000","last_unstale":"2024-05-08T21:10:08.046649+0000","last_undegraded":"2024-05-08T21:10:08.046649+0000","last_fullsized":"2024-05-08T21:10:08.046649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:03:10.791535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.187371+0000","last_change":"2024-05-08T21:10:07.759492+0000","last_active":"2024-05-08T21:10:08.187371+0000","last_peered":"2024-05-08T21:10:08.187371+0000","last_clean":"2024-05-08T21:10:08.187371+0000","last_became_active":"2024-05-08T21:10:07.759139+0000","last_became_peered":"2024-05-08T21:10:07.759139+0000","last_unstale":"2024-05-08T21:10:08.187371+0000","last_undegraded":"2024-05-08T21:10:08.187371+0000","last_fullsized":"2024-05-08T21:10:08.187371+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:10.579105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.743655+0000","last_change":"2024-05-08T21:10:03.329020+0000","last_active":"2024-05-08T21:10:07.743655+0000","last_peered":"2024-05-08T21:10:07.743655+0000","last_clean":"2024-05-08T21:10:07.743655+0000","last_became_active":"2024-05-08T21:10:03.328739+0000","last_became_peered":"2024-05-08T21:10:03.328739+0000","last_unstale":"2024-05-08T21:10:07.743655+0000","last_undegraded":"2024-05-08T21:10:07.743655+0000","last_fullsized":"2024-05-08T21:10:07.743655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:27:11.168780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.168756+0000","last_change":"2024-05-08T21:10:03.744662+0000","last_active":"2024-05-08T21:10:08.168756+0000","last_peered":"2024-05-08T21:10:08.168756+0000","last_clean":"2024-05-08T21:10:08.168756+0000","last_became_active":"2024-05-08T21:10:03.744398+0000","last_became_peered":"2024-05-08T21:10:03.744398+0000","last_unstale":"2024-05-08T21:10:08.168756+0000","last_undegraded":"2024-05-08T21:10:08.168756+0000","last_fullsized":"2024-05-08T21:10:08.168756+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:05:28.046055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.187253+0000","last_change":"2024-05-08T21:10:07.776566+0000","last_active":"2024-05-08T21:10:08.187253+0000","last_peered":"2024-05-08T21:10:08.187253+0000","last_clean":"2024-05-08T21:10:08.187253+0000","last_became_active":"2024-05-08T21:10:07.776080+0000","last_became_peered":"2024-05-08T21:10:07.776080+0000","last_unstale":"2024-05-08T21:10:08.187253+0000","last_undegraded":"2024-05-08T21:10:08.187253+0000","last_fullsized":"2024-05-08T21:10:08.187253+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:26:09.323466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.749542+0000","last_change":"2024-05-08T21:10:03.332953+0000","last_active":"2024-05-08T21:10:07.749542+0000","last_peered":"2024-05-08T21:10:07.749542+0000","last_clean":"2024-05-08T21:10:07.749542+0000","last_became_active":"2024-05-08T21:10:03.332689+0000","last_became_peered":"2024-05-08T21:10:03.332689+0000","last_unstale":"2024-05-08T21:10:07.749542+0000","last_undegraded":"2024-05-08T21:10:07.749542+0000","last_fullsized":"2024-05-08T21:10:07.749542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:15:32.058369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169816+0000","last_change":"2024-05-08T21:10:03.745651+0000","last_active":"2024-05-08T21:10:08.169816+0000","last_peered":"2024-05-08T21:10:08.169816+0000","last_clean":"2024-05-08T21:10:08.169816+0000","last_became_active":"2024-05-08T21:10:03.742744+0000","last_became_peered":"2024-05-08T21:10:03.742744+0000","last_unstale":"2024-05-08T21:10:08.169816+0000","last_undegraded":"2024-05-08T21:10:08.169816+0000","last_fullsized":"2024-05-08T21:10:08.169816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:32:31.689490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.187096+0000","last_change":"2024-05-08T21:10:07.776527+0000","last_active":"2024-05-08T21:10:08.187096+0000","last_peered":"2024-05-08T21:10:08.187096+0000","last_clean":"2024-05-08T21:10:08.187096+0000","last_became_active":"2024-05-08T21:10:07.776053+0000","last_became_peered":"2024-05-08T21:10:07.776053+0000","last_unstale":"2024-05-08T21:10:08.187096+0000","last_undegraded":"2024-05-08T21:10:08.187096+0000","last_fullsized":"2024-05-08T21:10:08.187096+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:08:26.401358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.186861+0000","last_change":"2024-05-08T21:10:03.738421+0000","last_active":"2024-05-08T21:10:08.186861+0000","last_peered":"2024-05-08T21:10:08.186861+0000","last_clean":"2024-05-08T21:10:08.186861+0000","last_became_active":"2024-05-08T21:10:03.738000+0000","last_became_peered":"2024-05-08T21:10:03.738000+0000","last_unstale":"2024-05-08T21:10:08.186861+0000","last_undegraded":"2024-05-08T21:10:08.186861+0000","last_fullsized":"2024-05-08T21:10:08.186861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:38:05.948755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.751476+0000","last_change":"2024-05-08T21:10:03.331141+0000","last_active":"2024-05-08T21:10:07.751476+0000","last_peered":"2024-05-08T21:10:07.751476+0000","last_clean":"2024-05-08T21:10:07.751476+0000","last_became_active":"2024-05-08T21:10:03.330842+0000","last_became_peered":"2024-05-08T21:10:03.330842+0000","last_unstale":"2024-05-08T21:10:07.751476+0000","last_undegraded":"2024-05-08T21:10:07.751476+0000","last_fullsized":"2024-05-08T21:10:07.751476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:42:52.648932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.271310+0000","last_change":"2024-05-08T21:10:08.049274+0000","last_active":"2024-05-08T21:10:08.271310+0000","last_peered":"2024-05-08T21:10:08.271310+0000","last_clean":"2024-05-08T21:10:08.271310+0000","last_became_active":"2024-05-08T21:10:08.048763+0000","last_became_peered":"2024-05-08T21:10:08.048763+0000","last_unstale":"2024-05-08T21:10:08.271310+0000","last_undegraded":"2024-05-08T21:10:08.271310+0000","last_fullsized":"2024-05-08T21:10:08.271310+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:00:41.257040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.754546+0000","last_change":"2024-05-08T21:10:03.747594+0000","last_active":"2024-05-08T21:10:07.754546+0000","last_peered":"2024-05-08T21:10:07.754546+0000","last_clean":"2024-05-08T21:10:07.754546+0000","last_became_active":"2024-05-08T21:10:03.747360+0000","last_became_peered":"2024-05-08T21:10:03.747360+0000","last_unstale":"2024-05-08T21:10:07.754546+0000","last_undegraded":"2024-05-08T21:10:07.754546+0000","last_fullsized":"2024-05-08T21:10:07.754546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:31:12.357348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.749455+0000","last_change":"2024-05-08T21:10:03.327847+0000","last_active":"2024-05-08T21:10:07.749455+0000","last_peered":"2024-05-08T21:10:07.749455+0000","last_clean":"2024-05-08T21:10:07.749455+0000","last_became_active":"2024-05-08T21:10:03.327530+0000","last_became_peered":"2024-05-08T21:10:03.327530+0000","last_unstale":"2024-05-08T21:10:07.749455+0000","last_undegraded":"2024-05-08T21:10:07.749455+0000","last_fullsized":"2024-05-08T21:10:07.749455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:46.232166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":168,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046147+0000","last_change":"2024-05-08T21:09:59.333990+0000","last_active":"2024-05-08T21:10:08.046147+0000","last_peered":"2024-05-08T21:10:08.046147+0000","last_clean":"2024-05-08T21:10:08.046147+0000","last_became_active":"2024-05-08T21:09:59.332929+0000","last_became_peered":"2024-05-08T21:09:59.332929+0000","last_unstale":"2024-05-08T21:10:08.046147+0000","last_undegraded":"2024-05-08T21:10:08.046147+0000","last_fullsized":"2024-05-08T21:10:08.046147+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:09:58.287675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:09:58.287675+0000","last_clean_scrub_stamp":"2024-05-08T21:09:58.287675+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:47.595380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.052138+0000","last_change":"2024-05-08T21:10:08.049848+0000","last_active":"2024-05-08T21:10:08.052138+0000","last_peered":"2024-05-08T21:10:08.052138+0000","last_clean":"2024-05-08T21:10:08.052138+0000","last_became_active":"2024-05-08T21:10:08.049153+0000","last_became_peered":"2024-05-08T21:10:08.049153+0000","last_unstale":"2024-05-08T21:10:08.052138+0000","last_undegraded":"2024-05-08T21:10:08.052138+0000","last_fullsized":"2024-05-08T21:10:08.052138+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:23.704112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.753311+0000","last_change":"2024-05-08T21:10:03.743094+0000","last_active":"2024-05-08T21:10:07.753311+0000","last_peered":"2024-05-08T21:10:07.753311+0000","last_clean":"2024-05-08T21:10:07.753311+0000","last_became_active":"2024-05-08T21:10:03.742819+0000","last_became_peered":"2024-05-08T21:10:03.742819+0000","last_unstale":"2024-05-08T21:10:07.753311+0000","last_undegraded":"2024-05-08T21:10:07.753311+0000","last_fullsized":"2024-05-08T21:10:07.753311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:41:25.593884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046341+0000","last_change":"2024-05-08T21:10:03.340259+0000","last_active":"2024-05-08T21:10:08.046341+0000","last_peered":"2024-05-08T21:10:08.046341+0000","last_clean":"2024-05-08T21:10:08.046341+0000","last_became_active":"2024-05-08T21:10:03.339957+0000","last_became_peered":"2024-05-08T21:10:03.339957+0000","last_unstale":"2024-05-08T21:10:08.046341+0000","last_undegraded":"2024-05-08T21:10:08.046341+0000","last_fullsized":"2024-05-08T21:10:08.046341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:38:36.535689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.051520+0000","last_change":"2024-05-08T21:10:08.050370+0000","last_active":"2024-05-08T21:10:08.051520+0000","last_peered":"2024-05-08T21:10:08.051520+0000","last_clean":"2024-05-08T21:10:08.051520+0000","last_became_active":"2024-05-08T21:10:08.049962+0000","last_became_peered":"2024-05-08T21:10:08.049962+0000","last_unstale":"2024-05-08T21:10:08.051520+0000","last_undegraded":"2024-05-08T21:10:08.051520+0000","last_fullsized":"2024-05-08T21:10:08.051520+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:11:35.394334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046359+0000","last_change":"2024-05-08T21:10:03.337949+0000","last_active":"2024-05-08T21:10:08.046359+0000","last_peered":"2024-05-08T21:10:08.046359+0000","last_clean":"2024-05-08T21:10:08.046359+0000","last_became_active":"2024-05-08T21:10:03.337627+0000","last_became_peered":"2024-05-08T21:10:03.337627+0000","last_unstale":"2024-05-08T21:10:08.046359+0000","last_undegraded":"2024-05-08T21:10:08.046359+0000","last_fullsized":"2024-05-08T21:10:08.046359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:17:36.792731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.187476+0000","last_change":"2024-05-08T21:10:03.738212+0000","last_active":"2024-05-08T21:10:08.187476+0000","last_peered":"2024-05-08T21:10:08.187476+0000","last_clean":"2024-05-08T21:10:08.187476+0000","last_became_active":"2024-05-08T21:10:03.737927+0000","last_became_peered":"2024-05-08T21:10:03.737927+0000","last_unstale":"2024-05-08T21:10:08.187476+0000","last_undegraded":"2024-05-08T21:10:08.187476+0000","last_fullsized":"2024-05-08T21:10:08.187476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:03:08.031584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.059425+0000","last_change":"2024-05-08T21:10:08.052270+0000","last_active":"2024-05-08T21:10:08.059425+0000","last_peered":"2024-05-08T21:10:08.059425+0000","last_clean":"2024-05-08T21:10:08.059425+0000","last_became_active":"2024-05-08T21:10:08.051881+0000","last_became_peered":"2024-05-08T21:10:08.051881+0000","last_unstale":"2024-05-08T21:10:08.059425+0000","last_undegraded":"2024-05-08T21:10:08.059425+0000","last_fullsized":"2024-05-08T21:10:08.059425+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:39:07.929942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.187471+0000","last_change":"2024-05-08T21:10:03.333696+0000","last_active":"2024-05-08T21:10:08.187471+0000","last_peered":"2024-05-08T21:10:08.187471+0000","last_clean":"2024-05-08T21:10:08.187471+0000","last_became_active":"2024-05-08T21:10:03.333368+0000","last_became_peered":"2024-05-08T21:10:03.333368+0000","last_unstale":"2024-05-08T21:10:08.187471+0000","last_undegraded":"2024-05-08T21:10:08.187471+0000","last_fullsized":"2024-05-08T21:10:08.187471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:00:08.459270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.762624+0000","last_change":"2024-05-08T21:10:03.752578+0000","last_active":"2024-05-08T21:10:07.762624+0000","last_peered":"2024-05-08T21:10:07.762624+0000","last_clean":"2024-05-08T21:10:07.762624+0000","last_became_active":"2024-05-08T21:10:03.752389+0000","last_became_peered":"2024-05-08T21:10:03.752389+0000","last_unstale":"2024-05-08T21:10:07.762624+0000","last_undegraded":"2024-05-08T21:10:07.762624+0000","last_fullsized":"2024-05-08T21:10:07.762624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:54:02.318162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169418+0000","last_change":"2024-05-08T21:10:08.048081+0000","last_active":"2024-05-08T21:10:08.169418+0000","last_peered":"2024-05-08T21:10:08.169418+0000","last_clean":"2024-05-08T21:10:08.169418+0000","last_became_active":"2024-05-08T21:10:08.047632+0000","last_became_peered":"2024-05-08T21:10:08.047632+0000","last_unstale":"2024-05-08T21:10:08.169418+0000","last_undegraded":"2024-05-08T21:10:08.169418+0000","last_fullsized":"2024-05-08T21:10:08.169418+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:26:05.857718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"26'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.738320+0000","last_change":"2024-05-08T21:10:03.340553+0000","last_active":"2024-05-08T21:10:08.738320+0000","last_peered":"2024-05-08T21:10:08.738320+0000","last_clean":"2024-05-08T21:10:08.738320+0000","last_became_active":"2024-05-08T21:10:03.340280+0000","last_became_peered":"2024-05-08T21:10:03.340280+0000","last_unstale":"2024-05-08T21:10:08.738320+0000","last_undegraded":"2024-05-08T21:10:08.738320+0000","last_fullsized":"2024-05-08T21:10:08.738320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:36:24.866220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.754313+0000","last_change":"2024-05-08T21:10:03.736316+0000","last_active":"2024-05-08T21:10:07.754313+0000","last_peered":"2024-05-08T21:10:07.754313+0000","last_clean":"2024-05-08T21:10:07.754313+0000","last_became_active":"2024-05-08T21:10:03.736049+0000","last_became_peered":"2024-05-08T21:10:03.736049+0000","last_unstale":"2024-05-08T21:10:07.754313+0000","last_undegraded":"2024-05-08T21:10:07.754313+0000","last_fullsized":"2024-05-08T21:10:07.754313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:09:48.973609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.170097+0000","last_change":"2024-05-08T21:10:07.777357+0000","last_active":"2024-05-08T21:10:08.170097+0000","last_peered":"2024-05-08T21:10:08.170097+0000","last_clean":"2024-05-08T21:10:08.170097+0000","last_became_active":"2024-05-08T21:10:07.776848+0000","last_became_peered":"2024-05-08T21:10:07.776848+0000","last_unstale":"2024-05-08T21:10:08.170097+0000","last_undegraded":"2024-05-08T21:10:08.170097+0000","last_fullsized":"2024-05-08T21:10:08.170097+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:51:47.727804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046274+0000","last_change":"2024-05-08T21:10:03.340078+0000","last_active":"2024-05-08T21:10:08.046274+0000","last_peered":"2024-05-08T21:10:08.046274+0000","last_clean":"2024-05-08T21:10:08.046274+0000","last_became_active":"2024-05-08T21:10:03.339690+0000","last_became_peered":"2024-05-08T21:10:03.339690+0000","last_unstale":"2024-05-08T21:10:08.046274+0000","last_undegraded":"2024-05-08T21:10:08.046274+0000","last_fullsized":"2024-05-08T21:10:08.046274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:01:33.991878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169765+0000","last_change":"2024-05-08T21:10:03.744606+0000","last_active":"2024-05-08T21:10:08.169765+0000","last_peered":"2024-05-08T21:10:08.169765+0000","last_clean":"2024-05-08T21:10:08.169765+0000","last_became_active":"2024-05-08T21:10:03.744160+0000","last_became_peered":"2024-05-08T21:10:03.744160+0000","last_unstale":"2024-05-08T21:10:08.169765+0000","last_undegraded":"2024-05-08T21:10:08.169765+0000","last_fullsized":"2024-05-08T21:10:08.169765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:10:25.144058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.187244+0000","last_change":"2024-05-08T21:10:08.049224+0000","last_active":"2024-05-08T21:10:08.187244+0000","last_peered":"2024-05-08T21:10:08.187244+0000","last_clean":"2024-05-08T21:10:08.187244+0000","last_became_active":"2024-05-08T21:10:08.048866+0000","last_became_peered":"2024-05-08T21:10:08.048866+0000","last_unstale":"2024-05-08T21:10:08.187244+0000","last_undegraded":"2024-05-08T21:10:08.187244+0000","last_fullsized":"2024-05-08T21:10:08.187244+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:38:20.601167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.743199+0000","last_change":"2024-05-08T21:10:03.339344+0000","last_active":"2024-05-08T21:10:07.743199+0000","last_peered":"2024-05-08T21:10:07.743199+0000","last_clean":"2024-05-08T21:10:07.743199+0000","last_became_active":"2024-05-08T21:10:03.339136+0000","last_became_peered":"2024-05-08T21:10:03.339136+0000","last_unstale":"2024-05-08T21:10:07.743199+0000","last_undegraded":"2024-05-08T21:10:07.743199+0000","last_fullsized":"2024-05-08T21:10:07.743199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:02:55.623727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.757429+0000","last_change":"2024-05-08T21:10:03.737684+0000","last_active":"2024-05-08T21:10:07.757429+0000","last_peered":"2024-05-08T21:10:07.757429+0000","last_clean":"2024-05-08T21:10:07.757429+0000","last_became_active":"2024-05-08T21:10:03.737459+0000","last_became_peered":"2024-05-08T21:10:03.737459+0000","last_unstale":"2024-05-08T21:10:07.757429+0000","last_undegraded":"2024-05-08T21:10:07.757429+0000","last_fullsized":"2024-05-08T21:10:07.757429+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:39.662018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.169949+0000","last_change":"2024-05-08T21:10:07.776483+0000","last_active":"2024-05-08T21:10:08.169949+0000","last_peered":"2024-05-08T21:10:08.169949+0000","last_clean":"2024-05-08T21:10:08.169949+0000","last_became_active":"2024-05-08T21:10:07.775956+0000","last_became_peered":"2024-05-08T21:10:07.775956+0000","last_unstale":"2024-05-08T21:10:08.169949+0000","last_undegraded":"2024-05-08T21:10:08.169949+0000","last_fullsized":"2024-05-08T21:10:08.169949+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:28:17.332488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.743317+0000","last_change":"2024-05-08T21:10:03.331695+0000","last_active":"2024-05-08T21:10:07.743317+0000","last_peered":"2024-05-08T21:10:07.743317+0000","last_clean":"2024-05-08T21:10:07.743317+0000","last_became_active":"2024-05-08T21:10:03.331198+0000","last_became_peered":"2024-05-08T21:10:03.331198+0000","last_unstale":"2024-05-08T21:10:07.743317+0000","last_undegraded":"2024-05-08T21:10:07.743317+0000","last_fullsized":"2024-05-08T21:10:07.743317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:37:54.491930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.761445+0000","last_change":"2024-05-08T21:10:03.744562+0000","last_active":"2024-05-08T21:10:07.761445+0000","last_peered":"2024-05-08T21:10:07.761445+0000","last_clean":"2024-05-08T21:10:07.761445+0000","last_became_active":"2024-05-08T21:10:03.744326+0000","last_became_peered":"2024-05-08T21:10:03.744326+0000","last_unstale":"2024-05-08T21:10:07.761445+0000","last_undegraded":"2024-05-08T21:10:07.761445+0000","last_fullsized":"2024-05-08T21:10:07.761445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:21:52.947209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.170163+0000","last_change":"2024-05-08T21:10:07.763204+0000","last_active":"2024-05-08T21:10:08.170163+0000","last_peered":"2024-05-08T21:10:08.170163+0000","last_clean":"2024-05-08T21:10:08.170163+0000","last_became_active":"2024-05-08T21:10:07.762886+0000","last_became_peered":"2024-05-08T21:10:07.762886+0000","last_unstale":"2024-05-08T21:10:08.170163+0000","last_undegraded":"2024-05-08T21:10:08.170163+0000","last_fullsized":"2024-05-08T21:10:08.170163+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:01.599700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.740037+0000","last_change":"2024-05-08T21:10:03.337993+0000","last_active":"2024-05-08T21:10:08.740037+0000","last_peered":"2024-05-08T21:10:08.740037+0000","last_clean":"2024-05-08T21:10:08.740037+0000","last_became_active":"2024-05-08T21:10:03.337654+0000","last_became_peered":"2024-05-08T21:10:03.337654+0000","last_unstale":"2024-05-08T21:10:08.740037+0000","last_undegraded":"2024-05-08T21:10:08.740037+0000","last_fullsized":"2024-05-08T21:10:08.740037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:23:20.536178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.271247+0000","last_change":"2024-05-08T21:10:03.744871+0000","last_active":"2024-05-08T21:10:08.271247+0000","last_peered":"2024-05-08T21:10:08.271247+0000","last_clean":"2024-05-08T21:10:08.271247+0000","last_became_active":"2024-05-08T21:10:03.744589+0000","last_became_peered":"2024-05-08T21:10:03.744589+0000","last_unstale":"2024-05-08T21:10:08.271247+0000","last_undegraded":"2024-05-08T21:10:08.271247+0000","last_fullsized":"2024-05-08T21:10:08.271247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:41.090204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.271212+0000","last_change":"2024-05-08T21:10:08.047735+0000","last_active":"2024-05-08T21:10:08.271212+0000","last_peered":"2024-05-08T21:10:08.271212+0000","last_clean":"2024-05-08T21:10:08.271212+0000","last_became_active":"2024-05-08T21:10:08.047331+0000","last_became_peered":"2024-05-08T21:10:08.047331+0000","last_unstale":"2024-05-08T21:10:08.271212+0000","last_undegraded":"2024-05-08T21:10:08.271212+0000","last_fullsized":"2024-05-08T21:10:08.271212+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:44:22.797154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.751739+0000","last_change":"2024-05-08T21:10:03.333117+0000","last_active":"2024-05-08T21:10:07.751739+0000","last_peered":"2024-05-08T21:10:07.751739+0000","last_clean":"2024-05-08T21:10:07.751739+0000","last_became_active":"2024-05-08T21:10:03.332790+0000","last_became_peered":"2024-05-08T21:10:03.332790+0000","last_unstale":"2024-05-08T21:10:07.751739+0000","last_undegraded":"2024-05-08T21:10:07.751739+0000","last_fullsized":"2024-05-08T21:10:07.751739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:52:36.355804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046458+0000","last_change":"2024-05-08T21:10:03.748047+0000","last_active":"2024-05-08T21:10:08.046458+0000","last_peered":"2024-05-08T21:10:08.046458+0000","last_clean":"2024-05-08T21:10:08.046458+0000","last_became_active":"2024-05-08T21:10:03.747759+0000","last_became_peered":"2024-05-08T21:10:03.747759+0000","last_unstale":"2024-05-08T21:10:08.046458+0000","last_undegraded":"2024-05-08T21:10:08.046458+0000","last_fullsized":"2024-05-08T21:10:08.046458+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:11:05.309278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.775292+0000","last_change":"2024-05-08T21:10:07.761000+0000","last_active":"2024-05-08T21:10:07.775292+0000","last_peered":"2024-05-08T21:10:07.775292+0000","last_clean":"2024-05-08T21:10:07.775292+0000","last_became_active":"2024-05-08T21:10:07.760566+0000","last_became_peered":"2024-05-08T21:10:07.760566+0000","last_unstale":"2024-05-08T21:10:07.775292+0000","last_undegraded":"2024-05-08T21:10:07.775292+0000","last_fullsized":"2024-05-08T21:10:07.775292+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:48:27.435678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"26'1","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.187152+0000","last_change":"2024-05-08T21:10:03.331358+0000","last_active":"2024-05-08T21:10:08.187152+0000","last_peered":"2024-05-08T21:10:08.187152+0000","last_clean":"2024-05-08T21:10:08.187152+0000","last_became_active":"2024-05-08T21:10:03.331028+0000","last_became_peered":"2024-05-08T21:10:03.331028+0000","last_unstale":"2024-05-08T21:10:08.187152+0000","last_undegraded":"2024-05-08T21:10:08.187152+0000","last_fullsized":"2024-05-08T21:10:08.187152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:18:47.922157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.168527+0000","last_change":"2024-05-08T21:10:03.751285+0000","last_active":"2024-05-08T21:10:08.168527+0000","last_peered":"2024-05-08T21:10:08.168527+0000","last_clean":"2024-05-08T21:10:08.168527+0000","last_became_active":"2024-05-08T21:10:03.746557+0000","last_became_peered":"2024-05-08T21:10:03.746557+0000","last_unstale":"2024-05-08T21:10:08.168527+0000","last_undegraded":"2024-05-08T21:10:08.168527+0000","last_fullsized":"2024-05-08T21:10:08.168527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:50:27.241404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.167816+0000","last_change":"2024-05-08T21:10:08.048830+0000","last_active":"2024-05-08T21:10:08.167816+0000","last_peered":"2024-05-08T21:10:08.167816+0000","last_clean":"2024-05-08T21:10:08.167816+0000","last_became_active":"2024-05-08T21:10:08.048453+0000","last_became_peered":"2024-05-08T21:10:08.048453+0000","last_unstale":"2024-05-08T21:10:08.167816+0000","last_undegraded":"2024-05-08T21:10:08.167816+0000","last_fullsized":"2024-05-08T21:10:08.167816+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:19:28.758712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.737384+0000","last_change":"2024-05-08T21:10:03.330419+0000","last_active":"2024-05-08T21:10:08.737384+0000","last_peered":"2024-05-08T21:10:08.737384+0000","last_clean":"2024-05-08T21:10:08.737384+0000","last_became_active":"2024-05-08T21:10:03.330082+0000","last_became_peered":"2024-05-08T21:10:03.330082+0000","last_unstale":"2024-05-08T21:10:08.737384+0000","last_undegraded":"2024-05-08T21:10:08.737384+0000","last_fullsized":"2024-05-08T21:10:08.737384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:09:20.516386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.046810+0000","last_change":"2024-05-08T21:10:03.747306+0000","last_active":"2024-05-08T21:10:08.046810+0000","last_peered":"2024-05-08T21:10:08.046810+0000","last_clean":"2024-05-08T21:10:08.046810+0000","last_became_active":"2024-05-08T21:10:03.746755+0000","last_became_peered":"2024-05-08T21:10:03.746755+0000","last_unstale":"2024-05-08T21:10:08.046810+0000","last_undegraded":"2024-05-08T21:10:08.046810+0000","last_fullsized":"2024-05-08T21:10:08.046810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:17:51.344821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.271171+0000","last_change":"2024-05-08T21:10:03.738627+0000","last_active":"2024-05-08T21:10:08.271171+0000","last_peered":"2024-05-08T21:10:08.271171+0000","last_clean":"2024-05-08T21:10:08.271171+0000","last_became_active":"2024-05-08T21:10:03.738338+0000","last_became_peered":"2024-05-08T21:10:03.738338+0000","last_unstale":"2024-05-08T21:10:08.271171+0000","last_undegraded":"2024-05-08T21:10:08.271171+0000","last_fullsized":"2024-05-08T21:10:08.271171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:34.088831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.751564+0000","last_change":"2024-05-08T21:10:03.745607+0000","last_active":"2024-05-08T21:10:07.751564+0000","last_peered":"2024-05-08T21:10:07.751564+0000","last_clean":"2024-05-08T21:10:07.751564+0000","last_became_active":"2024-05-08T21:10:03.745362+0000","last_became_peered":"2024-05-08T21:10:03.745362+0000","last_unstale":"2024-05-08T21:10:07.751564+0000","last_undegraded":"2024-05-08T21:10:07.751564+0000","last_fullsized":"2024-05-08T21:10:07.751564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:54.399930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.168448+0000","last_change":"2024-05-08T21:10:03.745137+0000","last_active":"2024-05-08T21:10:08.168448+0000","last_peered":"2024-05-08T21:10:08.168448+0000","last_clean":"2024-05-08T21:10:08.168448+0000","last_became_active":"2024-05-08T21:10:03.744844+0000","last_became_peered":"2024-05-08T21:10:03.744844+0000","last_unstale":"2024-05-08T21:10:08.168448+0000","last_undegraded":"2024-05-08T21:10:08.168448+0000","last_fullsized":"2024-05-08T21:10:08.168448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:06.853429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.753792+0000","last_change":"2024-05-08T21:10:03.745163+0000","last_active":"2024-05-08T21:10:07.753792+0000","last_peered":"2024-05-08T21:10:07.753792+0000","last_clean":"2024-05-08T21:10:07.753792+0000","last_became_active":"2024-05-08T21:10:03.744908+0000","last_became_peered":"2024-05-08T21:10:03.744908+0000","last_unstale":"2024-05-08T21:10:07.753792+0000","last_undegraded":"2024-05-08T21:10:07.753792+0000","last_fullsized":"2024-05-08T21:10:07.753792+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:06.593989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.762986+0000","last_change":"2024-05-08T21:10:03.748542+0000","last_active":"2024-05-08T21:10:07.762986+0000","last_peered":"2024-05-08T21:10:07.762986+0000","last_clean":"2024-05-08T21:10:07.762986+0000","last_became_active":"2024-05-08T21:10:03.748284+0000","last_became_peered":"2024-05-08T21:10:03.748284+0000","last_unstale":"2024-05-08T21:10:07.762986+0000","last_undegraded":"2024-05-08T21:10:07.762986+0000","last_fullsized":"2024-05-08T21:10:07.762986+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:49:10.430406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.187090+0000","last_change":"2024-05-08T21:10:03.739778+0000","last_active":"2024-05-08T21:10:08.187090+0000","last_peered":"2024-05-08T21:10:08.187090+0000","last_clean":"2024-05-08T21:10:08.187090+0000","last_became_active":"2024-05-08T21:10:03.739522+0000","last_became_peered":"2024-05-08T21:10:03.739522+0000","last_unstale":"2024-05-08T21:10:08.187090+0000","last_undegraded":"2024-05-08T21:10:08.187090+0000","last_fullsized":"2024-05-08T21:10:08.187090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:07:42.115999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.271345+0000","last_change":"2024-05-08T21:10:03.746126+0000","last_active":"2024-05-08T21:10:08.271345+0000","last_peered":"2024-05-08T21:10:08.271345+0000","last_clean":"2024-05-08T21:10:08.271345+0000","last_became_active":"2024-05-08T21:10:03.745842+0000","last_became_peered":"2024-05-08T21:10:03.745842+0000","last_unstale":"2024-05-08T21:10:08.271345+0000","last_undegraded":"2024-05-08T21:10:08.271345+0000","last_fullsized":"2024-05-08T21:10:08.271345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:51:06.176371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.762738+0000","last_change":"2024-05-08T21:10:03.745007+0000","last_active":"2024-05-08T21:10:07.762738+0000","last_peered":"2024-05-08T21:10:07.762738+0000","last_clean":"2024-05-08T21:10:07.762738+0000","last_became_active":"2024-05-08T21:10:03.744709+0000","last_became_peered":"2024-05-08T21:10:03.744709+0000","last_unstale":"2024-05-08T21:10:07.762738+0000","last_undegraded":"2024-05-08T21:10:07.762738+0000","last_fullsized":"2024-05-08T21:10:07.762738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:12:20.712861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.167909+0000","last_change":"2024-05-08T21:10:03.751111+0000","last_active":"2024-05-08T21:10:08.167909+0000","last_peered":"2024-05-08T21:10:08.167909+0000","last_clean":"2024-05-08T21:10:08.167909+0000","last_became_active":"2024-05-08T21:10:03.747059+0000","last_became_peered":"2024-05-08T21:10:03.747059+0000","last_unstale":"2024-05-08T21:10:08.167909+0000","last_undegraded":"2024-05-08T21:10:08.167909+0000","last_fullsized":"2024-05-08T21:10:08.167909+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:43.254221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.766689+0000","last_change":"2024-05-08T21:10:03.747207+0000","last_active":"2024-05-08T21:10:07.766689+0000","last_peered":"2024-05-08T21:10:07.766689+0000","last_clean":"2024-05-08T21:10:07.766689+0000","last_became_active":"2024-05-08T21:10:03.746942+0000","last_became_peered":"2024-05-08T21:10:03.746942+0000","last_unstale":"2024-05-08T21:10:07.766689+0000","last_undegraded":"2024-05-08T21:10:07.766689+0000","last_fullsized":"2024-05-08T21:10:07.766689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:33:52.317273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.168575+0000","last_change":"2024-05-08T21:10:03.753663+0000","last_active":"2024-05-08T21:10:08.168575+0000","last_peered":"2024-05-08T21:10:08.168575+0000","last_clean":"2024-05-08T21:10:08.168575+0000","last_became_active":"2024-05-08T21:10:03.752486+0000","last_became_peered":"2024-05-08T21:10:03.752486+0000","last_unstale":"2024-05-08T21:10:08.168575+0000","last_undegraded":"2024-05-08T21:10:08.168575+0000","last_fullsized":"2024-05-08T21:10:08.168575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:21:45.895154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:07.753497+0000","last_change":"2024-05-08T21:10:03.753849+0000","last_active":"2024-05-08T21:10:07.753497+0000","last_peered":"2024-05-08T21:10:07.753497+0000","last_clean":"2024-05-08T21:10:07.753497+0000","last_became_active":"2024-05-08T21:10:03.753616+0000","last_became_peered":"2024-05-08T21:10:03.753616+0000","last_unstale":"2024-05-08T21:10:07.753497+0000","last_undegraded":"2024-05-08T21:10:07.753497+0000","last_fullsized":"2024-05-08T21:10:07.753497+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:02:58.650310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T21:10:08.271297+0000","last_change":"2024-05-08T21:10:03.744906+0000","last_active":"2024-05-08T21:10:08.271297+0000","last_peered":"2024-05-08T21:10:08.271297+0000","last_clean":"2024-05-08T21:10:08.271297+0000","last_became_active":"2024-05-08T21:10:03.744562+0000","last_became_peered":"2024-05-08T21:10:03.744562+0000","last_unstale":"2024-05-08T21:10:08.271297+0000","last_undegraded":"2024-05-08T21:10:08.271297+0000","last_fullsized":"2024-05-08T21:10:08.271297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:21:30.416392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64612,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4856,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44,"ondisk_log_size":44,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509453,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":110300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]}]},{"osd":5,"up_from":15,"seq":64424509454,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":106332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]}]},{"osd":0,"up_from":14,"seq":60129542158,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":348160,"data_stored":697248,"data_compressed":32306,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]}]},{"osd":7,"up_from":14,"seq":60129542157,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":339968,"data_stored":697192,"data_compressed":32306,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":106242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]}]},{"osd":3,"up_from":14,"seq":60129542157,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":110300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]}]},{"osd":1,"up_from":15,"seq":64424509453,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":106402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]}]},{"osd":4,"up_from":15,"seq":64424509453,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":106368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32306,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32306,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":4058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":4058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T21:10:50.862 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T21:10:51.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.017+0000 7f4dd0607700 1 Processor -- start 2024-05-08T21:10:51.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.017+0000 7f4dd0607700 1 -- start start 2024-05-08T21:10:51.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.018+0000 7f4dd0607700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4dc8154320 0x7f4dc80c99d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:51.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.018+0000 7f4dd0607700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4dc8072120 0x7f4dc815a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:51.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.018+0000 7f4dd0607700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dc815a330 con 0x7f4dc80c9f10 2024-05-08T21:10:51.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.018+0000 7f4dd0607700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dc815e690 con 0x7f4dc8154320 2024-05-08T21:10:51.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.018+0000 7f4dd0607700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc815db30 con 0x7f4dc8072120 2024-05-08T21:10:51.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.018+0000 7f4dcdba2700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f4dc80c9f10 0x7f4dc806a9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:53226/0 (socket says 172.21.15.80:53226) 2024-05-08T21:10:51.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.018+0000 7f4dcdba2700 1 -- 172.21.15.80:0/902768671 learned_addr learned my addr 172.21.15.80:0/902768671 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:10:51.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.018+0000 7f4dceba4700 1 --2- 172.21.15.80:0/902768671 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4dc8072120 0x7f4dc815a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:51.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.018+0000 7f4dce3a3700 1 --2- 172.21.15.80:0/902768671 >> v2:172.21.15.106:3300/0 conn(0x7f4dc8154320 0x7f4dc80c99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:51.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.018+0000 7f4dcd3a1700 1 -- 172.21.15.80:0/902768671 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 658045108 0 0) 0x7f4dc815a330 con 0x7f4dc80c9f10 2024-05-08T21:10:51.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.018+0000 7f4dcd3a1700 1 -- 172.21.15.80:0/902768671 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4db40035b0 con 0x7f4dc80c9f10 2024-05-08T21:10:51.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.018+0000 7f4dcd3a1700 1 -- 172.21.15.80:0/902768671 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1289359298 0 0) 0x7f4db40035b0 con 0x7f4dc80c9f10 2024-05-08T21:10:51.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.018+0000 7f4dceba4700 1 -- 172.21.15.80:0/902768671 >> v2:172.21.15.106:3300/0 conn(0x7f4dc8154320 msgr2=0x7f4dc80c99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:51.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.018+0000 7f4dceba4700 1 --2- 172.21.15.80:0/902768671 >> v2:172.21.15.106:3300/0 conn(0x7f4dc8154320 0x7f4dc80c99d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:51.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.018+0000 7f4dceba4700 1 -- 172.21.15.80:0/902768671 >> v1:172.21.15.80:6789/0 conn(0x7f4dc80c9f10 legacy=0x7f4dc806a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:51.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.018+0000 7f4dceba4700 1 -- 172.21.15.80:0/902768671 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc815ddf0 con 0x7f4dc8072120 2024-05-08T21:10:51.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.018+0000 7f4dce3a3700 1 --2- 172.21.15.80:0/902768671 >> v2:172.21.15.106:3300/0 conn(0x7f4dc8154320 0x7f4dc80c99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:10:51.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.018+0000 7f4dceba4700 1 --2- 172.21.15.80:0/902768671 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4dc8072120 0x7f4dc815a7c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4dc0009d90 tx=0x7f4dc000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b9dea1dea73b6b6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:51.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.019+0000 7f4dcd3a1700 1 -- 172.21.15.80:0/902768671 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc000e070 con 0x7f4dc8072120 2024-05-08T21:10:51.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.019+0000 7f4dcd3a1700 1 -- 172.21.15.80:0/902768671 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc0003a20 con 0x7f4dc8072120 2024-05-08T21:10:51.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.019+0000 7f4dcd3a1700 1 -- 172.21.15.80:0/902768671 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc4001670 con 0x7f4dc8072120 2024-05-08T21:10:51.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.019+0000 7f4dd0607700 1 -- 172.21.15.80:0/902768671 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4dc8072120 msgr2=0x7f4dc815a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:51.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.019+0000 7f4dd0607700 1 --2- 172.21.15.80:0/902768671 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4dc8072120 0x7f4dc815a7c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4dc0009d90 tx=0x7f4dc000b330 comp rx=0 tx=0).stop 2024-05-08T21:10:51.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.019+0000 7f4dd0607700 1 -- 172.21.15.80:0/902768671 shutdown_connections 2024-05-08T21:10:51.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.019+0000 7f4dd0607700 1 --2- 172.21.15.80:0/902768671 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4dc8072120 0x7f4dc815a7c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:51.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.019+0000 7f4dd0607700 1 --2- 172.21.15.80:0/902768671 >> v2:172.21.15.106:3300/0 conn(0x7f4dc8154320 0x7f4dc80c99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:51.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.019+0000 7f4dd0607700 1 -- 172.21.15.80:0/902768671 >> 172.21.15.80:0/902768671 conn(0x7f4dc806f140 msgr2=0x7f4dc806f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:51.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.019+0000 7f4dd0607700 1 -- 172.21.15.80:0/902768671 shutdown_connections 2024-05-08T21:10:51.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.019+0000 7f4dd0607700 1 -- 172.21.15.80:0/902768671 wait complete. 2024-05-08T21:10:51.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.020+0000 7f4dd0607700 1 Processor -- start 2024-05-08T21:10:51.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.020+0000 7f4dd0607700 1 -- start start 2024-05-08T21:10:51.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.021+0000 7f4dd0607700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4dc8072120 0x7f4dc80c6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:51.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.021+0000 7f4dd0607700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4dc8154320 0x7f4dc8159920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:51.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.021+0000 7f4dd0607700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4dc8157850 0x7f4dc80cc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:51.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.021+0000 7f4dd0607700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc81557b0 con 0x7f4dc8157850 2024-05-08T21:10:51.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.021+0000 7f4dd0607700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc80ccf00 con 0x7f4dc8154320 2024-05-08T21:10:51.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.021+0000 7f4dd0607700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc80cbc20 con 0x7f4dc8072120 2024-05-08T21:10:51.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.021+0000 7f4dceba4700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4dc8157850 0x7f4dc80cc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:51.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.021+0000 7f4dceba4700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4dc8157850 0x7f4dc80cc0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34820/0 (socket says 172.21.15.80:34820) 2024-05-08T21:10:51.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.021+0000 7f4dceba4700 1 -- 172.21.15.80:0/3785866855 learned_addr learned my addr 172.21.15.80:0/3785866855 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:51.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.021+0000 7f4dce3a3700 1 --2- 172.21.15.80:0/3785866855 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4dc8072120 0x7f4dc80c6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:51.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.021+0000 7f4dcdba2700 1 --2- 172.21.15.80:0/3785866855 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4dc8154320 0x7f4dc8159920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:51.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.022+0000 7f4dceba4700 1 -- 172.21.15.80:0/3785866855 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4dc8072120 msgr2=0x7f4dc80c6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:51.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.022+0000 7f4dceba4700 1 --2- 172.21.15.80:0/3785866855 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4dc8072120 0x7f4dc80c6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:51.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.022+0000 7f4dceba4700 1 -- 172.21.15.80:0/3785866855 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4dc8154320 msgr2=0x7f4dc8159920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:51.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.022+0000 7f4dceba4700 1 --2- 172.21.15.80:0/3785866855 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4dc8154320 0x7f4dc8159920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:51.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.022+0000 7f4dceba4700 1 -- 172.21.15.80:0/3785866855 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db80094a0 con 0x7f4dc8157850 2024-05-08T21:10:51.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.022+0000 7f4dcdba2700 1 --2- 172.21.15.80:0/3785866855 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4dc8154320 0x7f4dc8159920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:10:51.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.022+0000 7f4dceba4700 1 --2- 172.21.15.80:0/3785866855 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4dc8157850 0x7f4dc80cc0b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4dc000b680 tx=0x7f4dc0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:51.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.022+0000 7f4dbeffd700 1 -- 172.21.15.80:0/3785866855 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc0009410 con 0x7f4dc8157850 2024-05-08T21:10:51.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.022+0000 7f4dbeffd700 1 -- 172.21.15.80:0/3785866855 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc00045c0 con 0x7f4dc8157850 2024-05-08T21:10:51.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.022+0000 7f4dd0607700 1 -- 172.21.15.80:0/3785866855 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dc0009a70 con 0x7f4dc8157850 2024-05-08T21:10:51.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.022+0000 7f4dbeffd700 1 -- 172.21.15.80:0/3785866855 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc0004970 con 0x7f4dc8157850 2024-05-08T21:10:51.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.022+0000 7f4dd0607700 1 -- 172.21.15.80:0/3785866855 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dc8154880 con 0x7f4dc8157850 2024-05-08T21:10:51.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.023+0000 7f4dd0607700 1 -- 172.21.15.80:0/3785866855 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dc804ec60 con 0x7f4dc8157850 2024-05-08T21:10:51.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.023+0000 7f4dbeffd700 1 -- 172.21.15.80:0/3785866855 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4dc0012430 con 0x7f4dc8157850 2024-05-08T21:10:51.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.023+0000 7f4dbeffd700 1 --2- 172.21.15.80:0/3785866855 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f4dac06acc0 0x7f4dac06d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:51.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.024+0000 7f4dbeffd700 1 -- 172.21.15.80:0/3785866855 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4dc008b270 con 0x7f4dc8157850 2024-05-08T21:10:51.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.024+0000 7f4dce3a3700 1 --2- 172.21.15.80:0/3785866855 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f4dac06acc0 0x7f4dac06d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:51.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.024+0000 7f4dce3a3700 1 --2- 172.21.15.80:0/3785866855 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f4dac06acc0 0x7f4dac06d180 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4db8009c60 tx=0x7f4db8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:51.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.028+0000 7f4dbeffd700 1 -- 172.21.15.80:0/3785866855 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f4dc0059c00 con 0x7f4dc8157850 2024-05-08T21:10:51.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.222+0000 7f4dd0607700 1 -- 172.21.15.80:0/3785866855 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4dc80cbd60 con 0x7f4dc8157850 2024-05-08T21:10:51.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.223+0000 7f4dbeffd700 1 -- 172.21.15.80:0/3785866855 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+17878 (secure 0 0 0) 0x7f4dc0059790 con 0x7f4dc8157850 2024-05-08T21:10:51.225 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:10:51.225 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":26,"fsid":"44d31c1e-aad3-47ca-a4fa-85a63d4a60aa","created":"2024-05-08T21:09:46.467038+0000","modified":"2024-05-08T21:10:08.163735+0000","last_up_change":"2024-05-08T21:09:57.284675+0000","last_in_change":"2024-05-08T21:09:49.125444+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T21:09:58.238951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T21:10:02.177476+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T21:10:02.685535+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-08T21:10:05.753779+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c3f9d93e-ed6d-4a0c-b5c0-0e8d44c65fdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":47011},{"type":"v1","addr":"172.21.15.80:6817","nonce":47011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":47011},{"type":"v1","addr":"172.21.15.80:6819","nonce":47011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":47011},{"type":"v1","addr":"172.21.15.80:6823","nonce":47011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":47011},{"type":"v1","addr":"172.21.15.80:6821","nonce":47011}]},"public_addr":"172.21.15.80:6817/47011","cluster_addr":"172.21.15.80:6819/47011","heartbeat_back_addr":"172.21.15.80:6823/47011","heartbeat_front_addr":"172.21.15.80:6821/47011","state":["exists","up"]},{"osd":1,"uuid":"4ce2b4d6-6c40-43aa-8dd1-743fef8915df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":47010},{"type":"v1","addr":"172.21.15.80:6809","nonce":47010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":47010},{"type":"v1","addr":"172.21.15.80:6811","nonce":47010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":47010},{"type":"v1","addr":"172.21.15.80:6815","nonce":47010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":47010},{"type":"v1","addr":"172.21.15.80:6813","nonce":47010}]},"public_addr":"172.21.15.80:6809/47010","cluster_addr":"172.21.15.80:6811/47010","heartbeat_back_addr":"172.21.15.80:6815/47010","heartbeat_front_addr":"172.21.15.80:6813/47010","state":["exists","up"]},{"osd":2,"uuid":"e30cc3bc-6461-4fac-960a-de00c9488d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":47009},{"type":"v1","addr":"172.21.15.80:6801","nonce":47009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":47009},{"type":"v1","addr":"172.21.15.80:6803","nonce":47009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":47009},{"type":"v1","addr":"172.21.15.80:6807","nonce":47009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":47009},{"type":"v1","addr":"172.21.15.80:6805","nonce":47009}]},"public_addr":"172.21.15.80:6801/47009","cluster_addr":"172.21.15.80:6803/47009","heartbeat_back_addr":"172.21.15.80:6807/47009","heartbeat_front_addr":"172.21.15.80:6805/47009","state":["exists","up"]},{"osd":3,"uuid":"a415c099-9ea6-40be-98ed-f2932f98dfd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":47012},{"type":"v1","addr":"172.21.15.80:6825","nonce":47012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":47012},{"type":"v1","addr":"172.21.15.80:6827","nonce":47012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":47012},{"type":"v1","addr":"172.21.15.80:6831","nonce":47012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":47012},{"type":"v1","addr":"172.21.15.80:6829","nonce":47012}]},"public_addr":"172.21.15.80:6825/47012","cluster_addr":"172.21.15.80:6827/47012","heartbeat_back_addr":"172.21.15.80:6831/47012","heartbeat_front_addr":"172.21.15.80:6829/47012","state":["exists","up"]},{"osd":4,"uuid":"5ae1d51f-0918-4571-b79b-154308d46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6823","nonce":47114},{"type":"v1","addr":"172.21.15.106:6825","nonce":47114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":47114},{"type":"v1","addr":"172.21.15.106:6827","nonce":47114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":47114},{"type":"v1","addr":"172.21.15.106:6831","nonce":47114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":47114},{"type":"v1","addr":"172.21.15.106:6829","nonce":47114}]},"public_addr":"172.21.15.106:6825/47114","cluster_addr":"172.21.15.106:6827/47114","heartbeat_back_addr":"172.21.15.106:6831/47114","heartbeat_front_addr":"172.21.15.106:6829/47114","state":["exists","up"]},{"osd":5,"uuid":"a19ac74e-4282-4428-b167-26ba6b92f732","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6807","nonce":47111},{"type":"v1","addr":"172.21.15.106:6809","nonce":47111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":47111},{"type":"v1","addr":"172.21.15.106:6811","nonce":47111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":47111},{"type":"v1","addr":"172.21.15.106:6815","nonce":47111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":47111},{"type":"v1","addr":"172.21.15.106:6813","nonce":47111}]},"public_addr":"172.21.15.106:6809/47111","cluster_addr":"172.21.15.106:6811/47111","heartbeat_back_addr":"172.21.15.106:6815/47111","heartbeat_front_addr":"172.21.15.106:6813/47111","state":["exists","up"]},{"osd":6,"uuid":"bfe72edd-7acc-4805-807d-2000e76f2feb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":47112},{"type":"v1","addr":"172.21.15.106:6817","nonce":47112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":47112},{"type":"v1","addr":"172.21.15.106:6819","nonce":47112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":47112},{"type":"v1","addr":"172.21.15.106:6824","nonce":47112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":47112},{"type":"v1","addr":"172.21.15.106:6821","nonce":47112}]},"public_addr":"172.21.15.106:6817/47112","cluster_addr":"172.21.15.106:6819/47112","heartbeat_back_addr":"172.21.15.106:6824/47112","heartbeat_front_addr":"172.21.15.106:6821/47112","state":["exists","up"]},{"osd":7,"uuid":"99897f22-ed17-4c7c-9088-cc0c4a51f786","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":47113},{"type":"v1","addr":"172.21.15.106:6801","nonce":47113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":47113},{"type":"v1","addr":"172.21.15.106:6803","nonce":47113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":47113},{"type":"v1","addr":"172.21.15.106:6808","nonce":47113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":47113},{"type":"v1","addr":"172.21.15.106:6805","nonce":47113}]},"public_addr":"172.21.15.106:6801/47113","cluster_addr":"172.21.15.106:6803/47113","heartbeat_back_addr":"172.21.15.106:6808/47113","heartbeat_front_addr":"172.21.15.106:6805/47113","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.232670+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.277753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.050087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.349312+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.344080+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.348781+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.352539+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.275013+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T21:10:51.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.225+0000 7f4dd0607700 1 -- 172.21.15.80:0/3785866855 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f4dac06acc0 msgr2=0x7f4dac06d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:51.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.225+0000 7f4dd0607700 1 --2- 172.21.15.80:0/3785866855 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f4dac06acc0 0x7f4dac06d180 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4db8009c60 tx=0x7f4db8008040 comp rx=0 tx=0).stop 2024-05-08T21:10:51.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.225+0000 7f4dd0607700 1 -- 172.21.15.80:0/3785866855 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4dc8157850 msgr2=0x7f4dc80cc0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:51.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.225+0000 7f4dd0607700 1 --2- 172.21.15.80:0/3785866855 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4dc8157850 0x7f4dc80cc0b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4dc000b680 tx=0x7f4dc0004ad0 comp rx=0 tx=0).stop 2024-05-08T21:10:51.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.225+0000 7f4dd0607700 1 -- 172.21.15.80:0/3785866855 shutdown_connections 2024-05-08T21:10:51.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.225+0000 7f4dd0607700 1 --2- 172.21.15.80:0/3785866855 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f4dac06acc0 0x7f4dac06d180 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:51.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.225+0000 7f4dd0607700 1 --2- 172.21.15.80:0/3785866855 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4dc8157850 0x7f4dc80cc0b0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:51.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.225+0000 7f4dd0607700 1 --2- 172.21.15.80:0/3785866855 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4dc8072120 0x7f4dc80c6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:51.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.225+0000 7f4dd0607700 1 --2- 172.21.15.80:0/3785866855 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4dc8154320 0x7f4dc8159920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:51.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.225+0000 7f4dd0607700 1 -- 172.21.15.80:0/3785866855 >> 172.21.15.80:0/3785866855 conn(0x7f4dc806f140 msgr2=0x7f4dc8071480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:51.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.225+0000 7f4dd0607700 1 -- 172.21.15.80:0/3785866855 shutdown_connections 2024-05-08T21:10:51.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.225+0000 7f4dd0607700 1 -- 172.21.15.80:0/3785866855 wait complete. 2024-05-08T21:10:51.240 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T21:09:58.238951+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T21:10:02.177476+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T21:10:02.685535+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-08T21:10:05.753779+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-08T21:10:51.240 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T21:10:51.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.363+0000 7fcdca90f700 1 Processor -- start 2024-05-08T21:10:51.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.364+0000 7fcdca90f700 1 -- start start 2024-05-08T21:10:51.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.364+0000 7fcdca90f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcdc4154320 0x7fcdc4071f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:51.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.364+0000 7fcdca90f700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcdc40c99d0 0x7fcdc406a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:51.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.364+0000 7fcdca90f700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdc415e570 con 0x7fcdc406af00 2024-05-08T21:10:51.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.364+0000 7fcdca90f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdc415d710 con 0x7fcdc4154320 2024-05-08T21:10:51.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.364+0000 7fcdca90f700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc415d960 con 0x7fcdc40c99d0 2024-05-08T21:10:51.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.364+0000 7fcdc3fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcdc4154320 0x7fcdc4071f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:51.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.364+0000 7fcdc8eac700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fcdc406af00 0x7fcdc415a340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:53228/0 (socket says 172.21.15.80:53228) 2024-05-08T21:10:51.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.364+0000 7fcdc3fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcdc4154320 0x7fcdc4071f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34826/0 (socket says 172.21.15.80:34826) 2024-05-08T21:10:51.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.364+0000 7fcdc8eac700 1 -- 172.21.15.80:0/809350883 learned_addr learned my addr 172.21.15.80:0/809350883 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:10:51.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.365+0000 7fcdc37fe700 1 --2- 172.21.15.80:0/809350883 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcdc40c99d0 0x7fcdc406a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:51.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.365+0000 7fcdc3fff700 1 -- 172.21.15.80:0/809350883 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcdc40c99d0 msgr2=0x7fcdc406a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:51.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.365+0000 7fcdc3fff700 1 --2- 172.21.15.80:0/809350883 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcdc40c99d0 0x7fcdc406a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:51.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.365+0000 7fcdc3fff700 1 -- 172.21.15.80:0/809350883 >> v1:172.21.15.80:6789/0 conn(0x7fcdc406af00 legacy=0x7fcdc415a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:51.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.365+0000 7fcdc3fff700 1 -- 172.21.15.80:0/809350883 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdc415dc40 con 0x7fcdc4154320 2024-05-08T21:10:51.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.365+0000 7fcdc2ffd700 1 -- 172.21.15.80:0/809350883 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3176020872 0 0) 0x7fcdc415e570 con 0x7fcdc406af00 2024-05-08T21:10:51.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.365+0000 7fcdc3fff700 1 --2- 172.21.15.80:0/809350883 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcdc4154320 0x7fcdc4071f90 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fcdb8009840 tx=0x7fcdb8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=390a8479ded57713 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:51.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.365+0000 7fcdc2ffd700 1 -- 172.21.15.80:0/809350883 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb8011830 con 0x7fcdc4154320 2024-05-08T21:10:51.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.365+0000 7fcdc2ffd700 1 -- 172.21.15.80:0/809350883 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdb8011990 con 0x7fcdc4154320 2024-05-08T21:10:51.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.365+0000 7fcdc2ffd700 1 -- 172.21.15.80:0/809350883 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb8011d20 con 0x7fcdc4154320 2024-05-08T21:10:51.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.366+0000 7fcdca90f700 1 -- 172.21.15.80:0/809350883 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcdc4154320 msgr2=0x7fcdc4071f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:51.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.366+0000 7fcdca90f700 1 --2- 172.21.15.80:0/809350883 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcdc4154320 0x7fcdc4071f90 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fcdb8009840 tx=0x7fcdb8009b50 comp rx=0 tx=0).stop 2024-05-08T21:10:51.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.366+0000 7fcdca90f700 1 -- 172.21.15.80:0/809350883 shutdown_connections 2024-05-08T21:10:51.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.366+0000 7fcdca90f700 1 --2- 172.21.15.80:0/809350883 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcdc4154320 0x7fcdc4071f90 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:51.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.366+0000 7fcdca90f700 1 --2- 172.21.15.80:0/809350883 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcdc40c99d0 0x7fcdc406a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:51.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.366+0000 7fcdca90f700 1 -- 172.21.15.80:0/809350883 >> 172.21.15.80:0/809350883 conn(0x7fcdc406f140 msgr2=0x7fcdc406f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:51.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.366+0000 7fcdca90f700 1 -- 172.21.15.80:0/809350883 shutdown_connections 2024-05-08T21:10:51.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.366+0000 7fcdca90f700 1 -- 172.21.15.80:0/809350883 wait complete. 2024-05-08T21:10:51.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.367+0000 7fcdca90f700 1 Processor -- start 2024-05-08T21:10:51.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.367+0000 7fcdca90f700 1 -- start start 2024-05-08T21:10:51.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.368+0000 7fcdca90f700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcdc406af00 0x7fcdc41e3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:51.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.368+0000 7fcdca90f700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcdc40c99d0 0x7fcdc41e6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:51.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.368+0000 7fcdca90f700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcdc4154320 0x7fcdc4152370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:51.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.368+0000 7fcdca90f700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc41e72a0 con 0x7fcdc40c99d0 2024-05-08T21:10:51.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.368+0000 7fcdca90f700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc41f15b0 con 0x7fcdc406af00 2024-05-08T21:10:51.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.368+0000 7fcdca90f700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc41f1890 con 0x7fcdc4154320 2024-05-08T21:10:51.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.368+0000 7fcdc37fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcdc40c99d0 0x7fcdc41e6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:51.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.368+0000 7fcdc37fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcdc40c99d0 0x7fcdc41e6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34840/0 (socket says 172.21.15.80:34840) 2024-05-08T21:10:51.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.368+0000 7fcdc37fe700 1 -- 172.21.15.80:0/396034025 learned_addr learned my addr 172.21.15.80:0/396034025 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:51.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.368+0000 7fcdc8eac700 1 --2- 172.21.15.80:0/396034025 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcdc4154320 0x7fcdc4152370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:51.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.368+0000 7fcdc3fff700 1 --2- 172.21.15.80:0/396034025 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcdc406af00 0x7fcdc41e3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:51.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.368+0000 7fcdc37fe700 1 -- 172.21.15.80:0/396034025 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcdc4154320 msgr2=0x7fcdc4152370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:51.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.368+0000 7fcdc37fe700 1 --2- 172.21.15.80:0/396034025 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcdc4154320 0x7fcdc4152370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:51.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.368+0000 7fcdc37fe700 1 -- 172.21.15.80:0/396034025 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcdc406af00 msgr2=0x7fcdc41e3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:51.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.368+0000 7fcdc37fe700 1 --2- 172.21.15.80:0/396034025 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcdc406af00 0x7fcdc41e3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:51.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.368+0000 7fcdc37fe700 1 -- 172.21.15.80:0/396034025 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb80094a0 con 0x7fcdc40c99d0 2024-05-08T21:10:51.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.368+0000 7fcdc8eac700 1 --2- 172.21.15.80:0/396034025 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcdc4154320 0x7fcdc4152370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:10:51.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.368+0000 7fcdc3fff700 1 --2- 172.21.15.80:0/396034025 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcdc406af00 0x7fcdc41e3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:10:51.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.368+0000 7fcdc37fe700 1 --2- 172.21.15.80:0/396034025 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcdc40c99d0 0x7fcdc41e6d60 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fcdb400e9b0 tx=0x7fcdb400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:51.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.368+0000 7fcdc0ff9700 1 -- 172.21.15.80:0/396034025 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb4009710 con 0x7fcdc40c99d0 2024-05-08T21:10:51.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.368+0000 7fcdc0ff9700 1 -- 172.21.15.80:0/396034025 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdb400c850 con 0x7fcdc40c99d0 2024-05-08T21:10:51.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.369+0000 7fcdc0ff9700 1 -- 172.21.15.80:0/396034025 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb400cbc0 con 0x7fcdc40c99d0 2024-05-08T21:10:51.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.369+0000 7fcdca90f700 1 -- 172.21.15.80:0/396034025 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdc4154880 con 0x7fcdc40c99d0 2024-05-08T21:10:51.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.369+0000 7fcdca90f700 1 -- 172.21.15.80:0/396034025 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdc41f1e50 con 0x7fcdc40c99d0 2024-05-08T21:10:51.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.369+0000 7fcdca90f700 1 -- 172.21.15.80:0/396034025 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdc404ec60 con 0x7fcdc40c99d0 2024-05-08T21:10:51.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.370+0000 7fcdc0ff9700 1 -- 172.21.15.80:0/396034025 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fcdb400cd20 con 0x7fcdc40c99d0 2024-05-08T21:10:51.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.370+0000 7fcdc0ff9700 1 --2- 172.21.15.80:0/396034025 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fcdb006ac90 0x7fcdb006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:51.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.370+0000 7fcdc0ff9700 1 -- 172.21.15.80:0/396034025 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcdb4089720 con 0x7fcdc40c99d0 2024-05-08T21:10:51.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.370+0000 7fcdc3fff700 1 --2- 172.21.15.80:0/396034025 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fcdb006ac90 0x7fcdb006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:51.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.371+0000 7fcdc3fff700 1 --2- 172.21.15.80:0/396034025 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fcdb006ac90 0x7fcdb006d150 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fcdb8009b90 tx=0x7fcdb8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:51.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.375+0000 7fcdc0ff9700 1 -- 172.21.15.80:0/396034025 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fcdb4054610 con 0x7fcdc40c99d0 2024-05-08T21:10:51.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.570+0000 7fcdca90f700 1 -- 172.21.15.80:0/396034025 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcdc4072180 con 0x7fcdc40c99d0 2024-05-08T21:10:51.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.570+0000 7fcdc0ff9700 1 -- 172.21.15.80:0/396034025 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcdb4057c30 con 0x7fcdc40c99d0 2024-05-08T21:10:51.573 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-05-08T21:10:51.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.573+0000 7fcdca90f700 1 -- 172.21.15.80:0/396034025 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fcdb006ac90 msgr2=0x7fcdb006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:51.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.573+0000 7fcdca90f700 1 --2- 172.21.15.80:0/396034025 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fcdb006ac90 0x7fcdb006d150 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fcdb8009b90 tx=0x7fcdb8008030 comp rx=0 tx=0).stop 2024-05-08T21:10:51.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.573+0000 7fcdca90f700 1 -- 172.21.15.80:0/396034025 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcdc40c99d0 msgr2=0x7fcdc41e6d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:51.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.573+0000 7fcdca90f700 1 --2- 172.21.15.80:0/396034025 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcdc40c99d0 0x7fcdc41e6d60 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fcdb400e9b0 tx=0x7fcdb400ed70 comp rx=0 tx=0).stop 2024-05-08T21:10:51.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.573+0000 7fcdca90f700 1 -- 172.21.15.80:0/396034025 shutdown_connections 2024-05-08T21:10:51.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.573+0000 7fcdca90f700 1 --2- 172.21.15.80:0/396034025 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fcdb006ac90 0x7fcdb006d150 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:51.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.573+0000 7fcdca90f700 1 --2- 172.21.15.80:0/396034025 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcdc4154320 0x7fcdc4152370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:51.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.573+0000 7fcdca90f700 1 --2- 172.21.15.80:0/396034025 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcdc406af00 0x7fcdc41e3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:51.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.573+0000 7fcdca90f700 1 --2- 172.21.15.80:0/396034025 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcdc40c99d0 0x7fcdc41e6d60 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:51.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.573+0000 7fcdca90f700 1 -- 172.21.15.80:0/396034025 >> 172.21.15.80:0/396034025 conn(0x7fcdc406f140 msgr2=0x7fcdc4153990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:51.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.573+0000 7fcdca90f700 1 -- 172.21.15.80:0/396034025 shutdown_connections 2024-05-08T21:10:51.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.573+0000 7fcdca90f700 1 -- 172.21.15.80:0/396034025 wait complete. 2024-05-08T21:10:51.587 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T21:10:51.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.708+0000 7f9d8e18b700 1 Processor -- start 2024-05-08T21:10:51.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.708+0000 7f9d8e18b700 1 -- start start 2024-05-08T21:10:51.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.709+0000 7f9d8e18b700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f9d8806aac0 0x7f9d8806af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:51.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.709+0000 7f9d8e18b700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d880c1a00 con 0x7f9d8815a9c0 2024-05-08T21:10:51.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.709+0000 7f9d8e18b700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d8806b440 con 0x7f9d8815a5e0 2024-05-08T21:10:51.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.709+0000 7f9d8e18b700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d880710b0 con 0x7f9d8806aac0 2024-05-08T21:10:51.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.709+0000 7f9d87fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f9d8815a9c0 0x7f9d8815ae50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:53242/0 (socket says 172.21.15.80:53242) 2024-05-08T21:10:51.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.709+0000 7f9d87fff700 1 -- 172.21.15.80:0/3813660132 learned_addr learned my addr 172.21.15.80:0/3813660132 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:10:51.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.709+0000 7f9d86ffd700 1 --2- 172.21.15.80:0/3813660132 >> v2:172.21.15.106:3300/0 conn(0x7f9d8806aac0 0x7f9d8806af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:51.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.709+0000 7f9d867fc700 1 -- 172.21.15.80:0/3813660132 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4257502080 0 0) 0x7f9d880c1a00 con 0x7f9d8815a9c0 2024-05-08T21:10:51.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.709+0000 7f9d867fc700 1 -- 172.21.15.80:0/3813660132 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d700035b0 con 0x7f9d8815a9c0 2024-05-08T21:10:51.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.710+0000 7f9d867fc700 1 -- 172.21.15.80:0/3813660132 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1793316901 0 0) 0x7f9d700035b0 con 0x7f9d8815a9c0 2024-05-08T21:10:51.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.710+0000 7f9d867fc700 1 -- 172.21.15.80:0/3813660132 >> v2:172.21.15.106:3300/0 conn(0x7f9d8806aac0 msgr2=0x7f9d8806af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:51.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.710+0000 7f9d867fc700 1 --2- 172.21.15.80:0/3813660132 >> v2:172.21.15.106:3300/0 conn(0x7f9d8806aac0 0x7f9d8806af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:51.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.710+0000 7f9d867fc700 1 -- 172.21.15.80:0/3813660132 >> v1:172.21.15.106:6789/0 conn(0x7f9d8815a5e0 legacy=0x7f9d880c7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:51.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.710+0000 7f9d867fc700 1 -- 172.21.15.80:0/3813660132 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d880c1ca0 con 0x7f9d8815a9c0 2024-05-08T21:10:51.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.710+0000 7f9d867fc700 1 -- 172.21.15.80:0/3813660132 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3520646302 0 0) 0x7f9d800019f0 con 0x7f9d8815a9c0 2024-05-08T21:10:51.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.710+0000 7f9d867fc700 1 -- 172.21.15.80:0/3813660132 >> v1:172.21.15.80:6789/0 conn(0x7f9d8815a9c0 legacy=0x7f9d8815ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:51.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.710+0000 7f9d867fc700 1 --2- 172.21.15.80:0/3813660132 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d70003a00 0x7f9d70003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:51.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.710+0000 7f9d867fc700 1 --2- 172.21.15.80:0/3813660132 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9d70004850 0x7f9d70004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:51.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.710+0000 7f9d867fc700 1 --2- 172.21.15.80:0/3813660132 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9d70005210 0x7f9d7000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:51.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.710+0000 7f9d867fc700 1 -- 172.21.15.80:0/3813660132 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d880710b0 con 0x7f9d70003a00 2024-05-08T21:10:51.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.710+0000 7f9d867fc700 1 -- 172.21.15.80:0/3813660132 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7000c0c0 con 0x7f9d70005210 2024-05-08T21:10:51.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.710+0000 7f9d867fc700 1 -- 172.21.15.80:0/3813660132 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7000c280 con 0x7f9d70004850 2024-05-08T21:10:51.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.710+0000 7f9d877fe700 1 --2- 172.21.15.80:0/3813660132 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d70003a00 0x7f9d70003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:51.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.710+0000 7f9d86ffd700 1 --2- 172.21.15.80:0/3813660132 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9d70004850 0x7f9d70004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:51.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.710+0000 7f9d87fff700 1 --2- 172.21.15.80:0/3813660132 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9d70005210 0x7f9d7000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:51.715 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.710+0000 7f9d877fe700 1 -- 172.21.15.80:0/3813660132 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9d70004850 msgr2=0x7f9d70004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:51.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.710+0000 7f9d877fe700 1 --2- 172.21.15.80:0/3813660132 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9d70004850 0x7f9d70004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:51.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.710+0000 7f9d877fe700 1 -- 172.21.15.80:0/3813660132 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9d70005210 msgr2=0x7f9d7000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:51.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.710+0000 7f9d877fe700 1 --2- 172.21.15.80:0/3813660132 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9d70005210 0x7f9d7000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:51.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.710+0000 7f9d877fe700 1 -- 172.21.15.80:0/3813660132 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d700035b0 con 0x7f9d70003a00 2024-05-08T21:10:51.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.710+0000 7f9d87fff700 1 -- 172.21.15.80:0/3813660132 reap_dead start 2024-05-08T21:10:51.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.710+0000 7f9d877fe700 1 --2- 172.21.15.80:0/3813660132 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d70003a00 0x7f9d70003e20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c0017c0 tx=0x7f9d70005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e354dae222a3796 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:51.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.710+0000 7f9d867fc700 1 -- 172.21.15.80:0/3813660132 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c0052d0 con 0x7f9d70003a00 2024-05-08T21:10:51.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.710+0000 7f9d867fc700 1 -- 172.21.15.80:0/3813660132 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d7c005450 con 0x7f9d70003a00 2024-05-08T21:10:51.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.711+0000 7f9d867fc700 1 -- 172.21.15.80:0/3813660132 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c0038c0 con 0x7f9d70003a00 2024-05-08T21:10:51.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.711+0000 7f9d8e18b700 1 -- 172.21.15.80:0/3813660132 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d70003a00 msgr2=0x7f9d70003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:51.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.711+0000 7f9d8e18b700 1 --2- 172.21.15.80:0/3813660132 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d70003a00 0x7f9d70003e20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c0017c0 tx=0x7f9d70005880 comp rx=0 tx=0).stop 2024-05-08T21:10:51.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.711+0000 7f9d8e18b700 1 -- 172.21.15.80:0/3813660132 shutdown_connections 2024-05-08T21:10:51.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.711+0000 7f9d8e18b700 1 --2- 172.21.15.80:0/3813660132 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d70003a00 0x7f9d70003e20 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:51.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.711+0000 7f9d8e18b700 1 -- 172.21.15.80:0/3813660132 >> 172.21.15.80:0/3813660132 conn(0x7f9d880cbe80 msgr2=0x7f9d880cc290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:51.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.711+0000 7f9d8e18b700 1 -- 172.21.15.80:0/3813660132 shutdown_connections 2024-05-08T21:10:51.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.711+0000 7f9d8e18b700 1 -- 172.21.15.80:0/3813660132 wait complete. 2024-05-08T21:10:51.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.712+0000 7f9d8e18b700 1 Processor -- start 2024-05-08T21:10:51.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.712+0000 7f9d8e18b700 1 -- start start 2024-05-08T21:10:51.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.713+0000 7f9d8e18b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9d70003a00 0x7f9d88159970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:51.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.713+0000 7f9d8e18b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d881581b0 0x7f9d88147da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:51.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.713+0000 7f9d8e18b700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9d881e52f0 0x7f9d881f3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:51.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.713+0000 7f9d8e18b700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d881596b0 con 0x7f9d881581b0 2024-05-08T21:10:51.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.713+0000 7f9d8e18b700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d88157f30 con 0x7f9d70003a00 2024-05-08T21:10:51.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.713+0000 7f9d8e18b700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8814eaf0 con 0x7f9d881e52f0 2024-05-08T21:10:51.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.713+0000 7f9d86ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d881581b0 0x7f9d88147da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:51.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.713+0000 7f9d86ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d881581b0 0x7f9d88147da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34850/0 (socket says 172.21.15.80:34850) 2024-05-08T21:10:51.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.713+0000 7f9d86ffd700 1 -- 172.21.15.80:0/202140491 learned_addr learned my addr 172.21.15.80:0/202140491 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:51.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.713+0000 7f9d87fff700 1 --2- 172.21.15.80:0/202140491 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9d881e52f0 0x7f9d881f3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:51.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.713+0000 7f9d877fe700 1 --2- 172.21.15.80:0/202140491 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9d70003a00 0x7f9d88159970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:51.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.713+0000 7f9d86ffd700 1 -- 172.21.15.80:0/202140491 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9d881e52f0 msgr2=0x7f9d881f3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:51.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.713+0000 7f9d86ffd700 1 --2- 172.21.15.80:0/202140491 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9d881e52f0 0x7f9d881f3040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:51.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.713+0000 7f9d86ffd700 1 -- 172.21.15.80:0/202140491 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9d70003a00 msgr2=0x7f9d88159970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:51.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.713+0000 7f9d86ffd700 1 --2- 172.21.15.80:0/202140491 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9d70003a00 0x7f9d88159970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:51.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.713+0000 7f9d86ffd700 1 -- 172.21.15.80:0/202140491 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d8815a040 con 0x7f9d881581b0 2024-05-08T21:10:51.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.714+0000 7f9d86ffd700 1 --2- 172.21.15.80:0/202140491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d881581b0 0x7f9d88147da0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9d78011aa0 tx=0x7f9d78011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:51.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.714+0000 7f9d6ffff700 1 -- 172.21.15.80:0/202140491 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7800f980 con 0x7f9d881581b0 2024-05-08T21:10:51.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.714+0000 7f9d6ffff700 1 -- 172.21.15.80:0/202140491 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d7800fb00 con 0x7f9d881581b0 2024-05-08T21:10:51.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.714+0000 7f9d6ffff700 1 -- 172.21.15.80:0/202140491 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7800feb0 con 0x7f9d881581b0 2024-05-08T21:10:51.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.714+0000 7f9d8e18b700 1 -- 172.21.15.80:0/202140491 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d8814dd30 con 0x7f9d881581b0 2024-05-08T21:10:51.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.714+0000 7f9d8e18b700 1 -- 172.21.15.80:0/202140491 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d8814e2f0 con 0x7f9d881581b0 2024-05-08T21:10:51.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.715+0000 7f9d8e18b700 1 -- 172.21.15.80:0/202140491 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d88067cf0 con 0x7f9d881581b0 2024-05-08T21:10:51.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.715+0000 7f9d6ffff700 1 -- 172.21.15.80:0/202140491 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9d78014440 con 0x7f9d881581b0 2024-05-08T21:10:51.721 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.716+0000 7f9d6ffff700 1 --2- 172.21.15.80:0/202140491 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f9d7406ac90 0x7f9d7406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:51.721 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.716+0000 7f9d6ffff700 1 -- 172.21.15.80:0/202140491 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9d78089ca0 con 0x7f9d881581b0 2024-05-08T21:10:51.721 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.716+0000 7f9d877fe700 1 --2- 172.21.15.80:0/202140491 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f9d7406ac90 0x7f9d7406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:51.721 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.716+0000 7f9d877fe700 1 --2- 172.21.15.80:0/202140491 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f9d7406ac90 0x7f9d7406d150 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c015040 tx=0x7f9d7c009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:51.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.720+0000 7f9d6ffff700 1 -- 172.21.15.80:0/202140491 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f9d78054d00 con 0x7f9d881581b0 2024-05-08T21:10:51.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.917+0000 7f9d8e18b700 1 -- 172.21.15.80:0/202140491 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9d8804ec60 con 0x7f9d881581b0 2024-05-08T21:10:51.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.918+0000 7f9d6ffff700 1 -- 172.21.15.80:0/202140491 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9d780220a0 con 0x7f9d881581b0 2024-05-08T21:10:51.920 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-05-08T21:10:51.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.920+0000 7f9d8e18b700 1 -- 172.21.15.80:0/202140491 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f9d7406ac90 msgr2=0x7f9d7406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:51.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.920+0000 7f9d8e18b700 1 --2- 172.21.15.80:0/202140491 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f9d7406ac90 0x7f9d7406d150 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c015040 tx=0x7f9d7c009030 comp rx=0 tx=0).stop 2024-05-08T21:10:51.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.920+0000 7f9d8e18b700 1 -- 172.21.15.80:0/202140491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d881581b0 msgr2=0x7f9d88147da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:51.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.920+0000 7f9d8e18b700 1 --2- 172.21.15.80:0/202140491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d881581b0 0x7f9d88147da0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9d78011aa0 tx=0x7f9d78011e60 comp rx=0 tx=0).stop 2024-05-08T21:10:51.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.920+0000 7f9d8e18b700 1 -- 172.21.15.80:0/202140491 shutdown_connections 2024-05-08T21:10:51.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.920+0000 7f9d8e18b700 1 --2- 172.21.15.80:0/202140491 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f9d7406ac90 0x7f9d7406d150 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:51.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.920+0000 7f9d8e18b700 1 --2- 172.21.15.80:0/202140491 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9d881e52f0 0x7f9d881f3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:51.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.920+0000 7f9d8e18b700 1 --2- 172.21.15.80:0/202140491 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9d70003a00 0x7f9d88159970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:51.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.920+0000 7f9d8e18b700 1 --2- 172.21.15.80:0/202140491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d881581b0 0x7f9d88147da0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:51.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.920+0000 7f9d8e18b700 1 -- 172.21.15.80:0/202140491 >> 172.21.15.80:0/202140491 conn(0x7f9d880cbe80 msgr2=0x7f9d880ca4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:51.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.920+0000 7f9d8e18b700 1 -- 172.21.15.80:0/202140491 shutdown_connections 2024-05-08T21:10:51.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:51.920+0000 7f9d8e18b700 1 -- 172.21.15.80:0/202140491 wait complete. 2024-05-08T21:10:51.934 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T21:10:52.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.056+0000 7fa3c1e19700 1 Processor -- start 2024-05-08T21:10:52.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.056+0000 7fa3c1e19700 1 -- start start 2024-05-08T21:10:52.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.056+0000 7fa3c1e19700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa3bc06b010 0x7fa3bc151c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:52.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.056+0000 7fa3c1e19700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3bc0c6100 con 0x7fa3bc1521d0 2024-05-08T21:10:52.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.056+0000 7fa3c1e19700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3bc1525f0 con 0x7fa3bc06ac30 2024-05-08T21:10:52.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.056+0000 7fa3c1e19700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3bc0c6ed0 con 0x7fa3bc06b010 2024-05-08T21:10:52.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.056+0000 7fa3baffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa3bc06b010 0x7fa3bc151c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:52.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.056+0000 7fa3bbfff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fa3bc1521d0 0x7fa3bc0c9960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:53256/0 (socket says 172.21.15.80:53256) 2024-05-08T21:10:52.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.056+0000 7fa3baffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa3bc06b010 0x7fa3bc151c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34852/0 (socket says 172.21.15.80:34852) 2024-05-08T21:10:52.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.057+0000 7fa3bbfff700 1 -- 172.21.15.80:0/2522995776 learned_addr learned my addr 172.21.15.80:0/2522995776 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:10:52.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.057+0000 7fa3baffd700 1 -- 172.21.15.80:0/2522995776 >> v1:172.21.15.106:6789/0 conn(0x7fa3bc06ac30 legacy=0x7fa3bc158600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:52.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.057+0000 7fa3baffd700 1 -- 172.21.15.80:0/2522995776 >> v1:172.21.15.80:6789/0 conn(0x7fa3bc1521d0 legacy=0x7fa3bc0c9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:52.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.057+0000 7fa3baffd700 1 -- 172.21.15.80:0/2522995776 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3bc0c6350 con 0x7fa3bc06b010 2024-05-08T21:10:52.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.057+0000 7fa3baffd700 1 --2- 172.21.15.80:0/2522995776 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3bc06b010 0x7fa3bc151c90 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac009840 tx=0x7fa3ac009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b65c2841df475f8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:52.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.057+0000 7fa3ba7fc700 1 -- 172.21.15.80:0/2522995776 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3ac011830 con 0x7fa3bc06b010 2024-05-08T21:10:52.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.057+0000 7fa3ba7fc700 1 -- 172.21.15.80:0/2522995776 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3ac011990 con 0x7fa3bc06b010 2024-05-08T21:10:52.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.057+0000 7fa3ba7fc700 1 -- 172.21.15.80:0/2522995776 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3ac011d20 con 0x7fa3bc06b010 2024-05-08T21:10:52.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.058+0000 7fa3c1e19700 1 -- 172.21.15.80:0/2522995776 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3bc06b010 msgr2=0x7fa3bc151c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:52.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.058+0000 7fa3c1e19700 1 --2- 172.21.15.80:0/2522995776 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3bc06b010 0x7fa3bc151c90 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac009840 tx=0x7fa3ac009b50 comp rx=0 tx=0).stop 2024-05-08T21:10:52.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.058+0000 7fa3c1e19700 1 -- 172.21.15.80:0/2522995776 shutdown_connections 2024-05-08T21:10:52.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.058+0000 7fa3c1e19700 1 --2- 172.21.15.80:0/2522995776 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3bc06b010 0x7fa3bc151c90 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:52.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.058+0000 7fa3c1e19700 1 -- 172.21.15.80:0/2522995776 >> 172.21.15.80:0/2522995776 conn(0x7fa3bc06f140 msgr2=0x7fa3bc06f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:52.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.058+0000 7fa3c1e19700 1 -- 172.21.15.80:0/2522995776 shutdown_connections 2024-05-08T21:10:52.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.058+0000 7fa3c1e19700 1 -- 172.21.15.80:0/2522995776 wait complete. 2024-05-08T21:10:52.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.059+0000 7fa3c1e19700 1 Processor -- start 2024-05-08T21:10:52.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.059+0000 7fa3c1e19700 1 -- start start 2024-05-08T21:10:52.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.060+0000 7fa3c1e19700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3bc06ac30 0x7fa3bc14b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:52.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.060+0000 7fa3c1e19700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa3bc06b010 0x7fa3bc0cc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:52.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.060+0000 7fa3c1e19700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3bc1521d0 0x7fa3bc0c76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:52.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.060+0000 7fa3c1e19700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3bc1eee40 con 0x7fa3bc1521d0 2024-05-08T21:10:52.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.060+0000 7fa3c1e19700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3bc0cc210 con 0x7fa3bc06ac30 2024-05-08T21:10:52.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.060+0000 7fa3c1e19700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3bc1ee2c0 con 0x7fa3bc06b010 2024-05-08T21:10:52.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.060+0000 7fa3bbfff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3bc1521d0 0x7fa3bc0c76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:52.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.060+0000 7fa3bbfff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3bc1521d0 0x7fa3bc0c76d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34866/0 (socket says 172.21.15.80:34866) 2024-05-08T21:10:52.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.060+0000 7fa3bbfff700 1 -- 172.21.15.80:0/378698659 learned_addr learned my addr 172.21.15.80:0/378698659 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:52.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.060+0000 7fa3bb7fe700 1 --2- 172.21.15.80:0/378698659 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3bc06ac30 0x7fa3bc14b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:52.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.060+0000 7fa3baffd700 1 --2- 172.21.15.80:0/378698659 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa3bc06b010 0x7fa3bc0cc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:52.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.060+0000 7fa3bbfff700 1 -- 172.21.15.80:0/378698659 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa3bc06b010 msgr2=0x7fa3bc0cc8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:52.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.060+0000 7fa3bbfff700 1 --2- 172.21.15.80:0/378698659 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa3bc06b010 0x7fa3bc0cc8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:52.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.060+0000 7fa3bbfff700 1 -- 172.21.15.80:0/378698659 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3bc06ac30 msgr2=0x7fa3bc14b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:52.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.060+0000 7fa3bbfff700 1 --2- 172.21.15.80:0/378698659 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3bc06ac30 0x7fa3bc14b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:52.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.060+0000 7fa3bbfff700 1 -- 172.21.15.80:0/378698659 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3ac0094a0 con 0x7fa3bc1521d0 2024-05-08T21:10:52.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.060+0000 7fa3bbfff700 1 --2- 172.21.15.80:0/378698659 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3bc1521d0 0x7fa3bc0c76d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa3b400ca80 tx=0x7fa3b400ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:52.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.060+0000 7fa3a3fff700 1 -- 172.21.15.80:0/378698659 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b400aaa0 con 0x7fa3bc1521d0 2024-05-08T21:10:52.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.060+0000 7fa3a3fff700 1 -- 172.21.15.80:0/378698659 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3b400ac00 con 0x7fa3bc1521d0 2024-05-08T21:10:52.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.060+0000 7fa3c1e19700 1 -- 172.21.15.80:0/378698659 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3bc1ee5a0 con 0x7fa3bc1521d0 2024-05-08T21:10:52.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.060+0000 7fa3a3fff700 1 -- 172.21.15.80:0/378698659 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b4012400 con 0x7fa3bc1521d0 2024-05-08T21:10:52.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.060+0000 7fa3c1e19700 1 -- 172.21.15.80:0/378698659 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3bc1eeb60 con 0x7fa3bc1521d0 2024-05-08T21:10:52.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.061+0000 7fa3c1e19700 1 -- 172.21.15.80:0/378698659 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3bc150df0 con 0x7fa3bc1521d0 2024-05-08T21:10:52.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.062+0000 7fa3a3fff700 1 -- 172.21.15.80:0/378698659 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa3b401b3b0 con 0x7fa3bc1521d0 2024-05-08T21:10:52.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.062+0000 7fa3a3fff700 1 --2- 172.21.15.80:0/378698659 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fa3a806ac90 0x7fa3a806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:52.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.062+0000 7fa3a3fff700 1 -- 172.21.15.80:0/378698659 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa3b4089360 con 0x7fa3bc1521d0 2024-05-08T21:10:52.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.062+0000 7fa3bb7fe700 1 --2- 172.21.15.80:0/378698659 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fa3a806ac90 0x7fa3a806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:52.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.063+0000 7fa3bb7fe700 1 --2- 172.21.15.80:0/378698659 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fa3a806ac90 0x7fa3a806d150 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0000f60 tx=0x7fa3b0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:52.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.067+0000 7fa3a3fff700 1 -- 172.21.15.80:0/378698659 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fa3b40541d0 con 0x7fa3bc1521d0 2024-05-08T21:10:52.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.264+0000 7fa3c1e19700 1 -- 172.21.15.80:0/378698659 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa3bc04ec60 con 0x7fa3bc1521d0 2024-05-08T21:10:52.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.264+0000 7fa3a3fff700 1 -- 172.21.15.80:0/378698659 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa3b4017020 con 0x7fa3bc1521d0 2024-05-08T21:10:52.267 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-05-08T21:10:52.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.266+0000 7fa3c1e19700 1 -- 172.21.15.80:0/378698659 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fa3a806ac90 msgr2=0x7fa3a806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:52.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.266+0000 7fa3c1e19700 1 --2- 172.21.15.80:0/378698659 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fa3a806ac90 0x7fa3a806d150 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0000f60 tx=0x7fa3b0009040 comp rx=0 tx=0).stop 2024-05-08T21:10:52.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.266+0000 7fa3c1e19700 1 -- 172.21.15.80:0/378698659 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3bc1521d0 msgr2=0x7fa3bc0c76d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:52.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.266+0000 7fa3c1e19700 1 --2- 172.21.15.80:0/378698659 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3bc1521d0 0x7fa3bc0c76d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa3b400ca80 tx=0x7fa3b400ce40 comp rx=0 tx=0).stop 2024-05-08T21:10:52.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.266+0000 7fa3c1e19700 1 -- 172.21.15.80:0/378698659 shutdown_connections 2024-05-08T21:10:52.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.266+0000 7fa3c1e19700 1 --2- 172.21.15.80:0/378698659 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fa3a806ac90 0x7fa3a806d150 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:52.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.266+0000 7fa3c1e19700 1 --2- 172.21.15.80:0/378698659 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3bc1521d0 0x7fa3bc0c76d0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:52.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.266+0000 7fa3c1e19700 1 --2- 172.21.15.80:0/378698659 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3bc06ac30 0x7fa3bc14b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:52.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.266+0000 7fa3c1e19700 1 --2- 172.21.15.80:0/378698659 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa3bc06b010 0x7fa3bc0cc8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:52.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.266+0000 7fa3c1e19700 1 -- 172.21.15.80:0/378698659 >> 172.21.15.80:0/378698659 conn(0x7fa3bc06f140 msgr2=0x7fa3bc151210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:52.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.266+0000 7fa3c1e19700 1 -- 172.21.15.80:0/378698659 shutdown_connections 2024-05-08T21:10:52.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.266+0000 7fa3c1e19700 1 -- 172.21.15.80:0/378698659 wait complete. 2024-05-08T21:10:52.281 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-08T21:10:52.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.403+0000 7f09d49fe700 1 Processor -- start 2024-05-08T21:10:52.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.403+0000 7f09d49fe700 1 -- start start 2024-05-08T21:10:52.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.404+0000 7f09d49fe700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f09d00c0ea0 0x7f09d00c1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:52.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.404+0000 7f09d49fe700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f09d00c1ac0 0x7f09d006bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:52.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.404+0000 7f09d49fe700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09d00706c0 con 0x7f09d0151100 2024-05-08T21:10:52.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.404+0000 7f09d49fe700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09d00718c0 con 0x7f09d00c0ea0 2024-05-08T21:10:52.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.404+0000 7f09d49fe700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09d01514e0 con 0x7f09d00c1ac0 2024-05-08T21:10:52.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.404+0000 7f09ced9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f09d0151100 0x7f09d00b18b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34930/0 (socket says 172.21.15.80:34930) 2024-05-08T21:10:52.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.404+0000 7f09ced9d700 1 -- 172.21.15.80:0/1984488406 learned_addr learned my addr 172.21.15.80:0/1984488406 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:10:52.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.404+0000 7f09cdd9b700 1 -- 172.21.15.80:0/1984488406 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 80003703 0 0) 0x7f09d00706c0 con 0x7f09d0151100 2024-05-08T21:10:52.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.404+0000 7f09cf59e700 1 --2- 172.21.15.80:0/1984488406 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f09d00c1ac0 0x7f09d006bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:52.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.404+0000 7f09ce59c700 1 --2- 172.21.15.80:0/1984488406 >> v2:172.21.15.106:3300/0 conn(0x7f09d00c0ea0 0x7f09d00c1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:52.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.404+0000 7f09cdd9b700 1 -- 172.21.15.80:0/1984488406 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09b80057c0 con 0x7f09d0151100 2024-05-08T21:10:52.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.405+0000 7f09cdd9b700 1 -- 172.21.15.80:0/1984488406 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4161641673 0 0) 0x7f09b80057c0 con 0x7f09d0151100 2024-05-08T21:10:52.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.405+0000 7f09cdd9b700 1 -- 172.21.15.80:0/1984488406 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f09d00c1ac0 msgr2=0x7f09d006bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:52.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.405+0000 7f09cdd9b700 1 --2- 172.21.15.80:0/1984488406 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f09d00c1ac0 0x7f09d006bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:52.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.405+0000 7f09cdd9b700 1 -- 172.21.15.80:0/1984488406 >> v2:172.21.15.106:3300/0 conn(0x7f09d00c0ea0 msgr2=0x7f09d00c1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:52.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.405+0000 7f09cdd9b700 1 --2- 172.21.15.80:0/1984488406 >> v2:172.21.15.106:3300/0 conn(0x7f09d00c0ea0 0x7f09d00c1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:52.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.405+0000 7f09cdd9b700 1 -- 172.21.15.80:0/1984488406 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d0072c00 con 0x7f09d0151100 2024-05-08T21:10:52.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.405+0000 7f09cdd9b700 1 -- 172.21.15.80:0/1984488406 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3520646302 0 0) 0x7f09c0001670 con 0x7f09d0151100 2024-05-08T21:10:52.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.405+0000 7f09cdd9b700 1 -- 172.21.15.80:0/1984488406 >> v1:172.21.15.80:6789/0 conn(0x7f09d0151100 legacy=0x7f09d00b18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:52.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.405+0000 7f09cdd9b700 1 --2- 172.21.15.80:0/1984488406 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f09d00c1ac0 0x7f09b8005c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:52.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.405+0000 7f09cdd9b700 1 --2- 172.21.15.80:0/1984488406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09b8006190 0x7f09b8006a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:52.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.405+0000 7f09cdd9b700 1 --2- 172.21.15.80:0/1984488406 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f09b8006fa0 0x7f09b8007420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:52.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.405+0000 7f09cdd9b700 1 -- 172.21.15.80:0/1984488406 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d01514e0 con 0x7f09b8006190 2024-05-08T21:10:52.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.405+0000 7f09cdd9b700 1 -- 172.21.15.80:0/1984488406 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09b800dc20 con 0x7f09b8006fa0 2024-05-08T21:10:52.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.405+0000 7f09cdd9b700 1 -- 172.21.15.80:0/1984488406 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09b800dd90 con 0x7f09d00c1ac0 2024-05-08T21:10:52.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.405+0000 7f09ce59c700 1 --2- 172.21.15.80:0/1984488406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09b8006190 0x7f09b8006a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:52.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.405+0000 7f09ced9d700 1 --2- 172.21.15.80:0/1984488406 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f09d00c1ac0 0x7f09b8005c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:52.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.405+0000 7f09cf59e700 1 --2- 172.21.15.80:0/1984488406 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f09b8006fa0 0x7f09b8007420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:52.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.405+0000 7f09ce59c700 1 -- 172.21.15.80:0/1984488406 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f09d00c1ac0 msgr2=0x7f09b8005c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:52.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.405+0000 7f09ce59c700 1 --2- 172.21.15.80:0/1984488406 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f09d00c1ac0 0x7f09b8005c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:52.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.405+0000 7f09ce59c700 1 -- 172.21.15.80:0/1984488406 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f09b8006fa0 msgr2=0x7f09b8007420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:52.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.405+0000 7f09ce59c700 1 --2- 172.21.15.80:0/1984488406 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f09b8006fa0 0x7f09b8007420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:52.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.405+0000 7f09ce59c700 1 -- 172.21.15.80:0/1984488406 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b80057c0 con 0x7f09b8006190 2024-05-08T21:10:52.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.405+0000 7f09ce59c700 1 --2- 172.21.15.80:0/1984488406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09b8006190 0x7f09b8006a60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f09c4009b60 tx=0x7f09b8007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=692629846c4881e7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:52.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.405+0000 7f09cdd9b700 1 -- 172.21.15.80:0/1984488406 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c400e6c0 con 0x7f09b8006190 2024-05-08T21:10:52.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.405+0000 7f09cdd9b700 1 -- 172.21.15.80:0/1984488406 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09c400e820 con 0x7f09b8006190 2024-05-08T21:10:52.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.405+0000 7f09cdd9b700 1 -- 172.21.15.80:0/1984488406 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c400eb90 con 0x7f09b8006190 2024-05-08T21:10:52.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.406+0000 7f09d49fe700 1 -- 172.21.15.80:0/1984488406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09b8006190 msgr2=0x7f09b8006a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:52.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.406+0000 7f09d49fe700 1 --2- 172.21.15.80:0/1984488406 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09b8006190 0x7f09b8006a60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f09c4009b60 tx=0x7f09b8007a90 comp rx=0 tx=0).stop 2024-05-08T21:10:52.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.406+0000 7f09cf59e700 1 -- 172.21.15.80:0/1984488406 reap_dead start 2024-05-08T21:10:52.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.406+0000 7f09d49fe700 1 -- 172.21.15.80:0/1984488406 shutdown_connections 2024-05-08T21:10:52.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.406+0000 7f09d49fe700 1 -- 172.21.15.80:0/1984488406 >> 172.21.15.80:0/1984488406 conn(0x7f09d006eb20 msgr2=0x7f09d00cbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:52.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.406+0000 7f09d49fe700 1 -- 172.21.15.80:0/1984488406 shutdown_connections 2024-05-08T21:10:52.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.406+0000 7f09d49fe700 1 -- 172.21.15.80:0/1984488406 wait complete. 2024-05-08T21:10:52.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.407+0000 7f09d49fe700 1 Processor -- start 2024-05-08T21:10:52.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.408+0000 7f09d49fe700 1 -- start start 2024-05-08T21:10:52.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.408+0000 7f09d49fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09b8006190 0x7f09d00cad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:52.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.408+0000 7f09d49fe700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f09d01e2320 0x7f09d00c3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:52.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.408+0000 7f09d49fe700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f09d00c40e0 0x7f09d0145390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:52.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.408+0000 7f09d49fe700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d00c4c40 con 0x7f09b8006190 2024-05-08T21:10:52.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.408+0000 7f09d49fe700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d00c3780 con 0x7f09d01e2320 2024-05-08T21:10:52.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.408+0000 7f09d49fe700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09d01ec150 con 0x7f09d00c40e0 2024-05-08T21:10:52.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.408+0000 7f09ced9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09b8006190 0x7f09d00cad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:52.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.408+0000 7f09ced9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09b8006190 0x7f09d00cad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:56510/0 (socket says 172.21.15.80:56510) 2024-05-08T21:10:52.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.408+0000 7f09ced9d700 1 -- 172.21.15.80:0/206758378 learned_addr learned my addr 172.21.15.80:0/206758378 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:52.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.409+0000 7f09cf59e700 1 --2- 172.21.15.80:0/206758378 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f09d00c40e0 0x7f09d0145390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:52.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.409+0000 7f09ce59c700 1 --2- 172.21.15.80:0/206758378 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f09d01e2320 0x7f09d00c3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:52.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.409+0000 7f09ced9d700 1 -- 172.21.15.80:0/206758378 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f09d00c40e0 msgr2=0x7f09d0145390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:52.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.409+0000 7f09ced9d700 1 --2- 172.21.15.80:0/206758378 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f09d00c40e0 0x7f09d0145390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:52.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.409+0000 7f09ced9d700 1 -- 172.21.15.80:0/206758378 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f09d01e2320 msgr2=0x7f09d00c3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:52.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.409+0000 7f09ced9d700 1 --2- 172.21.15.80:0/206758378 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f09d01e2320 0x7f09d00c3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:52.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.409+0000 7f09ced9d700 1 -- 172.21.15.80:0/206758378 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d01ec680 con 0x7f09b8006190 2024-05-08T21:10:52.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.409+0000 7f09ce59c700 1 --2- 172.21.15.80:0/206758378 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f09d01e2320 0x7f09d00c3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:10:52.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.409+0000 7f09ced9d700 1 --2- 172.21.15.80:0/206758378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09b8006190 0x7f09d00cad20 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f09c0007370 tx=0x7f09c0007680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:52.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.409+0000 7f09b77fe700 1 -- 172.21.15.80:0/206758378 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c0007ca0 con 0x7f09b8006190 2024-05-08T21:10:52.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.409+0000 7f09b77fe700 1 -- 172.21.15.80:0/206758378 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09c000f870 con 0x7f09b8006190 2024-05-08T21:10:52.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.409+0000 7f09b77fe700 1 -- 172.21.15.80:0/206758378 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c000fc20 con 0x7f09b8006190 2024-05-08T21:10:52.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.409+0000 7f09d49fe700 1 -- 172.21.15.80:0/206758378 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09d00c5ab0 con 0x7f09b8006190 2024-05-08T21:10:52.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.409+0000 7f09d49fe700 1 -- 172.21.15.80:0/206758378 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09d00c5d20 con 0x7f09b8006190 2024-05-08T21:10:52.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.410+0000 7f09d49fe700 1 -- 172.21.15.80:0/206758378 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09d00c44c0 con 0x7f09b8006190 2024-05-08T21:10:52.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.410+0000 7f09b77fe700 1 -- 172.21.15.80:0/206758378 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f09c000fd80 con 0x7f09b8006190 2024-05-08T21:10:52.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.411+0000 7f09b77fe700 1 --2- 172.21.15.80:0/206758378 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f09bc06ac90 0x7f09bc06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:52.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.411+0000 7f09b77fe700 1 -- 172.21.15.80:0/206758378 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f09c0088d50 con 0x7f09b8006190 2024-05-08T21:10:52.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.411+0000 7f09ce59c700 1 --2- 172.21.15.80:0/206758378 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f09bc06ac90 0x7f09bc06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:52.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.411+0000 7f09ce59c700 1 --2- 172.21.15.80:0/206758378 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f09bc06ac90 0x7f09bc06d150 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f09d014e4b0 tx=0x7f09c4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:52.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.415+0000 7f09b77fe700 1 -- 172.21.15.80:0/206758378 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f09d00c44c0 con 0x7f09b8006190 2024-05-08T21:10:52.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.623+0000 7f09d49fe700 1 -- 172.21.15.80:0/206758378 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f09d00c44c0 con 0x7f09b8006190 2024-05-08T21:10:52.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.623+0000 7f09b77fe700 1 -- 172.21.15.80:0/206758378 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f09d00c44c0 con 0x7f09b8006190 2024-05-08T21:10:52.626 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-05-08T21:10:52.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.625+0000 7f09d49fe700 1 -- 172.21.15.80:0/206758378 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f09bc06ac90 msgr2=0x7f09bc06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:52.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.625+0000 7f09d49fe700 1 --2- 172.21.15.80:0/206758378 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f09bc06ac90 0x7f09bc06d150 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f09d014e4b0 tx=0x7f09c4008030 comp rx=0 tx=0).stop 2024-05-08T21:10:52.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.625+0000 7f09d49fe700 1 -- 172.21.15.80:0/206758378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09b8006190 msgr2=0x7f09d00cad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:52.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.625+0000 7f09d49fe700 1 --2- 172.21.15.80:0/206758378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09b8006190 0x7f09d00cad20 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f09c0007370 tx=0x7f09c0007680 comp rx=0 tx=0).stop 2024-05-08T21:10:52.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.625+0000 7f09d49fe700 1 -- 172.21.15.80:0/206758378 shutdown_connections 2024-05-08T21:10:52.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.625+0000 7f09d49fe700 1 --2- 172.21.15.80:0/206758378 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f09bc06ac90 0x7f09bc06d150 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:52.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.625+0000 7f09d49fe700 1 --2- 172.21.15.80:0/206758378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09b8006190 0x7f09d00cad20 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:52.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.625+0000 7f09d49fe700 1 --2- 172.21.15.80:0/206758378 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f09d00c40e0 0x7f09d0145390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:52.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.625+0000 7f09d49fe700 1 --2- 172.21.15.80:0/206758378 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f09d01e2320 0x7f09d00c3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:52.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.625+0000 7f09d49fe700 1 -- 172.21.15.80:0/206758378 >> 172.21.15.80:0/206758378 conn(0x7f09d006eb20 msgr2=0x7f09d014e500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:52.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.626+0000 7f09d49fe700 1 -- 172.21.15.80:0/206758378 shutdown_connections 2024-05-08T21:10:52.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.626+0000 7f09d49fe700 1 -- 172.21.15.80:0/206758378 wait complete. 2024-05-08T21:10:52.640 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:10:52.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.759+0000 7f6e4c2c5700 1 Processor -- start 2024-05-08T21:10:52.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.760+0000 7f6e4c2c5700 1 -- start start 2024-05-08T21:10:52.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.760+0000 7f6e4c2c5700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6e441544f0 0x7f6e440c8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:52.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.760+0000 7f6e4c2c5700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e440c6db0 0x7f6e4415a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:52.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.761+0000 7f6e4c2c5700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e440c56d0 con 0x7f6e440c5890 2024-05-08T21:10:52.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.761+0000 7f6e4c2c5700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e440c4ae0 con 0x7f6e441544f0 2024-05-08T21:10:52.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.761+0000 7f6e4c2c5700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e440c6920 con 0x7f6e440c6db0 2024-05-08T21:10:52.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.761+0000 7f6e4a061700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6e441544f0 0x7f6e440c8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:52.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.761+0000 7f6e4a061700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6e441544f0 0x7f6e440c8240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:56522/0 (socket says 172.21.15.80:56522) 2024-05-08T21:10:52.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.761+0000 7f6e4a061700 1 -- 172.21.15.80:0/2710694827 learned_addr learned my addr 172.21.15.80:0/2710694827 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:52.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.761+0000 7f6e49860700 1 --2- 172.21.15.80:0/2710694827 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e440c6db0 0x7f6e4415a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:52.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.761+0000 7f6e4a061700 1 -- 172.21.15.80:0/2710694827 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e440c6db0 msgr2=0x7f6e4415a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:52.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.761+0000 7f6e4a061700 1 --2- 172.21.15.80:0/2710694827 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e440c6db0 0x7f6e4415a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:52.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.761+0000 7f6e4a061700 1 -- 172.21.15.80:0/2710694827 >> v1:172.21.15.106:6789/0 conn(0x7f6e440c5890 legacy=0x7f6e4415d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:52.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.761+0000 7f6e4a061700 1 -- 172.21.15.80:0/2710694827 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e440cb270 con 0x7f6e441544f0 2024-05-08T21:10:52.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.761+0000 7f6e4a061700 1 --2- 172.21.15.80:0/2710694827 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e441544f0 0x7f6e440c8240 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6e340098f0 tx=0x7f6e34009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ddedc156d0c6812 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:52.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.761+0000 7f6e4905f700 1 -- 172.21.15.80:0/2710694827 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e34004230 con 0x7f6e441544f0 2024-05-08T21:10:52.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.761+0000 7f6e4905f700 1 -- 172.21.15.80:0/2710694827 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e34004390 con 0x7f6e441544f0 2024-05-08T21:10:52.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.761+0000 7f6e4905f700 1 -- 172.21.15.80:0/2710694827 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e340036a0 con 0x7f6e441544f0 2024-05-08T21:10:52.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.762+0000 7f6e4c2c5700 1 -- 172.21.15.80:0/2710694827 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e441544f0 msgr2=0x7f6e440c8240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:52.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.762+0000 7f6e4c2c5700 1 --2- 172.21.15.80:0/2710694827 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e441544f0 0x7f6e440c8240 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6e340098f0 tx=0x7f6e34009c00 comp rx=0 tx=0).stop 2024-05-08T21:10:52.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.762+0000 7f6e4c2c5700 1 -- 172.21.15.80:0/2710694827 shutdown_connections 2024-05-08T21:10:52.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.762+0000 7f6e4c2c5700 1 --2- 172.21.15.80:0/2710694827 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e441544f0 0x7f6e440c8240 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:52.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.762+0000 7f6e4c2c5700 1 --2- 172.21.15.80:0/2710694827 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e440c6db0 0x7f6e4415a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:52.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.762+0000 7f6e4c2c5700 1 -- 172.21.15.80:0/2710694827 >> 172.21.15.80:0/2710694827 conn(0x7f6e440ca340 msgr2=0x7f6e440ca750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:52.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.762+0000 7f6e4c2c5700 1 -- 172.21.15.80:0/2710694827 shutdown_connections 2024-05-08T21:10:52.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.762+0000 7f6e4c2c5700 1 -- 172.21.15.80:0/2710694827 wait complete. 2024-05-08T21:10:52.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.763+0000 7f6e4c2c5700 1 Processor -- start 2024-05-08T21:10:52.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.763+0000 7f6e4c2c5700 1 -- start start 2024-05-08T21:10:52.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.764+0000 7f6e4c2c5700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e440c5890 0x7f6e44156350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:52.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.764+0000 7f6e4c2c5700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e440c6db0 0x7f6e441efce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:52.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.764+0000 7f6e4c2c5700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6e441544f0 0x7f6e441f0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:52.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.764+0000 7f6e4c2c5700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4415df50 con 0x7f6e440c5890 2024-05-08T21:10:52.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.764+0000 7f6e4c2c5700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e441f3e20 con 0x7f6e441544f0 2024-05-08T21:10:52.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.764+0000 7f6e4c2c5700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e441f0760 con 0x7f6e440c6db0 2024-05-08T21:10:52.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.764+0000 7f6e4a061700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e440c5890 0x7f6e44156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:52.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.764+0000 7f6e4a061700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e440c5890 0x7f6e44156350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:56534/0 (socket says 172.21.15.80:56534) 2024-05-08T21:10:52.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.764+0000 7f6e4a061700 1 -- 172.21.15.80:0/3423331444 learned_addr learned my addr 172.21.15.80:0/3423331444 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:52.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.764+0000 7f6e49860700 1 --2- 172.21.15.80:0/3423331444 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e440c6db0 0x7f6e441efce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:52.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.764+0000 7f6e4a862700 1 --2- 172.21.15.80:0/3423331444 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6e441544f0 0x7f6e441f0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:52.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.764+0000 7f6e4a061700 1 -- 172.21.15.80:0/3423331444 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e440c6db0 msgr2=0x7f6e441efce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:52.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.764+0000 7f6e4a061700 1 --2- 172.21.15.80:0/3423331444 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e440c6db0 0x7f6e441efce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:52.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.764+0000 7f6e4a061700 1 -- 172.21.15.80:0/3423331444 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6e441544f0 msgr2=0x7f6e441f0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:52.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.764+0000 7f6e4a061700 1 --2- 172.21.15.80:0/3423331444 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6e441544f0 0x7f6e441f0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:52.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.764+0000 7f6e4a061700 1 -- 172.21.15.80:0/3423331444 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e34009550 con 0x7f6e440c5890 2024-05-08T21:10:52.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.764+0000 7f6e4a061700 1 --2- 172.21.15.80:0/3423331444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e440c5890 0x7f6e44156350 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6e34009840 tx=0x7f6e34004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:52.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.764+0000 7f6e3affd700 1 -- 172.21.15.80:0/3423331444 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3400b660 con 0x7f6e440c5890 2024-05-08T21:10:52.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.764+0000 7f6e3affd700 1 -- 172.21.15.80:0/3423331444 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e3400b7e0 con 0x7f6e440c5890 2024-05-08T21:10:52.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.764+0000 7f6e4c2c5700 1 -- 172.21.15.80:0/3423331444 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e441f3250 con 0x7f6e440c5890 2024-05-08T21:10:52.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.765+0000 7f6e3affd700 1 -- 172.21.15.80:0/3423331444 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3400bb90 con 0x7f6e440c5890 2024-05-08T21:10:52.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.765+0000 7f6e4c2c5700 1 -- 172.21.15.80:0/3423331444 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e44157920 con 0x7f6e440c5890 2024-05-08T21:10:52.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.765+0000 7f6e4c2c5700 1 -- 172.21.15.80:0/3423331444 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e441f4100 con 0x7f6e440c5890 2024-05-08T21:10:52.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.766+0000 7f6e3affd700 1 -- 172.21.15.80:0/3423331444 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6e3400bcf0 con 0x7f6e440c5890 2024-05-08T21:10:52.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.766+0000 7f6e3affd700 1 --2- 172.21.15.80:0/3423331444 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f6e2806acc0 0x7f6e2806d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:52.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.766+0000 7f6e3affd700 1 -- 172.21.15.80:0/3423331444 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6e3408a750 con 0x7f6e440c5890 2024-05-08T21:10:52.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.766+0000 7f6e49860700 1 --2- 172.21.15.80:0/3423331444 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f6e2806acc0 0x7f6e2806d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:52.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.767+0000 7f6e49860700 1 --2- 172.21.15.80:0/3423331444 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f6e2806acc0 0x7f6e2806d180 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6e4415e7b0 tx=0x7f6e40008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:52.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:52.771+0000 7f6e3affd700 1 -- 172.21.15.80:0/3423331444 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f6e34055570 con 0x7f6e440c5890 2024-05-08T21:10:53.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.010+0000 7f6e4c2c5700 1 -- 172.21.15.80:0/3423331444 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6e440c7b10 con 0x7f6e440c5890 2024-05-08T21:10:53.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.011+0000 7f6e3affd700 1 -- 172.21.15.80:0/3423331444 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6254 (secure 0 0 0) 0x7f6e34058b90 con 0x7f6e440c5890 2024-05-08T21:10:53.013 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:10:53.013 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/2289230272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":2289230272},{"type":"v1","addr":"172.21.15.106:6833","nonce":2289230272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:10:31.304591+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.106:6836/1949999190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1949999190},{"type":"v1","addr":"172.21.15.106:6836","nonce":1949999190}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:10:53.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.013+0000 7f6e4c2c5700 1 -- 172.21.15.80:0/3423331444 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f6e2806acc0 msgr2=0x7f6e2806d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:53.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.013+0000 7f6e4c2c5700 1 --2- 172.21.15.80:0/3423331444 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f6e2806acc0 0x7f6e2806d180 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6e4415e7b0 tx=0x7f6e40008040 comp rx=0 tx=0).stop 2024-05-08T21:10:53.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.013+0000 7f6e4c2c5700 1 -- 172.21.15.80:0/3423331444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e440c5890 msgr2=0x7f6e44156350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:53.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.013+0000 7f6e4c2c5700 1 --2- 172.21.15.80:0/3423331444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e440c5890 0x7f6e44156350 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6e34009840 tx=0x7f6e34004750 comp rx=0 tx=0).stop 2024-05-08T21:10:53.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.013+0000 7f6e4c2c5700 1 -- 172.21.15.80:0/3423331444 shutdown_connections 2024-05-08T21:10:53.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.013+0000 7f6e4c2c5700 1 --2- 172.21.15.80:0/3423331444 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f6e2806acc0 0x7f6e2806d180 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:53.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.013+0000 7f6e4c2c5700 1 --2- 172.21.15.80:0/3423331444 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e440c5890 0x7f6e44156350 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:53.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.013+0000 7f6e4c2c5700 1 --2- 172.21.15.80:0/3423331444 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6e441544f0 0x7f6e441f0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:53.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.013+0000 7f6e4c2c5700 1 --2- 172.21.15.80:0/3423331444 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e440c6db0 0x7f6e441efce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:53.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.013+0000 7f6e4c2c5700 1 -- 172.21.15.80:0/3423331444 >> 172.21.15.80:0/3423331444 conn(0x7f6e440ca340 msgr2=0x7f6e4414fa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:53.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.013+0000 7f6e4c2c5700 1 -- 172.21.15.80:0/3423331444 shutdown_connections 2024-05-08T21:10:53.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.013+0000 7f6e4c2c5700 1 -- 172.21.15.80:0/3423331444 wait complete. 2024-05-08T21:10:53.017 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 10 2024-05-08T21:10:53.027 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T21:10:53.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.146+0000 7f83bdcd1700 1 Processor -- start 2024-05-08T21:10:53.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.146+0000 7f83bdcd1700 1 -- start start 2024-05-08T21:10:53.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.147+0000 7f83bdcd1700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f83b81520b0 0x7f83b8158810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:53.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.147+0000 7f83bdcd1700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f83b80cbba0 0x7f83b80cbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:53.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.147+0000 7f83bdcd1700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83b815b6d0 con 0x7f83b8158d50 2024-05-08T21:10:53.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.147+0000 7f83bdcd1700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83b81580e0 con 0x7f83b80cbba0 2024-05-08T21:10:53.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.147+0000 7f83bdcd1700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83b80cc500 con 0x7f83b81520b0 2024-05-08T21:10:53.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.147+0000 7f83b77fe700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f83b81520b0 0x7f83b8158810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:53.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.147+0000 7f83b7fff700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f83b80cbba0 0x7f83b80cbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:53.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.148+0000 7f83b77fe700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f83b81520b0 0x7f83b8158810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:39920/0 (socket says 172.21.15.80:39920) 2024-05-08T21:10:53.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.148+0000 7f83b77fe700 1 -- 172.21.15.80:0/161569341 learned_addr learned my addr 172.21.15.80:0/161569341 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:53.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.148+0000 7f83b7fff700 1 -- 172.21.15.80:0/161569341 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f83b81520b0 msgr2=0x7f83b8158810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:10:53.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.148+0000 7f83b7fff700 1 --2- 172.21.15.80:0/161569341 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f83b81520b0 0x7f83b8158810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:53.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.148+0000 7f83b7fff700 1 -- 172.21.15.80:0/161569341 >> v1:172.21.15.106:6789/0 conn(0x7f83b8158d50 legacy=0x7f83b8072d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:53.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.148+0000 7f83b7fff700 1 -- 172.21.15.80:0/161569341 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b815c650 con 0x7f83b80cbba0 2024-05-08T21:10:53.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.148+0000 7f83b77fe700 1 --2- 172.21.15.80:0/161569341 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f83b81520b0 0x7f83b8158810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:10:53.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.148+0000 7f83b7fff700 1 --2- 172.21.15.80:0/161569341 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f83b80cbba0 0x7f83b80cbfc0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f83b0009d90 tx=0x7f83b000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e083662b234741dc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:53.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.148+0000 7f83b67fc700 1 -- 172.21.15.80:0/161569341 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b000e070 con 0x7f83b80cbba0 2024-05-08T21:10:53.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.148+0000 7f83b67fc700 1 -- 172.21.15.80:0/161569341 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b000bb20 con 0x7f83b80cbba0 2024-05-08T21:10:53.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.148+0000 7f83b67fc700 1 -- 172.21.15.80:0/161569341 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b0012430 con 0x7f83b80cbba0 2024-05-08T21:10:53.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.149+0000 7f83bdcd1700 1 -- 172.21.15.80:0/161569341 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f83b80cbba0 msgr2=0x7f83b80cbfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:53.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.149+0000 7f83bdcd1700 1 --2- 172.21.15.80:0/161569341 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f83b80cbba0 0x7f83b80cbfc0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f83b0009d90 tx=0x7f83b000b330 comp rx=0 tx=0).stop 2024-05-08T21:10:53.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.149+0000 7f83bdcd1700 1 -- 172.21.15.80:0/161569341 shutdown_connections 2024-05-08T21:10:53.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.149+0000 7f83bdcd1700 1 --2- 172.21.15.80:0/161569341 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f83b80cbba0 0x7f83b80cbfc0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:53.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.149+0000 7f83bdcd1700 1 --2- 172.21.15.80:0/161569341 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f83b81520b0 0x7f83b8158810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:53.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.149+0000 7f83bdcd1700 1 -- 172.21.15.80:0/161569341 >> 172.21.15.80:0/161569341 conn(0x7f83b8066780 msgr2=0x7f83b8066b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:53.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.149+0000 7f83bdcd1700 1 -- 172.21.15.80:0/161569341 shutdown_connections 2024-05-08T21:10:53.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.149+0000 7f83bdcd1700 1 -- 172.21.15.80:0/161569341 wait complete. 2024-05-08T21:10:53.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.150+0000 7f83bdcd1700 1 Processor -- start 2024-05-08T21:10:53.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.150+0000 7f83bdcd1700 1 -- start start 2024-05-08T21:10:53.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.151+0000 7f83bdcd1700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f83b80cbba0 0x7f83b80c8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:53.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.151+0000 7f83bdcd1700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f83b81520b0 0x7f83b80c9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:53.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.151+0000 7f83bdcd1700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83b8158d50 0x7f83b814c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:53.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.151+0000 7f83bdcd1700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b80c8990 con 0x7f83b8158d50 2024-05-08T21:10:53.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.151+0000 7f83bdcd1700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b80cce80 con 0x7f83b80cbba0 2024-05-08T21:10:53.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.151+0000 7f83bdcd1700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83b80cad20 con 0x7f83b81520b0 2024-05-08T21:10:53.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.151+0000 7f83b7fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83b8158d50 0x7f83b814c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:53.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.151+0000 7f83b7fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83b8158d50 0x7f83b814c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:56550/0 (socket says 172.21.15.80:56550) 2024-05-08T21:10:53.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.151+0000 7f83b7fff700 1 -- 172.21.15.80:0/1272014325 learned_addr learned my addr 172.21.15.80:0/1272014325 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:10:53.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.151+0000 7f83b77fe700 1 --2- 172.21.15.80:0/1272014325 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f83b80cbba0 0x7f83b80c8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:53.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.151+0000 7f83b6ffd700 1 --2- 172.21.15.80:0/1272014325 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f83b81520b0 0x7f83b80c9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:53.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.151+0000 7f83b7fff700 1 -- 172.21.15.80:0/1272014325 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f83b81520b0 msgr2=0x7f83b80c9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:53.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.152+0000 7f83b7fff700 1 --2- 172.21.15.80:0/1272014325 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f83b81520b0 0x7f83b80c9360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:53.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.152+0000 7f83b7fff700 1 -- 172.21.15.80:0/1272014325 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f83b80cbba0 msgr2=0x7f83b80c8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:53.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.152+0000 7f83b7fff700 1 --2- 172.21.15.80:0/1272014325 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f83b80cbba0 0x7f83b80c8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:53.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.152+0000 7f83b7fff700 1 -- 172.21.15.80:0/1272014325 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83ac009550 con 0x7f83b8158d50 2024-05-08T21:10:53.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.152+0000 7f83b6ffd700 1 --2- 172.21.15.80:0/1272014325 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f83b81520b0 0x7f83b80c9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:10:53.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.152+0000 7f83b7fff700 1 --2- 172.21.15.80:0/1272014325 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83b8158d50 0x7f83b814c330 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f83b0014040 tx=0x7f83b0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:53.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.152+0000 7f839ffff700 1 -- 172.21.15.80:0/1272014325 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b0012430 con 0x7f83b8158d50 2024-05-08T21:10:53.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.152+0000 7f839ffff700 1 -- 172.21.15.80:0/1272014325 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b0020070 con 0x7f83b8158d50 2024-05-08T21:10:53.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.152+0000 7f839ffff700 1 -- 172.21.15.80:0/1272014325 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b0004280 con 0x7f83b8158d50 2024-05-08T21:10:53.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.152+0000 7f83bdcd1700 1 -- 172.21.15.80:0/1272014325 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83b0009a70 con 0x7f83b8158d50 2024-05-08T21:10:53.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.152+0000 7f83bdcd1700 1 -- 172.21.15.80:0/1272014325 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83b80c8340 con 0x7f83b8158d50 2024-05-08T21:10:53.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.153+0000 7f83bdcd1700 1 -- 172.21.15.80:0/1272014325 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83b80c8b40 con 0x7f83b8158d50 2024-05-08T21:10:53.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.153+0000 7f839ffff700 1 -- 172.21.15.80:0/1272014325 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f83b00043e0 con 0x7f83b8158d50 2024-05-08T21:10:53.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.154+0000 7f839ffff700 1 --2- 172.21.15.80:0/1272014325 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f83a406ac90 0x7f83a406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:10:53.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.154+0000 7f839ffff700 1 -- 172.21.15.80:0/1272014325 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f83b0022070 con 0x7f83b8158d50 2024-05-08T21:10:53.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.154+0000 7f83b77fe700 1 --2- 172.21.15.80:0/1272014325 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f83a406ac90 0x7f83a406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:10:53.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.154+0000 7f83b77fe700 1 --2- 172.21.15.80:0/1272014325 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f83a406ac90 0x7f83a406d150 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f83ac009cf0 tx=0x7f83ac008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:10:53.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.158+0000 7f839ffff700 1 -- 172.21.15.80:0/1272014325 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f83b80c8b40 con 0x7f83b8158d50 2024-05-08T21:10:53.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.357+0000 7f83bdcd1700 1 -- 172.21.15.80:0/1272014325 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f83b804ec60 con 0x7f83b8158d50 2024-05-08T21:10:53.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.358+0000 7f839ffff700 1 -- 172.21.15.80:0/1272014325 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18268 (secure 0 0 0) 0x7f83b0056310 con 0x7f83b8158d50 2024-05-08T21:10:53.361 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:10:53.361 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":27,"fsid":"44d31c1e-aad3-47ca-a4fa-85a63d4a60aa","created":"2024-05-08T21:09:46.467038+0000","modified":"2024-05-08T21:10:52.455036+0000","last_up_change":"2024-05-08T21:09:57.284675+0000","last_in_change":"2024-05-08T21:09:49.125444+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T21:09:58.238951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T21:10:02.177476+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T21:10:02.685535+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-08T21:10:05.753779+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c3f9d93e-ed6d-4a0c-b5c0-0e8d44c65fdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":47011},{"type":"v1","addr":"172.21.15.80:6817","nonce":47011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":47011},{"type":"v1","addr":"172.21.15.80:6819","nonce":47011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":47011},{"type":"v1","addr":"172.21.15.80:6823","nonce":47011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":47011},{"type":"v1","addr":"172.21.15.80:6821","nonce":47011}]},"public_addr":"172.21.15.80:6817/47011","cluster_addr":"172.21.15.80:6819/47011","heartbeat_back_addr":"172.21.15.80:6823/47011","heartbeat_front_addr":"172.21.15.80:6821/47011","state":["exists","up"]},{"osd":1,"uuid":"4ce2b4d6-6c40-43aa-8dd1-743fef8915df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":47010},{"type":"v1","addr":"172.21.15.80:6809","nonce":47010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":47010},{"type":"v1","addr":"172.21.15.80:6811","nonce":47010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":47010},{"type":"v1","addr":"172.21.15.80:6815","nonce":47010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":47010},{"type":"v1","addr":"172.21.15.80:6813","nonce":47010}]},"public_addr":"172.21.15.80:6809/47010","cluster_addr":"172.21.15.80:6811/47010","heartbeat_back_addr":"172.21.15.80:6815/47010","heartbeat_front_addr":"172.21.15.80:6813/47010","state":["exists","up"]},{"osd":2,"uuid":"e30cc3bc-6461-4fac-960a-de00c9488d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":47009},{"type":"v1","addr":"172.21.15.80:6801","nonce":47009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":47009},{"type":"v1","addr":"172.21.15.80:6803","nonce":47009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":47009},{"type":"v1","addr":"172.21.15.80:6807","nonce":47009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":47009},{"type":"v1","addr":"172.21.15.80:6805","nonce":47009}]},"public_addr":"172.21.15.80:6801/47009","cluster_addr":"172.21.15.80:6803/47009","heartbeat_back_addr":"172.21.15.80:6807/47009","heartbeat_front_addr":"172.21.15.80:6805/47009","state":["exists","up"]},{"osd":3,"uuid":"a415c099-9ea6-40be-98ed-f2932f98dfd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":47012},{"type":"v1","addr":"172.21.15.80:6825","nonce":47012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":47012},{"type":"v1","addr":"172.21.15.80:6827","nonce":47012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":47012},{"type":"v1","addr":"172.21.15.80:6831","nonce":47012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":47012},{"type":"v1","addr":"172.21.15.80:6829","nonce":47012}]},"public_addr":"172.21.15.80:6825/47012","cluster_addr":"172.21.15.80:6827/47012","heartbeat_back_addr":"172.21.15.80:6831/47012","heartbeat_front_addr":"172.21.15.80:6829/47012","state":["exists","up"]},{"osd":4,"uuid":"5ae1d51f-0918-4571-b79b-154308d46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6823","nonce":47114},{"type":"v1","addr":"172.21.15.106:6825","nonce":47114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":47114},{"type":"v1","addr":"172.21.15.106:6827","nonce":47114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":47114},{"type":"v1","addr":"172.21.15.106:6831","nonce":47114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":47114},{"type":"v1","addr":"172.21.15.106:6829","nonce":47114}]},"public_addr":"172.21.15.106:6825/47114","cluster_addr":"172.21.15.106:6827/47114","heartbeat_back_addr":"172.21.15.106:6831/47114","heartbeat_front_addr":"172.21.15.106:6829/47114","state":["exists","up"]},{"osd":5,"uuid":"a19ac74e-4282-4428-b167-26ba6b92f732","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6807","nonce":47111},{"type":"v1","addr":"172.21.15.106:6809","nonce":47111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":47111},{"type":"v1","addr":"172.21.15.106:6811","nonce":47111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":47111},{"type":"v1","addr":"172.21.15.106:6815","nonce":47111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":47111},{"type":"v1","addr":"172.21.15.106:6813","nonce":47111}]},"public_addr":"172.21.15.106:6809/47111","cluster_addr":"172.21.15.106:6811/47111","heartbeat_back_addr":"172.21.15.106:6815/47111","heartbeat_front_addr":"172.21.15.106:6813/47111","state":["exists","up"]},{"osd":6,"uuid":"bfe72edd-7acc-4805-807d-2000e76f2feb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":47112},{"type":"v1","addr":"172.21.15.106:6817","nonce":47112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":47112},{"type":"v1","addr":"172.21.15.106:6819","nonce":47112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":47112},{"type":"v1","addr":"172.21.15.106:6824","nonce":47112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":47112},{"type":"v1","addr":"172.21.15.106:6821","nonce":47112}]},"public_addr":"172.21.15.106:6817/47112","cluster_addr":"172.21.15.106:6819/47112","heartbeat_back_addr":"172.21.15.106:6824/47112","heartbeat_front_addr":"172.21.15.106:6821/47112","state":["exists","up"]},{"osd":7,"uuid":"99897f22-ed17-4c7c-9088-cc0c4a51f786","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":47113},{"type":"v1","addr":"172.21.15.106:6801","nonce":47113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":47113},{"type":"v1","addr":"172.21.15.106:6803","nonce":47113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":47113},{"type":"v1","addr":"172.21.15.106:6808","nonce":47113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":47113},{"type":"v1","addr":"172.21.15.106:6805","nonce":47113}]},"public_addr":"172.21.15.106:6801/47113","cluster_addr":"172.21.15.106:6803/47113","heartbeat_back_addr":"172.21.15.106:6808/47113","heartbeat_front_addr":"172.21.15.106:6805/47113","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.232670+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.277753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.050087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.349312+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.344080+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.348781+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.352539+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.275013+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.27","mappings":[{"from":3,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T21:10:53.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.360+0000 7f83bdcd1700 1 -- 172.21.15.80:0/1272014325 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f83a406ac90 msgr2=0x7f83a406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:53.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.360+0000 7f83bdcd1700 1 --2- 172.21.15.80:0/1272014325 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f83a406ac90 0x7f83a406d150 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f83ac009cf0 tx=0x7f83ac008040 comp rx=0 tx=0).stop 2024-05-08T21:10:53.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.360+0000 7f83bdcd1700 1 -- 172.21.15.80:0/1272014325 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83b8158d50 msgr2=0x7f83b814c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:10:53.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.360+0000 7f83bdcd1700 1 --2- 172.21.15.80:0/1272014325 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83b8158d50 0x7f83b814c330 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f83b0014040 tx=0x7f83b0004ad0 comp rx=0 tx=0).stop 2024-05-08T21:10:53.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.360+0000 7f83bdcd1700 1 -- 172.21.15.80:0/1272014325 shutdown_connections 2024-05-08T21:10:53.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.360+0000 7f83bdcd1700 1 --2- 172.21.15.80:0/1272014325 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f83a406ac90 0x7f83a406d150 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:53.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.360+0000 7f83bdcd1700 1 --2- 172.21.15.80:0/1272014325 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83b8158d50 0x7f83b814c330 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:53.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.360+0000 7f83bdcd1700 1 --2- 172.21.15.80:0/1272014325 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f83b80cbba0 0x7f83b80c8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:53.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.360+0000 7f83bdcd1700 1 --2- 172.21.15.80:0/1272014325 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f83b81520b0 0x7f83b80c9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:10:53.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.360+0000 7f83bdcd1700 1 -- 172.21.15.80:0/1272014325 >> 172.21.15.80:0/1272014325 conn(0x7f83b8066780 msgr2=0x7f83b8151720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:10:53.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.360+0000 7f83bdcd1700 1 -- 172.21.15.80:0/1272014325 shutdown_connections 2024-05-08T21:10:53.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:10:53.360+0000 7f83bdcd1700 1 -- 172.21.15.80:0/1272014325 wait complete. 2024-05-08T21:10:53.375 DEBUG:tasks.mds_thrash:Yielding 2024-05-08T21:10:53.376 INFO:teuthology.run_tasks:Running task workunit... 2024-05-08T21:10:53.388 INFO:tasks.workunit:Pulling workunits from ref d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T21:10:53.389 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-05-08T21:10:53.389 INFO:tasks.workunit:timeout=3h 2024-05-08T21:10:53.389 INFO:tasks.workunit:cleanup=True 2024-05-08T21:10:53.389 DEBUG:teuthology.orchestra.run.smithi080:> stat -- /home/ubuntu/cephtest/mnt.0 2024-05-08T21:10:53.389 INFO:tasks.mds_thrash.fs.[cephfs]:starting mds_do_thrash for fs cephfs 2024-05-08T21:10:53.390 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 58 secs before thrashing 2024-05-08T21:10:53.407 INFO:teuthology.orchestra.run.smithi080.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-05-08T21:10:53.407 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-05-08T21:10:53.407 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 2fh/47d Inode: 1 Links: 2 2024-05-08T21:10:53.407 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T21:10:53.407 INFO:teuthology.orchestra.run.smithi080.stdout:Context: system_u:object_r:cephfs_t:s0 2024-05-08T21:10:53.407 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-05-08T21:10:53.407 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2024-05-08 21:10:08.729296265 +0000 2024-05-08T21:10:53.407 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2024-05-08 21:10:17.503795872 +0000 2024-05-08T21:10:53.407 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: 2024-05-08 21:10:08.729296265 +0000 2024-05-08T21:10:53.408 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-05-08T21:10:53.408 DEBUG:teuthology.orchestra.run.smithi080:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-05-08T21:10:53.489 DEBUG:teuthology.orchestra.run.smithi080:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T21:10:53.547 INFO:tasks.workunit.client.0.smithi080.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-05-08T21:11:10.286 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:11:10.289 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:11:40.354 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:11:40.356 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:11:51.390 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:11:51.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.535+0000 7fe1fdb19700 1 Processor -- start 2024-05-08T21:11:51.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.535+0000 7fe1fdb19700 1 -- start start 2024-05-08T21:11:51.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.535+0000 7fe1fdb19700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe1f80c2b60 0x7fe1f8158af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:11:51.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.536+0000 7fe1fdb19700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe1f80c8600 0x7fe1f815b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:11:51.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.536+0000 7fe1fdb19700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1f8072b20 con 0x7fe1f8152180 2024-05-08T21:11:51.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.536+0000 7fe1fdb19700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1f8072560 con 0x7fe1f80c8600 2024-05-08T21:11:51.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.536+0000 7fe1fdb19700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f8072840 con 0x7fe1f80c2b60 2024-05-08T21:11:51.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.536+0000 7fe1f7fff700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe1f80c8600 0x7fe1f815b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:11:51.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.536+0000 7fe1f6ffd700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe1f80c2b60 0x7fe1f8158af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:11:51.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.536+0000 7fe1f6ffd700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe1f80c2b60 0x7fe1f8158af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:54842/0 (socket says 172.21.15.80:54842) 2024-05-08T21:11:51.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.536+0000 7fe1f7fff700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe1f80c8600 0x7fe1f815b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.80:38518/0 (socket says 172.21.15.80:38518) 2024-05-08T21:11:51.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.536+0000 7fe1f6ffd700 1 -- 172.21.15.80:0/2812580734 learned_addr learned my addr 172.21.15.80:0/2812580734 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:11:51.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.536+0000 7fe1f6ffd700 1 -- 172.21.15.80:0/2812580734 >> v2:172.21.15.106:3300/0 conn(0x7fe1f80c8600 msgr2=0x7fe1f815b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:11:51.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.536+0000 7fe1f6ffd700 1 --2- 172.21.15.80:0/2812580734 >> v2:172.21.15.106:3300/0 conn(0x7fe1f80c8600 0x7fe1f815b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:11:51.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.536+0000 7fe1f6ffd700 1 -- 172.21.15.80:0/2812580734 >> v1:172.21.15.106:6789/0 conn(0x7fe1f8152180 legacy=0x7fe1f8072f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:11:51.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.536+0000 7fe1f6ffd700 1 -- 172.21.15.80:0/2812580734 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1f8158010 con 0x7fe1f80c2b60 2024-05-08T21:11:51.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.537+0000 7fe1f6ffd700 1 --2- 172.21.15.80:0/2812580734 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe1f80c2b60 0x7fe1f8158af0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec0098f0 tx=0x7fe1ec009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83a0935bb7d4bd82 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:11:51.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.537+0000 7fe1f67fc700 1 -- 172.21.15.80:0/2812580734 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ec011830 con 0x7fe1f80c2b60 2024-05-08T21:11:51.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.537+0000 7fe1f67fc700 1 -- 172.21.15.80:0/2812580734 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1ec011990 con 0x7fe1f80c2b60 2024-05-08T21:11:51.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.537+0000 7fe1f67fc700 1 -- 172.21.15.80:0/2812580734 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ec011d20 con 0x7fe1f80c2b60 2024-05-08T21:11:51.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.537+0000 7fe1fdb19700 1 -- 172.21.15.80:0/2812580734 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe1f80c2b60 msgr2=0x7fe1f8158af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:11:51.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.537+0000 7fe1fdb19700 1 --2- 172.21.15.80:0/2812580734 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe1f80c2b60 0x7fe1f8158af0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec0098f0 tx=0x7fe1ec009c00 comp rx=0 tx=0).stop 2024-05-08T21:11:51.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.537+0000 7fe1fdb19700 1 -- 172.21.15.80:0/2812580734 shutdown_connections 2024-05-08T21:11:51.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.537+0000 7fe1fdb19700 1 --2- 172.21.15.80:0/2812580734 >> v2:172.21.15.106:3300/0 conn(0x7fe1f80c8600 0x7fe1f815b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:11:51.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.537+0000 7fe1fdb19700 1 --2- 172.21.15.80:0/2812580734 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe1f80c2b60 0x7fe1f8158af0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:11:51.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.537+0000 7fe1fdb19700 1 -- 172.21.15.80:0/2812580734 >> 172.21.15.80:0/2812580734 conn(0x7fe1f806a9c0 msgr2=0x7fe1f806add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:11:51.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.537+0000 7fe1fdb19700 1 -- 172.21.15.80:0/2812580734 shutdown_connections 2024-05-08T21:11:51.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.537+0000 7fe1fdb19700 1 -- 172.21.15.80:0/2812580734 wait complete. 2024-05-08T21:11:51.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.539+0000 7fe1fdb19700 1 Processor -- start 2024-05-08T21:11:51.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.539+0000 7fe1fdb19700 1 -- start start 2024-05-08T21:11:51.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.540+0000 7fe1fdb19700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe1f80c2b60 0x7fe1f81451d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:11:51.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.540+0000 7fe1fdb19700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe1f80c8600 0x7fe1f8146c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:11:51.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.540+0000 7fe1fdb19700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1f8152180 0x7fe1f8153e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:11:51.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.540+0000 7fe1fdb19700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f81ee330 con 0x7fe1f80c2b60 2024-05-08T21:11:51.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.540+0000 7fe1fdb19700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f8145710 con 0x7fe1f8152180 2024-05-08T21:11:51.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.540+0000 7fe1fdb19700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f81eda60 con 0x7fe1f80c8600 2024-05-08T21:11:51.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.540+0000 7fe1f77fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe1f80c2b60 0x7fe1f81451d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:11:51.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.540+0000 7fe1f77fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe1f80c2b60 0x7fe1f81451d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58722/0 (socket says 172.21.15.80:58722) 2024-05-08T21:11:51.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.540+0000 7fe1f77fe700 1 -- 172.21.15.80:0/386506504 learned_addr learned my addr 172.21.15.80:0/386506504 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:11:51.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.540+0000 7fe1f6ffd700 1 --2- 172.21.15.80:0/386506504 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe1f80c8600 0x7fe1f8146c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:11:51.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.540+0000 7fe1f7fff700 1 --2- 172.21.15.80:0/386506504 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1f8152180 0x7fe1f8153e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:11:51.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.541+0000 7fe1f77fe700 1 -- 172.21.15.80:0/386506504 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe1f80c8600 msgr2=0x7fe1f8146c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:11:51.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.541+0000 7fe1f77fe700 1 --2- 172.21.15.80:0/386506504 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe1f80c8600 0x7fe1f8146c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:11:51.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.541+0000 7fe1f77fe700 1 -- 172.21.15.80:0/386506504 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1f8152180 msgr2=0x7fe1f8153e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:11:51.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.541+0000 7fe1f77fe700 1 --2- 172.21.15.80:0/386506504 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1f8152180 0x7fe1f8153e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:11:51.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.541+0000 7fe1f77fe700 1 -- 172.21.15.80:0/386506504 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1ec009550 con 0x7fe1f80c2b60 2024-05-08T21:11:51.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.541+0000 7fe1f6ffd700 1 --2- 172.21.15.80:0/386506504 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe1f80c8600 0x7fe1f8146c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:11:51.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.541+0000 7fe1f7fff700 1 --2- 172.21.15.80:0/386506504 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1f8152180 0x7fe1f8153e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:11:51.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.541+0000 7fe1f77fe700 1 --2- 172.21.15.80:0/386506504 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe1f80c2b60 0x7fe1f81451d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe1e800c450 tx=0x7fe1e800c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:11:51.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.541+0000 7fe1dffff700 1 -- 172.21.15.80:0/386506504 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e80052d0 con 0x7fe1f80c2b60 2024-05-08T21:11:51.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.541+0000 7fe1dffff700 1 -- 172.21.15.80:0/386506504 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e8005430 con 0x7fe1f80c2b60 2024-05-08T21:11:51.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.541+0000 7fe1dffff700 1 -- 172.21.15.80:0/386506504 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e80038c0 con 0x7fe1f80c2b60 2024-05-08T21:11:51.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.541+0000 7fe1fdb19700 1 -- 172.21.15.80:0/386506504 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1f81551d0 con 0x7fe1f80c2b60 2024-05-08T21:11:51.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.541+0000 7fe1fdb19700 1 -- 172.21.15.80:0/386506504 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1f81edce0 con 0x7fe1f80c2b60 2024-05-08T21:11:51.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.542+0000 7fe1fdb19700 1 -- 172.21.15.80:0/386506504 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1f8150690 con 0x7fe1f80c2b60 2024-05-08T21:11:51.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.543+0000 7fe1dffff700 1 -- 172.21.15.80:0/386506504 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe1e8003a20 con 0x7fe1f80c2b60 2024-05-08T21:11:51.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.544+0000 7fe1dffff700 1 --2- 172.21.15.80:0/386506504 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe1e406ac90 0x7fe1e406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:11:51.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.544+0000 7fe1dffff700 1 -- 172.21.15.80:0/386506504 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe1e8088970 con 0x7fe1f80c2b60 2024-05-08T21:11:51.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.544+0000 7fe1f6ffd700 1 --2- 172.21.15.80:0/386506504 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe1e406ac90 0x7fe1e406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:11:51.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.544+0000 7fe1f6ffd700 1 --2- 172.21.15.80:0/386506504 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe1e406ac90 0x7fe1e406d150 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec009c40 tx=0x7fe1ec008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:11:51.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.552+0000 7fe1dffff700 1 -- 172.21.15.80:0/386506504 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fe1e8053820 con 0x7fe1f80c2b60 2024-05-08T21:11:51.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.893+0000 7fe1fdb19700 1 -- 172.21.15.80:0/386506504 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe1f804ec60 con 0x7fe1f80c2b60 2024-05-08T21:11:51.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.894+0000 7fe1dffff700 1 -- 172.21.15.80:0/386506504 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6254 (secure 0 0 0) 0x7fe1e800ce60 con 0x7fe1f80c2b60 2024-05-08T21:11:51.898 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:11:51.898 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/2289230272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":2289230272},{"type":"v1","addr":"172.21.15.106:6833","nonce":2289230272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:10:31.304591+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.106:6836/1949999190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1949999190},{"type":"v1","addr":"172.21.15.106:6836","nonce":1949999190}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:11:51.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.897+0000 7fe1fdb19700 1 -- 172.21.15.80:0/386506504 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe1e406ac90 msgr2=0x7fe1e406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:11:51.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.897+0000 7fe1fdb19700 1 --2- 172.21.15.80:0/386506504 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe1e406ac90 0x7fe1e406d150 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec009c40 tx=0x7fe1ec008030 comp rx=0 tx=0).stop 2024-05-08T21:11:51.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.897+0000 7fe1fdb19700 1 -- 172.21.15.80:0/386506504 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe1f80c2b60 msgr2=0x7fe1f81451d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:11:51.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.897+0000 7fe1fdb19700 1 --2- 172.21.15.80:0/386506504 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe1f80c2b60 0x7fe1f81451d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe1e800c450 tx=0x7fe1e800c760 comp rx=0 tx=0).stop 2024-05-08T21:11:51.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.897+0000 7fe1fdb19700 1 -- 172.21.15.80:0/386506504 shutdown_connections 2024-05-08T21:11:51.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.897+0000 7fe1fdb19700 1 --2- 172.21.15.80:0/386506504 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe1e406ac90 0x7fe1e406d150 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:11:51.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.897+0000 7fe1fdb19700 1 --2- 172.21.15.80:0/386506504 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe1f80c2b60 0x7fe1f81451d0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:11:51.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.897+0000 7fe1fdb19700 1 --2- 172.21.15.80:0/386506504 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1f8152180 0x7fe1f8153e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:11:51.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.897+0000 7fe1fdb19700 1 --2- 172.21.15.80:0/386506504 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe1f80c8600 0x7fe1f8146c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:11:51.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.897+0000 7fe1fdb19700 1 -- 172.21.15.80:0/386506504 >> 172.21.15.80:0/386506504 conn(0x7fe1f806a9c0 msgr2=0x7fe1f815b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:11:51.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.898+0000 7fe1fdb19700 1 -- 172.21.15.80:0/386506504 shutdown_connections 2024-05-08T21:11:51.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:51.898+0000 7fe1fdb19700 1 -- 172.21.15.80:0/386506504 wait complete. 2024-05-08T21:11:51.902 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 10 2024-05-08T21:11:51.913 INFO:tasks.mds_thrash.fs.[cephfs]:kill mds.d (rank=0) 2024-05-08T21:11:51.913 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-08T21:11:51.913 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:11:51.924 INFO:tasks.ceph.mds.d:Stopped 2024-05-08T21:11:51.924 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:11:52.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.069+0000 7fa5bbac2700 1 Processor -- start 2024-05-08T21:11:52.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.069+0000 7fa5bbac2700 1 -- start start 2024-05-08T21:11:52.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.071+0000 7fa5bbac2700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa5b40c3cd0 0x7fa5b40c8050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:11:52.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.071+0000 7fa5bbac2700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa5b40c8590 0x7fa5b40c4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:11:52.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.071+0000 7fa5bbac2700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5b40c27b0 con 0x7fa5b4150d30 2024-05-08T21:11:52.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.071+0000 7fa5bbac2700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5b41577f0 con 0x7fa5b40c3cd0 2024-05-08T21:11:52.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.071+0000 7fa5bbac2700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b4156c70 con 0x7fa5b40c8590 2024-05-08T21:11:52.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.071+0000 7fa5ba05f700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa5b40c8590 0x7fa5b40c4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:11:52.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.071+0000 7fa5b905d700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa5b40c3cd0 0x7fa5b40c8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:11:52.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.071+0000 7fa5b905d700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa5b40c3cd0 0x7fa5b40c8050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.80:38536/0 (socket says 172.21.15.80:38536) 2024-05-08T21:11:52.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.071+0000 7fa5ba05f700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa5b40c8590 0x7fa5b40c4840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:54870/0 (socket says 172.21.15.80:54870) 2024-05-08T21:11:52.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.071+0000 7fa5b985e700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fa5b4150d30 0x7fa5b40c20a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.80:33330/0 (socket says 172.21.15.80:33330) 2024-05-08T21:11:52.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.071+0000 7fa5b905d700 1 -- 172.21.15.80:0/3412959960 learned_addr learned my addr 172.21.15.80:0/3412959960 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:11:52.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.071+0000 7fa5ba05f700 1 -- 172.21.15.80:0/3412959960 >> v2:172.21.15.106:3300/0 conn(0x7fa5b40c3cd0 msgr2=0x7fa5b40c8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:11:52.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.071+0000 7fa5ba05f700 1 --2- 172.21.15.80:0/3412959960 >> v2:172.21.15.106:3300/0 conn(0x7fa5b40c3cd0 0x7fa5b40c8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:11:52.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.071+0000 7fa5ba05f700 1 -- 172.21.15.80:0/3412959960 >> v1:172.21.15.106:6789/0 conn(0x7fa5b4150d30 legacy=0x7fa5b40c20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:11:52.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.071+0000 7fa5ba05f700 1 -- 172.21.15.80:0/3412959960 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b4156f50 con 0x7fa5b40c8590 2024-05-08T21:11:52.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.071+0000 7fa5b905d700 1 --2- 172.21.15.80:0/3412959960 >> v2:172.21.15.106:3300/0 conn(0x7fa5b40c3cd0 0x7fa5b40c8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:11:52.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.072+0000 7fa5ba05f700 1 --2- 172.21.15.80:0/3412959960 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa5b40c8590 0x7fa5b40c4840 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac009d90 tx=0x7fa5ac00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3e85c626873e1b4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:11:52.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.072+0000 7fa5b885c700 1 -- 172.21.15.80:0/3412959960 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac00e070 con 0x7fa5b40c8590 2024-05-08T21:11:52.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.072+0000 7fa5b885c700 1 -- 172.21.15.80:0/3412959960 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5ac00bb20 con 0x7fa5b40c8590 2024-05-08T21:11:52.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.072+0000 7fa5b885c700 1 -- 172.21.15.80:0/3412959960 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac012430 con 0x7fa5b40c8590 2024-05-08T21:11:52.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.072+0000 7fa5bbac2700 1 -- 172.21.15.80:0/3412959960 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa5b40c8590 msgr2=0x7fa5b40c4840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:11:52.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.072+0000 7fa5bbac2700 1 --2- 172.21.15.80:0/3412959960 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa5b40c8590 0x7fa5b40c4840 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac009d90 tx=0x7fa5ac00b330 comp rx=0 tx=0).stop 2024-05-08T21:11:52.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.073+0000 7fa5bbac2700 1 -- 172.21.15.80:0/3412959960 shutdown_connections 2024-05-08T21:11:52.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.073+0000 7fa5bbac2700 1 --2- 172.21.15.80:0/3412959960 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa5b40c8590 0x7fa5b40c4840 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:11:52.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.073+0000 7fa5bbac2700 1 --2- 172.21.15.80:0/3412959960 >> v2:172.21.15.106:3300/0 conn(0x7fa5b40c3cd0 0x7fa5b40c8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:11:52.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.073+0000 7fa5bbac2700 1 -- 172.21.15.80:0/3412959960 >> 172.21.15.80:0/3412959960 conn(0x7fa5b406a9c0 msgr2=0x7fa5b406ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:11:52.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.073+0000 7fa5bbac2700 1 -- 172.21.15.80:0/3412959960 shutdown_connections 2024-05-08T21:11:52.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.073+0000 7fa5bbac2700 1 -- 172.21.15.80:0/3412959960 wait complete. 2024-05-08T21:11:52.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.074+0000 7fa5bbac2700 1 Processor -- start 2024-05-08T21:11:52.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.074+0000 7fa5bbac2700 1 -- start start 2024-05-08T21:11:52.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.075+0000 7fa5bbac2700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa5b40c3cd0 0x7fa5b41ee100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:11:52.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.075+0000 7fa5bbac2700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5b40c8590 0x7fa5b41420e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:11:52.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.075+0000 7fa5bbac2700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5b4150d30 0x7fa5b4142620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:11:52.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.075+0000 7fa5bbac2700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b40c9bc0 con 0x7fa5b4150d30 2024-05-08T21:11:52.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.075+0000 7fa5bbac2700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b414dfe0 con 0x7fa5b40c8590 2024-05-08T21:11:52.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.075+0000 7fa5bbac2700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b41ee640 con 0x7fa5b40c3cd0 2024-05-08T21:11:52.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.075+0000 7fa5b985e700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa5b40c3cd0 0x7fa5b41ee100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:11:52.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.075+0000 7fa5b905d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5b40c8590 0x7fa5b41420e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:11:52.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.075+0000 7fa5b985e700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa5b40c3cd0 0x7fa5b41ee100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:54884/0 (socket says 172.21.15.80:54884) 2024-05-08T21:11:52.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.075+0000 7fa5b985e700 1 -- 172.21.15.80:0/4182722086 learned_addr learned my addr 172.21.15.80:0/4182722086 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:11:52.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.076+0000 7fa5ba05f700 1 --2- 172.21.15.80:0/4182722086 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5b4150d30 0x7fa5b4142620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:11:52.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.076+0000 7fa5b985e700 1 -- 172.21.15.80:0/4182722086 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5b40c8590 msgr2=0x7fa5b41420e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:11:52.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.076+0000 7fa5b985e700 1 --2- 172.21.15.80:0/4182722086 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5b40c8590 0x7fa5b41420e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:11:52.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.076+0000 7fa5b985e700 1 -- 172.21.15.80:0/4182722086 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5b4150d30 msgr2=0x7fa5b4142620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:11:52.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.076+0000 7fa5b985e700 1 --2- 172.21.15.80:0/4182722086 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5b4150d30 0x7fa5b4142620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:11:52.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.076+0000 7fa5b985e700 1 -- 172.21.15.80:0/4182722086 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a400a6f0 con 0x7fa5b40c3cd0 2024-05-08T21:11:52.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.076+0000 7fa5b905d700 1 --2- 172.21.15.80:0/4182722086 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5b40c8590 0x7fa5b41420e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:11:52.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.076+0000 7fa5b985e700 1 --2- 172.21.15.80:0/4182722086 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa5b40c3cd0 0x7fa5b41ee100 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa5b000c550 tx=0x7fa5b000c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:11:52.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.076+0000 7fa5aa7fc700 1 -- 172.21.15.80:0/4182722086 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b0005cb0 con 0x7fa5b40c3cd0 2024-05-08T21:11:52.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.076+0000 7fa5aa7fc700 1 -- 172.21.15.80:0/4182722086 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b0005e10 con 0x7fa5b40c3cd0 2024-05-08T21:11:52.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.076+0000 7fa5bbac2700 1 -- 172.21.15.80:0/4182722086 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5ac009a70 con 0x7fa5b40c3cd0 2024-05-08T21:11:52.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.076+0000 7fa5aa7fc700 1 -- 172.21.15.80:0/4182722086 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b00072d0 con 0x7fa5b40c3cd0 2024-05-08T21:11:52.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.076+0000 7fa5bbac2700 1 -- 172.21.15.80:0/4182722086 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5b414f3e0 con 0x7fa5b40c3cd0 2024-05-08T21:11:52.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.078+0000 7fa5bbac2700 1 -- 172.21.15.80:0/4182722086 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5b404ec60 con 0x7fa5b40c3cd0 2024-05-08T21:11:52.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.078+0000 7fa5aa7fc700 1 -- 172.21.15.80:0/4182722086 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa5b0007430 con 0x7fa5b40c3cd0 2024-05-08T21:11:52.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.079+0000 7fa5aa7fc700 1 --2- 172.21.15.80:0/4182722086 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fa59806ac90 0x7fa59806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:11:52.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.079+0000 7fa5b905d700 1 --2- 172.21.15.80:0/4182722086 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fa59806ac90 0x7fa59806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:11:52.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.079+0000 7fa5aa7fc700 1 -- 172.21.15.80:0/4182722086 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa5b00889b0 con 0x7fa5b40c3cd0 2024-05-08T21:11:52.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.079+0000 7fa5b905d700 1 --2- 172.21.15.80:0/4182722086 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fa59806ac90 0x7fa59806d150 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa5a400afd0 tx=0x7fa5a400a3d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:11:52.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.084+0000 7fa5aa7fc700 1 -- 172.21.15.80:0/4182722086 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fa5b0053880 con 0x7fa5b40c3cd0 2024-05-08T21:11:52.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.417+0000 7fa5bbac2700 1 -- 172.21.15.80:0/4182722086 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa5b415ac40 con 0x7fa5b40c3cd0 2024-05-08T21:11:52.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.418+0000 7fa5aa7fc700 1 -- 172.21.15.80:0/4182722086 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6254 (secure 0 0 0) 0x7fa5b0017090 con 0x7fa5b40c3cd0 2024-05-08T21:11:52.422 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:11:52.422 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/2289230272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":2289230272},{"type":"v1","addr":"172.21.15.106:6833","nonce":2289230272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:10:31.304591+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.106:6836/1949999190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1949999190},{"type":"v1","addr":"172.21.15.106:6836","nonce":1949999190}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:11:52.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.421+0000 7fa5bbac2700 1 -- 172.21.15.80:0/4182722086 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fa59806ac90 msgr2=0x7fa59806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:11:52.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.421+0000 7fa5bbac2700 1 --2- 172.21.15.80:0/4182722086 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fa59806ac90 0x7fa59806d150 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa5a400afd0 tx=0x7fa5a400a3d0 comp rx=0 tx=0).stop 2024-05-08T21:11:52.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.421+0000 7fa5bbac2700 1 -- 172.21.15.80:0/4182722086 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa5b40c3cd0 msgr2=0x7fa5b41ee100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:11:52.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.421+0000 7fa5bbac2700 1 --2- 172.21.15.80:0/4182722086 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa5b40c3cd0 0x7fa5b41ee100 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa5b000c550 tx=0x7fa5b000c860 comp rx=0 tx=0).stop 2024-05-08T21:11:52.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.421+0000 7fa5bbac2700 1 -- 172.21.15.80:0/4182722086 shutdown_connections 2024-05-08T21:11:52.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.421+0000 7fa5bbac2700 1 --2- 172.21.15.80:0/4182722086 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fa59806ac90 0x7fa59806d150 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:11:52.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.421+0000 7fa5bbac2700 1 --2- 172.21.15.80:0/4182722086 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5b4150d30 0x7fa5b4142620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:11:52.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.421+0000 7fa5bbac2700 1 --2- 172.21.15.80:0/4182722086 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa5b40c3cd0 0x7fa5b41ee100 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:11:52.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.421+0000 7fa5bbac2700 1 --2- 172.21.15.80:0/4182722086 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5b40c8590 0x7fa5b41420e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:11:52.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.421+0000 7fa5bbac2700 1 -- 172.21.15.80:0/4182722086 >> 172.21.15.80:0/4182722086 conn(0x7fa5b406a9c0 msgr2=0x7fa5b4150300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:11:52.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.421+0000 7fa5bbac2700 1 -- 172.21.15.80:0/4182722086 shutdown_connections 2024-05-08T21:11:52.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:52.422+0000 7fa5bbac2700 1 -- 172.21.15.80:0/4182722086 wait complete. 2024-05-08T21:11:52.426 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 10 2024-05-08T21:11:52.441 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-05-08T21:11:54.442 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:11:54.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.597+0000 7fde8cb2f700 1 Processor -- start 2024-05-08T21:11:54.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.598+0000 7fde8cb2f700 1 -- start start 2024-05-08T21:11:54.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.599+0000 7fde8cb2f700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fde88154580 0x7fde8815abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:11:54.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.599+0000 7fde8cb2f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fde880cbe40 0x7fde880c48c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:11:54.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.599+0000 7fde8cb2f700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde880cad60 con 0x7fde880c4e00 2024-05-08T21:11:54.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.599+0000 7fde8cb2f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde880b2c60 con 0x7fde880cbe40 2024-05-08T21:11:54.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.599+0000 7fde8cb2f700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde8815d750 con 0x7fde88154580 2024-05-08T21:11:54.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.599+0000 7fde85d9b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fde880cbe40 0x7fde880c48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:11:54.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.599+0000 7fde86d9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fde880c4e00 0x7fde880cc3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:57090/0 (socket says 172.21.15.80:57090) 2024-05-08T21:11:54.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.599+0000 7fde86d9d700 1 -- 172.21.15.80:0/4161093911 learned_addr learned my addr 172.21.15.80:0/4161093911 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:11:54.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.599+0000 7fde8659c700 1 --2- 172.21.15.80:0/4161093911 >> v2:172.21.15.106:3300/0 conn(0x7fde88154580 0x7fde8815abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:11:54.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.599+0000 7fde8559a700 1 -- 172.21.15.80:0/4161093911 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4229921762 0 0) 0x7fde880cad60 con 0x7fde880c4e00 2024-05-08T21:11:54.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.599+0000 7fde8559a700 1 -- 172.21.15.80:0/4161093911 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde700035b0 con 0x7fde880c4e00 2024-05-08T21:11:54.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.599+0000 7fde85d9b700 1 -- 172.21.15.80:0/4161093911 >> v2:172.21.15.106:3300/0 conn(0x7fde88154580 msgr2=0x7fde8815abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:11:54.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.599+0000 7fde85d9b700 1 --2- 172.21.15.80:0/4161093911 >> v2:172.21.15.106:3300/0 conn(0x7fde88154580 0x7fde8815abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:11:54.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.599+0000 7fde85d9b700 1 -- 172.21.15.80:0/4161093911 >> v1:172.21.15.80:6789/0 conn(0x7fde880c4e00 legacy=0x7fde880cc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:11:54.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.600+0000 7fde85d9b700 1 -- 172.21.15.80:0/4161093911 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde8815d930 con 0x7fde880cbe40 2024-05-08T21:11:54.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.600+0000 7fde85d9b700 1 --2- 172.21.15.80:0/4161093911 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde880cbe40 0x7fde880c48c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fde880cd360 tx=0x7fde7c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42c2c42376ac27d7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:11:54.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.600+0000 7fde8559a700 1 -- 172.21.15.80:0/4161093911 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7c011830 con 0x7fde880cbe40 2024-05-08T21:11:54.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.600+0000 7fde8559a700 1 -- 172.21.15.80:0/4161093911 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde7c011990 con 0x7fde880cbe40 2024-05-08T21:11:54.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.600+0000 7fde8559a700 1 -- 172.21.15.80:0/4161093911 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7c011d00 con 0x7fde880cbe40 2024-05-08T21:11:54.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.600+0000 7fde8cb2f700 1 -- 172.21.15.80:0/4161093911 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde880cbe40 msgr2=0x7fde880c48c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:11:54.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.600+0000 7fde8cb2f700 1 --2- 172.21.15.80:0/4161093911 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde880cbe40 0x7fde880c48c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fde880cd360 tx=0x7fde7c009b50 comp rx=0 tx=0).stop 2024-05-08T21:11:54.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.601+0000 7fde8cb2f700 1 -- 172.21.15.80:0/4161093911 shutdown_connections 2024-05-08T21:11:54.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.601+0000 7fde8cb2f700 1 --2- 172.21.15.80:0/4161093911 >> v2:172.21.15.106:3300/0 conn(0x7fde88154580 0x7fde8815abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:11:54.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.601+0000 7fde8cb2f700 1 --2- 172.21.15.80:0/4161093911 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde880cbe40 0x7fde880c48c0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:11:54.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.601+0000 7fde8cb2f700 1 -- 172.21.15.80:0/4161093911 >> 172.21.15.80:0/4161093911 conn(0x7fde8806c6a0 msgr2=0x7fde8806cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:11:54.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.601+0000 7fde8cb2f700 1 -- 172.21.15.80:0/4161093911 shutdown_connections 2024-05-08T21:11:54.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.601+0000 7fde8cb2f700 1 -- 172.21.15.80:0/4161093911 wait complete. 2024-05-08T21:11:54.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.602+0000 7fde8cb2f700 1 Processor -- start 2024-05-08T21:11:54.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.602+0000 7fde8cb2f700 1 -- start start 2024-05-08T21:11:54.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.604+0000 7fde8cb2f700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fde880c4e00 0x7fde880ce960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:11:54.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.604+0000 7fde8cb2f700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde880cbe40 0x7fde88159290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:11:54.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.604+0000 7fde8cb2f700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fde88154580 0x7fde8815b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:11:54.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.604+0000 7fde8cb2f700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde880cdb60 con 0x7fde880cbe40 2024-05-08T21:11:54.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.604+0000 7fde8cb2f700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde8815b4c0 con 0x7fde88154580 2024-05-08T21:11:54.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.604+0000 7fde8cb2f700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde880cdcd0 con 0x7fde880c4e00 2024-05-08T21:11:54.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.604+0000 7fde85d9b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde880cbe40 0x7fde88159290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:11:54.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.604+0000 7fde85d9b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde880cbe40 0x7fde88159290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50726/0 (socket says 172.21.15.80:50726) 2024-05-08T21:11:54.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.604+0000 7fde85d9b700 1 -- 172.21.15.80:0/2084919047 learned_addr learned my addr 172.21.15.80:0/2084919047 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:11:54.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.604+0000 7fde8659c700 1 --2- 172.21.15.80:0/2084919047 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fde880c4e00 0x7fde880ce960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:11:54.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.604+0000 7fde86d9d700 1 --2- 172.21.15.80:0/2084919047 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fde88154580 0x7fde8815b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:11:54.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.604+0000 7fde85d9b700 1 -- 172.21.15.80:0/2084919047 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fde880c4e00 msgr2=0x7fde880ce960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:11:54.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.604+0000 7fde85d9b700 1 --2- 172.21.15.80:0/2084919047 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fde880c4e00 0x7fde880ce960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:11:54.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.604+0000 7fde85d9b700 1 -- 172.21.15.80:0/2084919047 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fde88154580 msgr2=0x7fde8815b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:11:54.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.604+0000 7fde85d9b700 1 --2- 172.21.15.80:0/2084919047 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fde88154580 0x7fde8815b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:11:54.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.604+0000 7fde85d9b700 1 -- 172.21.15.80:0/2084919047 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde7c0094a0 con 0x7fde880cbe40 2024-05-08T21:11:54.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.604+0000 7fde86d9d700 1 --2- 172.21.15.80:0/2084919047 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fde88154580 0x7fde8815b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:11:54.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.604+0000 7fde85d9b700 1 --2- 172.21.15.80:0/2084919047 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde880cbe40 0x7fde88159290 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fde7c0090b0 tx=0x7fde7c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:11:54.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.604+0000 7fde76ffd700 1 -- 172.21.15.80:0/2084919047 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7c004550 con 0x7fde880cbe40 2024-05-08T21:11:54.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.604+0000 7fde76ffd700 1 -- 172.21.15.80:0/2084919047 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde7c01e070 con 0x7fde880cbe40 2024-05-08T21:11:54.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.604+0000 7fde8cb2f700 1 -- 172.21.15.80:0/2084919047 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde880cd8c0 con 0x7fde880cbe40 2024-05-08T21:11:54.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.605+0000 7fde8cb2f700 1 -- 172.21.15.80:0/2084919047 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde8815cb70 con 0x7fde880cbe40 2024-05-08T21:11:54.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.605+0000 7fde76ffd700 1 -- 172.21.15.80:0/2084919047 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7c0038e0 con 0x7fde880cbe40 2024-05-08T21:11:54.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.605+0000 7fde8cb2f700 1 -- 172.21.15.80:0/2084919047 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde6c0052f0 con 0x7fde880cbe40 2024-05-08T21:11:54.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.607+0000 7fde76ffd700 1 -- 172.21.15.80:0/2084919047 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fde7c003a40 con 0x7fde880cbe40 2024-05-08T21:11:54.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.608+0000 7fde76ffd700 1 --2- 172.21.15.80:0/2084919047 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fde6806ac90 0x7fde6806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:11:54.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.608+0000 7fde76ffd700 1 -- 172.21.15.80:0/2084919047 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fde7c08a720 con 0x7fde880cbe40 2024-05-08T21:11:54.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.608+0000 7fde8659c700 1 --2- 172.21.15.80:0/2084919047 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fde6806ac90 0x7fde6806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:11:54.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.608+0000 7fde8659c700 1 --2- 172.21.15.80:0/2084919047 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fde6806ac90 0x7fde6806d150 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fde78009b40 tx=0x7fde78009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:11:54.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.613+0000 7fde76ffd700 1 -- 172.21.15.80:0/2084919047 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fde7c0556b0 con 0x7fde880cbe40 2024-05-08T21:11:54.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.936+0000 7fde8cb2f700 1 -- 172.21.15.80:0/2084919047 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fde6c005870 con 0x7fde880cbe40 2024-05-08T21:11:54.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.936+0000 7fde76ffd700 1 -- 172.21.15.80:0/2084919047 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6254 (secure 0 0 0) 0x7fde7c020090 con 0x7fde880cbe40 2024-05-08T21:11:54.940 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:11:54.940 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/2289230272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":2289230272},{"type":"v1","addr":"172.21.15.106:6833","nonce":2289230272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:10:31.304591+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.106:6836/1949999190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1949999190},{"type":"v1","addr":"172.21.15.106:6836","nonce":1949999190}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:11:54.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.939+0000 7fde8cb2f700 1 -- 172.21.15.80:0/2084919047 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fde6806ac90 msgr2=0x7fde6806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:11:54.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.939+0000 7fde8cb2f700 1 --2- 172.21.15.80:0/2084919047 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fde6806ac90 0x7fde6806d150 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fde78009b40 tx=0x7fde78009210 comp rx=0 tx=0).stop 2024-05-08T21:11:54.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.939+0000 7fde8cb2f700 1 -- 172.21.15.80:0/2084919047 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde880cbe40 msgr2=0x7fde88159290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:11:54.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.939+0000 7fde8cb2f700 1 --2- 172.21.15.80:0/2084919047 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde880cbe40 0x7fde88159290 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fde7c0090b0 tx=0x7fde7c004750 comp rx=0 tx=0).stop 2024-05-08T21:11:54.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.939+0000 7fde8cb2f700 1 -- 172.21.15.80:0/2084919047 shutdown_connections 2024-05-08T21:11:54.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.939+0000 7fde8cb2f700 1 --2- 172.21.15.80:0/2084919047 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fde6806ac90 0x7fde6806d150 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:11:54.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.939+0000 7fde8cb2f700 1 --2- 172.21.15.80:0/2084919047 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fde88154580 0x7fde8815b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:11:54.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.939+0000 7fde8cb2f700 1 --2- 172.21.15.80:0/2084919047 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fde880c4e00 0x7fde880ce960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:11:54.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.939+0000 7fde8cb2f700 1 --2- 172.21.15.80:0/2084919047 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fde880cbe40 0x7fde88159290 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:11:54.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.939+0000 7fde8cb2f700 1 -- 172.21.15.80:0/2084919047 >> 172.21.15.80:0/2084919047 conn(0x7fde8806c6a0 msgr2=0x7fde88151450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:11:54.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.939+0000 7fde8cb2f700 1 -- 172.21.15.80:0/2084919047 shutdown_connections 2024-05-08T21:11:54.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:54.939+0000 7fde8cb2f700 1 -- 172.21.15.80:0/2084919047 wait complete. 2024-05-08T21:11:54.948 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 10 2024-05-08T21:11:54.954 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-05-08T21:11:56.955 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:11:57.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.095+0000 7f10055bf700 1 Processor -- start 2024-05-08T21:11:57.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.096+0000 7f10055bf700 1 -- start start 2024-05-08T21:11:57.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.096+0000 7f10055bf700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1000150dd0 0x7f1000071390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:11:57.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.096+0000 7f10055bf700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f100006bad0 0x7f100006bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:11:57.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.096+0000 7f10055bf700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10000c7950 con 0x7f10000c97f0 2024-05-08T21:11:57.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.096+0000 7f10055bf700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10000c93d0 con 0x7f100006bad0 2024-05-08T21:11:57.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.096+0000 7f10055bf700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10000c9c80 con 0x7f1000150dd0 2024-05-08T21:11:57.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.097+0000 7f0ffe7fc700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f10000c97f0 0x7f1000157940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:57100/0 (socket says 172.21.15.80:57100) 2024-05-08T21:11:57.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.097+0000 7f0ffe7fc700 1 -- 172.21.15.80:0/114045315 learned_addr learned my addr 172.21.15.80:0/114045315 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:11:57.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.097+0000 7f0fff7fe700 1 --2- 172.21.15.80:0/114045315 >> v2:172.21.15.80:3300/0 conn(0x7f100006bad0 0x7f100006bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:11:57.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.097+0000 7f0ffeffd700 1 --2- 172.21.15.80:0/114045315 >> v2:172.21.15.106:3300/0 conn(0x7f1000150dd0 0x7f1000071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:11:57.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.097+0000 7f0ffdffb700 1 -- 172.21.15.80:0/114045315 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 840672644 0 0) 0x7f10000c7950 con 0x7f10000c97f0 2024-05-08T21:11:57.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.097+0000 7f0ffdffb700 1 -- 172.21.15.80:0/114045315 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fe80035b0 con 0x7f10000c97f0 2024-05-08T21:11:57.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.097+0000 7f0fff7fe700 1 -- 172.21.15.80:0/114045315 >> v2:172.21.15.106:3300/0 conn(0x7f1000150dd0 msgr2=0x7f1000071390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:11:57.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.097+0000 7f0fff7fe700 1 --2- 172.21.15.80:0/114045315 >> v2:172.21.15.106:3300/0 conn(0x7f1000150dd0 0x7f1000071390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:11:57.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.097+0000 7f0fff7fe700 1 -- 172.21.15.80:0/114045315 >> v1:172.21.15.80:6789/0 conn(0x7f10000c97f0 legacy=0x7f1000157940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:11:57.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.097+0000 7f0ffdffb700 1 -- 172.21.15.80:0/114045315 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1719980146 0 0) 0x7f0fe80035b0 con 0x7f10000c97f0 2024-05-08T21:11:57.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.097+0000 7f0fff7fe700 1 -- 172.21.15.80:0/114045315 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10000c8a30 con 0x7f100006bad0 2024-05-08T21:11:57.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.097+0000 7f0fff7fe700 1 --2- 172.21.15.80:0/114045315 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f100006bad0 0x7f100006bf40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f100006ce00 tx=0x7f0ff800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb2eb775e3662d7c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:11:57.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.097+0000 7f0ffdffb700 1 -- 172.21.15.80:0/114045315 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff4001670 con 0x7f100006bad0 2024-05-08T21:11:57.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.098+0000 7f0ffdffb700 1 -- 172.21.15.80:0/114045315 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ff8003a20 con 0x7f100006bad0 2024-05-08T21:11:57.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.098+0000 7f0ffdffb700 1 -- 172.21.15.80:0/114045315 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff8003d90 con 0x7f100006bad0 2024-05-08T21:11:57.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.098+0000 7f10055bf700 1 -- 172.21.15.80:0/114045315 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f100006bad0 msgr2=0x7f100006bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:11:57.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.098+0000 7f10055bf700 1 --2- 172.21.15.80:0/114045315 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f100006bad0 0x7f100006bf40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f100006ce00 tx=0x7f0ff800b330 comp rx=0 tx=0).stop 2024-05-08T21:11:57.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.098+0000 7f10055bf700 1 -- 172.21.15.80:0/114045315 shutdown_connections 2024-05-08T21:11:57.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.098+0000 7f10055bf700 1 --2- 172.21.15.80:0/114045315 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f100006bad0 0x7f100006bf40 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:11:57.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.098+0000 7f10055bf700 1 --2- 172.21.15.80:0/114045315 >> v2:172.21.15.106:3300/0 conn(0x7f1000150dd0 0x7f1000071390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:11:57.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.098+0000 7f10055bf700 1 -- 172.21.15.80:0/114045315 >> 172.21.15.80:0/114045315 conn(0x7f100006ef80 msgr2=0x7f100006f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:11:57.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.098+0000 7f10055bf700 1 -- 172.21.15.80:0/114045315 shutdown_connections 2024-05-08T21:11:57.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.098+0000 7f10055bf700 1 -- 172.21.15.80:0/114045315 wait complete. 2024-05-08T21:11:57.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.100+0000 7f10055bf700 1 Processor -- start 2024-05-08T21:11:57.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.100+0000 7f10055bf700 1 -- start start 2024-05-08T21:11:57.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.101+0000 7f10055bf700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f100006bad0 0x7f10001ef0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:11:57.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.101+0000 7f10055bf700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10000c97f0 0x7f100014e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:11:57.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.101+0000 7f10055bf700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1000150dd0 0x7f1000153b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:11:57.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.101+0000 7f10055bf700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10001eec80 con 0x7f10000c97f0 2024-05-08T21:11:57.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.101+0000 7f10055bf700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1000072910 con 0x7f100006bad0 2024-05-08T21:11:57.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.101+0000 7f10055bf700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f100015b130 con 0x7f1000150dd0 2024-05-08T21:11:57.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.101+0000 7f0ffe7fc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10000c97f0 0x7f100014e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:11:57.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.101+0000 7f0ffeffd700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f100006bad0 0x7f10001ef0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:11:57.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.101+0000 7f0ffe7fc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10000c97f0 0x7f100014e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50740/0 (socket says 172.21.15.80:50740) 2024-05-08T21:11:57.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.101+0000 7f0ffe7fc700 1 -- 172.21.15.80:0/2592834062 learned_addr learned my addr 172.21.15.80:0/2592834062 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:11:57.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.101+0000 7f0ffeffd700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f100006bad0 0x7f10001ef0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.80:39620/0 (socket says 172.21.15.80:39620) 2024-05-08T21:11:57.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.102+0000 7f0fff7fe700 1 --2- 172.21.15.80:0/2592834062 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1000150dd0 0x7f1000153b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:11:57.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.102+0000 7f0ffe7fc700 1 -- 172.21.15.80:0/2592834062 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1000150dd0 msgr2=0x7f1000153b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:11:57.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.102+0000 7f0ffe7fc700 1 --2- 172.21.15.80:0/2592834062 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1000150dd0 0x7f1000153b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:11:57.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.102+0000 7f0ffe7fc700 1 -- 172.21.15.80:0/2592834062 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f100006bad0 msgr2=0x7f10001ef0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:11:57.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.102+0000 7f0ffe7fc700 1 --2- 172.21.15.80:0/2592834062 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f100006bad0 0x7f10001ef0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:11:57.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.102+0000 7f0ffe7fc700 1 -- 172.21.15.80:0/2592834062 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff8009a70 con 0x7f10000c97f0 2024-05-08T21:11:57.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.102+0000 7f0ffeffd700 1 --2- 172.21.15.80:0/2592834062 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f100006bad0 0x7f10001ef0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:11:57.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.102+0000 7f0ffe7fc700 1 --2- 172.21.15.80:0/2592834062 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10000c97f0 0x7f100014e4b0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0ff40011e0 tx=0x7f0ff400ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:11:57.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.102+0000 7f0fe77fe700 1 -- 172.21.15.80:0/2592834062 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff4004c80 con 0x7f10000c97f0 2024-05-08T21:11:57.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.102+0000 7f0fe77fe700 1 -- 172.21.15.80:0/2592834062 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ff4004de0 con 0x7f10000c97f0 2024-05-08T21:11:57.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.102+0000 7f10055bf700 1 -- 172.21.15.80:0/2592834062 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1000072b40 con 0x7f10000c97f0 2024-05-08T21:11:57.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.102+0000 7f0fe77fe700 1 -- 172.21.15.80:0/2592834062 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff40072d0 con 0x7f10000c97f0 2024-05-08T21:11:57.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.102+0000 7f10055bf700 1 -- 172.21.15.80:0/2592834062 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1000158500 con 0x7f10000c97f0 2024-05-08T21:11:57.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.104+0000 7f10055bf700 1 -- 172.21.15.80:0/2592834062 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10001eedc0 con 0x7f10000c97f0 2024-05-08T21:11:57.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.104+0000 7f0fe77fe700 1 -- 172.21.15.80:0/2592834062 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0ff4007430 con 0x7f10000c97f0 2024-05-08T21:11:57.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.104+0000 7f0fe77fe700 1 --2- 172.21.15.80:0/2592834062 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f0fec06ac90 0x7f0fec06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:11:57.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.104+0000 7f0fe77fe700 1 -- 172.21.15.80:0/2592834062 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0ff40894b0 con 0x7f10000c97f0 2024-05-08T21:11:57.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.104+0000 7f0ffeffd700 1 --2- 172.21.15.80:0/2592834062 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f0fec06ac90 0x7f0fec06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:11:57.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.105+0000 7f0ffeffd700 1 --2- 172.21.15.80:0/2592834062 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f0fec06ac90 0x7f0fec06d150 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0ff0009f30 tx=0x7f0ff0009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:11:57.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.112+0000 7f0fe77fe700 1 -- 172.21.15.80:0/2592834062 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f10001eedc0 con 0x7f10000c97f0 2024-05-08T21:11:57.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.426+0000 7f10055bf700 1 -- 172.21.15.80:0/2592834062 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f10001eedc0 con 0x7f10000c97f0 2024-05-08T21:11:57.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.427+0000 7f0fe77fe700 1 -- 172.21.15.80:0/2592834062 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6254 (secure 0 0 0) 0x7f10001eedc0 con 0x7f10000c97f0 2024-05-08T21:11:57.430 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:11:57.430 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/2289230272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":2289230272},{"type":"v1","addr":"172.21.15.106:6833","nonce":2289230272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:10:31.304591+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.106:6836/1949999190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1949999190},{"type":"v1","addr":"172.21.15.106:6836","nonce":1949999190}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:11:57.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.429+0000 7f10055bf700 1 -- 172.21.15.80:0/2592834062 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f0fec06ac90 msgr2=0x7f0fec06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:11:57.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.429+0000 7f10055bf700 1 --2- 172.21.15.80:0/2592834062 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f0fec06ac90 0x7f0fec06d150 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0ff0009f30 tx=0x7f0ff0009210 comp rx=0 tx=0).stop 2024-05-08T21:11:57.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.429+0000 7f10055bf700 1 -- 172.21.15.80:0/2592834062 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10000c97f0 msgr2=0x7f100014e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:11:57.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.429+0000 7f10055bf700 1 --2- 172.21.15.80:0/2592834062 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10000c97f0 0x7f100014e4b0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0ff40011e0 tx=0x7f0ff400ca50 comp rx=0 tx=0).stop 2024-05-08T21:11:57.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.429+0000 7f10055bf700 1 -- 172.21.15.80:0/2592834062 shutdown_connections 2024-05-08T21:11:57.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.429+0000 7f10055bf700 1 --2- 172.21.15.80:0/2592834062 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f0fec06ac90 0x7f0fec06d150 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:11:57.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.429+0000 7f10055bf700 1 --2- 172.21.15.80:0/2592834062 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1000150dd0 0x7f1000153b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:11:57.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.429+0000 7f10055bf700 1 --2- 172.21.15.80:0/2592834062 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f100006bad0 0x7f10001ef0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:11:57.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.429+0000 7f10055bf700 1 --2- 172.21.15.80:0/2592834062 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10000c97f0 0x7f100014e4b0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:11:57.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.429+0000 7f10055bf700 1 -- 172.21.15.80:0/2592834062 >> 172.21.15.80:0/2592834062 conn(0x7f100006ef80 msgr2=0x7f100006f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:11:57.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.429+0000 7f10055bf700 1 -- 172.21.15.80:0/2592834062 shutdown_connections 2024-05-08T21:11:57.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:57.429+0000 7f10055bf700 1 -- 172.21.15.80:0/2592834062 wait complete. 2024-05-08T21:11:57.434 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 10 2024-05-08T21:11:57.445 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-05-08T21:11:59.446 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:11:59.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.576+0000 7f1e2148f700 1 Processor -- start 2024-05-08T21:11:59.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.576+0000 7f1e2148f700 1 -- start start 2024-05-08T21:11:59.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.577+0000 7f1e2148f700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1e1c06ef50 0x7f1e1c072cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:11:59.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.577+0000 7f1e2148f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1e1c153f60 0x7f1e1c154410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:11:59.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.577+0000 7f1e2148f700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e1c071390 con 0x7f1e1c06f330 2024-05-08T21:11:59.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.577+0000 7f1e2148f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e1c0c7030 con 0x7f1e1c153f60 2024-05-08T21:11:59.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.577+0000 7f1e2148f700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e1c0c8aa0 con 0x7f1e1c06ef50 2024-05-08T21:11:59.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.577+0000 7f1e1b7fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1e1c153f60 0x7f1e1c154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:11:59.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.577+0000 7f1e1b7fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1e1c153f60 0x7f1e1c154410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50744/0 (socket says 172.21.15.80:50744) 2024-05-08T21:11:59.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.577+0000 7f1e1b7fe700 1 -- 172.21.15.80:0/3246900973 learned_addr learned my addr 172.21.15.80:0/3246900973 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:11:59.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.577+0000 7f1e1affd700 1 --2- 172.21.15.80:0/3246900973 >> v2:172.21.15.106:3300/0 conn(0x7f1e1c06ef50 0x7f1e1c072cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:11:59.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.577+0000 7f1e1b7fe700 1 -- 172.21.15.80:0/3246900973 >> v2:172.21.15.106:3300/0 conn(0x7f1e1c06ef50 msgr2=0x7f1e1c072cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:11:59.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.577+0000 7f1e1b7fe700 1 --2- 172.21.15.80:0/3246900973 >> v2:172.21.15.106:3300/0 conn(0x7f1e1c06ef50 0x7f1e1c072cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:11:59.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.577+0000 7f1e1b7fe700 1 -- 172.21.15.80:0/3246900973 >> v1:172.21.15.106:6789/0 conn(0x7f1e1c06f330 legacy=0x7f1e1c15ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:11:59.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.577+0000 7f1e1b7fe700 1 -- 172.21.15.80:0/3246900973 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e1c0c8d60 con 0x7f1e1c153f60 2024-05-08T21:11:59.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.577+0000 7f1e1b7fe700 1 --2- 172.21.15.80:0/3246900973 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e1c153f60 0x7f1e1c154410 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c06fb10 tx=0x7f1e1400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff8b63c8325e49b8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:11:59.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.578+0000 7f1e19ffb700 1 -- 172.21.15.80:0/3246900973 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1400e070 con 0x7f1e1c153f60 2024-05-08T21:11:59.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.578+0000 7f1e19ffb700 1 -- 172.21.15.80:0/3246900973 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e1400b910 con 0x7f1e1c153f60 2024-05-08T21:11:59.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.578+0000 7f1e19ffb700 1 -- 172.21.15.80:0/3246900973 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1400bcc0 con 0x7f1e1c153f60 2024-05-08T21:11:59.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.578+0000 7f1e2148f700 1 -- 172.21.15.80:0/3246900973 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e1c153f60 msgr2=0x7f1e1c154410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:11:59.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.578+0000 7f1e2148f700 1 --2- 172.21.15.80:0/3246900973 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e1c153f60 0x7f1e1c154410 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c06fb10 tx=0x7f1e1400b330 comp rx=0 tx=0).stop 2024-05-08T21:11:59.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.578+0000 7f1e2148f700 1 -- 172.21.15.80:0/3246900973 shutdown_connections 2024-05-08T21:11:59.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.578+0000 7f1e2148f700 1 --2- 172.21.15.80:0/3246900973 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e1c153f60 0x7f1e1c154410 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:11:59.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.578+0000 7f1e2148f700 1 --2- 172.21.15.80:0/3246900973 >> v2:172.21.15.106:3300/0 conn(0x7f1e1c06ef50 0x7f1e1c072cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:11:59.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.578+0000 7f1e2148f700 1 -- 172.21.15.80:0/3246900973 >> 172.21.15.80:0/3246900973 conn(0x7f1e1c0c9310 msgr2=0x7f1e1c0c9720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:11:59.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.579+0000 7f1e2148f700 1 -- 172.21.15.80:0/3246900973 shutdown_connections 2024-05-08T21:11:59.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.579+0000 7f1e2148f700 1 -- 172.21.15.80:0/3246900973 wait complete. 2024-05-08T21:11:59.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.580+0000 7f1e2148f700 1 Processor -- start 2024-05-08T21:11:59.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.580+0000 7f1e2148f700 1 -- start start 2024-05-08T21:11:59.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.581+0000 7f1e2148f700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e1c06ef50 0x7f1e1c1efa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:11:59.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.581+0000 7f1e2148f700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1e1c06f330 0x7f1e1c155870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:11:59.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.581+0000 7f1e2148f700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1e1c153f60 0x7f1e1c149f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:11:59.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.581+0000 7f1e2148f700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1c14dba0 con 0x7f1e1c06ef50 2024-05-08T21:11:59.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.581+0000 7f1e2148f700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1c155db0 con 0x7f1e1c153f60 2024-05-08T21:11:59.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.581+0000 7f1e2148f700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1c1544f0 con 0x7f1e1c06f330 2024-05-08T21:11:59.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.581+0000 7f1e1affd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e1c06ef50 0x7f1e1c1efa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:11:59.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.581+0000 7f1e1affd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e1c06ef50 0x7f1e1c1efa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50752/0 (socket says 172.21.15.80:50752) 2024-05-08T21:11:59.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.581+0000 7f1e1affd700 1 -- 172.21.15.80:0/3879909356 learned_addr learned my addr 172.21.15.80:0/3879909356 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:11:59.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.581+0000 7f1e1a7fc700 1 --2- 172.21.15.80:0/3879909356 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1e1c06f330 0x7f1e1c155870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:11:59.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.581+0000 7f1e1b7fe700 1 --2- 172.21.15.80:0/3879909356 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1e1c153f60 0x7f1e1c149f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:11:59.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.581+0000 7f1e1affd700 1 -- 172.21.15.80:0/3879909356 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1e1c06f330 msgr2=0x7f1e1c155870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:11:59.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.581+0000 7f1e1affd700 1 --2- 172.21.15.80:0/3879909356 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1e1c06f330 0x7f1e1c155870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:11:59.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.581+0000 7f1e1affd700 1 -- 172.21.15.80:0/3879909356 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1e1c153f60 msgr2=0x7f1e1c149f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:11:59.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.581+0000 7f1e1affd700 1 --2- 172.21.15.80:0/3879909356 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1e1c153f60 0x7f1e1c149f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:11:59.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.581+0000 7f1e1affd700 1 -- 172.21.15.80:0/3879909356 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e14009b30 con 0x7f1e1c06ef50 2024-05-08T21:11:59.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.581+0000 7f1e1affd700 1 --2- 172.21.15.80:0/3879909356 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e1c06ef50 0x7f1e1c1efa10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c00e9b0 tx=0x7f1e0c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:11:59.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.581+0000 7f1e037fe700 1 -- 172.21.15.80:0/3879909356 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0c009710 con 0x7f1e1c06ef50 2024-05-08T21:11:59.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.581+0000 7f1e037fe700 1 -- 172.21.15.80:0/3879909356 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e0c00c850 con 0x7f1e1c06ef50 2024-05-08T21:11:59.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.581+0000 7f1e2148f700 1 -- 172.21.15.80:0/3879909356 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e1c1547d0 con 0x7f1e1c06ef50 2024-05-08T21:11:59.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.581+0000 7f1e037fe700 1 -- 172.21.15.80:0/3879909356 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0c00cbc0 con 0x7f1e1c06ef50 2024-05-08T21:11:59.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.581+0000 7f1e2148f700 1 -- 172.21.15.80:0/3879909356 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e1c154d90 con 0x7f1e1c06ef50 2024-05-08T21:11:59.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.583+0000 7f1e2148f700 1 -- 172.21.15.80:0/3879909356 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e1c072370 con 0x7f1e1c06ef50 2024-05-08T21:11:59.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.583+0000 7f1e037fe700 1 -- 172.21.15.80:0/3879909356 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1e0c00cd20 con 0x7f1e1c06ef50 2024-05-08T21:11:59.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.584+0000 7f1e037fe700 1 --2- 172.21.15.80:0/3879909356 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f1e0806ac90 0x7f1e0806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:11:59.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.584+0000 7f1e037fe700 1 -- 172.21.15.80:0/3879909356 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1e0c0897f0 con 0x7f1e1c06ef50 2024-05-08T21:11:59.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.584+0000 7f1e1a7fc700 1 --2- 172.21.15.80:0/3879909356 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f1e0806ac90 0x7f1e0806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:11:59.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.584+0000 7f1e1a7fc700 1 --2- 172.21.15.80:0/3879909356 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f1e0806ac90 0x7f1e0806d150 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c0c7e60 tx=0x7f1e10009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:11:59.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.588+0000 7f1e037fe700 1 -- 172.21.15.80:0/3879909356 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f1e0c054610 con 0x7f1e1c06ef50 2024-05-08T21:11:59.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.842+0000 7f1e2148f700 1 -- 172.21.15.80:0/3879909356 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1e1c06bd20 con 0x7f1e1c06ef50 2024-05-08T21:11:59.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.842+0000 7f1e037fe700 1 -- 172.21.15.80:0/3879909356 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6254 (secure 0 0 0) 0x7f1e0c057c30 con 0x7f1e1c06ef50 2024-05-08T21:11:59.847 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:11:59.847 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/2289230272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":2289230272},{"type":"v1","addr":"172.21.15.106:6833","nonce":2289230272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:10:31.304591+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.106:6836/1949999190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1949999190},{"type":"v1","addr":"172.21.15.106:6836","nonce":1949999190}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:11:59.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.845+0000 7f1e2148f700 1 -- 172.21.15.80:0/3879909356 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f1e0806ac90 msgr2=0x7f1e0806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:11:59.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.845+0000 7f1e2148f700 1 --2- 172.21.15.80:0/3879909356 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f1e0806ac90 0x7f1e0806d150 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c0c7e60 tx=0x7f1e10009040 comp rx=0 tx=0).stop 2024-05-08T21:11:59.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.845+0000 7f1e2148f700 1 -- 172.21.15.80:0/3879909356 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e1c06ef50 msgr2=0x7f1e1c1efa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:11:59.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.845+0000 7f1e2148f700 1 --2- 172.21.15.80:0/3879909356 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e1c06ef50 0x7f1e1c1efa10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c00e9b0 tx=0x7f1e0c00ed70 comp rx=0 tx=0).stop 2024-05-08T21:11:59.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.845+0000 7f1e2148f700 1 -- 172.21.15.80:0/3879909356 shutdown_connections 2024-05-08T21:11:59.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.845+0000 7f1e2148f700 1 --2- 172.21.15.80:0/3879909356 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f1e0806ac90 0x7f1e0806d150 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:11:59.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.845+0000 7f1e2148f700 1 --2- 172.21.15.80:0/3879909356 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e1c06ef50 0x7f1e1c1efa10 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:11:59.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.845+0000 7f1e2148f700 1 --2- 172.21.15.80:0/3879909356 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1e1c153f60 0x7f1e1c149f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:11:59.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.845+0000 7f1e2148f700 1 --2- 172.21.15.80:0/3879909356 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1e1c06f330 0x7f1e1c155870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:11:59.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.845+0000 7f1e2148f700 1 -- 172.21.15.80:0/3879909356 >> 172.21.15.80:0/3879909356 conn(0x7f1e1c0c9310 msgr2=0x7f1e1c1517c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:11:59.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.845+0000 7f1e2148f700 1 -- 172.21.15.80:0/3879909356 shutdown_connections 2024-05-08T21:11:59.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:11:59.846+0000 7f1e2148f700 1 -- 172.21.15.80:0/3879909356 wait complete. 2024-05-08T21:11:59.852 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 10 2024-05-08T21:11:59.865 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-05-08T21:12:01.866 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:12:02.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:01.997+0000 7f17f16cc700 1 Processor -- start 2024-05-08T21:12:02.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:01.997+0000 7f17f16cc700 1 -- start start 2024-05-08T21:12:02.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:01.998+0000 7f17f16cc700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f17ec151010 0x7f17ec15aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:12:02.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:01.998+0000 7f17f16cc700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f17ec15aff0 0x7f17ec0c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:12:02.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:01.998+0000 7f17f16cc700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17ec1572b0 con 0x7f17ec156dc0 2024-05-08T21:12:02.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:01.998+0000 7f17f16cc700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17ec15a3b0 con 0x7f17ec15aff0 2024-05-08T21:12:02.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:01.998+0000 7f17f16cc700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17ec15a690 con 0x7f17ec151010 2024-05-08T21:12:02.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:01.998+0000 7f17eb7fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f17ec15aff0 0x7f17ec0c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:12:02.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:01.998+0000 7f17eb7fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f17ec15aff0 0x7f17ec0c73f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50760/0 (socket says 172.21.15.80:50760) 2024-05-08T21:12:02.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:01.998+0000 7f17eb7fe700 1 -- 172.21.15.80:0/1834662589 learned_addr learned my addr 172.21.15.80:0/1834662589 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:12:02.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:01.998+0000 7f17eaffd700 1 --2- 172.21.15.80:0/1834662589 >> v2:172.21.15.106:3300/0 conn(0x7f17ec151010 0x7f17ec15aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:12:02.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:01.998+0000 7f17eb7fe700 1 -- 172.21.15.80:0/1834662589 >> v2:172.21.15.106:3300/0 conn(0x7f17ec151010 msgr2=0x7f17ec15aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:12:02.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:01.998+0000 7f17eb7fe700 1 --2- 172.21.15.80:0/1834662589 >> v2:172.21.15.106:3300/0 conn(0x7f17ec151010 0x7f17ec15aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:02.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:01.998+0000 7f17eb7fe700 1 -- 172.21.15.80:0/1834662589 >> v1:172.21.15.106:6789/0 conn(0x7f17ec156dc0 legacy=0x7f17ec0c8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:02.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:01.998+0000 7f17eb7fe700 1 -- 172.21.15.80:0/1834662589 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17ec157590 con 0x7f17ec15aff0 2024-05-08T21:12:02.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:01.998+0000 7f17eb7fe700 1 --2- 172.21.15.80:0/1834662589 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f17ec15aff0 0x7f17ec0c73f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f17ec06cb90 tx=0x7f17e400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1f457e3f99dd7a2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:12:02.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:01.999+0000 7f17e9ffb700 1 -- 172.21.15.80:0/1834662589 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e400e070 con 0x7f17ec15aff0 2024-05-08T21:12:02.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:01.999+0000 7f17e9ffb700 1 -- 172.21.15.80:0/1834662589 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17e400b8d0 con 0x7f17ec15aff0 2024-05-08T21:12:02.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:01.999+0000 7f17e9ffb700 1 -- 172.21.15.80:0/1834662589 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e400bc80 con 0x7f17ec15aff0 2024-05-08T21:12:02.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:02.000+0000 7f17f16cc700 1 -- 172.21.15.80:0/1834662589 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f17ec15aff0 msgr2=0x7f17ec0c73f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:02.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:02.000+0000 7f17f16cc700 1 --2- 172.21.15.80:0/1834662589 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f17ec15aff0 0x7f17ec0c73f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f17ec06cb90 tx=0x7f17e400b330 comp rx=0 tx=0).stop 2024-05-08T21:12:02.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:02.000+0000 7f17f16cc700 1 -- 172.21.15.80:0/1834662589 shutdown_connections 2024-05-08T21:12:02.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:02.000+0000 7f17f16cc700 1 --2- 172.21.15.80:0/1834662589 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f17ec15aff0 0x7f17ec0c73f0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:02.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:02.000+0000 7f17f16cc700 1 --2- 172.21.15.80:0/1834662589 >> v2:172.21.15.106:3300/0 conn(0x7f17ec151010 0x7f17ec15aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:02.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:02.000+0000 7f17f16cc700 1 -- 172.21.15.80:0/1834662589 >> 172.21.15.80:0/1834662589 conn(0x7f17ec0c9310 msgr2=0x7f17ec0c9720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:12:02.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:02.000+0000 7f17f16cc700 1 -- 172.21.15.80:0/1834662589 shutdown_connections 2024-05-08T21:12:02.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:02.000+0000 7f17f16cc700 1 -- 172.21.15.80:0/1834662589 wait complete. 2024-05-08T21:12:02.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:02.002+0000 7f17f16cc700 1 Processor -- start 2024-05-08T21:12:02.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:02.002+0000 7f17f16cc700 1 -- start start 2024-05-08T21:12:02.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:02.003+0000 7f17f16cc700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f17ec151010 0x7f17ec1466a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:12:02.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:02.003+0000 7f17f16cc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f17ec156dc0 0x7f17ec1f0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:12:02.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:02.003+0000 7f17f16cc700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17ec15aff0 0x7f17ec1f09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:12:02.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:02.003+0000 7f17f16cc700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17ec0cbfe0 con 0x7f17ec156dc0 2024-05-08T21:12:02.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:02.003+0000 7f17f16cc700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17ec1effd0 con 0x7f17ec15aff0 2024-05-08T21:12:02.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:02.003+0000 7f17f16cc700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17ec1f41f0 con 0x7f17ec151010 2024-05-08T21:12:02.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:02.004+0000 7f17eaffd700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f17ec151010 0x7f17ec1466a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:12:02.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:02.004+0000 7f17eaffd700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f17ec151010 0x7f17ec1466a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:47306/0 (socket says 172.21.15.80:47306) 2024-05-08T21:12:02.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:02.004+0000 7f17eaffd700 1 -- 172.21.15.80:0/2891455721 learned_addr learned my addr 172.21.15.80:0/2891455721 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:12:02.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:02.004+0000 7f17ea7fc700 1 --2- 172.21.15.80:0/2891455721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f17ec156dc0 0x7f17ec1f0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:12:02.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:02.004+0000 7f17eb7fe700 1 --2- 172.21.15.80:0/2891455721 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17ec15aff0 0x7f17ec1f09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:12:02.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:02.004+0000 7f17eaffd700 1 -- 172.21.15.80:0/2891455721 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17ec15aff0 msgr2=0x7f17ec1f09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:02.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:02.004+0000 7f17eaffd700 1 --2- 172.21.15.80:0/2891455721 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17ec15aff0 0x7f17ec1f09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:02.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:02.004+0000 7f17eaffd700 1 -- 172.21.15.80:0/2891455721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f17ec156dc0 msgr2=0x7f17ec1f0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:02.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:02.004+0000 7f17eaffd700 1 --2- 172.21.15.80:0/2891455721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f17ec156dc0 0x7f17ec1f0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:02.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:02.004+0000 7f17eaffd700 1 -- 172.21.15.80:0/2891455721 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17e4009b30 con 0x7f17ec151010 2024-05-08T21:12:02.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:02.004+0000 7f17eaffd700 1 --2- 172.21.15.80:0/2891455721 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f17ec151010 0x7f17ec1466a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f17dc00e9e0 tx=0x7f17dc00ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:12:02.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:02.004+0000 7f17d37fe700 1 -- 172.21.15.80:0/2891455721 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17dc009710 con 0x7f17ec151010 2024-05-08T21:12:02.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:02.004+0000 7f17d37fe700 1 -- 172.21.15.80:0/2891455721 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17dc00ee80 con 0x7f17ec151010 2024-05-08T21:12:02.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:02.004+0000 7f17d37fe700 1 -- 172.21.15.80:0/2891455721 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17dc00ca50 con 0x7f17ec151010 2024-05-08T21:12:02.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:02.004+0000 7f17f16cc700 1 -- 172.21.15.80:0/2891455721 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17ec1f3670 con 0x7f17ec151010 2024-05-08T21:12:02.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:02.005+0000 7f17f16cc700 1 -- 172.21.15.80:0/2891455721 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17ec1f3c30 con 0x7f17ec151010 2024-05-08T21:12:02.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:02.006+0000 7f17f16cc700 1 -- 172.21.15.80:0/2891455721 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17ec1f02b0 con 0x7f17ec151010 2024-05-08T21:12:02.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:02.006+0000 7f17d37fe700 1 -- 172.21.15.80:0/2891455721 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f17dc00cbb0 con 0x7f17ec151010 2024-05-08T21:12:02.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:02.007+0000 7f17d37fe700 1 --2- 172.21.15.80:0/2891455721 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f17d806ac90 0x7f17d806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:12:02.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:02.007+0000 7f17d37fe700 1 -- 172.21.15.80:0/2891455721 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f17dc0896a0 con 0x7f17ec151010 2024-05-08T21:12:02.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:02.007+0000 7f17ea7fc700 1 --2- 172.21.15.80:0/2891455721 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f17d806ac90 0x7f17d806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:12:02.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:02.007+0000 7f17ea7fc700 1 --2- 172.21.15.80:0/2891455721 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f17d806ac90 0x7f17d806d150 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f17ec14b2e0 tx=0x7f17e0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:12:02.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:02.011+0000 7f17d37fe700 1 -- 172.21.15.80:0/2891455721 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f17dc0544c0 con 0x7f17ec151010 2024-05-08T21:12:02.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:02.492+0000 7f17f16cc700 1 -- 172.21.15.80:0/2891455721 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f17ec1efda0 con 0x7f17ec151010 2024-05-08T21:12:02.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:02.493+0000 7f17d37fe700 1 -- 172.21.15.80:0/2891455721 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6254 (secure 0 0 0) 0x7f17ec1efda0 con 0x7f17ec151010 2024-05-08T21:12:02.496 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:12:02.496 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/2289230272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":2289230272},{"type":"v1","addr":"172.21.15.106:6833","nonce":2289230272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:10:31.304591+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.106:6836/1949999190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1949999190},{"type":"v1","addr":"172.21.15.106:6836","nonce":1949999190}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:12:02.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:02.496+0000 7f17f16cc700 1 -- 172.21.15.80:0/2891455721 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f17d806ac90 msgr2=0x7f17d806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:02.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:02.496+0000 7f17f16cc700 1 --2- 172.21.15.80:0/2891455721 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f17d806ac90 0x7f17d806d150 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f17ec14b2e0 tx=0x7f17e0009040 comp rx=0 tx=0).stop 2024-05-08T21:12:02.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:02.496+0000 7f17f16cc700 1 -- 172.21.15.80:0/2891455721 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f17ec151010 msgr2=0x7f17ec1466a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:02.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:02.496+0000 7f17f16cc700 1 --2- 172.21.15.80:0/2891455721 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f17ec151010 0x7f17ec1466a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f17dc00e9e0 tx=0x7f17dc00ecf0 comp rx=0 tx=0).stop 2024-05-08T21:12:02.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:02.496+0000 7f17f16cc700 1 -- 172.21.15.80:0/2891455721 shutdown_connections 2024-05-08T21:12:02.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:02.496+0000 7f17f16cc700 1 --2- 172.21.15.80:0/2891455721 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f17d806ac90 0x7f17d806d150 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:02.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:02.496+0000 7f17f16cc700 1 --2- 172.21.15.80:0/2891455721 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17ec15aff0 0x7f17ec1f09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:02.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:02.496+0000 7f17f16cc700 1 --2- 172.21.15.80:0/2891455721 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f17ec151010 0x7f17ec1466a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:02.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:02.496+0000 7f17f16cc700 1 --2- 172.21.15.80:0/2891455721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f17ec156dc0 0x7f17ec1f0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:02.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:02.496+0000 7f17f16cc700 1 -- 172.21.15.80:0/2891455721 >> 172.21.15.80:0/2891455721 conn(0x7f17ec0c9310 msgr2=0x7f17ec0c6700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:12:02.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:02.496+0000 7f17f16cc700 1 -- 172.21.15.80:0/2891455721 shutdown_connections 2024-05-08T21:12:02.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:02.496+0000 7f17f16cc700 1 -- 172.21.15.80:0/2891455721 wait complete. 2024-05-08T21:12:02.500 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 10 2024-05-08T21:12:02.516 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-05-08T21:12:04.517 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:12:04.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:04.643+0000 7f40ea5e4700 1 Processor -- start 2024-05-08T21:12:04.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:04.643+0000 7f40ea5e4700 1 -- start start 2024-05-08T21:12:04.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:04.644+0000 7f40ea5e4700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f40e4071390 0x7f40e40c97f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:12:04.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:04.644+0000 7f40ea5e4700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f40e406bad0 0x7f40e406bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:12:04.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:04.644+0000 7f40ea5e4700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40e40c7950 con 0x7f40e4150dd0 2024-05-08T21:12:04.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:04.644+0000 7f40ea5e4700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40e40c93d0 con 0x7f40e406bad0 2024-05-08T21:12:04.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:04.644+0000 7f40ea5e4700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40e4071820 con 0x7f40e4071390 2024-05-08T21:12:04.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:04.644+0000 7f40e8b81700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f40e406bad0 0x7f40e406bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:12:04.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:04.644+0000 7f40e8b81700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f40e406bad0 0x7f40e406bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50484/0 (socket says 172.21.15.80:50484) 2024-05-08T21:12:04.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:04.644+0000 7f40e8b81700 1 -- 172.21.15.80:0/4055458689 learned_addr learned my addr 172.21.15.80:0/4055458689 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:12:04.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:04.644+0000 7f40e37fe700 1 --2- 172.21.15.80:0/4055458689 >> v2:172.21.15.106:3300/0 conn(0x7f40e4071390 0x7f40e40c97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:12:04.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:04.644+0000 7f40e8b81700 1 -- 172.21.15.80:0/4055458689 >> v2:172.21.15.106:3300/0 conn(0x7f40e4071390 msgr2=0x7f40e40c97f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:12:04.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:04.644+0000 7f40e8b81700 1 --2- 172.21.15.80:0/4055458689 >> v2:172.21.15.106:3300/0 conn(0x7f40e4071390 0x7f40e40c97f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:04.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:04.644+0000 7f40e8b81700 1 -- 172.21.15.80:0/4055458689 >> v1:172.21.15.106:6789/0 conn(0x7f40e4150dd0 legacy=0x7f40e4157940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:04.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:04.644+0000 7f40e8b81700 1 -- 172.21.15.80:0/4055458689 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e40c8a30 con 0x7f40e406bad0 2024-05-08T21:12:04.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:04.645+0000 7f40e8b81700 1 --2- 172.21.15.80:0/4055458689 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f40e406bad0 0x7f40e406bf40 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f40e40c4ca0 tx=0x7f40dc00d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f0bae7a53ab7d2f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:12:04.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:04.646+0000 7f40e2ffd700 1 -- 172.21.15.80:0/4055458689 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40dc010070 con 0x7f40e406bad0 2024-05-08T21:12:04.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:04.646+0000 7f40e2ffd700 1 -- 172.21.15.80:0/4055458689 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40dc00dce0 con 0x7f40e406bad0 2024-05-08T21:12:04.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:04.646+0000 7f40e2ffd700 1 -- 172.21.15.80:0/4055458689 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40dc00b310 con 0x7f40e406bad0 2024-05-08T21:12:04.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:04.646+0000 7f40ea5e4700 1 -- 172.21.15.80:0/4055458689 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f40e406bad0 msgr2=0x7f40e406bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:04.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:04.646+0000 7f40ea5e4700 1 --2- 172.21.15.80:0/4055458689 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f40e406bad0 0x7f40e406bf40 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f40e40c4ca0 tx=0x7f40dc00d430 comp rx=0 tx=0).stop 2024-05-08T21:12:04.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:04.647+0000 7f40ea5e4700 1 -- 172.21.15.80:0/4055458689 shutdown_connections 2024-05-08T21:12:04.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:04.647+0000 7f40ea5e4700 1 --2- 172.21.15.80:0/4055458689 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f40e406bad0 0x7f40e406bf40 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:04.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:04.647+0000 7f40ea5e4700 1 --2- 172.21.15.80:0/4055458689 >> v2:172.21.15.106:3300/0 conn(0x7f40e4071390 0x7f40e40c97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:04.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:04.647+0000 7f40ea5e4700 1 -- 172.21.15.80:0/4055458689 >> 172.21.15.80:0/4055458689 conn(0x7f40e406ef80 msgr2=0x7f40e406f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:12:04.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:04.647+0000 7f40ea5e4700 1 -- 172.21.15.80:0/4055458689 shutdown_connections 2024-05-08T21:12:04.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:04.647+0000 7f40ea5e4700 1 -- 172.21.15.80:0/4055458689 wait complete. 2024-05-08T21:12:04.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:04.648+0000 7f40ea5e4700 1 Processor -- start 2024-05-08T21:12:04.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:04.649+0000 7f40ea5e4700 1 -- start start 2024-05-08T21:12:04.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:04.650+0000 7f40ea5e4700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f40e406bad0 0x7f40e41ec150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:12:04.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:04.650+0000 7f40ea5e4700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f40e4071390 0x7f40e415aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:12:04.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:04.650+0000 7f40ea5e4700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f40e4150dd0 0x7f40e41e2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:12:04.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:04.650+0000 7f40ea5e4700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e41ec690 con 0x7f40e406bad0 2024-05-08T21:12:04.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:04.650+0000 7f40ea5e4700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e41e25c0 con 0x7f40e4150dd0 2024-05-08T21:12:04.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:04.650+0000 7f40ea5e4700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40e41e0b90 con 0x7f40e4071390 2024-05-08T21:12:04.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:04.650+0000 7f40e3fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f40e406bad0 0x7f40e41ec150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:12:04.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:04.650+0000 7f40e3fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f40e406bad0 0x7f40e41ec150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50486/0 (socket says 172.21.15.80:50486) 2024-05-08T21:12:04.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:04.650+0000 7f40e3fff700 1 -- 172.21.15.80:0/2803860901 learned_addr learned my addr 172.21.15.80:0/2803860901 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:12:04.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:04.650+0000 7f40e8b81700 1 --2- 172.21.15.80:0/2803860901 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f40e4150dd0 0x7f40e41e2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:12:04.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:04.650+0000 7f40e37fe700 1 --2- 172.21.15.80:0/2803860901 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f40e4071390 0x7f40e415aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:12:04.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:04.650+0000 7f40e3fff700 1 -- 172.21.15.80:0/2803860901 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f40e4071390 msgr2=0x7f40e415aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:04.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:04.650+0000 7f40e3fff700 1 --2- 172.21.15.80:0/2803860901 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f40e4071390 0x7f40e415aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:04.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:04.650+0000 7f40e3fff700 1 -- 172.21.15.80:0/2803860901 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f40e4150dd0 msgr2=0x7f40e41e2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:04.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:04.650+0000 7f40e3fff700 1 --2- 172.21.15.80:0/2803860901 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f40e4150dd0 0x7f40e41e2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:04.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:04.650+0000 7f40e3fff700 1 -- 172.21.15.80:0/2803860901 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40dc00bd40 con 0x7f40e406bad0 2024-05-08T21:12:04.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:04.650+0000 7f40e8b81700 1 --2- 172.21.15.80:0/2803860901 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f40e4150dd0 0x7f40e41e2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:12:04.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:04.651+0000 7f40e3fff700 1 --2- 172.21.15.80:0/2803860901 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f40e406bad0 0x7f40e41ec150 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f40d400c450 tx=0x7f40d400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:12:04.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:04.651+0000 7f40e0ff9700 1 -- 172.21.15.80:0/2803860901 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d40052d0 con 0x7f40e406bad0 2024-05-08T21:12:04.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:04.651+0000 7f40e0ff9700 1 -- 172.21.15.80:0/2803860901 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40d4005430 con 0x7f40e406bad0 2024-05-08T21:12:04.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:04.651+0000 7f40ea5e4700 1 -- 172.21.15.80:0/2803860901 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40e41e0e70 con 0x7f40e406bad0 2024-05-08T21:12:04.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:04.651+0000 7f40e0ff9700 1 -- 172.21.15.80:0/2803860901 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d40119b0 con 0x7f40e406bad0 2024-05-08T21:12:04.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:04.651+0000 7f40ea5e4700 1 -- 172.21.15.80:0/2803860901 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40e41e2250 con 0x7f40e406bad0 2024-05-08T21:12:04.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:04.653+0000 7f40ea5e4700 1 -- 172.21.15.80:0/2803860901 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40e41e1390 con 0x7f40e406bad0 2024-05-08T21:12:04.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:04.653+0000 7f40e0ff9700 1 -- 172.21.15.80:0/2803860901 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f40d4011b10 con 0x7f40e406bad0 2024-05-08T21:12:04.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:04.653+0000 7f40e0ff9700 1 --2- 172.21.15.80:0/2803860901 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f40d006ac90 0x7f40d006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:12:04.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:04.653+0000 7f40e0ff9700 1 -- 172.21.15.80:0/2803860901 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f40d408ce50 con 0x7f40e406bad0 2024-05-08T21:12:04.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:04.653+0000 7f40e37fe700 1 --2- 172.21.15.80:0/2803860901 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f40d006ac90 0x7f40d006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:12:04.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:04.654+0000 7f40e37fe700 1 --2- 172.21.15.80:0/2803860901 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f40d006ac90 0x7f40d006d150 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f40e40cc6d0 tx=0x7f40d8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:12:04.665 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:04.662+0000 7f40e0ff9700 1 -- 172.21.15.80:0/2803860901 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f40d4057bf0 con 0x7f40e406bad0 2024-05-08T21:12:05.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:05.095+0000 7f40ea5e4700 1 -- 172.21.15.80:0/2803860901 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f40e404ec60 con 0x7f40e406bad0 2024-05-08T21:12:05.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:05.095+0000 7f40e0ff9700 1 -- 172.21.15.80:0/2803860901 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6254 (secure 0 0 0) 0x7f40d405b210 con 0x7f40e406bad0 2024-05-08T21:12:05.099 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:12:05.099 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/2289230272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":2289230272},{"type":"v1","addr":"172.21.15.106:6833","nonce":2289230272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:10:31.304591+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.106:6836/1949999190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1949999190},{"type":"v1","addr":"172.21.15.106:6836","nonce":1949999190}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:12:05.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:05.097+0000 7f40ea5e4700 1 -- 172.21.15.80:0/2803860901 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f40d006ac90 msgr2=0x7f40d006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:05.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:05.097+0000 7f40ea5e4700 1 --2- 172.21.15.80:0/2803860901 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f40d006ac90 0x7f40d006d150 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f40e40cc6d0 tx=0x7f40d8008040 comp rx=0 tx=0).stop 2024-05-08T21:12:05.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:05.097+0000 7f40ea5e4700 1 -- 172.21.15.80:0/2803860901 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f40e406bad0 msgr2=0x7f40e41ec150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:05.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:05.097+0000 7f40ea5e4700 1 --2- 172.21.15.80:0/2803860901 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f40e406bad0 0x7f40e41ec150 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f40d400c450 tx=0x7f40d400c810 comp rx=0 tx=0).stop 2024-05-08T21:12:05.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:05.097+0000 7f40ea5e4700 1 -- 172.21.15.80:0/2803860901 shutdown_connections 2024-05-08T21:12:05.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:05.097+0000 7f40ea5e4700 1 --2- 172.21.15.80:0/2803860901 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f40d006ac90 0x7f40d006d150 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:05.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:05.097+0000 7f40ea5e4700 1 --2- 172.21.15.80:0/2803860901 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f40e406bad0 0x7f40e41ec150 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:05.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:05.097+0000 7f40ea5e4700 1 --2- 172.21.15.80:0/2803860901 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f40e4150dd0 0x7f40e41e2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:05.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:05.097+0000 7f40ea5e4700 1 --2- 172.21.15.80:0/2803860901 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f40e4071390 0x7f40e415aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:05.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:05.097+0000 7f40ea5e4700 1 -- 172.21.15.80:0/2803860901 >> 172.21.15.80:0/2803860901 conn(0x7f40e406ef80 msgr2=0x7f40e4157840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:12:05.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:05.098+0000 7f40ea5e4700 1 -- 172.21.15.80:0/2803860901 shutdown_connections 2024-05-08T21:12:05.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:05.098+0000 7f40ea5e4700 1 -- 172.21.15.80:0/2803860901 wait complete. 2024-05-08T21:12:05.102 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 10 2024-05-08T21:12:05.113 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-05-08T21:12:07.115 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:12:07.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.245+0000 7f8c33a23700 1 Processor -- start 2024-05-08T21:12:07.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.245+0000 7f8c33a23700 1 -- start start 2024-05-08T21:12:07.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.246+0000 7f8c33a23700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8c2c154580 0x7f8c2c15abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:12:07.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.246+0000 7f8c33a23700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c2c0cad60 con 0x7f8c2c0cbe40 2024-05-08T21:12:07.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.246+0000 7f8c33a23700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c2c15d930 con 0x7f8c2c0cc3d0 2024-05-08T21:12:07.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.246+0000 7f8c33a23700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c2c0b2c60 con 0x7f8c2c154580 2024-05-08T21:12:07.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.246+0000 7f8c317bf700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8c2c154580 0x7f8c2c15abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:12:07.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.246+0000 7f8c30fbe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f8c2c0cbe40 0x7f8c2c0c48c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:54868/0 (socket says 172.21.15.80:54868) 2024-05-08T21:12:07.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.246+0000 7f8c30fbe700 1 -- 172.21.15.80:0/430615563 learned_addr learned my addr 172.21.15.80:0/430615563 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:12:07.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.247+0000 7f8c317bf700 1 -- 172.21.15.80:0/430615563 >> v1:172.21.15.106:6789/0 conn(0x7f8c2c0cc3d0 legacy=0x7f8c2c164ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:07.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.247+0000 7f8c317bf700 1 -- 172.21.15.80:0/430615563 >> v1:172.21.15.80:6789/0 conn(0x7f8c2c0cbe40 legacy=0x7f8c2c0c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:07.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.247+0000 7f8c317bf700 1 -- 172.21.15.80:0/430615563 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c2c15dc10 con 0x7f8c2c154580 2024-05-08T21:12:07.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.247+0000 7f8c23fff700 1 -- 172.21.15.80:0/430615563 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 944793545 0 0) 0x7f8c2c0cad60 con 0x7f8c2c0cbe40 2024-05-08T21:12:07.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.247+0000 7f8c317bf700 1 --2- 172.21.15.80:0/430615563 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8c2c154580 0x7f8c2c15abe0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8c28009840 tx=0x7f8c28009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c87bb085bf18b539 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:12:07.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.247+0000 7f8c23fff700 1 -- 172.21.15.80:0/430615563 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c28011830 con 0x7f8c2c154580 2024-05-08T21:12:07.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.247+0000 7f8c23fff700 1 -- 172.21.15.80:0/430615563 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c28011990 con 0x7f8c2c154580 2024-05-08T21:12:07.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.247+0000 7f8c23fff700 1 -- 172.21.15.80:0/430615563 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c28011d20 con 0x7f8c2c154580 2024-05-08T21:12:07.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.248+0000 7f8c33a23700 1 -- 172.21.15.80:0/430615563 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8c2c154580 msgr2=0x7f8c2c15abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:07.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.248+0000 7f8c33a23700 1 --2- 172.21.15.80:0/430615563 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8c2c154580 0x7f8c2c15abe0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8c28009840 tx=0x7f8c28009b50 comp rx=0 tx=0).stop 2024-05-08T21:12:07.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.248+0000 7f8c33a23700 1 -- 172.21.15.80:0/430615563 shutdown_connections 2024-05-08T21:12:07.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.248+0000 7f8c33a23700 1 --2- 172.21.15.80:0/430615563 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8c2c154580 0x7f8c2c15abe0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:07.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.248+0000 7f8c33a23700 1 -- 172.21.15.80:0/430615563 >> 172.21.15.80:0/430615563 conn(0x7f8c2c06c6a0 msgr2=0x7f8c2c06cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:12:07.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.249+0000 7f8c33a23700 1 -- 172.21.15.80:0/430615563 shutdown_connections 2024-05-08T21:12:07.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.249+0000 7f8c33a23700 1 -- 172.21.15.80:0/430615563 wait complete. 2024-05-08T21:12:07.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.250+0000 7f8c33a23700 1 Processor -- start 2024-05-08T21:12:07.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.250+0000 7f8c33a23700 1 -- start start 2024-05-08T21:12:07.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.251+0000 7f8c33a23700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c2c0cbe40 0x7f8c2c1f4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:12:07.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.251+0000 7f8c33a23700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c2c0cc3d0 0x7f8c2c0b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:12:07.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.251+0000 7f8c33a23700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8c2c154580 0x7f8c2c1f07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:12:07.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.251+0000 7f8c33a23700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2c15d750 con 0x7f8c2c154580 2024-05-08T21:12:07.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.251+0000 7f8c33a23700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2c1f0380 con 0x7f8c2c0cc3d0 2024-05-08T21:12:07.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.251+0000 7f8c33a23700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2c152540 con 0x7f8c2c0cbe40 2024-05-08T21:12:07.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.251+0000 7f8c31fc0700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8c2c154580 0x7f8c2c1f07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:12:07.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.251+0000 7f8c31fc0700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8c2c154580 0x7f8c2c1f07a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50510/0 (socket says 172.21.15.80:50510) 2024-05-08T21:12:07.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.251+0000 7f8c31fc0700 1 -- 172.21.15.80:0/1956684212 learned_addr learned my addr 172.21.15.80:0/1956684212 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:12:07.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.251+0000 7f8c317bf700 1 --2- 172.21.15.80:0/1956684212 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c2c0cbe40 0x7f8c2c1f4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:12:07.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.251+0000 7f8c30fbe700 1 --2- 172.21.15.80:0/1956684212 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c2c0cc3d0 0x7f8c2c0b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:12:07.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.252+0000 7f8c31fc0700 1 -- 172.21.15.80:0/1956684212 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c2c0cbe40 msgr2=0x7f8c2c1f4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:07.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.252+0000 7f8c31fc0700 1 --2- 172.21.15.80:0/1956684212 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c2c0cbe40 0x7f8c2c1f4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:07.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.252+0000 7f8c31fc0700 1 -- 172.21.15.80:0/1956684212 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c2c0cc3d0 msgr2=0x7f8c2c0b4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:07.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.252+0000 7f8c31fc0700 1 --2- 172.21.15.80:0/1956684212 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c2c0cc3d0 0x7f8c2c0b4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:07.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.252+0000 7f8c31fc0700 1 -- 172.21.15.80:0/1956684212 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c280094a0 con 0x7f8c2c154580 2024-05-08T21:12:07.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.252+0000 7f8c31fc0700 1 --2- 172.21.15.80:0/1956684212 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8c2c154580 0x7f8c2c1f07a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8c2400cc80 tx=0x7f8c2400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:12:07.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.252+0000 7f8c21ffb700 1 -- 172.21.15.80:0/1956684212 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c24003c00 con 0x7f8c2c154580 2024-05-08T21:12:07.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.252+0000 7f8c21ffb700 1 -- 172.21.15.80:0/1956684212 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c24003d60 con 0x7f8c2c154580 2024-05-08T21:12:07.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.252+0000 7f8c21ffb700 1 -- 172.21.15.80:0/1956684212 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2400aaa0 con 0x7f8c2c154580 2024-05-08T21:12:07.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.252+0000 7f8c33a23700 1 -- 172.21.15.80:0/1956684212 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c2c1f4550 con 0x7f8c2c154580 2024-05-08T21:12:07.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.253+0000 7f8c33a23700 1 -- 172.21.15.80:0/1956684212 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c2c151ca0 con 0x7f8c2c154580 2024-05-08T21:12:07.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.254+0000 7f8c21ffb700 1 -- 172.21.15.80:0/1956684212 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8c2400ac00 con 0x7f8c2c154580 2024-05-08T21:12:07.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.254+0000 7f8c21ffb700 1 --2- 172.21.15.80:0/1956684212 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f8c1006ac90 0x7f8c1006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:12:07.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.254+0000 7f8c33a23700 1 -- 172.21.15.80:0/1956684212 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c2c1f04c0 con 0x7f8c2c154580 2024-05-08T21:12:07.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.254+0000 7f8c21ffb700 1 -- 172.21.15.80:0/1956684212 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f8c240896c0 con 0x7f8c2c154580 2024-05-08T21:12:07.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.254+0000 7f8c317bf700 1 --2- 172.21.15.80:0/1956684212 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f8c1006ac90 0x7f8c1006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:12:07.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.255+0000 7f8c317bf700 1 --2- 172.21.15.80:0/1956684212 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f8c1006ac90 0x7f8c1006d150 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8c280090b0 tx=0x7f8c28008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:12:07.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.259+0000 7f8c21ffb700 1 -- 172.21.15.80:0/1956684212 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f8c2c1f04c0 con 0x7f8c2c154580 2024-05-08T21:12:07.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.683+0000 7f8c33a23700 1 -- 172.21.15.80:0/1956684212 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8c2c1f04c0 con 0x7f8c2c154580 2024-05-08T21:12:07.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.684+0000 7f8c21ffb700 1 -- 172.21.15.80:0/1956684212 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+5497 (secure 0 0 0) 0x7f8c2c1f04c0 con 0x7f8c2c154580 2024-05-08T21:12:07.688 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:12:07.688 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":11,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:12:06.229444+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":11,"state":"up:replay","state_seq":1,"addr":"172.21.15.106:6833/2289230272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":2289230272},{"type":"v1","addr":"172.21.15.106:6833","nonce":2289230272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:12:07.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.687+0000 7f8c33a23700 1 -- 172.21.15.80:0/1956684212 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f8c1006ac90 msgr2=0x7f8c1006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:07.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.687+0000 7f8c33a23700 1 --2- 172.21.15.80:0/1956684212 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f8c1006ac90 0x7f8c1006d150 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8c280090b0 tx=0x7f8c28008030 comp rx=0 tx=0).stop 2024-05-08T21:12:07.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.687+0000 7f8c33a23700 1 -- 172.21.15.80:0/1956684212 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8c2c154580 msgr2=0x7f8c2c1f07a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:07.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.687+0000 7f8c33a23700 1 --2- 172.21.15.80:0/1956684212 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8c2c154580 0x7f8c2c1f07a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8c2400cc80 tx=0x7f8c2400cf90 comp rx=0 tx=0).stop 2024-05-08T21:12:07.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.687+0000 7f8c33a23700 1 -- 172.21.15.80:0/1956684212 shutdown_connections 2024-05-08T21:12:07.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.687+0000 7f8c33a23700 1 --2- 172.21.15.80:0/1956684212 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f8c1006ac90 0x7f8c1006d150 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:07.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.687+0000 7f8c33a23700 1 --2- 172.21.15.80:0/1956684212 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8c2c154580 0x7f8c2c1f07a0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:07.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.687+0000 7f8c33a23700 1 --2- 172.21.15.80:0/1956684212 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c2c0cbe40 0x7f8c2c1f4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:07.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.687+0000 7f8c33a23700 1 --2- 172.21.15.80:0/1956684212 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c2c0cc3d0 0x7f8c2c0b4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:07.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.687+0000 7f8c33a23700 1 -- 172.21.15.80:0/1956684212 >> 172.21.15.80:0/1956684212 conn(0x7f8c2c06c6a0 msgr2=0x7f8c2c1530b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:12:07.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.688+0000 7f8c33a23700 1 -- 172.21.15.80:0/1956684212 shutdown_connections 2024-05-08T21:12:07.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.688+0000 7f8c33a23700 1 -- 172.21.15.80:0/1956684212 wait complete. 2024-05-08T21:12:07.692 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 11 2024-05-08T21:12:07.708 INFO:tasks.mds_thrash.fs.[cephfs]:mds.d down, removed from mdsmap 2024-05-08T21:12:07.708 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for mds cluster to stabilize... 2024-05-08T21:12:07.709 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:12:07.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.834+0000 7f0101d9c700 1 Processor -- start 2024-05-08T21:12:07.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.834+0000 7f0101d9c700 1 -- start start 2024-05-08T21:12:07.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.834+0000 7f0101d9c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f00fc06ad30 0x7f00fc06b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:12:07.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.834+0000 7f0101d9c700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f00fc161b70 0x7f00fc161fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:12:07.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.835+0000 7f0101d9c700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00fc06b6f0 con 0x7f00fc158540 2024-05-08T21:12:07.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.835+0000 7f0101d9c700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00fc06c2d0 con 0x7f00fc06ad30 2024-05-08T21:12:07.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.835+0000 7f0101d9c700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00fc0c8c50 con 0x7f00fc161b70 2024-05-08T21:12:07.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.835+0000 7f00fbfff700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f00fc161b70 0x7f00fc161fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:12:07.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.835+0000 7f00fb7fe700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f00fc158540 0x7f00fc15f000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.80:38554/0 (socket says 172.21.15.80:38554) 2024-05-08T21:12:07.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.835+0000 7f00fb7fe700 1 -- 172.21.15.80:0/1705522903 learned_addr learned my addr 172.21.15.80:0/1705522903 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:12:07.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.835+0000 7f00faffd700 1 --2- 172.21.15.80:0/1705522903 >> v2:172.21.15.80:3300/0 conn(0x7f00fc06ad30 0x7f00fc06b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:12:07.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.835+0000 7f00fa7fc700 1 -- 172.21.15.80:0/1705522903 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1109116266 0 0) 0x7f00fc06b6f0 con 0x7f00fc158540 2024-05-08T21:12:07.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.835+0000 7f00fa7fc700 1 -- 172.21.15.80:0/1705522903 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00e40035b0 con 0x7f00fc158540 2024-05-08T21:12:07.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.835+0000 7f00faffd700 1 -- 172.21.15.80:0/1705522903 >> v2:172.21.15.106:3300/0 conn(0x7f00fc161b70 msgr2=0x7f00fc161fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:12:07.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.835+0000 7f00faffd700 1 --2- 172.21.15.80:0/1705522903 >> v2:172.21.15.106:3300/0 conn(0x7f00fc161b70 0x7f00fc161fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:07.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.835+0000 7f00faffd700 1 -- 172.21.15.80:0/1705522903 >> v1:172.21.15.106:6789/0 conn(0x7f00fc158540 legacy=0x7f00fc15f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:07.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.835+0000 7f00faffd700 1 -- 172.21.15.80:0/1705522903 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00fc0c8f30 con 0x7f00fc06ad30 2024-05-08T21:12:07.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.835+0000 7f00faffd700 1 --2- 172.21.15.80:0/1705522903 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00fc06ad30 0x7f00fc06b1b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f00fc06df90 tx=0x7f00f0009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7d21fd8490c19e4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:12:07.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.836+0000 7f00fa7fc700 1 -- 172.21.15.80:0/1705522903 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f0011830 con 0x7f00fc06ad30 2024-05-08T21:12:07.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.836+0000 7f00fa7fc700 1 -- 172.21.15.80:0/1705522903 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00f0011990 con 0x7f00fc06ad30 2024-05-08T21:12:07.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.836+0000 7f00fa7fc700 1 -- 172.21.15.80:0/1705522903 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f0011d20 con 0x7f00fc06ad30 2024-05-08T21:12:07.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.836+0000 7f0101d9c700 1 -- 172.21.15.80:0/1705522903 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00fc06ad30 msgr2=0x7f00fc06b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:07.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.836+0000 7f0101d9c700 1 --2- 172.21.15.80:0/1705522903 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00fc06ad30 0x7f00fc06b1b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f00fc06df90 tx=0x7f00f0009b20 comp rx=0 tx=0).stop 2024-05-08T21:12:07.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.836+0000 7f0101d9c700 1 -- 172.21.15.80:0/1705522903 shutdown_connections 2024-05-08T21:12:07.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.836+0000 7f0101d9c700 1 --2- 172.21.15.80:0/1705522903 >> v2:172.21.15.106:3300/0 conn(0x7f00fc161b70 0x7f00fc161fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:07.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.836+0000 7f0101d9c700 1 --2- 172.21.15.80:0/1705522903 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00fc06ad30 0x7f00fc06b1b0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:07.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.836+0000 7f0101d9c700 1 -- 172.21.15.80:0/1705522903 >> 172.21.15.80:0/1705522903 conn(0x7f00fc06ef80 msgr2=0x7f00fc06f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:12:07.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.836+0000 7f0101d9c700 1 -- 172.21.15.80:0/1705522903 shutdown_connections 2024-05-08T21:12:07.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.836+0000 7f0101d9c700 1 -- 172.21.15.80:0/1705522903 wait complete. 2024-05-08T21:12:07.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.838+0000 7f0101d9c700 1 Processor -- start 2024-05-08T21:12:07.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.838+0000 7f0101d9c700 1 -- start start 2024-05-08T21:12:07.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.839+0000 7f0101d9c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00fc06ad30 0x7f00fc200640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:12:07.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.839+0000 7f0101d9c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00fc158540 0x7f00fc0cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:12:07.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.839+0000 7f0101d9c700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f00fc161b70 0x7f00fc152dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:12:07.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.839+0000 7f0101d9c700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00fc1528d0 con 0x7f00fc06ad30 2024-05-08T21:12:07.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.839+0000 7f0101d9c700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00fc15c0d0 con 0x7f00fc158540 2024-05-08T21:12:07.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.839+0000 7f0101d9c700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00fc0c5af0 con 0x7f00fc161b70 2024-05-08T21:12:07.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.839+0000 7f00fb7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00fc06ad30 0x7f00fc200640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:12:07.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.839+0000 7f00fb7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00fc06ad30 0x7f00fc200640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50532/0 (socket says 172.21.15.80:50532) 2024-05-08T21:12:07.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.839+0000 7f00fb7fe700 1 -- 172.21.15.80:0/1385389803 learned_addr learned my addr 172.21.15.80:0/1385389803 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:12:07.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.839+0000 7f00fbfff700 1 --2- 172.21.15.80:0/1385389803 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f00fc161b70 0x7f00fc152dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:12:07.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.839+0000 7f00faffd700 1 --2- 172.21.15.80:0/1385389803 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00fc158540 0x7f00fc0cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:12:07.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.840+0000 7f00fb7fe700 1 -- 172.21.15.80:0/1385389803 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f00fc161b70 msgr2=0x7f00fc152dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:07.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.840+0000 7f00fb7fe700 1 --2- 172.21.15.80:0/1385389803 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f00fc161b70 0x7f00fc152dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:07.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.840+0000 7f00fb7fe700 1 -- 172.21.15.80:0/1385389803 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00fc158540 msgr2=0x7f00fc0cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:07.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.840+0000 7f00fb7fe700 1 --2- 172.21.15.80:0/1385389803 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00fc158540 0x7f00fc0cbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:07.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.840+0000 7f00fb7fe700 1 -- 172.21.15.80:0/1385389803 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f00094a0 con 0x7f00fc06ad30 2024-05-08T21:12:07.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.840+0000 7f00fbfff700 1 --2- 172.21.15.80:0/1385389803 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f00fc161b70 0x7f00fc152dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:12:07.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.840+0000 7f00fb7fe700 1 --2- 172.21.15.80:0/1385389803 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00fc06ad30 0x7f00fc200640 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f00ec00c700 tx=0x7f00ec00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:12:07.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.840+0000 7f00e3fff700 1 -- 172.21.15.80:0/1385389803 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ec005d70 con 0x7f00fc06ad30 2024-05-08T21:12:07.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.840+0000 7f00e3fff700 1 -- 172.21.15.80:0/1385389803 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00ec0070d0 con 0x7f00fc06ad30 2024-05-08T21:12:07.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.840+0000 7f0101d9c700 1 -- 172.21.15.80:0/1385389803 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00fc0c5dd0 con 0x7f00fc06ad30 2024-05-08T21:12:07.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.840+0000 7f00e3fff700 1 -- 172.21.15.80:0/1385389803 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ec007460 con 0x7f00fc06ad30 2024-05-08T21:12:07.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.840+0000 7f0101d9c700 1 -- 172.21.15.80:0/1385389803 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00fc0c6390 con 0x7f00fc06ad30 2024-05-08T21:12:07.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.841+0000 7f0101d9c700 1 -- 172.21.15.80:0/1385389803 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00fc152c20 con 0x7f00fc06ad30 2024-05-08T21:12:07.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.842+0000 7f00e3fff700 1 -- 172.21.15.80:0/1385389803 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f00ec0075c0 con 0x7f00fc06ad30 2024-05-08T21:12:07.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.842+0000 7f00e3fff700 1 --2- 172.21.15.80:0/1385389803 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f00e806ac90 0x7f00e806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:12:07.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.842+0000 7f00e3fff700 1 -- 172.21.15.80:0/1385389803 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f00ec088c50 con 0x7f00fc06ad30 2024-05-08T21:12:07.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.843+0000 7f00faffd700 1 --2- 172.21.15.80:0/1385389803 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f00e806ac90 0x7f00e806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:12:07.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.843+0000 7f00faffd700 1 --2- 172.21.15.80:0/1385389803 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f00e806ac90 0x7f00e806d150 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f00f00090b0 tx=0x7f00f0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:12:07.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:07.847+0000 7f00e3fff700 1 -- 172.21.15.80:0/1385389803 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f00ec08e020 con 0x7f00fc06ad30 2024-05-08T21:12:08.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:08.101+0000 7f0101d9c700 1 -- 172.21.15.80:0/1385389803 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f00fc06c410 con 0x7f00fc06ad30 2024-05-08T21:12:08.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:08.101+0000 7f00e3fff700 1 -- 172.21.15.80:0/1385389803 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+5497 (secure 0 0 0) 0x7f00ec017090 con 0x7f00fc06ad30 2024-05-08T21:12:08.105 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:12:08.105 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":11,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:12:06.229444+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":11,"state":"up:replay","state_seq":1,"addr":"172.21.15.106:6833/2289230272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":2289230272},{"type":"v1","addr":"172.21.15.106:6833","nonce":2289230272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:12:08.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:08.103+0000 7f0101d9c700 1 -- 172.21.15.80:0/1385389803 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f00e806ac90 msgr2=0x7f00e806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:08.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:08.103+0000 7f0101d9c700 1 --2- 172.21.15.80:0/1385389803 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f00e806ac90 0x7f00e806d150 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f00f00090b0 tx=0x7f00f0008030 comp rx=0 tx=0).stop 2024-05-08T21:12:08.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:08.103+0000 7f0101d9c700 1 -- 172.21.15.80:0/1385389803 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00fc06ad30 msgr2=0x7f00fc200640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:08.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:08.103+0000 7f0101d9c700 1 --2- 172.21.15.80:0/1385389803 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00fc06ad30 0x7f00fc200640 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f00ec00c700 tx=0x7f00ec00ca10 comp rx=0 tx=0).stop 2024-05-08T21:12:08.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:08.103+0000 7f0101d9c700 1 -- 172.21.15.80:0/1385389803 shutdown_connections 2024-05-08T21:12:08.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:08.103+0000 7f0101d9c700 1 --2- 172.21.15.80:0/1385389803 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f00e806ac90 0x7f00e806d150 secure :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f00f00090b0 tx=0x7f00f0008030 comp rx=0 tx=0).stop 2024-05-08T21:12:08.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:08.103+0000 7f0101d9c700 1 --2- 172.21.15.80:0/1385389803 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00fc06ad30 0x7f00fc200640 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:08.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:08.103+0000 7f0101d9c700 1 --2- 172.21.15.80:0/1385389803 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f00fc161b70 0x7f00fc152dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:08.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:08.103+0000 7f0101d9c700 1 --2- 172.21.15.80:0/1385389803 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00fc158540 0x7f00fc0cbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:08.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:08.103+0000 7f0101d9c700 1 -- 172.21.15.80:0/1385389803 >> 172.21.15.80:0/1385389803 conn(0x7f00fc06ef80 msgr2=0x7f00fc156200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:12:08.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:08.104+0000 7f0101d9c700 1 -- 172.21.15.80:0/1385389803 shutdown_connections 2024-05-08T21:12:08.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:08.104+0000 7f0101d9c700 1 -- 172.21.15.80:0/1385389803 wait complete. 2024-05-08T21:12:08.108 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 11 2024-05-08T21:12:08.120 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 11, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-05-08T21:10:03.725481+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 11, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_4288": { "addr": "172.21.15.106:6833/2289230272", "addrs": { "addrvec": [ { "addr": "172.21.15.106:6832", "nonce": 2289230272, "type": "v2" }, { "addr": "172.21.15.106:6833", "nonce": 2289230272, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4288, "incarnation": 11, "join_fscid": -1, "name": "b", "rank": 0, "state": "up:replay", "state_seq": 1 } }, "last_failure": 0, "last_failure_osd_epoch": 29, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-05-08T21:12:06.229444+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4288 } } } ], "standbys": [ { "addr": "172.21.15.106:6837/2762323230", "addrs": { "addrvec": [ { "addr": "172.21.15.106:6835", "nonce": 2762323230, "type": "v2" }, { "addr": "172.21.15.106:6837", "nonce": 2762323230, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4229, "incarnation": 0, "join_fscid": -1, "name": "f", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.80:6837/1121814432", "addrs": { "addrvec": [ { "addr": "172.21.15.80:6834", "nonce": 1121814432, "type": "v2" }, { "addr": "172.21.15.80:6837", "nonce": 1121814432, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4251, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.80:6839/1867024080", "addrs": { "addrvec": [ { "addr": "172.21.15.80:6838", "nonce": 1867024080, "type": "v2" }, { "addr": "172.21.15.80:6839", "nonce": 1867024080, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 2, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4254, "incarnation": 0, "join_fscid": -1, "name": "e", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.80:6836/1947012643", "addrs": { "addrvec": [ { "addr": "172.21.15.80:6835", "nonce": 1947012643, "type": "v2" }, { "addr": "172.21.15.80:6836", "nonce": 1947012643, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4273, "incarnation": 0, "join_fscid": -1, "name": "c", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-05-08T21:12:10.121 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:12:10.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.243+0000 7fa5d7f7d700 1 Processor -- start 2024-05-08T21:12:10.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.243+0000 7fa5d7f7d700 1 -- start start 2024-05-08T21:12:10.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.244+0000 7fa5d7f7d700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa5d00c75e0 0x7fa5d015ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:12:10.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.244+0000 7fa5d7f7d700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa5d00c87b0 0x7fa5d0071400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:12:10.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.244+0000 7fa5d7f7d700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5d00c7e50 con 0x7fa5d00c79c0 2024-05-08T21:12:10.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.244+0000 7fa5d7f7d700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5d0157550 con 0x7fa5d00c75e0 2024-05-08T21:12:10.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.244+0000 7fa5d7f7d700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d0157830 con 0x7fa5d00c87b0 2024-05-08T21:12:10.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.245+0000 7fa5d5518700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa5d00c87b0 0x7fa5d0071400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:12:10.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.245+0000 7fa5d5d19700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa5d00c75e0 0x7fa5d015ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:12:10.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.245+0000 7fa5d5518700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa5d00c87b0 0x7fa5d0071400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:52272/0 (socket says 172.21.15.80:52272) 2024-05-08T21:12:10.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.245+0000 7fa5d5d19700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa5d00c75e0 0x7fa5d015ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.80:50278/0 (socket says 172.21.15.80:50278) 2024-05-08T21:12:10.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.245+0000 7fa5d5518700 1 -- 172.21.15.80:0/3183323071 learned_addr learned my addr 172.21.15.80:0/3183323071 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:12:10.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.245+0000 7fa5d5518700 1 -- 172.21.15.80:0/3183323071 >> v2:172.21.15.106:3300/0 conn(0x7fa5d00c75e0 msgr2=0x7fa5d015ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:12:10.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.245+0000 7fa5d5518700 1 --2- 172.21.15.80:0/3183323071 >> v2:172.21.15.106:3300/0 conn(0x7fa5d00c75e0 0x7fa5d015ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:10.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.245+0000 7fa5d5518700 1 -- 172.21.15.80:0/3183323071 >> v1:172.21.15.106:6789/0 conn(0x7fa5d00c79c0 legacy=0x7fa5d0156d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:10.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.245+0000 7fa5d5518700 1 -- 172.21.15.80:0/3183323071 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5d0157b10 con 0x7fa5d00c87b0 2024-05-08T21:12:10.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.245+0000 7fa5d5d19700 1 --2- 172.21.15.80:0/3183323071 >> v2:172.21.15.106:3300/0 conn(0x7fa5d00c75e0 0x7fa5d015ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:12:10.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.245+0000 7fa5d5518700 1 --2- 172.21.15.80:0/3183323071 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa5d00c87b0 0x7fa5d0071400 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa5c00098f0 tx=0x7fa5c0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75e612e7502fae99 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:12:10.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.245+0000 7fa5d4d17700 1 -- 172.21.15.80:0/3183323071 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c0004230 con 0x7fa5d00c87b0 2024-05-08T21:12:10.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.245+0000 7fa5d4d17700 1 -- 172.21.15.80:0/3183323071 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5c0004390 con 0x7fa5d00c87b0 2024-05-08T21:12:10.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.245+0000 7fa5d4d17700 1 -- 172.21.15.80:0/3183323071 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c00036a0 con 0x7fa5d00c87b0 2024-05-08T21:12:10.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.246+0000 7fa5d7f7d700 1 -- 172.21.15.80:0/3183323071 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa5d00c87b0 msgr2=0x7fa5d0071400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:10.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.246+0000 7fa5d7f7d700 1 --2- 172.21.15.80:0/3183323071 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa5d00c87b0 0x7fa5d0071400 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa5c00098f0 tx=0x7fa5c0009c00 comp rx=0 tx=0).stop 2024-05-08T21:12:10.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.246+0000 7fa5d7f7d700 1 -- 172.21.15.80:0/3183323071 shutdown_connections 2024-05-08T21:12:10.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.246+0000 7fa5d7f7d700 1 --2- 172.21.15.80:0/3183323071 >> v2:172.21.15.106:3300/0 conn(0x7fa5d00c75e0 0x7fa5d015ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:10.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.246+0000 7fa5d7f7d700 1 --2- 172.21.15.80:0/3183323071 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa5d00c87b0 0x7fa5d0071400 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:10.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.246+0000 7fa5d7f7d700 1 -- 172.21.15.80:0/3183323071 >> 172.21.15.80:0/3183323071 conn(0x7fa5d006bad0 msgr2=0x7fa5d006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:12:10.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.246+0000 7fa5d7f7d700 1 -- 172.21.15.80:0/3183323071 shutdown_connections 2024-05-08T21:12:10.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.246+0000 7fa5d7f7d700 1 -- 172.21.15.80:0/3183323071 wait complete. 2024-05-08T21:12:10.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.247+0000 7fa5d7f7d700 1 Processor -- start 2024-05-08T21:12:10.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.247+0000 7fa5d7f7d700 1 -- start start 2024-05-08T21:12:10.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.248+0000 7fa5d7f7d700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa5d00c75e0 0x7fa5d01e27b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:12:10.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.248+0000 7fa5d7f7d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5d00c79c0 0x7fa5d01efe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:12:10.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.248+0000 7fa5d7f7d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5d00c87b0 0x7fa5d01f0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:12:10.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.248+0000 7fa5d7f7d700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d01f3fa0 con 0x7fa5d00c79c0 2024-05-08T21:12:10.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.248+0000 7fa5d7f7d700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d01f30d0 con 0x7fa5d00c87b0 2024-05-08T21:12:10.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.248+0000 7fa5d7f7d700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d01f3390 con 0x7fa5d00c75e0 2024-05-08T21:12:10.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.248+0000 7fa5d5d19700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa5d00c75e0 0x7fa5d01e27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:12:10.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.248+0000 7fa5d651a700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5d00c87b0 0x7fa5d01f0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:12:10.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.248+0000 7fa5d5d19700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa5d00c75e0 0x7fa5d01e27b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:52278/0 (socket says 172.21.15.80:52278) 2024-05-08T21:12:10.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.248+0000 7fa5d5d19700 1 -- 172.21.15.80:0/386988798 learned_addr learned my addr 172.21.15.80:0/386988798 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:12:10.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.249+0000 7fa5d5518700 1 --2- 172.21.15.80:0/386988798 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5d00c79c0 0x7fa5d01efe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:12:10.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.249+0000 7fa5d5d19700 1 -- 172.21.15.80:0/386988798 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5d00c87b0 msgr2=0x7fa5d01f0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:10.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.249+0000 7fa5d5d19700 1 --2- 172.21.15.80:0/386988798 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5d00c87b0 0x7fa5d01f0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:10.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.249+0000 7fa5d5d19700 1 -- 172.21.15.80:0/386988798 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5d00c79c0 msgr2=0x7fa5d01efe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:10.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.249+0000 7fa5d5d19700 1 --2- 172.21.15.80:0/386988798 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5d00c79c0 0x7fa5d01efe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:10.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.249+0000 7fa5d5d19700 1 -- 172.21.15.80:0/386988798 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5cc0094a0 con 0x7fa5d00c75e0 2024-05-08T21:12:10.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.249+0000 7fa5d5d19700 1 --2- 172.21.15.80:0/386988798 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa5d00c75e0 0x7fa5d01e27b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc00ebe0 tx=0x7fa5cc00eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:12:10.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.249+0000 7fa5c67fc700 1 -- 172.21.15.80:0/386988798 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5cc00c850 con 0x7fa5d00c75e0 2024-05-08T21:12:10.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.249+0000 7fa5c67fc700 1 -- 172.21.15.80:0/386988798 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5cc00c9b0 con 0x7fa5d00c75e0 2024-05-08T21:12:10.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.249+0000 7fa5c67fc700 1 -- 172.21.15.80:0/386988798 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5cc00cd40 con 0x7fa5d00c75e0 2024-05-08T21:12:10.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.250+0000 7fa5d7f7d700 1 -- 172.21.15.80:0/386988798 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5c0009550 con 0x7fa5d00c75e0 2024-05-08T21:12:10.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.250+0000 7fa5d7f7d700 1 -- 172.21.15.80:0/386988798 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5d01f3950 con 0x7fa5d00c75e0 2024-05-08T21:12:10.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.251+0000 7fa5d7f7d700 1 -- 172.21.15.80:0/386988798 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5d01efc90 con 0x7fa5d00c75e0 2024-05-08T21:12:10.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.251+0000 7fa5c67fc700 1 -- 172.21.15.80:0/386988798 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa5cc013470 con 0x7fa5d00c75e0 2024-05-08T21:12:10.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.252+0000 7fa5c67fc700 1 --2- 172.21.15.80:0/386988798 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fa5b406ac90 0x7fa5b406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:12:10.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.252+0000 7fa5c67fc700 1 -- 172.21.15.80:0/386988798 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6749+0+0 (secure 0 0 0) 0x7fa5cc089810 con 0x7fa5d00c75e0 2024-05-08T21:12:10.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.253+0000 7fa5d5518700 1 --2- 172.21.15.80:0/386988798 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fa5b406ac90 0x7fa5b406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:12:10.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.254+0000 7fa5d5518700 1 --2- 172.21.15.80:0/386988798 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fa5b406ac90 0x7fa5b406d150 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa5c0009130 tx=0x7fa5c0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:12:10.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.257+0000 7fa5c67fc700 1 -- 172.21.15.80:0/386988798 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fa5cc0545d0 con 0x7fa5d00c75e0 2024-05-08T21:12:10.423 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:12:10.426 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:12:10.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.590+0000 7fa5d7f7d700 1 -- 172.21.15.80:0/386988798 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa5d004ec60 con 0x7fa5d00c75e0 2024-05-08T21:12:10.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.591+0000 7fa5c67fc700 1 -- 172.21.15.80:0/386988798 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+5497 (secure 0 0 0) 0x7fa5cc00cea0 con 0x7fa5d00c75e0 2024-05-08T21:12:10.594 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:12:10.594 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":11,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:12:06.229444+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":11,"state":"up:replay","state_seq":1,"addr":"172.21.15.106:6833/2289230272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":2289230272},{"type":"v1","addr":"172.21.15.106:6833","nonce":2289230272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:12:10.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.593+0000 7fa5d7f7d700 1 -- 172.21.15.80:0/386988798 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fa5b406ac90 msgr2=0x7fa5b406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:10.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.593+0000 7fa5d7f7d700 1 --2- 172.21.15.80:0/386988798 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fa5b406ac90 0x7fa5b406d150 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa5c0009130 tx=0x7fa5c0008030 comp rx=0 tx=0).stop 2024-05-08T21:12:10.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.593+0000 7fa5d7f7d700 1 -- 172.21.15.80:0/386988798 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa5d00c75e0 msgr2=0x7fa5d01e27b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:10.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.593+0000 7fa5d7f7d700 1 --2- 172.21.15.80:0/386988798 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa5d00c75e0 0x7fa5d01e27b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc00ebe0 tx=0x7fa5cc00eef0 comp rx=0 tx=0).stop 2024-05-08T21:12:10.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.593+0000 7fa5d7f7d700 1 -- 172.21.15.80:0/386988798 shutdown_connections 2024-05-08T21:12:10.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.593+0000 7fa5d7f7d700 1 --2- 172.21.15.80:0/386988798 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fa5b406ac90 0x7fa5b406d150 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:10.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.593+0000 7fa5d7f7d700 1 --2- 172.21.15.80:0/386988798 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5d00c87b0 0x7fa5d01f0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:10.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.593+0000 7fa5d7f7d700 1 --2- 172.21.15.80:0/386988798 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa5d00c75e0 0x7fa5d01e27b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:10.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.593+0000 7fa5d7f7d700 1 --2- 172.21.15.80:0/386988798 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5d00c79c0 0x7fa5d01efe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:10.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.593+0000 7fa5d7f7d700 1 -- 172.21.15.80:0/386988798 >> 172.21.15.80:0/386988798 conn(0x7fa5d006bad0 msgr2=0x7fa5d0072e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:12:10.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.593+0000 7fa5d7f7d700 1 -- 172.21.15.80:0/386988798 shutdown_connections 2024-05-08T21:12:10.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:10.593+0000 7fa5d7f7d700 1 -- 172.21.15.80:0/386988798 wait complete. 2024-05-08T21:12:10.598 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 11 2024-05-08T21:12:10.609 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-05-08T21:12:12.610 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:12:12.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:12.745+0000 7f4b953b7700 1 Processor -- start 2024-05-08T21:12:12.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:12.745+0000 7f4b953b7700 1 -- start start 2024-05-08T21:12:12.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:12.746+0000 7f4b953b7700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4b901589f0 0x7f4b9015ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:12:12.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:12.746+0000 7f4b953b7700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b900c70d0 con 0x7f4b9006ef50 2024-05-08T21:12:12.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:12.746+0000 7f4b953b7700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b900c73b0 con 0x7f4b9006f330 2024-05-08T21:12:12.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:12.746+0000 7f4b953b7700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9015f4b0 con 0x7f4b901589f0 2024-05-08T21:12:12.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:12.746+0000 7f4b8effd700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f4b9006ef50 0x7f4b901582e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59870/0 (socket says 172.21.15.80:59870) 2024-05-08T21:12:12.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:12.746+0000 7f4b8effd700 1 -- 172.21.15.80:0/1649925374 learned_addr learned my addr 172.21.15.80:0/1649925374 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:12:12.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:12.746+0000 7f4b8f7fe700 1 --2- 172.21.15.80:0/1649925374 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4b901589f0 0x7f4b9015ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:12:12.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:12.746+0000 7f4b8dffb700 1 -- 172.21.15.80:0/1649925374 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3563512825 0 0) 0x7f4b900c70d0 con 0x7f4b9006ef50 2024-05-08T21:12:12.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:12.746+0000 7f4b8dffb700 1 -- 172.21.15.80:0/1649925374 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b780035b0 con 0x7f4b9006ef50 2024-05-08T21:12:12.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:12.746+0000 7f4b8dffb700 1 -- 172.21.15.80:0/1649925374 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2975566096 0 0) 0x7f4b900c73b0 con 0x7f4b9006f330 2024-05-08T21:12:12.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:12.747+0000 7f4b8dffb700 1 -- 172.21.15.80:0/1649925374 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b900c70d0 con 0x7f4b9006f330 2024-05-08T21:12:12.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:12.747+0000 7f4b8f7fe700 1 -- 172.21.15.80:0/1649925374 >> v1:172.21.15.106:6789/0 conn(0x7f4b9006f330 legacy=0x7f4b90072490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:12.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:12.747+0000 7f4b8f7fe700 1 -- 172.21.15.80:0/1649925374 >> v1:172.21.15.80:6789/0 conn(0x7f4b9006ef50 legacy=0x7f4b901582e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:12.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:12.747+0000 7f4b8f7fe700 1 -- 172.21.15.80:0/1649925374 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b900c7690 con 0x7f4b901589f0 2024-05-08T21:12:12.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:12.747+0000 7f4b8f7fe700 1 --2- 172.21.15.80:0/1649925374 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4b901589f0 0x7f4b9015ef70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4b88009dc0 tx=0x7f4b8800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a66a29f66e2bfca5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:12:12.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:12.747+0000 7f4b8dffb700 1 -- 172.21.15.80:0/1649925374 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8800e070 con 0x7f4b901589f0 2024-05-08T21:12:12.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:12.747+0000 7f4b8dffb700 1 -- 172.21.15.80:0/1649925374 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b8800bae0 con 0x7f4b901589f0 2024-05-08T21:12:12.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:12.747+0000 7f4b8dffb700 1 -- 172.21.15.80:0/1649925374 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8800be90 con 0x7f4b901589f0 2024-05-08T21:12:12.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:12.748+0000 7f4b953b7700 1 -- 172.21.15.80:0/1649925374 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4b901589f0 msgr2=0x7f4b9015ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:12.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:12.748+0000 7f4b953b7700 1 --2- 172.21.15.80:0/1649925374 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4b901589f0 0x7f4b9015ef70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4b88009dc0 tx=0x7f4b8800b330 comp rx=0 tx=0).stop 2024-05-08T21:12:12.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:12.748+0000 7f4b953b7700 1 -- 172.21.15.80:0/1649925374 shutdown_connections 2024-05-08T21:12:12.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:12.748+0000 7f4b953b7700 1 --2- 172.21.15.80:0/1649925374 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4b901589f0 0x7f4b9015ef70 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:12.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:12.748+0000 7f4b953b7700 1 -- 172.21.15.80:0/1649925374 >> 172.21.15.80:0/1649925374 conn(0x7f4b900c9310 msgr2=0x7f4b900c9720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:12:12.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:12.748+0000 7f4b953b7700 1 -- 172.21.15.80:0/1649925374 shutdown_connections 2024-05-08T21:12:12.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:12.748+0000 7f4b953b7700 1 -- 172.21.15.80:0/1649925374 wait complete. 2024-05-08T21:12:12.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:12.749+0000 7f4b953b7700 1 Processor -- start 2024-05-08T21:12:12.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:12.749+0000 7f4b953b7700 1 -- start start 2024-05-08T21:12:12.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:12.750+0000 7f4b953b7700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4b9006ef50 0x7f4b901f7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:12:12.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:12.750+0000 7f4b953b7700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4b9006f330 0x7f4b900caed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:12:12.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:12.750+0000 7f4b953b7700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4b901589f0 0x7f4b900ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:12:12.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:12.750+0000 7f4b953b7700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b900c5bf0 con 0x7f4b9006f330 2024-05-08T21:12:12.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:12.750+0000 7f4b953b7700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b901f8370 con 0x7f4b901589f0 2024-05-08T21:12:12.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:12.750+0000 7f4b953b7700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b900c5350 con 0x7f4b9006ef50 2024-05-08T21:12:12.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:12.750+0000 7f4b8e7fc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4b9006f330 0x7f4b900caed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:12:12.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:12.750+0000 7f4b8e7fc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4b9006f330 0x7f4b900caed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37076/0 (socket says 172.21.15.80:37076) 2024-05-08T21:12:12.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:12.750+0000 7f4b8e7fc700 1 -- 172.21.15.80:0/2808522181 learned_addr learned my addr 172.21.15.80:0/2808522181 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:12:12.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:12.750+0000 7f4b8effd700 1 --2- 172.21.15.80:0/2808522181 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4b9006ef50 0x7f4b901f7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:12:12.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:12.750+0000 7f4b8f7fe700 1 --2- 172.21.15.80:0/2808522181 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4b901589f0 0x7f4b900ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:12:12.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:12.751+0000 7f4b8f7fe700 1 -- 172.21.15.80:0/2808522181 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4b9006ef50 msgr2=0x7f4b901f7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:12.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:12.751+0000 7f4b8f7fe700 1 --2- 172.21.15.80:0/2808522181 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4b9006ef50 0x7f4b901f7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:12.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:12.751+0000 7f4b8f7fe700 1 -- 172.21.15.80:0/2808522181 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4b9006f330 msgr2=0x7f4b900caed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:12.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:12.751+0000 7f4b8f7fe700 1 --2- 172.21.15.80:0/2808522181 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4b9006f330 0x7f4b900caed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:12.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:12.751+0000 7f4b8f7fe700 1 -- 172.21.15.80:0/2808522181 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b88009a70 con 0x7f4b901589f0 2024-05-08T21:12:12.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:12.751+0000 7f4b8f7fe700 1 --2- 172.21.15.80:0/2808522181 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4b901589f0 0x7f4b900ccee0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4b88015000 tx=0x7f4b88004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:12:12.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:12.751+0000 7f4b777fe700 1 -- 172.21.15.80:0/2808522181 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b880045c0 con 0x7f4b901589f0 2024-05-08T21:12:12.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:12.751+0000 7f4b777fe700 1 -- 172.21.15.80:0/2808522181 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b88004720 con 0x7f4b901589f0 2024-05-08T21:12:12.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:12.751+0000 7f4b953b7700 1 -- 172.21.15.80:0/2808522181 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b900c5630 con 0x7f4b901589f0 2024-05-08T21:12:12.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:12.751+0000 7f4b953b7700 1 -- 172.21.15.80:0/2808522181 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b900ca6f0 con 0x7f4b901589f0 2024-05-08T21:12:12.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:12.752+0000 7f4b777fe700 1 -- 172.21.15.80:0/2808522181 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b88012430 con 0x7f4b901589f0 2024-05-08T21:12:12.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:12.753+0000 7f4b777fe700 1 -- 172.21.15.80:0/2808522181 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4b88012590 con 0x7f4b901589f0 2024-05-08T21:12:12.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:12.753+0000 7f4b953b7700 1 -- 172.21.15.80:0/2808522181 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b900cad40 con 0x7f4b901589f0 2024-05-08T21:12:12.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:12.753+0000 7f4b777fe700 1 --2- 172.21.15.80:0/2808522181 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f4b7c06acc0 0x7f4b7c06d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:12:12.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:12.754+0000 7f4b777fe700 1 -- 172.21.15.80:0/2808522181 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f4b8808aa00 con 0x7f4b901589f0 2024-05-08T21:12:12.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:12.754+0000 7f4b8effd700 1 --2- 172.21.15.80:0/2808522181 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f4b7c06acc0 0x7f4b7c06d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:12:12.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:12.754+0000 7f4b8effd700 1 --2- 172.21.15.80:0/2808522181 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f4b7c06acc0 0x7f4b7c06d180 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4b800011e0 tx=0x7f4b80009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:12:12.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:12.759+0000 7f4b777fe700 1 -- 172.21.15.80:0/2808522181 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f4b880556a0 con 0x7f4b901589f0 2024-05-08T21:12:13.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:13.016+0000 7f4b953b7700 1 -- 172.21.15.80:0/2808522181 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4b900ca550 con 0x7f4b901589f0 2024-05-08T21:12:13.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:13.017+0000 7f4b777fe700 1 -- 172.21.15.80:0/2808522181 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+5501 (secure 0 0 0) 0x7f4b900ca550 con 0x7f4b901589f0 2024-05-08T21:12:13.020 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:12:13.021 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:12:11.345278+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":11,"state":"up:reconnect","state_seq":35,"addr":"172.21.15.106:6833/2289230272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":2289230272},{"type":"v1","addr":"172.21.15.106:6833","nonce":2289230272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:12:13.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:13.019+0000 7f4b953b7700 1 -- 172.21.15.80:0/2808522181 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f4b7c06acc0 msgr2=0x7f4b7c06d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:13.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:13.019+0000 7f4b953b7700 1 --2- 172.21.15.80:0/2808522181 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f4b7c06acc0 0x7f4b7c06d180 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4b800011e0 tx=0x7f4b80009040 comp rx=0 tx=0).stop 2024-05-08T21:12:13.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:13.019+0000 7f4b953b7700 1 -- 172.21.15.80:0/2808522181 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4b901589f0 msgr2=0x7f4b900ccee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:13.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:13.019+0000 7f4b953b7700 1 --2- 172.21.15.80:0/2808522181 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4b901589f0 0x7f4b900ccee0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4b88015000 tx=0x7f4b88004ad0 comp rx=0 tx=0).stop 2024-05-08T21:12:13.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:13.020+0000 7f4b953b7700 1 -- 172.21.15.80:0/2808522181 shutdown_connections 2024-05-08T21:12:13.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:13.020+0000 7f4b953b7700 1 --2- 172.21.15.80:0/2808522181 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f4b7c06acc0 0x7f4b7c06d180 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:13.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:13.020+0000 7f4b953b7700 1 --2- 172.21.15.80:0/2808522181 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4b901589f0 0x7f4b900ccee0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:13.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:13.020+0000 7f4b953b7700 1 --2- 172.21.15.80:0/2808522181 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4b9006ef50 0x7f4b901f7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:13.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:13.020+0000 7f4b953b7700 1 --2- 172.21.15.80:0/2808522181 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4b9006f330 0x7f4b900caed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:13.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:13.020+0000 7f4b953b7700 1 -- 172.21.15.80:0/2808522181 >> 172.21.15.80:0/2808522181 conn(0x7f4b900c9310 msgr2=0x7f4b90156570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:12:13.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:13.020+0000 7f4b953b7700 1 -- 172.21.15.80:0/2808522181 shutdown_connections 2024-05-08T21:12:13.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:13.020+0000 7f4b953b7700 1 -- 172.21.15.80:0/2808522181 wait complete. 2024-05-08T21:12:13.024 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 12 2024-05-08T21:12:13.040 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-05-08T21:12:15.041 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:12:15.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.162+0000 7f3415ae9700 1 Processor -- start 2024-05-08T21:12:15.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.162+0000 7f3415ae9700 1 -- start start 2024-05-08T21:12:15.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.163+0000 7f3415ae9700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f341015a1a0 0x7f3410072d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:12:15.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.163+0000 7f3415ae9700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34100c8cc0 con 0x7f34100c9860 2024-05-08T21:12:15.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.163+0000 7f3415ae9700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f341015e710 con 0x7f34101541a0 2024-05-08T21:12:15.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.163+0000 7f3415ae9700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f341006c5a0 con 0x7f341015a1a0 2024-05-08T21:12:15.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.163+0000 7f340ffff700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f341015a1a0 0x7f3410072d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:12:15.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.163+0000 7f340f7fe700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f34101541a0 0x7f34100c9150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.80:48070/0 (socket says 172.21.15.80:48070) 2024-05-08T21:12:15.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.163+0000 7f340ffff700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f341015a1a0 0x7f3410072d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:54240/0 (socket says 172.21.15.80:54240) 2024-05-08T21:12:15.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.163+0000 7f340f7fe700 1 -- 172.21.15.80:0/2591025768 learned_addr learned my addr 172.21.15.80:0/2591025768 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:12:15.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.163+0000 7f340e7fc700 1 -- 172.21.15.80:0/2591025768 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2709878161 0 0) 0x7f341015e710 con 0x7f34101541a0 2024-05-08T21:12:15.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.163+0000 7f340e7fc700 1 -- 172.21.15.80:0/2591025768 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33f80035b0 con 0x7f34101541a0 2024-05-08T21:12:15.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.163+0000 7f340ffff700 1 -- 172.21.15.80:0/2591025768 >> v1:172.21.15.106:6789/0 conn(0x7f34101541a0 legacy=0x7f34100c9150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:15.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.163+0000 7f340ffff700 1 -- 172.21.15.80:0/2591025768 >> v1:172.21.15.80:6789/0 conn(0x7f34100c9860 legacy=0x7f3410072600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:12:15.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.163+0000 7f340ffff700 1 -- 172.21.15.80:0/2591025768 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f341015dbb0 con 0x7f341015a1a0 2024-05-08T21:12:15.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.164+0000 7f340ffff700 1 --2- 172.21.15.80:0/2591025768 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f341015a1a0 0x7f3410072d10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3408009dc0 tx=0x7f340800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d719e7f96f3527c0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:12:15.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.164+0000 7f340e7fc700 1 -- 172.21.15.80:0/2591025768 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340800e070 con 0x7f341015a1a0 2024-05-08T21:12:15.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.164+0000 7f340e7fc700 1 -- 172.21.15.80:0/2591025768 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f340800bae0 con 0x7f341015a1a0 2024-05-08T21:12:15.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.164+0000 7f340e7fc700 1 -- 172.21.15.80:0/2591025768 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340800be90 con 0x7f341015a1a0 2024-05-08T21:12:15.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.165+0000 7f3415ae9700 1 -- 172.21.15.80:0/2591025768 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f341015a1a0 msgr2=0x7f3410072d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:15.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.165+0000 7f3415ae9700 1 --2- 172.21.15.80:0/2591025768 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f341015a1a0 0x7f3410072d10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3408009dc0 tx=0x7f340800b330 comp rx=0 tx=0).stop 2024-05-08T21:12:15.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.165+0000 7f3415ae9700 1 -- 172.21.15.80:0/2591025768 shutdown_connections 2024-05-08T21:12:15.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.165+0000 7f3415ae9700 1 --2- 172.21.15.80:0/2591025768 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f341015a1a0 0x7f3410072d10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:15.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.165+0000 7f3415ae9700 1 -- 172.21.15.80:0/2591025768 >> 172.21.15.80:0/2591025768 conn(0x7f341006ef80 msgr2=0x7f341006f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:12:15.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.165+0000 7f3415ae9700 1 -- 172.21.15.80:0/2591025768 shutdown_connections 2024-05-08T21:12:15.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.165+0000 7f3415ae9700 1 -- 172.21.15.80:0/2591025768 wait complete. 2024-05-08T21:12:15.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.167+0000 7f3415ae9700 1 Processor -- start 2024-05-08T21:12:15.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.167+0000 7f3415ae9700 1 -- start start 2024-05-08T21:12:15.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.168+0000 7f3415ae9700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f34100c9860 0x7f341014a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:12:15.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.168+0000 7f3415ae9700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34101541a0 0x7f34100ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:12:15.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.168+0000 7f3415ae9700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f341015a1a0 0x7f34100cd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:12:15.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.168+0000 7f3415ae9700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34100cbf60 con 0x7f34101541a0 2024-05-08T21:12:15.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.168+0000 7f3415ae9700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34101566c0 con 0x7f341015a1a0 2024-05-08T21:12:15.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.168+0000 7f3415ae9700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f341014b060 con 0x7f34100c9860 2024-05-08T21:12:15.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.168+0000 7f340effd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34101541a0 0x7f34100ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:12:15.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.168+0000 7f340effd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34101541a0 0x7f34100ccbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37078/0 (socket says 172.21.15.80:37078) 2024-05-08T21:12:15.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.168+0000 7f340effd700 1 -- 172.21.15.80:0/1480089104 learned_addr learned my addr 172.21.15.80:0/1480089104 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:12:15.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.168+0000 7f340f7fe700 1 --2- 172.21.15.80:0/1480089104 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f34100c9860 0x7f341014a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:12:15.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.168+0000 7f340ffff700 1 --2- 172.21.15.80:0/1480089104 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f341015a1a0 0x7f34100cd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:12:15.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.169+0000 7f340effd700 1 -- 172.21.15.80:0/1480089104 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f34100c9860 msgr2=0x7f341014a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:15.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.169+0000 7f340effd700 1 --2- 172.21.15.80:0/1480089104 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f34100c9860 0x7f341014a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:15.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.169+0000 7f340effd700 1 -- 172.21.15.80:0/1480089104 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f341015a1a0 msgr2=0x7f34100cd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:15.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.169+0000 7f340effd700 1 --2- 172.21.15.80:0/1480089104 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f341015a1a0 0x7f34100cd0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:15.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.169+0000 7f340effd700 1 -- 172.21.15.80:0/1480089104 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3408009a70 con 0x7f34101541a0 2024-05-08T21:12:15.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.169+0000 7f340effd700 1 --2- 172.21.15.80:0/1480089104 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34101541a0 0x7f34100ccbb0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f340400c4a0 tx=0x7f340400c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:12:15.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.169+0000 7f33f7fff700 1 -- 172.21.15.80:0/1480089104 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34040054e0 con 0x7f34101541a0 2024-05-08T21:12:15.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.169+0000 7f33f7fff700 1 -- 172.21.15.80:0/1480089104 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3404003680 con 0x7f34101541a0 2024-05-08T21:12:15.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.169+0000 7f3415ae9700 1 -- 172.21.15.80:0/1480089104 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34101f3650 con 0x7f34101541a0 2024-05-08T21:12:15.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.169+0000 7f33f7fff700 1 -- 172.21.15.80:0/1480089104 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3404003a10 con 0x7f34101541a0 2024-05-08T21:12:15.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.170+0000 7f3415ae9700 1 -- 172.21.15.80:0/1480089104 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f341014a9b0 con 0x7f34101541a0 2024-05-08T21:12:15.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.171+0000 7f33f7fff700 1 -- 172.21.15.80:0/1480089104 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3404003b70 con 0x7f34101541a0 2024-05-08T21:12:15.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.171+0000 7f3415ae9700 1 -- 172.21.15.80:0/1480089104 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f341004ec60 con 0x7f34101541a0 2024-05-08T21:12:15.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.171+0000 7f33f7fff700 1 --2- 172.21.15.80:0/1480089104 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f33fc06ac90 0x7f33fc06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:12:15.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.171+0000 7f33f7fff700 1 -- 172.21.15.80:0/1480089104 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f34040889f0 con 0x7f34101541a0 2024-05-08T21:12:15.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.171+0000 7f340f7fe700 1 --2- 172.21.15.80:0/1480089104 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f33fc06ac90 0x7f33fc06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:12:15.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.172+0000 7f340f7fe700 1 --2- 172.21.15.80:0/1480089104 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f33fc06ac90 0x7f33fc06d150 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f34000011e0 tx=0x7f3400009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:12:15.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.176+0000 7f33f7fff700 1 -- 172.21.15.80:0/1480089104 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f3404053730 con 0x7f34101541a0 2024-05-08T21:12:15.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.449+0000 7f3415ae9700 1 -- 172.21.15.80:0/1480089104 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f34100731d0 con 0x7f34101541a0 2024-05-08T21:12:15.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.450+0000 7f33f7fff700 1 -- 172.21.15.80:0/1480089104 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+5501 (secure 0 0 0) 0x7f3404017090 con 0x7f34101541a0 2024-05-08T21:12:15.453 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:12:15.454 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:12:11.345278+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":11,"state":"up:reconnect","state_seq":35,"addr":"172.21.15.106:6833/2289230272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":2289230272},{"type":"v1","addr":"172.21.15.106:6833","nonce":2289230272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:12:15.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.453+0000 7f3415ae9700 1 -- 172.21.15.80:0/1480089104 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f33fc06ac90 msgr2=0x7f33fc06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:15.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.453+0000 7f3415ae9700 1 --2- 172.21.15.80:0/1480089104 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f33fc06ac90 0x7f33fc06d150 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f34000011e0 tx=0x7f3400009040 comp rx=0 tx=0).stop 2024-05-08T21:12:15.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.453+0000 7f3415ae9700 1 -- 172.21.15.80:0/1480089104 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34101541a0 msgr2=0x7f34100ccbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:15.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.453+0000 7f3415ae9700 1 --2- 172.21.15.80:0/1480089104 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34101541a0 0x7f34100ccbb0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f340400c4a0 tx=0x7f340400c7b0 comp rx=0 tx=0).stop 2024-05-08T21:12:15.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.453+0000 7f3415ae9700 1 -- 172.21.15.80:0/1480089104 shutdown_connections 2024-05-08T21:12:15.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.453+0000 7f3415ae9700 1 --2- 172.21.15.80:0/1480089104 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f33fc06ac90 0x7f33fc06d150 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:15.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.453+0000 7f3415ae9700 1 --2- 172.21.15.80:0/1480089104 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f341015a1a0 0x7f34100cd0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:15.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.453+0000 7f3415ae9700 1 --2- 172.21.15.80:0/1480089104 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f34100c9860 0x7f341014a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:15.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.453+0000 7f3415ae9700 1 --2- 172.21.15.80:0/1480089104 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34101541a0 0x7f34100ccbb0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:15.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.453+0000 7f3415ae9700 1 -- 172.21.15.80:0/1480089104 >> 172.21.15.80:0/1480089104 conn(0x7f341006ef80 msgr2=0x7f34100c7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:12:15.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.453+0000 7f3415ae9700 1 -- 172.21.15.80:0/1480089104 shutdown_connections 2024-05-08T21:12:15.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:15.453+0000 7f3415ae9700 1 -- 172.21.15.80:0/1480089104 wait complete. 2024-05-08T21:12:15.458 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 12 2024-05-08T21:12:15.473 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-05-08T21:12:17.474 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:12:17.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.600+0000 7fe6dff69700 1 Processor -- start 2024-05-08T21:12:17.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.600+0000 7fe6dff69700 1 -- start start 2024-05-08T21:12:17.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.601+0000 7fe6dff69700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe6d80cdef0 0x7fe6d81431b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:12:17.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.601+0000 7fe6dff69700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe6d806c4e0 0x7fe6d81436f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:12:17.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.601+0000 7fe6dff69700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6d80733b0 con 0x7fe6d80cdb10 2024-05-08T21:12:17.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.601+0000 7fe6dff69700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6d815b360 con 0x7fe6d806c4e0 2024-05-08T21:12:17.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.601+0000 7fe6dff69700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d80c85d0 con 0x7fe6d80cdef0 2024-05-08T21:12:17.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.601+0000 7fe6dd504700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe6d80cdef0 0x7fe6d81431b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:12:17.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.601+0000 7fe6de506700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe6d806c4e0 0x7fe6d81436f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:12:17.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.601+0000 7fe6dd504700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe6d80cdef0 0x7fe6d81431b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:54262/0 (socket says 172.21.15.80:54262) 2024-05-08T21:12:17.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.601+0000 7fe6de506700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe6d806c4e0 0x7fe6d81436f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.80:32928/0 (socket says 172.21.15.80:32928) 2024-05-08T21:12:17.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.601+0000 7fe6dd504700 1 -- 172.21.15.80:0/3262644896 learned_addr learned my addr 172.21.15.80:0/3262644896 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:12:17.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.601+0000 7fe6dd504700 1 -- 172.21.15.80:0/3262644896 >> v2:172.21.15.106:3300/0 conn(0x7fe6d806c4e0 msgr2=0x7fe6d81436f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:12:17.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.601+0000 7fe6dd504700 1 --2- 172.21.15.80:0/3262644896 >> v2:172.21.15.106:3300/0 conn(0x7fe6d806c4e0 0x7fe6d81436f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:17.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.601+0000 7fe6dd504700 1 -- 172.21.15.80:0/3262644896 >> v1:172.21.15.106:6789/0 conn(0x7fe6d80cdb10 legacy=0x7fe6d8072ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:17.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.601+0000 7fe6dd504700 1 -- 172.21.15.80:0/3262644896 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6d815a500 con 0x7fe6d80cdef0 2024-05-08T21:12:17.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.602+0000 7fe6dd504700 1 --2- 172.21.15.80:0/3262644896 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe6d80cdef0 0x7fe6d81431b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe6c80098f0 tx=0x7fe6c8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2e203ffbd639a9f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:12:17.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.602+0000 7fe6dcd03700 1 -- 172.21.15.80:0/3262644896 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c8011830 con 0x7fe6d80cdef0 2024-05-08T21:12:17.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.602+0000 7fe6dcd03700 1 -- 172.21.15.80:0/3262644896 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6c8011990 con 0x7fe6d80cdef0 2024-05-08T21:12:17.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.602+0000 7fe6dcd03700 1 -- 172.21.15.80:0/3262644896 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c8011d20 con 0x7fe6d80cdef0 2024-05-08T21:12:17.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.602+0000 7fe6dff69700 1 -- 172.21.15.80:0/3262644896 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe6d80cdef0 msgr2=0x7fe6d81431b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:17.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.602+0000 7fe6dff69700 1 --2- 172.21.15.80:0/3262644896 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe6d80cdef0 0x7fe6d81431b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe6c80098f0 tx=0x7fe6c8009c00 comp rx=0 tx=0).stop 2024-05-08T21:12:17.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.602+0000 7fe6dff69700 1 -- 172.21.15.80:0/3262644896 shutdown_connections 2024-05-08T21:12:17.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.602+0000 7fe6dff69700 1 --2- 172.21.15.80:0/3262644896 >> v2:172.21.15.106:3300/0 conn(0x7fe6d806c4e0 0x7fe6d81436f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:17.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.602+0000 7fe6dff69700 1 --2- 172.21.15.80:0/3262644896 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe6d80cdef0 0x7fe6d81431b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:17.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.602+0000 7fe6dff69700 1 -- 172.21.15.80:0/3262644896 >> 172.21.15.80:0/3262644896 conn(0x7fe6d8070020 msgr2=0x7fe6d8070430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:12:17.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.603+0000 7fe6dff69700 1 -- 172.21.15.80:0/3262644896 shutdown_connections 2024-05-08T21:12:17.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.603+0000 7fe6dff69700 1 -- 172.21.15.80:0/3262644896 wait complete. 2024-05-08T21:12:17.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.604+0000 7fe6dff69700 1 Processor -- start 2024-05-08T21:12:17.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.604+0000 7fe6dff69700 1 -- start start 2024-05-08T21:12:17.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.605+0000 7fe6dff69700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6d806c4e0 0x7fe6d8141890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:12:17.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.605+0000 7fe6dff69700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe6d80cdb10 0x7fe6d81f0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:12:17.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.605+0000 7fe6dff69700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6d80cdef0 0x7fe6d813e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:12:17.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.605+0000 7fe6dff69700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d81e33d0 con 0x7fe6d806c4e0 2024-05-08T21:12:17.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.605+0000 7fe6dff69700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d81efa20 con 0x7fe6d80cdef0 2024-05-08T21:12:17.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.605+0000 7fe6dff69700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d815cc90 con 0x7fe6d80cdb10 2024-05-08T21:12:17.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.605+0000 7fe6ddd05700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6d806c4e0 0x7fe6d8141890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:12:17.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.605+0000 7fe6ddd05700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6d806c4e0 0x7fe6d8141890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37094/0 (socket says 172.21.15.80:37094) 2024-05-08T21:12:17.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.605+0000 7fe6ddd05700 1 -- 172.21.15.80:0/1156209777 learned_addr learned my addr 172.21.15.80:0/1156209777 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:12:17.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.605+0000 7fe6dd504700 1 --2- 172.21.15.80:0/1156209777 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe6d80cdb10 0x7fe6d81f0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:12:17.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.605+0000 7fe6ddd05700 1 -- 172.21.15.80:0/1156209777 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe6d80cdb10 msgr2=0x7fe6d81f0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:17.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.605+0000 7fe6ddd05700 1 --2- 172.21.15.80:0/1156209777 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe6d80cdb10 0x7fe6d81f0200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:17.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.605+0000 7fe6ddd05700 1 -- 172.21.15.80:0/1156209777 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6d80cdef0 msgr2=0x7fe6d813e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:17.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.605+0000 7fe6de506700 1 --2- 172.21.15.80:0/1156209777 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6d80cdef0 0x7fe6d813e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:12:17.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.605+0000 7fe6ddd05700 1 --2- 172.21.15.80:0/1156209777 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6d80cdef0 0x7fe6d813e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:17.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.605+0000 7fe6ddd05700 1 -- 172.21.15.80:0/1156209777 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6c8009550 con 0x7fe6d806c4e0 2024-05-08T21:12:17.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.605+0000 7fe6de506700 1 --2- 172.21.15.80:0/1156209777 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6d80cdef0 0x7fe6d813e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:12:17.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.605+0000 7fe6ddd05700 1 --2- 172.21.15.80:0/1156209777 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6d806c4e0 0x7fe6d8141890 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe6d400c4e0 tx=0x7fe6d400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:12:17.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.605+0000 7fe6ce7fc700 1 -- 172.21.15.80:0/1156209777 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d40052d0 con 0x7fe6d806c4e0 2024-05-08T21:12:17.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.606+0000 7fe6dff69700 1 -- 172.21.15.80:0/1156209777 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6d815cf70 con 0x7fe6d806c4e0 2024-05-08T21:12:17.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.606+0000 7fe6dff69700 1 -- 172.21.15.80:0/1156209777 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6d815d530 con 0x7fe6d806c4e0 2024-05-08T21:12:17.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.606+0000 7fe6ce7fc700 1 -- 172.21.15.80:0/1156209777 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6d4005430 con 0x7fe6d806c4e0 2024-05-08T21:12:17.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.606+0000 7fe6ce7fc700 1 -- 172.21.15.80:0/1156209777 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d40038c0 con 0x7fe6d806c4e0 2024-05-08T21:12:17.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.607+0000 7fe6dff69700 1 -- 172.21.15.80:0/1156209777 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6c00052f0 con 0x7fe6d806c4e0 2024-05-08T21:12:17.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.607+0000 7fe6ce7fc700 1 -- 172.21.15.80:0/1156209777 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe6d4003a20 con 0x7fe6d806c4e0 2024-05-08T21:12:17.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.607+0000 7fe6ce7fc700 1 --2- 172.21.15.80:0/1156209777 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe6bc06ac90 0x7fe6bc06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:12:17.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.608+0000 7fe6ce7fc700 1 -- 172.21.15.80:0/1156209777 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6749+0+0 (secure 0 0 0) 0x7fe6d4088a80 con 0x7fe6d806c4e0 2024-05-08T21:12:17.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.609+0000 7fe6dd504700 1 --2- 172.21.15.80:0/1156209777 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe6bc06ac90 0x7fe6bc06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:12:17.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.609+0000 7fe6dd504700 1 --2- 172.21.15.80:0/1156209777 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe6bc06ac90 0x7fe6bc06d150 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe6c8014040 tx=0x7fe6c8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:12:17.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.612+0000 7fe6ce7fc700 1 -- 172.21.15.80:0/1156209777 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fe6d40538e0 con 0x7fe6d806c4e0 2024-05-08T21:12:17.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.865+0000 7fe6dff69700 1 -- 172.21.15.80:0/1156209777 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe6c00055a0 con 0x7fe6d806c4e0 2024-05-08T21:12:17.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.866+0000 7fe6ce7fc700 1 -- 172.21.15.80:0/1156209777 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+5498 (secure 0 0 0) 0x7fe6d4056f00 con 0x7fe6d806c4e0 2024-05-08T21:12:17.870 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:12:17.870 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:12:16.363448+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":11,"state":"up:rejoin","state_seq":37,"addr":"172.21.15.106:6833/2289230272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":2289230272},{"type":"v1","addr":"172.21.15.106:6833","nonce":2289230272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:12:17.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.868+0000 7fe6dff69700 1 -- 172.21.15.80:0/1156209777 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe6bc06ac90 msgr2=0x7fe6bc06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:17.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.868+0000 7fe6dff69700 1 --2- 172.21.15.80:0/1156209777 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe6bc06ac90 0x7fe6bc06d150 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe6c8014040 tx=0x7fe6c8008030 comp rx=0 tx=0).stop 2024-05-08T21:12:17.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.868+0000 7fe6dff69700 1 -- 172.21.15.80:0/1156209777 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6d806c4e0 msgr2=0x7fe6d8141890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:17.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.868+0000 7fe6dff69700 1 --2- 172.21.15.80:0/1156209777 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6d806c4e0 0x7fe6d8141890 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe6d400c4e0 tx=0x7fe6d400c7f0 comp rx=0 tx=0).stop 2024-05-08T21:12:17.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.868+0000 7fe6dff69700 1 -- 172.21.15.80:0/1156209777 shutdown_connections 2024-05-08T21:12:17.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.868+0000 7fe6dff69700 1 --2- 172.21.15.80:0/1156209777 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe6bc06ac90 0x7fe6bc06d150 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:17.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.868+0000 7fe6dff69700 1 --2- 172.21.15.80:0/1156209777 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6d806c4e0 0x7fe6d8141890 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:17.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.868+0000 7fe6dff69700 1 --2- 172.21.15.80:0/1156209777 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6d80cdef0 0x7fe6d813e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:17.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.868+0000 7fe6dff69700 1 --2- 172.21.15.80:0/1156209777 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe6d80cdb10 0x7fe6d81f0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:17.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.868+0000 7fe6dff69700 1 -- 172.21.15.80:0/1156209777 >> 172.21.15.80:0/1156209777 conn(0x7fe6d8070020 msgr2=0x7fe6d8073e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:12:17.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.869+0000 7fe6dff69700 1 -- 172.21.15.80:0/1156209777 shutdown_connections 2024-05-08T21:12:17.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:17.869+0000 7fe6dff69700 1 -- 172.21.15.80:0/1156209777 wait complete. 2024-05-08T21:12:17.873 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 13 2024-05-08T21:12:17.884 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-05-08T21:12:19.885 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:12:20.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.008+0000 7f59997ec700 1 Processor -- start 2024-05-08T21:12:20.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.008+0000 7f59997ec700 1 -- start start 2024-05-08T21:12:20.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.009+0000 7f59997ec700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f599406c5d0 0x7f599406bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:12:20.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.009+0000 7f59997ec700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f599406c010 0x7f599415a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:12:20.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.009+0000 7f59997ec700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f599415b290 con 0x7f5994154300 2024-05-08T21:12:20.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.009+0000 7f59997ec700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f599415e7e0 con 0x7f599406c5d0 2024-05-08T21:12:20.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.009+0000 7f59997ec700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f599415afb0 con 0x7f599406c010 2024-05-08T21:12:20.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.009+0000 7f59927fc700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f599406c5d0 0x7f599406bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:12:20.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.009+0000 7f59937fe700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f599406c010 0x7f599415a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:12:20.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.009+0000 7f59937fe700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f599406c010 0x7f599415a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:54286/0 (socket says 172.21.15.80:54286) 2024-05-08T21:12:20.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.009+0000 7f59937fe700 1 -- 172.21.15.80:0/3057429705 learned_addr learned my addr 172.21.15.80:0/3057429705 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:12:20.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.009+0000 7f59937fe700 1 -- 172.21.15.80:0/3057429705 >> v2:172.21.15.106:3300/0 conn(0x7f599406c5d0 msgr2=0x7f599406bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:12:20.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.009+0000 7f59937fe700 1 --2- 172.21.15.80:0/3057429705 >> v2:172.21.15.106:3300/0 conn(0x7f599406c5d0 0x7f599406bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:20.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.009+0000 7f59937fe700 1 -- 172.21.15.80:0/3057429705 >> v1:172.21.15.106:6789/0 conn(0x7f5994154300 legacy=0x7f59940cc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:20.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.009+0000 7f59937fe700 1 -- 172.21.15.80:0/3057429705 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f599415da20 con 0x7f599406c010 2024-05-08T21:12:20.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.009+0000 7f59927fc700 1 --2- 172.21.15.80:0/3057429705 >> v2:172.21.15.106:3300/0 conn(0x7f599406c5d0 0x7f599406bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:12:20.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.010+0000 7f59937fe700 1 --2- 172.21.15.80:0/3057429705 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f599406c010 0x7f599415a300 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f598c009e50 tx=0x7f598c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a6022a151851114 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:12:20.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.010+0000 7f5991ffb700 1 -- 172.21.15.80:0/3057429705 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f598c00e070 con 0x7f599406c010 2024-05-08T21:12:20.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.010+0000 7f5991ffb700 1 -- 172.21.15.80:0/3057429705 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f598c00b910 con 0x7f599406c010 2024-05-08T21:12:20.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.010+0000 7f5991ffb700 1 -- 172.21.15.80:0/3057429705 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f598c00bcc0 con 0x7f599406c010 2024-05-08T21:12:20.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.010+0000 7f59997ec700 1 -- 172.21.15.80:0/3057429705 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f599406c010 msgr2=0x7f599415a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:20.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.010+0000 7f59997ec700 1 --2- 172.21.15.80:0/3057429705 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f599406c010 0x7f599415a300 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f598c009e50 tx=0x7f598c00b330 comp rx=0 tx=0).stop 2024-05-08T21:12:20.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.010+0000 7f59997ec700 1 -- 172.21.15.80:0/3057429705 shutdown_connections 2024-05-08T21:12:20.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.010+0000 7f59997ec700 1 --2- 172.21.15.80:0/3057429705 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f599406c010 0x7f599415a300 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:20.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.010+0000 7f59997ec700 1 --2- 172.21.15.80:0/3057429705 >> v2:172.21.15.106:3300/0 conn(0x7f599406c5d0 0x7f599406bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:20.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.010+0000 7f59997ec700 1 -- 172.21.15.80:0/3057429705 >> 172.21.15.80:0/3057429705 conn(0x7f5994066780 msgr2=0x7f5994066b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:12:20.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.010+0000 7f59997ec700 1 -- 172.21.15.80:0/3057429705 shutdown_connections 2024-05-08T21:12:20.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.010+0000 7f59997ec700 1 -- 172.21.15.80:0/3057429705 wait complete. 2024-05-08T21:12:20.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.012+0000 7f59997ec700 1 Processor -- start 2024-05-08T21:12:20.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.012+0000 7f59997ec700 1 -- start start 2024-05-08T21:12:20.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.012+0000 7f59997ec700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f599406c010 0x7f59941506f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:12:20.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.012+0000 7f59997ec700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f599406c5d0 0x7f5994159560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:12:20.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.012+0000 7f59997ec700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5994154300 0x7f59941f12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:12:20.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.012+0000 7f59997ec700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5994157c60 con 0x7f599406c5d0 2024-05-08T21:12:20.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.012+0000 7f59997ec700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59940cb200 con 0x7f5994154300 2024-05-08T21:12:20.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.012+0000 7f59997ec700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59941f0c70 con 0x7f599406c010 2024-05-08T21:12:20.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.013+0000 7f59927fc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f599406c5d0 0x7f5994159560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:12:20.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.013+0000 7f59927fc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f599406c5d0 0x7f5994159560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37106/0 (socket says 172.21.15.80:37106) 2024-05-08T21:12:20.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.013+0000 7f59927fc700 1 -- 172.21.15.80:0/2771000835 learned_addr learned my addr 172.21.15.80:0/2771000835 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:12:20.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.013+0000 7f59937fe700 1 --2- 172.21.15.80:0/2771000835 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5994154300 0x7f59941f12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:12:20.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.013+0000 7f5992ffd700 1 --2- 172.21.15.80:0/2771000835 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f599406c010 0x7f59941506f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:12:20.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.013+0000 7f59927fc700 1 -- 172.21.15.80:0/2771000835 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f599406c010 msgr2=0x7f59941506f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:20.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.013+0000 7f59927fc700 1 --2- 172.21.15.80:0/2771000835 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f599406c010 0x7f59941506f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:20.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.013+0000 7f59927fc700 1 -- 172.21.15.80:0/2771000835 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5994154300 msgr2=0x7f59941f12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:20.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.013+0000 7f59927fc700 1 --2- 172.21.15.80:0/2771000835 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5994154300 0x7f59941f12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:20.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.013+0000 7f59927fc700 1 -- 172.21.15.80:0/2771000835 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59880094a0 con 0x7f599406c5d0 2024-05-08T21:12:20.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.013+0000 7f59927fc700 1 --2- 172.21.15.80:0/2771000835 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f599406c5d0 0x7f5994159560 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f598800ebe0 tx=0x7f598800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:12:20.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.013+0000 7f597b7fe700 1 -- 172.21.15.80:0/2771000835 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59880097a0 con 0x7f599406c5d0 2024-05-08T21:12:20.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.013+0000 7f597b7fe700 1 -- 172.21.15.80:0/2771000835 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f598800c850 con 0x7f599406c5d0 2024-05-08T21:12:20.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.013+0000 7f59997ec700 1 -- 172.21.15.80:0/2771000835 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f598c009b30 con 0x7f599406c5d0 2024-05-08T21:12:20.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.013+0000 7f597b7fe700 1 -- 172.21.15.80:0/2771000835 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f598800cbe0 con 0x7f599406c5d0 2024-05-08T21:12:20.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.013+0000 7f59997ec700 1 -- 172.21.15.80:0/2771000835 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f599414f4f0 con 0x7f599406c5d0 2024-05-08T21:12:20.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.014+0000 7f59997ec700 1 -- 172.21.15.80:0/2771000835 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f599406d3d0 con 0x7f599406c5d0 2024-05-08T21:12:20.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.015+0000 7f597b7fe700 1 -- 172.21.15.80:0/2771000835 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f598800cd40 con 0x7f599406c5d0 2024-05-08T21:12:20.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.015+0000 7f597b7fe700 1 --2- 172.21.15.80:0/2771000835 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f598006ac90 0x7f598006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:12:20.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.015+0000 7f597b7fe700 1 -- 172.21.15.80:0/2771000835 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f5988089720 con 0x7f599406c5d0 2024-05-08T21:12:20.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.015+0000 7f5992ffd700 1 --2- 172.21.15.80:0/2771000835 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f598006ac90 0x7f598006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:12:20.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.016+0000 7f5992ffd700 1 --2- 172.21.15.80:0/2771000835 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f598006ac90 0x7f598006d150 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5984007fd0 tx=0x7f5984009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:12:20.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.020+0000 7f597b7fe700 1 -- 172.21.15.80:0/2771000835 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f5988054580 con 0x7f599406c5d0 2024-05-08T21:12:20.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.268+0000 7f59997ec700 1 -- 172.21.15.80:0/2771000835 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f599415e2c0 con 0x7f599406c5d0 2024-05-08T21:12:20.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.268+0000 7f597b7fe700 1 -- 172.21.15.80:0/2771000835 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+5498 (secure 0 0 0) 0x7f5988057ba0 con 0x7f599406c5d0 2024-05-08T21:12:20.271 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:12:20.271 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:12:16.363448+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":11,"state":"up:rejoin","state_seq":37,"addr":"172.21.15.106:6833/2289230272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":2289230272},{"type":"v1","addr":"172.21.15.106:6833","nonce":2289230272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:12:20.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.271+0000 7f59997ec700 1 -- 172.21.15.80:0/2771000835 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f598006ac90 msgr2=0x7f598006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:20.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.271+0000 7f59997ec700 1 --2- 172.21.15.80:0/2771000835 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f598006ac90 0x7f598006d150 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5984007fd0 tx=0x7f5984009040 comp rx=0 tx=0).stop 2024-05-08T21:12:20.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.271+0000 7f59997ec700 1 -- 172.21.15.80:0/2771000835 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f599406c5d0 msgr2=0x7f5994159560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:20.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.271+0000 7f59997ec700 1 --2- 172.21.15.80:0/2771000835 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f599406c5d0 0x7f5994159560 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f598800ebe0 tx=0x7f598800eef0 comp rx=0 tx=0).stop 2024-05-08T21:12:20.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.271+0000 7f59997ec700 1 -- 172.21.15.80:0/2771000835 shutdown_connections 2024-05-08T21:12:20.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.271+0000 7f59997ec700 1 --2- 172.21.15.80:0/2771000835 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f598006ac90 0x7f598006d150 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:20.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.271+0000 7f59997ec700 1 --2- 172.21.15.80:0/2771000835 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5994154300 0x7f59941f12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:20.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.271+0000 7f59997ec700 1 --2- 172.21.15.80:0/2771000835 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f599406c010 0x7f59941506f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:20.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.271+0000 7f59997ec700 1 --2- 172.21.15.80:0/2771000835 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f599406c5d0 0x7f5994159560 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:20.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.271+0000 7f59997ec700 1 -- 172.21.15.80:0/2771000835 >> 172.21.15.80:0/2771000835 conn(0x7f5994066780 msgr2=0x7f599415b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:12:20.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.271+0000 7f59997ec700 1 -- 172.21.15.80:0/2771000835 shutdown_connections 2024-05-08T21:12:20.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:20.271+0000 7f59997ec700 1 -- 172.21.15.80:0/2771000835 wait complete. 2024-05-08T21:12:20.275 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 13 2024-05-08T21:12:20.286 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 13, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-05-08T21:10:03.725481+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 13, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_4288": { "addr": "172.21.15.106:6833/2289230272", "addrs": { "addrvec": [ { "addr": "172.21.15.106:6832", "nonce": 2289230272, "type": "v2" }, { "addr": "172.21.15.106:6833", "nonce": 2289230272, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4288, "incarnation": 11, "join_fscid": -1, "name": "b", "rank": 0, "state": "up:rejoin", "state_seq": 37 } }, "last_failure": 0, "last_failure_osd_epoch": 29, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-05-08T21:12:16.363448+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4288 } } } ], "standbys": [ { "addr": "172.21.15.106:6837/2762323230", "addrs": { "addrvec": [ { "addr": "172.21.15.106:6835", "nonce": 2762323230, "type": "v2" }, { "addr": "172.21.15.106:6837", "nonce": 2762323230, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4229, "incarnation": 0, "join_fscid": -1, "name": "f", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.80:6837/1121814432", "addrs": { "addrvec": [ { "addr": "172.21.15.80:6834", "nonce": 1121814432, "type": "v2" }, { "addr": "172.21.15.80:6837", "nonce": 1121814432, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4251, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.80:6839/1867024080", "addrs": { "addrvec": [ { "addr": "172.21.15.80:6838", "nonce": 1867024080, "type": "v2" }, { "addr": "172.21.15.80:6839", "nonce": 1867024080, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 2, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4254, "incarnation": 0, "join_fscid": -1, "name": "e", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.80:6836/1947012643", "addrs": { "addrvec": [ { "addr": "172.21.15.80:6835", "nonce": 1947012643, "type": "v2" }, { "addr": "172.21.15.80:6836", "nonce": 1947012643, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4273, "incarnation": 0, "join_fscid": -1, "name": "c", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-05-08T21:12:22.288 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:12:22.372 INFO:tasks.workunit.client.0.smithi080.stderr:Note: switching to 'd21e4f961318b56f0d915caa2490c3711bf13c34'. 2024-05-08T21:12:22.372 INFO:tasks.workunit.client.0.smithi080.stderr: 2024-05-08T21:12:22.372 INFO:tasks.workunit.client.0.smithi080.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-05-08T21:12:22.372 INFO:tasks.workunit.client.0.smithi080.stderr:changes and commit them, and you can discard any commits you make in this 2024-05-08T21:12:22.372 INFO:tasks.workunit.client.0.smithi080.stderr:state without impacting any branches by switching back to a branch. 2024-05-08T21:12:22.372 INFO:tasks.workunit.client.0.smithi080.stderr: 2024-05-08T21:12:22.372 INFO:tasks.workunit.client.0.smithi080.stderr:If you want to create a new branch to retain commits you create, you may 2024-05-08T21:12:22.372 INFO:tasks.workunit.client.0.smithi080.stderr:do so (now or later) by using -c with the switch command. Example: 2024-05-08T21:12:22.372 INFO:tasks.workunit.client.0.smithi080.stderr: 2024-05-08T21:12:22.372 INFO:tasks.workunit.client.0.smithi080.stderr: git switch -c 2024-05-08T21:12:22.372 INFO:tasks.workunit.client.0.smithi080.stderr: 2024-05-08T21:12:22.372 INFO:tasks.workunit.client.0.smithi080.stderr:Or undo this operation with: 2024-05-08T21:12:22.372 INFO:tasks.workunit.client.0.smithi080.stderr: 2024-05-08T21:12:22.373 INFO:tasks.workunit.client.0.smithi080.stderr: git switch - 2024-05-08T21:12:22.373 INFO:tasks.workunit.client.0.smithi080.stderr: 2024-05-08T21:12:22.373 INFO:tasks.workunit.client.0.smithi080.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-05-08T21:12:22.373 INFO:tasks.workunit.client.0.smithi080.stderr: 2024-05-08T21:12:22.373 INFO:tasks.workunit.client.0.smithi080.stderr:HEAD is now at d21e4f96131 Merge PR #57343 into wip-pdonnell-testing-20240508.150423-reef 2024-05-08T21:12:22.378 DEBUG:teuthology.orchestra.run.smithi080:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-05-08T21:12:22.408 INFO:tasks.workunit.client.0.smithi080.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-05-08T21:12:22.410 INFO:tasks.workunit.client.0.smithi080.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-08T21:12:22.410 INFO:tasks.workunit.client.0.smithi080.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-05-08T21:12:22.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.413+0000 7f810a8aa700 1 Processor -- start 2024-05-08T21:12:22.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.413+0000 7f810a8aa700 1 -- start start 2024-05-08T21:12:22.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.414+0000 7f810a8aa700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8104154580 0x7f810415abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:12:22.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.414+0000 7f810a8aa700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f81040cbe40 0x7f81040c48c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:12:22.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.414+0000 7f810a8aa700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81040cad60 con 0x7f81040c4e00 2024-05-08T21:12:22.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.414+0000 7f810a8aa700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81040b2c60 con 0x7f81040cbe40 2024-05-08T21:12:22.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.414+0000 7f810a8aa700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f810415d750 con 0x7f8104154580 2024-05-08T21:12:22.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.414+0000 7f81037fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f81040cbe40 0x7f81040c48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:12:22.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.414+0000 7f8108e47700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f81040c4e00 0x7f81040cc3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60684/0 (socket says 172.21.15.80:60684) 2024-05-08T21:12:22.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.414+0000 7f8108e47700 1 -- 172.21.15.80:0/2950328782 learned_addr learned my addr 172.21.15.80:0/2950328782 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:12:22.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.414+0000 7f8103fff700 1 --2- 172.21.15.80:0/2950328782 >> v2:172.21.15.106:3300/0 conn(0x7f8104154580 0x7f810415abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:12:22.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.414+0000 7f81037fe700 1 -- 172.21.15.80:0/2950328782 >> v2:172.21.15.106:3300/0 conn(0x7f8104154580 msgr2=0x7f810415abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:12:22.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.414+0000 7f81037fe700 1 --2- 172.21.15.80:0/2950328782 >> v2:172.21.15.106:3300/0 conn(0x7f8104154580 0x7f810415abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:22.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.414+0000 7f81037fe700 1 -- 172.21.15.80:0/2950328782 >> v1:172.21.15.80:6789/0 conn(0x7f81040c4e00 legacy=0x7f81040cc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:22.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.414+0000 7f81037fe700 1 -- 172.21.15.80:0/2950328782 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f810415d930 con 0x7f81040cbe40 2024-05-08T21:12:22.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.414+0000 7f8102ffd700 1 -- 172.21.15.80:0/2950328782 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 431796805 0 0) 0x7f81040cad60 con 0x7f81040c4e00 2024-05-08T21:12:22.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.414+0000 7f81037fe700 1 --2- 172.21.15.80:0/2950328782 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f81040cbe40 0x7f81040c48c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f81040cd360 tx=0x7f80ec009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcd606bd9b53fbd0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:12:22.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.414+0000 7f8102ffd700 1 -- 172.21.15.80:0/2950328782 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ec011830 con 0x7f81040cbe40 2024-05-08T21:12:22.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.414+0000 7f8102ffd700 1 -- 172.21.15.80:0/2950328782 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80ec011990 con 0x7f81040cbe40 2024-05-08T21:12:22.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.414+0000 7f8102ffd700 1 -- 172.21.15.80:0/2950328782 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ec011d20 con 0x7f81040cbe40 2024-05-08T21:12:22.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.415+0000 7f810a8aa700 1 -- 172.21.15.80:0/2950328782 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f81040cbe40 msgr2=0x7f81040c48c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:22.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.415+0000 7f810a8aa700 1 --2- 172.21.15.80:0/2950328782 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f81040cbe40 0x7f81040c48c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f81040cd360 tx=0x7f80ec009b50 comp rx=0 tx=0).stop 2024-05-08T21:12:22.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.415+0000 7f810a8aa700 1 -- 172.21.15.80:0/2950328782 shutdown_connections 2024-05-08T21:12:22.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.415+0000 7f810a8aa700 1 --2- 172.21.15.80:0/2950328782 >> v2:172.21.15.106:3300/0 conn(0x7f8104154580 0x7f810415abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:22.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.415+0000 7f810a8aa700 1 --2- 172.21.15.80:0/2950328782 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f81040cbe40 0x7f81040c48c0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:22.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.415+0000 7f810a8aa700 1 -- 172.21.15.80:0/2950328782 >> 172.21.15.80:0/2950328782 conn(0x7f810406c6a0 msgr2=0x7f810406cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:12:22.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.415+0000 7f810a8aa700 1 -- 172.21.15.80:0/2950328782 shutdown_connections 2024-05-08T21:12:22.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.415+0000 7f810a8aa700 1 -- 172.21.15.80:0/2950328782 wait complete. 2024-05-08T21:12:22.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.416+0000 7f810a8aa700 1 Processor -- start 2024-05-08T21:12:22.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.416+0000 7f810a8aa700 1 -- start start 2024-05-08T21:12:22.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.417+0000 7f810a8aa700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f81040c4e00 0x7f81041f1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:12:22.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.417+0000 7f810a8aa700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f81040cbe40 0x7f81041f1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:12:22.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.417+0000 7f810a8aa700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8104154580 0x7f8104150db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:12:22.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.417+0000 7f810a8aa700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81041526f0 con 0x7f81040cbe40 2024-05-08T21:12:22.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.417+0000 7f810a8aa700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81040cf580 con 0x7f8104154580 2024-05-08T21:12:22.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.417+0000 7f810a8aa700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81040ce9b0 con 0x7f81040c4e00 2024-05-08T21:12:22.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.417+0000 7f81037fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f81040cbe40 0x7f81041f1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:12:22.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.417+0000 7f81037fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f81040cbe40 0x7f81041f1740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38294/0 (socket says 172.21.15.80:38294) 2024-05-08T21:12:22.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.417+0000 7f81037fe700 1 -- 172.21.15.80:0/1369179712 learned_addr learned my addr 172.21.15.80:0/1369179712 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:12:22.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.417+0000 7f8103fff700 1 --2- 172.21.15.80:0/1369179712 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f81040c4e00 0x7f81041f1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:12:22.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.417+0000 7f8108e47700 1 --2- 172.21.15.80:0/1369179712 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8104154580 0x7f8104150db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:12:22.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.417+0000 7f81037fe700 1 -- 172.21.15.80:0/1369179712 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f81040c4e00 msgr2=0x7f81041f1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:22.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.417+0000 7f81037fe700 1 --2- 172.21.15.80:0/1369179712 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f81040c4e00 0x7f81041f1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:22.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.417+0000 7f81037fe700 1 -- 172.21.15.80:0/1369179712 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8104154580 msgr2=0x7f8104150db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:22.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.417+0000 7f81037fe700 1 --2- 172.21.15.80:0/1369179712 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8104154580 0x7f8104150db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:22.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.417+0000 7f81037fe700 1 -- 172.21.15.80:0/1369179712 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80ec0094a0 con 0x7f81040cbe40 2024-05-08T21:12:22.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.417+0000 7f8103fff700 1 --2- 172.21.15.80:0/1369179712 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f81040c4e00 0x7f81041f1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:12:22.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.418+0000 7f81037fe700 1 --2- 172.21.15.80:0/1369179712 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f81040cbe40 0x7f81041f1740 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f80ec0097c0 tx=0x7f80ec004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:12:22.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.418+0000 7f8100ff9700 1 -- 172.21.15.80:0/1369179712 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ec0038a0 con 0x7f81040cbe40 2024-05-08T21:12:22.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.418+0000 7f8100ff9700 1 -- 172.21.15.80:0/1369179712 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80ec01f070 con 0x7f81040cbe40 2024-05-08T21:12:22.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.418+0000 7f810a8aa700 1 -- 172.21.15.80:0/1369179712 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81040cfa10 con 0x7f81040cbe40 2024-05-08T21:12:22.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.418+0000 7f8100ff9700 1 -- 172.21.15.80:0/1369179712 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ec003c40 con 0x7f81040cbe40 2024-05-08T21:12:22.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.418+0000 7f810a8aa700 1 -- 172.21.15.80:0/1369179712 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81040cef30 con 0x7f81040cbe40 2024-05-08T21:12:22.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.419+0000 7f810a8aa700 1 -- 172.21.15.80:0/1369179712 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8104067790 con 0x7f81040cbe40 2024-05-08T21:12:22.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.419+0000 7f8100ff9700 1 -- 172.21.15.80:0/1369179712 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f80ec026480 con 0x7f81040cbe40 2024-05-08T21:12:22.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.419+0000 7f8100ff9700 1 --2- 172.21.15.80:0/1369179712 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f80e406ac90 0x7f80e406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:12:22.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.420+0000 7f8100ff9700 1 -- 172.21.15.80:0/1369179712 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f80ec021070 con 0x7f81040cbe40 2024-05-08T21:12:22.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.420+0000 7f8103fff700 1 --2- 172.21.15.80:0/1369179712 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f80e406ac90 0x7f80e406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:12:22.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.420+0000 7f8103fff700 1 --2- 172.21.15.80:0/1369179712 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f80e406ac90 0x7f80e406d150 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f80f4007a50 tx=0x7f80f4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:12:22.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.424+0000 7f8100ff9700 1 -- 172.21.15.80:0/1369179712 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f80ec055e90 con 0x7f81040cbe40 2024-05-08T21:12:22.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.668+0000 7f810a8aa700 1 -- 172.21.15.80:0/1369179712 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f81040cf6f0 con 0x7f81040cbe40 2024-05-08T21:12:22.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.668+0000 7f8100ff9700 1 -- 172.21.15.80:0/1369179712 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+5498 (secure 0 0 0) 0x7f80ec015020 con 0x7f81040cbe40 2024-05-08T21:12:22.671 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:12:22.671 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:12:21.380279+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":39,"addr":"172.21.15.106:6833/2289230272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":2289230272},{"type":"v1","addr":"172.21.15.106:6833","nonce":2289230272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:12:22.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.671+0000 7f810a8aa700 1 -- 172.21.15.80:0/1369179712 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f80e406ac90 msgr2=0x7f80e406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:22.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.671+0000 7f810a8aa700 1 --2- 172.21.15.80:0/1369179712 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f80e406ac90 0x7f80e406d150 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f80f4007a50 tx=0x7f80f4008040 comp rx=0 tx=0).stop 2024-05-08T21:12:22.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.671+0000 7f810a8aa700 1 -- 172.21.15.80:0/1369179712 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f81040cbe40 msgr2=0x7f81041f1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:22.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.671+0000 7f810a8aa700 1 --2- 172.21.15.80:0/1369179712 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f81040cbe40 0x7f81041f1740 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f80ec0097c0 tx=0x7f80ec004750 comp rx=0 tx=0).stop 2024-05-08T21:12:22.674 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.671+0000 7f810a8aa700 1 -- 172.21.15.80:0/1369179712 shutdown_connections 2024-05-08T21:12:22.674 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.671+0000 7f810a8aa700 1 --2- 172.21.15.80:0/1369179712 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f80e406ac90 0x7f80e406d150 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:22.674 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.671+0000 7f810a8aa700 1 --2- 172.21.15.80:0/1369179712 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8104154580 0x7f8104150db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:22.674 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.671+0000 7f810a8aa700 1 --2- 172.21.15.80:0/1369179712 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f81040c4e00 0x7f81041f1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:22.674 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.671+0000 7f810a8aa700 1 --2- 172.21.15.80:0/1369179712 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f81040cbe40 0x7f81041f1740 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:22.674 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.671+0000 7f810a8aa700 1 -- 172.21.15.80:0/1369179712 >> 172.21.15.80:0/1369179712 conn(0x7f810406c6a0 msgr2=0x7f81040c52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:12:22.674 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.671+0000 7f810a8aa700 1 -- 172.21.15.80:0/1369179712 shutdown_connections 2024-05-08T21:12:22.674 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.671+0000 7f810a8aa700 1 -- 172.21.15.80:0/1369179712 wait complete. 2024-05-08T21:12:22.674 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 14 2024-05-08T21:12:22.685 INFO:tasks.mds_thrash.fs.[cephfs]:mds.b has gained rank=0, replacing gid=4291 2024-05-08T21:12:22.686 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 0 secs before reviving mds.d 2024-05-08T21:12:22.686 INFO:tasks.mds_thrash.fs.[cephfs]:reviving mds.d 2024-05-08T21:12:22.686 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-08T21:12:22.686 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-08T21:12:22.689 INFO:tasks.ceph.mds.d:Started 2024-05-08T21:12:22.689 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:12:22.778 INFO:tasks.ceph.mds.d.smithi106.stdout:starting mds.d at 2024-05-08T21:12:22.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.847+0000 7fcfa590a700 1 Processor -- start 2024-05-08T21:12:22.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.847+0000 7fcfa590a700 1 -- start start 2024-05-08T21:12:22.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.848+0000 7fcfa590a700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fcfa00c83a0 0x7fcfa00711f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:12:22.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.848+0000 7fcfa590a700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfa0152800 con 0x7fcfa0158ac0 2024-05-08T21:12:22.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.848+0000 7fcfa590a700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfa00c7800 con 0x7fcfa0152420 2024-05-08T21:12:22.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.848+0000 7fcfa590a700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfa00729b0 con 0x7fcfa00c83a0 2024-05-08T21:12:22.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.848+0000 7fcf9f7fe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fcfa0158ac0 0x7fcfa0071730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60700/0 (socket says 172.21.15.80:60700) 2024-05-08T21:12:22.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.848+0000 7fcf9f7fe700 1 -- 172.21.15.80:0/1012139483 learned_addr learned my addr 172.21.15.80:0/1012139483 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:12:22.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.848+0000 7fcf9e7fc700 1 --2- 172.21.15.80:0/1012139483 >> v2:172.21.15.106:3300/0 conn(0x7fcfa00c83a0 0x7fcfa00711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:12:22.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.848+0000 7fcf9dffb700 1 -- 172.21.15.80:0/1012139483 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2547356347 0 0) 0x7fcfa0152800 con 0x7fcfa0158ac0 2024-05-08T21:12:22.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.848+0000 7fcf9dffb700 1 -- 172.21.15.80:0/1012139483 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf880035b0 con 0x7fcfa0158ac0 2024-05-08T21:12:22.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.848+0000 7fcf9dffb700 1 -- 172.21.15.80:0/1012139483 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2638947797 0 0) 0x7fcfa00c7800 con 0x7fcfa0152420 2024-05-08T21:12:22.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.848+0000 7fcf9dffb700 1 -- 172.21.15.80:0/1012139483 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfa0152800 con 0x7fcfa0152420 2024-05-08T21:12:22.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.848+0000 7fcf9e7fc700 1 -- 172.21.15.80:0/1012139483 >> v1:172.21.15.106:6789/0 conn(0x7fcfa0152420 legacy=0x7fcfa00c7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:22.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.848+0000 7fcf9e7fc700 1 -- 172.21.15.80:0/1012139483 >> v1:172.21.15.80:6789/0 conn(0x7fcfa0158ac0 legacy=0x7fcfa0071730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:22.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.848+0000 7fcf9e7fc700 1 -- 172.21.15.80:0/1012139483 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa0066d80 con 0x7fcfa00c83a0 2024-05-08T21:12:22.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.849+0000 7fcf9e7fc700 1 --2- 172.21.15.80:0/1012139483 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcfa00c83a0 0x7fcfa00711f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fcf90009840 tx=0x7fcf90009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9a77824bce729db server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:12:22.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.849+0000 7fcf9dffb700 1 -- 172.21.15.80:0/1012139483 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf90011830 con 0x7fcfa00c83a0 2024-05-08T21:12:22.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.849+0000 7fcf9dffb700 1 -- 172.21.15.80:0/1012139483 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf90011990 con 0x7fcfa00c83a0 2024-05-08T21:12:22.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.849+0000 7fcf9dffb700 1 -- 172.21.15.80:0/1012139483 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf90011d20 con 0x7fcfa00c83a0 2024-05-08T21:12:22.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.849+0000 7fcfa590a700 1 -- 172.21.15.80:0/1012139483 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcfa00c83a0 msgr2=0x7fcfa00711f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:22.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.849+0000 7fcfa590a700 1 --2- 172.21.15.80:0/1012139483 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcfa00c83a0 0x7fcfa00711f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fcf90009840 tx=0x7fcf90009b50 comp rx=0 tx=0).stop 2024-05-08T21:12:22.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.849+0000 7fcfa590a700 1 -- 172.21.15.80:0/1012139483 shutdown_connections 2024-05-08T21:12:22.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.849+0000 7fcfa590a700 1 --2- 172.21.15.80:0/1012139483 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcfa00c83a0 0x7fcfa00711f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:22.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.849+0000 7fcfa590a700 1 -- 172.21.15.80:0/1012139483 >> 172.21.15.80:0/1012139483 conn(0x7fcfa00c8980 msgr2=0x7fcfa00c8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:12:22.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.849+0000 7fcfa590a700 1 -- 172.21.15.80:0/1012139483 shutdown_connections 2024-05-08T21:12:22.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.849+0000 7fcfa590a700 1 -- 172.21.15.80:0/1012139483 wait complete. 2024-05-08T21:12:22.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.851+0000 7fcfa590a700 1 Processor -- start 2024-05-08T21:12:22.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.851+0000 7fcfa590a700 1 -- start start 2024-05-08T21:12:22.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.851+0000 7fcfa590a700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcfa00c83a0 0x7fcfa014de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:12:22.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.851+0000 7fcfa590a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcfa0152420 0x7fcfa01efc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:12:22.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.851+0000 7fcfa590a700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcfa0158ac0 0x7fcfa01f0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:12:22.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.851+0000 7fcfa590a700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa01ef790 con 0x7fcfa0152420 2024-05-08T21:12:22.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.851+0000 7fcfa590a700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa00cbb10 con 0x7fcfa0158ac0 2024-05-08T21:12:22.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.851+0000 7fcfa590a700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa01479a0 con 0x7fcfa00c83a0 2024-05-08T21:12:22.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.852+0000 7fcf9e7fc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcfa0152420 0x7fcfa01efc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:12:22.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.852+0000 7fcf9e7fc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcfa0152420 0x7fcfa01efc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38296/0 (socket says 172.21.15.80:38296) 2024-05-08T21:12:22.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.852+0000 7fcf9e7fc700 1 -- 172.21.15.80:0/3537590009 learned_addr learned my addr 172.21.15.80:0/3537590009 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:12:22.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.852+0000 7fcf9effd700 1 --2- 172.21.15.80:0/3537590009 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcfa00c83a0 0x7fcfa014de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:12:22.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.852+0000 7fcf9f7fe700 1 --2- 172.21.15.80:0/3537590009 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcfa0158ac0 0x7fcfa01f0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:12:22.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.852+0000 7fcf9e7fc700 1 -- 172.21.15.80:0/3537590009 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcfa00c83a0 msgr2=0x7fcfa014de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:22.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.852+0000 7fcf9e7fc700 1 --2- 172.21.15.80:0/3537590009 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcfa00c83a0 0x7fcfa014de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:22.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.852+0000 7fcf9e7fc700 1 -- 172.21.15.80:0/3537590009 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcfa0158ac0 msgr2=0x7fcfa01f0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:22.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.852+0000 7fcf9e7fc700 1 --2- 172.21.15.80:0/3537590009 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcfa0158ac0 0x7fcfa01f0160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:22.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.852+0000 7fcf9e7fc700 1 -- 172.21.15.80:0/3537590009 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf900094a0 con 0x7fcfa0152420 2024-05-08T21:12:22.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.852+0000 7fcf9f7fe700 1 --2- 172.21.15.80:0/3537590009 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcfa0158ac0 0x7fcfa01f0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:12:22.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.852+0000 7fcf9e7fc700 1 --2- 172.21.15.80:0/3537590009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcfa0152420 0x7fcfa01efc20 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fcf90014040 tx=0x7fcf90004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:12:22.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.852+0000 7fcf87fff700 1 -- 172.21.15.80:0/3537590009 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9001a7e0 con 0x7fcfa0152420 2024-05-08T21:12:22.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.852+0000 7fcf87fff700 1 -- 172.21.15.80:0/3537590009 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf9001a940 con 0x7fcfa0152420 2024-05-08T21:12:22.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.852+0000 7fcf87fff700 1 -- 172.21.15.80:0/3537590009 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9001acb0 con 0x7fcfa0152420 2024-05-08T21:12:22.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.852+0000 7fcfa590a700 1 -- 172.21.15.80:0/3537590009 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfa0147c80 con 0x7fcfa0152420 2024-05-08T21:12:22.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.852+0000 7fcfa590a700 1 -- 172.21.15.80:0/3537590009 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfa00ca100 con 0x7fcfa0152420 2024-05-08T21:12:22.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.853+0000 7fcfa590a700 1 -- 172.21.15.80:0/3537590009 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfa00c9c80 con 0x7fcfa0152420 2024-05-08T21:12:22.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.854+0000 7fcf87fff700 1 -- 172.21.15.80:0/3537590009 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fcf90022070 con 0x7fcfa0152420 2024-05-08T21:12:22.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.854+0000 7fcf87fff700 1 --2- 172.21.15.80:0/3537590009 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fcf8c06ac90 0x7fcf8c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:12:22.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.854+0000 7fcf87fff700 1 -- 172.21.15.80:0/3537590009 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6749+0+0 (secure 0 0 0) 0x7fcf9008a370 con 0x7fcfa0152420 2024-05-08T21:12:22.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.854+0000 7fcf9effd700 1 --2- 172.21.15.80:0/3537590009 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fcf8c06ac90 0x7fcf8c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:12:22.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.854+0000 7fcf9effd700 1 --2- 172.21.15.80:0/3537590009 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fcf8c06ac90 0x7fcf8c06d150 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fcf94001220 tx=0x7fcf94009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:12:22.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:22.858+0000 7fcf87fff700 1 -- 172.21.15.80:0/3537590009 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fcfa00c9c80 con 0x7fcfa0152420 2024-05-08T21:12:22.868 INFO:tasks.workunit.client.0.smithi080.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-05-08T21:12:22.936 INFO:tasks.workunit.client.0.smithi080.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-05-08T21:12:22.973 INFO:tasks.workunit.client.0.smithi080.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-08T21:12:22.974 INFO:tasks.workunit.client.0.smithi080.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-08T21:12:22.974 INFO:tasks.workunit.client.0.smithi080.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-05-08T21:12:23.011 INFO:tasks.workunit.client.0.smithi080.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-08T21:12:23.014 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T21:12:23.014 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-05-08T21:12:23.031 INFO:tasks.workunit:Running workunits matching suites/ffsb.sh on client.0... 2024-05-08T21:12:23.032 INFO:tasks.workunit:Running workunit suites/ffsb.sh... 2024-05-08T21:12:23.033 DEBUG:teuthology.orchestra.run.smithi080:workunit test suites/ffsb.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d21e4f961318b56f0d915caa2490c3711bf13c34 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh 2024-05-08T21:12:23.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:23.114+0000 7fcfa590a700 1 -- 172.21.15.80:0/3537590009 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcfa00c9c80 con 0x7fcfa0152420 2024-05-08T21:12:23.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:23.114+0000 7fcf87fff700 1 -- 172.21.15.80:0/3537590009 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+5498 (secure 0 0 0) 0x7fcfa00c9c80 con 0x7fcfa0152420 2024-05-08T21:12:23.116 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:12:23.117 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:12:21.380279+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":39,"addr":"172.21.15.106:6833/2289230272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":2289230272},{"type":"v1","addr":"172.21.15.106:6833","nonce":2289230272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:12:23.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:23.116+0000 7fcfa590a700 1 -- 172.21.15.80:0/3537590009 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fcf8c06ac90 msgr2=0x7fcf8c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:23.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:23.116+0000 7fcfa590a700 1 --2- 172.21.15.80:0/3537590009 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fcf8c06ac90 0x7fcf8c06d150 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fcf94001220 tx=0x7fcf94009040 comp rx=0 tx=0).stop 2024-05-08T21:12:23.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:23.116+0000 7fcfa590a700 1 -- 172.21.15.80:0/3537590009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcfa0152420 msgr2=0x7fcfa01efc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:23.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:23.116+0000 7fcfa590a700 1 --2- 172.21.15.80:0/3537590009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcfa0152420 0x7fcfa01efc20 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fcf90014040 tx=0x7fcf90004750 comp rx=0 tx=0).stop 2024-05-08T21:12:23.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:23.116+0000 7fcfa590a700 1 -- 172.21.15.80:0/3537590009 shutdown_connections 2024-05-08T21:12:23.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:23.116+0000 7fcfa590a700 1 --2- 172.21.15.80:0/3537590009 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fcf8c06ac90 0x7fcf8c06d150 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:23.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:23.116+0000 7fcfa590a700 1 --2- 172.21.15.80:0/3537590009 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcfa0158ac0 0x7fcfa01f0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:23.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:23.116+0000 7fcfa590a700 1 --2- 172.21.15.80:0/3537590009 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcfa00c83a0 0x7fcfa014de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:23.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:23.116+0000 7fcfa590a700 1 --2- 172.21.15.80:0/3537590009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcfa0152420 0x7fcfa01efc20 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:23.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:23.116+0000 7fcfa590a700 1 -- 172.21.15.80:0/3537590009 >> 172.21.15.80:0/3537590009 conn(0x7fcfa00c8980 msgr2=0x7fcfa006b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:12:23.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:23.116+0000 7fcfa590a700 1 -- 172.21.15.80:0/3537590009 shutdown_connections 2024-05-08T21:12:23.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:23.117+0000 7fcfa590a700 1 -- 172.21.15.80:0/3537590009 wait complete. 2024-05-08T21:12:23.120 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 14 2024-05-08T21:12:23.131 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.d is in active, standby or standby-replay 2024-05-08T21:12:25.132 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:12:25.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.265+0000 7f8058ae6700 1 Processor -- start 2024-05-08T21:12:25.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.265+0000 7f8058ae6700 1 -- start start 2024-05-08T21:12:25.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.266+0000 7f8058ae6700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8054071f90 0x7f805406a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:12:25.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.266+0000 7f8058ae6700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f805406af00 0x7f805415a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:12:25.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.266+0000 7f8058ae6700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f805415e570 con 0x7f8054154320 2024-05-08T21:12:25.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.266+0000 7f8058ae6700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8054072400 con 0x7f8054071f90 2024-05-08T21:12:25.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.266+0000 7f8058ae6700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f805415d710 con 0x7f805406af00 2024-05-08T21:12:25.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.266+0000 7f8051d9b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8054071f90 0x7f805406a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:12:25.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.266+0000 7f8051d9b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8054071f90 0x7f805406a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38312/0 (socket says 172.21.15.80:38312) 2024-05-08T21:12:25.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.266+0000 7f8051d9b700 1 -- 172.21.15.80:0/2417858663 learned_addr learned my addr 172.21.15.80:0/2417858663 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:12:25.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.266+0000 7f8052d9d700 1 --2- 172.21.15.80:0/2417858663 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f805406af00 0x7f805415a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:12:25.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.266+0000 7f8051d9b700 1 -- 172.21.15.80:0/2417858663 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f805406af00 msgr2=0x7f805415a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:12:25.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.266+0000 7f8051d9b700 1 --2- 172.21.15.80:0/2417858663 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f805406af00 0x7f805415a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:25.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.266+0000 7f8051d9b700 1 -- 172.21.15.80:0/2417858663 >> v1:172.21.15.106:6789/0 conn(0x7f8054154320 legacy=0x7f80540c99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:12:25.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.266+0000 7f8051d9b700 1 -- 172.21.15.80:0/2417858663 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f805415d960 con 0x7f8054071f90 2024-05-08T21:12:25.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.267+0000 7f8051d9b700 1 --2- 172.21.15.80:0/2417858663 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8054071f90 0x7f805406a9c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f80440098f0 tx=0x7f8044009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c77ba6d0701e46e1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:12:25.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.267+0000 7f805159a700 1 -- 172.21.15.80:0/2417858663 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8044004230 con 0x7f8054071f90 2024-05-08T21:12:25.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.267+0000 7f805159a700 1 -- 172.21.15.80:0/2417858663 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8044004390 con 0x7f8054071f90 2024-05-08T21:12:25.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.267+0000 7f805159a700 1 -- 172.21.15.80:0/2417858663 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80440036a0 con 0x7f8054071f90 2024-05-08T21:12:25.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.267+0000 7f8058ae6700 1 -- 172.21.15.80:0/2417858663 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8054071f90 msgr2=0x7f805406a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:25.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.267+0000 7f8058ae6700 1 --2- 172.21.15.80:0/2417858663 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8054071f90 0x7f805406a9c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f80440098f0 tx=0x7f8044009c00 comp rx=0 tx=0).stop 2024-05-08T21:12:25.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.267+0000 7f8058ae6700 1 -- 172.21.15.80:0/2417858663 shutdown_connections 2024-05-08T21:12:25.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.267+0000 7f8058ae6700 1 --2- 172.21.15.80:0/2417858663 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f805406af00 0x7f805415a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:25.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.267+0000 7f8058ae6700 1 --2- 172.21.15.80:0/2417858663 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8054071f90 0x7f805406a9c0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:25.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.267+0000 7f8058ae6700 1 -- 172.21.15.80:0/2417858663 >> 172.21.15.80:0/2417858663 conn(0x7f805406f140 msgr2=0x7f805406f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:12:25.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.267+0000 7f8058ae6700 1 -- 172.21.15.80:0/2417858663 shutdown_connections 2024-05-08T21:12:25.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.267+0000 7f8058ae6700 1 -- 172.21.15.80:0/2417858663 wait complete. 2024-05-08T21:12:25.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.269+0000 7f8058ae6700 1 Processor -- start 2024-05-08T21:12:25.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.269+0000 7f8058ae6700 1 -- start start 2024-05-08T21:12:25.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.269+0000 7f8058ae6700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f805406af00 0x7f805414e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:12:25.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.269+0000 7f8058ae6700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8054071f90 0x7f80541f3190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:12:25.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.269+0000 7f8058ae6700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8054154320 0x7f8054149220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:12:25.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.269+0000 7f8058ae6700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8054151d40 con 0x7f805406af00 2024-05-08T21:12:25.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.270+0000 7f8058ae6700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f805415a000 con 0x7f8054071f90 2024-05-08T21:12:25.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.270+0000 7f8058ae6700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80541f29d0 con 0x7f8054154320 2024-05-08T21:12:25.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.270+0000 7f805259c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f805406af00 0x7f805414e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:12:25.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.270+0000 7f805259c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f805406af00 0x7f805414e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38324/0 (socket says 172.21.15.80:38324) 2024-05-08T21:12:25.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.270+0000 7f805259c700 1 -- 172.21.15.80:0/1073082026 learned_addr learned my addr 172.21.15.80:0/1073082026 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:12:25.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.270+0000 7f8051d9b700 1 --2- 172.21.15.80:0/1073082026 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8054071f90 0x7f80541f3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:12:25.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.270+0000 7f8052d9d700 1 --2- 172.21.15.80:0/1073082026 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8054154320 0x7f8054149220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:12:25.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.270+0000 7f805259c700 1 -- 172.21.15.80:0/1073082026 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8054154320 msgr2=0x7f8054149220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:25.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.270+0000 7f805259c700 1 --2- 172.21.15.80:0/1073082026 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8054154320 0x7f8054149220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:25.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.270+0000 7f805259c700 1 -- 172.21.15.80:0/1073082026 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8054071f90 msgr2=0x7f80541f3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:25.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.270+0000 7f805259c700 1 --2- 172.21.15.80:0/1073082026 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8054071f90 0x7f80541f3190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:25.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.270+0000 7f805259c700 1 -- 172.21.15.80:0/1073082026 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8044009550 con 0x7f805406af00 2024-05-08T21:12:25.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.270+0000 7f8052d9d700 1 --2- 172.21.15.80:0/1073082026 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8054154320 0x7f8054149220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:12:25.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.270+0000 7f805259c700 1 --2- 172.21.15.80:0/1073082026 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f805406af00 0x7f805414e850 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f804800c4d0 tx=0x7f804800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:12:25.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.270+0000 7f8042ffd700 1 -- 172.21.15.80:0/1073082026 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8048011790 con 0x7f805406af00 2024-05-08T21:12:25.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.270+0000 7f8042ffd700 1 -- 172.21.15.80:0/1073082026 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80480118f0 con 0x7f805406af00 2024-05-08T21:12:25.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.270+0000 7f8058ae6700 1 -- 172.21.15.80:0/1073082026 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8054152200 con 0x7f805406af00 2024-05-08T21:12:25.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.270+0000 7f8042ffd700 1 -- 172.21.15.80:0/1073082026 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8048011ca0 con 0x7f805406af00 2024-05-08T21:12:25.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.270+0000 7f8058ae6700 1 -- 172.21.15.80:0/1073082026 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80541527c0 con 0x7f805406af00 2024-05-08T21:12:25.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.271+0000 7f8058ae6700 1 -- 172.21.15.80:0/1073082026 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80541519a0 con 0x7f805406af00 2024-05-08T21:12:25.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.272+0000 7f8042ffd700 1 -- 172.21.15.80:0/1073082026 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f804801c460 con 0x7f805406af00 2024-05-08T21:12:25.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.272+0000 7f8042ffd700 1 --2- 172.21.15.80:0/1073082026 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f803406ac90 0x7f803406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:12:25.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.272+0000 7f8042ffd700 1 -- 172.21.15.80:0/1073082026 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f80480894a0 con 0x7f805406af00 2024-05-08T21:12:25.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.272+0000 7f8051d9b700 1 --2- 172.21.15.80:0/1073082026 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f803406ac90 0x7f803406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:12:25.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.273+0000 7f8051d9b700 1 --2- 172.21.15.80:0/1073082026 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f803406ac90 0x7f803406d150 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8044009130 tx=0x7f8044008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:12:25.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.277+0000 7f8042ffd700 1 -- 172.21.15.80:0/1073082026 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f80541519a0 con 0x7f805406af00 2024-05-08T21:12:25.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.518+0000 7f8058ae6700 1 -- 172.21.15.80:0/1073082026 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f80541519a0 con 0x7f805406af00 2024-05-08T21:12:25.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.518+0000 7f8042ffd700 1 -- 172.21.15.80:0/1073082026 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+6258 (secure 0 0 0) 0x7f80541519a0 con 0x7f805406af00 2024-05-08T21:12:25.521 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:12:25.521 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4990,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/1499761952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1499761952},{"type":"v1","addr":"172.21.15.106:6836","nonce":1499761952}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:12:21.380279+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":39,"addr":"172.21.15.106:6833/2289230272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":2289230272},{"type":"v1","addr":"172.21.15.106:6833","nonce":2289230272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:12:25.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.521+0000 7f8058ae6700 1 -- 172.21.15.80:0/1073082026 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f803406ac90 msgr2=0x7f803406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:25.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.521+0000 7f8058ae6700 1 --2- 172.21.15.80:0/1073082026 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f803406ac90 0x7f803406d150 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8044009130 tx=0x7f8044008030 comp rx=0 tx=0).stop 2024-05-08T21:12:25.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.521+0000 7f8058ae6700 1 -- 172.21.15.80:0/1073082026 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f805406af00 msgr2=0x7f805414e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:12:25.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.521+0000 7f8058ae6700 1 --2- 172.21.15.80:0/1073082026 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f805406af00 0x7f805414e850 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f804800c4d0 tx=0x7f804800c7e0 comp rx=0 tx=0).stop 2024-05-08T21:12:25.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.521+0000 7f8058ae6700 1 -- 172.21.15.80:0/1073082026 shutdown_connections 2024-05-08T21:12:25.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.521+0000 7f8058ae6700 1 --2- 172.21.15.80:0/1073082026 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f803406ac90 0x7f803406d150 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:25.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.521+0000 7f8058ae6700 1 --2- 172.21.15.80:0/1073082026 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f805406af00 0x7f805414e850 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:25.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.521+0000 7f8058ae6700 1 --2- 172.21.15.80:0/1073082026 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8054154320 0x7f8054149220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:25.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.521+0000 7f8058ae6700 1 --2- 172.21.15.80:0/1073082026 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8054071f90 0x7f80541f3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:12:25.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.521+0000 7f8058ae6700 1 -- 172.21.15.80:0/1073082026 >> 172.21.15.80:0/1073082026 conn(0x7f805406f140 msgr2=0x7f8054073ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:12:25.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.521+0000 7f8058ae6700 1 -- 172.21.15.80:0/1073082026 shutdown_connections 2024-05-08T21:12:25.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:12:25.521+0000 7f8058ae6700 1 -- 172.21.15.80:0/1073082026 wait complete. 2024-05-08T21:12:25.525 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 15 2024-05-08T21:12:25.535 INFO:tasks.mds_thrash.fs.[cephfs]:mds.d reported in up:standby state 2024-05-08T21:12:25.536 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 110 secs before thrashing 2024-05-08T21:12:26.811 INFO:tasks.workunit.client.0.smithi080.stderr:Cloning into 'ffsb'... 2024-05-08T21:12:28.729 INFO:tasks.ceph.mds.b.smithi106.stderr:2024-05-08T21:12:28.726+0000 7fabe5b6b700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-08T21:12:32.155 INFO:tasks.workunit.client.0.smithi080.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-05-08T21:12:33.162 INFO:tasks.workunit.client.0.smithi080.stdout:checking whether build environment is sane... yes 2024-05-08T21:12:33.170 INFO:tasks.workunit.client.0.smithi080.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-05-08T21:12:33.170 INFO:tasks.workunit.client.0.smithi080.stdout:checking for gawk... gawk 2024-05-08T21:12:33.185 INFO:tasks.workunit.client.0.smithi080.stdout:checking whether make sets $(MAKE)... yes 2024-05-08T21:12:33.218 INFO:tasks.workunit.client.0.smithi080.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-05-08T21:12:33.218 INFO:tasks.workunit.client.0.smithi080.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-05-08T21:12:34.149 INFO:tasks.workunit.client.0.smithi080.stdout:checking for style of include used by make... GNU 2024-05-08T21:12:34.153 INFO:tasks.workunit.client.0.smithi080.stdout:checking for gcc... gcc 2024-05-08T21:12:34.213 INFO:tasks.workunit.client.0.smithi080.stdout:checking for C compiler default output file name... a.out 2024-05-08T21:12:34.215 INFO:tasks.workunit.client.0.smithi080.stdout:checking whether the C compiler works... yes 2024-05-08T21:12:34.217 INFO:tasks.workunit.client.0.smithi080.stdout:checking whether we are cross compiling... no 2024-05-08T21:12:34.258 INFO:tasks.workunit.client.0.smithi080.stdout:checking for suffix of executables... 2024-05-08T21:12:34.292 INFO:tasks.workunit.client.0.smithi080.stdout:checking for suffix of object files... o 2024-05-08T21:12:34.324 INFO:tasks.workunit.client.0.smithi080.stdout:checking whether we are using the GNU C compiler... yes 2024-05-08T21:12:34.355 INFO:tasks.workunit.client.0.smithi080.stdout:checking whether gcc accepts -g... yes 2024-05-08T21:12:34.400 INFO:tasks.workunit.client.0.smithi080.stdout:checking for gcc option to accept ISO C89... none needed 2024-05-08T21:12:34.506 INFO:tasks.workunit.client.0.smithi080.stdout:checking dependency style of gcc... gcc3 2024-05-08T21:12:34.563 INFO:tasks.workunit.client.0.smithi080.stdout:checking how to run the C preprocessor... gcc -E 2024-05-08T21:12:34.598 INFO:tasks.workunit.client.0.smithi080.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-05-08T21:12:34.599 INFO:tasks.workunit.client.0.smithi080.stdout:checking for egrep... /usr/bin/grep -E 2024-05-08T21:12:34.607 INFO:tasks.workunit.client.0.smithi080.stdout:checking for AIX... no 2024-05-08T21:12:34.629 INFO:tasks.workunit.client.0.smithi080.stdout:checking for gcc... (cached) gcc 2024-05-08T21:12:34.636 INFO:tasks.workunit.client.0.smithi080.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-05-08T21:12:34.638 INFO:tasks.workunit.client.0.smithi080.stdout:checking whether gcc accepts -g... (cached) yes 2024-05-08T21:12:34.638 INFO:tasks.workunit.client.0.smithi080.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-05-08T21:12:34.638 INFO:tasks.workunit.client.0.smithi080.stdout:checking dependency style of gcc... (cached) gcc3 2024-05-08T21:12:34.683 INFO:tasks.workunit.client.0.smithi080.stdout:checking for main in -lm... yes 2024-05-08T21:12:34.728 INFO:tasks.workunit.client.0.smithi080.stdout:checking for main in -lpthread... yes 2024-05-08T21:12:36.077 INFO:tasks.workunit.client.0.smithi080.stdout:checking for ANSI C header files... yes 2024-05-08T21:12:36.127 INFO:tasks.workunit.client.0.smithi080.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-05-08T21:12:36.171 INFO:tasks.workunit.client.0.smithi080.stdout:checking for sys/types.h... yes 2024-05-08T21:12:36.214 INFO:tasks.workunit.client.0.smithi080.stdout:checking for sys/stat.h... yes 2024-05-08T21:12:36.258 INFO:tasks.workunit.client.0.smithi080.stdout:checking for stdlib.h... yes 2024-05-08T21:12:36.302 INFO:tasks.workunit.client.0.smithi080.stdout:checking for string.h... yes 2024-05-08T21:12:36.345 INFO:tasks.workunit.client.0.smithi080.stdout:checking for memory.h... yes 2024-05-08T21:12:36.388 INFO:tasks.workunit.client.0.smithi080.stdout:checking for strings.h... yes 2024-05-08T21:12:36.442 INFO:tasks.workunit.client.0.smithi080.stdout:checking for inttypes.h... yes 2024-05-08T21:12:36.486 INFO:tasks.workunit.client.0.smithi080.stdout:checking for stdint.h... yes 2024-05-08T21:12:36.532 INFO:tasks.workunit.client.0.smithi080.stdout:checking for unistd.h... yes 2024-05-08T21:12:36.581 INFO:tasks.workunit.client.0.smithi080.stdout:checking pthread.h usability... yes 2024-05-08T21:12:36.599 INFO:tasks.workunit.client.0.smithi080.stdout:checking pthread.h presence... yes 2024-05-08T21:12:36.600 INFO:tasks.workunit.client.0.smithi080.stdout:checking for pthread.h... yes 2024-05-08T21:12:36.646 INFO:tasks.workunit.client.0.smithi080.stdout:checking fcntl.h usability... yes 2024-05-08T21:12:36.663 INFO:tasks.workunit.client.0.smithi080.stdout:checking fcntl.h presence... yes 2024-05-08T21:12:36.663 INFO:tasks.workunit.client.0.smithi080.stdout:checking for fcntl.h... yes 2024-05-08T21:12:36.710 INFO:tasks.workunit.client.0.smithi080.stdout:checking limits.h usability... yes 2024-05-08T21:12:36.725 INFO:tasks.workunit.client.0.smithi080.stdout:checking limits.h presence... yes 2024-05-08T21:12:36.726 INFO:tasks.workunit.client.0.smithi080.stdout:checking for limits.h... yes 2024-05-08T21:12:36.739 INFO:tasks.workunit.client.0.smithi080.stdout:checking for stdint.h... (cached) yes 2024-05-08T21:12:36.796 INFO:tasks.workunit.client.0.smithi080.stdout:checking sys/time.h usability... yes 2024-05-08T21:12:36.813 INFO:tasks.workunit.client.0.smithi080.stdout:checking sys/time.h presence... yes 2024-05-08T21:12:36.813 INFO:tasks.workunit.client.0.smithi080.stdout:checking for sys/time.h... yes 2024-05-08T21:12:36.826 INFO:tasks.workunit.client.0.smithi080.stdout:checking for unistd.h... (cached) yes 2024-05-08T21:12:36.871 INFO:tasks.workunit.client.0.smithi080.stdout:checking sys/vfs.h usability... yes 2024-05-08T21:12:36.888 INFO:tasks.workunit.client.0.smithi080.stdout:checking sys/vfs.h presence... yes 2024-05-08T21:12:36.889 INFO:tasks.workunit.client.0.smithi080.stdout:checking for sys/vfs.h... yes 2024-05-08T21:12:36.931 INFO:tasks.workunit.client.0.smithi080.stdout:checking sys/limits.h usability... no 2024-05-08T21:12:36.947 INFO:tasks.workunit.client.0.smithi080.stdout:checking sys/limits.h presence... no 2024-05-08T21:12:36.948 INFO:tasks.workunit.client.0.smithi080.stdout:checking for sys/limits.h... no 2024-05-08T21:12:36.978 INFO:tasks.workunit.client.0.smithi080.stdout:checking for an ANSI C-conforming const... yes 2024-05-08T21:12:37.011 INFO:tasks.workunit.client.0.smithi080.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-05-08T21:12:37.012 INFO:tasks.workunit.client.0.smithi080.stdout:checking for function prototypes... yes 2024-05-08T21:12:37.036 INFO:tasks.workunit.client.0.smithi080.stdout:checking whether setvbuf arguments are reversed... no 2024-05-08T21:12:37.101 INFO:tasks.workunit.client.0.smithi080.stdout:checking for system... yes 2024-05-08T21:12:37.159 INFO:tasks.workunit.client.0.smithi080.stdout:checking for gettimeofday... yes 2024-05-08T21:12:37.218 INFO:tasks.workunit.client.0.smithi080.stdout:checking for mkdir... yes 2024-05-08T21:12:37.275 INFO:tasks.workunit.client.0.smithi080.stdout:checking for strerror... yes 2024-05-08T21:12:37.332 INFO:tasks.workunit.client.0.smithi080.stdout:checking for open64... yes 2024-05-08T21:12:37.390 INFO:tasks.workunit.client.0.smithi080.stdout:checking for stat64... yes 2024-05-08T21:12:37.449 INFO:tasks.workunit.client.0.smithi080.stdout:checking for fseeko64... yes 2024-05-08T21:12:37.768 INFO:tasks.workunit.client.0.smithi080.stdout:checking for lrand48_r... yes 2024-05-08T21:12:37.826 INFO:tasks.workunit.client.0.smithi080.stdout:checking for srand48_r... yes 2024-05-08T21:12:37.849 INFO:tasks.workunit.client.0.smithi080.stdout:configure: creating ./config.status 2024-05-08T21:12:38.204 INFO:tasks.workunit.client.0.smithi080.stdout:config.status: creating Makefile 2024-05-08T21:12:38.217 INFO:tasks.workunit.client.0.smithi080.stdout:config.status: creating config.h 2024-05-08T21:12:38.233 INFO:tasks.workunit.client.0.smithi080.stdout:config.status: executing depfiles commands 2024-05-08T21:12:39.195 INFO:tasks.workunit.client.0.smithi080.stdout:config.status: executing default commands 2024-05-08T21:12:39.621 INFO:tasks.workunit.client.0.smithi080.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run aclocal-1.10 2024-05-08T21:12:39.623 INFO:tasks.workunit.client.0.smithi080.stderr:/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing: line 46: aclocal-1.10: command not found 2024-05-08T21:12:39.624 INFO:tasks.workunit.client.0.smithi080.stderr:WARNING: `aclocal-1.10' is missing on your system. You should only need it if 2024-05-08T21:12:39.624 INFO:tasks.workunit.client.0.smithi080.stderr: you modified `acinclude.m4' or `configure.in'. You might want 2024-05-08T21:12:39.624 INFO:tasks.workunit.client.0.smithi080.stderr: to install the `Automake' and `Perl' packages. Grab them from 2024-05-08T21:12:39.624 INFO:tasks.workunit.client.0.smithi080.stderr: any GNU archive site. 2024-05-08T21:12:39.626 INFO:tasks.workunit.client.0.smithi080.stdout: cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run automake-1.10 --gnu 2024-05-08T21:12:39.627 INFO:tasks.workunit.client.0.smithi080.stderr:/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing: line 46: automake-1.10: command not found 2024-05-08T21:12:39.628 INFO:tasks.workunit.client.0.smithi080.stderr:WARNING: `automake-1.10' is missing on your system. You should only need it if 2024-05-08T21:12:39.628 INFO:tasks.workunit.client.0.smithi080.stderr: you modified `Makefile.am', `acinclude.m4' or `configure.in'. 2024-05-08T21:12:39.628 INFO:tasks.workunit.client.0.smithi080.stderr: You might want to install the `Automake' and `Perl' packages. 2024-05-08T21:12:39.629 INFO:tasks.workunit.client.0.smithi080.stderr: Grab them from any GNU archive site. 2024-05-08T21:12:39.669 INFO:tasks.workunit.client.0.smithi080.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run autoconf 2024-05-08T21:12:39.911 INFO:tasks.workunit.client.0.smithi080.stderr:aclocal.m4:16: warning: this file was generated for autoconf 2.61. 2024-05-08T21:12:39.911 INFO:tasks.workunit.client.0.smithi080.stderr:You have another version of autoconf. It may work, but is not guaranteed to. 2024-05-08T21:12:39.911 INFO:tasks.workunit.client.0.smithi080.stderr:If you have problems, you may need to regenerate the build system entirely. 2024-05-08T21:12:39.911 INFO:tasks.workunit.client.0.smithi080.stderr:To do so, use the procedure documented by the package, typically `autoreconf'. 2024-05-08T21:12:40.298 INFO:tasks.workunit.client.0.smithi080.stdout:/bin/sh ./config.status --recheck 2024-05-08T21:12:40.496 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:12:40.498 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:12:41.118 INFO:tasks.workunit.client.0.smithi080.stdout:running CONFIG_SHELL=/bin/sh /bin/sh ./configure --no-create --no-recursion 2024-05-08T21:12:41.219 INFO:tasks.workunit.client.0.smithi080.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-05-08T21:12:42.227 INFO:tasks.workunit.client.0.smithi080.stdout:checking whether build environment is sane... yes 2024-05-08T21:12:42.232 INFO:tasks.workunit.client.0.smithi080.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-05-08T21:12:42.233 INFO:tasks.workunit.client.0.smithi080.stdout:checking for gawk... gawk 2024-05-08T21:12:42.247 INFO:tasks.workunit.client.0.smithi080.stdout:checking whether make sets $(MAKE)... yes 2024-05-08T21:12:42.284 INFO:tasks.workunit.client.0.smithi080.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-05-08T21:12:42.284 INFO:tasks.workunit.client.0.smithi080.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-05-08T21:12:42.298 INFO:tasks.workunit.client.0.smithi080.stdout:checking for style of include used by make... GNU 2024-05-08T21:12:43.252 INFO:tasks.workunit.client.0.smithi080.stdout:checking for gcc... gcc 2024-05-08T21:12:43.344 INFO:tasks.workunit.client.0.smithi080.stdout:checking whether the C compiler works... yes 2024-05-08T21:12:43.344 INFO:tasks.workunit.client.0.smithi080.stdout:checking for C compiler default output file name... a.out 2024-05-08T21:12:43.384 INFO:tasks.workunit.client.0.smithi080.stdout:checking for suffix of executables... 2024-05-08T21:12:43.424 INFO:tasks.workunit.client.0.smithi080.stdout:checking whether we are cross compiling... no 2024-05-08T21:12:43.462 INFO:tasks.workunit.client.0.smithi080.stdout:checking for suffix of object files... o 2024-05-08T21:12:43.488 INFO:tasks.workunit.client.0.smithi080.stdout:checking whether we are using the GNU C compiler... yes 2024-05-08T21:12:43.512 INFO:tasks.workunit.client.0.smithi080.stdout:checking whether gcc accepts -g... yes 2024-05-08T21:12:43.548 INFO:tasks.workunit.client.0.smithi080.stdout:checking for gcc option to accept ISO C89... none needed 2024-05-08T21:12:44.990 INFO:tasks.workunit.client.0.smithi080.stdout:checking dependency style of gcc... gcc3 2024-05-08T21:12:45.032 INFO:tasks.workunit.client.0.smithi080.stdout:checking how to run the C preprocessor... gcc -E 2024-05-08T21:12:45.076 INFO:tasks.workunit.client.0.smithi080.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-05-08T21:12:45.077 INFO:tasks.workunit.client.0.smithi080.stdout:checking for egrep... /usr/bin/grep -E 2024-05-08T21:12:45.190 INFO:tasks.workunit.client.0.smithi080.stdout:checking for ANSI C header files... yes 2024-05-08T21:12:45.221 INFO:tasks.workunit.client.0.smithi080.stdout:checking for sys/types.h... yes 2024-05-08T21:12:45.256 INFO:tasks.workunit.client.0.smithi080.stdout:checking for sys/stat.h... yes 2024-05-08T21:12:45.291 INFO:tasks.workunit.client.0.smithi080.stdout:checking for stdlib.h... yes 2024-05-08T21:12:45.329 INFO:tasks.workunit.client.0.smithi080.stdout:checking for string.h... yes 2024-05-08T21:12:45.368 INFO:tasks.workunit.client.0.smithi080.stdout:checking for memory.h... yes 2024-05-08T21:12:45.405 INFO:tasks.workunit.client.0.smithi080.stdout:checking for strings.h... yes 2024-05-08T21:12:45.443 INFO:tasks.workunit.client.0.smithi080.stdout:checking for inttypes.h... yes 2024-05-08T21:12:45.482 INFO:tasks.workunit.client.0.smithi080.stdout:checking for stdint.h... yes 2024-05-08T21:12:45.544 INFO:tasks.workunit.client.0.smithi080.stdout:checking for unistd.h... yes 2024-05-08T21:12:45.591 INFO:tasks.workunit.client.0.smithi080.stdout:checking minix/config.h usability... no 2024-05-08T21:12:45.613 INFO:tasks.workunit.client.0.smithi080.stdout:checking minix/config.h presence... no 2024-05-08T21:12:45.613 INFO:tasks.workunit.client.0.smithi080.stdout:checking for minix/config.h... no 2024-05-08T21:12:45.645 INFO:tasks.workunit.client.0.smithi080.stdout:checking whether it is safe to define __EXTENSIONS__... yes 2024-05-08T21:12:45.646 INFO:tasks.workunit.client.0.smithi080.stdout:checking for gcc... (cached) gcc 2024-05-08T21:12:45.676 INFO:tasks.workunit.client.0.smithi080.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-05-08T21:12:45.676 INFO:tasks.workunit.client.0.smithi080.stdout:checking whether gcc accepts -g... (cached) yes 2024-05-08T21:12:45.676 INFO:tasks.workunit.client.0.smithi080.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-05-08T21:12:45.676 INFO:tasks.workunit.client.0.smithi080.stdout:checking dependency style of gcc... (cached) gcc3 2024-05-08T21:12:45.715 INFO:tasks.workunit.client.0.smithi080.stdout:checking for main in -lm... yes 2024-05-08T21:12:45.755 INFO:tasks.workunit.client.0.smithi080.stdout:checking for main in -lpthread... yes 2024-05-08T21:12:45.757 INFO:tasks.workunit.client.0.smithi080.stdout:checking for ANSI C header files... (cached) yes 2024-05-08T21:12:45.784 INFO:tasks.workunit.client.0.smithi080.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-05-08T21:12:45.828 INFO:tasks.workunit.client.0.smithi080.stdout:checking pthread.h usability... yes 2024-05-08T21:12:45.843 INFO:tasks.workunit.client.0.smithi080.stdout:checking pthread.h presence... yes 2024-05-08T21:12:45.843 INFO:tasks.workunit.client.0.smithi080.stdout:checking for pthread.h... yes 2024-05-08T21:12:45.889 INFO:tasks.workunit.client.0.smithi080.stdout:checking fcntl.h usability... yes 2024-05-08T21:12:45.902 INFO:tasks.workunit.client.0.smithi080.stdout:checking fcntl.h presence... yes 2024-05-08T21:12:45.903 INFO:tasks.workunit.client.0.smithi080.stdout:checking for fcntl.h... yes 2024-05-08T21:12:46.445 INFO:tasks.workunit.client.0.smithi080.stdout:checking limits.h usability... yes 2024-05-08T21:12:46.460 INFO:tasks.workunit.client.0.smithi080.stdout:checking limits.h presence... yes 2024-05-08T21:12:46.460 INFO:tasks.workunit.client.0.smithi080.stdout:checking for limits.h... yes 2024-05-08T21:12:46.484 INFO:tasks.workunit.client.0.smithi080.stdout:checking for stdint.h... (cached) yes 2024-05-08T21:12:46.519 INFO:tasks.workunit.client.0.smithi080.stdout:checking sys/time.h usability... yes 2024-05-08T21:12:46.533 INFO:tasks.workunit.client.0.smithi080.stdout:checking sys/time.h presence... yes 2024-05-08T21:12:46.533 INFO:tasks.workunit.client.0.smithi080.stdout:checking for sys/time.h... yes 2024-05-08T21:12:46.550 INFO:tasks.workunit.client.0.smithi080.stdout:checking for unistd.h... (cached) yes 2024-05-08T21:12:46.585 INFO:tasks.workunit.client.0.smithi080.stdout:checking sys/vfs.h usability... yes 2024-05-08T21:12:46.598 INFO:tasks.workunit.client.0.smithi080.stdout:checking sys/vfs.h presence... yes 2024-05-08T21:12:46.598 INFO:tasks.workunit.client.0.smithi080.stdout:checking for sys/vfs.h... yes 2024-05-08T21:12:46.649 INFO:tasks.workunit.client.0.smithi080.stdout:checking sys/limits.h usability... no 2024-05-08T21:12:46.673 INFO:tasks.workunit.client.0.smithi080.stdout:checking sys/limits.h presence... no 2024-05-08T21:12:46.673 INFO:tasks.workunit.client.0.smithi080.stdout:checking for sys/limits.h... no 2024-05-08T21:12:46.698 INFO:tasks.workunit.client.0.smithi080.stdout:checking for an ANSI C-conforming const... yes 2024-05-08T21:12:46.725 INFO:tasks.workunit.client.0.smithi080.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-05-08T21:12:46.782 INFO:tasks.workunit.client.0.smithi080.stdout:checking for system... yes 2024-05-08T21:12:46.837 INFO:tasks.workunit.client.0.smithi080.stdout:checking for gettimeofday... yes 2024-05-08T21:12:47.321 INFO:tasks.workunit.client.0.smithi080.stdout:checking for mkdir... yes 2024-05-08T21:12:47.376 INFO:tasks.workunit.client.0.smithi080.stdout:checking for strerror... yes 2024-05-08T21:12:47.431 INFO:tasks.workunit.client.0.smithi080.stdout:checking for open64... yes 2024-05-08T21:12:47.484 INFO:tasks.workunit.client.0.smithi080.stdout:checking for stat64... yes 2024-05-08T21:12:47.539 INFO:tasks.workunit.client.0.smithi080.stdout:checking for fseeko64... yes 2024-05-08T21:12:47.591 INFO:tasks.workunit.client.0.smithi080.stdout:checking for lrand48_r... yes 2024-05-08T21:12:47.854 INFO:tasks.workunit.client.0.smithi080.stdout:checking for srand48_r... yes 2024-05-08T21:12:47.877 INFO:tasks.workunit.client.0.smithi080.stdout:configure: creating ./config.status 2024-05-08T21:12:47.935 INFO:tasks.workunit.client.0.smithi080.stdout: /bin/sh ./config.status 2024-05-08T21:12:47.980 INFO:tasks.workunit.client.0.smithi080.stdout:config.status: creating Makefile 2024-05-08T21:12:47.991 INFO:tasks.workunit.client.0.smithi080.stdout:config.status: creating config.h 2024-05-08T21:12:48.010 INFO:tasks.workunit.client.0.smithi080.stdout:config.status: executing depfiles commands 2024-05-08T21:12:48.021 INFO:tasks.workunit.client.0.smithi080.stdout:config.status: executing default commands 2024-05-08T21:12:48.046 INFO:tasks.workunit.client.0.smithi080.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run autoheader 2024-05-08T21:12:48.177 INFO:tasks.workunit.client.0.smithi080.stdout:rm -f stamp-h1 2024-05-08T21:12:48.178 INFO:tasks.workunit.client.0.smithi080.stdout:touch config.h.in 2024-05-08T21:12:48.180 INFO:tasks.workunit.client.0.smithi080.stdout:cd . && /bin/sh ./config.status config.h 2024-05-08T21:12:48.219 INFO:tasks.workunit.client.0.smithi080.stdout:config.status: creating config.h 2024-05-08T21:12:48.243 INFO:tasks.workunit.client.0.smithi080.stdout:make all-am 2024-05-08T21:12:48.249 INFO:tasks.workunit.client.0.smithi080.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb' 2024-05-08T21:12:48.249 INFO:tasks.workunit.client.0.smithi080.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fileops.o -MD -MP -MF .deps/fileops.Tpo -c -o fileops.o fileops.c 2024-05-08T21:12:48.391 INFO:tasks.workunit.client.0.smithi080.stdout:mv -f .deps/fileops.Tpo .deps/fileops.Po 2024-05-08T21:12:48.394 INFO:tasks.workunit.client.0.smithi080.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rand.o -MD -MP -MF .deps/rand.Tpo -c -o rand.o rand.c 2024-05-08T21:12:48.456 INFO:tasks.workunit.client.0.smithi080.stdout:mv -f .deps/rand.Tpo .deps/rand.Po 2024-05-08T21:12:48.459 INFO:tasks.workunit.client.0.smithi080.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT main.o -MD -MP -MF .deps/main.Tpo -c -o main.o main.c 2024-05-08T21:12:48.964 INFO:tasks.workunit.client.0.smithi080.stdout:mv -f .deps/main.Tpo .deps/main.Po 2024-05-08T21:12:48.967 INFO:tasks.workunit.client.0.smithi080.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fh.o -MD -MP -MF .deps/fh.Tpo -c -o fh.o fh.c 2024-05-08T21:12:49.055 INFO:tasks.workunit.client.0.smithi080.stdout:mv -f .deps/fh.Tpo .deps/fh.Po 2024-05-08T21:12:49.058 INFO:tasks.workunit.client.0.smithi080.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT filelist.o -MD -MP -MF .deps/filelist.Tpo -c -o filelist.o filelist.c 2024-05-08T21:12:49.161 INFO:tasks.workunit.client.0.smithi080.stdout:mv -f .deps/filelist.Tpo .deps/filelist.Po 2024-05-08T21:12:49.164 INFO:tasks.workunit.client.0.smithi080.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT metaops.o -MD -MP -MF .deps/metaops.Tpo -c -o metaops.o metaops.c 2024-05-08T21:12:49.209 INFO:tasks.workunit.client.0.smithi080.stdout:mv -f .deps/metaops.Tpo .deps/metaops.Po 2024-05-08T21:12:49.212 INFO:tasks.workunit.client.0.smithi080.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rwlock.o -MD -MP -MF .deps/rwlock.Tpo -c -o rwlock.o rwlock.c 2024-05-08T21:12:49.251 INFO:tasks.workunit.client.0.smithi080.stdout:mv -f .deps/rwlock.Tpo .deps/rwlock.Po 2024-05-08T21:12:49.254 INFO:tasks.workunit.client.0.smithi080.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT cirlist.o -MD -MP -MF .deps/cirlist.Tpo -c -o cirlist.o cirlist.c 2024-05-08T21:12:49.297 INFO:tasks.workunit.client.0.smithi080.stdout:mv -f .deps/cirlist.Tpo .deps/cirlist.Po 2024-05-08T21:12:49.300 INFO:tasks.workunit.client.0.smithi080.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rbt.o -MD -MP -MF .deps/rbt.Tpo -c -o rbt.o rbt.c 2024-05-08T21:12:49.452 INFO:tasks.workunit.client.0.smithi080.stdout:mv -f .deps/rbt.Tpo .deps/rbt.Po 2024-05-08T21:12:49.455 INFO:tasks.workunit.client.0.smithi080.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_tg.o -MD -MP -MF .deps/ffsb_tg.Tpo -c -o ffsb_tg.o ffsb_tg.c 2024-05-08T21:12:49.561 INFO:tasks.workunit.client.0.smithi080.stdout:mv -f .deps/ffsb_tg.Tpo .deps/ffsb_tg.Po 2024-05-08T21:12:49.564 INFO:tasks.workunit.client.0.smithi080.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fs.o -MD -MP -MF .deps/ffsb_fs.Tpo -c -o ffsb_fs.o ffsb_fs.c 2024-05-08T21:12:49.720 INFO:tasks.workunit.client.0.smithi080.stdout:mv -f .deps/ffsb_fs.Tpo .deps/ffsb_fs.Po 2024-05-08T21:12:49.722 INFO:tasks.workunit.client.0.smithi080.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_thread.o -MD -MP -MF .deps/ffsb_thread.Tpo -c -o ffsb_thread.o ffsb_thread.c 2024-05-08T21:12:49.783 INFO:tasks.workunit.client.0.smithi080.stdout:mv -f .deps/ffsb_thread.Tpo .deps/ffsb_thread.Po 2024-05-08T21:12:49.786 INFO:tasks.workunit.client.0.smithi080.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_op.o -MD -MP -MF .deps/ffsb_op.Tpo -c -o ffsb_op.o ffsb_op.c 2024-05-08T21:12:49.851 INFO:tasks.workunit.client.0.smithi080.stdout:mv -f .deps/ffsb_op.Tpo .deps/ffsb_op.Po 2024-05-08T21:12:49.854 INFO:tasks.workunit.client.0.smithi080.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT util.o -MD -MP -MF .deps/util.Tpo -c -o util.o util.c 2024-05-08T21:12:49.947 INFO:tasks.workunit.client.0.smithi080.stdout:mv -f .deps/util.Tpo .deps/util.Po 2024-05-08T21:12:49.951 INFO:tasks.workunit.client.0.smithi080.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT parser.o -MD -MP -MF .deps/parser.Tpo -c -o parser.o parser.c 2024-05-08T21:12:49.975 INFO:tasks.workunit.client.0.smithi080.stderr:In file included from parser.h:22, 2024-05-08T21:12:49.975 INFO:tasks.workunit.client.0.smithi080.stderr: from parser.c:25: 2024-05-08T21:12:49.975 INFO:tasks.workunit.client.0.smithi080.stderr:parser.c: In function ‘init_filesys’: 2024-05-08T21:12:49.975 INFO:tasks.workunit.client.0.smithi080.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-05-08T21:12:49.975 INFO:tasks.workunit.client.0.smithi080.stderr: #define offsetof(type, member) ((int) &((type *)0)->member) 2024-05-08T21:12:49.975 INFO:tasks.workunit.client.0.smithi080.stderr: ^ 2024-05-08T21:12:49.975 INFO:tasks.workunit.client.0.smithi080.stderr:list.h:33:28: note: in expansion of macro ‘offsetof’ 2024-05-08T21:12:49.975 INFO:tasks.workunit.client.0.smithi080.stderr: (type *)((char *)__mptr - offsetof(type, member)); }) 2024-05-08T21:12:49.975 INFO:tasks.workunit.client.0.smithi080.stderr: ^~~~~~~~ 2024-05-08T21:12:49.976 INFO:tasks.workunit.client.0.smithi080.stderr:list.h:36:2: note: in expansion of macro ‘container_of’ 2024-05-08T21:12:49.976 INFO:tasks.workunit.client.0.smithi080.stderr: container_of(ptr, type, member) 2024-05-08T21:12:49.976 INFO:tasks.workunit.client.0.smithi080.stderr: ^~~~~~~~~~~~ 2024-05-08T21:12:49.976 INFO:tasks.workunit.client.0.smithi080.stderr:list.h:39:13: note: in expansion of macro ‘list_entry’ 2024-05-08T21:12:49.976 INFO:tasks.workunit.client.0.smithi080.stderr: for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-05-08T21:12:49.976 INFO:tasks.workunit.client.0.smithi080.stderr: ^~~~~~~~~~ 2024-05-08T21:12:49.976 INFO:tasks.workunit.client.0.smithi080.stderr:parser.c:934:3: note: in expansion of macro ‘list_for_each_entry’ 2024-05-08T21:12:49.976 INFO:tasks.workunit.client.0.smithi080.stderr: list_for_each_entry(tmp_list, &list_head->list, list) 2024-05-08T21:12:49.976 INFO:tasks.workunit.client.0.smithi080.stderr: ^~~~~~~~~~~~~~~~~~~ 2024-05-08T21:12:49.976 INFO:tasks.workunit.client.0.smithi080.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-05-08T21:12:49.976 INFO:tasks.workunit.client.0.smithi080.stderr: #define offsetof(type, member) ((int) &((type *)0)->member) 2024-05-08T21:12:49.976 INFO:tasks.workunit.client.0.smithi080.stderr: ^ 2024-05-08T21:12:49.976 INFO:tasks.workunit.client.0.smithi080.stderr:list.h:33:28: note: in expansion of macro ‘offsetof’ 2024-05-08T21:12:49.976 INFO:tasks.workunit.client.0.smithi080.stderr: (type *)((char *)__mptr - offsetof(type, member)); }) 2024-05-08T21:12:49.977 INFO:tasks.workunit.client.0.smithi080.stderr: ^~~~~~~~ 2024-05-08T21:12:49.977 INFO:tasks.workunit.client.0.smithi080.stderr:list.h:36:2: note: in expansion of macro ‘container_of’ 2024-05-08T21:12:49.977 INFO:tasks.workunit.client.0.smithi080.stderr: container_of(ptr, type, member) 2024-05-08T21:12:49.977 INFO:tasks.workunit.client.0.smithi080.stderr: ^~~~~~~~~~~~ 2024-05-08T21:12:49.977 INFO:tasks.workunit.client.0.smithi080.stderr:list.h:41:13: note: in expansion of macro ‘list_entry’ 2024-05-08T21:12:49.977 INFO:tasks.workunit.client.0.smithi080.stderr: pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-05-08T21:12:49.977 INFO:tasks.workunit.client.0.smithi080.stderr: ^~~~~~~~~~ 2024-05-08T21:12:49.977 INFO:tasks.workunit.client.0.smithi080.stderr:parser.c:934:3: note: in expansion of macro ‘list_for_each_entry’ 2024-05-08T21:12:49.977 INFO:tasks.workunit.client.0.smithi080.stderr: list_for_each_entry(tmp_list, &list_head->list, list) 2024-05-08T21:12:49.977 INFO:tasks.workunit.client.0.smithi080.stderr: ^~~~~~~~~~~~~~~~~~~ 2024-05-08T21:12:49.977 INFO:tasks.workunit.client.0.smithi080.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-05-08T21:12:49.977 INFO:tasks.workunit.client.0.smithi080.stderr: #define offsetof(type, member) ((int) &((type *)0)->member) 2024-05-08T21:12:49.978 INFO:tasks.workunit.client.0.smithi080.stderr: ^ 2024-05-08T21:12:49.978 INFO:tasks.workunit.client.0.smithi080.stderr:list.h:33:28: note: in expansion of macro ‘offsetof’ 2024-05-08T21:12:49.978 INFO:tasks.workunit.client.0.smithi080.stderr: (type *)((char *)__mptr - offsetof(type, member)); }) 2024-05-08T21:12:49.978 INFO:tasks.workunit.client.0.smithi080.stderr: ^~~~~~~~ 2024-05-08T21:12:49.978 INFO:tasks.workunit.client.0.smithi080.stderr:list.h:36:2: note: in expansion of macro ‘container_of’ 2024-05-08T21:12:49.978 INFO:tasks.workunit.client.0.smithi080.stderr: container_of(ptr, type, member) 2024-05-08T21:12:49.978 INFO:tasks.workunit.client.0.smithi080.stderr: ^~~~~~~~~~~~ 2024-05-08T21:12:49.978 INFO:tasks.workunit.client.0.smithi080.stderr:list.h:39:13: note: in expansion of macro ‘list_entry’ 2024-05-08T21:12:49.978 INFO:tasks.workunit.client.0.smithi080.stderr: for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-05-08T21:12:49.978 INFO:tasks.workunit.client.0.smithi080.stderr: ^~~~~~~~~~ 2024-05-08T21:12:49.978 INFO:tasks.workunit.client.0.smithi080.stderr:parser.c:941:3: note: in expansion of macro ‘list_for_each_entry’ 2024-05-08T21:12:49.978 INFO:tasks.workunit.client.0.smithi080.stderr: list_for_each_entry(tmp_list, &list_head->list, list) { 2024-05-08T21:12:49.978 INFO:tasks.workunit.client.0.smithi080.stderr: ^~~~~~~~~~~~~~~~~~~ 2024-05-08T21:12:49.979 INFO:tasks.workunit.client.0.smithi080.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-05-08T21:12:49.979 INFO:tasks.workunit.client.0.smithi080.stderr: #define offsetof(type, member) ((int) &((type *)0)->member) 2024-05-08T21:12:49.979 INFO:tasks.workunit.client.0.smithi080.stderr: ^ 2024-05-08T21:12:49.979 INFO:tasks.workunit.client.0.smithi080.stderr:list.h:33:28: note: in expansion of macro ‘offsetof’ 2024-05-08T21:12:49.979 INFO:tasks.workunit.client.0.smithi080.stderr: (type *)((char *)__mptr - offsetof(type, member)); }) 2024-05-08T21:12:49.979 INFO:tasks.workunit.client.0.smithi080.stderr: ^~~~~~~~ 2024-05-08T21:12:49.979 INFO:tasks.workunit.client.0.smithi080.stderr:list.h:36:2: note: in expansion of macro ‘container_of’ 2024-05-08T21:12:49.979 INFO:tasks.workunit.client.0.smithi080.stderr: container_of(ptr, type, member) 2024-05-08T21:12:49.979 INFO:tasks.workunit.client.0.smithi080.stderr: ^~~~~~~~~~~~ 2024-05-08T21:12:49.979 INFO:tasks.workunit.client.0.smithi080.stderr:list.h:41:13: note: in expansion of macro ‘list_entry’ 2024-05-08T21:12:49.979 INFO:tasks.workunit.client.0.smithi080.stderr: pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-05-08T21:12:49.979 INFO:tasks.workunit.client.0.smithi080.stderr: ^~~~~~~~~~ 2024-05-08T21:12:49.979 INFO:tasks.workunit.client.0.smithi080.stderr:parser.c:941:3: note: in expansion of macro ‘list_for_each_entry’ 2024-05-08T21:12:49.979 INFO:tasks.workunit.client.0.smithi080.stderr: list_for_each_entry(tmp_list, &list_head->list, list) { 2024-05-08T21:12:49.980 INFO:tasks.workunit.client.0.smithi080.stderr: ^~~~~~~~~~~~~~~~~~~ 2024-05-08T21:12:49.980 INFO:tasks.workunit.client.0.smithi080.stderr:parser.c: In function ‘init_tg_stats’: 2024-05-08T21:12:49.980 INFO:tasks.workunit.client.0.smithi080.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-05-08T21:12:49.980 INFO:tasks.workunit.client.0.smithi080.stderr: #define offsetof(type, member) ((int) &((type *)0)->member) 2024-05-08T21:12:49.980 INFO:tasks.workunit.client.0.smithi080.stderr: ^ 2024-05-08T21:12:49.980 INFO:tasks.workunit.client.0.smithi080.stderr:list.h:33:28: note: in expansion of macro ‘offsetof’ 2024-05-08T21:12:49.980 INFO:tasks.workunit.client.0.smithi080.stderr: (type *)((char *)__mptr - offsetof(type, member)); }) 2024-05-08T21:12:49.980 INFO:tasks.workunit.client.0.smithi080.stderr: ^~~~~~~~ 2024-05-08T21:12:49.980 INFO:tasks.workunit.client.0.smithi080.stderr:list.h:36:2: note: in expansion of macro ‘container_of’ 2024-05-08T21:12:49.980 INFO:tasks.workunit.client.0.smithi080.stderr: container_of(ptr, type, member) 2024-05-08T21:12:49.980 INFO:tasks.workunit.client.0.smithi080.stderr: ^~~~~~~~~~~~ 2024-05-08T21:12:49.980 INFO:tasks.workunit.client.0.smithi080.stderr:list.h:39:13: note: in expansion of macro ‘list_entry’ 2024-05-08T21:12:49.980 INFO:tasks.workunit.client.0.smithi080.stderr: for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-05-08T21:12:49.980 INFO:tasks.workunit.client.0.smithi080.stderr: ^~~~~~~~~~ 2024-05-08T21:12:49.980 INFO:tasks.workunit.client.0.smithi080.stderr:parser.c:971:6: note: in expansion of macro ‘list_for_each_entry’ 2024-05-08T21:12:49.981 INFO:tasks.workunit.client.0.smithi080.stderr: list_for_each_entry(tmp_list, 2024-05-08T21:12:49.981 INFO:tasks.workunit.client.0.smithi080.stderr: ^~~~~~~~~~~~~~~~~~~ 2024-05-08T21:12:49.981 INFO:tasks.workunit.client.0.smithi080.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-05-08T21:12:49.981 INFO:tasks.workunit.client.0.smithi080.stderr: #define offsetof(type, member) ((int) &((type *)0)->member) 2024-05-08T21:12:49.981 INFO:tasks.workunit.client.0.smithi080.stderr: ^ 2024-05-08T21:12:49.981 INFO:tasks.workunit.client.0.smithi080.stderr:list.h:33:28: note: in expansion of macro ‘offsetof’ 2024-05-08T21:12:49.981 INFO:tasks.workunit.client.0.smithi080.stderr: (type *)((char *)__mptr - offsetof(type, member)); }) 2024-05-08T21:12:49.981 INFO:tasks.workunit.client.0.smithi080.stderr: ^~~~~~~~ 2024-05-08T21:12:49.981 INFO:tasks.workunit.client.0.smithi080.stderr:list.h:36:2: note: in expansion of macro ‘container_of’ 2024-05-08T21:12:49.981 INFO:tasks.workunit.client.0.smithi080.stderr: container_of(ptr, type, member) 2024-05-08T21:12:49.981 INFO:tasks.workunit.client.0.smithi080.stderr: ^~~~~~~~~~~~ 2024-05-08T21:12:49.982 INFO:tasks.workunit.client.0.smithi080.stderr:list.h:41:13: note: in expansion of macro ‘list_entry’ 2024-05-08T21:12:49.982 INFO:tasks.workunit.client.0.smithi080.stderr: pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-05-08T21:12:49.982 INFO:tasks.workunit.client.0.smithi080.stderr: ^~~~~~~~~~ 2024-05-08T21:12:49.982 INFO:tasks.workunit.client.0.smithi080.stderr:parser.c:971:6: note: in expansion of macro ‘list_for_each_entry’ 2024-05-08T21:12:49.982 INFO:tasks.workunit.client.0.smithi080.stderr: list_for_each_entry(tmp_list, 2024-05-08T21:12:49.982 INFO:tasks.workunit.client.0.smithi080.stderr: ^~~~~~~~~~~~~~~~~~~ 2024-05-08T21:12:49.982 INFO:tasks.workunit.client.0.smithi080.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-05-08T21:12:49.982 INFO:tasks.workunit.client.0.smithi080.stderr: #define offsetof(type, member) ((int) &((type *)0)->member) 2024-05-08T21:12:49.982 INFO:tasks.workunit.client.0.smithi080.stderr: ^ 2024-05-08T21:12:49.982 INFO:tasks.workunit.client.0.smithi080.stderr:list.h:33:28: note: in expansion of macro ‘offsetof’ 2024-05-08T21:12:49.982 INFO:tasks.workunit.client.0.smithi080.stderr: (type *)((char *)__mptr - offsetof(type, member)); }) 2024-05-08T21:12:49.982 INFO:tasks.workunit.client.0.smithi080.stderr: ^~~~~~~~ 2024-05-08T21:12:49.982 INFO:tasks.workunit.client.0.smithi080.stderr:list.h:36:2: note: in expansion of macro ‘container_of’ 2024-05-08T21:12:49.982 INFO:tasks.workunit.client.0.smithi080.stderr: container_of(ptr, type, member) 2024-05-08T21:12:49.983 INFO:tasks.workunit.client.0.smithi080.stderr: ^~~~~~~~~~~~ 2024-05-08T21:12:49.983 INFO:tasks.workunit.client.0.smithi080.stderr:list.h:39:13: note: in expansion of macro ‘list_entry’ 2024-05-08T21:12:49.983 INFO:tasks.workunit.client.0.smithi080.stderr: for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-05-08T21:12:49.983 INFO:tasks.workunit.client.0.smithi080.stderr: ^~~~~~~~~~ 2024-05-08T21:12:49.983 INFO:tasks.workunit.client.0.smithi080.stderr:parser.c:980:6: note: in expansion of macro ‘list_for_each_entry’ 2024-05-08T21:12:49.983 INFO:tasks.workunit.client.0.smithi080.stderr: list_for_each_entry(tmp_list, 2024-05-08T21:12:49.983 INFO:tasks.workunit.client.0.smithi080.stderr: ^~~~~~~~~~~~~~~~~~~ 2024-05-08T21:12:49.983 INFO:tasks.workunit.client.0.smithi080.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-05-08T21:12:49.983 INFO:tasks.workunit.client.0.smithi080.stderr: #define offsetof(type, member) ((int) &((type *)0)->member) 2024-05-08T21:12:49.983 INFO:tasks.workunit.client.0.smithi080.stderr: ^ 2024-05-08T21:12:49.983 INFO:tasks.workunit.client.0.smithi080.stderr:list.h:33:28: note: in expansion of macro ‘offsetof’ 2024-05-08T21:12:49.983 INFO:tasks.workunit.client.0.smithi080.stderr: (type *)((char *)__mptr - offsetof(type, member)); }) 2024-05-08T21:12:49.983 INFO:tasks.workunit.client.0.smithi080.stderr: ^~~~~~~~ 2024-05-08T21:12:49.983 INFO:tasks.workunit.client.0.smithi080.stderr:list.h:36:2: note: in expansion of macro ‘container_of’ 2024-05-08T21:12:49.983 INFO:tasks.workunit.client.0.smithi080.stderr: container_of(ptr, type, member) 2024-05-08T21:12:49.984 INFO:tasks.workunit.client.0.smithi080.stderr: ^~~~~~~~~~~~ 2024-05-08T21:12:49.984 INFO:tasks.workunit.client.0.smithi080.stderr:list.h:41:13: note: in expansion of macro ‘list_entry’ 2024-05-08T21:12:49.984 INFO:tasks.workunit.client.0.smithi080.stderr: pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-05-08T21:12:49.984 INFO:tasks.workunit.client.0.smithi080.stderr: ^~~~~~~~~~ 2024-05-08T21:12:49.984 INFO:tasks.workunit.client.0.smithi080.stderr:parser.c:980:6: note: in expansion of macro ‘list_for_each_entry’ 2024-05-08T21:12:49.984 INFO:tasks.workunit.client.0.smithi080.stderr: list_for_each_entry(tmp_list, 2024-05-08T21:12:49.984 INFO:tasks.workunit.client.0.smithi080.stderr: ^~~~~~~~~~~~~~~~~~~ 2024-05-08T21:12:50.078 INFO:tasks.workunit.client.0.smithi080.stderr:parser.c: In function ‘set_weight’: 2024-05-08T21:12:50.078 INFO:tasks.workunit.client.0.smithi080.stderr:parser.c:623:4: warning: ‘strncpy’ specified bound depends on the length of the source argument [-Wstringop-overflow=] 2024-05-08T21:12:50.078 INFO:tasks.workunit.client.0.smithi080.stderr: strncpy (op, tmp_config->name, len - 7); 2024-05-08T21:12:50.079 INFO:tasks.workunit.client.0.smithi080.stderr: ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-08T21:12:50.079 INFO:tasks.workunit.client.0.smithi080.stderr:parser.c:620:10: note: length computed here 2024-05-08T21:12:50.079 INFO:tasks.workunit.client.0.smithi080.stderr: len = strlen(tmp_config->name); 2024-05-08T21:12:50.079 INFO:tasks.workunit.client.0.smithi080.stderr: ^~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-08T21:12:50.082 INFO:tasks.workunit.client.0.smithi080.stderr:parser.c: In function ‘get_weight_total’: 2024-05-08T21:12:50.082 INFO:tasks.workunit.client.0.smithi080.stderr:parser.c:645:4: warning: ‘strncpy’ specified bound depends on the length of the source argument [-Wstringop-overflow=] 2024-05-08T21:12:50.082 INFO:tasks.workunit.client.0.smithi080.stderr: strncpy (op, tmp_config->name, len - 7); 2024-05-08T21:12:50.083 INFO:tasks.workunit.client.0.smithi080.stderr: ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-08T21:12:50.083 INFO:tasks.workunit.client.0.smithi080.stderr:parser.c:642:10: note: length computed here 2024-05-08T21:12:50.083 INFO:tasks.workunit.client.0.smithi080.stderr: len = strlen(tmp_config->name); 2024-05-08T21:12:50.083 INFO:tasks.workunit.client.0.smithi080.stderr: ^~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-08T21:12:50.203 INFO:tasks.workunit.client.0.smithi080.stdout:mv -f .deps/parser.Tpo .deps/parser.Po 2024-05-08T21:12:50.206 INFO:tasks.workunit.client.0.smithi080.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fc.o -MD -MP -MF .deps/ffsb_fc.Tpo -c -o ffsb_fc.o ffsb_fc.c 2024-05-08T21:12:50.258 INFO:tasks.workunit.client.0.smithi080.stdout:mv -f .deps/ffsb_fc.Tpo .deps/ffsb_fc.Po 2024-05-08T21:12:50.261 INFO:tasks.workunit.client.0.smithi080.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_stats.o -MD -MP -MF .deps/ffsb_stats.Tpo -c -o ffsb_stats.o ffsb_stats.c 2024-05-08T21:12:50.343 INFO:tasks.workunit.client.0.smithi080.stdout:mv -f .deps/ffsb_stats.Tpo .deps/ffsb_stats.Po 2024-05-08T21:12:50.346 INFO:tasks.workunit.client.0.smithi080.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT list.o -MD -MP -MF .deps/list.Tpo -c -o list.o list.c 2024-05-08T21:12:50.374 INFO:tasks.workunit.client.0.smithi080.stdout:mv -f .deps/list.Tpo .deps/list.Po 2024-05-08T21:12:50.377 INFO:tasks.workunit.client.0.smithi080.stdout:gcc -D_GNU_SOURCE -g -O2 -D_REENTRANT -o ffsb fileops.o rand.o main.o fh.o filelist.o metaops.o rwlock.o cirlist.o rbt.o ffsb_tg.o ffsb_fs.o ffsb_thread.o ffsb_op.o util.o parser.o ffsb_fc.o ffsb_stats.o list.o -lpthread -lm 2024-05-08T21:12:50.407 INFO:tasks.workunit.client.0.smithi080.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb' 2024-05-08T21:12:50.410 INFO:tasks.workunit.client.0.smithi080.stdout:FFSB version 6.0-RC2 started 2024-05-08T21:12:50.410 INFO:tasks.workunit.client.0.smithi080.stdout: 2024-05-08T21:12:50.414 INFO:tasks.workunit.client.0.smithi080.stdout:benchmark time = 300 2024-05-08T21:12:50.414 INFO:tasks.workunit.client.0.smithi080.stdout:ThreadGroup 0 2024-05-08T21:12:50.415 INFO:tasks.workunit.client.0.smithi080.stdout:================ 2024-05-08T21:12:50.415 INFO:tasks.workunit.client.0.smithi080.stdout: num_threads = 32 2024-05-08T21:12:50.415 INFO:tasks.workunit.client.0.smithi080.stdout: 2024-05-08T21:12:50.415 INFO:tasks.workunit.client.0.smithi080.stdout: read_random = off 2024-05-08T21:12:50.415 INFO:tasks.workunit.client.0.smithi080.stdout: read_size = 0 (0B) 2024-05-08T21:12:50.415 INFO:tasks.workunit.client.0.smithi080.stdout: read_blocksize = 0 (0B) 2024-05-08T21:12:50.415 INFO:tasks.workunit.client.0.smithi080.stdout: read_skip = off 2024-05-08T21:12:50.415 INFO:tasks.workunit.client.0.smithi080.stdout: read_skipsize = 0 (0B) 2024-05-08T21:12:50.415 INFO:tasks.workunit.client.0.smithi080.stdout: 2024-05-08T21:12:50.415 INFO:tasks.workunit.client.0.smithi080.stdout: write_random = on 2024-05-08T21:12:50.415 INFO:tasks.workunit.client.0.smithi080.stdout: write_size = 5242880 (5MB) 2024-05-08T21:12:50.415 INFO:tasks.workunit.client.0.smithi080.stdout: fsync_file = 0 2024-05-08T21:12:50.415 INFO:tasks.workunit.client.0.smithi080.stdout: write_blocksize = 4096 (4KB) 2024-05-08T21:12:50.415 INFO:tasks.workunit.client.0.smithi080.stdout: wait time = 0 2024-05-08T21:12:50.415 INFO:tasks.workunit.client.0.smithi080.stdout: 2024-05-08T21:12:50.416 INFO:tasks.workunit.client.0.smithi080.stdout: op weights 2024-05-08T21:12:50.416 INFO:tasks.workunit.client.0.smithi080.stdout: read = 0 (0.00%) 2024-05-08T21:12:50.416 INFO:tasks.workunit.client.0.smithi080.stdout: readall = 0 (0.00%) 2024-05-08T21:12:50.416 INFO:tasks.workunit.client.0.smithi080.stdout: write = 1 (100.00%) 2024-05-08T21:12:50.416 INFO:tasks.workunit.client.0.smithi080.stdout: create = 0 (0.00%) 2024-05-08T21:12:50.416 INFO:tasks.workunit.client.0.smithi080.stdout: append = 0 (0.00%) 2024-05-08T21:12:50.416 INFO:tasks.workunit.client.0.smithi080.stdout: delete = 0 (0.00%) 2024-05-08T21:12:50.416 INFO:tasks.workunit.client.0.smithi080.stdout: metaop = 0 (0.00%) 2024-05-08T21:12:50.416 INFO:tasks.workunit.client.0.smithi080.stdout: createdir = 0 (0.00%) 2024-05-08T21:12:50.416 INFO:tasks.workunit.client.0.smithi080.stdout: stat = 0 (0.00%) 2024-05-08T21:12:50.416 INFO:tasks.workunit.client.0.smithi080.stdout: writeall = 0 (0.00%) 2024-05-08T21:12:50.416 INFO:tasks.workunit.client.0.smithi080.stdout: writeall_fsync = 0 (0.00%) 2024-05-08T21:12:50.416 INFO:tasks.workunit.client.0.smithi080.stdout: open_close = 0 (0.00%) 2024-05-08T21:12:50.416 INFO:tasks.workunit.client.0.smithi080.stdout: write_fsync = 0 (0.00%) 2024-05-08T21:12:50.416 INFO:tasks.workunit.client.0.smithi080.stdout: create_fsync = 0 (0.00%) 2024-05-08T21:12:50.417 INFO:tasks.workunit.client.0.smithi080.stdout: append_fsync = 0 (0.00%) 2024-05-08T21:12:50.417 INFO:tasks.workunit.client.0.smithi080.stdout: 2024-05-08T21:12:50.417 INFO:tasks.workunit.client.0.smithi080.stdout:FileSystem . 2024-05-08T21:12:50.417 INFO:tasks.workunit.client.0.smithi080.stdout:========== 2024-05-08T21:12:50.417 INFO:tasks.workunit.client.0.smithi080.stdout: num_dirs = 0 2024-05-08T21:12:50.417 INFO:tasks.workunit.client.0.smithi080.stdout: starting files = 128 2024-05-08T21:12:50.417 INFO:tasks.workunit.client.0.smithi080.stdout: 2024-05-08T21:12:50.417 INFO:tasks.workunit.client.0.smithi080.stdout: min file size = 104857600 (100MB) 2024-05-08T21:12:50.417 INFO:tasks.workunit.client.0.smithi080.stdout: max file size = 104857600 (100MB) 2024-05-08T21:12:50.417 INFO:tasks.workunit.client.0.smithi080.stdout: directio = off 2024-05-08T21:12:50.417 INFO:tasks.workunit.client.0.smithi080.stdout: alignedio = on 2024-05-08T21:12:50.417 INFO:tasks.workunit.client.0.smithi080.stdout: bufferedio = off 2024-05-08T21:12:50.417 INFO:tasks.workunit.client.0.smithi080.stdout: 2024-05-08T21:12:50.417 INFO:tasks.workunit.client.0.smithi080.stdout: aging is off 2024-05-08T21:12:50.417 INFO:tasks.workunit.client.0.smithi080.stdout: current utilization = 0.03% 2024-05-08T21:12:50.418 INFO:tasks.workunit.client.0.smithi080.stdout: 2024-05-08T21:12:50.418 INFO:tasks.workunit.client.0.smithi080.stdout:checking existing fs: . 2024-05-08T21:12:50.418 INFO:tasks.workunit.client.0.smithi080.stdout:recreating new fileset 2024-05-08T21:12:50.418 INFO:tasks.workunit.client.0.smithi080.stderr:opendir: No such file or directory 2024-05-08T21:13:10.661 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:13:10.684 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:13:11.925 INFO:tasks.workunit.client.0.smithi080.stdout:fs setup took 21 secs 2024-05-08T21:13:14.940 INFO:tasks.workunit.client.0.smithi080.stdout:Syncing()...3 sec 2024-05-08T21:13:14.941 INFO:tasks.workunit.client.0.smithi080.stdout:Starting Actual Benchmark At: Wed May 8 21:13:14 2024 2024-05-08T21:13:14.941 INFO:tasks.workunit.client.0.smithi080.stdout: 2024-05-08T21:13:40.917 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:13:40.922 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:14:11.359 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:14:11.363 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:14:15.536 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:14:24.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.034+0000 7f80373de700 1 Processor -- start 2024-05-08T21:14:24.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.038+0000 7f80373de700 1 -- start start 2024-05-08T21:14:24.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.039+0000 7f80373de700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8030071390 0x7f80300c97f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:24.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.039+0000 7f80373de700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f803006bad0 0x7f803006bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:24.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.039+0000 7f80373de700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80300c7950 con 0x7f8030150dd0 2024-05-08T21:14:24.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.039+0000 7f80373de700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80300c93d0 con 0x7f803006bad0 2024-05-08T21:14:24.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.039+0000 7f80373de700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8030071820 con 0x7f8030071390 2024-05-08T21:14:24.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.041+0000 7f803597b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f803006bad0 0x7f803006bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:24.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.041+0000 7f8034979700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8030071390 0x7f80300c97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:24.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.041+0000 7f8034979700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8030071390 0x7f80300c97f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.80:33940/0 (socket says 172.21.15.80:33940) 2024-05-08T21:14:24.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.041+0000 7f803597b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f803006bad0 0x7f803006bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45162/0 (socket says 172.21.15.80:45162) 2024-05-08T21:14:24.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.041+0000 7f8034979700 1 -- 172.21.15.80:0/3914218678 learned_addr learned my addr 172.21.15.80:0/3914218678 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:14:24.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.041+0000 7f8034979700 1 -- 172.21.15.80:0/3914218678 >> v2:172.21.15.80:3300/0 conn(0x7f803006bad0 msgr2=0x7f803006bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:14:24.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.041+0000 7f8034979700 1 --2- 172.21.15.80:0/3914218678 >> v2:172.21.15.80:3300/0 conn(0x7f803006bad0 0x7f803006bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:24.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.041+0000 7f8034979700 1 -- 172.21.15.80:0/3914218678 >> v1:172.21.15.80:6789/0 conn(0x7f8030150dd0 legacy=0x7f8030157940 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T21:14:24.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.041+0000 7f8034979700 1 -- 172.21.15.80:0/3914218678 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80300c8a30 con 0x7f8030071390 2024-05-08T21:14:24.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.041+0000 7f8034979700 1 --2- 172.21.15.80:0/3914218678 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8030071390 0x7f80300c97f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f80300c4ca0 tx=0x7f802000f050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=956ac8b4d5950821 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:14:24.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.042+0000 7f8027fff700 1 -- 172.21.15.80:0/3914218678 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8020018ce0 con 0x7f8030071390 2024-05-08T21:14:24.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.042+0000 7f8027fff700 1 -- 172.21.15.80:0/3914218678 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8020018e40 con 0x7f8030071390 2024-05-08T21:14:24.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.042+0000 7f803597b700 1 --2- 172.21.15.80:0/3914218678 >> v2:172.21.15.80:3300/0 conn(0x7f803006bad0 0x7f803006bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-05-08T21:14:24.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.042+0000 7f8027fff700 1 -- 172.21.15.80:0/3914218678 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8020004250 con 0x7f8030071390 2024-05-08T21:14:24.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.043+0000 7f80373de700 1 -- 172.21.15.80:0/3914218678 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8030071390 msgr2=0x7f80300c97f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:24.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.043+0000 7f80373de700 1 --2- 172.21.15.80:0/3914218678 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8030071390 0x7f80300c97f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f80300c4ca0 tx=0x7f802000f050 comp rx=0 tx=0).stop 2024-05-08T21:14:24.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.044+0000 7f80373de700 1 -- 172.21.15.80:0/3914218678 shutdown_connections 2024-05-08T21:14:24.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.044+0000 7f80373de700 1 --2- 172.21.15.80:0/3914218678 >> v2:172.21.15.80:3300/0 conn(0x7f803006bad0 0x7f803006bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:24.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.044+0000 7f80373de700 1 --2- 172.21.15.80:0/3914218678 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8030071390 0x7f80300c97f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:24.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.044+0000 7f80373de700 1 -- 172.21.15.80:0/3914218678 >> 172.21.15.80:0/3914218678 conn(0x7f803006ef80 msgr2=0x7f803006f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:14:24.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.044+0000 7f80373de700 1 -- 172.21.15.80:0/3914218678 shutdown_connections 2024-05-08T21:14:24.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.044+0000 7f80373de700 1 -- 172.21.15.80:0/3914218678 wait complete. 2024-05-08T21:14:24.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.046+0000 7f80373de700 1 Processor -- start 2024-05-08T21:14:24.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.046+0000 7f80373de700 1 -- start start 2024-05-08T21:14:24.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.047+0000 7f80373de700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f803006bad0 0x7f80301e0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:24.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.047+0000 7f80373de700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8030071390 0x7f803006ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:24.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.047+0000 7f80373de700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8030150dd0 0x7f80301e15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:24.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.047+0000 7f80373de700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80301e0ac0 con 0x7f8030150dd0 2024-05-08T21:14:24.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.047+0000 7f80373de700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f803015b3f0 con 0x7f8030071390 2024-05-08T21:14:24.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.047+0000 7f80373de700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f803015a210 con 0x7f803006bad0 2024-05-08T21:14:24.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.048+0000 7f803597b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8030150dd0 0x7f80301e15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:24.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.048+0000 7f803597b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8030150dd0 0x7f80301e15c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45168/0 (socket says 172.21.15.80:45168) 2024-05-08T21:14:24.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.048+0000 7f803597b700 1 -- 172.21.15.80:0/4290515966 learned_addr learned my addr 172.21.15.80:0/4290515966 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:14:24.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.049+0000 7f803597b700 1 -- 172.21.15.80:0/4290515966 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f803006bad0 msgr2=0x7f80301e0580 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T21:14:24.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.049+0000 7f803597b700 1 --2- 172.21.15.80:0/4290515966 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f803006bad0 0x7f80301e0580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:24.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.049+0000 7f803597b700 1 -- 172.21.15.80:0/4290515966 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8030071390 msgr2=0x7f803006ac30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T21:14:24.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.049+0000 7f803597b700 1 --2- 172.21.15.80:0/4290515966 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8030071390 0x7f803006ac30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:24.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.049+0000 7f803597b700 1 -- 172.21.15.80:0/4290515966 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f802000da00 con 0x7f8030150dd0 2024-05-08T21:14:24.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.049+0000 7f803597b700 1 --2- 172.21.15.80:0/4290515966 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8030150dd0 0x7f80301e15c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f802800cef0 tx=0x7f802800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:14:24.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.050+0000 7f8025ffb700 1 -- 172.21.15.80:0/4290515966 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802800ae50 con 0x7f8030150dd0 2024-05-08T21:14:24.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.050+0000 7f8025ffb700 1 -- 172.21.15.80:0/4290515966 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8028015440 con 0x7f8030150dd0 2024-05-08T21:14:24.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.050+0000 7f8025ffb700 1 -- 172.21.15.80:0/4290515966 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80280157f0 con 0x7f8030150dd0 2024-05-08T21:14:24.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.050+0000 7f80373de700 1 -- 172.21.15.80:0/4290515966 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8030159f50 con 0x7f8030150dd0 2024-05-08T21:14:24.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.050+0000 7f80373de700 1 -- 172.21.15.80:0/4290515966 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f803015a440 con 0x7f8030150dd0 2024-05-08T21:14:24.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.052+0000 7f80373de700 1 -- 172.21.15.80:0/4290515966 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f803004ec60 con 0x7f8030150dd0 2024-05-08T21:14:24.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.064+0000 7f8025ffb700 1 -- 172.21.15.80:0/4290515966 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f802800d430 con 0x7f8030150dd0 2024-05-08T21:14:24.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.065+0000 7f8025ffb700 1 --2- 172.21.15.80:0/4290515966 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f801c06aef0 0x7f801c06d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:24.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.065+0000 7f8025ffb700 1 -- 172.21.15.80:0/4290515966 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f8028089b90 con 0x7f8030150dd0 2024-05-08T21:14:24.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.065+0000 7f803517a700 1 --2- 172.21.15.80:0/4290515966 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f801c06aef0 0x7f801c06d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:24.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.065+0000 7f8025ffb700 1 -- 172.21.15.80:0/4290515966 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f802808d280 con 0x7f8030150dd0 2024-05-08T21:14:24.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.066+0000 7f803517a700 1 --2- 172.21.15.80:0/4290515966 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f801c06aef0 0x7f801c06d3b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f802c009670 tx=0x7f802c006bd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:14:24.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.578+0000 7f80373de700 1 -- 172.21.15.80:0/4290515966 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8030159f50 con 0x7f8030150dd0 2024-05-08T21:14:24.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.578+0000 7f8025ffb700 1 -- 172.21.15.80:0/4290515966 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+6258 (secure 0 0 0) 0x7f8030159f50 con 0x7f8030150dd0 2024-05-08T21:14:24.582 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:14:24.582 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4990,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/1499761952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1499761952},{"type":"v1","addr":"172.21.15.106:6836","nonce":1499761952}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:12:21.380279+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":39,"addr":"172.21.15.106:6833/2289230272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":2289230272},{"type":"v1","addr":"172.21.15.106:6833","nonce":2289230272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:14:24.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.582+0000 7f80373de700 1 -- 172.21.15.80:0/4290515966 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f801c06aef0 msgr2=0x7f801c06d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:24.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.582+0000 7f80373de700 1 --2- 172.21.15.80:0/4290515966 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f801c06aef0 0x7f801c06d3b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f802c009670 tx=0x7f802c006bd0 comp rx=0 tx=0).stop 2024-05-08T21:14:24.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.582+0000 7f80373de700 1 -- 172.21.15.80:0/4290515966 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8030150dd0 msgr2=0x7f80301e15c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:24.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.582+0000 7f80373de700 1 --2- 172.21.15.80:0/4290515966 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8030150dd0 0x7f80301e15c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f802800cef0 tx=0x7f802800a340 comp rx=0 tx=0).stop 2024-05-08T21:14:24.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.583+0000 7f80373de700 1 -- 172.21.15.80:0/4290515966 shutdown_connections 2024-05-08T21:14:24.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.583+0000 7f80373de700 1 --2- 172.21.15.80:0/4290515966 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f801c06aef0 0x7f801c06d3b0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:24.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.583+0000 7f80373de700 1 --2- 172.21.15.80:0/4290515966 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8030150dd0 0x7f80301e15c0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:24.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.583+0000 7f80373de700 1 --2- 172.21.15.80:0/4290515966 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f803006bad0 0x7f80301e0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:24.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.583+0000 7f80373de700 1 --2- 172.21.15.80:0/4290515966 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8030071390 0x7f803006ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:24.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.583+0000 7f80373de700 1 -- 172.21.15.80:0/4290515966 >> 172.21.15.80:0/4290515966 conn(0x7f803006ef80 msgr2=0x7f8030157330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:14:24.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.583+0000 7f80373de700 1 -- 172.21.15.80:0/4290515966 shutdown_connections 2024-05-08T21:14:24.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:24.583+0000 7f80373de700 1 -- 172.21.15.80:0/4290515966 wait complete. 2024-05-08T21:14:24.591 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 15 2024-05-08T21:14:24.607 INFO:tasks.mds_thrash.fs.[cephfs]:kill mds.b (rank=0) 2024-05-08T21:14:24.607 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-08T21:14:24.607 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:14:24.618 INFO:tasks.ceph.mds.b:Stopped 2024-05-08T21:14:24.619 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:14:25.303 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:25.300+0000 7f006d87f700 1 Processor -- start 2024-05-08T21:14:25.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:25.300+0000 7f006d87f700 1 -- start start 2024-05-08T21:14:25.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:25.301+0000 7f006d87f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f00681544e0 0x7f00680bdc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:25.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:25.301+0000 7f006d87f700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f006815acc0 0x7f00680c8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:25.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:25.301+0000 7f006d87f700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f006815b240 con 0x7f00680bd530 2024-05-08T21:14:25.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:25.301+0000 7f006d87f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00680c69c0 con 0x7f00681544e0 2024-05-08T21:14:25.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:25.301+0000 7f006d87f700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00680c6c60 con 0x7f006815acc0 2024-05-08T21:14:25.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:25.301+0000 7f0066ffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f00681544e0 0x7f00680bdc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:25.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:25.302+0000 7f0066ffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f00681544e0 0x7f00680bdc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45170/0 (socket says 172.21.15.80:45170) 2024-05-08T21:14:25.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:25.302+0000 7f0066ffd700 1 -- 172.21.15.80:0/31935730 learned_addr learned my addr 172.21.15.80:0/31935730 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:14:25.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:25.302+0000 7f0066ffd700 1 -- 172.21.15.80:0/31935730 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f006815acc0 msgr2=0x7f00680c8a70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T21:14:25.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:25.302+0000 7f0066ffd700 1 --2- 172.21.15.80:0/31935730 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f006815acc0 0x7f00680c8a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:25.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:25.302+0000 7f0066ffd700 1 -- 172.21.15.80:0/31935730 >> v1:172.21.15.106:6789/0 conn(0x7f00680bd530 legacy=0x7f00680cb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:25.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:25.302+0000 7f0066ffd700 1 -- 172.21.15.80:0/31935730 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00680c6f40 con 0x7f00681544e0 2024-05-08T21:14:25.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:25.302+0000 7f0066ffd700 1 --2- 172.21.15.80:0/31935730 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00681544e0 0x7f00680bdc30 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f005c0098f0 tx=0x7f005c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c4da8daebdc4595 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:14:25.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:25.303+0000 7f0065ffb700 1 -- 172.21.15.80:0/31935730 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005c00b8a0 con 0x7f00681544e0 2024-05-08T21:14:25.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:25.303+0000 7f0065ffb700 1 -- 172.21.15.80:0/31935730 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f005c00ba00 con 0x7f00681544e0 2024-05-08T21:14:25.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:25.303+0000 7f0065ffb700 1 -- 172.21.15.80:0/31935730 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005c00bd90 con 0x7f00681544e0 2024-05-08T21:14:25.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:25.304+0000 7f006d87f700 1 -- 172.21.15.80:0/31935730 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00681544e0 msgr2=0x7f00680bdc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:25.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:25.304+0000 7f006d87f700 1 --2- 172.21.15.80:0/31935730 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00681544e0 0x7f00680bdc30 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f005c0098f0 tx=0x7f005c009c00 comp rx=0 tx=0).stop 2024-05-08T21:14:25.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:25.304+0000 7f006d87f700 1 -- 172.21.15.80:0/31935730 shutdown_connections 2024-05-08T21:14:25.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:25.304+0000 7f006d87f700 1 --2- 172.21.15.80:0/31935730 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f00681544e0 0x7f00680bdc30 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:25.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:25.304+0000 7f006d87f700 1 --2- 172.21.15.80:0/31935730 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f006815acc0 0x7f00680c8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:25.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:25.304+0000 7f006d87f700 1 -- 172.21.15.80:0/31935730 >> 172.21.15.80:0/31935730 conn(0x7f006806a9c0 msgr2=0x7f006806ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:14:25.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:25.304+0000 7f006d87f700 1 -- 172.21.15.80:0/31935730 shutdown_connections 2024-05-08T21:14:25.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:25.305+0000 7f006d87f700 1 -- 172.21.15.80:0/31935730 wait complete. 2024-05-08T21:14:25.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:25.306+0000 7f006d87f700 1 Processor -- start 2024-05-08T21:14:25.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:25.306+0000 7f006d87f700 1 -- start start 2024-05-08T21:14:25.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:25.307+0000 7f006d87f700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00680bd530 0x7f006814d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:25.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:25.307+0000 7f006d87f700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f00681544e0 0x7f00680c0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:25.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:25.307+0000 7f006d87f700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f006815acc0 0x7f00680bdf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:25.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:25.307+0000 7f006d87f700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00680ca9b0 con 0x7f006815acc0 2024-05-08T21:14:25.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:25.307+0000 7f006d87f700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00680707d0 con 0x7f00680bd530 2024-05-08T21:14:25.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:25.307+0000 7f006d87f700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00680c1b50 con 0x7f00681544e0 2024-05-08T21:14:25.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:25.307+0000 7f0066ffd700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00680bd530 0x7f006814d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:25.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:25.307+0000 7f0066ffd700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00680bd530 0x7f006814d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.80:33952/0 (socket says 172.21.15.80:33952) 2024-05-08T21:14:25.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:25.307+0000 7f0066ffd700 1 -- 172.21.15.80:0/2099614269 learned_addr learned my addr 172.21.15.80:0/2099614269 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:14:25.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:25.309+0000 7f00677fe700 1 --2- 172.21.15.80:0/2099614269 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f006815acc0 0x7f00680bdf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:25.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:25.309+0000 7f00677fe700 1 -- 172.21.15.80:0/2099614269 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f00681544e0 msgr2=0x7f00680c0d90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T21:14:25.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:25.309+0000 7f00677fe700 1 --2- 172.21.15.80:0/2099614269 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f00681544e0 0x7f00680c0d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:25.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:25.309+0000 7f00677fe700 1 -- 172.21.15.80:0/2099614269 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00680bd530 msgr2=0x7f006814d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:25.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:25.309+0000 7f00677fe700 1 --2- 172.21.15.80:0/2099614269 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00680bd530 0x7f006814d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:25.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:25.309+0000 7f00677fe700 1 -- 172.21.15.80:0/2099614269 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f005c009550 con 0x7f006815acc0 2024-05-08T21:14:25.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:25.310+0000 7f00677fe700 1 --2- 172.21.15.80:0/2099614269 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f006815acc0 0x7f00680bdf00 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f0058000f60 tx=0x7f005800c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:14:25.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:25.310+0000 7f004ffff700 1 -- 172.21.15.80:0/2099614269 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00580052d0 con 0x7f006815acc0 2024-05-08T21:14:25.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:25.310+0000 7f004ffff700 1 -- 172.21.15.80:0/2099614269 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0058005430 con 0x7f006815acc0 2024-05-08T21:14:25.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:25.310+0000 7f004ffff700 1 -- 172.21.15.80:0/2099614269 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00580038c0 con 0x7f006815acc0 2024-05-08T21:14:25.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:25.311+0000 7f006d87f700 1 -- 172.21.15.80:0/2099614269 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00680c1870 con 0x7f006815acc0 2024-05-08T21:14:25.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:25.311+0000 7f006d87f700 1 -- 172.21.15.80:0/2099614269 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00681f5d80 con 0x7f006815acc0 2024-05-08T21:14:25.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:25.314+0000 7f004ffff700 1 -- 172.21.15.80:0/2099614269 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0058003a20 con 0x7f006815acc0 2024-05-08T21:14:25.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:25.314+0000 7f004ffff700 1 --2- 172.21.15.80:0/2099614269 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f005408ccd0 0x7f005408f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:25.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:25.315+0000 7f004ffff700 1 -- 172.21.15.80:0/2099614269 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f0058088a40 con 0x7f006815acc0 2024-05-08T21:14:25.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:25.315+0000 7f0066ffd700 1 --2- 172.21.15.80:0/2099614269 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f005408ccd0 0x7f005408f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:25.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:25.315+0000 7f006d87f700 1 -- 172.21.15.80:0/2099614269 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00680bd320 con 0x7f006815acc0 2024-05-08T21:14:25.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:25.316+0000 7f0066ffd700 1 --2- 172.21.15.80:0/2099614269 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f005408ccd0 0x7f005408f190 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f005c000c00 tx=0x7f005c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:14:25.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:25.322+0000 7f004ffff700 1 -- 172.21.15.80:0/2099614269 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f0058053790 con 0x7f006815acc0 2024-05-08T21:14:25.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:25.848+0000 7f006d87f700 1 -- 172.21.15.80:0/2099614269 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f006804ec60 con 0x7f006815acc0 2024-05-08T21:14:25.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:25.849+0000 7f004ffff700 1 -- 172.21.15.80:0/2099614269 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+6258 (secure 0 0 0) 0x7f0058017020 con 0x7f006815acc0 2024-05-08T21:14:25.856 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:14:25.856 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4990,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/1499761952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1499761952},{"type":"v1","addr":"172.21.15.106:6836","nonce":1499761952}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:12:21.380279+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":39,"addr":"172.21.15.106:6833/2289230272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":2289230272},{"type":"v1","addr":"172.21.15.106:6833","nonce":2289230272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:14:25.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:25.855+0000 7f006d87f700 1 -- 172.21.15.80:0/2099614269 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f005408ccd0 msgr2=0x7f005408f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:25.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:25.855+0000 7f006d87f700 1 --2- 172.21.15.80:0/2099614269 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f005408ccd0 0x7f005408f190 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f005c000c00 tx=0x7f005c008030 comp rx=0 tx=0).stop 2024-05-08T21:14:25.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:25.855+0000 7f006d87f700 1 -- 172.21.15.80:0/2099614269 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f006815acc0 msgr2=0x7f00680bdf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:25.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:25.855+0000 7f006d87f700 1 --2- 172.21.15.80:0/2099614269 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f006815acc0 0x7f00680bdf00 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f0058000f60 tx=0x7f005800c790 comp rx=0 tx=0).stop 2024-05-08T21:14:25.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:25.855+0000 7f006d87f700 1 -- 172.21.15.80:0/2099614269 shutdown_connections 2024-05-08T21:14:25.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:25.855+0000 7f006d87f700 1 --2- 172.21.15.80:0/2099614269 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f005408ccd0 0x7f005408f190 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:25.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:25.855+0000 7f006d87f700 1 --2- 172.21.15.80:0/2099614269 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f006815acc0 0x7f00680bdf00 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:25.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:25.855+0000 7f006d87f700 1 --2- 172.21.15.80:0/2099614269 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00680bd530 0x7f006814d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:25.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:25.855+0000 7f006d87f700 1 --2- 172.21.15.80:0/2099614269 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f00681544e0 0x7f00680c0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:25.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:25.855+0000 7f006d87f700 1 -- 172.21.15.80:0/2099614269 >> 172.21.15.80:0/2099614269 conn(0x7f006806a9c0 msgr2=0x7f0068150070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:14:25.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:25.856+0000 7f006d87f700 1 -- 172.21.15.80:0/2099614269 shutdown_connections 2024-05-08T21:14:25.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:25.856+0000 7f006d87f700 1 -- 172.21.15.80:0/2099614269 wait complete. 2024-05-08T21:14:25.861 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 15 2024-05-08T21:14:25.880 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-05-08T21:14:27.882 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:14:28.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.154+0000 7f72a9f39700 1 Processor -- start 2024-05-08T21:14:28.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.154+0000 7f72a9f39700 1 -- start start 2024-05-08T21:14:28.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.155+0000 7f72a9f39700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f72a4151010 0x7f72a415aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:28.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.155+0000 7f72a9f39700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f72a4156dc0 0x7f72a40c8150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:28.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.155+0000 7f72a9f39700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f72a415aff0 0x7f72a40c8690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:28.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.155+0000 7f72a9f39700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72a415a3b0 con 0x7f72a415aff0 2024-05-08T21:14:28.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.155+0000 7f72a9f39700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72a415a690 con 0x7f72a4151010 2024-05-08T21:14:28.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.155+0000 7f72a9f39700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72a4071850 con 0x7f72a4156dc0 2024-05-08T21:14:28.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.156+0000 7f72a37fe700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f72a4151010 0x7f72a415aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:28.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.156+0000 7f72a37fe700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f72a4151010 0x7f72a415aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.80:33956/0 (socket says 172.21.15.80:33956) 2024-05-08T21:14:28.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.156+0000 7f72a37fe700 1 -- 172.21.15.80:0/3448708112 learned_addr learned my addr 172.21.15.80:0/3448708112 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:14:28.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.156+0000 7f72a3fff700 1 --2- 172.21.15.80:0/3448708112 >> v2:172.21.15.80:3300/0 conn(0x7f72a415aff0 0x7f72a40c8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:28.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.157+0000 7f72a37fe700 1 -- 172.21.15.80:0/3448708112 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f72a4156dc0 msgr2=0x7f72a40c8150 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T21:14:28.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.157+0000 7f72a37fe700 1 --2- 172.21.15.80:0/3448708112 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f72a4156dc0 0x7f72a40c8150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:28.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.157+0000 7f72a37fe700 1 -- 172.21.15.80:0/3448708112 >> v2:172.21.15.80:3300/0 conn(0x7f72a415aff0 msgr2=0x7f72a40c8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:14:28.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.157+0000 7f72a37fe700 1 --2- 172.21.15.80:0/3448708112 >> v2:172.21.15.80:3300/0 conn(0x7f72a415aff0 0x7f72a40c8690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:28.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.157+0000 7f72a37fe700 1 -- 172.21.15.80:0/3448708112 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a41572b0 con 0x7f72a4151010 2024-05-08T21:14:28.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.157+0000 7f72a37fe700 1 --2- 172.21.15.80:0/3448708112 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f72a4151010 0x7f72a415aab0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f72a406cb90 tx=0x7f7294009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14e204e9b1d980b7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:14:28.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.169+0000 7f72a27fc700 1 -- 172.21.15.80:0/3448708112 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7294014e90 con 0x7f72a4151010 2024-05-08T21:14:28.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.169+0000 7f72a27fc700 1 -- 172.21.15.80:0/3448708112 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f729401c440 con 0x7f72a4151010 2024-05-08T21:14:28.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.169+0000 7f72a27fc700 1 -- 172.21.15.80:0/3448708112 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f729401c7d0 con 0x7f72a4151010 2024-05-08T21:14:28.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.171+0000 7f72a9f39700 1 -- 172.21.15.80:0/3448708112 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f72a4151010 msgr2=0x7f72a415aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:28.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.171+0000 7f72a9f39700 1 --2- 172.21.15.80:0/3448708112 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f72a4151010 0x7f72a415aab0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f72a406cb90 tx=0x7f7294009c00 comp rx=0 tx=0).stop 2024-05-08T21:14:28.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.172+0000 7f72a9f39700 1 -- 172.21.15.80:0/3448708112 shutdown_connections 2024-05-08T21:14:28.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.172+0000 7f72a9f39700 1 --2- 172.21.15.80:0/3448708112 >> v2:172.21.15.80:3300/0 conn(0x7f72a415aff0 0x7f72a40c8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:28.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.172+0000 7f72a9f39700 1 --2- 172.21.15.80:0/3448708112 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f72a4151010 0x7f72a415aab0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:28.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.172+0000 7f72a9f39700 1 --2- 172.21.15.80:0/3448708112 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f72a4156dc0 0x7f72a40c8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:28.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.172+0000 7f72a9f39700 1 -- 172.21.15.80:0/3448708112 >> 172.21.15.80:0/3448708112 conn(0x7f72a40c9310 msgr2=0x7f72a40c9720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:14:28.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.172+0000 7f72a9f39700 1 -- 172.21.15.80:0/3448708112 shutdown_connections 2024-05-08T21:14:28.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.172+0000 7f72a9f39700 1 -- 172.21.15.80:0/3448708112 wait complete. 2024-05-08T21:14:28.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.174+0000 7f72a9f39700 1 Processor -- start 2024-05-08T21:14:28.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.175+0000 7f72a9f39700 1 -- start start 2024-05-08T21:14:28.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.176+0000 7f72a9f39700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72a4151010 0x7f72a4200570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:28.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.176+0000 7f72a9f39700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f72a4156dc0 0x7f72a4153f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:28.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.176+0000 7f72a9f39700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f72a415aff0 0x7f72a41f37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:28.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.176+0000 7f72a9f39700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72a4072b40 con 0x7f72a4151010 2024-05-08T21:14:28.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.176+0000 7f72a9f39700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72a41536d0 con 0x7f72a4156dc0 2024-05-08T21:14:28.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.176+0000 7f72a9f39700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72a41ffdb0 con 0x7f72a415aff0 2024-05-08T21:14:28.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.176+0000 7f72a37fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72a4151010 0x7f72a4200570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:28.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.176+0000 7f72a37fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72a4151010 0x7f72a4200570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45204/0 (socket says 172.21.15.80:45204) 2024-05-08T21:14:28.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.176+0000 7f72a37fe700 1 -- 172.21.15.80:0/1841614916 learned_addr learned my addr 172.21.15.80:0/1841614916 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:14:28.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.177+0000 7f72a3fff700 1 --2- 172.21.15.80:0/1841614916 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f72a415aff0 0x7f72a41f37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:28.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.177+0000 7f72a2ffd700 1 --2- 172.21.15.80:0/1841614916 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f72a4156dc0 0x7f72a4153f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:28.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.177+0000 7f72a37fe700 1 -- 172.21.15.80:0/1841614916 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f72a415aff0 msgr2=0x7f72a41f37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:28.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.177+0000 7f72a37fe700 1 --2- 172.21.15.80:0/1841614916 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f72a415aff0 0x7f72a41f37b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:28.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.177+0000 7f72a37fe700 1 -- 172.21.15.80:0/1841614916 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f72a4156dc0 msgr2=0x7f72a4153f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:28.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.177+0000 7f72a37fe700 1 --2- 172.21.15.80:0/1841614916 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f72a4156dc0 0x7f72a4153f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:28.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.177+0000 7f72a37fe700 1 -- 172.21.15.80:0/1841614916 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7294009550 con 0x7f72a4151010 2024-05-08T21:14:28.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.178+0000 7f72a37fe700 1 --2- 172.21.15.80:0/1841614916 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72a4151010 0x7f72a4200570 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f7294000c00 tx=0x7f7294004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:14:28.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.178+0000 7f728bfff700 1 -- 172.21.15.80:0/1841614916 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7294003b70 con 0x7f72a4151010 2024-05-08T21:14:28.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.178+0000 7f728bfff700 1 -- 172.21.15.80:0/1841614916 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7294003cf0 con 0x7f72a4151010 2024-05-08T21:14:28.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.178+0000 7f728bfff700 1 -- 172.21.15.80:0/1841614916 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f729401c7f0 con 0x7f72a4151010 2024-05-08T21:14:28.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.179+0000 7f72a9f39700 1 -- 172.21.15.80:0/1841614916 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72a41533f0 con 0x7f72a4151010 2024-05-08T21:14:28.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.179+0000 7f72a9f39700 1 -- 172.21.15.80:0/1841614916 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72a4200050 con 0x7f72a4151010 2024-05-08T21:14:28.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.181+0000 7f728bfff700 1 -- 172.21.15.80:0/1841614916 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f729401c950 con 0x7f72a4151010 2024-05-08T21:14:28.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.182+0000 7f728bfff700 1 --2- 172.21.15.80:0/1841614916 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f729006ac90 0x7f729006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:28.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.182+0000 7f728bfff700 1 -- 172.21.15.80:0/1841614916 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f7294093550 con 0x7f72a4151010 2024-05-08T21:14:28.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.182+0000 7f72a2ffd700 1 --2- 172.21.15.80:0/1841614916 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f729006ac90 0x7f729006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:28.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.183+0000 7f72a2ffd700 1 --2- 172.21.15.80:0/1841614916 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f729006ac90 0x7f729006d150 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f72a4155330 tx=0x7f7298009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:14:28.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.187+0000 7f72a9f39700 1 -- 172.21.15.80:0/1841614916 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72a40c64c0 con 0x7f72a4151010 2024-05-08T21:14:28.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.195+0000 7f728bfff700 1 -- 172.21.15.80:0/1841614916 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f729405e430 con 0x7f72a4151010 2024-05-08T21:14:28.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.675+0000 7f72a9f39700 1 -- 172.21.15.80:0/1841614916 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f72a404ec60 con 0x7f72a4151010 2024-05-08T21:14:28.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.675+0000 7f728bfff700 1 -- 172.21.15.80:0/1841614916 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+6258 (secure 0 0 0) 0x7f7294021090 con 0x7f72a4151010 2024-05-08T21:14:28.684 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:14:28.685 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4990,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/1499761952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1499761952},{"type":"v1","addr":"172.21.15.106:6836","nonce":1499761952}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:12:21.380279+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":39,"addr":"172.21.15.106:6833/2289230272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":2289230272},{"type":"v1","addr":"172.21.15.106:6833","nonce":2289230272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:14:28.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.687+0000 7f72a9f39700 1 -- 172.21.15.80:0/1841614916 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f729006ac90 msgr2=0x7f729006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:28.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.687+0000 7f72a9f39700 1 --2- 172.21.15.80:0/1841614916 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f729006ac90 0x7f729006d150 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f72a4155330 tx=0x7f7298009190 comp rx=0 tx=0).stop 2024-05-08T21:14:28.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.687+0000 7f72a9f39700 1 -- 172.21.15.80:0/1841614916 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72a4151010 msgr2=0x7f72a4200570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:28.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.687+0000 7f72a9f39700 1 --2- 172.21.15.80:0/1841614916 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72a4151010 0x7f72a4200570 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f7294000c00 tx=0x7f7294004750 comp rx=0 tx=0).stop 2024-05-08T21:14:28.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.689+0000 7f72a9f39700 1 -- 172.21.15.80:0/1841614916 shutdown_connections 2024-05-08T21:14:28.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.689+0000 7f72a9f39700 1 --2- 172.21.15.80:0/1841614916 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f729006ac90 0x7f729006d150 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:28.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.689+0000 7f72a9f39700 1 --2- 172.21.15.80:0/1841614916 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72a4151010 0x7f72a4200570 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:28.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.689+0000 7f72a9f39700 1 --2- 172.21.15.80:0/1841614916 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f72a415aff0 0x7f72a41f37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:28.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.689+0000 7f72a9f39700 1 --2- 172.21.15.80:0/1841614916 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f72a4156dc0 0x7f72a4153f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:28.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.689+0000 7f72a9f39700 1 -- 172.21.15.80:0/1841614916 >> 172.21.15.80:0/1841614916 conn(0x7f72a40c9310 msgr2=0x7f72a40c73b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:14:28.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.690+0000 7f72a9f39700 1 -- 172.21.15.80:0/1841614916 shutdown_connections 2024-05-08T21:14:28.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:28.690+0000 7f72a9f39700 1 -- 172.21.15.80:0/1841614916 wait complete. 2024-05-08T21:14:28.695 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 15 2024-05-08T21:14:28.723 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-05-08T21:14:30.723 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:14:30.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.956+0000 7ff001e3b700 1 Processor -- start 2024-05-08T21:14:30.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.956+0000 7ff001e3b700 1 -- start start 2024-05-08T21:14:30.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.957+0000 7ff001e3b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7feffc158720 0x7feffc15f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:30.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.957+0000 7ff001e3b700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feffc06bad0 0x7feffc072ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:30.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.957+0000 7ff001e3b700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feffc15ec10 con 0x7feffc0cd8a0 2024-05-08T21:14:30.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.958+0000 7ff001e3b700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feffc06bfa0 con 0x7feffc158720 2024-05-08T21:14:30.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.958+0000 7ff001e3b700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feffc06c280 con 0x7feffc06bad0 2024-05-08T21:14:30.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.958+0000 7feffb7fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7feffc158720 0x7feffc15f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:30.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.958+0000 7feffbfff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7feffc0cd8a0 0x7feffc0ca360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:49254/0 (socket says 172.21.15.80:49254) 2024-05-08T21:14:30.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.958+0000 7feffbfff700 1 -- 172.21.15.80:0/3730385726 learned_addr learned my addr 172.21.15.80:0/3730385726 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:14:30.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.958+0000 7feffa7fc700 1 -- 172.21.15.80:0/3730385726 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 598279980 0 0) 0x7feffc15ec10 con 0x7feffc0cd8a0 2024-05-08T21:14:30.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.958+0000 7feffa7fc700 1 -- 172.21.15.80:0/3730385726 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefe40035b0 con 0x7feffc0cd8a0 2024-05-08T21:14:30.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.959+0000 7feffa7fc700 1 -- 172.21.15.80:0/3730385726 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 778150278 0 0) 0x7fefe40035b0 con 0x7feffc0cd8a0 2024-05-08T21:14:30.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.959+0000 7feffa7fc700 1 -- 172.21.15.80:0/3730385726 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feffc06bad0 msgr2=0x7feffc072ca0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T21:14:30.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.959+0000 7feffa7fc700 1 --2- 172.21.15.80:0/3730385726 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feffc06bad0 0x7feffc072ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:30.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.959+0000 7feffa7fc700 1 -- 172.21.15.80:0/3730385726 >> v2:172.21.15.80:3300/0 conn(0x7feffc158720 msgr2=0x7feffc15f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:14:30.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.959+0000 7feffa7fc700 1 --2- 172.21.15.80:0/3730385726 >> v2:172.21.15.80:3300/0 conn(0x7feffc158720 0x7feffc15f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:30.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.959+0000 7feffa7fc700 1 -- 172.21.15.80:0/3730385726 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feffc06c560 con 0x7feffc0cd8a0 2024-05-08T21:14:30.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.959+0000 7feffa7fc700 1 -- 172.21.15.80:0/3730385726 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3520646302 0 0) 0x7feff0001670 con 0x7feffc0cd8a0 2024-05-08T21:14:30.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.959+0000 7feffa7fc700 1 -- 172.21.15.80:0/3730385726 >> v1:172.21.15.80:6789/0 conn(0x7feffc0cd8a0 legacy=0x7feffc0ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:30.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.959+0000 7feffa7fc700 1 --2- 172.21.15.80:0/3730385726 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fefe4003a00 0x7fefe4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:30.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.959+0000 7feffa7fc700 1 --2- 172.21.15.80:0/3730385726 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fefe4004850 0x7fefe4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:30.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.959+0000 7feffa7fc700 1 --2- 172.21.15.80:0/3730385726 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fefe4005210 0x7fefe400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:30.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.959+0000 7feffa7fc700 1 -- 172.21.15.80:0/3730385726 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feffc06bfa0 con 0x7fefe4004850 2024-05-08T21:14:30.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.959+0000 7feffa7fc700 1 -- 172.21.15.80:0/3730385726 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feffc06c280 con 0x7fefe4005210 2024-05-08T21:14:30.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.959+0000 7feffa7fc700 1 -- 172.21.15.80:0/3730385726 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefe400c110 con 0x7fefe4003a00 2024-05-08T21:14:30.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.959+0000 7feffbfff700 1 --2- 172.21.15.80:0/3730385726 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fefe4005210 0x7fefe400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:30.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.960+0000 7feffbfff700 1 -- 172.21.15.80:0/3730385726 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fefe4003a00 msgr2=0x7fefe4003e20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T21:14:30.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.960+0000 7feffbfff700 1 --2- 172.21.15.80:0/3730385726 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fefe4003a00 0x7fefe4003e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:30.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.960+0000 7feffbfff700 1 -- 172.21.15.80:0/3730385726 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fefe4004850 msgr2=0x7fefe4004cd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T21:14:30.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.960+0000 7feffbfff700 1 --2- 172.21.15.80:0/3730385726 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fefe4004850 0x7fefe4004cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:30.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.960+0000 7feffbfff700 1 -- 172.21.15.80:0/3730385726 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe40035b0 con 0x7fefe4005210 2024-05-08T21:14:30.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.960+0000 7feffbfff700 1 --2- 172.21.15.80:0/3730385726 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fefe4005210 0x7fefe400ba10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7feff000c320 tx=0x7fefe4005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6fe5bec2690866bf server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:14:30.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.961+0000 7feffa7fc700 1 -- 172.21.15.80:0/3730385726 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff000ce60 con 0x7fefe4005210 2024-05-08T21:14:30.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.961+0000 7feffa7fc700 1 -- 172.21.15.80:0/3730385726 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feff0005960 con 0x7fefe4005210 2024-05-08T21:14:30.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.961+0000 7feffa7fc700 1 -- 172.21.15.80:0/3730385726 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff0005cf0 con 0x7fefe4005210 2024-05-08T21:14:30.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.962+0000 7ff001e3b700 1 -- 172.21.15.80:0/3730385726 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fefe4005210 msgr2=0x7fefe400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:30.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.962+0000 7ff001e3b700 1 --2- 172.21.15.80:0/3730385726 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fefe4005210 0x7fefe400ba10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7feff000c320 tx=0x7fefe4005880 comp rx=0 tx=0).stop 2024-05-08T21:14:30.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.962+0000 7feffbfff700 1 -- 172.21.15.80:0/3730385726 reap_dead start 2024-05-08T21:14:30.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.962+0000 7ff001e3b700 1 -- 172.21.15.80:0/3730385726 shutdown_connections 2024-05-08T21:14:30.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.962+0000 7ff001e3b700 1 -- 172.21.15.80:0/3730385726 >> 172.21.15.80:0/3730385726 conn(0x7feffc070020 msgr2=0x7feffc070430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:14:30.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.962+0000 7ff001e3b700 1 -- 172.21.15.80:0/3730385726 shutdown_connections 2024-05-08T21:14:30.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.965+0000 7ff001e3b700 1 -- 172.21.15.80:0/3730385726 wait complete. 2024-05-08T21:14:30.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.967+0000 7ff001e3b700 1 Processor -- start 2024-05-08T21:14:30.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.967+0000 7ff001e3b700 1 -- start start 2024-05-08T21:14:30.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.967+0000 7ff001e3b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fefe4005210 0x7feffc1f8060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:30.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.967+0000 7ff001e3b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feffc153490 0x7feffc15f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:30.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.967+0000 7ff001e3b700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feffc1f4d60 0x7feffc14d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:30.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.968+0000 7ff001e3b700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feffc161430 con 0x7feffc153490 2024-05-08T21:14:30.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.968+0000 7ff001e3b700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feffc074360 con 0x7fefe4005210 2024-05-08T21:14:30.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.968+0000 7ff001e3b700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feffc1f85a0 con 0x7feffc1f4d60 2024-05-08T21:14:30.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.968+0000 7feffaffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feffc153490 0x7feffc15f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:30.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.968+0000 7feffaffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feffc153490 0x7feffc15f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45220/0 (socket says 172.21.15.80:45220) 2024-05-08T21:14:30.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.968+0000 7feffaffd700 1 -- 172.21.15.80:0/2301894393 learned_addr learned my addr 172.21.15.80:0/2301894393 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:14:30.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.968+0000 7feffbfff700 1 --2- 172.21.15.80:0/2301894393 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feffc1f4d60 0x7feffc14d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:30.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.968+0000 7feffaffd700 1 -- 172.21.15.80:0/2301894393 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feffc1f4d60 msgr2=0x7feffc14d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:30.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.968+0000 7feffaffd700 1 --2- 172.21.15.80:0/2301894393 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feffc1f4d60 0x7feffc14d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:30.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.968+0000 7feffaffd700 1 -- 172.21.15.80:0/2301894393 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fefe4005210 msgr2=0x7feffc1f8060 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T21:14:30.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.968+0000 7feffaffd700 1 --2- 172.21.15.80:0/2301894393 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fefe4005210 0x7feffc1f8060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:30.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.968+0000 7feffaffd700 1 -- 172.21.15.80:0/2301894393 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feffc1f48d0 con 0x7feffc153490 2024-05-08T21:14:30.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.968+0000 7feffbfff700 1 --2- 172.21.15.80:0/2301894393 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feffc1f4d60 0x7feffc14d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:14:30.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.968+0000 7feffaffd700 1 --2- 172.21.15.80:0/2301894393 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feffc153490 0x7feffc15f8c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fefec00b3e0 tx=0x7fefec00b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:14:30.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.969+0000 7fefe3fff700 1 -- 172.21.15.80:0/2301894393 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefec011830 con 0x7feffc153490 2024-05-08T21:14:30.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.969+0000 7fefe3fff700 1 -- 172.21.15.80:0/2301894393 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefec0119b0 con 0x7feffc153490 2024-05-08T21:14:30.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.969+0000 7fefe3fff700 1 -- 172.21.15.80:0/2301894393 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefec011d60 con 0x7feffc153490 2024-05-08T21:14:30.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.969+0000 7ff001e3b700 1 -- 172.21.15.80:0/2301894393 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feffc15fe00 con 0x7feffc153490 2024-05-08T21:14:30.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.969+0000 7ff001e3b700 1 -- 172.21.15.80:0/2301894393 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feffc162170 con 0x7feffc153490 2024-05-08T21:14:30.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.971+0000 7fefe3fff700 1 -- 172.21.15.80:0/2301894393 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fefec01a400 con 0x7feffc153490 2024-05-08T21:14:30.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.971+0000 7fefe3fff700 1 --2- 172.21.15.80:0/2301894393 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fefe806ac90 0x7fefe806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:30.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.971+0000 7fefe3fff700 1 -- 172.21.15.80:0/2301894393 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6749+0+0 (secure 0 0 0) 0x7fefec0895a0 con 0x7feffc153490 2024-05-08T21:14:30.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.971+0000 7ff001e3b700 1 -- 172.21.15.80:0/2301894393 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feffc068080 con 0x7feffc153490 2024-05-08T21:14:30.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.974+0000 7feffb7fe700 1 --2- 172.21.15.80:0/2301894393 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fefe806ac90 0x7fefe806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:30.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.974+0000 7feffb7fe700 1 --2- 172.21.15.80:0/2301894393 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fefe806ac90 0x7fefe806d150 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7feff4009df0 tx=0x7feff4009830 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:14:30.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:30.977+0000 7fefe3fff700 1 -- 172.21.15.80:0/2301894393 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fefec015080 con 0x7feffc153490 2024-05-08T21:14:31.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:31.489+0000 7ff001e3b700 1 -- 172.21.15.80:0/2301894393 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feffc04ec60 con 0x7feffc153490 2024-05-08T21:14:31.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:31.489+0000 7fefe3fff700 1 -- 172.21.15.80:0/2301894393 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+6258 (secure 0 0 0) 0x7fefec057e90 con 0x7feffc153490 2024-05-08T21:14:31.497 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:14:31.498 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4990,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/1499761952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1499761952},{"type":"v1","addr":"172.21.15.106:6836","nonce":1499761952}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:12:21.380279+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":39,"addr":"172.21.15.106:6833/2289230272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":2289230272},{"type":"v1","addr":"172.21.15.106:6833","nonce":2289230272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:14:31.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:31.501+0000 7ff001e3b700 1 -- 172.21.15.80:0/2301894393 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fefe806ac90 msgr2=0x7fefe806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:31.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:31.501+0000 7ff001e3b700 1 --2- 172.21.15.80:0/2301894393 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fefe806ac90 0x7fefe806d150 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7feff4009df0 tx=0x7feff4009830 comp rx=0 tx=0).stop 2024-05-08T21:14:31.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:31.501+0000 7ff001e3b700 1 -- 172.21.15.80:0/2301894393 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feffc153490 msgr2=0x7feffc15f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:31.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:31.501+0000 7ff001e3b700 1 --2- 172.21.15.80:0/2301894393 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feffc153490 0x7feffc15f8c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fefec00b3e0 tx=0x7fefec00b6f0 comp rx=0 tx=0).stop 2024-05-08T21:14:31.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:31.502+0000 7ff001e3b700 1 -- 172.21.15.80:0/2301894393 shutdown_connections 2024-05-08T21:14:31.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:31.502+0000 7ff001e3b700 1 --2- 172.21.15.80:0/2301894393 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fefe806ac90 0x7fefe806d150 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:31.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:31.502+0000 7ff001e3b700 1 --2- 172.21.15.80:0/2301894393 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feffc1f4d60 0x7feffc14d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:31.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:31.502+0000 7ff001e3b700 1 --2- 172.21.15.80:0/2301894393 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fefe4005210 0x7feffc1f8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:31.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:31.502+0000 7ff001e3b700 1 --2- 172.21.15.80:0/2301894393 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feffc153490 0x7feffc15f8c0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:31.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:31.502+0000 7ff001e3b700 1 -- 172.21.15.80:0/2301894393 >> 172.21.15.80:0/2301894393 conn(0x7feffc070020 msgr2=0x7feffc0ca2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:14:31.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:31.502+0000 7ff001e3b700 1 -- 172.21.15.80:0/2301894393 shutdown_connections 2024-05-08T21:14:31.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:31.502+0000 7ff001e3b700 1 -- 172.21.15.80:0/2301894393 wait complete. 2024-05-08T21:14:31.510 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 15 2024-05-08T21:14:31.536 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-05-08T21:14:33.537 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:14:34.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:34.090+0000 7fa40b163700 1 Processor -- start 2024-05-08T21:14:34.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:34.090+0000 7fa40b163700 1 -- start start 2024-05-08T21:14:34.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:34.091+0000 7fa40b163700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa40415abe0 0x7fa404165af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:34.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:34.091+0000 7fa40b163700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa40415b050 con 0x7fa4040cbe40 2024-05-08T21:14:34.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:34.091+0000 7fa40b163700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4040cad60 con 0x7fa404154580 2024-05-08T21:14:34.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:34.091+0000 7fa40b163700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4040b2c60 con 0x7fa40415abe0 2024-05-08T21:14:34.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:34.092+0000 7fa403fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fa4040cbe40 0x7fa4040cc3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37108/0 (socket says 172.21.15.80:37108) 2024-05-08T21:14:34.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:34.092+0000 7fa403fff700 1 -- 172.21.15.80:0/4194544521 learned_addr learned my addr 172.21.15.80:0/4194544521 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:14:34.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:34.092+0000 7fa409700700 1 --2- 172.21.15.80:0/4194544521 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa40415abe0 0x7fa404165af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:34.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:34.093+0000 7fa409700700 1 -- 172.21.15.80:0/4194544521 >> v1:172.21.15.106:6789/0 conn(0x7fa404154580 legacy=0x7fa4040c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:34.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:34.093+0000 7fa409700700 1 -- 172.21.15.80:0/4194544521 >> v1:172.21.15.80:6789/0 conn(0x7fa4040cbe40 legacy=0x7fa4040cc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:34.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:34.094+0000 7fa409700700 1 -- 172.21.15.80:0/4194544521 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa40415d930 con 0x7fa40415abe0 2024-05-08T21:14:34.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:34.094+0000 7fa409700700 1 --2- 172.21.15.80:0/4194544521 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa40415abe0 0x7fa404165af0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc009dc0 tx=0x7fa3fc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21bd6a082e036438 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:14:34.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:34.095+0000 7fa4037fe700 1 -- 172.21.15.80:0/4194544521 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3fc00e070 con 0x7fa40415abe0 2024-05-08T21:14:34.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:34.095+0000 7fa4037fe700 1 -- 172.21.15.80:0/4194544521 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3fc00bad0 con 0x7fa40415abe0 2024-05-08T21:14:34.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:34.095+0000 7fa4037fe700 1 -- 172.21.15.80:0/4194544521 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3fc00be60 con 0x7fa40415abe0 2024-05-08T21:14:34.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:34.096+0000 7fa40b163700 1 -- 172.21.15.80:0/4194544521 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa40415abe0 msgr2=0x7fa404165af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:34.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:34.096+0000 7fa40b163700 1 --2- 172.21.15.80:0/4194544521 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa40415abe0 0x7fa404165af0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc009dc0 tx=0x7fa3fc00b330 comp rx=0 tx=0).stop 2024-05-08T21:14:34.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:34.097+0000 7fa40b163700 1 -- 172.21.15.80:0/4194544521 shutdown_connections 2024-05-08T21:14:34.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:34.097+0000 7fa40b163700 1 --2- 172.21.15.80:0/4194544521 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa40415abe0 0x7fa404165af0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:34.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:34.097+0000 7fa40b163700 1 -- 172.21.15.80:0/4194544521 >> 172.21.15.80:0/4194544521 conn(0x7fa40406c6a0 msgr2=0x7fa40406cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:14:34.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:34.098+0000 7fa40b163700 1 -- 172.21.15.80:0/4194544521 shutdown_connections 2024-05-08T21:14:34.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:34.099+0000 7fa40b163700 1 -- 172.21.15.80:0/4194544521 wait complete. 2024-05-08T21:14:34.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:34.101+0000 7fa40b163700 1 Processor -- start 2024-05-08T21:14:34.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:34.102+0000 7fa40b163700 1 -- start start 2024-05-08T21:14:34.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:34.103+0000 7fa40b163700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa4040cbe40 0x7fa404150690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:34.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:34.103+0000 7fa40b163700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa404154580 0x7fa4040c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:34.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:34.103+0000 7fa40b163700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa40415abe0 0x7fa4040c8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:34.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:34.103+0000 7fa40b163700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa40415d750 con 0x7fa40415abe0 2024-05-08T21:14:34.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:34.103+0000 7fa40b163700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4041fda50 con 0x7fa404154580 2024-05-08T21:14:34.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:34.103+0000 7fa40b163700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4040c7f40 con 0x7fa4040cbe40 2024-05-08T21:14:34.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:34.104+0000 7fa408eff700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa4040cbe40 0x7fa404150690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:34.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:34.104+0000 7fa408eff700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa4040cbe40 0x7fa404150690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:35972/0 (socket says 172.21.15.80:35972) 2024-05-08T21:14:34.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:34.104+0000 7fa408eff700 1 -- 172.21.15.80:0/4117878245 learned_addr learned my addr 172.21.15.80:0/4117878245 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:14:34.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:34.105+0000 7fa408eff700 1 -- 172.21.15.80:0/4117878245 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa404154580 msgr2=0x7fa4040c83d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T21:14:34.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:34.105+0000 7fa408eff700 1 --2- 172.21.15.80:0/4117878245 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa404154580 0x7fa4040c83d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:34.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:34.105+0000 7fa408eff700 1 -- 172.21.15.80:0/4117878245 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa40415abe0 msgr2=0x7fa4040c8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:34.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:34.105+0000 7fa408eff700 1 --2- 172.21.15.80:0/4117878245 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa40415abe0 0x7fa4040c8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:34.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:34.105+0000 7fa408eff700 1 -- 172.21.15.80:0/4117878245 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3fc009a70 con 0x7fa4040cbe40 2024-05-08T21:14:34.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:34.105+0000 7fa408eff700 1 --2- 172.21.15.80:0/4117878245 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa4040cbe40 0x7fa404150690 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa3f400c730 tx=0x7fa3f400caf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:14:34.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:34.105+0000 7fa4017fa700 1 -- 172.21.15.80:0/4117878245 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f40054e0 con 0x7fa4040cbe40 2024-05-08T21:14:34.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:34.105+0000 7fa4017fa700 1 -- 172.21.15.80:0/4117878245 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3f4003680 con 0x7fa4040cbe40 2024-05-08T21:14:34.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:34.105+0000 7fa4017fa700 1 -- 172.21.15.80:0/4117878245 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f4003a30 con 0x7fa4040cbe40 2024-05-08T21:14:34.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:34.105+0000 7fa40b163700 1 -- 172.21.15.80:0/4117878245 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4041fced0 con 0x7fa4040cbe40 2024-05-08T21:14:34.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:34.105+0000 7fa40b163700 1 -- 172.21.15.80:0/4117878245 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4041fd490 con 0x7fa4040cbe40 2024-05-08T21:14:34.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:34.107+0000 7fa40b163700 1 -- 172.21.15.80:0/4117878245 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa40404ec60 con 0x7fa4040cbe40 2024-05-08T21:14:34.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:34.107+0000 7fa4017fa700 1 -- 172.21.15.80:0/4117878245 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa3f4003b90 con 0x7fa4040cbe40 2024-05-08T21:14:34.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:34.108+0000 7fa4017fa700 1 --2- 172.21.15.80:0/4117878245 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fa3ec06aea0 0x7fa3ec06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:34.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:34.108+0000 7fa4017fa700 1 -- 172.21.15.80:0/4117878245 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6749+0+0 (secure 0 0 0) 0x7fa3f4088cd0 con 0x7fa4040cbe40 2024-05-08T21:14:34.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:34.111+0000 7fa403fff700 1 --2- 172.21.15.80:0/4117878245 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fa3ec06aea0 0x7fa3ec06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:34.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:34.112+0000 7fa403fff700 1 --2- 172.21.15.80:0/4117878245 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fa3ec06aea0 0x7fa3ec06d360 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa40414e990 tx=0x7fa3f8007a30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:14:34.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:34.115+0000 7fa4017fa700 1 -- 172.21.15.80:0/4117878245 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fa3f408e020 con 0x7fa4040cbe40 2024-05-08T21:14:34.595 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:14:34.595 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4990,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/1499761952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1499761952},{"type":"v1","addr":"172.21.15.106:6836","nonce":1499761952}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:12:21.380279+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":39,"addr":"172.21.15.106:6833/2289230272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":2289230272},{"type":"v1","addr":"172.21.15.106:6833","nonce":2289230272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:14:34.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:34.590+0000 7fa40b163700 1 -- 172.21.15.80:0/4117878245 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa4040c7d10 con 0x7fa4040cbe40 2024-05-08T21:14:34.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:34.591+0000 7fa4017fa700 1 -- 172.21.15.80:0/4117878245 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+6258 (secure 0 0 0) 0x7fa3f4017020 con 0x7fa4040cbe40 2024-05-08T21:14:34.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:34.595+0000 7fa40b163700 1 -- 172.21.15.80:0/4117878245 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fa3ec06aea0 msgr2=0x7fa3ec06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:34.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:34.595+0000 7fa40b163700 1 --2- 172.21.15.80:0/4117878245 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fa3ec06aea0 0x7fa3ec06d360 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa40414e990 tx=0x7fa3f8007a30 comp rx=0 tx=0).stop 2024-05-08T21:14:34.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:34.595+0000 7fa40b163700 1 -- 172.21.15.80:0/4117878245 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa4040cbe40 msgr2=0x7fa404150690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:34.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:34.595+0000 7fa40b163700 1 --2- 172.21.15.80:0/4117878245 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa4040cbe40 0x7fa404150690 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa3f400c730 tx=0x7fa3f400caf0 comp rx=0 tx=0).stop 2024-05-08T21:14:34.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:34.596+0000 7fa40b163700 1 -- 172.21.15.80:0/4117878245 shutdown_connections 2024-05-08T21:14:34.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:34.596+0000 7fa40b163700 1 --2- 172.21.15.80:0/4117878245 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fa3ec06aea0 0x7fa3ec06d360 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:34.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:34.596+0000 7fa40b163700 1 --2- 172.21.15.80:0/4117878245 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa40415abe0 0x7fa4040c8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:34.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:34.596+0000 7fa40b163700 1 --2- 172.21.15.80:0/4117878245 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa4040cbe40 0x7fa404150690 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:34.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:34.596+0000 7fa40b163700 1 --2- 172.21.15.80:0/4117878245 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa404154580 0x7fa4040c83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:34.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:34.596+0000 7fa40b163700 1 -- 172.21.15.80:0/4117878245 >> 172.21.15.80:0/4117878245 conn(0x7fa40406c6a0 msgr2=0x7fa4040c5150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:14:34.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:34.596+0000 7fa40b163700 1 -- 172.21.15.80:0/4117878245 shutdown_connections 2024-05-08T21:14:34.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:34.596+0000 7fa40b163700 1 -- 172.21.15.80:0/4117878245 wait complete. 2024-05-08T21:14:34.601 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 15 2024-05-08T21:14:34.626 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-05-08T21:14:36.628 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:14:37.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.024+0000 7f1e6b133700 1 Processor -- start 2024-05-08T21:14:37.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.024+0000 7f1e6b133700 1 -- start start 2024-05-08T21:14:37.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.025+0000 7f1e6b133700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1e640c7420 0x7f1e640c2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:37.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.025+0000 7f1e6b133700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e640c6f30 con 0x7f1e6406b0d0 2024-05-08T21:14:37.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.025+0000 7f1e6b133700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e6415e7d0 con 0x7f1e640c8180 2024-05-08T21:14:37.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.025+0000 7f1e6b133700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e6415eab0 con 0x7f1e640c7420 2024-05-08T21:14:37.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.026+0000 7f1e63fff700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f1e640c8180 0x7f1e6406a9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.80:55814/0 (socket says 172.21.15.80:55814) 2024-05-08T21:14:37.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.026+0000 7f1e63fff700 1 -- 172.21.15.80:0/187145251 learned_addr learned my addr 172.21.15.80:0/187145251 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:14:37.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.027+0000 7f1e68ecf700 1 --2- 172.21.15.80:0/187145251 >> v2:172.21.15.106:3300/0 conn(0x7f1e640c7420 0x7f1e640c2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:37.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.028+0000 7f1e637fe700 1 -- 172.21.15.80:0/187145251 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2369618073 0 0) 0x7f1e640c6f30 con 0x7f1e6406b0d0 2024-05-08T21:14:37.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.028+0000 7f1e637fe700 1 -- 172.21.15.80:0/187145251 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e4c0035b0 con 0x7f1e6406b0d0 2024-05-08T21:14:37.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.028+0000 7f1e637fe700 1 -- 172.21.15.80:0/187145251 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2901112324 0 0) 0x7f1e6415e7d0 con 0x7f1e640c8180 2024-05-08T21:14:37.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.028+0000 7f1e637fe700 1 -- 172.21.15.80:0/187145251 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e640c6f30 con 0x7f1e640c8180 2024-05-08T21:14:37.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.028+0000 7f1e637fe700 1 -- 172.21.15.80:0/187145251 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 839527437 0 0) 0x7f1e4c0035b0 con 0x7f1e6406b0d0 2024-05-08T21:14:37.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.028+0000 7f1e637fe700 1 -- 172.21.15.80:0/187145251 >> v2:172.21.15.106:3300/0 conn(0x7f1e640c7420 msgr2=0x7f1e640c2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:14:37.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.028+0000 7f1e637fe700 1 --2- 172.21.15.80:0/187145251 >> v2:172.21.15.106:3300/0 conn(0x7f1e640c7420 0x7f1e640c2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:37.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.028+0000 7f1e637fe700 1 -- 172.21.15.80:0/187145251 >> v1:172.21.15.106:6789/0 conn(0x7f1e640c8180 legacy=0x7f1e6406a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:37.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.028+0000 7f1e637fe700 1 -- 172.21.15.80:0/187145251 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e6415ed90 con 0x7f1e6406b0d0 2024-05-08T21:14:37.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.028+0000 7f1e637fe700 1 -- 172.21.15.80:0/187145251 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3520646302 0 0) 0x7f1e5c0019f0 con 0x7f1e6406b0d0 2024-05-08T21:14:37.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.028+0000 7f1e637fe700 1 -- 172.21.15.80:0/187145251 >> v1:172.21.15.80:6789/0 conn(0x7f1e6406b0d0 legacy=0x7f1e64168f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:37.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.029+0000 7f1e637fe700 1 --2- 172.21.15.80:0/187145251 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1e4c003b90 0x7f1e4c003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:37.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.029+0000 7f1e637fe700 1 --2- 172.21.15.80:0/187145251 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1e4c004850 0x7f1e4c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:37.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.029+0000 7f1e637fe700 1 --2- 172.21.15.80:0/187145251 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e4c005210 0x7f1e4c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:37.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.029+0000 7f1e637fe700 1 -- 172.21.15.80:0/187145251 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6415eab0 con 0x7f1e4c005210 2024-05-08T21:14:37.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.029+0000 7f1e637fe700 1 -- 172.21.15.80:0/187145251 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4c00bf80 con 0x7f1e4c004850 2024-05-08T21:14:37.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.029+0000 7f1e637fe700 1 -- 172.21.15.80:0/187145251 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4c00c140 con 0x7f1e4c003b90 2024-05-08T21:14:37.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.029+0000 7f1e696d0700 1 --2- 172.21.15.80:0/187145251 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e4c005210 0x7f1e4c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:37.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.030+0000 7f1e68ecf700 1 --2- 172.21.15.80:0/187145251 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1e4c003b90 0x7f1e4c003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:37.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.030+0000 7f1e696d0700 1 -- 172.21.15.80:0/187145251 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1e4c003b90 msgr2=0x7f1e4c003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:14:37.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.030+0000 7f1e696d0700 1 --2- 172.21.15.80:0/187145251 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1e4c003b90 0x7f1e4c003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:37.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.030+0000 7f1e696d0700 1 -- 172.21.15.80:0/187145251 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1e4c004850 msgr2=0x7f1e4c004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:14:37.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.030+0000 7f1e696d0700 1 --2- 172.21.15.80:0/187145251 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1e4c004850 0x7f1e4c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:37.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.030+0000 7f1e696d0700 1 -- 172.21.15.80:0/187145251 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e6415ed90 con 0x7f1e4c005210 2024-05-08T21:14:37.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.030+0000 7f1e696d0700 1 -- 172.21.15.80:0/187145251 reap_dead start 2024-05-08T21:14:37.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.031+0000 7f1e696d0700 1 --2- 172.21.15.80:0/187145251 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e4c005210 0x7f1e4c00ba10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c00a8b0 tx=0x7f1e4c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2824fb3c87414177 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:14:37.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.031+0000 7f1e637fe700 1 -- 172.21.15.80:0/187145251 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c016070 con 0x7f1e4c005210 2024-05-08T21:14:37.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.031+0000 7f1e637fe700 1 -- 172.21.15.80:0/187145251 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e5c012440 con 0x7f1e4c005210 2024-05-08T21:14:37.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.031+0000 7f1e637fe700 1 -- 172.21.15.80:0/187145251 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c012810 con 0x7f1e4c005210 2024-05-08T21:14:37.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.032+0000 7f1e6b133700 1 -- 172.21.15.80:0/187145251 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e4c005210 msgr2=0x7f1e4c00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:37.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.032+0000 7f1e6b133700 1 --2- 172.21.15.80:0/187145251 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e4c005210 0x7f1e4c00ba10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c00a8b0 tx=0x7f1e4c005880 comp rx=0 tx=0).stop 2024-05-08T21:14:37.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.051+0000 7f1e6b133700 1 -- 172.21.15.80:0/187145251 shutdown_connections 2024-05-08T21:14:37.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.051+0000 7f1e6b133700 1 --2- 172.21.15.80:0/187145251 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e4c005210 0x7f1e4c00ba10 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:37.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.051+0000 7f1e6b133700 1 -- 172.21.15.80:0/187145251 >> 172.21.15.80:0/187145251 conn(0x7f1e640c8980 msgr2=0x7f1e640c8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:14:37.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.052+0000 7f1e6b133700 1 -- 172.21.15.80:0/187145251 shutdown_connections 2024-05-08T21:14:37.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.053+0000 7f1e6b133700 1 -- 172.21.15.80:0/187145251 wait complete. 2024-05-08T21:14:37.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.054+0000 7f1e6b133700 1 Processor -- start 2024-05-08T21:14:37.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.057+0000 7f1e6b133700 1 -- start start 2024-05-08T21:14:37.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.058+0000 7f1e6b133700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1e4c005210 0x7f1e64073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:37.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.058+0000 7f1e6b133700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e64156840 0x7f1e641f7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:37.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.058+0000 7f1e6b133700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1e6414b180 0x7f1e6414b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:37.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.058+0000 7f1e6b133700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e641f79a0 con 0x7f1e64156840 2024-05-08T21:14:37.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.058+0000 7f1e6b133700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e64073680 con 0x7f1e4c005210 2024-05-08T21:14:37.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.058+0000 7f1e6b133700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e641f4d80 con 0x7f1e6414b180 2024-05-08T21:14:37.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.058+0000 7f1e696d0700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1e6414b180 0x7f1e6414b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:37.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.058+0000 7f1e63fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e64156840 0x7f1e641f7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:37.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.058+0000 7f1e63fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e64156840 0x7f1e641f7e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51120/0 (socket says 172.21.15.80:51120) 2024-05-08T21:14:37.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.058+0000 7f1e63fff700 1 -- 172.21.15.80:0/4034429136 learned_addr learned my addr 172.21.15.80:0/4034429136 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:14:37.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.058+0000 7f1e68ecf700 1 --2- 172.21.15.80:0/4034429136 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1e4c005210 0x7f1e64073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:37.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.059+0000 7f1e63fff700 1 -- 172.21.15.80:0/4034429136 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1e6414b180 msgr2=0x7f1e6414b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:37.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.059+0000 7f1e63fff700 1 --2- 172.21.15.80:0/4034429136 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1e6414b180 0x7f1e6414b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:37.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.059+0000 7f1e63fff700 1 -- 172.21.15.80:0/4034429136 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1e4c005210 msgr2=0x7f1e64073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:37.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.059+0000 7f1e63fff700 1 --2- 172.21.15.80:0/4034429136 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1e4c005210 0x7f1e64073140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:37.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.059+0000 7f1e63fff700 1 -- 172.21.15.80:0/4034429136 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e64072bc0 con 0x7f1e64156840 2024-05-08T21:14:37.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.059+0000 7f1e63fff700 1 --2- 172.21.15.80:0/4034429136 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e64156840 0x7f1e641f7e30 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1e5800c760 tx=0x7f1e5800cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:14:37.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.060+0000 7f1e617fa700 1 -- 172.21.15.80:0/4034429136 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e58004c80 con 0x7f1e64156840 2024-05-08T21:14:37.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.060+0000 7f1e617fa700 1 -- 172.21.15.80:0/4034429136 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e58004de0 con 0x7f1e64156840 2024-05-08T21:14:37.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.060+0000 7f1e617fa700 1 -- 172.21.15.80:0/4034429136 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e580072f0 con 0x7f1e64156840 2024-05-08T21:14:37.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.060+0000 7f1e6b133700 1 -- 172.21.15.80:0/4034429136 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e64072ea0 con 0x7f1e64156840 2024-05-08T21:14:37.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.060+0000 7f1e6b133700 1 -- 172.21.15.80:0/4034429136 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e6415bee0 con 0x7f1e64156840 2024-05-08T21:14:37.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.061+0000 7f1e6b133700 1 -- 172.21.15.80:0/4034429136 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e6404ec60 con 0x7f1e64156840 2024-05-08T21:14:37.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.068+0000 7f1e617fa700 1 -- 172.21.15.80:0/4034429136 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1e58007450 con 0x7f1e64156840 2024-05-08T21:14:37.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.068+0000 7f1e617fa700 1 --2- 172.21.15.80:0/4034429136 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f1e5006ac90 0x7f1e5006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:37.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.068+0000 7f1e617fa700 1 -- 172.21.15.80:0/4034429136 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f1e580898c0 con 0x7f1e64156840 2024-05-08T21:14:37.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.073+0000 7f1e68ecf700 1 --2- 172.21.15.80:0/4034429136 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f1e5006ac90 0x7f1e5006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:37.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.073+0000 7f1e68ecf700 1 --2- 172.21.15.80:0/4034429136 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f1e5006ac90 0x7f1e5006d150 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1e640647e0 tx=0x7f1e54008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:14:37.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.074+0000 7f1e617fa700 1 -- 172.21.15.80:0/4034429136 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f1e580546a0 con 0x7f1e64156840 2024-05-08T21:14:37.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.586+0000 7f1e6b133700 1 -- 172.21.15.80:0/4034429136 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1e640c2010 con 0x7f1e64156840 2024-05-08T21:14:37.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.591+0000 7f1e617fa700 1 -- 172.21.15.80:0/4034429136 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+6258 (secure 0 0 0) 0x7f1e58007700 con 0x7f1e64156840 2024-05-08T21:14:37.598 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:14:37.598 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4990,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/1499761952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1499761952},{"type":"v1","addr":"172.21.15.106:6836","nonce":1499761952}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:12:21.380279+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":39,"addr":"172.21.15.106:6833/2289230272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":2289230272},{"type":"v1","addr":"172.21.15.106:6833","nonce":2289230272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:14:37.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.597+0000 7f1e6b133700 1 -- 172.21.15.80:0/4034429136 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f1e5006ac90 msgr2=0x7f1e5006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:37.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.597+0000 7f1e6b133700 1 --2- 172.21.15.80:0/4034429136 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f1e5006ac90 0x7f1e5006d150 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1e640647e0 tx=0x7f1e54008040 comp rx=0 tx=0).stop 2024-05-08T21:14:37.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.597+0000 7f1e6b133700 1 -- 172.21.15.80:0/4034429136 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e64156840 msgr2=0x7f1e641f7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:37.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.597+0000 7f1e6b133700 1 --2- 172.21.15.80:0/4034429136 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e64156840 0x7f1e641f7e30 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1e5800c760 tx=0x7f1e5800cb20 comp rx=0 tx=0).stop 2024-05-08T21:14:37.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.597+0000 7f1e6b133700 1 -- 172.21.15.80:0/4034429136 shutdown_connections 2024-05-08T21:14:37.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.597+0000 7f1e6b133700 1 --2- 172.21.15.80:0/4034429136 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f1e5006ac90 0x7f1e5006d150 secure :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1e640647e0 tx=0x7f1e54008040 comp rx=0 tx=0).stop 2024-05-08T21:14:37.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.597+0000 7f1e6b133700 1 --2- 172.21.15.80:0/4034429136 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1e6414b180 0x7f1e6414b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:37.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.597+0000 7f1e6b133700 1 --2- 172.21.15.80:0/4034429136 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1e4c005210 0x7f1e64073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:37.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.597+0000 7f1e6b133700 1 --2- 172.21.15.80:0/4034429136 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e64156840 0x7f1e641f7e30 secure :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1e5800c760 tx=0x7f1e5800cb20 comp rx=0 tx=0).stop 2024-05-08T21:14:37.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.597+0000 7f1e6b133700 1 -- 172.21.15.80:0/4034429136 >> 172.21.15.80:0/4034429136 conn(0x7f1e640c8980 msgr2=0x7f1e640c7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:14:37.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.599+0000 7f1e6b133700 1 -- 172.21.15.80:0/4034429136 shutdown_connections 2024-05-08T21:14:37.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:37.599+0000 7f1e6b133700 1 -- 172.21.15.80:0/4034429136 wait complete. 2024-05-08T21:14:37.607 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 15 2024-05-08T21:14:37.628 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-05-08T21:14:39.629 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:14:39.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:39.853+0000 7f2dafea6700 1 Processor -- start 2024-05-08T21:14:39.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:39.853+0000 7f2dafea6700 1 -- start start 2024-05-08T21:14:39.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:39.854+0000 7f2dafea6700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f2da81520b0 0x7f2da8158810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:39.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:39.854+0000 7f2dafea6700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2da8158d50 0x7f2da8072d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:39.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:39.854+0000 7f2dafea6700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2da815b6d0 con 0x7f2da80732c0 2024-05-08T21:14:39.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:39.854+0000 7f2dafea6700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2da81580e0 con 0x7f2da8158d50 2024-05-08T21:14:39.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:39.854+0000 7f2dafea6700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2da815c650 con 0x7f2da81520b0 2024-05-08T21:14:39.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:39.854+0000 7f2dad441700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2da8158d50 0x7f2da8072d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:39.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:39.854+0000 7f2dadc42700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f2da81520b0 0x7f2da8158810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:39.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:39.854+0000 7f2dad441700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2da8158d50 0x7f2da8072d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51136/0 (socket says 172.21.15.80:51136) 2024-05-08T21:14:39.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:39.854+0000 7f2dad441700 1 -- 172.21.15.80:0/2906068017 learned_addr learned my addr 172.21.15.80:0/2906068017 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:14:39.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:39.855+0000 7f2dad441700 1 -- 172.21.15.80:0/2906068017 >> v2:172.21.15.106:3300/0 conn(0x7f2da81520b0 msgr2=0x7f2da8158810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:14:39.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:39.855+0000 7f2dad441700 1 --2- 172.21.15.80:0/2906068017 >> v2:172.21.15.106:3300/0 conn(0x7f2da81520b0 0x7f2da8158810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:39.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:39.855+0000 7f2dad441700 1 -- 172.21.15.80:0/2906068017 >> v1:172.21.15.106:6789/0 conn(0x7f2da80732c0 legacy=0x7f2da80cbba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:39.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:39.855+0000 7f2dad441700 1 -- 172.21.15.80:0/2906068017 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2da80c5cd0 con 0x7f2da8158d50 2024-05-08T21:14:39.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:39.855+0000 7f2dadc42700 1 --2- 172.21.15.80:0/2906068017 >> v2:172.21.15.106:3300/0 conn(0x7f2da81520b0 0x7f2da8158810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:14:39.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:39.855+0000 7f2dad441700 1 --2- 172.21.15.80:0/2906068017 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2da8158d50 0x7f2da8072d80 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2da80ce660 tx=0x7f2d98009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e7cd19ccf59a7f6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:14:39.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:39.855+0000 7f2dacc40700 1 -- 172.21.15.80:0/2906068017 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d98011830 con 0x7f2da8158d50 2024-05-08T21:14:39.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:39.855+0000 7f2dacc40700 1 -- 172.21.15.80:0/2906068017 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d98011990 con 0x7f2da8158d50 2024-05-08T21:14:39.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:39.855+0000 7f2dacc40700 1 -- 172.21.15.80:0/2906068017 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d98011d20 con 0x7f2da8158d50 2024-05-08T21:14:39.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:39.856+0000 7f2dafea6700 1 -- 172.21.15.80:0/2906068017 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2da8158d50 msgr2=0x7f2da8072d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:39.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:39.856+0000 7f2dafea6700 1 --2- 172.21.15.80:0/2906068017 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2da8158d50 0x7f2da8072d80 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2da80ce660 tx=0x7f2d98009bd0 comp rx=0 tx=0).stop 2024-05-08T21:14:39.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:39.856+0000 7f2dafea6700 1 -- 172.21.15.80:0/2906068017 shutdown_connections 2024-05-08T21:14:39.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:39.856+0000 7f2dafea6700 1 --2- 172.21.15.80:0/2906068017 >> v2:172.21.15.106:3300/0 conn(0x7f2da81520b0 0x7f2da8158810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:39.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:39.856+0000 7f2dafea6700 1 --2- 172.21.15.80:0/2906068017 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2da8158d50 0x7f2da8072d80 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:39.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:39.856+0000 7f2dafea6700 1 -- 172.21.15.80:0/2906068017 >> 172.21.15.80:0/2906068017 conn(0x7f2da8066780 msgr2=0x7f2da8066b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:14:39.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:39.856+0000 7f2dafea6700 1 -- 172.21.15.80:0/2906068017 shutdown_connections 2024-05-08T21:14:39.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:39.856+0000 7f2dafea6700 1 -- 172.21.15.80:0/2906068017 wait complete. 2024-05-08T21:14:39.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:39.857+0000 7f2dafea6700 1 Processor -- start 2024-05-08T21:14:39.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:39.861+0000 7f2dafea6700 1 -- start start 2024-05-08T21:14:39.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:39.863+0000 7f2dafea6700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2da80732c0 0x7f2da814ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:39.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:39.863+0000 7f2dafea6700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2da81520b0 0x7f2da806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:39.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:39.863+0000 7f2dafea6700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2da8158d50 0x7f2da81f7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:39.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:39.863+0000 7f2dafea6700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da8149a70 con 0x7f2da8158d50 2024-05-08T21:14:39.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:39.863+0000 7f2dafea6700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da81f71d0 con 0x7f2da80732c0 2024-05-08T21:14:39.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:39.863+0000 7f2dafea6700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2da8148040 con 0x7f2da81520b0 2024-05-08T21:14:39.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:39.864+0000 7f2dae443700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2da8158d50 0x7f2da81f7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:39.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:39.864+0000 7f2dad441700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2da81520b0 0x7f2da806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:39.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:39.864+0000 7f2dae443700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2da8158d50 0x7f2da81f7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51140/0 (socket says 172.21.15.80:51140) 2024-05-08T21:14:39.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:39.864+0000 7f2dae443700 1 -- 172.21.15.80:0/4282743300 learned_addr learned my addr 172.21.15.80:0/4282743300 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:14:39.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:39.865+0000 7f2dae443700 1 -- 172.21.15.80:0/4282743300 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2da81520b0 msgr2=0x7f2da806d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:39.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:39.865+0000 7f2dae443700 1 --2- 172.21.15.80:0/4282743300 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2da81520b0 0x7f2da806d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:39.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:39.865+0000 7f2dae443700 1 -- 172.21.15.80:0/4282743300 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2da80732c0 msgr2=0x7f2da814ce20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T21:14:39.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:39.865+0000 7f2dae443700 1 --2- 172.21.15.80:0/4282743300 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2da80732c0 0x7f2da814ce20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:39.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:39.865+0000 7f2dae443700 1 -- 172.21.15.80:0/4282743300 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2da40094a0 con 0x7f2da8158d50 2024-05-08T21:14:39.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:39.865+0000 7f2dae443700 1 --2- 172.21.15.80:0/4282743300 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2da8158d50 0x7f2da81f7660 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f2da000cc50 tx=0x7f2da000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:14:39.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:39.865+0000 7f2d9e7fc700 1 -- 172.21.15.80:0/4282743300 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da0003c00 con 0x7f2da8158d50 2024-05-08T21:14:39.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:39.865+0000 7f2d9e7fc700 1 -- 172.21.15.80:0/4282743300 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2da0003d60 con 0x7f2da8158d50 2024-05-08T21:14:39.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:39.865+0000 7f2d9e7fc700 1 -- 172.21.15.80:0/4282743300 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da000ab60 con 0x7f2da8158d50 2024-05-08T21:14:39.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:39.867+0000 7f2dafea6700 1 -- 172.21.15.80:0/4282743300 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d98009550 con 0x7f2da8158d50 2024-05-08T21:14:39.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:39.867+0000 7f2dafea6700 1 -- 172.21.15.80:0/4282743300 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2da81485c0 con 0x7f2da8158d50 2024-05-08T21:14:39.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:39.869+0000 7f2dafea6700 1 -- 172.21.15.80:0/4282743300 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2da804ec60 con 0x7f2da8158d50 2024-05-08T21:14:39.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:39.870+0000 7f2d9e7fc700 1 -- 172.21.15.80:0/4282743300 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2da000acc0 con 0x7f2da8158d50 2024-05-08T21:14:39.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:39.870+0000 7f2d9e7fc700 1 --2- 172.21.15.80:0/4282743300 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f2d8c06ace0 0x7f2d8c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:39.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:39.871+0000 7f2d9e7fc700 1 -- 172.21.15.80:0/4282743300 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f2da00897a0 con 0x7f2da8158d50 2024-05-08T21:14:39.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:39.877+0000 7f2dadc42700 1 --2- 172.21.15.80:0/4282743300 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f2d8c06ace0 0x7f2d8c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:39.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:39.877+0000 7f2d9e7fc700 1 -- 172.21.15.80:0/4282743300 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f2da0054550 con 0x7f2da8158d50 2024-05-08T21:14:39.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:39.879+0000 7f2dadc42700 1 --2- 172.21.15.80:0/4282743300 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f2d8c06ace0 0x7f2d8c06d1a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2da4009c20 tx=0x7f2da4009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:14:40.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:40.384+0000 7f2dafea6700 1 -- 172.21.15.80:0/4282743300 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2da80ccb00 con 0x7f2da8158d50 2024-05-08T21:14:40.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:40.385+0000 7f2d9e7fc700 1 -- 172.21.15.80:0/4282743300 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+6258 (secure 0 0 0) 0x7f2da0057b70 con 0x7f2da8158d50 2024-05-08T21:14:40.387 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:14:40.388 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4990,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/1499761952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1499761952},{"type":"v1","addr":"172.21.15.106:6836","nonce":1499761952}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:12:21.380279+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":39,"addr":"172.21.15.106:6833/2289230272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":2289230272},{"type":"v1","addr":"172.21.15.106:6833","nonce":2289230272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:14:40.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:40.388+0000 7f2dafea6700 1 -- 172.21.15.80:0/4282743300 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f2d8c06ace0 msgr2=0x7f2d8c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:40.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:40.388+0000 7f2dafea6700 1 --2- 172.21.15.80:0/4282743300 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f2d8c06ace0 0x7f2d8c06d1a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2da4009c20 tx=0x7f2da4009210 comp rx=0 tx=0).stop 2024-05-08T21:14:40.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:40.388+0000 7f2dafea6700 1 -- 172.21.15.80:0/4282743300 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2da8158d50 msgr2=0x7f2da81f7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:40.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:40.388+0000 7f2dafea6700 1 --2- 172.21.15.80:0/4282743300 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2da8158d50 0x7f2da81f7660 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f2da000cc50 tx=0x7f2da000cf60 comp rx=0 tx=0).stop 2024-05-08T21:14:40.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:40.388+0000 7f2dafea6700 1 -- 172.21.15.80:0/4282743300 shutdown_connections 2024-05-08T21:14:40.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:40.388+0000 7f2dafea6700 1 --2- 172.21.15.80:0/4282743300 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f2d8c06ace0 0x7f2d8c06d1a0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:40.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:40.388+0000 7f2dafea6700 1 --2- 172.21.15.80:0/4282743300 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2da8158d50 0x7f2da81f7660 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:40.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:40.388+0000 7f2dafea6700 1 --2- 172.21.15.80:0/4282743300 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2da80732c0 0x7f2da814ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:40.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:40.388+0000 7f2dafea6700 1 --2- 172.21.15.80:0/4282743300 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2da81520b0 0x7f2da806d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:40.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:40.388+0000 7f2dafea6700 1 -- 172.21.15.80:0/4282743300 >> 172.21.15.80:0/4282743300 conn(0x7f2da8066780 msgr2=0x7f2da8066b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:14:40.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:40.388+0000 7f2dafea6700 1 -- 172.21.15.80:0/4282743300 shutdown_connections 2024-05-08T21:14:40.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:40.388+0000 7f2dafea6700 1 -- 172.21.15.80:0/4282743300 wait complete. 2024-05-08T21:14:40.392 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 15 2024-05-08T21:14:40.408 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-05-08T21:14:41.944 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:14:41.950 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:14:42.409 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:14:42.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.529+0000 7f432d6bb700 1 Processor -- start 2024-05-08T21:14:42.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.530+0000 7f432d6bb700 1 -- start start 2024-05-08T21:14:42.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.530+0000 7f432d6bb700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4328141450 0x7f432806dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:42.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.530+0000 7f432d6bb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4328158ab0 0x7f43281628e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:42.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.530+0000 7f432d6bb700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4328158f40 con 0x7f432806eff0 2024-05-08T21:14:42.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.530+0000 7f432d6bb700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43280c57f0 con 0x7f4328158ab0 2024-05-08T21:14:42.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.530+0000 7f432d6bb700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43280c5a40 con 0x7f4328141450 2024-05-08T21:14:42.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.530+0000 7f43277fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4328158ab0 0x7f43281628e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:42.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.530+0000 7f43277fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4328158ab0 0x7f43281628e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:56402/0 (socket says 172.21.15.80:56402) 2024-05-08T21:14:42.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.530+0000 7f43277fe700 1 -- 172.21.15.80:0/3264274273 learned_addr learned my addr 172.21.15.80:0/3264274273 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:14:42.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.531+0000 7f4326ffd700 1 --2- 172.21.15.80:0/3264274273 >> v2:172.21.15.106:3300/0 conn(0x7f4328141450 0x7f432806dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:42.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.531+0000 7f43277fe700 1 -- 172.21.15.80:0/3264274273 >> v2:172.21.15.106:3300/0 conn(0x7f4328141450 msgr2=0x7f432806dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:14:42.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.531+0000 7f43277fe700 1 --2- 172.21.15.80:0/3264274273 >> v2:172.21.15.106:3300/0 conn(0x7f4328141450 0x7f432806dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:42.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.531+0000 7f43277fe700 1 -- 172.21.15.80:0/3264274273 >> v1:172.21.15.106:6789/0 conn(0x7f432806eff0 legacy=0x7f43280c7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:42.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.531+0000 7f43277fe700 1 -- 172.21.15.80:0/3264274273 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43280cae60 con 0x7f4328158ab0 2024-05-08T21:14:42.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.531+0000 7f43277fe700 1 --2- 172.21.15.80:0/3264274273 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4328158ab0 0x7f43281628e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4328070080 tx=0x7f432000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1faa4ec5cd8a795e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:14:42.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.531+0000 7f4325ffb700 1 -- 172.21.15.80:0/3264274273 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432000e070 con 0x7f4328158ab0 2024-05-08T21:14:42.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.531+0000 7f4325ffb700 1 -- 172.21.15.80:0/3264274273 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f432000b910 con 0x7f4328158ab0 2024-05-08T21:14:42.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.531+0000 7f4325ffb700 1 -- 172.21.15.80:0/3264274273 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432000bcc0 con 0x7f4328158ab0 2024-05-08T21:14:42.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.531+0000 7f432d6bb700 1 -- 172.21.15.80:0/3264274273 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4328158ab0 msgr2=0x7f43281628e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:42.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.531+0000 7f432d6bb700 1 --2- 172.21.15.80:0/3264274273 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4328158ab0 0x7f43281628e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4328070080 tx=0x7f432000b330 comp rx=0 tx=0).stop 2024-05-08T21:14:42.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.532+0000 7f432d6bb700 1 -- 172.21.15.80:0/3264274273 shutdown_connections 2024-05-08T21:14:42.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.532+0000 7f432d6bb700 1 --2- 172.21.15.80:0/3264274273 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4328158ab0 0x7f43281628e0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:42.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.532+0000 7f432d6bb700 1 --2- 172.21.15.80:0/3264274273 >> v2:172.21.15.106:3300/0 conn(0x7f4328141450 0x7f432806dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:42.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.532+0000 7f432d6bb700 1 -- 172.21.15.80:0/3264274273 >> 172.21.15.80:0/3264274273 conn(0x7f43280ca340 msgr2=0x7f43280ca750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:14:42.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.532+0000 7f432d6bb700 1 -- 172.21.15.80:0/3264274273 shutdown_connections 2024-05-08T21:14:42.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.532+0000 7f432d6bb700 1 -- 172.21.15.80:0/3264274273 wait complete. 2024-05-08T21:14:42.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.533+0000 7f432d6bb700 1 Processor -- start 2024-05-08T21:14:42.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.533+0000 7f432d6bb700 1 -- start start 2024-05-08T21:14:42.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.534+0000 7f432d6bb700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f432806eff0 0x7f43281ee9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:42.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.534+0000 7f432d6bb700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4328141450 0x7f43281eef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:42.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.534+0000 7f432d6bb700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4328158ab0 0x7f43281f0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:42.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.534+0000 7f432d6bb700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43281392e0 con 0x7f432806eff0 2024-05-08T21:14:42.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.534+0000 7f432d6bb700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f432813d6b0 con 0x7f4328158ab0 2024-05-08T21:14:42.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.534+0000 7f432d6bb700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f432813d970 con 0x7f4328141450 2024-05-08T21:14:42.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.534+0000 7f4326ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f432806eff0 0x7f43281ee9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:42.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.534+0000 7f4326ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f432806eff0 0x7f43281ee9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:56412/0 (socket says 172.21.15.80:56412) 2024-05-08T21:14:42.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.534+0000 7f4326ffd700 1 -- 172.21.15.80:0/1585444819 learned_addr learned my addr 172.21.15.80:0/1585444819 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:14:42.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.534+0000 7f43277fe700 1 --2- 172.21.15.80:0/1585444819 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4328158ab0 0x7f43281f0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:42.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.534+0000 7f43267fc700 1 --2- 172.21.15.80:0/1585444819 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4328141450 0x7f43281eef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:42.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.534+0000 7f4326ffd700 1 -- 172.21.15.80:0/1585444819 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4328141450 msgr2=0x7f43281eef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:42.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.534+0000 7f4326ffd700 1 --2- 172.21.15.80:0/1585444819 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4328141450 0x7f43281eef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:42.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.534+0000 7f4326ffd700 1 -- 172.21.15.80:0/1585444819 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4328158ab0 msgr2=0x7f43281f0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:42.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.534+0000 7f4326ffd700 1 --2- 172.21.15.80:0/1585444819 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4328158ab0 0x7f43281f0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:42.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.534+0000 7f4326ffd700 1 -- 172.21.15.80:0/1585444819 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4320009b30 con 0x7f432806eff0 2024-05-08T21:14:42.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.535+0000 7f4326ffd700 1 --2- 172.21.15.80:0/1585444819 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f432806eff0 0x7f43281ee9d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f431000e9b0 tx=0x7f431000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:14:42.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.535+0000 7f431f7fe700 1 -- 172.21.15.80:0/1585444819 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4310009710 con 0x7f432806eff0 2024-05-08T21:14:42.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.535+0000 7f431f7fe700 1 -- 172.21.15.80:0/1585444819 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f431000c850 con 0x7f432806eff0 2024-05-08T21:14:42.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.535+0000 7f432d6bb700 1 -- 172.21.15.80:0/1585444819 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f432813dc50 con 0x7f432806eff0 2024-05-08T21:14:42.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.535+0000 7f431f7fe700 1 -- 172.21.15.80:0/1585444819 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431000cbc0 con 0x7f432806eff0 2024-05-08T21:14:42.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.535+0000 7f432d6bb700 1 -- 172.21.15.80:0/1585444819 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f432813e210 con 0x7f432806eff0 2024-05-08T21:14:42.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.536+0000 7f432d6bb700 1 -- 172.21.15.80:0/1585444819 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f432813e540 con 0x7f432806eff0 2024-05-08T21:14:42.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.536+0000 7f431f7fe700 1 -- 172.21.15.80:0/1585444819 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f431000cd20 con 0x7f432806eff0 2024-05-08T21:14:42.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.537+0000 7f431f7fe700 1 --2- 172.21.15.80:0/1585444819 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f430806acc0 0x7f430806d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:42.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.537+0000 7f431f7fe700 1 -- 172.21.15.80:0/1585444819 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6835+0+0 (secure 0 0 0) 0x7f4310089820 con 0x7f432806eff0 2024-05-08T21:14:42.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.537+0000 7f43267fc700 1 --2- 172.21.15.80:0/1585444819 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f430806acc0 0x7f430806d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:42.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.537+0000 7f43267fc700 1 --2- 172.21.15.80:0/1585444819 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f430806acc0 0x7f430806d180 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4328157bd0 tx=0x7f4318009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:14:42.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.541+0000 7f431f7fe700 1 -- 172.21.15.80:0/1585444819 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f4310054590 con 0x7f432806eff0 2024-05-08T21:14:42.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.784+0000 7f432d6bb700 1 -- 172.21.15.80:0/1585444819 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f432804ec60 con 0x7f432806eff0 2024-05-08T21:14:42.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.785+0000 7f431f7fe700 1 -- 172.21.15.80:0/1585444819 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+5497 (secure 0 0 0) 0x7f4310057bb0 con 0x7f432806eff0 2024-05-08T21:14:42.787 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:14:42.787 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:14:41.257502+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4990},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4990":{"gid":4990,"name":"d","rank":0,"incarnation":16,"state":"up:replay","state_seq":1,"addr":"172.21.15.106:6836/1499761952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1499761952},{"type":"v1","addr":"172.21.15.106:6836","nonce":1499761952}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:14:42.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.787+0000 7f432d6bb700 1 -- 172.21.15.80:0/1585444819 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f430806acc0 msgr2=0x7f430806d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:42.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.787+0000 7f432d6bb700 1 --2- 172.21.15.80:0/1585444819 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f430806acc0 0x7f430806d180 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4328157bd0 tx=0x7f4318009040 comp rx=0 tx=0).stop 2024-05-08T21:14:42.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.787+0000 7f432d6bb700 1 -- 172.21.15.80:0/1585444819 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f432806eff0 msgr2=0x7f43281ee9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:42.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.787+0000 7f432d6bb700 1 --2- 172.21.15.80:0/1585444819 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f432806eff0 0x7f43281ee9d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f431000e9b0 tx=0x7f431000ed70 comp rx=0 tx=0).stop 2024-05-08T21:14:42.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.787+0000 7f432d6bb700 1 -- 172.21.15.80:0/1585444819 shutdown_connections 2024-05-08T21:14:42.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.787+0000 7f432d6bb700 1 --2- 172.21.15.80:0/1585444819 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f430806acc0 0x7f430806d180 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:42.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.787+0000 7f432d6bb700 1 --2- 172.21.15.80:0/1585444819 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f432806eff0 0x7f43281ee9d0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:42.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.787+0000 7f432d6bb700 1 --2- 172.21.15.80:0/1585444819 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4328158ab0 0x7f43281f0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:42.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.787+0000 7f432d6bb700 1 --2- 172.21.15.80:0/1585444819 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4328141450 0x7f43281eef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:42.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.787+0000 7f432d6bb700 1 -- 172.21.15.80:0/1585444819 >> 172.21.15.80:0/1585444819 conn(0x7f43280ca340 msgr2=0x7f43280cce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:14:42.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.787+0000 7f432d6bb700 1 -- 172.21.15.80:0/1585444819 shutdown_connections 2024-05-08T21:14:42.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.787+0000 7f432d6bb700 1 -- 172.21.15.80:0/1585444819 wait complete. 2024-05-08T21:14:42.790 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 16 2024-05-08T21:14:42.801 INFO:tasks.mds_thrash.fs.[cephfs]:mds.b down, removed from mdsmap 2024-05-08T21:14:42.801 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for mds cluster to stabilize... 2024-05-08T21:14:42.802 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:14:42.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.920+0000 7fe585dd3700 1 Processor -- start 2024-05-08T21:14:42.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.920+0000 7fe585dd3700 1 -- start start 2024-05-08T21:14:42.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.921+0000 7fe585dd3700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe58006ef50 0x7fe580072d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:42.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.921+0000 7fe585dd3700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe5800c74c0 0x7fe5800c7910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:42.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.921+0000 7fe585dd3700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5800c7030 con 0x7fe58006f330 2024-05-08T21:14:42.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.921+0000 7fe585dd3700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe580072ab0 con 0x7fe58006ef50 2024-05-08T21:14:42.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.921+0000 7fe585dd3700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe580071390 con 0x7fe5800c74c0 2024-05-08T21:14:42.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.921+0000 7fe57effd700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe58006f330 0x7fe58015abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45860/0 (socket says 172.21.15.80:45860) 2024-05-08T21:14:42.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.921+0000 7fe57effd700 1 -- 172.21.15.80:0/768045227 learned_addr learned my addr 172.21.15.80:0/768045227 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:14:42.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.921+0000 7fe57ffff700 1 --2- 172.21.15.80:0/768045227 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe5800c74c0 0x7fe5800c7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:42.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.921+0000 7fe57f7fe700 1 --2- 172.21.15.80:0/768045227 >> v2:172.21.15.106:3300/0 conn(0x7fe58006ef50 0x7fe580072d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:42.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.921+0000 7fe57e7fc700 1 -- 172.21.15.80:0/768045227 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1685912930 0 0) 0x7fe5800c7030 con 0x7fe58006f330 2024-05-08T21:14:42.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.921+0000 7fe57e7fc700 1 -- 172.21.15.80:0/768045227 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5680035b0 con 0x7fe58006f330 2024-05-08T21:14:42.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.921+0000 7fe57e7fc700 1 -- 172.21.15.80:0/768045227 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2253681865 0 0) 0x7fe5680035b0 con 0x7fe58006f330 2024-05-08T21:14:42.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.921+0000 7fe57e7fc700 1 -- 172.21.15.80:0/768045227 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe5800c74c0 msgr2=0x7fe5800c7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:14:42.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.921+0000 7fe57e7fc700 1 --2- 172.21.15.80:0/768045227 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe5800c74c0 0x7fe5800c7910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:42.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.921+0000 7fe57e7fc700 1 -- 172.21.15.80:0/768045227 >> v2:172.21.15.106:3300/0 conn(0x7fe58006ef50 msgr2=0x7fe580072d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:14:42.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.921+0000 7fe57e7fc700 1 --2- 172.21.15.80:0/768045227 >> v2:172.21.15.106:3300/0 conn(0x7fe58006ef50 0x7fe580072d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:42.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.921+0000 7fe57e7fc700 1 -- 172.21.15.80:0/768045227 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5800c7e50 con 0x7fe58006f330 2024-05-08T21:14:42.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.921+0000 7fe57e7fc700 1 -- 172.21.15.80:0/768045227 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3520646302 0 0) 0x7fe570001670 con 0x7fe58006f330 2024-05-08T21:14:42.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.921+0000 7fe57e7fc700 1 -- 172.21.15.80:0/768045227 >> v1:172.21.15.80:6789/0 conn(0x7fe58006f330 legacy=0x7fe58015abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:42.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.922+0000 7fe57e7fc700 1 --2- 172.21.15.80:0/768045227 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe568003a00 0x7fe568003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:42.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.922+0000 7fe57e7fc700 1 --2- 172.21.15.80:0/768045227 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe568004850 0x7fe568004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:42.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.922+0000 7fe57e7fc700 1 --2- 172.21.15.80:0/768045227 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe5800c74c0 0x7fe568005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:42.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.922+0000 7fe57e7fc700 1 -- 172.21.15.80:0/768045227 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe580072ab0 con 0x7fe568003a00 2024-05-08T21:14:42.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.922+0000 7fe57e7fc700 1 -- 172.21.15.80:0/768045227 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe580071390 con 0x7fe568004850 2024-05-08T21:14:42.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.922+0000 7fe57e7fc700 1 -- 172.21.15.80:0/768045227 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe56800ba10 con 0x7fe5800c74c0 2024-05-08T21:14:42.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.922+0000 7fe57f7fe700 1 --2- 172.21.15.80:0/768045227 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe568003a00 0x7fe568003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:42.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.922+0000 7fe57ffff700 1 --2- 172.21.15.80:0/768045227 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe5800c74c0 0x7fe568005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:42.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.922+0000 7fe57effd700 1 --2- 172.21.15.80:0/768045227 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe568004850 0x7fe568004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:42.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.922+0000 7fe57f7fe700 1 -- 172.21.15.80:0/768045227 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe5800c74c0 msgr2=0x7fe568005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:14:42.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.922+0000 7fe57f7fe700 1 --2- 172.21.15.80:0/768045227 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe5800c74c0 0x7fe568005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:42.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.922+0000 7fe57f7fe700 1 -- 172.21.15.80:0/768045227 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe568004850 msgr2=0x7fe568004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:14:42.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.922+0000 7fe57f7fe700 1 --2- 172.21.15.80:0/768045227 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe568004850 0x7fe568004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:42.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.922+0000 7fe57f7fe700 1 -- 172.21.15.80:0/768045227 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5680035b0 con 0x7fe568003a00 2024-05-08T21:14:42.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.922+0000 7fe57f7fe700 1 --2- 172.21.15.80:0/768045227 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe568003a00 0x7fe568003e20 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe574009b60 tx=0x7fe568005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcb6e97ca65e4a7e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:14:42.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.922+0000 7fe57e7fc700 1 -- 172.21.15.80:0/768045227 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57400e6c0 con 0x7fe568003a00 2024-05-08T21:14:42.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.922+0000 7fe57e7fc700 1 -- 172.21.15.80:0/768045227 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe57400e820 con 0x7fe568003a00 2024-05-08T21:14:42.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.922+0000 7fe57e7fc700 1 -- 172.21.15.80:0/768045227 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57400eb90 con 0x7fe568003a00 2024-05-08T21:14:42.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.923+0000 7fe585dd3700 1 -- 172.21.15.80:0/768045227 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe568003a00 msgr2=0x7fe568003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:42.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.923+0000 7fe585dd3700 1 --2- 172.21.15.80:0/768045227 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe568003a00 0x7fe568003e20 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe574009b60 tx=0x7fe568005880 comp rx=0 tx=0).stop 2024-05-08T21:14:42.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.923+0000 7fe57ffff700 1 -- 172.21.15.80:0/768045227 reap_dead start 2024-05-08T21:14:42.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.923+0000 7fe585dd3700 1 -- 172.21.15.80:0/768045227 shutdown_connections 2024-05-08T21:14:42.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.923+0000 7fe585dd3700 1 -- 172.21.15.80:0/768045227 >> 172.21.15.80:0/768045227 conn(0x7fe5800c9310 msgr2=0x7fe5800c9720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:14:42.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.923+0000 7fe585dd3700 1 -- 172.21.15.80:0/768045227 shutdown_connections 2024-05-08T21:14:42.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.923+0000 7fe585dd3700 1 -- 172.21.15.80:0/768045227 wait complete. 2024-05-08T21:14:42.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.924+0000 7fe585dd3700 1 Processor -- start 2024-05-08T21:14:42.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.924+0000 7fe585dd3700 1 -- start start 2024-05-08T21:14:42.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.925+0000 7fe585dd3700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe568003a00 0x7fe5800c66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:42.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.925+0000 7fe585dd3700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe5800cb4c0 0x7fe5800cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:42.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.925+0000 7fe585dd3700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe5800cc040 0x7fe5800cc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:42.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.925+0000 7fe585dd3700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5800cbbb0 con 0x7fe568003a00 2024-05-08T21:14:42.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.925+0000 7fe585dd3700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5800cca00 con 0x7fe5800cc040 2024-05-08T21:14:42.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.925+0000 7fe585dd3700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5801eff60 con 0x7fe5800cb4c0 2024-05-08T21:14:42.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.925+0000 7fe57f7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe568003a00 0x7fe5800c66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:42.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.925+0000 7fe57f7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe568003a00 0x7fe5800c66e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:56428/0 (socket says 172.21.15.80:56428) 2024-05-08T21:14:42.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.925+0000 7fe57f7fe700 1 -- 172.21.15.80:0/1495683263 learned_addr learned my addr 172.21.15.80:0/1495683263 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:14:42.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.925+0000 7fe57effd700 1 --2- 172.21.15.80:0/1495683263 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe5800cb4c0 0x7fe5800cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:42.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.925+0000 7fe57ffff700 1 --2- 172.21.15.80:0/1495683263 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe5800cc040 0x7fe5800cc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:42.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.925+0000 7fe57f7fe700 1 -- 172.21.15.80:0/1495683263 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe5800cb4c0 msgr2=0x7fe5800cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:42.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.925+0000 7fe57f7fe700 1 --2- 172.21.15.80:0/1495683263 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe5800cb4c0 0x7fe5800cabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:42.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.925+0000 7fe57f7fe700 1 -- 172.21.15.80:0/1495683263 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe5800cc040 msgr2=0x7fe5800cc4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:42.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.925+0000 7fe57f7fe700 1 --2- 172.21.15.80:0/1495683263 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe5800cc040 0x7fe5800cc4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:42.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.925+0000 7fe57f7fe700 1 -- 172.21.15.80:0/1495683263 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5801f0240 con 0x7fe568003a00 2024-05-08T21:14:42.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.925+0000 7fe57f7fe700 1 --2- 172.21.15.80:0/1495683263 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe568003a00 0x7fe5800c66e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe5680046a0 tx=0x7fe5740047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:14:42.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.925+0000 7fe567fff700 1 -- 172.21.15.80:0/1495683263 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe574021070 con 0x7fe568003a00 2024-05-08T21:14:42.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.925+0000 7fe567fff700 1 -- 172.21.15.80:0/1495683263 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5740045d0 con 0x7fe568003a00 2024-05-08T21:14:42.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.925+0000 7fe585dd3700 1 -- 172.21.15.80:0/1495683263 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5801f0520 con 0x7fe568003a00 2024-05-08T21:14:42.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.925+0000 7fe567fff700 1 -- 172.21.15.80:0/1495683263 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57400e6c0 con 0x7fe568003a00 2024-05-08T21:14:42.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.925+0000 7fe585dd3700 1 -- 172.21.15.80:0/1495683263 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5801f0ae0 con 0x7fe568003a00 2024-05-08T21:14:42.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.926+0000 7fe585dd3700 1 -- 172.21.15.80:0/1495683263 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5800c9ca0 con 0x7fe568003a00 2024-05-08T21:14:42.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.927+0000 7fe567fff700 1 -- 172.21.15.80:0/1495683263 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe574025070 con 0x7fe568003a00 2024-05-08T21:14:42.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.927+0000 7fe567fff700 1 --2- 172.21.15.80:0/1495683263 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe56c06acc0 0x7fe56c06d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:42.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.927+0000 7fe567fff700 1 -- 172.21.15.80:0/1495683263 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6835+0+0 (secure 0 0 0) 0x7fe57408a9a0 con 0x7fe568003a00 2024-05-08T21:14:42.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.927+0000 7fe57effd700 1 --2- 172.21.15.80:0/1495683263 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe56c06acc0 0x7fe56c06d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:42.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.928+0000 7fe57effd700 1 --2- 172.21.15.80:0/1495683263 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe56c06acc0 0x7fe56c06d180 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe5800cba30 tx=0x7fe570009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:14:42.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:42.932+0000 7fe567fff700 1 -- 172.21.15.80:0/1495683263 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fe574055820 con 0x7fe568003a00 2024-05-08T21:14:43.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:43.173+0000 7fe585dd3700 1 -- 172.21.15.80:0/1495683263 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe58006f770 con 0x7fe568003a00 2024-05-08T21:14:43.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:43.173+0000 7fe567fff700 1 -- 172.21.15.80:0/1495683263 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+5497 (secure 0 0 0) 0x7fe574058e40 con 0x7fe568003a00 2024-05-08T21:14:43.176 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:14:43.176 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:14:41.257502+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4990},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4990":{"gid":4990,"name":"d","rank":0,"incarnation":16,"state":"up:replay","state_seq":1,"addr":"172.21.15.106:6836/1499761952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1499761952},{"type":"v1","addr":"172.21.15.106:6836","nonce":1499761952}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:14:43.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:43.175+0000 7fe585dd3700 1 -- 172.21.15.80:0/1495683263 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe56c06acc0 msgr2=0x7fe56c06d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:43.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:43.175+0000 7fe585dd3700 1 --2- 172.21.15.80:0/1495683263 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe56c06acc0 0x7fe56c06d180 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe5800cba30 tx=0x7fe570009040 comp rx=0 tx=0).stop 2024-05-08T21:14:43.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:43.175+0000 7fe585dd3700 1 -- 172.21.15.80:0/1495683263 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe568003a00 msgr2=0x7fe5800c66e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:43.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:43.175+0000 7fe585dd3700 1 --2- 172.21.15.80:0/1495683263 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe568003a00 0x7fe5800c66e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe5680046a0 tx=0x7fe5740047c0 comp rx=0 tx=0).stop 2024-05-08T21:14:43.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:43.175+0000 7fe585dd3700 1 -- 172.21.15.80:0/1495683263 shutdown_connections 2024-05-08T21:14:43.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:43.175+0000 7fe585dd3700 1 --2- 172.21.15.80:0/1495683263 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe56c06acc0 0x7fe56c06d180 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:43.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:43.175+0000 7fe585dd3700 1 --2- 172.21.15.80:0/1495683263 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe568003a00 0x7fe5800c66e0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:43.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:43.175+0000 7fe585dd3700 1 --2- 172.21.15.80:0/1495683263 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe5800cc040 0x7fe5800cc4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:43.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:43.175+0000 7fe585dd3700 1 --2- 172.21.15.80:0/1495683263 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe5800cb4c0 0x7fe5800cabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:43.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:43.175+0000 7fe585dd3700 1 -- 172.21.15.80:0/1495683263 >> 172.21.15.80:0/1495683263 conn(0x7fe5800c9310 msgr2=0x7fe5801510a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:14:43.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:43.175+0000 7fe585dd3700 1 -- 172.21.15.80:0/1495683263 shutdown_connections 2024-05-08T21:14:43.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:43.175+0000 7fe585dd3700 1 -- 172.21.15.80:0/1495683263 wait complete. 2024-05-08T21:14:43.179 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 16 2024-05-08T21:14:43.191 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 16, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-05-08T21:10:03.725481+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 16, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_4990": { "addr": "172.21.15.106:6836/1499761952", "addrs": { "addrvec": [ { "addr": "172.21.15.106:6834", "nonce": 1499761952, "type": "v2" }, { "addr": "172.21.15.106:6836", "nonce": 1499761952, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4990, "incarnation": 16, "join_fscid": -1, "name": "d", "rank": 0, "state": "up:replay", "state_seq": 1 } }, "last_failure": 0, "last_failure_osd_epoch": 30, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-05-08T21:14:41.257502+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4990 } } } ], "standbys": [ { "addr": "172.21.15.106:6837/2762323230", "addrs": { "addrvec": [ { "addr": "172.21.15.106:6835", "nonce": 2762323230, "type": "v2" }, { "addr": "172.21.15.106:6837", "nonce": 2762323230, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4229, "incarnation": 0, "join_fscid": -1, "name": "f", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.80:6837/1121814432", "addrs": { "addrvec": [ { "addr": "172.21.15.80:6834", "nonce": 1121814432, "type": "v2" }, { "addr": "172.21.15.80:6837", "nonce": 1121814432, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4251, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.80:6839/1867024080", "addrs": { "addrvec": [ { "addr": "172.21.15.80:6838", "nonce": 1867024080, "type": "v2" }, { "addr": "172.21.15.80:6839", "nonce": 1867024080, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 2, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4254, "incarnation": 0, "join_fscid": -1, "name": "e", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.80:6836/1947012643", "addrs": { "addrvec": [ { "addr": "172.21.15.80:6835", "nonce": 1947012643, "type": "v2" }, { "addr": "172.21.15.80:6836", "nonce": 1947012643, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4273, "incarnation": 0, "join_fscid": -1, "name": "c", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-05-08T21:14:45.192 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:14:45.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.329+0000 7faaff4ca700 1 Processor -- start 2024-05-08T21:14:45.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.329+0000 7faaff4ca700 1 -- start start 2024-05-08T21:14:45.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.330+0000 7faaff4ca700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faaf806b010 0x7faaf8151c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:45.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.330+0000 7faaff4ca700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7faaf81521d0 0x7faaf80c9960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:45.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.330+0000 7faaff4ca700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaf80c6100 con 0x7faaf806ac30 2024-05-08T21:14:45.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.330+0000 7faaff4ca700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaf80c6ed0 con 0x7faaf81521d0 2024-05-08T21:14:45.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.330+0000 7faaff4ca700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaf8157ef0 con 0x7faaf806b010 2024-05-08T21:14:45.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.330+0000 7faafd266700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7faaf806ac30 0x7faaf8158600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45870/0 (socket says 172.21.15.80:45870) 2024-05-08T21:14:45.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.330+0000 7faafd266700 1 -- 172.21.15.80:0/4006676458 learned_addr learned my addr 172.21.15.80:0/4006676458 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:14:45.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.331+0000 7faafca65700 1 --2- 172.21.15.80:0/4006676458 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faaf806b010 0x7faaf8151c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:45.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.331+0000 7faafda67700 1 --2- 172.21.15.80:0/4006676458 >> v2:172.21.15.106:3300/0 conn(0x7faaf81521d0 0x7faaf80c9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:45.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.331+0000 7faaebfff700 1 -- 172.21.15.80:0/4006676458 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1365326167 0 0) 0x7faaf80c6100 con 0x7faaf806ac30 2024-05-08T21:14:45.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.331+0000 7faaebfff700 1 -- 172.21.15.80:0/4006676458 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faae40035b0 con 0x7faaf806ac30 2024-05-08T21:14:45.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.331+0000 7faaebfff700 1 -- 172.21.15.80:0/4006676458 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4172737086 0 0) 0x7faae40035b0 con 0x7faaf806ac30 2024-05-08T21:14:45.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.331+0000 7faaebfff700 1 -- 172.21.15.80:0/4006676458 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faaf806b010 msgr2=0x7faaf8151c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:14:45.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.331+0000 7faaebfff700 1 --2- 172.21.15.80:0/4006676458 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faaf806b010 0x7faaf8151c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:45.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.331+0000 7faaebfff700 1 -- 172.21.15.80:0/4006676458 >> v2:172.21.15.106:3300/0 conn(0x7faaf81521d0 msgr2=0x7faaf80c9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:14:45.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.331+0000 7faaebfff700 1 --2- 172.21.15.80:0/4006676458 >> v2:172.21.15.106:3300/0 conn(0x7faaf81521d0 0x7faaf80c9960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:45.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.331+0000 7faaebfff700 1 -- 172.21.15.80:0/4006676458 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaf80c6350 con 0x7faaf806ac30 2024-05-08T21:14:45.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.331+0000 7faaebfff700 1 -- 172.21.15.80:0/4006676458 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3520646302 0 0) 0x7faaec001670 con 0x7faaf806ac30 2024-05-08T21:14:45.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.331+0000 7faaebfff700 1 -- 172.21.15.80:0/4006676458 >> v1:172.21.15.80:6789/0 conn(0x7faaf806ac30 legacy=0x7faaf8158600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:45.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.331+0000 7faaebfff700 1 --2- 172.21.15.80:0/4006676458 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faae4003a00 0x7faae4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:45.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.331+0000 7faaebfff700 1 --2- 172.21.15.80:0/4006676458 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faaf806b010 0x7faae4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:45.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.331+0000 7faaebfff700 1 --2- 172.21.15.80:0/4006676458 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faae4004d90 0x7faae4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:45.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.331+0000 7faaebfff700 1 -- 172.21.15.80:0/4006676458 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf80c6ed0 con 0x7faae4004d90 2024-05-08T21:14:45.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.331+0000 7faaebfff700 1 -- 172.21.15.80:0/4006676458 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae400ba10 con 0x7faae4003a00 2024-05-08T21:14:45.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.331+0000 7faaebfff700 1 -- 172.21.15.80:0/4006676458 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faae400bb50 con 0x7faaf806b010 2024-05-08T21:14:45.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.331+0000 7faafda67700 1 --2- 172.21.15.80:0/4006676458 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faae4004d90 0x7faae4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:45.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.331+0000 7faafd266700 1 --2- 172.21.15.80:0/4006676458 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faae4003a00 0x7faae4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:45.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.331+0000 7faafca65700 1 --2- 172.21.15.80:0/4006676458 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faaf806b010 0x7faae4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:45.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.331+0000 7faafda67700 1 -- 172.21.15.80:0/4006676458 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faaf806b010 msgr2=0x7faae4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:14:45.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.331+0000 7faafda67700 1 --2- 172.21.15.80:0/4006676458 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faaf806b010 0x7faae4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:45.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.331+0000 7faafda67700 1 -- 172.21.15.80:0/4006676458 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faae4003a00 msgr2=0x7faae4003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:14:45.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.331+0000 7faafda67700 1 --2- 172.21.15.80:0/4006676458 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faae4003a00 0x7faae4003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:45.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.331+0000 7faafda67700 1 -- 172.21.15.80:0/4006676458 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faae40035b0 con 0x7faae4004d90 2024-05-08T21:14:45.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.331+0000 7faafd266700 1 --2- 172.21.15.80:0/4006676458 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faae4003a00 0x7faae4003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:14:45.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.332+0000 7faafda67700 1 --2- 172.21.15.80:0/4006676458 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faae4004d90 0x7faae4005210 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7faaf0009fc0 tx=0x7faae4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33cebc4f441fd5ec server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:14:45.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.332+0000 7faaebfff700 1 -- 172.21.15.80:0/4006676458 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf000ec30 con 0x7faae4004d90 2024-05-08T21:14:45.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.332+0000 7faaebfff700 1 -- 172.21.15.80:0/4006676458 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaf000f040 con 0x7faae4004d90 2024-05-08T21:14:45.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.332+0000 7faaebfff700 1 -- 172.21.15.80:0/4006676458 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf0014480 con 0x7faae4004d90 2024-05-08T21:14:45.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.332+0000 7faaff4ca700 1 -- 172.21.15.80:0/4006676458 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faae4004d90 msgr2=0x7faae4005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:45.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.332+0000 7faaff4ca700 1 --2- 172.21.15.80:0/4006676458 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faae4004d90 0x7faae4005210 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7faaf0009fc0 tx=0x7faae4005880 comp rx=0 tx=0).stop 2024-05-08T21:14:45.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.332+0000 7faafda67700 1 -- 172.21.15.80:0/4006676458 reap_dead start 2024-05-08T21:14:45.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.332+0000 7faaff4ca700 1 -- 172.21.15.80:0/4006676458 shutdown_connections 2024-05-08T21:14:45.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.332+0000 7faaff4ca700 1 -- 172.21.15.80:0/4006676458 >> 172.21.15.80:0/4006676458 conn(0x7faaf806f140 msgr2=0x7faaf806f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:14:45.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.332+0000 7faaff4ca700 1 -- 172.21.15.80:0/4006676458 shutdown_connections 2024-05-08T21:14:45.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.332+0000 7faaff4ca700 1 -- 172.21.15.80:0/4006676458 wait complete. 2024-05-08T21:14:45.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.334+0000 7faaff4ca700 1 Processor -- start 2024-05-08T21:14:45.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.334+0000 7faaff4ca700 1 -- start start 2024-05-08T21:14:45.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.334+0000 7faaff4ca700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faaf814f130 0x7faaf80cb470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:45.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.334+0000 7faaff4ca700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faaf814f510 0x7faaf81ee300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:45.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.334+0000 7faaff4ca700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faaf8148f90 0x7faaf80cbf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:45.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.334+0000 7faaff4ca700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf81ed860 con 0x7faaf814f130 2024-05-08T21:14:45.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.334+0000 7faaff4ca700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf815ba30 con 0x7faaf814f510 2024-05-08T21:14:45.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.334+0000 7faaff4ca700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaf815bd10 con 0x7faaf8148f90 2024-05-08T21:14:45.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.334+0000 7faafd266700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faaf814f130 0x7faaf80cb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:45.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.334+0000 7faafd266700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faaf814f130 0x7faaf80cb470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:56432/0 (socket says 172.21.15.80:56432) 2024-05-08T21:14:45.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.334+0000 7faafd266700 1 -- 172.21.15.80:0/448307528 learned_addr learned my addr 172.21.15.80:0/448307528 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:14:45.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.334+0000 7faafca65700 1 --2- 172.21.15.80:0/448307528 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faaf814f510 0x7faaf81ee300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:45.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.335+0000 7faafda67700 1 --2- 172.21.15.80:0/448307528 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faaf8148f90 0x7faaf80cbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:45.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.335+0000 7faafd266700 1 -- 172.21.15.80:0/448307528 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faaf8148f90 msgr2=0x7faaf80cbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:45.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.335+0000 7faafd266700 1 --2- 172.21.15.80:0/448307528 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faaf8148f90 0x7faaf80cbf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:45.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.335+0000 7faafd266700 1 -- 172.21.15.80:0/448307528 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faaf814f510 msgr2=0x7faaf81ee300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:45.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.335+0000 7faafd266700 1 --2- 172.21.15.80:0/448307528 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faaf814f510 0x7faaf81ee300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:45.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.335+0000 7faafd266700 1 -- 172.21.15.80:0/448307528 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaf81edb00 con 0x7faaf814f130 2024-05-08T21:14:45.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.335+0000 7faafd266700 1 --2- 172.21.15.80:0/448307528 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faaf814f130 0x7faaf80cb470 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7faaec0017a0 tx=0x7faaec007c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:14:45.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.335+0000 7faae9ffb700 1 -- 172.21.15.80:0/448307528 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaec00f870 con 0x7faaf814f130 2024-05-08T21:14:45.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.335+0000 7faae9ffb700 1 -- 172.21.15.80:0/448307528 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaec00f9d0 con 0x7faaf814f130 2024-05-08T21:14:45.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.335+0000 7faaff4ca700 1 -- 172.21.15.80:0/448307528 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaf81edde0 con 0x7faaf814f130 2024-05-08T21:14:45.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.335+0000 7faae9ffb700 1 -- 172.21.15.80:0/448307528 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaec00fd40 con 0x7faaf814f130 2024-05-08T21:14:45.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.335+0000 7faaff4ca700 1 -- 172.21.15.80:0/448307528 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaf815a560 con 0x7faaf814f130 2024-05-08T21:14:45.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.336+0000 7faaff4ca700 1 -- 172.21.15.80:0/448307528 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaf815c1d0 con 0x7faaf814f130 2024-05-08T21:14:45.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.336+0000 7faae9ffb700 1 -- 172.21.15.80:0/448307528 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7faaec01d460 con 0x7faaf814f130 2024-05-08T21:14:45.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.337+0000 7faae9ffb700 1 --2- 172.21.15.80:0/448307528 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7faadc06ac90 0x7faadc06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:45.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.337+0000 7faae9ffb700 1 -- 172.21.15.80:0/448307528 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6835+0+0 (secure 0 0 0) 0x7faaec089950 con 0x7faaf814f130 2024-05-08T21:14:45.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.337+0000 7faafca65700 1 --2- 172.21.15.80:0/448307528 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7faadc06ac90 0x7faadc06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:45.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.337+0000 7faafca65700 1 --2- 172.21.15.80:0/448307528 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7faadc06ac90 0x7faadc06d150 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7faaf814e6b0 tx=0x7faaf4009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:14:45.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.342+0000 7faae9ffb700 1 -- 172.21.15.80:0/448307528 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7faaec0546f0 con 0x7faaf814f130 2024-05-08T21:14:45.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.585+0000 7faaff4ca700 1 -- 172.21.15.80:0/448307528 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faaf804ec60 con 0x7faaf814f130 2024-05-08T21:14:45.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.585+0000 7faae9ffb700 1 -- 172.21.15.80:0/448307528 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+5497 (secure 0 0 0) 0x7faaec00fea0 con 0x7faaf814f130 2024-05-08T21:14:45.588 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:14:45.588 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:14:41.257502+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4990},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4990":{"gid":4990,"name":"d","rank":0,"incarnation":16,"state":"up:replay","state_seq":1,"addr":"172.21.15.106:6836/1499761952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1499761952},{"type":"v1","addr":"172.21.15.106:6836","nonce":1499761952}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:14:45.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.587+0000 7faaff4ca700 1 -- 172.21.15.80:0/448307528 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7faadc06ac90 msgr2=0x7faadc06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:45.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.587+0000 7faaff4ca700 1 --2- 172.21.15.80:0/448307528 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7faadc06ac90 0x7faadc06d150 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7faaf814e6b0 tx=0x7faaf4009210 comp rx=0 tx=0).stop 2024-05-08T21:14:45.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.588+0000 7faaff4ca700 1 -- 172.21.15.80:0/448307528 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faaf814f130 msgr2=0x7faaf80cb470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:45.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.588+0000 7faaff4ca700 1 --2- 172.21.15.80:0/448307528 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faaf814f130 0x7faaf80cb470 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7faaec0017a0 tx=0x7faaec007c60 comp rx=0 tx=0).stop 2024-05-08T21:14:45.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.588+0000 7faaff4ca700 1 -- 172.21.15.80:0/448307528 shutdown_connections 2024-05-08T21:14:45.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.588+0000 7faaff4ca700 1 --2- 172.21.15.80:0/448307528 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7faadc06ac90 0x7faadc06d150 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:45.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.588+0000 7faaff4ca700 1 --2- 172.21.15.80:0/448307528 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faaf814f130 0x7faaf80cb470 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:45.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.588+0000 7faaff4ca700 1 --2- 172.21.15.80:0/448307528 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faaf8148f90 0x7faaf80cbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:45.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.588+0000 7faaff4ca700 1 --2- 172.21.15.80:0/448307528 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faaf814f510 0x7faaf81ee300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:45.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.588+0000 7faaff4ca700 1 -- 172.21.15.80:0/448307528 >> 172.21.15.80:0/448307528 conn(0x7faaf806f140 msgr2=0x7faaf80c98c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:14:45.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.588+0000 7faaff4ca700 1 -- 172.21.15.80:0/448307528 shutdown_connections 2024-05-08T21:14:45.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:45.588+0000 7faaff4ca700 1 -- 172.21.15.80:0/448307528 wait complete. 2024-05-08T21:14:45.591 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 16 2024-05-08T21:14:45.603 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-05-08T21:14:47.604 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:14:47.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:47.745+0000 7f344495b700 1 Processor -- start 2024-05-08T21:14:47.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:47.746+0000 7f344495b700 1 -- start start 2024-05-08T21:14:47.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:47.746+0000 7f344495b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3440154580 0x7f344015abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:47.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:47.747+0000 7f344495b700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f34400cc3d0 0x7f34400cc800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:47.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:47.747+0000 7f344495b700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34400cad60 con 0x7f34400cbe40 2024-05-08T21:14:47.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:47.747+0000 7f344495b700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34400b2c60 con 0x7f3440154580 2024-05-08T21:14:47.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:47.747+0000 7f344495b700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f344015d750 con 0x7f34400cc3d0 2024-05-08T21:14:47.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:47.747+0000 7f343e59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3440154580 0x7f344015abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:47.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:47.747+0000 7f343e59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3440154580 0x7f344015abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:56438/0 (socket says 172.21.15.80:56438) 2024-05-08T21:14:47.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:47.747+0000 7f343e59c700 1 -- 172.21.15.80:0/3519288078 learned_addr learned my addr 172.21.15.80:0/3519288078 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:14:47.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:47.747+0000 7f343ed9d700 1 --2- 172.21.15.80:0/3519288078 >> v2:172.21.15.106:3300/0 conn(0x7f34400cc3d0 0x7f34400cc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:47.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:47.747+0000 7f343e59c700 1 -- 172.21.15.80:0/3519288078 >> v2:172.21.15.106:3300/0 conn(0x7f34400cc3d0 msgr2=0x7f34400cc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:14:47.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:47.747+0000 7f343e59c700 1 --2- 172.21.15.80:0/3519288078 >> v2:172.21.15.106:3300/0 conn(0x7f34400cc3d0 0x7f34400cc800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:47.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:47.747+0000 7f343e59c700 1 -- 172.21.15.80:0/3519288078 >> v1:172.21.15.106:6789/0 conn(0x7f34400cbe40 legacy=0x7f34400c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:14:47.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:47.747+0000 7f343e59c700 1 -- 172.21.15.80:0/3519288078 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f344015d930 con 0x7f3440154580 2024-05-08T21:14:47.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:47.747+0000 7f343ed9d700 1 --2- 172.21.15.80:0/3519288078 >> v2:172.21.15.106:3300/0 conn(0x7f34400cc3d0 0x7f34400cc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:14:47.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:47.747+0000 7f343e59c700 1 --2- 172.21.15.80:0/3519288078 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3440154580 0x7f344015abe0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f3440073100 tx=0x7f3430009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dc9c025d9a663c9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:14:47.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:47.747+0000 7f343d59a700 1 -- 172.21.15.80:0/3519288078 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3430004230 con 0x7f3440154580 2024-05-08T21:14:47.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:47.747+0000 7f343d59a700 1 -- 172.21.15.80:0/3519288078 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3430004390 con 0x7f3440154580 2024-05-08T21:14:47.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:47.747+0000 7f343d59a700 1 -- 172.21.15.80:0/3519288078 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34300036a0 con 0x7f3440154580 2024-05-08T21:14:47.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:47.748+0000 7f344495b700 1 -- 172.21.15.80:0/3519288078 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3440154580 msgr2=0x7f344015abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:47.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:47.748+0000 7f344495b700 1 --2- 172.21.15.80:0/3519288078 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3440154580 0x7f344015abe0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f3440073100 tx=0x7f3430009c00 comp rx=0 tx=0).stop 2024-05-08T21:14:47.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:47.748+0000 7f344495b700 1 -- 172.21.15.80:0/3519288078 shutdown_connections 2024-05-08T21:14:47.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:47.748+0000 7f344495b700 1 --2- 172.21.15.80:0/3519288078 >> v2:172.21.15.106:3300/0 conn(0x7f34400cc3d0 0x7f34400cc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:47.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:47.748+0000 7f344495b700 1 --2- 172.21.15.80:0/3519288078 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3440154580 0x7f344015abe0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:47.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:47.748+0000 7f344495b700 1 -- 172.21.15.80:0/3519288078 >> 172.21.15.80:0/3519288078 conn(0x7f344006c6a0 msgr2=0x7f344006cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:14:47.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:47.748+0000 7f344495b700 1 -- 172.21.15.80:0/3519288078 shutdown_connections 2024-05-08T21:14:47.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:47.748+0000 7f344495b700 1 -- 172.21.15.80:0/3519288078 wait complete. 2024-05-08T21:14:47.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:47.750+0000 7f344495b700 1 Processor -- start 2024-05-08T21:14:47.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:47.750+0000 7f344495b700 1 -- start start 2024-05-08T21:14:47.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:47.751+0000 7f344495b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f34400cbe40 0x7f34400cdc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:47.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:47.751+0000 7f344495b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34400cc3d0 0x7f344015bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:47.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:47.751+0000 7f344495b700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3440154580 0x7f34400ce440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:47.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:47.751+0000 7f344495b700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f344015ce90 con 0x7f34400cc3d0 2024-05-08T21:14:47.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:47.751+0000 7f344495b700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34400d07c0 con 0x7f34400cbe40 2024-05-08T21:14:47.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:47.751+0000 7f344495b700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34401575a0 con 0x7f3440154580 2024-05-08T21:14:47.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:47.751+0000 7f343dd9b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34400cc3d0 0x7f344015bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:47.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:47.751+0000 7f343dd9b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34400cc3d0 0x7f344015bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:56444/0 (socket says 172.21.15.80:56444) 2024-05-08T21:14:47.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:47.751+0000 7f343dd9b700 1 -- 172.21.15.80:0/63322103 learned_addr learned my addr 172.21.15.80:0/63322103 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:14:47.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:47.751+0000 7f343e59c700 1 --2- 172.21.15.80:0/63322103 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f34400cbe40 0x7f34400cdc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:47.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:47.751+0000 7f343ed9d700 1 --2- 172.21.15.80:0/63322103 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3440154580 0x7f34400ce440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:47.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:47.751+0000 7f343dd9b700 1 -- 172.21.15.80:0/63322103 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3440154580 msgr2=0x7f34400ce440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:47.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:47.751+0000 7f343dd9b700 1 --2- 172.21.15.80:0/63322103 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3440154580 0x7f34400ce440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:47.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:47.751+0000 7f343dd9b700 1 -- 172.21.15.80:0/63322103 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f34400cbe40 msgr2=0x7f34400cdc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:47.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:47.751+0000 7f343dd9b700 1 --2- 172.21.15.80:0/63322103 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f34400cbe40 0x7f34400cdc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:47.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:47.751+0000 7f343dd9b700 1 -- 172.21.15.80:0/63322103 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3430009550 con 0x7f34400cc3d0 2024-05-08T21:14:47.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:47.751+0000 7f343e59c700 1 --2- 172.21.15.80:0/63322103 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f34400cbe40 0x7f34400cdc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:14:47.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:47.751+0000 7f343dd9b700 1 --2- 172.21.15.80:0/63322103 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34400cc3d0 0x7f344015bd30 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f343400c4d0 tx=0x7f343400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:14:47.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:47.752+0000 7f342effd700 1 -- 172.21.15.80:0/63322103 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3434011790 con 0x7f34400cc3d0 2024-05-08T21:14:47.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:47.752+0000 7f342effd700 1 -- 172.21.15.80:0/63322103 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34340118f0 con 0x7f34400cc3d0 2024-05-08T21:14:47.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:47.752+0000 7f342effd700 1 -- 172.21.15.80:0/63322103 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3434011ca0 con 0x7f34400cc3d0 2024-05-08T21:14:47.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:47.752+0000 7f344495b700 1 -- 172.21.15.80:0/63322103 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3440157880 con 0x7f34400cc3d0 2024-05-08T21:14:47.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:47.752+0000 7f344495b700 1 -- 172.21.15.80:0/63322103 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34400d04e0 con 0x7f34400cc3d0 2024-05-08T21:14:47.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:47.753+0000 7f344495b700 1 -- 172.21.15.80:0/63322103 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34400cd950 con 0x7f34400cc3d0 2024-05-08T21:14:47.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:47.754+0000 7f342effd700 1 -- 172.21.15.80:0/63322103 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f343401c460 con 0x7f34400cc3d0 2024-05-08T21:14:47.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:47.754+0000 7f342effd700 1 --2- 172.21.15.80:0/63322103 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f342006ac90 0x7f342006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:47.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:47.754+0000 7f342effd700 1 -- 172.21.15.80:0/63322103 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6835+0+0 (secure 0 0 0) 0x7f34340895b0 con 0x7f34400cc3d0 2024-05-08T21:14:47.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:47.754+0000 7f343e59c700 1 --2- 172.21.15.80:0/63322103 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f342006ac90 0x7f342006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:47.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:47.755+0000 7f343e59c700 1 --2- 172.21.15.80:0/63322103 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f342006ac90 0x7f342006d150 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3430009130 tx=0x7f3430008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:14:47.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:47.759+0000 7f342effd700 1 -- 172.21.15.80:0/63322103 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f3434054320 con 0x7f34400cc3d0 2024-05-08T21:14:48.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:48.009+0000 7f344495b700 1 -- 172.21.15.80:0/63322103 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f344006a110 con 0x7f34400cc3d0 2024-05-08T21:14:48.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:48.009+0000 7f342effd700 1 -- 172.21.15.80:0/63322103 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+5501 (secure 0 0 0) 0x7f3434057940 con 0x7f34400cc3d0 2024-05-08T21:14:48.012 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:14:48.012 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:14:47.593454+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4990},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4990":{"gid":4990,"name":"d","rank":0,"incarnation":16,"state":"up:reconnect","state_seq":37,"addr":"172.21.15.106:6836/1499761952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1499761952},{"type":"v1","addr":"172.21.15.106:6836","nonce":1499761952}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:14:48.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:48.011+0000 7f344495b700 1 -- 172.21.15.80:0/63322103 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f342006ac90 msgr2=0x7f342006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:48.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:48.011+0000 7f344495b700 1 --2- 172.21.15.80:0/63322103 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f342006ac90 0x7f342006d150 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3430009130 tx=0x7f3430008030 comp rx=0 tx=0).stop 2024-05-08T21:14:48.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:48.011+0000 7f344495b700 1 -- 172.21.15.80:0/63322103 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34400cc3d0 msgr2=0x7f344015bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:48.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:48.011+0000 7f344495b700 1 --2- 172.21.15.80:0/63322103 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34400cc3d0 0x7f344015bd30 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f343400c4d0 tx=0x7f343400c890 comp rx=0 tx=0).stop 2024-05-08T21:14:48.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:48.011+0000 7f344495b700 1 -- 172.21.15.80:0/63322103 shutdown_connections 2024-05-08T21:14:48.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:48.011+0000 7f344495b700 1 --2- 172.21.15.80:0/63322103 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f342006ac90 0x7f342006d150 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:48.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:48.011+0000 7f344495b700 1 --2- 172.21.15.80:0/63322103 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3440154580 0x7f34400ce440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:48.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:48.011+0000 7f344495b700 1 --2- 172.21.15.80:0/63322103 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f34400cbe40 0x7f34400cdc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:48.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:48.011+0000 7f344495b700 1 --2- 172.21.15.80:0/63322103 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34400cc3d0 0x7f344015bd30 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:48.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:48.011+0000 7f344495b700 1 -- 172.21.15.80:0/63322103 >> 172.21.15.80:0/63322103 conn(0x7f344006c6a0 msgr2=0x7f3440152490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:14:48.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:48.012+0000 7f344495b700 1 -- 172.21.15.80:0/63322103 shutdown_connections 2024-05-08T21:14:48.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:48.012+0000 7f344495b700 1 -- 172.21.15.80:0/63322103 wait complete. 2024-05-08T21:14:48.015 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 17 2024-05-08T21:14:48.027 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-05-08T21:14:50.028 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:14:50.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.160+0000 7fd43d050700 1 Processor -- start 2024-05-08T21:14:50.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.160+0000 7fd43d050700 1 -- start start 2024-05-08T21:14:50.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.160+0000 7fd43d050700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd43815bc90 0x7fd438071e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:50.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.160+0000 7fd43d050700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd43806edd0 con 0x7fd4380c7050 2024-05-08T21:14:50.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.160+0000 7fd43d050700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd43815a090 con 0x7fd4381433e0 2024-05-08T21:14:50.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.160+0000 7fd43d050700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd43806fa10 con 0x7fd43815bc90 2024-05-08T21:14:50.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.161+0000 7fd43659c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd4380c7050 0x7fd43815b580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45874/0 (socket says 172.21.15.80:45874) 2024-05-08T21:14:50.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.161+0000 7fd43659c700 1 -- 172.21.15.80:0/1293657435 learned_addr learned my addr 172.21.15.80:0/1293657435 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:14:50.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.161+0000 7fd43759e700 1 --2- 172.21.15.80:0/1293657435 >> v2:172.21.15.106:3300/0 conn(0x7fd43815bc90 0x7fd438071e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:50.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.161+0000 7fd435d9b700 1 -- 172.21.15.80:0/1293657435 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 646328444 0 0) 0x7fd43806edd0 con 0x7fd4380c7050 2024-05-08T21:14:50.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.161+0000 7fd435d9b700 1 -- 172.21.15.80:0/1293657435 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4200035b0 con 0x7fd4380c7050 2024-05-08T21:14:50.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.161+0000 7fd435d9b700 1 -- 172.21.15.80:0/1293657435 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2908981197 0 0) 0x7fd4200035b0 con 0x7fd4380c7050 2024-05-08T21:14:50.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.161+0000 7fd435d9b700 1 -- 172.21.15.80:0/1293657435 >> v2:172.21.15.106:3300/0 conn(0x7fd43815bc90 msgr2=0x7fd438071e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:14:50.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.161+0000 7fd435d9b700 1 --2- 172.21.15.80:0/1293657435 >> v2:172.21.15.106:3300/0 conn(0x7fd43815bc90 0x7fd438071e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:50.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.161+0000 7fd435d9b700 1 -- 172.21.15.80:0/1293657435 >> v1:172.21.15.106:6789/0 conn(0x7fd4381433e0 legacy=0x7fd43806a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:50.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.161+0000 7fd435d9b700 1 -- 172.21.15.80:0/1293657435 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd43815a310 con 0x7fd4380c7050 2024-05-08T21:14:50.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.161+0000 7fd435d9b700 1 -- 172.21.15.80:0/1293657435 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3520646302 0 0) 0x7fd42c001670 con 0x7fd4380c7050 2024-05-08T21:14:50.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.161+0000 7fd435d9b700 1 -- 172.21.15.80:0/1293657435 >> v1:172.21.15.80:6789/0 conn(0x7fd4380c7050 legacy=0x7fd43815b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:50.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.161+0000 7fd435d9b700 1 --2- 172.21.15.80:0/1293657435 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd420003a00 0x7fd420003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:50.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.161+0000 7fd435d9b700 1 --2- 172.21.15.80:0/1293657435 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd420004850 0x7fd420004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:50.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.161+0000 7fd435d9b700 1 --2- 172.21.15.80:0/1293657435 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd420005210 0x7fd42000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:50.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.161+0000 7fd435d9b700 1 -- 172.21.15.80:0/1293657435 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd43806fa10 con 0x7fd420003a00 2024-05-08T21:14:50.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.161+0000 7fd435d9b700 1 -- 172.21.15.80:0/1293657435 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd42000c0c0 con 0x7fd420005210 2024-05-08T21:14:50.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.161+0000 7fd435d9b700 1 -- 172.21.15.80:0/1293657435 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd42000c280 con 0x7fd420004850 2024-05-08T21:14:50.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.161+0000 7fd436d9d700 1 --2- 172.21.15.80:0/1293657435 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd420003a00 0x7fd420003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:50.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.161+0000 7fd43659c700 1 --2- 172.21.15.80:0/1293657435 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd420004850 0x7fd420004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:50.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.161+0000 7fd43759e700 1 --2- 172.21.15.80:0/1293657435 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd420005210 0x7fd42000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:50.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.162+0000 7fd436d9d700 1 -- 172.21.15.80:0/1293657435 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd420004850 msgr2=0x7fd420004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:14:50.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.162+0000 7fd436d9d700 1 --2- 172.21.15.80:0/1293657435 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd420004850 0x7fd420004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:50.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.162+0000 7fd436d9d700 1 -- 172.21.15.80:0/1293657435 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd420005210 msgr2=0x7fd42000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:14:50.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.162+0000 7fd436d9d700 1 --2- 172.21.15.80:0/1293657435 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd420005210 0x7fd42000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:50.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.162+0000 7fd43759e700 1 -- 172.21.15.80:0/1293657435 reap_dead start 2024-05-08T21:14:50.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.162+0000 7fd436d9d700 1 -- 172.21.15.80:0/1293657435 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4200035b0 con 0x7fd420003a00 2024-05-08T21:14:50.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.162+0000 7fd436d9d700 1 --2- 172.21.15.80:0/1293657435 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd420003a00 0x7fd420003e20 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fd4280017c0 tx=0x7fd420005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e249dad7347ca69 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:14:50.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.162+0000 7fd435d9b700 1 -- 172.21.15.80:0/1293657435 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4280052d0 con 0x7fd420003a00 2024-05-08T21:14:50.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.162+0000 7fd435d9b700 1 -- 172.21.15.80:0/1293657435 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd428005450 con 0x7fd420003a00 2024-05-08T21:14:50.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.162+0000 7fd435d9b700 1 -- 172.21.15.80:0/1293657435 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4280038c0 con 0x7fd420003a00 2024-05-08T21:14:50.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.162+0000 7fd43d050700 1 -- 172.21.15.80:0/1293657435 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd420003a00 msgr2=0x7fd420003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:50.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.162+0000 7fd43d050700 1 --2- 172.21.15.80:0/1293657435 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd420003a00 0x7fd420003e20 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fd4280017c0 tx=0x7fd420005880 comp rx=0 tx=0).stop 2024-05-08T21:14:50.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.162+0000 7fd43d050700 1 -- 172.21.15.80:0/1293657435 shutdown_connections 2024-05-08T21:14:50.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.162+0000 7fd43d050700 1 --2- 172.21.15.80:0/1293657435 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd420003a00 0x7fd420003e20 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:50.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.162+0000 7fd43d050700 1 -- 172.21.15.80:0/1293657435 >> 172.21.15.80:0/1293657435 conn(0x7fd43806bad0 msgr2=0x7fd43806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:14:50.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.162+0000 7fd43d050700 1 -- 172.21.15.80:0/1293657435 shutdown_connections 2024-05-08T21:14:50.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.163+0000 7fd43d050700 1 -- 172.21.15.80:0/1293657435 wait complete. 2024-05-08T21:14:50.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.164+0000 7fd43d050700 1 Processor -- start 2024-05-08T21:14:50.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.164+0000 7fd43d050700 1 -- start start 2024-05-08T21:14:50.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.165+0000 7fd43d050700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd420003a00 0x7fd4381f09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:50.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.165+0000 7fd43d050700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4380c64b0 0x7fd4380c8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:50.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.165+0000 7fd43d050700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd4381531c0 0x7fd438153670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:50.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.165+0000 7fd43d050700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd438153bb0 con 0x7fd4380c64b0 2024-05-08T21:14:50.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.165+0000 7fd43d050700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4381f0ef0 con 0x7fd420003a00 2024-05-08T21:14:50.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.165+0000 7fd43d050700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4380c6940 con 0x7fd4381531c0 2024-05-08T21:14:50.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.165+0000 7fd43659c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4380c64b0 0x7fd4380c8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:50.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.165+0000 7fd43659c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4380c64b0 0x7fd4380c8590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:56466/0 (socket says 172.21.15.80:56466) 2024-05-08T21:14:50.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.165+0000 7fd43659c700 1 -- 172.21.15.80:0/660068730 learned_addr learned my addr 172.21.15.80:0/660068730 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:14:50.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.165+0000 7fd43759e700 1 --2- 172.21.15.80:0/660068730 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd4381531c0 0x7fd438153670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:50.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.165+0000 7fd436d9d700 1 --2- 172.21.15.80:0/660068730 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd420003a00 0x7fd4381f09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:50.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.165+0000 7fd43659c700 1 -- 172.21.15.80:0/660068730 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd4381531c0 msgr2=0x7fd438153670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:50.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.165+0000 7fd43659c700 1 --2- 172.21.15.80:0/660068730 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd4381531c0 0x7fd438153670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:50.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.165+0000 7fd43659c700 1 -- 172.21.15.80:0/660068730 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd420003a00 msgr2=0x7fd4381f09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:50.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.165+0000 7fd43659c700 1 --2- 172.21.15.80:0/660068730 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd420003a00 0x7fd4381f09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:50.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.165+0000 7fd43659c700 1 -- 172.21.15.80:0/660068730 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4380c49f0 con 0x7fd4380c64b0 2024-05-08T21:14:50.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.165+0000 7fd43659c700 1 --2- 172.21.15.80:0/660068730 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4380c64b0 0x7fd4380c8590 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd42c000f60 tx=0x7fd42c007570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:14:50.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.165+0000 7fd41f7fe700 1 -- 172.21.15.80:0/660068730 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42c011580 con 0x7fd4380c64b0 2024-05-08T21:14:50.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.166+0000 7fd41f7fe700 1 -- 172.21.15.80:0/660068730 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd42c011700 con 0x7fd4380c64b0 2024-05-08T21:14:50.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.166+0000 7fd43d050700 1 -- 172.21.15.80:0/660068730 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4380c4cd0 con 0x7fd4380c64b0 2024-05-08T21:14:50.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.166+0000 7fd41f7fe700 1 -- 172.21.15.80:0/660068730 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42c011ab0 con 0x7fd4380c64b0 2024-05-08T21:14:50.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.166+0000 7fd43d050700 1 -- 172.21.15.80:0/660068730 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4380c5290 con 0x7fd4380c64b0 2024-05-08T21:14:50.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.166+0000 7fd43d050700 1 -- 172.21.15.80:0/660068730 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4380c57b0 con 0x7fd4380c64b0 2024-05-08T21:14:50.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.167+0000 7fd41f7fe700 1 -- 172.21.15.80:0/660068730 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd42c011c10 con 0x7fd4380c64b0 2024-05-08T21:14:50.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.167+0000 7fd41f7fe700 1 --2- 172.21.15.80:0/660068730 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fd42406acc0 0x7fd42406d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:50.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.168+0000 7fd436d9d700 1 --2- 172.21.15.80:0/660068730 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fd42406acc0 0x7fd42406d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:50.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.168+0000 7fd41f7fe700 1 -- 172.21.15.80:0/660068730 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6835+0+0 (secure 0 0 0) 0x7fd42c089760 con 0x7fd4380c64b0 2024-05-08T21:14:50.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.168+0000 7fd436d9d700 1 --2- 172.21.15.80:0/660068730 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fd42406acc0 0x7fd42406d180 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd428000c00 tx=0x7fd428009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:14:50.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.172+0000 7fd41f7fe700 1 -- 172.21.15.80:0/660068730 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fd4380c57b0 con 0x7fd4380c64b0 2024-05-08T21:14:50.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.415+0000 7fd43d050700 1 -- 172.21.15.80:0/660068730 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd4380c57b0 con 0x7fd4380c64b0 2024-05-08T21:14:50.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.415+0000 7fd41f7fe700 1 -- 172.21.15.80:0/660068730 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+5501 (secure 0 0 0) 0x7fd4380c57b0 con 0x7fd4380c64b0 2024-05-08T21:14:50.419 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:14:50.419 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:14:47.593454+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4990},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4990":{"gid":4990,"name":"d","rank":0,"incarnation":16,"state":"up:reconnect","state_seq":37,"addr":"172.21.15.106:6836/1499761952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1499761952},{"type":"v1","addr":"172.21.15.106:6836","nonce":1499761952}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:14:50.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.418+0000 7fd43d050700 1 -- 172.21.15.80:0/660068730 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fd42406acc0 msgr2=0x7fd42406d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:50.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.418+0000 7fd43d050700 1 --2- 172.21.15.80:0/660068730 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fd42406acc0 0x7fd42406d180 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd428000c00 tx=0x7fd428009030 comp rx=0 tx=0).stop 2024-05-08T21:14:50.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.418+0000 7fd43d050700 1 -- 172.21.15.80:0/660068730 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4380c64b0 msgr2=0x7fd4380c8590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:50.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.418+0000 7fd43d050700 1 --2- 172.21.15.80:0/660068730 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4380c64b0 0x7fd4380c8590 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd42c000f60 tx=0x7fd42c007570 comp rx=0 tx=0).stop 2024-05-08T21:14:50.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.418+0000 7fd43d050700 1 -- 172.21.15.80:0/660068730 shutdown_connections 2024-05-08T21:14:50.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.418+0000 7fd43d050700 1 --2- 172.21.15.80:0/660068730 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fd42406acc0 0x7fd42406d180 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:50.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.418+0000 7fd43d050700 1 --2- 172.21.15.80:0/660068730 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd4381531c0 0x7fd438153670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:50.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.418+0000 7fd43d050700 1 --2- 172.21.15.80:0/660068730 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd420003a00 0x7fd4381f09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:50.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.418+0000 7fd43d050700 1 --2- 172.21.15.80:0/660068730 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4380c64b0 0x7fd4380c8590 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:50.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.418+0000 7fd43d050700 1 -- 172.21.15.80:0/660068730 >> 172.21.15.80:0/660068730 conn(0x7fd43806bad0 msgr2=0x7fd4381415d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:14:50.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.418+0000 7fd43d050700 1 -- 172.21.15.80:0/660068730 shutdown_connections 2024-05-08T21:14:50.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:50.418+0000 7fd43d050700 1 -- 172.21.15.80:0/660068730 wait complete. 2024-05-08T21:14:50.423 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 17 2024-05-08T21:14:50.434 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-05-08T21:14:52.435 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:14:52.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.570+0000 7f610c33c700 1 Processor -- start 2024-05-08T21:14:52.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.570+0000 7f610c33c700 1 -- start start 2024-05-08T21:14:52.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.571+0000 7f610c33c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6104152190 0x7f6104066a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:52.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.571+0000 7f610c33c700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6104070cf0 0x7f610406a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:52.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.571+0000 7f610c33c700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61040ccd80 con 0x7f6104158a90 2024-05-08T21:14:52.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.571+0000 7f610c33c700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61040721a0 con 0x7f6104152190 2024-05-08T21:14:52.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.571+0000 7f610c33c700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6104158010 con 0x7f6104070cf0 2024-05-08T21:14:52.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.571+0000 7f610a0d8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6104152190 0x7f6104066a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:52.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.571+0000 7f610a8d9700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f6104158a90 0x7f61040c5970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42152/0 (socket says 172.21.15.80:42152) 2024-05-08T21:14:52.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.571+0000 7f610a8d9700 1 -- 172.21.15.80:0/1266972151 learned_addr learned my addr 172.21.15.80:0/1266972151 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:14:52.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.571+0000 7f61098d7700 1 --2- 172.21.15.80:0/1266972151 >> v2:172.21.15.106:3300/0 conn(0x7f6104070cf0 0x7f610406a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:52.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.572+0000 7f610a0d8700 1 -- 172.21.15.80:0/1266972151 >> v2:172.21.15.106:3300/0 conn(0x7f6104070cf0 msgr2=0x7f610406a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:14:52.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.572+0000 7f610a0d8700 1 --2- 172.21.15.80:0/1266972151 >> v2:172.21.15.106:3300/0 conn(0x7f6104070cf0 0x7f610406a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:52.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.572+0000 7f610a0d8700 1 -- 172.21.15.80:0/1266972151 >> v1:172.21.15.80:6789/0 conn(0x7f6104158a90 legacy=0x7f61040c5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:52.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.572+0000 7f610a0d8700 1 -- 172.21.15.80:0/1266972151 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61040ccfb0 con 0x7f6104152190 2024-05-08T21:14:52.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.572+0000 7f61090d6700 1 -- 172.21.15.80:0/1266972151 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2973756097 0 0) 0x7f61040ccd80 con 0x7f6104158a90 2024-05-08T21:14:52.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.572+0000 7f610a0d8700 1 --2- 172.21.15.80:0/1266972151 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6104152190 0x7f6104066a70 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6104067650 tx=0x7f60f4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3876074db7dbc3c3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:14:52.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.572+0000 7f61090d6700 1 -- 172.21.15.80:0/1266972151 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f4011830 con 0x7f6104152190 2024-05-08T21:14:52.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.572+0000 7f61090d6700 1 -- 172.21.15.80:0/1266972151 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60f4011990 con 0x7f6104152190 2024-05-08T21:14:52.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.572+0000 7f61090d6700 1 -- 172.21.15.80:0/1266972151 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f4011d20 con 0x7f6104152190 2024-05-08T21:14:52.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.572+0000 7f610c33c700 1 -- 172.21.15.80:0/1266972151 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6104152190 msgr2=0x7f6104066a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:52.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.572+0000 7f610c33c700 1 --2- 172.21.15.80:0/1266972151 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6104152190 0x7f6104066a70 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6104067650 tx=0x7f60f4009b20 comp rx=0 tx=0).stop 2024-05-08T21:14:52.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.573+0000 7f610c33c700 1 -- 172.21.15.80:0/1266972151 shutdown_connections 2024-05-08T21:14:52.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.573+0000 7f610c33c700 1 --2- 172.21.15.80:0/1266972151 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6104152190 0x7f6104066a70 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:52.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.573+0000 7f610c33c700 1 --2- 172.21.15.80:0/1266972151 >> v2:172.21.15.106:3300/0 conn(0x7f6104070cf0 0x7f610406a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:52.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.573+0000 7f610c33c700 1 -- 172.21.15.80:0/1266972151 >> 172.21.15.80:0/1266972151 conn(0x7f61040cc260 msgr2=0x7f61040cc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:14:52.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.573+0000 7f610c33c700 1 -- 172.21.15.80:0/1266972151 shutdown_connections 2024-05-08T21:14:52.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.573+0000 7f610c33c700 1 -- 172.21.15.80:0/1266972151 wait complete. 2024-05-08T21:14:52.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.574+0000 7f610c33c700 1 Processor -- start 2024-05-08T21:14:52.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.574+0000 7f610c33c700 1 -- start start 2024-05-08T21:14:52.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.575+0000 7f610c33c700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6104070cf0 0x7f61041570e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:52.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.575+0000 7f610c33c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6104152190 0x7f610414ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:52.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.575+0000 7f610c33c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6104158a90 0x7f6104150520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:52.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.575+0000 7f610c33c700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6104153f60 con 0x7f6104152190 2024-05-08T21:14:52.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.575+0000 7f610c33c700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61041553c0 con 0x7f6104158a90 2024-05-08T21:14:52.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.575+0000 7f610c33c700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6104153000 con 0x7f6104070cf0 2024-05-08T21:14:52.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.575+0000 7f61098d7700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6104152190 0x7f610414ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:52.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.575+0000 7f61098d7700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6104152190 0x7f610414ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37194/0 (socket says 172.21.15.80:37194) 2024-05-08T21:14:52.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.575+0000 7f61098d7700 1 -- 172.21.15.80:0/1219859609 learned_addr learned my addr 172.21.15.80:0/1219859609 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:14:52.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.575+0000 7f610a8d9700 1 --2- 172.21.15.80:0/1219859609 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6104158a90 0x7f6104150520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:52.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.575+0000 7f610a0d8700 1 --2- 172.21.15.80:0/1219859609 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6104070cf0 0x7f61041570e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:52.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.576+0000 7f61098d7700 1 -- 172.21.15.80:0/1219859609 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6104070cf0 msgr2=0x7f61041570e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:52.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.576+0000 7f61098d7700 1 --2- 172.21.15.80:0/1219859609 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6104070cf0 0x7f61041570e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:52.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.576+0000 7f61098d7700 1 -- 172.21.15.80:0/1219859609 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6104158a90 msgr2=0x7f6104150520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:52.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.576+0000 7f61098d7700 1 --2- 172.21.15.80:0/1219859609 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6104158a90 0x7f6104150520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:52.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.576+0000 7f61098d7700 1 -- 172.21.15.80:0/1219859609 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60f40094a0 con 0x7f6104152190 2024-05-08T21:14:52.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.576+0000 7f61098d7700 1 --2- 172.21.15.80:0/1219859609 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6104152190 0x7f610414ffe0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f610000d800 tx=0x7f610000dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:14:52.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.576+0000 7f60faffd700 1 -- 172.21.15.80:0/1219859609 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61000125f0 con 0x7f6104152190 2024-05-08T21:14:52.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.576+0000 7f60faffd700 1 -- 172.21.15.80:0/1219859609 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6100012750 con 0x7f6104152190 2024-05-08T21:14:52.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.576+0000 7f610c33c700 1 -- 172.21.15.80:0/1219859609 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61041532e0 con 0x7f6104152190 2024-05-08T21:14:52.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.576+0000 7f60faffd700 1 -- 172.21.15.80:0/1219859609 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6100012ae0 con 0x7f6104152190 2024-05-08T21:14:52.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.576+0000 7f610c33c700 1 -- 172.21.15.80:0/1219859609 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61041538a0 con 0x7f6104152190 2024-05-08T21:14:52.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.577+0000 7f610c33c700 1 -- 172.21.15.80:0/1219859609 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61040c8b60 con 0x7f6104152190 2024-05-08T21:14:52.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.577+0000 7f60faffd700 1 -- 172.21.15.80:0/1219859609 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6100012c40 con 0x7f6104152190 2024-05-08T21:14:52.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.578+0000 7f60faffd700 1 --2- 172.21.15.80:0/1219859609 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f60e806ac90 0x7f60e806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:52.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.578+0000 7f610a0d8700 1 --2- 172.21.15.80:0/1219859609 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f60e806ac90 0x7f60e806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:52.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.578+0000 7f60faffd700 1 -- 172.21.15.80:0/1219859609 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6835+0+0 (secure 0 0 0) 0x7f6100089960 con 0x7f6104152190 2024-05-08T21:14:52.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.578+0000 7f610a0d8700 1 --2- 172.21.15.80:0/1219859609 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f60e806ac90 0x7f60e806d150 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f60f40090b0 tx=0x7f60f401c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:14:52.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.582+0000 7f60faffd700 1 -- 172.21.15.80:0/1219859609 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f6100054640 con 0x7f6104152190 2024-05-08T21:14:52.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.828+0000 7f610c33c700 1 -- 172.21.15.80:0/1219859609 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f610404ec60 con 0x7f6104152190 2024-05-08T21:14:52.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.828+0000 7f60faffd700 1 -- 172.21.15.80:0/1219859609 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+5498 (secure 0 0 0) 0x7f6100057c60 con 0x7f6104152190 2024-05-08T21:14:52.832 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:14:52.832 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:14:52.619585+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4990},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4990":{"gid":4990,"name":"d","rank":0,"incarnation":16,"state":"up:rejoin","state_seq":39,"addr":"172.21.15.106:6836/1499761952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1499761952},{"type":"v1","addr":"172.21.15.106:6836","nonce":1499761952}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:14:52.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.831+0000 7f610c33c700 1 -- 172.21.15.80:0/1219859609 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f60e806ac90 msgr2=0x7f60e806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:52.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.831+0000 7f610c33c700 1 --2- 172.21.15.80:0/1219859609 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f60e806ac90 0x7f60e806d150 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f60f40090b0 tx=0x7f60f401c040 comp rx=0 tx=0).stop 2024-05-08T21:14:52.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.831+0000 7f610c33c700 1 -- 172.21.15.80:0/1219859609 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6104152190 msgr2=0x7f610414ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:52.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.831+0000 7f610c33c700 1 --2- 172.21.15.80:0/1219859609 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6104152190 0x7f610414ffe0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f610000d800 tx=0x7f610000dbc0 comp rx=0 tx=0).stop 2024-05-08T21:14:52.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.831+0000 7f610c33c700 1 -- 172.21.15.80:0/1219859609 shutdown_connections 2024-05-08T21:14:52.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.831+0000 7f610c33c700 1 --2- 172.21.15.80:0/1219859609 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f60e806ac90 0x7f60e806d150 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:52.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.831+0000 7f610c33c700 1 --2- 172.21.15.80:0/1219859609 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6104158a90 0x7f6104150520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:52.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.831+0000 7f610c33c700 1 --2- 172.21.15.80:0/1219859609 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6104070cf0 0x7f61041570e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:52.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.831+0000 7f610c33c700 1 --2- 172.21.15.80:0/1219859609 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6104152190 0x7f610414ffe0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:52.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.831+0000 7f610c33c700 1 -- 172.21.15.80:0/1219859609 >> 172.21.15.80:0/1219859609 conn(0x7f61040cc260 msgr2=0x7f610414d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:14:52.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.831+0000 7f610c33c700 1 -- 172.21.15.80:0/1219859609 shutdown_connections 2024-05-08T21:14:52.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:52.831+0000 7f610c33c700 1 -- 172.21.15.80:0/1219859609 wait complete. 2024-05-08T21:14:52.836 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 18 2024-05-08T21:14:52.848 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-05-08T21:14:54.848 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:14:54.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:54.982+0000 7f80a6f63700 1 Processor -- start 2024-05-08T21:14:54.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:54.982+0000 7f80a6f63700 1 -- start start 2024-05-08T21:14:54.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:54.983+0000 7f80a6f63700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f80a0154580 0x7f80a015abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:54.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:54.983+0000 7f80a6f63700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f80a00cbe40 0x7f80a00c48c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:54.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:54.983+0000 7f80a6f63700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80a00cad60 con 0x7f80a00c4e00 2024-05-08T21:14:54.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:54.983+0000 7f80a6f63700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80a00b2c60 con 0x7f80a0154580 2024-05-08T21:14:54.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:54.983+0000 7f80a6f63700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80a015d750 con 0x7f80a00cbe40 2024-05-08T21:14:54.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:54.983+0000 7f80a4cff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f80a0154580 0x7f80a015abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:54.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:54.983+0000 7f80a4cff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f80a0154580 0x7f80a015abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37210/0 (socket says 172.21.15.80:37210) 2024-05-08T21:14:54.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:54.983+0000 7f80a4cff700 1 -- 172.21.15.80:0/2494226562 learned_addr learned my addr 172.21.15.80:0/2494226562 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:14:54.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:54.983+0000 7f809ffff700 1 --2- 172.21.15.80:0/2494226562 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f80a00cbe40 0x7f80a00c48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:54.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:54.983+0000 7f80a4cff700 1 -- 172.21.15.80:0/2494226562 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f80a00cbe40 msgr2=0x7f80a00c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:14:54.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:54.983+0000 7f80a4cff700 1 --2- 172.21.15.80:0/2494226562 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f80a00cbe40 0x7f80a00c48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:54.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:54.983+0000 7f80a4cff700 1 -- 172.21.15.80:0/2494226562 >> v1:172.21.15.106:6789/0 conn(0x7f80a00c4e00 legacy=0x7f80a00cc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:14:54.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:54.983+0000 7f80a4cff700 1 -- 172.21.15.80:0/2494226562 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a015d930 con 0x7f80a0154580 2024-05-08T21:14:54.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:54.983+0000 7f809ffff700 1 --2- 172.21.15.80:0/2494226562 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f80a00cbe40 0x7f80a00c48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:14:54.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:54.984+0000 7f80a4cff700 1 --2- 172.21.15.80:0/2494226562 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80a0154580 0x7f80a015abe0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f80940098f0 tx=0x7f8094009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60ba61de55f68fa2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:14:54.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:54.984+0000 7f809f7fe700 1 -- 172.21.15.80:0/2494226562 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8094004230 con 0x7f80a0154580 2024-05-08T21:14:54.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:54.984+0000 7f809f7fe700 1 -- 172.21.15.80:0/2494226562 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8094004390 con 0x7f80a0154580 2024-05-08T21:14:54.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:54.984+0000 7f809f7fe700 1 -- 172.21.15.80:0/2494226562 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80940036a0 con 0x7f80a0154580 2024-05-08T21:14:54.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:54.984+0000 7f80a6f63700 1 -- 172.21.15.80:0/2494226562 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80a0154580 msgr2=0x7f80a015abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:54.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:54.984+0000 7f80a6f63700 1 --2- 172.21.15.80:0/2494226562 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80a0154580 0x7f80a015abe0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f80940098f0 tx=0x7f8094009c00 comp rx=0 tx=0).stop 2024-05-08T21:14:54.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:54.984+0000 7f80a6f63700 1 -- 172.21.15.80:0/2494226562 shutdown_connections 2024-05-08T21:14:54.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:54.984+0000 7f80a6f63700 1 --2- 172.21.15.80:0/2494226562 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80a0154580 0x7f80a015abe0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:54.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:54.984+0000 7f80a6f63700 1 --2- 172.21.15.80:0/2494226562 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f80a00cbe40 0x7f80a00c48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:54.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:54.984+0000 7f80a6f63700 1 -- 172.21.15.80:0/2494226562 >> 172.21.15.80:0/2494226562 conn(0x7f80a006c6a0 msgr2=0x7f80a006cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:14:54.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:54.984+0000 7f80a6f63700 1 -- 172.21.15.80:0/2494226562 shutdown_connections 2024-05-08T21:14:54.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:54.984+0000 7f80a6f63700 1 -- 172.21.15.80:0/2494226562 wait complete. 2024-05-08T21:14:54.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:54.985+0000 7f80a6f63700 1 Processor -- start 2024-05-08T21:14:54.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:54.986+0000 7f80a6f63700 1 -- start start 2024-05-08T21:14:54.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:54.986+0000 7f80a6f63700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f80a00c4e00 0x7f80a00c92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:54.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:54.986+0000 7f80a6f63700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f80a00cbe40 0x7f80a00c9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:54.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:54.986+0000 7f80a6f63700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80a0154580 0x7f80a0144440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:54.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:54.986+0000 7f80a6f63700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a00c7930 con 0x7f80a0154580 2024-05-08T21:14:54.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:54.986+0000 7f80a6f63700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a00cd8c0 con 0x7f80a00c4e00 2024-05-08T21:14:54.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:54.986+0000 7f80a6f63700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80a00c6d60 con 0x7f80a00cbe40 2024-05-08T21:14:54.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:54.986+0000 7f80a5500700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80a0154580 0x7f80a0144440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:54.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:54.987+0000 7f80a5500700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80a0154580 0x7f80a0144440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37214/0 (socket says 172.21.15.80:37214) 2024-05-08T21:14:54.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:54.987+0000 7f80a5500700 1 -- 172.21.15.80:0/1445987042 learned_addr learned my addr 172.21.15.80:0/1445987042 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:14:54.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:54.987+0000 7f809ffff700 1 --2- 172.21.15.80:0/1445987042 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f80a00cbe40 0x7f80a00c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:54.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:54.987+0000 7f80a4cff700 1 --2- 172.21.15.80:0/1445987042 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f80a00c4e00 0x7f80a00c92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:54.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:54.987+0000 7f80a5500700 1 -- 172.21.15.80:0/1445987042 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f80a00cbe40 msgr2=0x7f80a00c9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:54.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:54.987+0000 7f80a5500700 1 --2- 172.21.15.80:0/1445987042 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f80a00cbe40 0x7f80a00c9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:54.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:54.987+0000 7f80a5500700 1 -- 172.21.15.80:0/1445987042 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f80a00c4e00 msgr2=0x7f80a00c92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:54.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:54.987+0000 7f80a5500700 1 --2- 172.21.15.80:0/1445987042 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f80a00c4e00 0x7f80a00c92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:54.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:54.987+0000 7f80a5500700 1 -- 172.21.15.80:0/1445987042 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8094009550 con 0x7f80a0154580 2024-05-08T21:14:54.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:54.987+0000 7f80a5500700 1 --2- 172.21.15.80:0/1445987042 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80a0154580 0x7f80a0144440 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f809800cc10 tx=0x7f809800cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:14:54.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:54.987+0000 7f809d7fa700 1 -- 172.21.15.80:0/1445987042 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809800aa60 con 0x7f80a0154580 2024-05-08T21:14:54.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:54.987+0000 7f809d7fa700 1 -- 172.21.15.80:0/1445987042 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f809800abc0 con 0x7f80a0154580 2024-05-08T21:14:54.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:54.987+0000 7f80a6f63700 1 -- 172.21.15.80:0/1445987042 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80a00cdb60 con 0x7f80a0154580 2024-05-08T21:14:54.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:54.987+0000 7f809d7fa700 1 -- 172.21.15.80:0/1445987042 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8098012420 con 0x7f80a0154580 2024-05-08T21:14:54.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:54.987+0000 7f80a6f63700 1 -- 172.21.15.80:0/1445987042 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80a01f0730 con 0x7f80a0154580 2024-05-08T21:14:54.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:54.988+0000 7f80a6f63700 1 -- 172.21.15.80:0/1445987042 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80a00c7ae0 con 0x7f80a0154580 2024-05-08T21:14:54.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:54.989+0000 7f809d7fa700 1 -- 172.21.15.80:0/1445987042 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8098012580 con 0x7f80a0154580 2024-05-08T21:14:54.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:54.989+0000 7f809d7fa700 1 --2- 172.21.15.80:0/1445987042 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f808406acc0 0x7f808406d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:54.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:54.989+0000 7f809d7fa700 1 -- 172.21.15.80:0/1445987042 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6835+0+0 (secure 0 0 0) 0x7f8098089930 con 0x7f80a0154580 2024-05-08T21:14:54.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:54.989+0000 7f80a4cff700 1 --2- 172.21.15.80:0/1445987042 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f808406acc0 0x7f808406d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:54.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:54.990+0000 7f80a4cff700 1 --2- 172.21.15.80:0/1445987042 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f808406acc0 0x7f808406d180 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8094009130 tx=0x7f8094008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:14:54.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:54.993+0000 7f809d7fa700 1 -- 172.21.15.80:0/1445987042 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f80a00c7ae0 con 0x7f80a0154580 2024-05-08T21:14:55.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:55.237+0000 7f80a6f63700 1 -- 172.21.15.80:0/1445987042 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f80a00c7ae0 con 0x7f80a0154580 2024-05-08T21:14:55.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:55.237+0000 7f809d7fa700 1 -- 172.21.15.80:0/1445987042 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+5498 (secure 0 0 0) 0x7f80a00c7ae0 con 0x7f80a0154580 2024-05-08T21:14:55.241 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:14:55.241 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:14:52.619585+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4990},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4990":{"gid":4990,"name":"d","rank":0,"incarnation":16,"state":"up:rejoin","state_seq":39,"addr":"172.21.15.106:6836/1499761952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1499761952},{"type":"v1","addr":"172.21.15.106:6836","nonce":1499761952}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:14:55.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:55.239+0000 7f80a6f63700 1 -- 172.21.15.80:0/1445987042 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f808406acc0 msgr2=0x7f808406d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:55.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:55.239+0000 7f80a6f63700 1 --2- 172.21.15.80:0/1445987042 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f808406acc0 0x7f808406d180 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8094009130 tx=0x7f8094008030 comp rx=0 tx=0).stop 2024-05-08T21:14:55.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:55.239+0000 7f80a6f63700 1 -- 172.21.15.80:0/1445987042 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80a0154580 msgr2=0x7f80a0144440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:55.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:55.239+0000 7f80a6f63700 1 --2- 172.21.15.80:0/1445987042 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80a0154580 0x7f80a0144440 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f809800cc10 tx=0x7f809800cf20 comp rx=0 tx=0).stop 2024-05-08T21:14:55.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:55.239+0000 7f80a6f63700 1 -- 172.21.15.80:0/1445987042 shutdown_connections 2024-05-08T21:14:55.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:55.239+0000 7f80a6f63700 1 --2- 172.21.15.80:0/1445987042 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f808406acc0 0x7f808406d180 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:55.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:55.239+0000 7f80a6f63700 1 --2- 172.21.15.80:0/1445987042 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80a0154580 0x7f80a0144440 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:55.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:55.239+0000 7f80a6f63700 1 --2- 172.21.15.80:0/1445987042 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f80a00c4e00 0x7f80a00c92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:55.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:55.239+0000 7f80a6f63700 1 --2- 172.21.15.80:0/1445987042 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f80a00cbe40 0x7f80a00c9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:55.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:55.239+0000 7f80a6f63700 1 -- 172.21.15.80:0/1445987042 >> 172.21.15.80:0/1445987042 conn(0x7f80a006c6a0 msgr2=0x7f80a006ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:14:55.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:55.240+0000 7f80a6f63700 1 -- 172.21.15.80:0/1445987042 shutdown_connections 2024-05-08T21:14:55.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:55.240+0000 7f80a6f63700 1 -- 172.21.15.80:0/1445987042 wait complete. 2024-05-08T21:14:55.244 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 18 2024-05-08T21:14:55.256 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 18, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-05-08T21:10:03.725481+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 18, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_4990": { "addr": "172.21.15.106:6836/1499761952", "addrs": { "addrvec": [ { "addr": "172.21.15.106:6834", "nonce": 1499761952, "type": "v2" }, { "addr": "172.21.15.106:6836", "nonce": 1499761952, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4990, "incarnation": 16, "join_fscid": -1, "name": "d", "rank": 0, "state": "up:rejoin", "state_seq": 39 } }, "last_failure": 0, "last_failure_osd_epoch": 30, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-05-08T21:14:52.619585+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4990 } } } ], "standbys": [ { "addr": "172.21.15.106:6837/2762323230", "addrs": { "addrvec": [ { "addr": "172.21.15.106:6835", "nonce": 2762323230, "type": "v2" }, { "addr": "172.21.15.106:6837", "nonce": 2762323230, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4229, "incarnation": 0, "join_fscid": -1, "name": "f", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.80:6837/1121814432", "addrs": { "addrvec": [ { "addr": "172.21.15.80:6834", "nonce": 1121814432, "type": "v2" }, { "addr": "172.21.15.80:6837", "nonce": 1121814432, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4251, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.80:6839/1867024080", "addrs": { "addrvec": [ { "addr": "172.21.15.80:6838", "nonce": 1867024080, "type": "v2" }, { "addr": "172.21.15.80:6839", "nonce": 1867024080, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 2, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4254, "incarnation": 0, "join_fscid": -1, "name": "e", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.80:6836/1947012643", "addrs": { "addrvec": [ { "addr": "172.21.15.80:6835", "nonce": 1947012643, "type": "v2" }, { "addr": "172.21.15.80:6836", "nonce": 1947012643, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4273, "incarnation": 0, "join_fscid": -1, "name": "c", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-05-08T21:14:57.258 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:14:57.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.392+0000 7f1609a68700 1 Processor -- start 2024-05-08T21:14:57.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.392+0000 7f1609a68700 1 -- start start 2024-05-08T21:14:57.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.392+0000 7f1609a68700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f16040c5be0 0x7f1604158260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:57.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.392+0000 7f1609a68700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f16040c5fc0 0x7f16041587a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:57.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.393+0000 7f1609a68700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16040ccd80 con 0x7f16040c6440 2024-05-08T21:14:57.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.393+0000 7f1609a68700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1604066db0 con 0x7f16040c5fc0 2024-05-08T21:14:57.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.393+0000 7f1609a68700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1604072250 con 0x7f16040c5be0 2024-05-08T21:14:57.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.393+0000 7f1602ffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f16040c5fc0 0x7f16041587a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:57.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.393+0000 7f1602ffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f16040c5fc0 0x7f16041587a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37224/0 (socket says 172.21.15.80:37224) 2024-05-08T21:14:57.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.393+0000 7f1602ffd700 1 -- 172.21.15.80:0/3882446909 learned_addr learned my addr 172.21.15.80:0/3882446909 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:14:57.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.393+0000 7f16037fe700 1 --2- 172.21.15.80:0/3882446909 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f16040c5be0 0x7f1604158260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:57.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.393+0000 7f1602ffd700 1 -- 172.21.15.80:0/3882446909 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f16040c5be0 msgr2=0x7f1604158260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:14:57.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.393+0000 7f1602ffd700 1 --2- 172.21.15.80:0/3882446909 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f16040c5be0 0x7f1604158260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:57.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.393+0000 7f1602ffd700 1 -- 172.21.15.80:0/3882446909 >> v1:172.21.15.106:6789/0 conn(0x7f16040c6440 legacy=0x7f160415b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:14:57.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.393+0000 7f1602ffd700 1 -- 172.21.15.80:0/3882446909 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1604066780 con 0x7f16040c5fc0 2024-05-08T21:14:57.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.393+0000 7f1602ffd700 1 --2- 172.21.15.80:0/3882446909 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16040c5fc0 0x7f16041587a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f15f80098f0 tx=0x7f15f8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f067c54c17f8b4b3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:14:57.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.393+0000 7f16027fc700 1 -- 172.21.15.80:0/3882446909 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f8004230 con 0x7f16040c5fc0 2024-05-08T21:14:57.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.393+0000 7f16027fc700 1 -- 172.21.15.80:0/3882446909 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15f8004390 con 0x7f16040c5fc0 2024-05-08T21:14:57.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.393+0000 7f16027fc700 1 -- 172.21.15.80:0/3882446909 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f80036a0 con 0x7f16040c5fc0 2024-05-08T21:14:57.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.394+0000 7f1609a68700 1 -- 172.21.15.80:0/3882446909 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16040c5fc0 msgr2=0x7f16041587a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:57.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.394+0000 7f1609a68700 1 --2- 172.21.15.80:0/3882446909 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16040c5fc0 0x7f16041587a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f15f80098f0 tx=0x7f15f8009c00 comp rx=0 tx=0).stop 2024-05-08T21:14:57.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.394+0000 7f1609a68700 1 -- 172.21.15.80:0/3882446909 shutdown_connections 2024-05-08T21:14:57.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.394+0000 7f1609a68700 1 --2- 172.21.15.80:0/3882446909 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f16040c5be0 0x7f1604158260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:57.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.394+0000 7f1609a68700 1 --2- 172.21.15.80:0/3882446909 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16040c5fc0 0x7f16041587a0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:57.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.394+0000 7f1609a68700 1 -- 172.21.15.80:0/3882446909 >> 172.21.15.80:0/3882446909 conn(0x7f16040cc260 msgr2=0x7f16040cc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:14:57.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.394+0000 7f1609a68700 1 -- 172.21.15.80:0/3882446909 shutdown_connections 2024-05-08T21:14:57.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.394+0000 7f1609a68700 1 -- 172.21.15.80:0/3882446909 wait complete. 2024-05-08T21:14:57.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.395+0000 7f1609a68700 1 Processor -- start 2024-05-08T21:14:57.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.395+0000 7f1609a68700 1 -- start start 2024-05-08T21:14:57.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.396+0000 7f1609a68700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16040c5be0 0x7f16041435c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:57.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.396+0000 7f1609a68700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f16040c5fc0 0x7f160414c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:57.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.396+0000 7f1609a68700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f16040c6440 0x7f16041f0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:57.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.396+0000 7f1609a68700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1604153b40 con 0x7f16040c5be0 2024-05-08T21:14:57.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.396+0000 7f1609a68700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1604153060 con 0x7f16040c6440 2024-05-08T21:14:57.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.396+0000 7f1609a68700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f160414f240 con 0x7f16040c5fc0 2024-05-08T21:14:57.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.396+0000 7f16037fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16040c5be0 0x7f16041435c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:57.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.396+0000 7f16037fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16040c5be0 0x7f16041435c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37236/0 (socket says 172.21.15.80:37236) 2024-05-08T21:14:57.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.396+0000 7f16037fe700 1 -- 172.21.15.80:0/672677528 learned_addr learned my addr 172.21.15.80:0/672677528 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:14:57.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.396+0000 7f1602ffd700 1 --2- 172.21.15.80:0/672677528 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f16040c5fc0 0x7f160414c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:57.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.396+0000 7f1603fff700 1 --2- 172.21.15.80:0/672677528 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f16040c6440 0x7f16041f0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:57.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.397+0000 7f16037fe700 1 -- 172.21.15.80:0/672677528 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f16040c5fc0 msgr2=0x7f160414c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:57.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.397+0000 7f16037fe700 1 --2- 172.21.15.80:0/672677528 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f16040c5fc0 0x7f160414c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:57.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.397+0000 7f16037fe700 1 -- 172.21.15.80:0/672677528 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f16040c6440 msgr2=0x7f16041f0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:57.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.397+0000 7f16037fe700 1 --2- 172.21.15.80:0/672677528 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f16040c6440 0x7f16041f0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:57.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.397+0000 7f16037fe700 1 -- 172.21.15.80:0/672677528 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f8009550 con 0x7f16040c5be0 2024-05-08T21:14:57.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.397+0000 7f1603fff700 1 --2- 172.21.15.80:0/672677528 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f16040c6440 0x7f16041f0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:14:57.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.397+0000 7f16037fe700 1 --2- 172.21.15.80:0/672677528 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16040c5be0 0x7f16041435c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f15f400d830 tx=0x7f15f400dbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:14:57.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.397+0000 7f15ebfff700 1 -- 172.21.15.80:0/672677528 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f40125f0 con 0x7f16040c5be0 2024-05-08T21:14:57.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.397+0000 7f15ebfff700 1 -- 172.21.15.80:0/672677528 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15f4012750 con 0x7f16040c5be0 2024-05-08T21:14:57.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.397+0000 7f15ebfff700 1 -- 172.21.15.80:0/672677528 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f4012b00 con 0x7f16040c5be0 2024-05-08T21:14:57.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.397+0000 7f1609a68700 1 -- 172.21.15.80:0/672677528 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16041f1980 con 0x7f16040c5be0 2024-05-08T21:14:57.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.397+0000 7f1609a68700 1 -- 172.21.15.80:0/672677528 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16041f16a0 con 0x7f16040c5be0 2024-05-08T21:14:57.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.398+0000 7f1609a68700 1 -- 172.21.15.80:0/672677528 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f160404ec60 con 0x7f16040c5be0 2024-05-08T21:14:57.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.398+0000 7f15ebfff700 1 -- 172.21.15.80:0/672677528 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f15f4012c60 con 0x7f16040c5be0 2024-05-08T21:14:57.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.399+0000 7f15ebfff700 1 --2- 172.21.15.80:0/672677528 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f15f006ac90 0x7f15f006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:57.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.399+0000 7f15ebfff700 1 -- 172.21.15.80:0/672677528 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6835+0+0 (secure 0 0 0) 0x7f15f4089a80 con 0x7f16040c5be0 2024-05-08T21:14:57.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.399+0000 7f1602ffd700 1 --2- 172.21.15.80:0/672677528 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f15f006ac90 0x7f15f006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:57.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.399+0000 7f1602ffd700 1 --2- 172.21.15.80:0/672677528 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f15f006ac90 0x7f15f006d150 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f15f8009130 tx=0x7f15f8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:14:57.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.404+0000 7f15ebfff700 1 -- 172.21.15.80:0/672677528 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f15f4054880 con 0x7f16040c5be0 2024-05-08T21:14:57.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.646+0000 7f1609a68700 1 -- 172.21.15.80:0/672677528 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f160406ca20 con 0x7f16040c5be0 2024-05-08T21:14:57.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.647+0000 7f15ebfff700 1 -- 172.21.15.80:0/672677528 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+5498 (secure 0 0 0) 0x7f15f4057ea0 con 0x7f16040c5be0 2024-05-08T21:14:57.651 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:14:57.651 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:14:52.619585+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4990},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4990":{"gid":4990,"name":"d","rank":0,"incarnation":16,"state":"up:rejoin","state_seq":39,"addr":"172.21.15.106:6836/1499761952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1499761952},{"type":"v1","addr":"172.21.15.106:6836","nonce":1499761952}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:14:57.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.649+0000 7f1609a68700 1 -- 172.21.15.80:0/672677528 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f15f006ac90 msgr2=0x7f15f006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:57.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.649+0000 7f1609a68700 1 --2- 172.21.15.80:0/672677528 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f15f006ac90 0x7f15f006d150 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f15f8009130 tx=0x7f15f8008030 comp rx=0 tx=0).stop 2024-05-08T21:14:57.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.649+0000 7f1609a68700 1 -- 172.21.15.80:0/672677528 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16040c5be0 msgr2=0x7f16041435c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:57.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.649+0000 7f1609a68700 1 --2- 172.21.15.80:0/672677528 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16040c5be0 0x7f16041435c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f15f400d830 tx=0x7f15f400dbf0 comp rx=0 tx=0).stop 2024-05-08T21:14:57.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.649+0000 7f1609a68700 1 -- 172.21.15.80:0/672677528 shutdown_connections 2024-05-08T21:14:57.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.649+0000 7f1609a68700 1 --2- 172.21.15.80:0/672677528 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f15f006ac90 0x7f15f006d150 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:57.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.649+0000 7f1609a68700 1 --2- 172.21.15.80:0/672677528 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16040c5be0 0x7f16041435c0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:57.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.649+0000 7f1609a68700 1 --2- 172.21.15.80:0/672677528 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f16040c6440 0x7f16041f0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:57.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.649+0000 7f1609a68700 1 --2- 172.21.15.80:0/672677528 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f16040c5fc0 0x7f160414c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:57.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.649+0000 7f1609a68700 1 -- 172.21.15.80:0/672677528 >> 172.21.15.80:0/672677528 conn(0x7f16040cc260 msgr2=0x7f1604070bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:14:57.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.649+0000 7f1609a68700 1 -- 172.21.15.80:0/672677528 shutdown_connections 2024-05-08T21:14:57.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:57.649+0000 7f1609a68700 1 -- 172.21.15.80:0/672677528 wait complete. 2024-05-08T21:14:57.654 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 18 2024-05-08T21:14:57.665 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-05-08T21:14:59.666 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:14:59.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:59.806+0000 7fa440f91700 1 Processor -- start 2024-05-08T21:14:59.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:59.806+0000 7fa440f91700 1 -- start start 2024-05-08T21:14:59.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:59.807+0000 7fa440f91700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa43c0c2230 0x7fa43c0c6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:59.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:59.807+0000 7fa440f91700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa43c0cb570 0x7fa43c0cb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:59.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:59.807+0000 7fa440f91700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa43c16a850 0x7fa43c16ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:59.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:59.807+0000 7fa440f91700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa43c167f40 con 0x7fa43c0c2230 2024-05-08T21:14:59.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:59.807+0000 7fa440f91700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa43c16b220 con 0x7fa43c0cb570 2024-05-08T21:14:59.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:59.807+0000 7fa440f91700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa43c0c6bc0 con 0x7fa43c16a850 2024-05-08T21:14:59.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:59.807+0000 7fa43a59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa43c0c2230 0x7fa43c0c6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:59.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:59.807+0000 7fa43a59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa43c0c2230 0x7fa43c0c6680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37244/0 (socket says 172.21.15.80:37244) 2024-05-08T21:14:59.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:59.807+0000 7fa43a59c700 1 -- 172.21.15.80:0/829778594 learned_addr learned my addr 172.21.15.80:0/829778594 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:14:59.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:59.807+0000 7fa43ad9d700 1 --2- 172.21.15.80:0/829778594 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa43c16a850 0x7fa43c16ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:59.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:59.807+0000 7fa439d9b700 1 --2- 172.21.15.80:0/829778594 >> v2:172.21.15.106:3300/0 conn(0x7fa43c0cb570 0x7fa43c0cb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:59.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:59.811+0000 7fa43a59c700 1 -- 172.21.15.80:0/829778594 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa43c16a850 msgr2=0x7fa43c16ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:14:59.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:59.811+0000 7fa43a59c700 1 --2- 172.21.15.80:0/829778594 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa43c16a850 0x7fa43c16ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:59.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:59.811+0000 7fa43a59c700 1 -- 172.21.15.80:0/829778594 >> v2:172.21.15.106:3300/0 conn(0x7fa43c0cb570 msgr2=0x7fa43c0cb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:14:59.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:59.811+0000 7fa43a59c700 1 --2- 172.21.15.80:0/829778594 >> v2:172.21.15.106:3300/0 conn(0x7fa43c0cb570 0x7fa43c0cb9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:59.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:59.811+0000 7fa43a59c700 1 -- 172.21.15.80:0/829778594 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa43c167330 con 0x7fa43c0c2230 2024-05-08T21:14:59.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:59.811+0000 7fa43a59c700 1 --2- 172.21.15.80:0/829778594 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa43c0c2230 0x7fa43c0c6680 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fa43c164c10 tx=0x7fa43000bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7499fb768032139a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:14:59.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:59.811+0000 7fa43959a700 1 -- 172.21.15.80:0/829778594 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43000ca70 con 0x7fa43c0c2230 2024-05-08T21:14:59.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:59.811+0000 7fa43959a700 1 -- 172.21.15.80:0/829778594 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa43000cbd0 con 0x7fa43c0c2230 2024-05-08T21:14:59.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:59.811+0000 7fa43959a700 1 -- 172.21.15.80:0/829778594 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43000f460 con 0x7fa43c0c2230 2024-05-08T21:14:59.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:59.812+0000 7fa440f91700 1 -- 172.21.15.80:0/829778594 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa43c0c2230 msgr2=0x7fa43c0c6680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:59.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:59.812+0000 7fa440f91700 1 --2- 172.21.15.80:0/829778594 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa43c0c2230 0x7fa43c0c6680 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fa43c164c10 tx=0x7fa43000bc80 comp rx=0 tx=0).stop 2024-05-08T21:14:59.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:59.812+0000 7fa440f91700 1 -- 172.21.15.80:0/829778594 shutdown_connections 2024-05-08T21:14:59.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:59.812+0000 7fa440f91700 1 --2- 172.21.15.80:0/829778594 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa43c0c2230 0x7fa43c0c6680 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:59.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:59.812+0000 7fa440f91700 1 --2- 172.21.15.80:0/829778594 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa43c16a850 0x7fa43c16ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:59.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:59.812+0000 7fa440f91700 1 --2- 172.21.15.80:0/829778594 >> v2:172.21.15.106:3300/0 conn(0x7fa43c0cb570 0x7fa43c0cb9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:59.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:59.812+0000 7fa440f91700 1 -- 172.21.15.80:0/829778594 >> 172.21.15.80:0/829778594 conn(0x7fa43c06a9c0 msgr2=0x7fa43c06ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:14:59.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:59.812+0000 7fa440f91700 1 -- 172.21.15.80:0/829778594 shutdown_connections 2024-05-08T21:14:59.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:59.812+0000 7fa440f91700 1 -- 172.21.15.80:0/829778594 wait complete. 2024-05-08T21:14:59.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:59.814+0000 7fa440f91700 1 Processor -- start 2024-05-08T21:14:59.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:59.814+0000 7fa440f91700 1 -- start start 2024-05-08T21:14:59.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:59.814+0000 7fa440f91700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa43c0c2230 0x7fa43c1636e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:59.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:59.814+0000 7fa440f91700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa43c0cb570 0x7fa43c163e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:59.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:59.814+0000 7fa440f91700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa43c16a850 0x7fa43c1fc540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:59.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:59.814+0000 7fa440f91700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa43c200310 con 0x7fa43c0c2230 2024-05-08T21:14:59.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:59.814+0000 7fa440f91700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa43c164520 con 0x7fa43c0cb570 2024-05-08T21:14:59.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:59.814+0000 7fa440f91700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa43c164800 con 0x7fa43c16a850 2024-05-08T21:14:59.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:59.814+0000 7fa43a59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa43c0c2230 0x7fa43c1636e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:59.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:59.815+0000 7fa43a59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa43c0c2230 0x7fa43c1636e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37248/0 (socket says 172.21.15.80:37248) 2024-05-08T21:14:59.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:59.815+0000 7fa43a59c700 1 -- 172.21.15.80:0/2821489527 learned_addr learned my addr 172.21.15.80:0/2821489527 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:14:59.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:59.815+0000 7fa43ad9d700 1 --2- 172.21.15.80:0/2821489527 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa43c16a850 0x7fa43c1fc540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:59.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:59.815+0000 7fa439d9b700 1 --2- 172.21.15.80:0/2821489527 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa43c0cb570 0x7fa43c163e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:59.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:59.815+0000 7fa43a59c700 1 -- 172.21.15.80:0/2821489527 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa43c16a850 msgr2=0x7fa43c1fc540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:59.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:59.815+0000 7fa43a59c700 1 --2- 172.21.15.80:0/2821489527 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa43c16a850 0x7fa43c1fc540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:59.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:59.815+0000 7fa43a59c700 1 -- 172.21.15.80:0/2821489527 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa43c0cb570 msgr2=0x7fa43c163e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:14:59.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:59.815+0000 7fa43a59c700 1 --2- 172.21.15.80:0/2821489527 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa43c0cb570 0x7fa43c163e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:14:59.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:59.815+0000 7fa43a59c700 1 -- 172.21.15.80:0/2821489527 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa43000b600 con 0x7fa43c0c2230 2024-05-08T21:14:59.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:59.815+0000 7fa439d9b700 1 --2- 172.21.15.80:0/2821489527 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa43c0cb570 0x7fa43c163e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:14:59.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:59.815+0000 7fa43a59c700 1 --2- 172.21.15.80:0/2821489527 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa43c0c2230 0x7fa43c1636e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fa4300090b0 tx=0x7fa430004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:14:59.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:59.815+0000 7fa42affd700 1 -- 172.21.15.80:0/2821489527 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43001c070 con 0x7fa43c0c2230 2024-05-08T21:14:59.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:59.815+0000 7fa42affd700 1 -- 172.21.15.80:0/2821489527 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa43000c870 con 0x7fa43c0c2230 2024-05-08T21:14:59.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:59.815+0000 7fa42affd700 1 -- 172.21.15.80:0/2821489527 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa430004270 con 0x7fa43c0c2230 2024-05-08T21:14:59.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:59.815+0000 7fa440f91700 1 -- 172.21.15.80:0/2821489527 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa43c1ffc50 con 0x7fa43c0c2230 2024-05-08T21:14:59.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:59.815+0000 7fa440f91700 1 -- 172.21.15.80:0/2821489527 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa43c0c5750 con 0x7fa43c0c2230 2024-05-08T21:14:59.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:59.816+0000 7fa440f91700 1 -- 172.21.15.80:0/2821489527 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa43c1ffab0 con 0x7fa43c0c2230 2024-05-08T21:14:59.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:59.817+0000 7fa42affd700 1 -- 172.21.15.80:0/2821489527 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa4300043d0 con 0x7fa43c0c2230 2024-05-08T21:14:59.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:59.817+0000 7fa42affd700 1 --2- 172.21.15.80:0/2821489527 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fa41c06ac90 0x7fa41c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:14:59.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:59.817+0000 7fa42affd700 1 -- 172.21.15.80:0/2821489527 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6835+0+0 (secure 0 0 0) 0x7fa43008ac70 con 0x7fa43c0c2230 2024-05-08T21:14:59.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:59.817+0000 7fa439d9b700 1 --2- 172.21.15.80:0/2821489527 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fa41c06ac90 0x7fa41c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:14:59.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:59.817+0000 7fa439d9b700 1 --2- 172.21.15.80:0/2821489527 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fa41c06ac90 0x7fa41c06d150 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa43c067ed0 tx=0x7fa42c009180 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:14:59.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:14:59.821+0000 7fa42affd700 1 -- 172.21.15.80:0/2821489527 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fa43c1ffab0 con 0x7fa43c0c2230 2024-05-08T21:15:00.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:00.074+0000 7fa440f91700 1 -- 172.21.15.80:0/2821489527 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa43c1ffab0 con 0x7fa43c0c2230 2024-05-08T21:15:00.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:00.074+0000 7fa42affd700 1 -- 172.21.15.80:0/2821489527 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+5498 (secure 0 0 0) 0x7fa43c1ffab0 con 0x7fa43c0c2230 2024-05-08T21:15:00.078 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:15:00.078 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:14:57.684476+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4990},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4990":{"gid":4990,"name":"d","rank":0,"incarnation":16,"state":"up:active","state_seq":41,"addr":"172.21.15.106:6836/1499761952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1499761952},{"type":"v1","addr":"172.21.15.106:6836","nonce":1499761952}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:15:00.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:00.076+0000 7fa440f91700 1 -- 172.21.15.80:0/2821489527 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fa41c06ac90 msgr2=0x7fa41c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:15:00.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:00.076+0000 7fa440f91700 1 --2- 172.21.15.80:0/2821489527 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fa41c06ac90 0x7fa41c06d150 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa43c067ed0 tx=0x7fa42c009180 comp rx=0 tx=0).stop 2024-05-08T21:15:00.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:00.076+0000 7fa440f91700 1 -- 172.21.15.80:0/2821489527 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa43c0c2230 msgr2=0x7fa43c1636e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:15:00.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:00.076+0000 7fa440f91700 1 --2- 172.21.15.80:0/2821489527 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa43c0c2230 0x7fa43c1636e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fa4300090b0 tx=0x7fa430004750 comp rx=0 tx=0).stop 2024-05-08T21:15:00.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:00.076+0000 7fa440f91700 1 -- 172.21.15.80:0/2821489527 shutdown_connections 2024-05-08T21:15:00.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:00.076+0000 7fa440f91700 1 --2- 172.21.15.80:0/2821489527 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fa41c06ac90 0x7fa41c06d150 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:15:00.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:00.076+0000 7fa440f91700 1 --2- 172.21.15.80:0/2821489527 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa43c0c2230 0x7fa43c1636e0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:15:00.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:00.076+0000 7fa440f91700 1 --2- 172.21.15.80:0/2821489527 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa43c16a850 0x7fa43c1fc540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:15:00.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:00.076+0000 7fa440f91700 1 --2- 172.21.15.80:0/2821489527 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa43c0cb570 0x7fa43c163e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:15:00.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:00.076+0000 7fa440f91700 1 -- 172.21.15.80:0/2821489527 >> 172.21.15.80:0/2821489527 conn(0x7fa43c06a9c0 msgr2=0x7fa43c0c9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:15:00.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:00.077+0000 7fa440f91700 1 -- 172.21.15.80:0/2821489527 shutdown_connections 2024-05-08T21:15:00.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:00.077+0000 7fa440f91700 1 -- 172.21.15.80:0/2821489527 wait complete. 2024-05-08T21:15:00.081 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 19 2024-05-08T21:15:00.093 INFO:tasks.mds_thrash.fs.[cephfs]:mds.d has gained rank=0, replacing gid=4288 2024-05-08T21:15:00.093 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 9 secs before reviving mds.b 2024-05-08T21:15:03.406 INFO:tasks.ceph.mds.d.smithi106.stderr:2024-05-08T21:15:03.403+0000 7f35cb4c8700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-08T21:15:09.094 INFO:tasks.mds_thrash.fs.[cephfs]:reviving mds.b 2024-05-08T21:15:09.094 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-08T21:15:09.094 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-08T21:15:09.101 INFO:tasks.ceph.mds.b:Started 2024-05-08T21:15:09.101 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:15:09.344 INFO:tasks.ceph.mds.b.smithi106.stdout:starting mds.b at 2024-05-08T21:15:09.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:09.364+0000 7f67ded31700 1 Processor -- start 2024-05-08T21:15:09.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:09.364+0000 7f67ded31700 1 -- start start 2024-05-08T21:15:09.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:09.365+0000 7f67ded31700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f67d80c21a0 0x7f67d80c6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:15:09.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:09.365+0000 7f67ded31700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f67d816af60 0x7f67d80cb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:15:09.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:09.365+0000 7f67ded31700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67d8167f40 con 0x7f67d80cb570 2024-05-08T21:15:09.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:09.365+0000 7f67ded31700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67d80c6bc0 con 0x7f67d816af60 2024-05-08T21:15:09.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:09.365+0000 7f67ded31700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67d8167330 con 0x7f67d80c21a0 2024-05-08T21:15:09.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:09.367+0000 7f67dcacd700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f67d80c21a0 0x7f67d80c6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:15:09.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:09.367+0000 7f67dcacd700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f67d80c21a0 0x7f67d80c6680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:36346/0 (socket says 172.21.15.80:36346) 2024-05-08T21:15:09.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:09.367+0000 7f67dcacd700 1 -- 172.21.15.80:0/3112502081 learned_addr learned my addr 172.21.15.80:0/3112502081 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:15:09.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:09.368+0000 7f67dd2ce700 1 --2- 172.21.15.80:0/3112502081 >> v2:172.21.15.106:3300/0 conn(0x7f67d816af60 0x7f67d80cb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:15:09.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:09.369+0000 7f67dd2ce700 1 -- 172.21.15.80:0/3112502081 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f67d80c21a0 msgr2=0x7f67d80c6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:15:09.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:09.369+0000 7f67dd2ce700 1 --2- 172.21.15.80:0/3112502081 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f67d80c21a0 0x7f67d80c6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:15:09.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:09.369+0000 7f67dd2ce700 1 -- 172.21.15.80:0/3112502081 >> v1:172.21.15.106:6789/0 conn(0x7f67d80cb570 legacy=0x7f67d816a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:15:09.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:09.369+0000 7f67dd2ce700 1 -- 172.21.15.80:0/3112502081 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67d8167610 con 0x7f67d816af60 2024-05-08T21:15:09.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:09.371+0000 7f67dd2ce700 1 --2- 172.21.15.80:0/3112502081 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67d816af60 0x7f67d80cb9b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f67d0009d90 tx=0x7f67d000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b018ececa87443af server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:15:09.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:09.374+0000 7f67d77fe700 1 -- 172.21.15.80:0/3112502081 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d000e070 con 0x7f67d816af60 2024-05-08T21:15:09.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:09.374+0000 7f67d77fe700 1 -- 172.21.15.80:0/3112502081 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67d000bae0 con 0x7f67d816af60 2024-05-08T21:15:09.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:09.374+0000 7f67d77fe700 1 -- 172.21.15.80:0/3112502081 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d000be90 con 0x7f67d816af60 2024-05-08T21:15:09.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:09.375+0000 7f67ded31700 1 -- 172.21.15.80:0/3112502081 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67d816af60 msgr2=0x7f67d80cb9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:15:09.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:09.375+0000 7f67ded31700 1 --2- 172.21.15.80:0/3112502081 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67d816af60 0x7f67d80cb9b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f67d0009d90 tx=0x7f67d000b330 comp rx=0 tx=0).stop 2024-05-08T21:15:09.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:09.383+0000 7f67ded31700 1 -- 172.21.15.80:0/3112502081 shutdown_connections 2024-05-08T21:15:09.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:09.383+0000 7f67ded31700 1 --2- 172.21.15.80:0/3112502081 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67d816af60 0x7f67d80cb9b0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:15:09.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:09.383+0000 7f67ded31700 1 --2- 172.21.15.80:0/3112502081 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f67d80c21a0 0x7f67d80c6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:15:09.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:09.383+0000 7f67ded31700 1 -- 172.21.15.80:0/3112502081 >> 172.21.15.80:0/3112502081 conn(0x7f67d806a9c0 msgr2=0x7f67d806ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:15:09.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:09.386+0000 7f67ded31700 1 -- 172.21.15.80:0/3112502081 shutdown_connections 2024-05-08T21:15:09.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:09.386+0000 7f67ded31700 1 -- 172.21.15.80:0/3112502081 wait complete. 2024-05-08T21:15:09.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:09.388+0000 7f67ded31700 1 Processor -- start 2024-05-08T21:15:09.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:09.388+0000 7f67ded31700 1 -- start start 2024-05-08T21:15:09.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:09.389+0000 7f67ded31700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f67d80c21a0 0x7f67d82092c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:15:09.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:09.389+0000 7f67ded31700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67d80cb570 0x7f67d815f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:15:09.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:09.389+0000 7f67ded31700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67d816af60 0x7f67d815f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:15:09.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:09.389+0000 7f67ded31700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67d8071f60 con 0x7f67d816af60 2024-05-08T21:15:09.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:09.389+0000 7f67ded31700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67d8206060 con 0x7f67d80cb570 2024-05-08T21:15:09.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:09.389+0000 7f67ded31700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67d8209800 con 0x7f67d80c21a0 2024-05-08T21:15:09.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:09.390+0000 7f67dd2ce700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67d816af60 0x7f67d815f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:15:09.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:09.390+0000 7f67dd2ce700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67d816af60 0x7f67d815f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38418/0 (socket says 172.21.15.80:38418) 2024-05-08T21:15:09.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:09.390+0000 7f67dd2ce700 1 -- 172.21.15.80:0/409446087 learned_addr learned my addr 172.21.15.80:0/409446087 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:15:09.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:09.390+0000 7f67dd2ce700 1 -- 172.21.15.80:0/409446087 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f67d80c21a0 msgr2=0x7f67d82092c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T21:15:09.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:09.390+0000 7f67dd2ce700 1 --2- 172.21.15.80:0/409446087 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f67d80c21a0 0x7f67d82092c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:15:09.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:09.390+0000 7f67dd2ce700 1 -- 172.21.15.80:0/409446087 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67d80cb570 msgr2=0x7f67d815f1c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T21:15:09.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:09.390+0000 7f67dd2ce700 1 --2- 172.21.15.80:0/409446087 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67d80cb570 0x7f67d815f1c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:15:09.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:09.390+0000 7f67dd2ce700 1 -- 172.21.15.80:0/409446087 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67d0009a70 con 0x7f67d816af60 2024-05-08T21:15:09.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:09.391+0000 7f67dd2ce700 1 --2- 172.21.15.80:0/409446087 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67d816af60 0x7f67d815f700 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f67d80cc150 tx=0x7f67d0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:15:09.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:09.391+0000 7f67d57fa700 1 -- 172.21.15.80:0/409446087 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d00046a0 con 0x7f67d816af60 2024-05-08T21:15:09.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:09.391+0000 7f67d57fa700 1 -- 172.21.15.80:0/409446087 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67d0004800 con 0x7f67d816af60 2024-05-08T21:15:09.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:09.391+0000 7f67d57fa700 1 -- 172.21.15.80:0/409446087 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d0004970 con 0x7f67d816af60 2024-05-08T21:15:09.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:09.391+0000 7f67ded31700 1 -- 172.21.15.80:0/409446087 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67d80735b0 con 0x7f67d816af60 2024-05-08T21:15:09.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:09.391+0000 7f67ded31700 1 -- 172.21.15.80:0/409446087 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67d8205730 con 0x7f67d816af60 2024-05-08T21:15:09.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:09.394+0000 7f67d57fa700 1 -- 172.21.15.80:0/409446087 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f67d0012650 con 0x7f67d816af60 2024-05-08T21:15:09.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:09.394+0000 7f67d57fa700 1 --2- 172.21.15.80:0/409446087 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f67c406ad60 0x7f67c406d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:15:09.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:09.394+0000 7f67d57fa700 1 -- 172.21.15.80:0/409446087 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6835+0+0 (secure 0 0 0) 0x7f67d008b990 con 0x7f67d816af60 2024-05-08T21:15:09.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:09.395+0000 7f67ded31700 1 -- 172.21.15.80:0/409446087 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67b80052f0 con 0x7f67d816af60 2024-05-08T21:15:09.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:09.395+0000 7f67dcacd700 1 --2- 172.21.15.80:0/409446087 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f67c406ad60 0x7f67c406d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:15:09.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:09.403+0000 7f67dcacd700 1 --2- 172.21.15.80:0/409446087 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f67c406ad60 0x7f67c406d220 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f67cc0099c0 tx=0x7f67cc0092c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:15:09.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:09.403+0000 7f67d57fa700 1 -- 172.21.15.80:0/409446087 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f67d005a200 con 0x7f67d816af60 2024-05-08T21:15:09.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:09.913+0000 7f67ded31700 1 -- 172.21.15.80:0/409446087 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f67b8005b20 con 0x7f67d816af60 2024-05-08T21:15:09.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:09.914+0000 7f67d57fa700 1 -- 172.21.15.80:0/409446087 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+6255 (secure 0 0 0) 0x7f67d0059d90 con 0x7f67d816af60 2024-05-08T21:15:09.923 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:15:09.923 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":5086,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/791920806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":791920806},{"type":"v1","addr":"172.21.15.106:6833","nonce":791920806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:14:57.684476+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4990},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4990":{"gid":4990,"name":"d","rank":0,"incarnation":16,"state":"up:active","state_seq":41,"addr":"172.21.15.106:6836/1499761952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1499761952},{"type":"v1","addr":"172.21.15.106:6836","nonce":1499761952}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:15:09.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:09.919+0000 7f67ded31700 1 -- 172.21.15.80:0/409446087 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f67c406ad60 msgr2=0x7f67c406d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:15:09.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:09.919+0000 7f67ded31700 1 --2- 172.21.15.80:0/409446087 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f67c406ad60 0x7f67c406d220 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f67cc0099c0 tx=0x7f67cc0092c0 comp rx=0 tx=0).stop 2024-05-08T21:15:09.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:09.919+0000 7f67ded31700 1 -- 172.21.15.80:0/409446087 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67d816af60 msgr2=0x7f67d815f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:15:09.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:09.919+0000 7f67ded31700 1 --2- 172.21.15.80:0/409446087 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67d816af60 0x7f67d815f700 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f67d80cc150 tx=0x7f67d0004ad0 comp rx=0 tx=0).stop 2024-05-08T21:15:09.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:09.920+0000 7f67ded31700 1 -- 172.21.15.80:0/409446087 shutdown_connections 2024-05-08T21:15:09.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:09.920+0000 7f67ded31700 1 --2- 172.21.15.80:0/409446087 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f67c406ad60 0x7f67c406d220 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:15:09.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:09.920+0000 7f67ded31700 1 --2- 172.21.15.80:0/409446087 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f67d816af60 0x7f67d815f700 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:15:09.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:09.920+0000 7f67ded31700 1 --2- 172.21.15.80:0/409446087 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f67d80c21a0 0x7f67d82092c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:15:09.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:09.920+0000 7f67ded31700 1 --2- 172.21.15.80:0/409446087 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67d80cb570 0x7f67d815f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:15:09.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:09.920+0000 7f67ded31700 1 -- 172.21.15.80:0/409446087 >> 172.21.15.80:0/409446087 conn(0x7f67d806a9c0 msgr2=0x7f67d81659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:15:09.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:09.920+0000 7f67ded31700 1 -- 172.21.15.80:0/409446087 shutdown_connections 2024-05-08T21:15:09.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:15:09.920+0000 7f67ded31700 1 -- 172.21.15.80:0/409446087 wait complete. 2024-05-08T21:15:09.935 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 20 2024-05-08T21:15:09.943 INFO:tasks.mds_thrash.fs.[cephfs]:mds.b reported in up:standby state 2024-05-08T21:15:09.944 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 111 secs before thrashing 2024-05-08T21:15:12.506 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:15:12.513 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:15:42.920 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:15:42.929 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:16:13.837 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:16:13.840 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:16:45.012 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:16:45.015 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:16:45.427 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T21:16:45.424+0000 7f67792d8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 63149) UID: 0 2024-05-08T21:16:45.428 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T21:16:45.424+0000 7f80031f2700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 63149) UID: 0 2024-05-08T21:16:45.429 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T21:16:45.425+0000 7fbcd7a67700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 63149) UID: 0 2024-05-08T21:16:45.430 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T21:16:45.424+0000 7fb31b39a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 63149) UID: 0 2024-05-08T21:17:00.945 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:17:03.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:03.614+0000 7f45a5155700 1 Processor -- start 2024-05-08T21:17:03.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:03.614+0000 7f45a5155700 1 -- start start 2024-05-08T21:17:03.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:03.615+0000 7f45a5155700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f45a01587c0 0x7f45a00cc440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:03.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:03.615+0000 7f45a5155700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f45a00cc980 0x7f45a00b45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:03.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:03.615+0000 7f45a5155700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45a015e930 con 0x7f45a00b4af0 2024-05-08T21:17:03.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:03.615+0000 7f45a5155700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45a015ec10 con 0x7f45a00cc980 2024-05-08T21:17:03.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:03.615+0000 7f45a5155700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45a015eef0 con 0x7f45a01587c0 2024-05-08T21:17:03.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:03.615+0000 7f459f59e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f45a00b4af0 0x7f45a01620f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60448/0 (socket says 172.21.15.80:60448) 2024-05-08T21:17:03.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:03.615+0000 7f459f59e700 1 -- 172.21.15.80:0/2313323163 learned_addr learned my addr 172.21.15.80:0/2313323163 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:17:03.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:03.615+0000 7f459ed9d700 1 --2- 172.21.15.80:0/2313323163 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f45a01587c0 0x7f45a00cc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:03.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:03.616+0000 7f459659c700 1 --2- 172.21.15.80:0/2313323163 >> v2:172.21.15.80:3300/0 conn(0x7f45a00cc980 0x7f45a00b45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:03.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:03.616+0000 7f459ed9d700 1 -- 172.21.15.80:0/2313323163 >> v2:172.21.15.80:3300/0 conn(0x7f45a00cc980 msgr2=0x7f45a00b45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:17:03.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:03.616+0000 7f459ed9d700 1 --2- 172.21.15.80:0/2313323163 >> v2:172.21.15.80:3300/0 conn(0x7f45a00cc980 0x7f45a00b45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:03.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:03.616+0000 7f459ed9d700 1 -- 172.21.15.80:0/2313323163 >> v1:172.21.15.80:6789/0 conn(0x7f45a00b4af0 legacy=0x7f45a01620f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:03.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:03.616+0000 7f459ed9d700 1 -- 172.21.15.80:0/2313323163 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a015f1d0 con 0x7f45a01587c0 2024-05-08T21:17:03.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:03.616+0000 7f459ed9d700 1 --2- 172.21.15.80:0/2313323163 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f45a01587c0 0x7f45a00cc440 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4590009840 tx=0x7f4590009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89ea5329c64c9f81 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:17:03.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:03.618+0000 7f459e59c700 1 -- 172.21.15.80:0/2313323163 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4590011830 con 0x7f45a01587c0 2024-05-08T21:17:03.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:03.618+0000 7f459e59c700 1 -- 172.21.15.80:0/2313323163 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4590011990 con 0x7f45a01587c0 2024-05-08T21:17:03.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:03.618+0000 7f459e59c700 1 -- 172.21.15.80:0/2313323163 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4590011d00 con 0x7f45a01587c0 2024-05-08T21:17:03.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:03.619+0000 7f45a5155700 1 -- 172.21.15.80:0/2313323163 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f45a01587c0 msgr2=0x7f45a00cc440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:03.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:03.619+0000 7f45a5155700 1 --2- 172.21.15.80:0/2313323163 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f45a01587c0 0x7f45a00cc440 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4590009840 tx=0x7f4590009b50 comp rx=0 tx=0).stop 2024-05-08T21:17:03.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:03.619+0000 7f45a5155700 1 -- 172.21.15.80:0/2313323163 shutdown_connections 2024-05-08T21:17:03.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:03.619+0000 7f45a5155700 1 --2- 172.21.15.80:0/2313323163 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f45a01587c0 0x7f45a00cc440 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:03.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:03.619+0000 7f45a5155700 1 --2- 172.21.15.80:0/2313323163 >> v2:172.21.15.80:3300/0 conn(0x7f45a00cc980 0x7f45a00b45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:03.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:03.619+0000 7f45a5155700 1 -- 172.21.15.80:0/2313323163 >> 172.21.15.80:0/2313323163 conn(0x7f45a006ad70 msgr2=0x7f45a006c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:17:03.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:03.620+0000 7f45a5155700 1 -- 172.21.15.80:0/2313323163 shutdown_connections 2024-05-08T21:17:03.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:03.620+0000 7f45a5155700 1 -- 172.21.15.80:0/2313323163 wait complete. 2024-05-08T21:17:03.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:03.622+0000 7f45a5155700 1 Processor -- start 2024-05-08T21:17:03.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:03.623+0000 7f45a5155700 1 -- start start 2024-05-08T21:17:03.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:03.624+0000 7f45a5155700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f45a00b4af0 0x7f45a014f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:03.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:03.624+0000 7f45a5155700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f45a00cc980 0x7f45a015d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:03.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:03.624+0000 7f45a5155700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f45a01587c0 0x7f45a014daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:03.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:03.624+0000 7f45a5155700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a00c94e0 con 0x7f45a01587c0 2024-05-08T21:17:03.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:03.624+0000 7f45a5155700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a014f750 con 0x7f45a00b4af0 2024-05-08T21:17:03.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:03.624+0000 7f45a5155700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45a00c8c60 con 0x7f45a00cc980 2024-05-08T21:17:03.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:03.624+0000 7f459f59e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f45a01587c0 0x7f45a014daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:03.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:03.624+0000 7f459f59e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f45a01587c0 0x7f45a014daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52016/0 (socket says 172.21.15.80:52016) 2024-05-08T21:17:03.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:03.624+0000 7f459f59e700 1 -- 172.21.15.80:0/1306077716 learned_addr learned my addr 172.21.15.80:0/1306077716 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:17:03.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:03.625+0000 7f459f59e700 1 -- 172.21.15.80:0/1306077716 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f45a00cc980 msgr2=0x7f45a015d840 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T21:17:03.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:03.625+0000 7f459f59e700 1 --2- 172.21.15.80:0/1306077716 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f45a00cc980 0x7f45a015d840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:03.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:03.625+0000 7f459f59e700 1 -- 172.21.15.80:0/1306077716 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f45a00b4af0 msgr2=0x7f45a014f210 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T21:17:03.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:03.625+0000 7f459f59e700 1 --2- 172.21.15.80:0/1306077716 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f45a00b4af0 0x7f45a014f210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:03.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:03.625+0000 7f459f59e700 1 -- 172.21.15.80:0/1306077716 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45900094a0 con 0x7f45a01587c0 2024-05-08T21:17:03.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:03.625+0000 7f459f59e700 1 --2- 172.21.15.80:0/1306077716 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f45a01587c0 0x7f45a014daf0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f459800cad0 tx=0x7f459800ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:17:03.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:03.625+0000 7f4597fff700 1 -- 172.21.15.80:0/1306077716 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459800aac0 con 0x7f45a01587c0 2024-05-08T21:17:03.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:03.625+0000 7f4597fff700 1 -- 172.21.15.80:0/1306077716 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f459800ac20 con 0x7f45a01587c0 2024-05-08T21:17:03.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:03.625+0000 7f4597fff700 1 -- 172.21.15.80:0/1306077716 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4598012400 con 0x7f45a01587c0 2024-05-08T21:17:03.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:03.625+0000 7f45a5155700 1 -- 172.21.15.80:0/1306077716 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45a00c8f20 con 0x7f45a01587c0 2024-05-08T21:17:03.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:03.625+0000 7f45a5155700 1 -- 172.21.15.80:0/1306077716 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45a014ce70 con 0x7f45a01587c0 2024-05-08T21:17:03.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:03.627+0000 7f45a5155700 1 -- 172.21.15.80:0/1306077716 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45a014ccd0 con 0x7f45a01587c0 2024-05-08T21:17:03.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:03.628+0000 7f4597fff700 1 -- 172.21.15.80:0/1306077716 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f459801b3b0 con 0x7f45a01587c0 2024-05-08T21:17:03.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:03.628+0000 7f4597fff700 1 --2- 172.21.15.80:0/1306077716 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f458006ace0 0x7f458006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:03.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:03.629+0000 7f459ed9d700 1 --2- 172.21.15.80:0/1306077716 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f458006ace0 0x7f458006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:03.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:03.630+0000 7f459ed9d700 1 --2- 172.21.15.80:0/1306077716 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f458006ace0 0x7f458006d1a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f45900090b0 tx=0x7f4590008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:17:03.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:03.634+0000 7f4597fff700 1 -- 172.21.15.80:0/1306077716 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6835+0+0 (secure 0 0 0) 0x7f4598057e20 con 0x7f45a01587c0 2024-05-08T21:17:03.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:03.636+0000 7f4597fff700 1 -- 172.21.15.80:0/1306077716 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f45a014ccd0 con 0x7f45a01587c0 2024-05-08T21:17:04.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:04.169+0000 7f45a5155700 1 -- 172.21.15.80:0/1306077716 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f45a014ccd0 con 0x7f45a01587c0 2024-05-08T21:17:04.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:04.170+0000 7f4597fff700 1 -- 172.21.15.80:0/1306077716 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+6255 (secure 0 0 0) 0x7f45a014ccd0 con 0x7f45a01587c0 2024-05-08T21:17:04.173 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:17:04.173 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":5086,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/791920806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":791920806},{"type":"v1","addr":"172.21.15.106:6833","nonce":791920806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:14:57.684476+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4990},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4990":{"gid":4990,"name":"d","rank":0,"incarnation":16,"state":"up:active","state_seq":41,"addr":"172.21.15.106:6836/1499761952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1499761952},{"type":"v1","addr":"172.21.15.106:6836","nonce":1499761952}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:17:04.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:04.189+0000 7f45a5155700 1 -- 172.21.15.80:0/1306077716 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f458006ace0 msgr2=0x7f458006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:04.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:04.189+0000 7f45a5155700 1 --2- 172.21.15.80:0/1306077716 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f458006ace0 0x7f458006d1a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f45900090b0 tx=0x7f4590008030 comp rx=0 tx=0).stop 2024-05-08T21:17:04.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:04.189+0000 7f45a5155700 1 -- 172.21.15.80:0/1306077716 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f45a01587c0 msgr2=0x7f45a014daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:04.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:04.189+0000 7f45a5155700 1 --2- 172.21.15.80:0/1306077716 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f45a01587c0 0x7f45a014daf0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f459800cad0 tx=0x7f459800ce90 comp rx=0 tx=0).stop 2024-05-08T21:17:04.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:04.191+0000 7f45a5155700 1 -- 172.21.15.80:0/1306077716 shutdown_connections 2024-05-08T21:17:04.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:04.191+0000 7f45a5155700 1 --2- 172.21.15.80:0/1306077716 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f458006ace0 0x7f458006d1a0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:04.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:04.191+0000 7f45a5155700 1 --2- 172.21.15.80:0/1306077716 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f45a01587c0 0x7f45a014daf0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:04.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:04.191+0000 7f45a5155700 1 --2- 172.21.15.80:0/1306077716 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f45a00b4af0 0x7f45a014f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:04.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:04.191+0000 7f45a5155700 1 --2- 172.21.15.80:0/1306077716 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f45a00cc980 0x7f45a015d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:04.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:04.191+0000 7f45a5155700 1 -- 172.21.15.80:0/1306077716 >> 172.21.15.80:0/1306077716 conn(0x7f45a006ad70 msgr2=0x7f45a0150240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:17:04.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:04.192+0000 7f45a5155700 1 -- 172.21.15.80:0/1306077716 shutdown_connections 2024-05-08T21:17:04.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:04.192+0000 7f45a5155700 1 -- 172.21.15.80:0/1306077716 wait complete. 2024-05-08T21:17:04.205 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 20 2024-05-08T21:17:04.259 INFO:tasks.mds_thrash.fs.[cephfs]:kill mds.d (rank=0) 2024-05-08T21:17:04.260 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-08T21:17:04.260 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:17:04.269 INFO:tasks.ceph.mds.d:Stopped 2024-05-08T21:17:04.269 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:17:05.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.014+0000 7fe4f8783700 1 Processor -- start 2024-05-08T21:17:05.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.019+0000 7fe4f8783700 1 -- start start 2024-05-08T21:17:05.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.019+0000 7fe4f8783700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe4f0150ac0 0x7fe4f015ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:05.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.019+0000 7fe4f8783700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe4f00c8cb0 0x7fe4f00c3f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:05.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.019+0000 7fe4f8783700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4f00c70e0 con 0x7fe4f0150ea0 2024-05-08T21:17:05.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.019+0000 7fe4f8783700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4f00c8820 con 0x7fe4f00c8cb0 2024-05-08T21:17:05.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.019+0000 7fe4f8783700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f015b240 con 0x7fe4f0150ac0 2024-05-08T21:17:05.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.019+0000 7fe4f6d20700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fe4f0150ea0 0x7fe4f00cb830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.80:52776/0 (socket says 172.21.15.80:52776) 2024-05-08T21:17:05.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.019+0000 7fe4f6d20700 1 -- 172.21.15.80:0/439535190 learned_addr learned my addr 172.21.15.80:0/439535190 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:17:05.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.019+0000 7fe4f551d700 1 -- 172.21.15.80:0/439535190 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1077043739 0 0) 0x7fe4f00c70e0 con 0x7fe4f0150ea0 2024-05-08T21:17:05.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.019+0000 7fe4f551d700 1 -- 172.21.15.80:0/439535190 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4dc0035b0 con 0x7fe4f0150ea0 2024-05-08T21:17:05.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.019+0000 7fe4f551d700 1 -- 172.21.15.80:0/439535190 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1467043953 0 0) 0x7fe4dc0035b0 con 0x7fe4f0150ea0 2024-05-08T21:17:05.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.019+0000 7fe4f551d700 1 -- 172.21.15.80:0/439535190 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe4f0150ac0 msgr2=0x7fe4f015ad00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T21:17:05.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.019+0000 7fe4f551d700 1 --2- 172.21.15.80:0/439535190 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe4f0150ac0 0x7fe4f015ad00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:05.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.019+0000 7fe4f551d700 1 -- 172.21.15.80:0/439535190 >> v2:172.21.15.80:3300/0 conn(0x7fe4f00c8cb0 msgr2=0x7fe4f00c3f00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T21:17:05.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.019+0000 7fe4f551d700 1 --2- 172.21.15.80:0/439535190 >> v2:172.21.15.80:3300/0 conn(0x7fe4f00c8cb0 0x7fe4f00c3f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:05.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.019+0000 7fe4f551d700 1 -- 172.21.15.80:0/439535190 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f00c6b60 con 0x7fe4f0150ea0 2024-05-08T21:17:05.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.019+0000 7fe4f551d700 1 -- 172.21.15.80:0/439535190 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3520646302 0 0) 0x7fe4e0001670 con 0x7fe4f0150ea0 2024-05-08T21:17:05.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.019+0000 7fe4f551d700 1 -- 172.21.15.80:0/439535190 >> v1:172.21.15.106:6789/0 conn(0x7fe4f0150ea0 legacy=0x7fe4f00cb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:05.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.019+0000 7fe4f551d700 1 --2- 172.21.15.80:0/439535190 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe4dc003a00 0x7fe4dc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:05.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.019+0000 7fe4f551d700 1 --2- 172.21.15.80:0/439535190 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4dc004850 0x7fe4dc004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:05.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.019+0000 7fe4f551d700 1 --2- 172.21.15.80:0/439535190 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe4dc005410 0x7fe4dc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:05.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.019+0000 7fe4f551d700 1 -- 172.21.15.80:0/439535190 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f00c8820 con 0x7fe4dc004850 2024-05-08T21:17:05.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.019+0000 7fe4f551d700 1 -- 172.21.15.80:0/439535190 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f015b240 con 0x7fe4dc003a00 2024-05-08T21:17:05.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.019+0000 7fe4f551d700 1 -- 172.21.15.80:0/439535190 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4dc00c2b0 con 0x7fe4dc005410 2024-05-08T21:17:05.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.019+0000 7fe4f6d20700 1 --2- 172.21.15.80:0/439535190 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe4dc005410 0x7fe4dc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:05.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.019+0000 7fe4f6d20700 1 -- 172.21.15.80:0/439535190 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe4dc003a00 msgr2=0x7fe4dc003e20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T21:17:05.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.019+0000 7fe4f6d20700 1 --2- 172.21.15.80:0/439535190 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe4dc003a00 0x7fe4dc003e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:05.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.019+0000 7fe4f6d20700 1 -- 172.21.15.80:0/439535190 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4dc004850 msgr2=0x7fe4dc004cd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T21:17:05.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.019+0000 7fe4f6d20700 1 --2- 172.21.15.80:0/439535190 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4dc004850 0x7fe4dc004cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:05.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.019+0000 7fe4f6d20700 1 -- 172.21.15.80:0/439535190 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4dc0035b0 con 0x7fe4dc005410 2024-05-08T21:17:05.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.019+0000 7fe4f6d20700 1 --2- 172.21.15.80:0/439535190 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe4dc005410 0x7fe4dc00ba10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe4e000c320 tx=0x7fe4dc005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64415a066bf6c6d0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:17:05.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.019+0000 7fe4f551d700 1 -- 172.21.15.80:0/439535190 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e000ce60 con 0x7fe4dc005410 2024-05-08T21:17:05.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.019+0000 7fe4f551d700 1 -- 172.21.15.80:0/439535190 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4e0005960 con 0x7fe4dc005410 2024-05-08T21:17:05.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.019+0000 7fe4f551d700 1 -- 172.21.15.80:0/439535190 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e0005cf0 con 0x7fe4dc005410 2024-05-08T21:17:05.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.023+0000 7fe4f8783700 1 -- 172.21.15.80:0/439535190 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe4dc005410 msgr2=0x7fe4dc00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:05.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.023+0000 7fe4f8783700 1 --2- 172.21.15.80:0/439535190 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe4dc005410 0x7fe4dc00ba10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe4e000c320 tx=0x7fe4dc005880 comp rx=0 tx=0).stop 2024-05-08T21:17:05.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.023+0000 7fe4f6d20700 1 -- 172.21.15.80:0/439535190 reap_dead start 2024-05-08T21:17:05.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.023+0000 7fe4f8783700 1 -- 172.21.15.80:0/439535190 shutdown_connections 2024-05-08T21:17:05.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.023+0000 7fe4f8783700 1 -- 172.21.15.80:0/439535190 >> 172.21.15.80:0/439535190 conn(0x7fe4f006a9c0 msgr2=0x7fe4f006ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:17:05.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.029+0000 7fe4f8783700 1 -- 172.21.15.80:0/439535190 shutdown_connections 2024-05-08T21:17:05.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.029+0000 7fe4f8783700 1 -- 172.21.15.80:0/439535190 wait complete. 2024-05-08T21:17:05.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.031+0000 7fe4f8783700 1 Processor -- start 2024-05-08T21:17:05.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.031+0000 7fe4f8783700 1 -- start start 2024-05-08T21:17:05.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.031+0000 7fe4f8783700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe4f014f650 0x7fe4f014ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:05.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.031+0000 7fe4f8783700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe4f014fa30 0x7fe4f00ca640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:05.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.031+0000 7fe4f8783700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4f014db70 0x7fe4f0143380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:05.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.032+0000 7fe4f8783700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f00ca220 con 0x7fe4f014db70 2024-05-08T21:17:05.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.032+0000 7fe4f8783700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f00c95a0 con 0x7fe4f014fa30 2024-05-08T21:17:05.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.032+0000 7fe4f8783700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f00c9880 con 0x7fe4f014f650 2024-05-08T21:17:05.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.032+0000 7fe4f651f700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe4f014f650 0x7fe4f014ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:05.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.032+0000 7fe4f651f700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe4f014f650 0x7fe4f014ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:55286/0 (socket says 172.21.15.80:55286) 2024-05-08T21:17:05.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.032+0000 7fe4f651f700 1 -- 172.21.15.80:0/2839774853 learned_addr learned my addr 172.21.15.80:0/2839774853 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:17:05.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.032+0000 7fe4f651f700 1 -- 172.21.15.80:0/2839774853 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe4f014fa30 msgr2=0x7fe4f00ca640 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T21:17:05.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.032+0000 7fe4f651f700 1 --2- 172.21.15.80:0/2839774853 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe4f014fa30 0x7fe4f00ca640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:05.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.032+0000 7fe4f651f700 1 -- 172.21.15.80:0/2839774853 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4f014db70 msgr2=0x7fe4f0143380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:05.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.032+0000 7fe4f651f700 1 --2- 172.21.15.80:0/2839774853 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4f014db70 0x7fe4f0143380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:05.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.032+0000 7fe4f651f700 1 -- 172.21.15.80:0/2839774853 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f00c9b60 con 0x7fe4f014f650 2024-05-08T21:17:05.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.033+0000 7fe4f651f700 1 --2- 172.21.15.80:0/2839774853 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe4f014f650 0x7fe4f014ec50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec00b3c0 tx=0x7fe4ec00b780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:17:05.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.033+0000 7fe4e6ffd700 1 -- 172.21.15.80:0/2839774853 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4ec011630 con 0x7fe4f014f650 2024-05-08T21:17:05.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.033+0000 7fe4e6ffd700 1 -- 172.21.15.80:0/2839774853 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4ec011790 con 0x7fe4f014f650 2024-05-08T21:17:05.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.033+0000 7fe4e6ffd700 1 -- 172.21.15.80:0/2839774853 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4ec011b40 con 0x7fe4f014f650 2024-05-08T21:17:05.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.033+0000 7fe4f8783700 1 -- 172.21.15.80:0/2839774853 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4f00c9e40 con 0x7fe4f014f650 2024-05-08T21:17:05.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.033+0000 7fe4f8783700 1 -- 172.21.15.80:0/2839774853 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4f00cb040 con 0x7fe4f014f650 2024-05-08T21:17:05.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.037+0000 7fe4e6ffd700 1 -- 172.21.15.80:0/2839774853 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe4ec011ca0 con 0x7fe4f014f650 2024-05-08T21:17:05.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.038+0000 7fe4e6ffd700 1 --2- 172.21.15.80:0/2839774853 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe4d406acc0 0x7fe4d406d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:05.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.038+0000 7fe4e6ffd700 1 -- 172.21.15.80:0/2839774853 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6835+0+0 (secure 0 0 0) 0x7fe4ec088cb0 con 0x7fe4f014f650 2024-05-08T21:17:05.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.041+0000 7fe4f5d1e700 1 --2- 172.21.15.80:0/2839774853 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe4d406acc0 0x7fe4d406d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:05.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.042+0000 7fe4f5d1e700 1 --2- 172.21.15.80:0/2839774853 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe4d406acc0 0x7fe4d406d180 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe4f0150290 tx=0x7fe4e8009230 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:17:05.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.051+0000 7fe4f8783700 1 -- 172.21.15.80:0/2839774853 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4f00c9fd0 con 0x7fe4f014f650 2024-05-08T21:17:05.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.056+0000 7fe4e6ffd700 1 -- 172.21.15.80:0/2839774853 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fe4ec053980 con 0x7fe4f014f650 2024-05-08T21:17:05.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.693+0000 7fe4f8783700 1 -- 172.21.15.80:0/2839774853 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe4f00c99c0 con 0x7fe4f014f650 2024-05-08T21:17:05.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.694+0000 7fe4e6ffd700 1 -- 172.21.15.80:0/2839774853 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+6255 (secure 0 0 0) 0x7fe4f00c99c0 con 0x7fe4f014f650 2024-05-08T21:17:05.702 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:17:05.703 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":5086,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/791920806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":791920806},{"type":"v1","addr":"172.21.15.106:6833","nonce":791920806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:14:57.684476+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4990},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4990":{"gid":4990,"name":"d","rank":0,"incarnation":16,"state":"up:active","state_seq":41,"addr":"172.21.15.106:6836/1499761952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1499761952},{"type":"v1","addr":"172.21.15.106:6836","nonce":1499761952}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:17:05.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.704+0000 7fe4f8783700 1 -- 172.21.15.80:0/2839774853 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe4d406acc0 msgr2=0x7fe4d406d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:05.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.704+0000 7fe4f8783700 1 --2- 172.21.15.80:0/2839774853 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe4d406acc0 0x7fe4d406d180 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe4f0150290 tx=0x7fe4e8009230 comp rx=0 tx=0).stop 2024-05-08T21:17:05.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.704+0000 7fe4f8783700 1 -- 172.21.15.80:0/2839774853 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe4f014f650 msgr2=0x7fe4f014ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:05.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.704+0000 7fe4f8783700 1 --2- 172.21.15.80:0/2839774853 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe4f014f650 0x7fe4f014ec50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec00b3c0 tx=0x7fe4ec00b780 comp rx=0 tx=0).stop 2024-05-08T21:17:05.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.704+0000 7fe4f8783700 1 -- 172.21.15.80:0/2839774853 shutdown_connections 2024-05-08T21:17:05.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.704+0000 7fe4f8783700 1 --2- 172.21.15.80:0/2839774853 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe4d406acc0 0x7fe4d406d180 secure :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe4f0150290 tx=0x7fe4e8009230 comp rx=0 tx=0).stop 2024-05-08T21:17:05.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.704+0000 7fe4f8783700 1 --2- 172.21.15.80:0/2839774853 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe4f014db70 0x7fe4f0143380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:05.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.704+0000 7fe4f8783700 1 --2- 172.21.15.80:0/2839774853 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe4f014f650 0x7fe4f014ec50 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:05.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.704+0000 7fe4f8783700 1 --2- 172.21.15.80:0/2839774853 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe4f014fa30 0x7fe4f00ca640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:05.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.704+0000 7fe4f8783700 1 -- 172.21.15.80:0/2839774853 >> 172.21.15.80:0/2839774853 conn(0x7fe4f006a9c0 msgr2=0x7fe4f014c190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:17:05.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.704+0000 7fe4f8783700 1 -- 172.21.15.80:0/2839774853 shutdown_connections 2024-05-08T21:17:05.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:05.708+0000 7fe4f8783700 1 -- 172.21.15.80:0/2839774853 wait complete. 2024-05-08T21:17:05.715 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 20 2024-05-08T21:17:05.737 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-05-08T21:17:07.738 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:17:08.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:08.200+0000 7f305c4bb700 1 Processor -- start 2024-05-08T21:17:08.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:08.200+0000 7f305c4bb700 1 -- start start 2024-05-08T21:17:08.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:08.201+0000 7f305c4bb700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f305406a9c0 0x7f305406adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:08.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:08.201+0000 7f305c4bb700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30540722f0 con 0x7f3054071580 2024-05-08T21:17:08.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:08.201+0000 7f305c4bb700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f305415eab0 con 0x7f3054158580 2024-05-08T21:17:08.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:08.201+0000 7f305c4bb700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3054072d60 con 0x7f305406a9c0 2024-05-08T21:17:08.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:08.202+0000 7f3059a56700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f3054071580 0x7f30540c9a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60454/0 (socket says 172.21.15.80:60454) 2024-05-08T21:17:08.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:08.202+0000 7f3059a56700 1 -- 172.21.15.80:0/4165387209 learned_addr learned my addr 172.21.15.80:0/4165387209 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:17:08.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:08.202+0000 7f305aa58700 1 --2- 172.21.15.80:0/4165387209 >> v2:172.21.15.80:3300/0 conn(0x7f305406a9c0 0x7f305406adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:08.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:08.202+0000 7f305aa58700 1 -- 172.21.15.80:0/4165387209 >> v1:172.21.15.106:6789/0 conn(0x7f3054158580 legacy=0x7f305415ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:17:08.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:08.202+0000 7f305aa58700 1 -- 172.21.15.80:0/4165387209 >> v1:172.21.15.80:6789/0 conn(0x7f3054071580 legacy=0x7f30540c9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:08.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:08.202+0000 7f305aa58700 1 -- 172.21.15.80:0/4165387209 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30540ca150 con 0x7f305406a9c0 2024-05-08T21:17:08.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:08.202+0000 7f305aa58700 1 --2- 172.21.15.80:0/4165387209 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f305406a9c0 0x7f305406adf0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f3044009840 tx=0x7f3044009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9350c9fcecb8fb3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:17:08.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:08.206+0000 7f3059255700 1 -- 172.21.15.80:0/4165387209 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3044004230 con 0x7f305406a9c0 2024-05-08T21:17:08.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:08.206+0000 7f3059255700 1 -- 172.21.15.80:0/4165387209 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3044004390 con 0x7f305406a9c0 2024-05-08T21:17:08.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:08.206+0000 7f3059255700 1 -- 172.21.15.80:0/4165387209 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30440036a0 con 0x7f305406a9c0 2024-05-08T21:17:08.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:08.210+0000 7f305c4bb700 1 -- 172.21.15.80:0/4165387209 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f305406a9c0 msgr2=0x7f305406adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:08.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:08.210+0000 7f305c4bb700 1 --2- 172.21.15.80:0/4165387209 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f305406a9c0 0x7f305406adf0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f3044009840 tx=0x7f3044009b50 comp rx=0 tx=0).stop 2024-05-08T21:17:08.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:08.215+0000 7f305c4bb700 1 -- 172.21.15.80:0/4165387209 shutdown_connections 2024-05-08T21:17:08.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:08.215+0000 7f305c4bb700 1 --2- 172.21.15.80:0/4165387209 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f305406a9c0 0x7f305406adf0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:08.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:08.215+0000 7f305c4bb700 1 -- 172.21.15.80:0/4165387209 >> 172.21.15.80:0/4165387209 conn(0x7f305406f140 msgr2=0x7f305406f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:17:08.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:08.221+0000 7f305c4bb700 1 -- 172.21.15.80:0/4165387209 shutdown_connections 2024-05-08T21:17:08.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:08.222+0000 7f305c4bb700 1 -- 172.21.15.80:0/4165387209 wait complete. 2024-05-08T21:17:08.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:08.223+0000 7f305c4bb700 1 Processor -- start 2024-05-08T21:17:08.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:08.226+0000 7f305c4bb700 1 -- start start 2024-05-08T21:17:08.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:08.227+0000 7f305c4bb700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f305406a9c0 0x7f30540c4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:08.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:08.227+0000 7f305c4bb700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3054071580 0x7f3054152a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:08.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:08.227+0000 7f305c4bb700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3054158580 0x7f30541f5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:08.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:08.227+0000 7f305c4bb700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30541f8bb0 con 0x7f3054158580 2024-05-08T21:17:08.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:08.227+0000 7f305c4bb700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30540c5460 con 0x7f305406a9c0 2024-05-08T21:17:08.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:08.227+0000 7f305c4bb700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30541f7d90 con 0x7f3054071580 2024-05-08T21:17:08.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:08.227+0000 7f305a257700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f305406a9c0 0x7f30540c4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:08.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:08.227+0000 7f305a257700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f305406a9c0 0x7f30540c4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.80:37350/0 (socket says 172.21.15.80:37350) 2024-05-08T21:17:08.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:08.227+0000 7f305a257700 1 -- 172.21.15.80:0/168948189 learned_addr learned my addr 172.21.15.80:0/168948189 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:17:08.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:08.228+0000 7f305a257700 1 -- 172.21.15.80:0/168948189 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3054071580 msgr2=0x7f3054152a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:08.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:08.228+0000 7f305a257700 1 --2- 172.21.15.80:0/168948189 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3054071580 0x7f3054152a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:08.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:08.228+0000 7f305a257700 1 -- 172.21.15.80:0/168948189 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3054158580 msgr2=0x7f30541f5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:08.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:08.228+0000 7f305a257700 1 --2- 172.21.15.80:0/168948189 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3054158580 0x7f30541f5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:08.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:08.228+0000 7f305a257700 1 -- 172.21.15.80:0/168948189 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30440094a0 con 0x7f305406a9c0 2024-05-08T21:17:08.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:08.232+0000 7f305a257700 1 --2- 172.21.15.80:0/168948189 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f305406a9c0 0x7f30540c4f20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f305000b470 tx=0x7f305000b830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:17:08.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:08.233+0000 7f304affd700 1 -- 172.21.15.80:0/168948189 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3050011830 con 0x7f305406a9c0 2024-05-08T21:17:08.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:08.233+0000 7f304affd700 1 -- 172.21.15.80:0/168948189 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3050011990 con 0x7f305406a9c0 2024-05-08T21:17:08.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:08.233+0000 7f304affd700 1 -- 172.21.15.80:0/168948189 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3050011d40 con 0x7f305406a9c0 2024-05-08T21:17:08.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:08.234+0000 7f305c4bb700 1 -- 172.21.15.80:0/168948189 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30541f8030 con 0x7f305406a9c0 2024-05-08T21:17:08.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:08.234+0000 7f305c4bb700 1 -- 172.21.15.80:0/168948189 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30541f85f0 con 0x7f305406a9c0 2024-05-08T21:17:08.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:08.235+0000 7f305c4bb700 1 -- 172.21.15.80:0/168948189 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3054072590 con 0x7f305406a9c0 2024-05-08T21:17:08.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:08.249+0000 7f304affd700 1 -- 172.21.15.80:0/168948189 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f305001a400 con 0x7f305406a9c0 2024-05-08T21:17:08.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:08.250+0000 7f304affd700 1 --2- 172.21.15.80:0/168948189 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f304006aef0 0x7f304006d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:08.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:08.250+0000 7f304affd700 1 -- 172.21.15.80:0/168948189 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6835+0+0 (secure 0 0 0) 0x7f3050089e30 con 0x7f305406a9c0 2024-05-08T21:17:08.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:08.254+0000 7f3059a56700 1 --2- 172.21.15.80:0/168948189 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f304006aef0 0x7f304006d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:08.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:08.255+0000 7f3059a56700 1 --2- 172.21.15.80:0/168948189 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f304006aef0 0x7f304006d3b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f304c0012e0 tx=0x7f304c001630 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:17:08.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:08.269+0000 7f304affd700 1 -- 172.21.15.80:0/168948189 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f3050054b80 con 0x7f305406a9c0 2024-05-08T21:17:08.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:08.850+0000 7f305c4bb700 1 -- 172.21.15.80:0/168948189 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f305404ec60 con 0x7f305406a9c0 2024-05-08T21:17:08.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:08.853+0000 7f304affd700 1 -- 172.21.15.80:0/168948189 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+6255 (secure 0 0 0) 0x7f30500581a0 con 0x7f305406a9c0 2024-05-08T21:17:08.865 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:17:08.865 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":5086,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/791920806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":791920806},{"type":"v1","addr":"172.21.15.106:6833","nonce":791920806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:14:57.684476+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4990},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4990":{"gid":4990,"name":"d","rank":0,"incarnation":16,"state":"up:active","state_seq":41,"addr":"172.21.15.106:6836/1499761952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1499761952},{"type":"v1","addr":"172.21.15.106:6836","nonce":1499761952}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:17:08.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:08.866+0000 7f305c4bb700 1 -- 172.21.15.80:0/168948189 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f304006aef0 msgr2=0x7f304006d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:08.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:08.866+0000 7f305c4bb700 1 --2- 172.21.15.80:0/168948189 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f304006aef0 0x7f304006d3b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f304c0012e0 tx=0x7f304c001630 comp rx=0 tx=0).stop 2024-05-08T21:17:08.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:08.866+0000 7f305c4bb700 1 -- 172.21.15.80:0/168948189 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f305406a9c0 msgr2=0x7f30540c4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:08.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:08.866+0000 7f305c4bb700 1 --2- 172.21.15.80:0/168948189 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f305406a9c0 0x7f30540c4f20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f305000b470 tx=0x7f305000b830 comp rx=0 tx=0).stop 2024-05-08T21:17:08.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:08.867+0000 7f305c4bb700 1 -- 172.21.15.80:0/168948189 shutdown_connections 2024-05-08T21:17:08.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:08.867+0000 7f305c4bb700 1 --2- 172.21.15.80:0/168948189 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f304006aef0 0x7f304006d3b0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:08.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:08.867+0000 7f305c4bb700 1 --2- 172.21.15.80:0/168948189 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3054158580 0x7f30541f5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:08.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:08.867+0000 7f305c4bb700 1 --2- 172.21.15.80:0/168948189 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f305406a9c0 0x7f30540c4f20 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:08.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:08.867+0000 7f305c4bb700 1 --2- 172.21.15.80:0/168948189 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3054071580 0x7f3054152a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:08.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:08.867+0000 7f305c4bb700 1 -- 172.21.15.80:0/168948189 >> 172.21.15.80:0/168948189 conn(0x7f305406f140 msgr2=0x7f30540c8100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:17:08.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:08.867+0000 7f305c4bb700 1 -- 172.21.15.80:0/168948189 shutdown_connections 2024-05-08T21:17:08.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:08.867+0000 7f305c4bb700 1 -- 172.21.15.80:0/168948189 wait complete. 2024-05-08T21:17:08.870 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 20 2024-05-08T21:17:08.898 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-05-08T21:17:10.898 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:17:11.111 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.108+0000 7f8e61666700 1 Processor -- start 2024-05-08T21:17:11.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.108+0000 7f8e61666700 1 -- start start 2024-05-08T21:17:11.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.110+0000 7f8e61666700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8e5c0c7340 0x7f8e5c06e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:11.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.110+0000 7f8e61666700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8e5c0c7720 0x7f8e5c072500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:11.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.110+0000 7f8e61666700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8e5c0c4d40 0x7f8e5c158050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:11.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.110+0000 7f8e61666700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e5c158fa0 con 0x7f8e5c0c4d40 2024-05-08T21:17:11.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.110+0000 7f8e61666700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e5c1589e0 con 0x7f8e5c0c7340 2024-05-08T21:17:11.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.110+0000 7f8e61666700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5c158cc0 con 0x7f8e5c0c7720 2024-05-08T21:17:11.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.110+0000 7f8e5a7fc700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8e5c0c7720 0x7f8e5c072500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:11.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.110+0000 7f8e5a7fc700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8e5c0c7720 0x7f8e5c072500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:55314/0 (socket says 172.21.15.80:55314) 2024-05-08T21:17:11.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.110+0000 7f8e5a7fc700 1 -- 172.21.15.80:0/2070285363 learned_addr learned my addr 172.21.15.80:0/2070285363 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:17:11.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.111+0000 7f8e5b7fe700 1 --2- 172.21.15.80:0/2070285363 >> v2:172.21.15.80:3300/0 conn(0x7f8e5c0c4d40 0x7f8e5c158050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:11.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.111+0000 7f8e5a7fc700 1 -- 172.21.15.80:0/2070285363 >> v2:172.21.15.106:3300/0 conn(0x7f8e5c0c7340 msgr2=0x7f8e5c06e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:17:11.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.111+0000 7f8e5a7fc700 1 --2- 172.21.15.80:0/2070285363 >> v2:172.21.15.106:3300/0 conn(0x7f8e5c0c7340 0x7f8e5c06e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:11.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.111+0000 7f8e5a7fc700 1 -- 172.21.15.80:0/2070285363 >> v2:172.21.15.80:3300/0 conn(0x7f8e5c0c4d40 msgr2=0x7f8e5c158050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:17:11.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.111+0000 7f8e5a7fc700 1 --2- 172.21.15.80:0/2070285363 >> v2:172.21.15.80:3300/0 conn(0x7f8e5c0c4d40 0x7f8e5c158050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:11.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.111+0000 7f8e5a7fc700 1 -- 172.21.15.80:0/2070285363 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e5c06de10 con 0x7f8e5c0c7720 2024-05-08T21:17:11.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.112+0000 7f8e5a7fc700 1 --2- 172.21.15.80:0/2070285363 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8e5c0c7720 0x7f8e5c072500 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c0748c0 tx=0x7f8e50009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9cd534866f846ecb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:17:11.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.112+0000 7f8e59ffb700 1 -- 172.21.15.80:0/2070285363 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e5000b870 con 0x7f8e5c0c7720 2024-05-08T21:17:11.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.112+0000 7f8e59ffb700 1 -- 172.21.15.80:0/2070285363 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e5000b9d0 con 0x7f8e5c0c7720 2024-05-08T21:17:11.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.112+0000 7f8e59ffb700 1 -- 172.21.15.80:0/2070285363 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e5000bd60 con 0x7f8e5c0c7720 2024-05-08T21:17:11.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.114+0000 7f8e61666700 1 -- 172.21.15.80:0/2070285363 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8e5c0c7720 msgr2=0x7f8e5c072500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:11.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.114+0000 7f8e61666700 1 --2- 172.21.15.80:0/2070285363 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8e5c0c7720 0x7f8e5c072500 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c0748c0 tx=0x7f8e50009bd0 comp rx=0 tx=0).stop 2024-05-08T21:17:11.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.115+0000 7f8e61666700 1 -- 172.21.15.80:0/2070285363 shutdown_connections 2024-05-08T21:17:11.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.115+0000 7f8e61666700 1 --2- 172.21.15.80:0/2070285363 >> v2:172.21.15.80:3300/0 conn(0x7f8e5c0c4d40 0x7f8e5c158050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:11.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.115+0000 7f8e61666700 1 --2- 172.21.15.80:0/2070285363 >> v2:172.21.15.106:3300/0 conn(0x7f8e5c0c7340 0x7f8e5c06e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:11.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.115+0000 7f8e61666700 1 --2- 172.21.15.80:0/2070285363 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8e5c0c7720 0x7f8e5c072500 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:11.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.115+0000 7f8e61666700 1 -- 172.21.15.80:0/2070285363 >> 172.21.15.80:0/2070285363 conn(0x7f8e5c0cd840 msgr2=0x7f8e5c0cdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:17:11.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.116+0000 7f8e61666700 1 -- 172.21.15.80:0/2070285363 shutdown_connections 2024-05-08T21:17:11.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.116+0000 7f8e61666700 1 -- 172.21.15.80:0/2070285363 wait complete. 2024-05-08T21:17:11.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.118+0000 7f8e61666700 1 Processor -- start 2024-05-08T21:17:11.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.118+0000 7f8e61666700 1 -- start start 2024-05-08T21:17:11.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.119+0000 7f8e61666700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8e5c0c4d40 0x7f8e5c154cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:11.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.119+0000 7f8e61666700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8e5c0c7340 0x7f8e5c1f6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:11.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.119+0000 7f8e61666700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e5c0c7720 0x7f8e5c1f6660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:11.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.119+0000 7f8e61666700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5c06da10 con 0x7f8e5c0c7720 2024-05-08T21:17:11.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.119+0000 7f8e61666700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5c150cf0 con 0x7f8e5c0c4d40 2024-05-08T21:17:11.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.119+0000 7f8e61666700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5c06d770 con 0x7f8e5c0c7340 2024-05-08T21:17:11.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.119+0000 7f8e5b7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e5c0c7720 0x7f8e5c1f6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:11.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.119+0000 7f8e5b7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e5c0c7720 0x7f8e5c1f6660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52082/0 (socket says 172.21.15.80:52082) 2024-05-08T21:17:11.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.119+0000 7f8e5b7fe700 1 -- 172.21.15.80:0/979336452 learned_addr learned my addr 172.21.15.80:0/979336452 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:17:11.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.120+0000 7f8e5b7fe700 1 -- 172.21.15.80:0/979336452 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8e5c0c7340 msgr2=0x7f8e5c1f6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:11.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.120+0000 7f8e5b7fe700 1 --2- 172.21.15.80:0/979336452 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8e5c0c7340 0x7f8e5c1f6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:11.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.120+0000 7f8e5b7fe700 1 -- 172.21.15.80:0/979336452 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8e5c0c4d40 msgr2=0x7f8e5c154cf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T21:17:11.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.120+0000 7f8e5b7fe700 1 --2- 172.21.15.80:0/979336452 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8e5c0c4d40 0x7f8e5c154cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:11.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.120+0000 7f8e5b7fe700 1 -- 172.21.15.80:0/979336452 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e50009550 con 0x7f8e5c0c7720 2024-05-08T21:17:11.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.120+0000 7f8e5b7fe700 1 --2- 172.21.15.80:0/979336452 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e5c0c7720 0x7f8e5c1f6660 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f8e54007e40 tx=0x7f8e5400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:17:11.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.121+0000 7f8e437fe700 1 -- 172.21.15.80:0/979336452 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e5400ee40 con 0x7f8e5c0c7720 2024-05-08T21:17:11.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.121+0000 7f8e437fe700 1 -- 172.21.15.80:0/979336452 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e54014420 con 0x7f8e5c0c7720 2024-05-08T21:17:11.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.121+0000 7f8e437fe700 1 -- 172.21.15.80:0/979336452 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e540147d0 con 0x7f8e5c0c7720 2024-05-08T21:17:11.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.121+0000 7f8e61666700 1 -- 172.21.15.80:0/979336452 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e5c1f77e0 con 0x7f8e5c0c7720 2024-05-08T21:17:11.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.121+0000 7f8e61666700 1 -- 172.21.15.80:0/979336452 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e5c1f4b50 con 0x7f8e5c0c7720 2024-05-08T21:17:11.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.123+0000 7f8e61666700 1 -- 172.21.15.80:0/979336452 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e5c04ec60 con 0x7f8e5c0c7720 2024-05-08T21:17:11.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.126+0000 7f8e437fe700 1 -- 172.21.15.80:0/979336452 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8e54014930 con 0x7f8e5c0c7720 2024-05-08T21:17:11.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.127+0000 7f8e437fe700 1 --2- 172.21.15.80:0/979336452 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f8e4806ac90 0x7f8e4806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:11.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.127+0000 7f8e437fe700 1 -- 172.21.15.80:0/979336452 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6835+0+0 (secure 0 0 0) 0x7f8e54089fa0 con 0x7f8e5c0c7720 2024-05-08T21:17:11.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.135+0000 7f8e437fe700 1 -- 172.21.15.80:0/979336452 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f8e540bd900 con 0x7f8e5c0c7720 2024-05-08T21:17:11.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.135+0000 7f8e5affd700 1 --2- 172.21.15.80:0/979336452 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f8e4806ac90 0x7f8e4806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:11.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.136+0000 7f8e5affd700 1 --2- 172.21.15.80:0/979336452 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f8e4806ac90 0x7f8e4806d150 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c009730 tx=0x7f8e4c006cb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:17:11.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.676+0000 7f8e61666700 1 -- 172.21.15.80:0/979336452 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8e5c06f0f0 con 0x7f8e5c0c7720 2024-05-08T21:17:11.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.679+0000 7f8e437fe700 1 -- 172.21.15.80:0/979336452 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+6255 (secure 0 0 0) 0x7f8e54054c80 con 0x7f8e5c0c7720 2024-05-08T21:17:11.688 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:17:11.689 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":5086,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/791920806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":791920806},{"type":"v1","addr":"172.21.15.106:6833","nonce":791920806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:14:57.684476+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4990},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4990":{"gid":4990,"name":"d","rank":0,"incarnation":16,"state":"up:active","state_seq":41,"addr":"172.21.15.106:6836/1499761952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1499761952},{"type":"v1","addr":"172.21.15.106:6836","nonce":1499761952}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:17:11.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.695+0000 7f8e61666700 1 -- 172.21.15.80:0/979336452 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f8e4806ac90 msgr2=0x7f8e4806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:11.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.695+0000 7f8e61666700 1 --2- 172.21.15.80:0/979336452 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f8e4806ac90 0x7f8e4806d150 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c009730 tx=0x7f8e4c006cb0 comp rx=0 tx=0).stop 2024-05-08T21:17:11.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.695+0000 7f8e61666700 1 -- 172.21.15.80:0/979336452 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e5c0c7720 msgr2=0x7f8e5c1f6660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:11.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.695+0000 7f8e61666700 1 --2- 172.21.15.80:0/979336452 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e5c0c7720 0x7f8e5c1f6660 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f8e54007e40 tx=0x7f8e5400e3c0 comp rx=0 tx=0).stop 2024-05-08T21:17:11.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.695+0000 7f8e61666700 1 -- 172.21.15.80:0/979336452 shutdown_connections 2024-05-08T21:17:11.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.695+0000 7f8e61666700 1 --2- 172.21.15.80:0/979336452 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f8e4806ac90 0x7f8e4806d150 secure :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c009730 tx=0x7f8e4c006cb0 comp rx=0 tx=0).stop 2024-05-08T21:17:11.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.695+0000 7f8e61666700 1 --2- 172.21.15.80:0/979336452 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e5c0c7720 0x7f8e5c1f6660 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:11.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.695+0000 7f8e61666700 1 --2- 172.21.15.80:0/979336452 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8e5c0c4d40 0x7f8e5c154cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:11.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.695+0000 7f8e61666700 1 --2- 172.21.15.80:0/979336452 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8e5c0c7340 0x7f8e5c1f6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:11.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.695+0000 7f8e61666700 1 -- 172.21.15.80:0/979336452 >> 172.21.15.80:0/979336452 conn(0x7f8e5c0cd840 msgr2=0x7f8e5c06c240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:17:11.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.703+0000 7f8e61666700 1 -- 172.21.15.80:0/979336452 shutdown_connections 2024-05-08T21:17:11.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:11.706+0000 7f8e61666700 1 -- 172.21.15.80:0/979336452 wait complete. 2024-05-08T21:17:11.722 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 20 2024-05-08T21:17:11.743 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-05-08T21:17:13.744 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:17:14.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.158+0000 7fddfd8a9700 1 Processor -- start 2024-05-08T21:17:14.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.159+0000 7fddfd8a9700 1 -- start start 2024-05-08T21:17:14.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.160+0000 7fddfd8a9700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fddf8158980 0x7fddf80c3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:14.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.160+0000 7fddfd8a9700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fddf815f260 0x7fddf80c8020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:14.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.160+0000 7fddfd8a9700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddf815f6f0 con 0x7fddf80c3000 2024-05-08T21:17:14.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.160+0000 7fddfd8a9700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddf815edd0 con 0x7fddf815f260 2024-05-08T21:17:14.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.160+0000 7fddfd8a9700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddf81625b0 con 0x7fddf8158980 2024-05-08T21:17:14.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.161+0000 7fddf6ffd700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fddf8158980 0x7fddf80c3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:14.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.161+0000 7fddf6ffd700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fddf8158980 0x7fddf80c3550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:57428/0 (socket says 172.21.15.80:57428) 2024-05-08T21:17:14.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.161+0000 7fddf6ffd700 1 -- 172.21.15.80:0/3131371940 learned_addr learned my addr 172.21.15.80:0/3131371940 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:17:14.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.161+0000 7fddf77fe700 1 --2- 172.21.15.80:0/3131371940 >> v2:172.21.15.106:3300/0 conn(0x7fddf815f260 0x7fddf80c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:14.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.161+0000 7fddf77fe700 1 -- 172.21.15.80:0/3131371940 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fddf8158980 msgr2=0x7fddf80c3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:17:14.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.161+0000 7fddf77fe700 1 --2- 172.21.15.80:0/3131371940 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fddf8158980 0x7fddf80c3550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:14.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.161+0000 7fddf77fe700 1 -- 172.21.15.80:0/3131371940 >> v1:172.21.15.80:6789/0 conn(0x7fddf80c3000 legacy=0x7fddf8161d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:17:14.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.161+0000 7fddf77fe700 1 -- 172.21.15.80:0/3131371940 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf8162890 con 0x7fddf815f260 2024-05-08T21:17:14.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.162+0000 7fddf77fe700 1 --2- 172.21.15.80:0/3131371940 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fddf815f260 0x7fddf80c8020 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fddec009840 tx=0x7fddec009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=889fe5dad0d99858 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:17:14.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.164+0000 7fddf5ffb700 1 -- 172.21.15.80:0/3131371940 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddec004230 con 0x7fddf815f260 2024-05-08T21:17:14.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.164+0000 7fddf5ffb700 1 -- 172.21.15.80:0/3131371940 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddec004390 con 0x7fddf815f260 2024-05-08T21:17:14.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.165+0000 7fddf5ffb700 1 -- 172.21.15.80:0/3131371940 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddec0036a0 con 0x7fddf815f260 2024-05-08T21:17:14.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.165+0000 7fddfd8a9700 1 -- 172.21.15.80:0/3131371940 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fddf815f260 msgr2=0x7fddf80c8020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:14.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.165+0000 7fddfd8a9700 1 --2- 172.21.15.80:0/3131371940 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fddf815f260 0x7fddf80c8020 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fddec009840 tx=0x7fddec009b50 comp rx=0 tx=0).stop 2024-05-08T21:17:14.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.169+0000 7fddfd8a9700 1 -- 172.21.15.80:0/3131371940 shutdown_connections 2024-05-08T21:17:14.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.169+0000 7fddfd8a9700 1 --2- 172.21.15.80:0/3131371940 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fddf815f260 0x7fddf80c8020 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:14.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.169+0000 7fddfd8a9700 1 --2- 172.21.15.80:0/3131371940 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fddf8158980 0x7fddf80c3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:14.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.169+0000 7fddfd8a9700 1 -- 172.21.15.80:0/3131371940 >> 172.21.15.80:0/3131371940 conn(0x7fddf806a9c0 msgr2=0x7fddf806ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:17:14.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.171+0000 7fddfd8a9700 1 -- 172.21.15.80:0/3131371940 shutdown_connections 2024-05-08T21:17:14.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.171+0000 7fddfd8a9700 1 -- 172.21.15.80:0/3131371940 wait complete. 2024-05-08T21:17:14.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.172+0000 7fddfd8a9700 1 Processor -- start 2024-05-08T21:17:14.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.172+0000 7fddfd8a9700 1 -- start start 2024-05-08T21:17:14.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.173+0000 7fddfd8a9700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fddf80c3000 0x7fddf80c1290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:14.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.173+0000 7fddfd8a9700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fddf8158980 0x7fddf80720e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:14.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.173+0000 7fddfd8a9700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fddf815f260 0x7fddf8072620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:14.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.173+0000 7fddfd8a9700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf815fce0 con 0x7fddf80c3000 2024-05-08T21:17:14.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.173+0000 7fddfd8a9700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf8071c50 con 0x7fddf8158980 2024-05-08T21:17:14.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.173+0000 7fddfd8a9700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddf8071920 con 0x7fddf815f260 2024-05-08T21:17:14.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.174+0000 7fddf67fc700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fddf8158980 0x7fddf80720e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:14.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.174+0000 7fddf67fc700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fddf8158980 0x7fddf80720e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.80:48732/0 (socket says 172.21.15.80:48732) 2024-05-08T21:17:14.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.174+0000 7fddf67fc700 1 -- 172.21.15.80:0/2415866738 learned_addr learned my addr 172.21.15.80:0/2415866738 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:17:14.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.174+0000 7fddf77fe700 1 --2- 172.21.15.80:0/2415866738 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fddf815f260 0x7fddf8072620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:14.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.174+0000 7fddf67fc700 1 -- 172.21.15.80:0/2415866738 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fddf815f260 msgr2=0x7fddf8072620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:14.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.174+0000 7fddf67fc700 1 --2- 172.21.15.80:0/2415866738 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fddf815f260 0x7fddf8072620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:14.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.174+0000 7fddf67fc700 1 -- 172.21.15.80:0/2415866738 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fddf80c3000 msgr2=0x7fddf80c1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:14.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.174+0000 7fddf67fc700 1 --2- 172.21.15.80:0/2415866738 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fddf80c3000 0x7fddf80c1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:14.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.174+0000 7fddf67fc700 1 -- 172.21.15.80:0/2415866738 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddec0094a0 con 0x7fddf8158980 2024-05-08T21:17:14.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.174+0000 7fddf67fc700 1 --2- 172.21.15.80:0/2415866738 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fddf8158980 0x7fddf80720e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fddf000c8f0 tx=0x7fddf000cc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:17:14.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.175+0000 7fdddffff700 1 -- 172.21.15.80:0/2415866738 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf0003e10 con 0x7fddf8158980 2024-05-08T21:17:14.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.175+0000 7fdddffff700 1 -- 172.21.15.80:0/2415866738 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf0005070 con 0x7fddf8158980 2024-05-08T21:17:14.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.175+0000 7fdddffff700 1 -- 172.21.15.80:0/2415866738 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf0005420 con 0x7fddf8158980 2024-05-08T21:17:14.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.177+0000 7fddfd8a9700 1 -- 172.21.15.80:0/2415866738 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddf815fa00 con 0x7fddf8158980 2024-05-08T21:17:14.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.177+0000 7fddfd8a9700 1 -- 172.21.15.80:0/2415866738 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddf81603f0 con 0x7fddf8158980 2024-05-08T21:17:14.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.179+0000 7fddfd8a9700 1 -- 172.21.15.80:0/2415866738 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddf8071f30 con 0x7fddf8158980 2024-05-08T21:17:14.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.181+0000 7fdddffff700 1 -- 172.21.15.80:0/2415866738 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fddf0005580 con 0x7fddf8158980 2024-05-08T21:17:14.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.181+0000 7fdddffff700 1 --2- 172.21.15.80:0/2415866738 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fdde406ad60 0x7fdde406d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:14.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.181+0000 7fdddffff700 1 -- 172.21.15.80:0/2415866738 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6835+0+0 (secure 0 0 0) 0x7fddf0088e50 con 0x7fddf8158980 2024-05-08T21:17:14.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.184+0000 7fddf6ffd700 1 --2- 172.21.15.80:0/2415866738 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fdde406ad60 0x7fdde406d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:14.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.185+0000 7fddf6ffd700 1 --2- 172.21.15.80:0/2415866738 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fdde406ad60 0x7fdde406d220 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fdde8009520 tx=0x7fdde8009470 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:17:14.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.188+0000 7fdddffff700 1 -- 172.21.15.80:0/2415866738 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fddf0053c30 con 0x7fddf8158980 2024-05-08T21:17:14.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.745+0000 7fddfd8a9700 1 -- 172.21.15.80:0/2415866738 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fddf8071d90 con 0x7fddf8158980 2024-05-08T21:17:14.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.748+0000 7fdddffff700 1 -- 172.21.15.80:0/2415866738 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+6255 (secure 0 0 0) 0x7fddf8071d90 con 0x7fddf8158980 2024-05-08T21:17:14.751 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:17:14.751 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":5086,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/791920806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":791920806},{"type":"v1","addr":"172.21.15.106:6833","nonce":791920806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:14:57.684476+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4990},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4990":{"gid":4990,"name":"d","rank":0,"incarnation":16,"state":"up:active","state_seq":41,"addr":"172.21.15.106:6836/1499761952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1499761952},{"type":"v1","addr":"172.21.15.106:6836","nonce":1499761952}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:17:14.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.752+0000 7fddfd8a9700 1 -- 172.21.15.80:0/2415866738 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fdde406ad60 msgr2=0x7fdde406d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:14.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.752+0000 7fddfd8a9700 1 --2- 172.21.15.80:0/2415866738 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fdde406ad60 0x7fdde406d220 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fdde8009520 tx=0x7fdde8009470 comp rx=0 tx=0).stop 2024-05-08T21:17:14.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.752+0000 7fddfd8a9700 1 -- 172.21.15.80:0/2415866738 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fddf8158980 msgr2=0x7fddf80720e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:14.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.752+0000 7fddfd8a9700 1 --2- 172.21.15.80:0/2415866738 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fddf8158980 0x7fddf80720e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fddf000c8f0 tx=0x7fddf000cc00 comp rx=0 tx=0).stop 2024-05-08T21:17:14.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.752+0000 7fddfd8a9700 1 -- 172.21.15.80:0/2415866738 shutdown_connections 2024-05-08T21:17:14.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.752+0000 7fddfd8a9700 1 --2- 172.21.15.80:0/2415866738 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fdde406ad60 0x7fdde406d220 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:14.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.752+0000 7fddfd8a9700 1 --2- 172.21.15.80:0/2415866738 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fddf80c3000 0x7fddf80c1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:14.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.752+0000 7fddfd8a9700 1 --2- 172.21.15.80:0/2415866738 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fddf815f260 0x7fddf8072620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:14.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.752+0000 7fddfd8a9700 1 --2- 172.21.15.80:0/2415866738 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fddf8158980 0x7fddf80720e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:14.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.752+0000 7fddfd8a9700 1 -- 172.21.15.80:0/2415866738 >> 172.21.15.80:0/2415866738 conn(0x7fddf806a9c0 msgr2=0x7fddf806ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:17:14.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.753+0000 7fddfd8a9700 1 -- 172.21.15.80:0/2415866738 shutdown_connections 2024-05-08T21:17:14.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:14.753+0000 7fddfd8a9700 1 -- 172.21.15.80:0/2415866738 wait complete. 2024-05-08T21:17:14.758 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 20 2024-05-08T21:17:14.779 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-05-08T21:17:16.780 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:17:16.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:16.962+0000 7f63b6d17700 1 Processor -- start 2024-05-08T21:17:16.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:16.962+0000 7f63b6d17700 1 -- start start 2024-05-08T21:17:16.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:16.963+0000 7f63b6d17700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f63b0072f10 0x7f63b015c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:16.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:16.963+0000 7f63b6d17700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f63b0159630 0x7f63b00cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:16.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:16.963+0000 7f63b6d17700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63b00c5c00 con 0x7f63b00732f0 2024-05-08T21:17:16.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:16.963+0000 7f63b6d17700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63b015b8b0 con 0x7f63b0072f10 2024-05-08T21:17:16.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:16.963+0000 7f63b6d17700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63b00c5360 con 0x7f63b0159630 2024-05-08T21:17:16.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:16.963+0000 7f63b52b4700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f63b00732f0 0x7f63b0141000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:48336/0 (socket says 172.21.15.80:48336) 2024-05-08T21:17:16.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:16.963+0000 7f63b52b4700 1 -- 172.21.15.80:0/4131708537 learned_addr learned my addr 172.21.15.80:0/4131708537 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:17:16.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:16.963+0000 7f63affff700 1 --2- 172.21.15.80:0/4131708537 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f63b0159630 0x7f63b00cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:16.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:16.963+0000 7f63b4ab3700 1 --2- 172.21.15.80:0/4131708537 >> v2:172.21.15.106:3300/0 conn(0x7f63b0072f10 0x7f63b015c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:16.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:16.964+0000 7f63affff700 1 -- 172.21.15.80:0/4131708537 >> v2:172.21.15.106:3300/0 conn(0x7f63b0072f10 msgr2=0x7f63b015c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:17:16.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:16.964+0000 7f63affff700 1 --2- 172.21.15.80:0/4131708537 >> v2:172.21.15.106:3300/0 conn(0x7f63b0072f10 0x7f63b015c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:16.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:16.964+0000 7f63af7fe700 1 -- 172.21.15.80:0/4131708537 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2694897940 0 0) 0x7f63b00c5c00 con 0x7f63b00732f0 2024-05-08T21:17:16.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:16.964+0000 7f63affff700 1 -- 172.21.15.80:0/4131708537 >> v1:172.21.15.80:6789/0 conn(0x7f63b00732f0 legacy=0x7f63b0141000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:16.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:16.964+0000 7f63affff700 1 -- 172.21.15.80:0/4131708537 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63b00c5640 con 0x7f63b0159630 2024-05-08T21:17:16.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:16.964+0000 7f63b4ab3700 1 --2- 172.21.15.80:0/4131708537 >> v2:172.21.15.106:3300/0 conn(0x7f63b0072f10 0x7f63b015c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:17:16.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:16.964+0000 7f63affff700 1 --2- 172.21.15.80:0/4131708537 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f63b0159630 0x7f63b00cd930 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f639c009840 tx=0x7f639c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6bc9c3476744d3d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:17:16.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:16.964+0000 7f63af7fe700 1 -- 172.21.15.80:0/4131708537 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f639c011830 con 0x7f63b0159630 2024-05-08T21:17:16.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:16.964+0000 7f63af7fe700 1 -- 172.21.15.80:0/4131708537 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f639c011990 con 0x7f63b0159630 2024-05-08T21:17:16.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:16.964+0000 7f63af7fe700 1 -- 172.21.15.80:0/4131708537 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f639c011d20 con 0x7f63b0159630 2024-05-08T21:17:16.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:16.965+0000 7f63b6d17700 1 -- 172.21.15.80:0/4131708537 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f63b0159630 msgr2=0x7f63b00cd930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:16.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:16.965+0000 7f63b6d17700 1 --2- 172.21.15.80:0/4131708537 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f63b0159630 0x7f63b00cd930 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f639c009840 tx=0x7f639c009b50 comp rx=0 tx=0).stop 2024-05-08T21:17:16.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:16.965+0000 7f63b6d17700 1 -- 172.21.15.80:0/4131708537 shutdown_connections 2024-05-08T21:17:16.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:16.965+0000 7f63b6d17700 1 --2- 172.21.15.80:0/4131708537 >> v2:172.21.15.106:3300/0 conn(0x7f63b0072f10 0x7f63b015c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:16.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:16.965+0000 7f63b6d17700 1 --2- 172.21.15.80:0/4131708537 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f63b0159630 0x7f63b00cd930 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:16.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:16.965+0000 7f63b6d17700 1 -- 172.21.15.80:0/4131708537 >> 172.21.15.80:0/4131708537 conn(0x7f63b0070020 msgr2=0x7f63b0070430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:17:16.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:16.965+0000 7f63b6d17700 1 -- 172.21.15.80:0/4131708537 shutdown_connections 2024-05-08T21:17:16.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:16.965+0000 7f63b6d17700 1 -- 172.21.15.80:0/4131708537 wait complete. 2024-05-08T21:17:16.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:16.966+0000 7f63b6d17700 1 Processor -- start 2024-05-08T21:17:16.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:16.966+0000 7f63b6d17700 1 -- start start 2024-05-08T21:17:16.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:16.967+0000 7f63b6d17700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f63b0072f10 0x7f63b013b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:16.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:16.967+0000 7f63b6d17700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f63b00732f0 0x7f63b00cab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:16.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:16.967+0000 7f63b6d17700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63b0159630 0x7f63b01eec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:16.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:16.967+0000 7f63b6d17700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b013a6e0 con 0x7f63b0159630 2024-05-08T21:17:16.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:16.967+0000 7f63b6d17700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b013bda0 con 0x7f63b00732f0 2024-05-08T21:17:16.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:16.967+0000 7f63b6d17700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63b0151eb0 con 0x7f63b0072f10 2024-05-08T21:17:16.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:16.967+0000 7f63b52b4700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63b0159630 0x7f63b01eec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:16.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:16.967+0000 7f63b4ab3700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f63b0072f10 0x7f63b013b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:16.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:16.967+0000 7f63b4ab3700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f63b0072f10 0x7f63b013b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:57458/0 (socket says 172.21.15.80:57458) 2024-05-08T21:17:16.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:16.967+0000 7f63affff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f63b00732f0 0x7f63b00cab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:16.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:16.967+0000 7f63b4ab3700 1 -- 172.21.15.80:0/2777626388 learned_addr learned my addr 172.21.15.80:0/2777626388 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:17:16.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:16.967+0000 7f63b52b4700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63b0159630 0x7f63b01eec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45558/0 (socket says 172.21.15.80:45558) 2024-05-08T21:17:16.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:16.967+0000 7f63b4ab3700 1 -- 172.21.15.80:0/2777626388 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f63b00732f0 msgr2=0x7f63b00cab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:16.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:16.967+0000 7f63b4ab3700 1 --2- 172.21.15.80:0/2777626388 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f63b00732f0 0x7f63b00cab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:16.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:16.967+0000 7f63b4ab3700 1 -- 172.21.15.80:0/2777626388 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63b0159630 msgr2=0x7f63b01eec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:16.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:16.967+0000 7f63b4ab3700 1 --2- 172.21.15.80:0/2777626388 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63b0159630 0x7f63b01eec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:16.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:16.967+0000 7f63b4ab3700 1 -- 172.21.15.80:0/2777626388 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63a40094a0 con 0x7f63b0072f10 2024-05-08T21:17:16.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:16.967+0000 7f63b52b4700 1 --2- 172.21.15.80:0/2777626388 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63b0159630 0x7f63b01eec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:17:16.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:16.968+0000 7f63b4ab3700 1 --2- 172.21.15.80:0/2777626388 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f63b0072f10 0x7f63b013b860 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f63a400ebe0 tx=0x7f63a400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:17:16.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:16.968+0000 7f63ad7fa700 1 -- 172.21.15.80:0/2777626388 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a400c850 con 0x7f63b0072f10 2024-05-08T21:17:16.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:16.968+0000 7f63ad7fa700 1 -- 172.21.15.80:0/2777626388 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63a400c9b0 con 0x7f63b0072f10 2024-05-08T21:17:16.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:16.968+0000 7f63b6d17700 1 -- 172.21.15.80:0/2777626388 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f639c0094a0 con 0x7f63b0072f10 2024-05-08T21:17:16.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:16.968+0000 7f63ad7fa700 1 -- 172.21.15.80:0/2777626388 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a400cd40 con 0x7f63b0072f10 2024-05-08T21:17:16.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:16.968+0000 7f63b6d17700 1 -- 172.21.15.80:0/2777626388 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63b013a930 con 0x7f63b0072f10 2024-05-08T21:17:16.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:16.969+0000 7f63b6d17700 1 -- 172.21.15.80:0/2777626388 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63b0068080 con 0x7f63b0072f10 2024-05-08T21:17:16.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:16.970+0000 7f63ad7fa700 1 -- 172.21.15.80:0/2777626388 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f63a4013470 con 0x7f63b0072f10 2024-05-08T21:17:16.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:16.970+0000 7f63ad7fa700 1 --2- 172.21.15.80:0/2777626388 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f639406ac90 0x7f639406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:16.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:16.970+0000 7f63ad7fa700 1 -- 172.21.15.80:0/2777626388 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6835+0+0 (secure 0 0 0) 0x7f63a40897d0 con 0x7f63b0072f10 2024-05-08T21:17:16.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:16.970+0000 7f63affff700 1 --2- 172.21.15.80:0/2777626388 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f639406ac90 0x7f639406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:16.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:16.971+0000 7f63affff700 1 --2- 172.21.15.80:0/2777626388 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f639406ac90 0x7f639406d150 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f639c0090b0 tx=0x7f639c01c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:17:16.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:16.976+0000 7f63ad7fa700 1 -- 172.21.15.80:0/2777626388 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f63a40545d0 con 0x7f63b0072f10 2024-05-08T21:17:17.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:17.471+0000 7f63b6d17700 1 -- 172.21.15.80:0/2777626388 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f63b0140db0 con 0x7f63b0072f10 2024-05-08T21:17:17.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:17.474+0000 7f63ad7fa700 1 -- 172.21.15.80:0/2777626388 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+6255 (secure 0 0 0) 0x7f63a400cea0 con 0x7f63b0072f10 2024-05-08T21:17:17.487 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:17:17.487 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":5086,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/791920806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":791920806},{"type":"v1","addr":"172.21.15.106:6833","nonce":791920806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:14:57.684476+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4990},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4990":{"gid":4990,"name":"d","rank":0,"incarnation":16,"state":"up:active","state_seq":41,"addr":"172.21.15.106:6836/1499761952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1499761952},{"type":"v1","addr":"172.21.15.106:6836","nonce":1499761952}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:17:17.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:17.487+0000 7f63b6d17700 1 -- 172.21.15.80:0/2777626388 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f639406ac90 msgr2=0x7f639406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:17.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:17.487+0000 7f63b6d17700 1 --2- 172.21.15.80:0/2777626388 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f639406ac90 0x7f639406d150 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f639c0090b0 tx=0x7f639c01c040 comp rx=0 tx=0).stop 2024-05-08T21:17:17.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:17.487+0000 7f63b6d17700 1 -- 172.21.15.80:0/2777626388 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f63b0072f10 msgr2=0x7f63b013b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:17.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:17.487+0000 7f63b6d17700 1 --2- 172.21.15.80:0/2777626388 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f63b0072f10 0x7f63b013b860 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f63a400ebe0 tx=0x7f63a400eef0 comp rx=0 tx=0).stop 2024-05-08T21:17:17.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:17.487+0000 7f63b6d17700 1 -- 172.21.15.80:0/2777626388 shutdown_connections 2024-05-08T21:17:17.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:17.487+0000 7f63b6d17700 1 --2- 172.21.15.80:0/2777626388 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f639406ac90 0x7f639406d150 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:17.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:17.487+0000 7f63b6d17700 1 --2- 172.21.15.80:0/2777626388 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63b0159630 0x7f63b01eec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:17.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:17.487+0000 7f63b6d17700 1 --2- 172.21.15.80:0/2777626388 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f63b0072f10 0x7f63b013b860 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:17.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:17.487+0000 7f63b6d17700 1 --2- 172.21.15.80:0/2777626388 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f63b00732f0 0x7f63b00cab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:17.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:17.487+0000 7f63b6d17700 1 -- 172.21.15.80:0/2777626388 >> 172.21.15.80:0/2777626388 conn(0x7f63b0070020 msgr2=0x7f63b01405b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:17:17.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:17.492+0000 7f63b6d17700 1 -- 172.21.15.80:0/2777626388 shutdown_connections 2024-05-08T21:17:17.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:17.492+0000 7f63b6d17700 1 -- 172.21.15.80:0/2777626388 wait complete. 2024-05-08T21:17:17.499 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 20 2024-05-08T21:17:17.517 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-05-08T21:17:19.518 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:17:19.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.636+0000 7f0dc738e700 1 Processor -- start 2024-05-08T21:17:19.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.636+0000 7f0dc738e700 1 -- start start 2024-05-08T21:17:19.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.637+0000 7f0dc738e700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0dc0154290 0x7f0dc00cd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:19.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.637+0000 7f0dc738e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0dc00cdde0 0x7f0dc0072c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:19.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.637+0000 7f0dc738e700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0dc0073170 0x7f0dc015a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:19.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.637+0000 7f0dc738e700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dc006c780 con 0x7f0dc00cdde0 2024-05-08T21:17:19.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.637+0000 7f0dc738e700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dc0073580 con 0x7f0dc0154290 2024-05-08T21:17:19.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.637+0000 7f0dc738e700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc015da20 con 0x7f0dc0073170 2024-05-08T21:17:19.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.637+0000 7f0dc4929700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0dc00cdde0 0x7f0dc0072c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:19.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.637+0000 7f0dc4929700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0dc00cdde0 0x7f0dc0072c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45568/0 (socket says 172.21.15.80:45568) 2024-05-08T21:17:19.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.637+0000 7f0dc4929700 1 -- 172.21.15.80:0/289395546 learned_addr learned my addr 172.21.15.80:0/289395546 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:17:19.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.637+0000 7f0dc592b700 1 --2- 172.21.15.80:0/289395546 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0dc0073170 0x7f0dc015a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:19.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.638+0000 7f0dc4929700 1 -- 172.21.15.80:0/289395546 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0dc0073170 msgr2=0x7f0dc015a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:17:19.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.638+0000 7f0dc4929700 1 --2- 172.21.15.80:0/289395546 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0dc0073170 0x7f0dc015a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:19.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.638+0000 7f0dc512a700 1 --2- 172.21.15.80:0/289395546 >> v2:172.21.15.106:3300/0 conn(0x7f0dc0154290 0x7f0dc00cd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:19.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.638+0000 7f0dc4929700 1 -- 172.21.15.80:0/289395546 >> v2:172.21.15.106:3300/0 conn(0x7f0dc0154290 msgr2=0x7f0dc00cd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:17:19.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.638+0000 7f0dc4929700 1 --2- 172.21.15.80:0/289395546 >> v2:172.21.15.106:3300/0 conn(0x7f0dc0154290 0x7f0dc00cd8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:19.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.638+0000 7f0dc4929700 1 -- 172.21.15.80:0/289395546 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc015dd00 con 0x7f0dc00cdde0 2024-05-08T21:17:19.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.638+0000 7f0dc4929700 1 --2- 172.21.15.80:0/289395546 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0dc00cdde0 0x7f0dc0072c30 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f0dc00ca3b0 tx=0x7f0dbc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a58a65012bb36c48 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:17:19.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.638+0000 7f0db7fff700 1 -- 172.21.15.80:0/289395546 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc00b870 con 0x7f0dc00cdde0 2024-05-08T21:17:19.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.638+0000 7f0db7fff700 1 -- 172.21.15.80:0/289395546 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dbc00b9d0 con 0x7f0dc00cdde0 2024-05-08T21:17:19.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.638+0000 7f0db7fff700 1 -- 172.21.15.80:0/289395546 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc00bd60 con 0x7f0dc00cdde0 2024-05-08T21:17:19.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.638+0000 7f0dc738e700 1 -- 172.21.15.80:0/289395546 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0dc00cdde0 msgr2=0x7f0dc0072c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:19.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.638+0000 7f0dc738e700 1 --2- 172.21.15.80:0/289395546 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0dc00cdde0 0x7f0dc0072c30 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f0dc00ca3b0 tx=0x7f0dbc009bd0 comp rx=0 tx=0).stop 2024-05-08T21:17:19.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.638+0000 7f0dc738e700 1 -- 172.21.15.80:0/289395546 shutdown_connections 2024-05-08T21:17:19.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.638+0000 7f0dc738e700 1 --2- 172.21.15.80:0/289395546 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0dc0073170 0x7f0dc015a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:19.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.638+0000 7f0dc738e700 1 --2- 172.21.15.80:0/289395546 >> v2:172.21.15.106:3300/0 conn(0x7f0dc0154290 0x7f0dc00cd8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:19.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.638+0000 7f0dc738e700 1 --2- 172.21.15.80:0/289395546 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0dc00cdde0 0x7f0dc0072c30 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:19.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.638+0000 7f0dc738e700 1 -- 172.21.15.80:0/289395546 >> 172.21.15.80:0/289395546 conn(0x7f0dc0066780 msgr2=0x7f0dc0066b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:17:19.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.638+0000 7f0dc738e700 1 -- 172.21.15.80:0/289395546 shutdown_connections 2024-05-08T21:17:19.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.639+0000 7f0dc738e700 1 -- 172.21.15.80:0/289395546 wait complete. 2024-05-08T21:17:19.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.640+0000 7f0dc738e700 1 Processor -- start 2024-05-08T21:17:19.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.640+0000 7f0dc738e700 1 -- start start 2024-05-08T21:17:19.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.641+0000 7f0dc738e700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0dc0073170 0x7f0dc00c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:19.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.641+0000 7f0dc738e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0dc00cdde0 0x7f0dc014fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:19.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.641+0000 7f0dc738e700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0dc0154290 0x7f0dc0149d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:19.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.641+0000 7f0dc738e700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc014ec90 con 0x7f0dc00cdde0 2024-05-08T21:17:19.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.641+0000 7f0dc738e700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc00c6e30 con 0x7f0dc0154290 2024-05-08T21:17:19.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.641+0000 7f0dc738e700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc00c4f50 con 0x7f0dc0073170 2024-05-08T21:17:19.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.641+0000 7f0dc4929700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0dc00cdde0 0x7f0dc014fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:19.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.641+0000 7f0dc4929700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0dc00cdde0 0x7f0dc014fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45572/0 (socket says 172.21.15.80:45572) 2024-05-08T21:17:19.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.641+0000 7f0dc4929700 1 -- 172.21.15.80:0/1365439367 learned_addr learned my addr 172.21.15.80:0/1365439367 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:17:19.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.641+0000 7f0dc4929700 1 -- 172.21.15.80:0/1365439367 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0dc0073170 msgr2=0x7f0dc00c78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:19.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.641+0000 7f0dc512a700 1 --2- 172.21.15.80:0/1365439367 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0dc0073170 0x7f0dc00c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:19.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.641+0000 7f0dc4929700 1 --2- 172.21.15.80:0/1365439367 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0dc0073170 0x7f0dc00c78a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:19.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.641+0000 7f0dc4929700 1 -- 172.21.15.80:0/1365439367 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0dc0154290 msgr2=0x7f0dc0149d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:19.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.641+0000 7f0dc592b700 1 --2- 172.21.15.80:0/1365439367 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0dc0154290 0x7f0dc0149d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:19.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.641+0000 7f0dc4929700 1 --2- 172.21.15.80:0/1365439367 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0dc0154290 0x7f0dc0149d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:19.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.641+0000 7f0dc4929700 1 -- 172.21.15.80:0/1365439367 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dbc009550 con 0x7f0dc00cdde0 2024-05-08T21:17:19.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.641+0000 7f0dc4929700 1 --2- 172.21.15.80:0/1365439367 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0dc00cdde0 0x7f0dc014fb60 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f0dc00cb510 tx=0x7f0dbc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:17:19.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.642+0000 7f0db5ffb700 1 -- 172.21.15.80:0/1365439367 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc004520 con 0x7f0dc00cdde0 2024-05-08T21:17:19.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.642+0000 7f0db5ffb700 1 -- 172.21.15.80:0/1365439367 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dbc01e070 con 0x7f0dc00cdde0 2024-05-08T21:17:19.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.642+0000 7f0db5ffb700 1 -- 172.21.15.80:0/1365439367 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc0038e0 con 0x7f0dc00cdde0 2024-05-08T21:17:19.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.642+0000 7f0dc738e700 1 -- 172.21.15.80:0/1365439367 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dc0150c50 con 0x7f0dc00cdde0 2024-05-08T21:17:19.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.642+0000 7f0dc738e700 1 -- 172.21.15.80:0/1365439367 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dc014e5d0 con 0x7f0dc00cdde0 2024-05-08T21:17:19.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.643+0000 7f0dc738e700 1 -- 172.21.15.80:0/1365439367 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dc014edd0 con 0x7f0dc00cdde0 2024-05-08T21:17:19.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.643+0000 7f0db5ffb700 1 -- 172.21.15.80:0/1365439367 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0dbc003a40 con 0x7f0dc00cdde0 2024-05-08T21:17:19.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.643+0000 7f0db5ffb700 1 --2- 172.21.15.80:0/1365439367 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f0da406acc0 0x7f0da406d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:19.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.644+0000 7f0db5ffb700 1 -- 172.21.15.80:0/1365439367 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6835+0+0 (secure 0 0 0) 0x7f0dbc020070 con 0x7f0dc00cdde0 2024-05-08T21:17:19.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.644+0000 7f0dc512a700 1 --2- 172.21.15.80:0/1365439367 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f0da406acc0 0x7f0da406d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:19.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.644+0000 7f0dc512a700 1 --2- 172.21.15.80:0/1365439367 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f0da406acc0 0x7f0da406d180 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0db000b7c0 tx=0x7f0db0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:17:19.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.648+0000 7f0db5ffb700 1 -- 172.21.15.80:0/1365439367 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f0dc014edd0 con 0x7f0dc00cdde0 2024-05-08T21:17:19.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.922+0000 7f0dc738e700 1 -- 172.21.15.80:0/1365439367 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0dc014edd0 con 0x7f0dc00cdde0 2024-05-08T21:17:19.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.923+0000 7f0db5ffb700 1 -- 172.21.15.80:0/1365439367 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+6255 (secure 0 0 0) 0x7f0dc014edd0 con 0x7f0dc00cdde0 2024-05-08T21:17:19.926 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:17:19.926 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":5086,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/791920806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":791920806},{"type":"v1","addr":"172.21.15.106:6833","nonce":791920806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:14:57.684476+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4990},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4990":{"gid":4990,"name":"d","rank":0,"incarnation":16,"state":"up:active","state_seq":41,"addr":"172.21.15.106:6836/1499761952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1499761952},{"type":"v1","addr":"172.21.15.106:6836","nonce":1499761952}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:17:19.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.925+0000 7f0dc738e700 1 -- 172.21.15.80:0/1365439367 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f0da406acc0 msgr2=0x7f0da406d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:19.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.925+0000 7f0dc738e700 1 --2- 172.21.15.80:0/1365439367 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f0da406acc0 0x7f0da406d180 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0db000b7c0 tx=0x7f0db0008040 comp rx=0 tx=0).stop 2024-05-08T21:17:19.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.925+0000 7f0dc738e700 1 -- 172.21.15.80:0/1365439367 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0dc00cdde0 msgr2=0x7f0dc014fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:19.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.925+0000 7f0dc738e700 1 --2- 172.21.15.80:0/1365439367 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0dc00cdde0 0x7f0dc014fb60 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f0dc00cb510 tx=0x7f0dbc004750 comp rx=0 tx=0).stop 2024-05-08T21:17:19.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.925+0000 7f0dc738e700 1 -- 172.21.15.80:0/1365439367 shutdown_connections 2024-05-08T21:17:19.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.925+0000 7f0dc738e700 1 --2- 172.21.15.80:0/1365439367 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f0da406acc0 0x7f0da406d180 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:19.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.925+0000 7f0dc738e700 1 --2- 172.21.15.80:0/1365439367 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0dc0154290 0x7f0dc0149d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:19.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.925+0000 7f0dc738e700 1 --2- 172.21.15.80:0/1365439367 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0dc0073170 0x7f0dc00c78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:19.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.925+0000 7f0dc738e700 1 --2- 172.21.15.80:0/1365439367 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0dc00cdde0 0x7f0dc014fb60 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:19.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.925+0000 7f0dc738e700 1 -- 172.21.15.80:0/1365439367 >> 172.21.15.80:0/1365439367 conn(0x7f0dc0066780 msgr2=0x7f0dc0150fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:17:19.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.925+0000 7f0dc738e700 1 -- 172.21.15.80:0/1365439367 shutdown_connections 2024-05-08T21:17:19.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:19.925+0000 7f0dc738e700 1 -- 172.21.15.80:0/1365439367 wait complete. 2024-05-08T21:17:19.929 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 20 2024-05-08T21:17:19.940 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-05-08T21:17:21.942 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:17:22.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.059+0000 7f3917389700 1 Processor -- start 2024-05-08T21:17:22.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.059+0000 7f3917389700 1 -- start start 2024-05-08T21:17:22.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.060+0000 7f3917389700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3910154580 0x7f391015abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:22.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.060+0000 7f3917389700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f39100cbe40 0x7f39100c48c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:22.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.060+0000 7f3917389700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f39100c4e00 0x7f39100cc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:22.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.060+0000 7f3917389700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39100b2c60 con 0x7f39100cbe40 2024-05-08T21:17:22.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.060+0000 7f3917389700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f391015d750 con 0x7f39100c4e00 2024-05-08T21:17:22.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.060+0000 7f3917389700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39100b34f0 con 0x7f3910154580 2024-05-08T21:17:22.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.061+0000 7f3914924700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f39100cbe40 0x7f39100c48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:22.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.061+0000 7f3914924700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f39100cbe40 0x7f39100c48c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45576/0 (socket says 172.21.15.80:45576) 2024-05-08T21:17:22.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.061+0000 7f3914924700 1 -- 172.21.15.80:0/4022355962 learned_addr learned my addr 172.21.15.80:0/4022355962 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:17:22.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.061+0000 7f3915125700 1 --2- 172.21.15.80:0/4022355962 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3910154580 0x7f391015abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:22.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.061+0000 7f3915926700 1 --2- 172.21.15.80:0/4022355962 >> v2:172.21.15.106:3300/0 conn(0x7f39100c4e00 0x7f39100cc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:22.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.061+0000 7f3914924700 1 -- 172.21.15.80:0/4022355962 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3910154580 msgr2=0x7f391015abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:17:22.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.061+0000 7f3914924700 1 --2- 172.21.15.80:0/4022355962 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3910154580 0x7f391015abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:22.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.061+0000 7f3914924700 1 -- 172.21.15.80:0/4022355962 >> v2:172.21.15.106:3300/0 conn(0x7f39100c4e00 msgr2=0x7f39100cc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:17:22.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.061+0000 7f3914924700 1 --2- 172.21.15.80:0/4022355962 >> v2:172.21.15.106:3300/0 conn(0x7f39100c4e00 0x7f39100cc3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:22.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.061+0000 7f3914924700 1 -- 172.21.15.80:0/4022355962 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39100cad60 con 0x7f39100cbe40 2024-05-08T21:17:22.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.061+0000 7f3914924700 1 --2- 172.21.15.80:0/4022355962 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f39100cbe40 0x7f39100c48c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f39100cb470 tx=0x7f3900009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dc999d966027e3b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:17:22.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.061+0000 7f3907fff700 1 -- 172.21.15.80:0/4022355962 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3900011830 con 0x7f39100cbe40 2024-05-08T21:17:22.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.061+0000 7f3907fff700 1 -- 172.21.15.80:0/4022355962 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3900011990 con 0x7f39100cbe40 2024-05-08T21:17:22.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.061+0000 7f3907fff700 1 -- 172.21.15.80:0/4022355962 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3900011d20 con 0x7f39100cbe40 2024-05-08T21:17:22.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.062+0000 7f3917389700 1 -- 172.21.15.80:0/4022355962 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f39100cbe40 msgr2=0x7f39100c48c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:22.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.062+0000 7f3917389700 1 --2- 172.21.15.80:0/4022355962 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f39100cbe40 0x7f39100c48c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f39100cb470 tx=0x7f3900009bd0 comp rx=0 tx=0).stop 2024-05-08T21:17:22.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.062+0000 7f3917389700 1 -- 172.21.15.80:0/4022355962 shutdown_connections 2024-05-08T21:17:22.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.062+0000 7f3917389700 1 --2- 172.21.15.80:0/4022355962 >> v2:172.21.15.106:3300/0 conn(0x7f39100c4e00 0x7f39100cc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:22.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.062+0000 7f3917389700 1 --2- 172.21.15.80:0/4022355962 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3910154580 0x7f391015abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:22.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.062+0000 7f3917389700 1 --2- 172.21.15.80:0/4022355962 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f39100cbe40 0x7f39100c48c0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:22.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.062+0000 7f3917389700 1 -- 172.21.15.80:0/4022355962 >> 172.21.15.80:0/4022355962 conn(0x7f391006c6a0 msgr2=0x7f391006cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:17:22.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.062+0000 7f3917389700 1 -- 172.21.15.80:0/4022355962 shutdown_connections 2024-05-08T21:17:22.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.062+0000 7f3917389700 1 -- 172.21.15.80:0/4022355962 wait complete. 2024-05-08T21:17:22.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.064+0000 7f3917389700 1 Processor -- start 2024-05-08T21:17:22.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.064+0000 7f3917389700 1 -- start start 2024-05-08T21:17:22.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.065+0000 7f3917389700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f39100c4e00 0x7f3910144e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:22.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.065+0000 7f3917389700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f39100cbe40 0x7f39101f0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:22.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.065+0000 7f3917389700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3910154580 0x7f39100ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:22.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.065+0000 7f3917389700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39101464d0 con 0x7f3910154580 2024-05-08T21:17:22.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.065+0000 7f3917389700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39101f02b0 con 0x7f39100c4e00 2024-05-08T21:17:22.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.065+0000 7f3917389700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3910147780 con 0x7f39100cbe40 2024-05-08T21:17:22.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.065+0000 7f3915926700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3910154580 0x7f39100ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:22.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.065+0000 7f3915926700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3910154580 0x7f39100ce6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45582/0 (socket says 172.21.15.80:45582) 2024-05-08T21:17:22.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.065+0000 7f3915926700 1 -- 172.21.15.80:0/1299829450 learned_addr learned my addr 172.21.15.80:0/1299829450 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:17:22.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.065+0000 7f3914924700 1 --2- 172.21.15.80:0/1299829450 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f39100cbe40 0x7f39101f0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:22.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.065+0000 7f3915125700 1 --2- 172.21.15.80:0/1299829450 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f39100c4e00 0x7f3910144e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:22.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.065+0000 7f3915926700 1 -- 172.21.15.80:0/1299829450 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f39100cbe40 msgr2=0x7f39101f0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:22.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.065+0000 7f3915926700 1 --2- 172.21.15.80:0/1299829450 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f39100cbe40 0x7f39101f0740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:22.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.065+0000 7f3915926700 1 -- 172.21.15.80:0/1299829450 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f39100c4e00 msgr2=0x7f3910144e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:22.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.065+0000 7f3915926700 1 --2- 172.21.15.80:0/1299829450 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f39100c4e00 0x7f3910144e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:22.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.065+0000 7f3915926700 1 -- 172.21.15.80:0/1299829450 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3900009550 con 0x7f3910154580 2024-05-08T21:17:22.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.066+0000 7f3915926700 1 --2- 172.21.15.80:0/1299829450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3910154580 0x7f39100ce6f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f390800eed0 tx=0x7f390800b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:17:22.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.066+0000 7f3905ffb700 1 -- 172.21.15.80:0/1299829450 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3908010040 con 0x7f3910154580 2024-05-08T21:17:22.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.066+0000 7f3905ffb700 1 -- 172.21.15.80:0/1299829450 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f390800bc80 con 0x7f3910154580 2024-05-08T21:17:22.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.066+0000 7f3905ffb700 1 -- 172.21.15.80:0/1299829450 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3908009e40 con 0x7f3910154580 2024-05-08T21:17:22.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.066+0000 7f3917389700 1 -- 172.21.15.80:0/1299829450 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3910147a20 con 0x7f3910154580 2024-05-08T21:17:22.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.066+0000 7f3917389700 1 -- 172.21.15.80:0/1299829450 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39101eff40 con 0x7f3910154580 2024-05-08T21:17:22.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.067+0000 7f3917389700 1 -- 172.21.15.80:0/1299829450 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39101f0460 con 0x7f3910154580 2024-05-08T21:17:22.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.067+0000 7f3905ffb700 1 -- 172.21.15.80:0/1299829450 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3908014400 con 0x7f3910154580 2024-05-08T21:17:22.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.068+0000 7f3905ffb700 1 --2- 172.21.15.80:0/1299829450 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f38f406ac90 0x7f38f406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:22.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.068+0000 7f3915125700 1 --2- 172.21.15.80:0/1299829450 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f38f406ac90 0x7f38f406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:22.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.068+0000 7f3905ffb700 1 -- 172.21.15.80:0/1299829450 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6921+0+0 (secure 0 0 0) 0x7f3908089b20 con 0x7f3910154580 2024-05-08T21:17:22.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.068+0000 7f3915125700 1 --2- 172.21.15.80:0/1299829450 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f38f406ac90 0x7f38f406d150 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f390c009b40 tx=0x7f390c009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:17:22.075 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.072+0000 7f3905ffb700 1 -- 172.21.15.80:0/1299829450 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f39101f0460 con 0x7f3910154580 2024-05-08T21:17:22.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.313+0000 7f3917389700 1 -- 172.21.15.80:0/1299829450 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f39101f0460 con 0x7f3910154580 2024-05-08T21:17:22.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.313+0000 7f3905ffb700 1 -- 172.21.15.80:0/1299829450 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+5494 (secure 0 0 0) 0x7f39101f0460 con 0x7f3910154580 2024-05-08T21:17:22.316 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:17:22.316 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:17:21.292778+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5086},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5086":{"gid":5086,"name":"b","rank":0,"incarnation":21,"state":"up:replay","state_seq":1,"addr":"172.21.15.106:6833/791920806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":791920806},{"type":"v1","addr":"172.21.15.106:6833","nonce":791920806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:17:22.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.315+0000 7f3917389700 1 -- 172.21.15.80:0/1299829450 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f38f406ac90 msgr2=0x7f38f406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:22.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.315+0000 7f3917389700 1 --2- 172.21.15.80:0/1299829450 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f38f406ac90 0x7f38f406d150 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f390c009b40 tx=0x7f390c009210 comp rx=0 tx=0).stop 2024-05-08T21:17:22.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.315+0000 7f3917389700 1 -- 172.21.15.80:0/1299829450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3910154580 msgr2=0x7f39100ce6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:22.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.315+0000 7f3917389700 1 --2- 172.21.15.80:0/1299829450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3910154580 0x7f39100ce6f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f390800eed0 tx=0x7f390800b390 comp rx=0 tx=0).stop 2024-05-08T21:17:22.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.315+0000 7f3917389700 1 -- 172.21.15.80:0/1299829450 shutdown_connections 2024-05-08T21:17:22.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.315+0000 7f3917389700 1 --2- 172.21.15.80:0/1299829450 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f38f406ac90 0x7f38f406d150 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:22.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.315+0000 7f3917389700 1 --2- 172.21.15.80:0/1299829450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3910154580 0x7f39100ce6f0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:22.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.315+0000 7f3917389700 1 --2- 172.21.15.80:0/1299829450 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f39100c4e00 0x7f3910144e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:22.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.315+0000 7f3917389700 1 --2- 172.21.15.80:0/1299829450 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f39100cbe40 0x7f39101f0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:22.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.315+0000 7f3917389700 1 -- 172.21.15.80:0/1299829450 >> 172.21.15.80:0/1299829450 conn(0x7f391006c6a0 msgr2=0x7f391015b530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:17:22.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.315+0000 7f3917389700 1 -- 172.21.15.80:0/1299829450 shutdown_connections 2024-05-08T21:17:22.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.315+0000 7f3917389700 1 -- 172.21.15.80:0/1299829450 wait complete. 2024-05-08T21:17:22.320 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 21 2024-05-08T21:17:22.330 INFO:tasks.mds_thrash.fs.[cephfs]:mds.d down, removed from mdsmap 2024-05-08T21:17:22.331 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for mds cluster to stabilize... 2024-05-08T21:17:22.331 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:17:22.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.450+0000 7f5828c16700 1 Processor -- start 2024-05-08T21:17:22.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.450+0000 7f5828c16700 1 -- start start 2024-05-08T21:17:22.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.450+0000 7f5828c16700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5824154390 0x7f582415ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:22.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.450+0000 7f5828c16700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f58240ca840 0x7f582415b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:22.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.450+0000 7f5828c16700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58240732b0 con 0x7f58240ca400 2024-05-08T21:17:22.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.450+0000 7f5828c16700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f582415b1b0 con 0x7f5824154390 2024-05-08T21:17:22.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.450+0000 7f5828c16700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58240c5d20 con 0x7f58240ca840 2024-05-08T21:17:22.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.451+0000 7f582259c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5824154390 0x7f582415ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:22.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.451+0000 7f5821d9b700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f58240ca400 0x7f58240cff30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44082/0 (socket says 172.21.15.80:44082) 2024-05-08T21:17:22.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.451+0000 7f5821d9b700 1 -- 172.21.15.80:0/2941569261 learned_addr learned my addr 172.21.15.80:0/2941569261 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:17:22.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.451+0000 7f5822d9d700 1 --2- 172.21.15.80:0/2941569261 >> v2:172.21.15.106:3300/0 conn(0x7f58240ca840 0x7f582415b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:22.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.451+0000 7f582259c700 1 -- 172.21.15.80:0/2941569261 >> v2:172.21.15.106:3300/0 conn(0x7f58240ca840 msgr2=0x7f582415b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:17:22.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.451+0000 7f582259c700 1 --2- 172.21.15.80:0/2941569261 >> v2:172.21.15.106:3300/0 conn(0x7f58240ca840 0x7f582415b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:22.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.451+0000 7f582259c700 1 -- 172.21.15.80:0/2941569261 >> v1:172.21.15.80:6789/0 conn(0x7f58240ca400 legacy=0x7f58240cff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:22.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.451+0000 7f582159a700 1 -- 172.21.15.80:0/2941569261 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3370454002 0 0) 0x7f58240732b0 con 0x7f58240ca400 2024-05-08T21:17:22.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.451+0000 7f582259c700 1 -- 172.21.15.80:0/2941569261 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58240c49a0 con 0x7f5824154390 2024-05-08T21:17:22.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.451+0000 7f582259c700 1 --2- 172.21.15.80:0/2941569261 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5824154390 0x7f582415ac70 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f582415d690 tx=0x7f5814009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6e50473ef7e6482 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:17:22.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.451+0000 7f582159a700 1 -- 172.21.15.80:0/2941569261 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5814011830 con 0x7f5824154390 2024-05-08T21:17:22.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.451+0000 7f582159a700 1 -- 172.21.15.80:0/2941569261 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5814011990 con 0x7f5824154390 2024-05-08T21:17:22.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.451+0000 7f582159a700 1 -- 172.21.15.80:0/2941569261 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5814011d20 con 0x7f5824154390 2024-05-08T21:17:22.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.452+0000 7f5828c16700 1 -- 172.21.15.80:0/2941569261 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5824154390 msgr2=0x7f582415ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:22.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.452+0000 7f5828c16700 1 --2- 172.21.15.80:0/2941569261 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5824154390 0x7f582415ac70 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f582415d690 tx=0x7f5814009b20 comp rx=0 tx=0).stop 2024-05-08T21:17:22.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.452+0000 7f5828c16700 1 -- 172.21.15.80:0/2941569261 shutdown_connections 2024-05-08T21:17:22.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.452+0000 7f5828c16700 1 --2- 172.21.15.80:0/2941569261 >> v2:172.21.15.106:3300/0 conn(0x7f58240ca840 0x7f582415b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:22.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.452+0000 7f5828c16700 1 --2- 172.21.15.80:0/2941569261 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5824154390 0x7f582415ac70 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:22.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.452+0000 7f5828c16700 1 -- 172.21.15.80:0/2941569261 >> 172.21.15.80:0/2941569261 conn(0x7f582406ab90 msgr2=0x7f582406afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:17:22.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.452+0000 7f5828c16700 1 -- 172.21.15.80:0/2941569261 shutdown_connections 2024-05-08T21:17:22.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.452+0000 7f5828c16700 1 -- 172.21.15.80:0/2941569261 wait complete. 2024-05-08T21:17:22.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.453+0000 7f5828c16700 1 Processor -- start 2024-05-08T21:17:22.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.453+0000 7f5828c16700 1 -- start start 2024-05-08T21:17:22.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.454+0000 7f5828c16700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58240ca400 0x7f582415c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:22.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.454+0000 7f5828c16700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58240ca840 0x7f582415cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:22.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.454+0000 7f5828c16700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5824154390 0x7f58240b3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:22.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.454+0000 7f5828c16700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5824150c10 con 0x7f58240ca840 2024-05-08T21:17:22.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.454+0000 7f5828c16700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f582414fa60 con 0x7f58240ca400 2024-05-08T21:17:22.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.454+0000 7f5828c16700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f582414fd20 con 0x7f5824154390 2024-05-08T21:17:22.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.454+0000 7f5821d9b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58240ca840 0x7f582415cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:22.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.454+0000 7f5821d9b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58240ca840 0x7f582415cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47456/0 (socket says 172.21.15.80:47456) 2024-05-08T21:17:22.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.454+0000 7f5821d9b700 1 -- 172.21.15.80:0/4187796751 learned_addr learned my addr 172.21.15.80:0/4187796751 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:17:22.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.454+0000 7f582259c700 1 --2- 172.21.15.80:0/4187796751 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58240ca400 0x7f582415c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:22.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.454+0000 7f5822d9d700 1 --2- 172.21.15.80:0/4187796751 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5824154390 0x7f58240b3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:22.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.454+0000 7f5821d9b700 1 -- 172.21.15.80:0/4187796751 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5824154390 msgr2=0x7f58240b3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:22.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.454+0000 7f5821d9b700 1 --2- 172.21.15.80:0/4187796751 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5824154390 0x7f58240b3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:22.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.454+0000 7f5821d9b700 1 -- 172.21.15.80:0/4187796751 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58240ca400 msgr2=0x7f582415c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:22.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.454+0000 7f5821d9b700 1 --2- 172.21.15.80:0/4187796751 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58240ca400 0x7f582415c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:22.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.454+0000 7f5821d9b700 1 -- 172.21.15.80:0/4187796751 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58140094a0 con 0x7f58240ca840 2024-05-08T21:17:22.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.454+0000 7f5822d9d700 1 --2- 172.21.15.80:0/4187796751 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5824154390 0x7f58240b3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:17:22.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.454+0000 7f5821d9b700 1 --2- 172.21.15.80:0/4187796751 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58240ca840 0x7f582415cbf0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f58180010e0 tx=0x7f581800ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:17:22.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.454+0000 7f5812ffd700 1 -- 172.21.15.80:0/4187796751 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58180074e0 con 0x7f58240ca840 2024-05-08T21:17:22.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.454+0000 7f5812ffd700 1 -- 172.21.15.80:0/4187796751 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5818007640 con 0x7f58240ca840 2024-05-08T21:17:22.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.454+0000 7f5828c16700 1 -- 172.21.15.80:0/4187796751 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5824150000 con 0x7f58240ca840 2024-05-08T21:17:22.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.454+0000 7f5812ffd700 1 -- 172.21.15.80:0/4187796751 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5818005a70 con 0x7f58240ca840 2024-05-08T21:17:22.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.454+0000 7f5828c16700 1 -- 172.21.15.80:0/4187796751 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58241505c0 con 0x7f58240ca840 2024-05-08T21:17:22.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.455+0000 7f5828c16700 1 -- 172.21.15.80:0/4187796751 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5824150dc0 con 0x7f58240ca840 2024-05-08T21:17:22.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.456+0000 7f5812ffd700 1 -- 172.21.15.80:0/4187796751 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5818005bd0 con 0x7f58240ca840 2024-05-08T21:17:22.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.456+0000 7f5812ffd700 1 --2- 172.21.15.80:0/4187796751 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f580406ac90 0x7f580406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:22.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.456+0000 7f582259c700 1 --2- 172.21.15.80:0/4187796751 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f580406ac90 0x7f580406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:22.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.456+0000 7f5812ffd700 1 -- 172.21.15.80:0/4187796751 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6921+0+0 (secure 0 0 0) 0x7f5818088c70 con 0x7f58240ca840 2024-05-08T21:17:22.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.457+0000 7f582259c700 1 --2- 172.21.15.80:0/4187796751 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f580406ac90 0x7f580406d150 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f58140090b0 tx=0x7f581401c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:17:22.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.461+0000 7f5812ffd700 1 -- 172.21.15.80:0/4187796751 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f5824150dc0 con 0x7f58240ca840 2024-05-08T21:17:22.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.713+0000 7f5828c16700 1 -- 172.21.15.80:0/4187796751 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f582404ec60 con 0x7f58240ca840 2024-05-08T21:17:22.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.714+0000 7f5812ffd700 1 -- 172.21.15.80:0/4187796751 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+5494 (secure 0 0 0) 0x7f5818017020 con 0x7f58240ca840 2024-05-08T21:17:22.717 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:17:22.717 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:17:21.292778+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5086},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5086":{"gid":5086,"name":"b","rank":0,"incarnation":21,"state":"up:replay","state_seq":1,"addr":"172.21.15.106:6833/791920806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":791920806},{"type":"v1","addr":"172.21.15.106:6833","nonce":791920806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:17:22.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.716+0000 7f5828c16700 1 -- 172.21.15.80:0/4187796751 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f580406ac90 msgr2=0x7f580406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:22.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.716+0000 7f5828c16700 1 --2- 172.21.15.80:0/4187796751 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f580406ac90 0x7f580406d150 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f58140090b0 tx=0x7f581401c040 comp rx=0 tx=0).stop 2024-05-08T21:17:22.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.716+0000 7f5828c16700 1 -- 172.21.15.80:0/4187796751 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58240ca840 msgr2=0x7f582415cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:22.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.716+0000 7f5828c16700 1 --2- 172.21.15.80:0/4187796751 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58240ca840 0x7f582415cbf0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f58180010e0 tx=0x7f581800ca30 comp rx=0 tx=0).stop 2024-05-08T21:17:22.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.716+0000 7f5828c16700 1 -- 172.21.15.80:0/4187796751 shutdown_connections 2024-05-08T21:17:22.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.716+0000 7f5828c16700 1 --2- 172.21.15.80:0/4187796751 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f580406ac90 0x7f580406d150 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:22.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.716+0000 7f5828c16700 1 --2- 172.21.15.80:0/4187796751 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5824154390 0x7f58240b3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:22.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.716+0000 7f5828c16700 1 --2- 172.21.15.80:0/4187796751 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58240ca400 0x7f582415c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:22.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.716+0000 7f5828c16700 1 --2- 172.21.15.80:0/4187796751 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58240ca840 0x7f582415cbf0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:22.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.716+0000 7f5828c16700 1 -- 172.21.15.80:0/4187796751 >> 172.21.15.80:0/4187796751 conn(0x7f582406ab90 msgr2=0x7f582415a520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:17:22.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.716+0000 7f5828c16700 1 -- 172.21.15.80:0/4187796751 shutdown_connections 2024-05-08T21:17:22.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:22.716+0000 7f5828c16700 1 -- 172.21.15.80:0/4187796751 wait complete. 2024-05-08T21:17:22.720 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 21 2024-05-08T21:17:22.731 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 21, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-05-08T21:10:03.725481+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 21, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_5086": { "addr": "172.21.15.106:6833/791920806", "addrs": { "addrvec": [ { "addr": "172.21.15.106:6832", "nonce": 791920806, "type": "v2" }, { "addr": "172.21.15.106:6833", "nonce": 791920806, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5086, "incarnation": 21, "join_fscid": -1, "name": "b", "rank": 0, "state": "up:replay", "state_seq": 1 } }, "last_failure": 0, "last_failure_osd_epoch": 31, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-05-08T21:17:21.292778+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5086 } } } ], "standbys": [ { "addr": "172.21.15.106:6837/2762323230", "addrs": { "addrvec": [ { "addr": "172.21.15.106:6835", "nonce": 2762323230, "type": "v2" }, { "addr": "172.21.15.106:6837", "nonce": 2762323230, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4229, "incarnation": 0, "join_fscid": -1, "name": "f", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.80:6837/1121814432", "addrs": { "addrvec": [ { "addr": "172.21.15.80:6834", "nonce": 1121814432, "type": "v2" }, { "addr": "172.21.15.80:6837", "nonce": 1121814432, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4251, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.80:6839/1867024080", "addrs": { "addrvec": [ { "addr": "172.21.15.80:6838", "nonce": 1867024080, "type": "v2" }, { "addr": "172.21.15.80:6839", "nonce": 1867024080, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 2, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4254, "incarnation": 0, "join_fscid": -1, "name": "e", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.80:6836/1947012643", "addrs": { "addrvec": [ { "addr": "172.21.15.80:6835", "nonce": 1947012643, "type": "v2" }, { "addr": "172.21.15.80:6836", "nonce": 1947012643, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4273, "incarnation": 0, "join_fscid": -1, "name": "c", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-05-08T21:17:24.733 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:17:24.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:24.859+0000 7f1ff3985700 1 Processor -- start 2024-05-08T21:17:24.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:24.860+0000 7f1ff3985700 1 -- start start 2024-05-08T21:17:24.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:24.860+0000 7f1ff3985700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1fec142a70 0x7f1fec071f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:24.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:24.860+0000 7f1ff3985700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fec15b1b0 con 0x7f1fec0c9cb0 2024-05-08T21:17:24.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:24.860+0000 7f1ff3985700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fec15a630 con 0x7f1fec0c73d0 2024-05-08T21:17:24.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:24.860+0000 7f1ff3985700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fec15a910 con 0x7f1fec142a70 2024-05-08T21:17:24.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:24.860+0000 7f1ff1f22700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f1fec0c9cb0 0x7f1fec15ddf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44094/0 (socket says 172.21.15.80:44094) 2024-05-08T21:17:24.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:24.860+0000 7f1ff1f22700 1 -- 172.21.15.80:0/1140498608 learned_addr learned my addr 172.21.15.80:0/1140498608 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:17:24.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:24.861+0000 7f1ff1721700 1 --2- 172.21.15.80:0/1140498608 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1fec142a70 0x7f1fec071f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:24.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:24.861+0000 7f1fe3fff700 1 -- 172.21.15.80:0/1140498608 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3530993761 0 0) 0x7f1fec15b1b0 con 0x7f1fec0c9cb0 2024-05-08T21:17:24.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:24.861+0000 7f1fe3fff700 1 -- 172.21.15.80:0/1140498608 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fd80035b0 con 0x7f1fec0c9cb0 2024-05-08T21:17:24.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:24.861+0000 7f1fe3fff700 1 -- 172.21.15.80:0/1140498608 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2747697922 0 0) 0x7f1fec15a630 con 0x7f1fec0c73d0 2024-05-08T21:17:24.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:24.861+0000 7f1ff1721700 1 -- 172.21.15.80:0/1140498608 >> v1:172.21.15.106:6789/0 conn(0x7f1fec0c73d0 legacy=0x7f1fec06a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:24.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:24.861+0000 7f1ff1721700 1 -- 172.21.15.80:0/1140498608 >> v1:172.21.15.80:6789/0 conn(0x7f1fec0c9cb0 legacy=0x7f1fec15ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:24.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:24.861+0000 7f1ff1721700 1 -- 172.21.15.80:0/1140498608 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fec15abf0 con 0x7f1fec142a70 2024-05-08T21:17:24.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:24.861+0000 7f1ff1721700 1 --2- 172.21.15.80:0/1140498608 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1fec142a70 0x7f1fec071f90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc009870 tx=0x7f1fdc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=676d3e08cc53fa4a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:17:24.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:24.861+0000 7f1fe3fff700 1 -- 172.21.15.80:0/1140498608 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc011830 con 0x7f1fec142a70 2024-05-08T21:17:24.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:24.861+0000 7f1fe3fff700 1 -- 172.21.15.80:0/1140498608 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fdc011990 con 0x7f1fec142a70 2024-05-08T21:17:24.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:24.861+0000 7f1fe3fff700 1 -- 172.21.15.80:0/1140498608 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc011d20 con 0x7f1fec142a70 2024-05-08T21:17:24.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:24.862+0000 7f1ff3985700 1 -- 172.21.15.80:0/1140498608 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1fec142a70 msgr2=0x7f1fec071f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:24.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:24.862+0000 7f1ff3985700 1 --2- 172.21.15.80:0/1140498608 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1fec142a70 0x7f1fec071f90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc009870 tx=0x7f1fdc009b80 comp rx=0 tx=0).stop 2024-05-08T21:17:24.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:24.862+0000 7f1ff3985700 1 -- 172.21.15.80:0/1140498608 shutdown_connections 2024-05-08T21:17:24.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:24.862+0000 7f1ff3985700 1 --2- 172.21.15.80:0/1140498608 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1fec142a70 0x7f1fec071f90 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:24.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:24.862+0000 7f1ff3985700 1 -- 172.21.15.80:0/1140498608 >> 172.21.15.80:0/1140498608 conn(0x7f1fec06f140 msgr2=0x7f1fec06f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:17:24.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:24.862+0000 7f1ff3985700 1 -- 172.21.15.80:0/1140498608 shutdown_connections 2024-05-08T21:17:24.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:24.862+0000 7f1ff3985700 1 -- 172.21.15.80:0/1140498608 wait complete. 2024-05-08T21:17:24.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:24.863+0000 7f1ff3985700 1 Processor -- start 2024-05-08T21:17:24.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:24.863+0000 7f1ff3985700 1 -- start start 2024-05-08T21:17:24.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:24.864+0000 7f1ff3985700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1fec0c73d0 0x7f1fec1f0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:24.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:24.864+0000 7f1ff3985700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1fec0c9cb0 0x7f1fec15c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:24.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:24.864+0000 7f1ff3985700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1fec142a70 0x7f1fec0c4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:24.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:24.864+0000 7f1ff3985700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fec1f39e0 con 0x7f1fec0c9cb0 2024-05-08T21:17:24.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:24.864+0000 7f1ff3985700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fec0bf560 con 0x7f1fec142a70 2024-05-08T21:17:24.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:24.864+0000 7f1ff3985700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fec1f0a80 con 0x7f1fec0c73d0 2024-05-08T21:17:24.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:24.864+0000 7f1ff0f20700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1fec0c9cb0 0x7f1fec15c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:24.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:24.864+0000 7f1ff0f20700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1fec0c9cb0 0x7f1fec15c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47458/0 (socket says 172.21.15.80:47458) 2024-05-08T21:17:24.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:24.864+0000 7f1ff0f20700 1 -- 172.21.15.80:0/3542523948 learned_addr learned my addr 172.21.15.80:0/3542523948 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:17:24.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:24.864+0000 7f1ff1721700 1 --2- 172.21.15.80:0/3542523948 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1fec0c73d0 0x7f1fec1f0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:24.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:24.864+0000 7f1ff1f22700 1 --2- 172.21.15.80:0/3542523948 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1fec142a70 0x7f1fec0c4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:24.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:24.864+0000 7f1ff0f20700 1 -- 172.21.15.80:0/3542523948 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1fec0c73d0 msgr2=0x7f1fec1f0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:24.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:24.864+0000 7f1ff0f20700 1 --2- 172.21.15.80:0/3542523948 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1fec0c73d0 0x7f1fec1f0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:24.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:24.864+0000 7f1ff0f20700 1 -- 172.21.15.80:0/3542523948 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1fec142a70 msgr2=0x7f1fec0c4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:24.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:24.864+0000 7f1ff0f20700 1 --2- 172.21.15.80:0/3542523948 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1fec142a70 0x7f1fec0c4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:24.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:24.864+0000 7f1ff0f20700 1 -- 172.21.15.80:0/3542523948 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fdc0094a0 con 0x7f1fec0c9cb0 2024-05-08T21:17:24.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:24.864+0000 7f1ff0f20700 1 --2- 172.21.15.80:0/3542523948 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1fec0c9cb0 0x7f1fec15c2d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f1fe800c500 tx=0x7f1fe800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:17:24.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:24.864+0000 7f1fe1ffb700 1 -- 172.21.15.80:0/3542523948 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe80054e0 con 0x7f1fec0c9cb0 2024-05-08T21:17:24.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:24.865+0000 7f1fe1ffb700 1 -- 172.21.15.80:0/3542523948 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fe8003680 con 0x7f1fec0c9cb0 2024-05-08T21:17:24.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:24.865+0000 7f1ff3985700 1 -- 172.21.15.80:0/3542523948 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fec0c06a0 con 0x7f1fec0c9cb0 2024-05-08T21:17:24.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:24.865+0000 7f1fe1ffb700 1 -- 172.21.15.80:0/3542523948 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe8003a30 con 0x7f1fec0c9cb0 2024-05-08T21:17:24.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:24.865+0000 7f1ff3985700 1 -- 172.21.15.80:0/3542523948 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fec0c0c40 con 0x7f1fec0c9cb0 2024-05-08T21:17:24.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:24.866+0000 7f1ff3985700 1 -- 172.21.15.80:0/3542523948 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fec072290 con 0x7f1fec0c9cb0 2024-05-08T21:17:24.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:24.866+0000 7f1fe1ffb700 1 -- 172.21.15.80:0/3542523948 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1fe8003b90 con 0x7f1fec0c9cb0 2024-05-08T21:17:24.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:24.866+0000 7f1fe1ffb700 1 --2- 172.21.15.80:0/3542523948 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f1fd006ac90 0x7f1fd006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:24.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:24.867+0000 7f1fe1ffb700 1 -- 172.21.15.80:0/3542523948 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6921+0+0 (secure 0 0 0) 0x7f1fe8088de0 con 0x7f1fec0c9cb0 2024-05-08T21:17:24.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:24.867+0000 7f1ff1721700 1 --2- 172.21.15.80:0/3542523948 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f1fd006ac90 0x7f1fd006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:24.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:24.867+0000 7f1ff1721700 1 --2- 172.21.15.80:0/3542523948 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f1fd006ac90 0x7f1fd006d150 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc0097c0 tx=0x7f1fdc01c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:17:24.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:24.871+0000 7f1fe1ffb700 1 -- 172.21.15.80:0/3542523948 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f1fe8053a70 con 0x7f1fec0c9cb0 2024-05-08T21:17:25.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:25.129+0000 7f1ff3985700 1 -- 172.21.15.80:0/3542523948 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1fec0725f0 con 0x7f1fec0c9cb0 2024-05-08T21:17:25.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:25.130+0000 7f1fe1ffb700 1 -- 172.21.15.80:0/3542523948 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+5494 (secure 0 0 0) 0x7f1fe8017070 con 0x7f1fec0c9cb0 2024-05-08T21:17:25.133 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:17:25.133 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:17:21.292778+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5086},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5086":{"gid":5086,"name":"b","rank":0,"incarnation":21,"state":"up:replay","state_seq":1,"addr":"172.21.15.106:6833/791920806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":791920806},{"type":"v1","addr":"172.21.15.106:6833","nonce":791920806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:17:25.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:25.132+0000 7f1ff3985700 1 -- 172.21.15.80:0/3542523948 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f1fd006ac90 msgr2=0x7f1fd006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:25.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:25.132+0000 7f1ff3985700 1 --2- 172.21.15.80:0/3542523948 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f1fd006ac90 0x7f1fd006d150 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc0097c0 tx=0x7f1fdc01c040 comp rx=0 tx=0).stop 2024-05-08T21:17:25.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:25.132+0000 7f1ff3985700 1 -- 172.21.15.80:0/3542523948 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1fec0c9cb0 msgr2=0x7f1fec15c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:25.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:25.132+0000 7f1ff3985700 1 --2- 172.21.15.80:0/3542523948 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1fec0c9cb0 0x7f1fec15c2d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f1fe800c500 tx=0x7f1fe800c8c0 comp rx=0 tx=0).stop 2024-05-08T21:17:25.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:25.132+0000 7f1ff3985700 1 -- 172.21.15.80:0/3542523948 shutdown_connections 2024-05-08T21:17:25.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:25.132+0000 7f1ff3985700 1 --2- 172.21.15.80:0/3542523948 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f1fd006ac90 0x7f1fd006d150 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:25.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:25.132+0000 7f1ff3985700 1 --2- 172.21.15.80:0/3542523948 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1fec142a70 0x7f1fec0c4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:25.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:25.132+0000 7f1ff3985700 1 --2- 172.21.15.80:0/3542523948 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1fec0c73d0 0x7f1fec1f0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:25.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:25.132+0000 7f1ff3985700 1 --2- 172.21.15.80:0/3542523948 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1fec0c9cb0 0x7f1fec15c2d0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:25.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:25.132+0000 7f1ff3985700 1 -- 172.21.15.80:0/3542523948 >> 172.21.15.80:0/3542523948 conn(0x7f1fec06f140 msgr2=0x7f1fec140950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:17:25.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:25.132+0000 7f1ff3985700 1 -- 172.21.15.80:0/3542523948 shutdown_connections 2024-05-08T21:17:25.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:25.132+0000 7f1ff3985700 1 -- 172.21.15.80:0/3542523948 wait complete. 2024-05-08T21:17:25.136 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 21 2024-05-08T21:17:25.148 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-05-08T21:17:27.149 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:17:27.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.266+0000 7f5ecf7b6700 1 Processor -- start 2024-05-08T21:17:27.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.266+0000 7f5ecf7b6700 1 -- start start 2024-05-08T21:17:27.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.266+0000 7f5ecf7b6700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5ec806c5d0 0x7f5ec806bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:27.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.266+0000 7f5ecf7b6700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5ec806c010 0x7f5ec815a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:27.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.267+0000 7f5ecf7b6700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ec815b290 con 0x7f5ec8154300 2024-05-08T21:17:27.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.267+0000 7f5ecf7b6700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ec815e7e0 con 0x7f5ec806c010 2024-05-08T21:17:27.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.267+0000 7f5ecf7b6700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec815afb0 con 0x7f5ec806c5d0 2024-05-08T21:17:27.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.267+0000 7f5ecdd53700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5ec806c010 0x7f5ec815a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:27.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.267+0000 7f5ecdd53700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5ec806c010 0x7f5ec815a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47472/0 (socket says 172.21.15.80:47472) 2024-05-08T21:17:27.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.267+0000 7f5ecdd53700 1 -- 172.21.15.80:0/403978749 learned_addr learned my addr 172.21.15.80:0/403978749 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:17:27.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.267+0000 7f5eccd51700 1 --2- 172.21.15.80:0/403978749 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5ec806c5d0 0x7f5ec806bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:27.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.267+0000 7f5ecdd53700 1 -- 172.21.15.80:0/403978749 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5ec806c5d0 msgr2=0x7f5ec806bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:17:27.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.267+0000 7f5ecdd53700 1 --2- 172.21.15.80:0/403978749 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5ec806c5d0 0x7f5ec806bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:27.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.267+0000 7f5ecdd53700 1 -- 172.21.15.80:0/403978749 >> v1:172.21.15.106:6789/0 conn(0x7f5ec8154300 legacy=0x7f5ec80cc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:27.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.267+0000 7f5ecdd53700 1 -- 172.21.15.80:0/403978749 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec815da20 con 0x7f5ec806c010 2024-05-08T21:17:27.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.267+0000 7f5ecdd53700 1 --2- 172.21.15.80:0/403978749 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ec806c010 0x7f5ec815a300 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f5ec0009e50 tx=0x7f5ec000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0e30e0431d1d1f8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:17:27.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.267+0000 7f5ebffff700 1 -- 172.21.15.80:0/403978749 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec000e070 con 0x7f5ec806c010 2024-05-08T21:17:27.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.267+0000 7f5ebffff700 1 -- 172.21.15.80:0/403978749 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ec000b9c0 con 0x7f5ec806c010 2024-05-08T21:17:27.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.267+0000 7f5ebffff700 1 -- 172.21.15.80:0/403978749 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec000bd70 con 0x7f5ec806c010 2024-05-08T21:17:27.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.268+0000 7f5ecf7b6700 1 -- 172.21.15.80:0/403978749 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ec806c010 msgr2=0x7f5ec815a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:27.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.268+0000 7f5ecf7b6700 1 --2- 172.21.15.80:0/403978749 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ec806c010 0x7f5ec815a300 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f5ec0009e50 tx=0x7f5ec000b330 comp rx=0 tx=0).stop 2024-05-08T21:17:27.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.268+0000 7f5ecf7b6700 1 -- 172.21.15.80:0/403978749 shutdown_connections 2024-05-08T21:17:27.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.268+0000 7f5ecf7b6700 1 --2- 172.21.15.80:0/403978749 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ec806c010 0x7f5ec815a300 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:27.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.268+0000 7f5ecf7b6700 1 --2- 172.21.15.80:0/403978749 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5ec806c5d0 0x7f5ec806bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:27.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.268+0000 7f5ecf7b6700 1 -- 172.21.15.80:0/403978749 >> 172.21.15.80:0/403978749 conn(0x7f5ec8066780 msgr2=0x7f5ec8066b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:17:27.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.268+0000 7f5ecf7b6700 1 -- 172.21.15.80:0/403978749 shutdown_connections 2024-05-08T21:17:27.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.268+0000 7f5ecf7b6700 1 -- 172.21.15.80:0/403978749 wait complete. 2024-05-08T21:17:27.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.269+0000 7f5ecf7b6700 1 Processor -- start 2024-05-08T21:17:27.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.269+0000 7f5ecf7b6700 1 -- start start 2024-05-08T21:17:27.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.270+0000 7f5ecf7b6700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ec806c010 0x7f5ec814e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:27.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.270+0000 7f5ecf7b6700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5ec806c5d0 0x7f5ec80c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:27.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.270+0000 7f5ecf7b6700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ec8154300 0x7f5ec81f0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:27.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.270+0000 7f5ecf7b6700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec8155050 con 0x7f5ec8154300 2024-05-08T21:17:27.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.270+0000 7f5ecf7b6700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec81f0dd0 con 0x7f5ec806c010 2024-05-08T21:17:27.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.270+0000 7f5ecf7b6700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec80ca890 con 0x7f5ec806c5d0 2024-05-08T21:17:27.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.270+0000 7f5ecdd53700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ec8154300 0x7f5ec81f0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:27.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.270+0000 7f5ecdd53700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ec8154300 0x7f5ec81f0890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47488/0 (socket says 172.21.15.80:47488) 2024-05-08T21:17:27.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.270+0000 7f5ecdd53700 1 -- 172.21.15.80:0/2667256810 learned_addr learned my addr 172.21.15.80:0/2667256810 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:17:27.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.270+0000 7f5eccd51700 1 --2- 172.21.15.80:0/2667256810 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5ec806c5d0 0x7f5ec80c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:27.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.270+0000 7f5ecdd53700 1 -- 172.21.15.80:0/2667256810 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5ec806c5d0 msgr2=0x7f5ec80c8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:27.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.270+0000 7f5ecd552700 1 --2- 172.21.15.80:0/2667256810 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ec806c010 0x7f5ec814e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:27.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.270+0000 7f5ecdd53700 1 --2- 172.21.15.80:0/2667256810 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5ec806c5d0 0x7f5ec80c8c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:27.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.270+0000 7f5ecdd53700 1 -- 172.21.15.80:0/2667256810 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ec806c010 msgr2=0x7f5ec814e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:27.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.270+0000 7f5ecdd53700 1 --2- 172.21.15.80:0/2667256810 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ec806c010 0x7f5ec814e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:27.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.270+0000 7f5ecdd53700 1 -- 172.21.15.80:0/2667256810 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec0009b30 con 0x7f5ec8154300 2024-05-08T21:17:27.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.270+0000 7f5ecdd53700 1 --2- 172.21.15.80:0/2667256810 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ec8154300 0x7f5ec81f0890 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f5ec80cb550 tx=0x7f5ec0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:17:27.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.270+0000 7f5ebdffb700 1 -- 172.21.15.80:0/2667256810 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec00092e0 con 0x7f5ec8154300 2024-05-08T21:17:27.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.270+0000 7f5ebdffb700 1 -- 172.21.15.80:0/2667256810 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ec001c440 con 0x7f5ec8154300 2024-05-08T21:17:27.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.270+0000 7f5ecf7b6700 1 -- 172.21.15.80:0/2667256810 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ec80ca2f0 con 0x7f5ec8154300 2024-05-08T21:17:27.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.270+0000 7f5ebdffb700 1 -- 172.21.15.80:0/2667256810 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec001c7f0 con 0x7f5ec8154300 2024-05-08T21:17:27.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.270+0000 7f5ecf7b6700 1 -- 172.21.15.80:0/2667256810 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ec80c8170 con 0x7f5ec8154300 2024-05-08T21:17:27.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.271+0000 7f5ecf7b6700 1 -- 172.21.15.80:0/2667256810 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ec804ec60 con 0x7f5ec8154300 2024-05-08T21:17:27.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.273+0000 7f5ebdffb700 1 -- 172.21.15.80:0/2667256810 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5ec001c950 con 0x7f5ec8154300 2024-05-08T21:17:27.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.273+0000 7f5ebdffb700 1 --2- 172.21.15.80:0/2667256810 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f5eac06ac90 0x7f5eac06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:27.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.273+0000 7f5ebdffb700 1 -- 172.21.15.80:0/2667256810 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6921+0+0 (secure 0 0 0) 0x7f5ec008b8e0 con 0x7f5ec8154300 2024-05-08T21:17:27.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.273+0000 7f5ecd552700 1 --2- 172.21.15.80:0/2667256810 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f5eac06ac90 0x7f5eac06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:27.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.274+0000 7f5ecd552700 1 --2- 172.21.15.80:0/2667256810 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f5eac06ac90 0x7f5eac06d150 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5ec4000f60 tx=0x7f5ec4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:17:27.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.277+0000 7f5ebdffb700 1 -- 172.21.15.80:0/2667256810 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f5ec0056770 con 0x7f5ec8154300 2024-05-08T21:17:27.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.524+0000 7f5ecf7b6700 1 -- 172.21.15.80:0/2667256810 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5ec8153cb0 con 0x7f5ec8154300 2024-05-08T21:17:27.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.527+0000 7f5ebdffb700 1 -- 172.21.15.80:0/2667256810 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+5494 (secure 0 0 0) 0x7f5ec0059d90 con 0x7f5ec8154300 2024-05-08T21:17:27.530 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:17:27.530 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:17:21.292778+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5086},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5086":{"gid":5086,"name":"b","rank":0,"incarnation":21,"state":"up:replay","state_seq":1,"addr":"172.21.15.106:6833/791920806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":791920806},{"type":"v1","addr":"172.21.15.106:6833","nonce":791920806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:17:27.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.529+0000 7f5ecf7b6700 1 -- 172.21.15.80:0/2667256810 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f5eac06ac90 msgr2=0x7f5eac06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:27.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.529+0000 7f5ecf7b6700 1 --2- 172.21.15.80:0/2667256810 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f5eac06ac90 0x7f5eac06d150 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5ec4000f60 tx=0x7f5ec4009040 comp rx=0 tx=0).stop 2024-05-08T21:17:27.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.529+0000 7f5ecf7b6700 1 -- 172.21.15.80:0/2667256810 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ec8154300 msgr2=0x7f5ec81f0890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:27.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.529+0000 7f5ecf7b6700 1 --2- 172.21.15.80:0/2667256810 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ec8154300 0x7f5ec81f0890 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f5ec80cb550 tx=0x7f5ec0004ad0 comp rx=0 tx=0).stop 2024-05-08T21:17:27.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.529+0000 7f5ecf7b6700 1 -- 172.21.15.80:0/2667256810 shutdown_connections 2024-05-08T21:17:27.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.529+0000 7f5ecf7b6700 1 --2- 172.21.15.80:0/2667256810 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f5eac06ac90 0x7f5eac06d150 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:27.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.529+0000 7f5ecf7b6700 1 --2- 172.21.15.80:0/2667256810 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ec8154300 0x7f5ec81f0890 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:27.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.529+0000 7f5ecf7b6700 1 --2- 172.21.15.80:0/2667256810 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ec806c010 0x7f5ec814e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:27.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.529+0000 7f5ecf7b6700 1 --2- 172.21.15.80:0/2667256810 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5ec806c5d0 0x7f5ec80c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:27.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.529+0000 7f5ecf7b6700 1 -- 172.21.15.80:0/2667256810 >> 172.21.15.80:0/2667256810 conn(0x7f5ec8066780 msgr2=0x7f5ec80ccf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:17:27.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.529+0000 7f5ecf7b6700 1 -- 172.21.15.80:0/2667256810 shutdown_connections 2024-05-08T21:17:27.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:27.529+0000 7f5ecf7b6700 1 -- 172.21.15.80:0/2667256810 wait complete. 2024-05-08T21:17:27.533 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 21 2024-05-08T21:17:27.549 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-05-08T21:17:29.550 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:17:29.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.674+0000 7fcc6630f700 1 Processor -- start 2024-05-08T21:17:29.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.674+0000 7fcc6630f700 1 -- start start 2024-05-08T21:17:29.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.675+0000 7fcc6630f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcc60154390 0x7fcc6015ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:29.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.675+0000 7fcc6630f700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fcc600ca400 0x7fcc600cff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:29.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.675+0000 7fcc6630f700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc600732b0 con 0x7fcc600ca840 2024-05-08T21:17:29.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.675+0000 7fcc6630f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc6015b1b0 con 0x7fcc60154390 2024-05-08T21:17:29.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.675+0000 7fcc6630f700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc600c5d20 con 0x7fcc600ca400 2024-05-08T21:17:29.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.675+0000 7fcc5ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcc60154390 0x7fcc6015ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:29.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.675+0000 7fcc5ffff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcc60154390 0x7fcc6015ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47504/0 (socket says 172.21.15.80:47504) 2024-05-08T21:17:29.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.675+0000 7fcc5ffff700 1 -- 172.21.15.80:0/1034564894 learned_addr learned my addr 172.21.15.80:0/1034564894 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:17:29.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.675+0000 7fcc5f7fe700 1 --2- 172.21.15.80:0/1034564894 >> v2:172.21.15.106:3300/0 conn(0x7fcc600ca400 0x7fcc600cff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:29.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.675+0000 7fcc5ffff700 1 -- 172.21.15.80:0/1034564894 >> v2:172.21.15.106:3300/0 conn(0x7fcc600ca400 msgr2=0x7fcc600cff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:17:29.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.675+0000 7fcc5ffff700 1 --2- 172.21.15.80:0/1034564894 >> v2:172.21.15.106:3300/0 conn(0x7fcc600ca400 0x7fcc600cff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:29.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.675+0000 7fcc5ffff700 1 -- 172.21.15.80:0/1034564894 >> v1:172.21.15.106:6789/0 conn(0x7fcc600ca840 legacy=0x7fcc6015b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:17:29.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.675+0000 7fcc5ffff700 1 -- 172.21.15.80:0/1034564894 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc600c49a0 con 0x7fcc60154390 2024-05-08T21:17:29.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.675+0000 7fcc5ffff700 1 --2- 172.21.15.80:0/1034564894 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc60154390 0x7fcc6015ac70 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fcc600c6d50 tx=0x7fcc50009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b61b53f21fdde1f0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:17:29.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.676+0000 7fcc5effd700 1 -- 172.21.15.80:0/1034564894 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc50004230 con 0x7fcc60154390 2024-05-08T21:17:29.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.676+0000 7fcc5effd700 1 -- 172.21.15.80:0/1034564894 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc50004390 con 0x7fcc60154390 2024-05-08T21:17:29.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.676+0000 7fcc5effd700 1 -- 172.21.15.80:0/1034564894 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc500036a0 con 0x7fcc60154390 2024-05-08T21:17:29.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.676+0000 7fcc6630f700 1 -- 172.21.15.80:0/1034564894 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc60154390 msgr2=0x7fcc6015ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:29.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.676+0000 7fcc6630f700 1 --2- 172.21.15.80:0/1034564894 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc60154390 0x7fcc6015ac70 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fcc600c6d50 tx=0x7fcc50009bd0 comp rx=0 tx=0).stop 2024-05-08T21:17:29.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.676+0000 7fcc6630f700 1 -- 172.21.15.80:0/1034564894 shutdown_connections 2024-05-08T21:17:29.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.676+0000 7fcc6630f700 1 --2- 172.21.15.80:0/1034564894 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc60154390 0x7fcc6015ac70 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:29.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.676+0000 7fcc6630f700 1 --2- 172.21.15.80:0/1034564894 >> v2:172.21.15.106:3300/0 conn(0x7fcc600ca400 0x7fcc600cff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:29.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.676+0000 7fcc6630f700 1 -- 172.21.15.80:0/1034564894 >> 172.21.15.80:0/1034564894 conn(0x7fcc6006ab90 msgr2=0x7fcc6006afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:17:29.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.676+0000 7fcc6630f700 1 -- 172.21.15.80:0/1034564894 shutdown_connections 2024-05-08T21:17:29.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.676+0000 7fcc6630f700 1 -- 172.21.15.80:0/1034564894 wait complete. 2024-05-08T21:17:29.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.678+0000 7fcc6630f700 1 Processor -- start 2024-05-08T21:17:29.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.678+0000 7fcc6630f700 1 -- start start 2024-05-08T21:17:29.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.679+0000 7fcc6630f700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc600ca400 0x7fcc60159a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:29.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.679+0000 7fcc6630f700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcc600ca840 0x7fcc60150bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:29.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.679+0000 7fcc6630f700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc60154390 0x7fcc60144240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:29.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.679+0000 7fcc6630f700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc6014f7f0 con 0x7fcc600ca400 2024-05-08T21:17:29.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.679+0000 7fcc6630f700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc600b4ec0 con 0x7fcc60154390 2024-05-08T21:17:29.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.679+0000 7fcc6630f700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc60159fb0 con 0x7fcc600ca840 2024-05-08T21:17:29.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.679+0000 7fcc5ffff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc600ca400 0x7fcc60159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:29.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.679+0000 7fcc5ffff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc600ca400 0x7fcc60159a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47520/0 (socket says 172.21.15.80:47520) 2024-05-08T21:17:29.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.679+0000 7fcc5ffff700 1 -- 172.21.15.80:0/610988714 learned_addr learned my addr 172.21.15.80:0/610988714 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:17:29.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.679+0000 7fcc5f7fe700 1 --2- 172.21.15.80:0/610988714 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcc600ca840 0x7fcc60150bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:29.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.679+0000 7fcc648ac700 1 --2- 172.21.15.80:0/610988714 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc60154390 0x7fcc60144240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:29.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.679+0000 7fcc5ffff700 1 -- 172.21.15.80:0/610988714 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcc600ca840 msgr2=0x7fcc60150bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:29.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.679+0000 7fcc5ffff700 1 --2- 172.21.15.80:0/610988714 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcc600ca840 0x7fcc60150bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:29.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.679+0000 7fcc5ffff700 1 -- 172.21.15.80:0/610988714 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc60154390 msgr2=0x7fcc60144240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:29.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.679+0000 7fcc5ffff700 1 --2- 172.21.15.80:0/610988714 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc60154390 0x7fcc60144240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:29.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.679+0000 7fcc5ffff700 1 -- 172.21.15.80:0/610988714 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc50009550 con 0x7fcc600ca400 2024-05-08T21:17:29.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.679+0000 7fcc5ffff700 1 --2- 172.21.15.80:0/610988714 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc600ca400 0x7fcc60159a70 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fcc50009130 tx=0x7fcc50004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:17:29.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.680+0000 7fcc5cff9700 1 -- 172.21.15.80:0/610988714 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc50003ea0 con 0x7fcc600ca400 2024-05-08T21:17:29.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.680+0000 7fcc5cff9700 1 -- 172.21.15.80:0/610988714 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc50011630 con 0x7fcc600ca400 2024-05-08T21:17:29.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.680+0000 7fcc6630f700 1 -- 172.21.15.80:0/610988714 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc60158fd0 con 0x7fcc600ca400 2024-05-08T21:17:29.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.680+0000 7fcc5cff9700 1 -- 172.21.15.80:0/610988714 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc500119e0 con 0x7fcc600ca400 2024-05-08T21:17:29.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.680+0000 7fcc6630f700 1 -- 172.21.15.80:0/610988714 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc600b4900 con 0x7fcc600ca400 2024-05-08T21:17:29.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.681+0000 7fcc6630f700 1 -- 172.21.15.80:0/610988714 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc6004ec60 con 0x7fcc600ca400 2024-05-08T21:17:29.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.682+0000 7fcc5cff9700 1 -- 172.21.15.80:0/610988714 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fcc50011b40 con 0x7fcc600ca400 2024-05-08T21:17:29.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.682+0000 7fcc5cff9700 1 --2- 172.21.15.80:0/610988714 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fcc4c06ac90 0x7fcc4c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:29.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.682+0000 7fcc5cff9700 1 -- 172.21.15.80:0/610988714 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6921+0+0 (secure 0 0 0) 0x7fcc5008b250 con 0x7fcc600ca400 2024-05-08T21:17:29.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.682+0000 7fcc5f7fe700 1 --2- 172.21.15.80:0/610988714 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fcc4c06ac90 0x7fcc4c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:29.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.682+0000 7fcc5f7fe700 1 --2- 172.21.15.80:0/610988714 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fcc4c06ac90 0x7fcc4c06d150 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fcc600cf2d0 tx=0x7fcc54008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:17:29.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.689+0000 7fcc5cff9700 1 -- 172.21.15.80:0/610988714 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fcc50056000 con 0x7fcc600ca400 2024-05-08T21:17:29.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.938+0000 7fcc6630f700 1 -- 172.21.15.80:0/610988714 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcc6004ec60 con 0x7fcc600ca400 2024-05-08T21:17:29.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.939+0000 7fcc5cff9700 1 -- 172.21.15.80:0/610988714 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+5498 (secure 0 0 0) 0x7fcc50059620 con 0x7fcc600ca400 2024-05-08T21:17:29.942 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:17:29.942 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:17:27.522650+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5086},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5086":{"gid":5086,"name":"b","rank":0,"incarnation":21,"state":"up:reconnect","state_seq":36,"addr":"172.21.15.106:6833/791920806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":791920806},{"type":"v1","addr":"172.21.15.106:6833","nonce":791920806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:17:29.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.941+0000 7fcc6630f700 1 -- 172.21.15.80:0/610988714 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fcc4c06ac90 msgr2=0x7fcc4c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:29.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.941+0000 7fcc6630f700 1 --2- 172.21.15.80:0/610988714 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fcc4c06ac90 0x7fcc4c06d150 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fcc600cf2d0 tx=0x7fcc54008040 comp rx=0 tx=0).stop 2024-05-08T21:17:29.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.941+0000 7fcc6630f700 1 -- 172.21.15.80:0/610988714 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc600ca400 msgr2=0x7fcc60159a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:29.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.941+0000 7fcc6630f700 1 --2- 172.21.15.80:0/610988714 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc600ca400 0x7fcc60159a70 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fcc50009130 tx=0x7fcc50004750 comp rx=0 tx=0).stop 2024-05-08T21:17:29.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.941+0000 7fcc6630f700 1 -- 172.21.15.80:0/610988714 shutdown_connections 2024-05-08T21:17:29.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.941+0000 7fcc6630f700 1 --2- 172.21.15.80:0/610988714 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fcc4c06ac90 0x7fcc4c06d150 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:29.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.941+0000 7fcc6630f700 1 --2- 172.21.15.80:0/610988714 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc600ca400 0x7fcc60159a70 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:29.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.941+0000 7fcc6630f700 1 --2- 172.21.15.80:0/610988714 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc60154390 0x7fcc60144240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:29.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.941+0000 7fcc6630f700 1 --2- 172.21.15.80:0/610988714 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcc600ca840 0x7fcc60150bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:29.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.941+0000 7fcc6630f700 1 -- 172.21.15.80:0/610988714 >> 172.21.15.80:0/610988714 conn(0x7fcc6006ab90 msgr2=0x7fcc60153410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:17:29.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.941+0000 7fcc6630f700 1 -- 172.21.15.80:0/610988714 shutdown_connections 2024-05-08T21:17:29.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:29.941+0000 7fcc6630f700 1 -- 172.21.15.80:0/610988714 wait complete. 2024-05-08T21:17:29.945 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 22 2024-05-08T21:17:29.956 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-05-08T21:17:31.957 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:17:32.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.078+0000 7f63f58bd700 1 Processor -- start 2024-05-08T21:17:32.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.078+0000 7f63f58bd700 1 -- start start 2024-05-08T21:17:32.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.078+0000 7f63f58bd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f63f00c2230 0x7f63f00c6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:32.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.078+0000 7f63f58bd700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f63f00cb570 0x7f63f00cb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:32.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.078+0000 7f63f58bd700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63f0167f40 con 0x7f63f016a850 2024-05-08T21:17:32.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.078+0000 7f63f58bd700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63f00c6bc0 con 0x7f63f00c2230 2024-05-08T21:17:32.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.078+0000 7f63f58bd700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63f0167330 con 0x7f63f00cb570 2024-05-08T21:17:32.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.078+0000 7f63eeffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f63f00c2230 0x7f63f00c6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:32.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.079+0000 7f63eeffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f63f00c2230 0x7f63f00c6680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47530/0 (socket says 172.21.15.80:47530) 2024-05-08T21:17:32.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.079+0000 7f63eeffd700 1 -- 172.21.15.80:0/696051185 learned_addr learned my addr 172.21.15.80:0/696051185 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:17:32.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.079+0000 7f63ef7fe700 1 --1- 172.21.15.80:0/696051185 >> v1:172.21.15.80:6789/0 conn(0x7f63f016a850 0x7f63f016ace0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44098/0 (socket says 172.21.15.80:44098) 2024-05-08T21:17:32.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.079+0000 7f63ee7fc700 1 --2- 172.21.15.80:0/696051185 >> v2:172.21.15.106:3300/0 conn(0x7f63f00cb570 0x7f63f00cb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:32.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.107+0000 7f63eeffd700 1 -- 172.21.15.80:0/696051185 >> v2:172.21.15.106:3300/0 conn(0x7f63f00cb570 msgr2=0x7f63f00cb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:17:32.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.107+0000 7f63eeffd700 1 --2- 172.21.15.80:0/696051185 >> v2:172.21.15.106:3300/0 conn(0x7f63f00cb570 0x7f63f00cb9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:32.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.107+0000 7f63eeffd700 1 -- 172.21.15.80:0/696051185 >> v1:172.21.15.80:6789/0 conn(0x7f63f016a850 legacy=0x7f63f016ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:32.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.107+0000 7f63eeffd700 1 -- 172.21.15.80:0/696051185 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f0167610 con 0x7f63f00c2230 2024-05-08T21:17:32.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.107+0000 7f63edffb700 1 -- 172.21.15.80:0/696051185 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 790285637 0 0) 0x7f63f0167f40 con 0x7f63f016a850 2024-05-08T21:17:32.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.107+0000 7f63eeffd700 1 --2- 172.21.15.80:0/696051185 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63f00c2230 0x7f63f00c6680 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f63f0164c10 tx=0x7f63e000bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=680e141dc85e9c01 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:17:32.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.107+0000 7f63edffb700 1 -- 172.21.15.80:0/696051185 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e000ca70 con 0x7f63f00c2230 2024-05-08T21:17:32.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.107+0000 7f63edffb700 1 -- 172.21.15.80:0/696051185 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e000cbd0 con 0x7f63f00c2230 2024-05-08T21:17:32.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.107+0000 7f63edffb700 1 -- 172.21.15.80:0/696051185 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e000f460 con 0x7f63f00c2230 2024-05-08T21:17:32.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.108+0000 7f63f58bd700 1 -- 172.21.15.80:0/696051185 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63f00c2230 msgr2=0x7f63f00c6680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:32.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.108+0000 7f63f58bd700 1 --2- 172.21.15.80:0/696051185 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63f00c2230 0x7f63f00c6680 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f63f0164c10 tx=0x7f63e000bc80 comp rx=0 tx=0).stop 2024-05-08T21:17:32.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.108+0000 7f63f58bd700 1 -- 172.21.15.80:0/696051185 shutdown_connections 2024-05-08T21:17:32.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.108+0000 7f63f58bd700 1 --2- 172.21.15.80:0/696051185 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63f00c2230 0x7f63f00c6680 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:32.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.108+0000 7f63f58bd700 1 --2- 172.21.15.80:0/696051185 >> v2:172.21.15.106:3300/0 conn(0x7f63f00cb570 0x7f63f00cb9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:32.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.108+0000 7f63f58bd700 1 -- 172.21.15.80:0/696051185 >> 172.21.15.80:0/696051185 conn(0x7f63f006a9c0 msgr2=0x7f63f006ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:17:32.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.108+0000 7f63f58bd700 1 -- 172.21.15.80:0/696051185 shutdown_connections 2024-05-08T21:17:32.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.108+0000 7f63f58bd700 1 -- 172.21.15.80:0/696051185 wait complete. 2024-05-08T21:17:32.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.110+0000 7f63f58bd700 1 Processor -- start 2024-05-08T21:17:32.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.110+0000 7f63f58bd700 1 -- start start 2024-05-08T21:17:32.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.111+0000 7f63f58bd700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f63f00c2230 0x7f63f0070ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:32.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.111+0000 7f63f58bd700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f63f00cb570 0x7f63f0200580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:32.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.111+0000 7f63f58bd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63f016a850 0x7f63f01658a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:32.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.111+0000 7f63f58bd700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f00711e0 con 0x7f63f016a850 2024-05-08T21:17:32.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.111+0000 7f63f58bd700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f0200ac0 con 0x7f63f00c2230 2024-05-08T21:17:32.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.111+0000 7f63f58bd700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63f00c07f0 con 0x7f63f00cb570 2024-05-08T21:17:32.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.111+0000 7f63ef7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63f016a850 0x7f63f01658a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:32.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.111+0000 7f63ef7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63f016a850 0x7f63f01658a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47546/0 (socket says 172.21.15.80:47546) 2024-05-08T21:17:32.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.111+0000 7f63ef7fe700 1 -- 172.21.15.80:0/149200958 learned_addr learned my addr 172.21.15.80:0/149200958 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:17:32.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.111+0000 7f63eeffd700 1 --2- 172.21.15.80:0/149200958 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f63f00c2230 0x7f63f0070ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:32.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.111+0000 7f63ee7fc700 1 --2- 172.21.15.80:0/149200958 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f63f00cb570 0x7f63f0200580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:32.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.112+0000 7f63ef7fe700 1 -- 172.21.15.80:0/149200958 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f63f00cb570 msgr2=0x7f63f0200580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:32.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.112+0000 7f63ef7fe700 1 --2- 172.21.15.80:0/149200958 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f63f00cb570 0x7f63f0200580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:32.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.112+0000 7f63ef7fe700 1 -- 172.21.15.80:0/149200958 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f63f00c2230 msgr2=0x7f63f0070ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:32.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.112+0000 7f63ef7fe700 1 --2- 172.21.15.80:0/149200958 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f63f00c2230 0x7f63f0070ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:32.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.112+0000 7f63ef7fe700 1 -- 172.21.15.80:0/149200958 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e000b600 con 0x7f63f016a850 2024-05-08T21:17:32.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.112+0000 7f63ef7fe700 1 --2- 172.21.15.80:0/149200958 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63f016a850 0x7f63f01658a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f63e8007fd0 tx=0x7f63e800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:17:32.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.112+0000 7f63d7fff700 1 -- 172.21.15.80:0/149200958 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e8005680 con 0x7f63f016a850 2024-05-08T21:17:32.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.112+0000 7f63d7fff700 1 -- 172.21.15.80:0/149200958 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e8005800 con 0x7f63f016a850 2024-05-08T21:17:32.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.112+0000 7f63f58bd700 1 -- 172.21.15.80:0/149200958 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63f00c0a90 con 0x7f63f016a850 2024-05-08T21:17:32.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.112+0000 7f63d7fff700 1 -- 172.21.15.80:0/149200958 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e8005bb0 con 0x7f63f016a850 2024-05-08T21:17:32.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.112+0000 7f63f58bd700 1 -- 172.21.15.80:0/149200958 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63f00c1050 con 0x7f63f016a850 2024-05-08T21:17:32.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.113+0000 7f63f58bd700 1 -- 172.21.15.80:0/149200958 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63f004ec60 con 0x7f63f016a850 2024-05-08T21:17:32.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.113+0000 7f63d7fff700 1 -- 172.21.15.80:0/149200958 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f63e8005d10 con 0x7f63f016a850 2024-05-08T21:17:32.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.114+0000 7f63d7fff700 1 --2- 172.21.15.80:0/149200958 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f63dc06acc0 0x7f63dc06d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:32.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.114+0000 7f63d7fff700 1 -- 172.21.15.80:0/149200958 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6921+0+0 (secure 0 0 0) 0x7f63e8088df0 con 0x7f63f016a850 2024-05-08T21:17:32.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.114+0000 7f63eeffd700 1 --2- 172.21.15.80:0/149200958 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f63dc06acc0 0x7f63dc06d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:32.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.114+0000 7f63eeffd700 1 --2- 172.21.15.80:0/149200958 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f63dc06acc0 0x7f63dc06d180 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f63e00090b0 tx=0x7f63e0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:17:32.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.118+0000 7f63d7fff700 1 -- 172.21.15.80:0/149200958 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f63e8053ba0 con 0x7f63f016a850 2024-05-08T21:17:32.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.361+0000 7f63f58bd700 1 -- 172.21.15.80:0/149200958 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f63f00c71e0 con 0x7f63f016a850 2024-05-08T21:17:32.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.361+0000 7f63d7fff700 1 -- 172.21.15.80:0/149200958 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+5498 (secure 0 0 0) 0x7f63e8017070 con 0x7f63f016a850 2024-05-08T21:17:32.364 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:17:32.365 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:17:27.522650+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5086},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5086":{"gid":5086,"name":"b","rank":0,"incarnation":21,"state":"up:reconnect","state_seq":36,"addr":"172.21.15.106:6833/791920806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":791920806},{"type":"v1","addr":"172.21.15.106:6833","nonce":791920806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:17:32.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.364+0000 7f63f58bd700 1 -- 172.21.15.80:0/149200958 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f63dc06acc0 msgr2=0x7f63dc06d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:32.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.364+0000 7f63f58bd700 1 --2- 172.21.15.80:0/149200958 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f63dc06acc0 0x7f63dc06d180 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f63e00090b0 tx=0x7f63e0008030 comp rx=0 tx=0).stop 2024-05-08T21:17:32.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.364+0000 7f63f58bd700 1 -- 172.21.15.80:0/149200958 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63f016a850 msgr2=0x7f63f01658a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:32.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.364+0000 7f63f58bd700 1 --2- 172.21.15.80:0/149200958 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63f016a850 0x7f63f01658a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f63e8007fd0 tx=0x7f63e800cb70 comp rx=0 tx=0).stop 2024-05-08T21:17:32.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.364+0000 7f63f58bd700 1 -- 172.21.15.80:0/149200958 shutdown_connections 2024-05-08T21:17:32.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.364+0000 7f63f58bd700 1 --2- 172.21.15.80:0/149200958 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f63dc06acc0 0x7f63dc06d180 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:32.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.364+0000 7f63f58bd700 1 --2- 172.21.15.80:0/149200958 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f63f016a850 0x7f63f01658a0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:32.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.364+0000 7f63f58bd700 1 --2- 172.21.15.80:0/149200958 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f63f00c2230 0x7f63f0070ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:32.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.364+0000 7f63f58bd700 1 --2- 172.21.15.80:0/149200958 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f63f00cb570 0x7f63f0200580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:32.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.364+0000 7f63f58bd700 1 -- 172.21.15.80:0/149200958 >> 172.21.15.80:0/149200958 conn(0x7f63f006a9c0 msgr2=0x7f63f0166ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:17:32.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.364+0000 7f63f58bd700 1 -- 172.21.15.80:0/149200958 shutdown_connections 2024-05-08T21:17:32.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:32.364+0000 7f63f58bd700 1 -- 172.21.15.80:0/149200958 wait complete. 2024-05-08T21:17:32.368 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 22 2024-05-08T21:17:32.379 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-05-08T21:17:34.380 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:17:34.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.500+0000 7f7a21ea4700 1 Processor -- start 2024-05-08T21:17:34.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.500+0000 7f7a21ea4700 1 -- start start 2024-05-08T21:17:34.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.501+0000 7f7a21ea4700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7a1c06f1f0 0x7f7a1c06f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:34.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.501+0000 7f7a21ea4700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7a1c15ba50 0x7f7a1c15bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:34.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.501+0000 7f7a21ea4700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a1c15b5c0 con 0x7f7a1c154470 2024-05-08T21:17:34.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.501+0000 7f7a21ea4700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a1c06fb70 con 0x7f7a1c06f1f0 2024-05-08T21:17:34.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.501+0000 7f7a21ea4700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1c15c420 con 0x7f7a1c15ba50 2024-05-08T21:17:34.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.501+0000 7f7a1bfff700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7a1c15ba50 0x7f7a1c15bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:34.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.501+0000 7f7a1bfff700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7a1c15ba50 0x7f7a1c15bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:40088/0 (socket says 172.21.15.80:40088) 2024-05-08T21:17:34.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.501+0000 7f7a1bfff700 1 -- 172.21.15.80:0/4252029932 learned_addr learned my addr 172.21.15.80:0/4252029932 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:17:34.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.501+0000 7f7a1affd700 1 --2- 172.21.15.80:0/4252029932 >> v2:172.21.15.106:3300/0 conn(0x7f7a1c06f1f0 0x7f7a1c06f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:34.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.501+0000 7f7a1bfff700 1 -- 172.21.15.80:0/4252029932 >> v2:172.21.15.106:3300/0 conn(0x7f7a1c06f1f0 msgr2=0x7f7a1c06f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:17:34.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.501+0000 7f7a1bfff700 1 --2- 172.21.15.80:0/4252029932 >> v2:172.21.15.106:3300/0 conn(0x7f7a1c06f1f0 0x7f7a1c06f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:34.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.501+0000 7f7a1bfff700 1 -- 172.21.15.80:0/4252029932 >> v1:172.21.15.106:6789/0 conn(0x7f7a1c154470 legacy=0x7f7a1c06a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:34.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.501+0000 7f7a1bfff700 1 -- 172.21.15.80:0/4252029932 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a1c154850 con 0x7f7a1c15ba50 2024-05-08T21:17:34.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.502+0000 7f7a1bfff700 1 --2- 172.21.15.80:0/4252029932 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7a1c15ba50 0x7f7a1c15bee0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7a14009e50 tx=0x7f7a1400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=667b8696d599338 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:17:34.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.502+0000 7f7a1a7fc700 1 -- 172.21.15.80:0/4252029932 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1400e070 con 0x7f7a1c15ba50 2024-05-08T21:17:34.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.502+0000 7f7a1a7fc700 1 -- 172.21.15.80:0/4252029932 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a1400b910 con 0x7f7a1c15ba50 2024-05-08T21:17:34.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.502+0000 7f7a1a7fc700 1 -- 172.21.15.80:0/4252029932 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1400bcc0 con 0x7f7a1c15ba50 2024-05-08T21:17:34.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.502+0000 7f7a21ea4700 1 -- 172.21.15.80:0/4252029932 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7a1c15ba50 msgr2=0x7f7a1c15bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:34.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.502+0000 7f7a21ea4700 1 --2- 172.21.15.80:0/4252029932 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7a1c15ba50 0x7f7a1c15bee0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7a14009e50 tx=0x7f7a1400b330 comp rx=0 tx=0).stop 2024-05-08T21:17:34.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.502+0000 7f7a21ea4700 1 -- 172.21.15.80:0/4252029932 shutdown_connections 2024-05-08T21:17:34.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.502+0000 7f7a21ea4700 1 --2- 172.21.15.80:0/4252029932 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7a1c15ba50 0x7f7a1c15bee0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:34.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.502+0000 7f7a21ea4700 1 --2- 172.21.15.80:0/4252029932 >> v2:172.21.15.106:3300/0 conn(0x7f7a1c06f1f0 0x7f7a1c06f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:34.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.502+0000 7f7a21ea4700 1 -- 172.21.15.80:0/4252029932 >> 172.21.15.80:0/4252029932 conn(0x7f7a1c06bad0 msgr2=0x7f7a1c06bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:17:34.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.502+0000 7f7a21ea4700 1 -- 172.21.15.80:0/4252029932 shutdown_connections 2024-05-08T21:17:34.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.502+0000 7f7a21ea4700 1 -- 172.21.15.80:0/4252029932 wait complete. 2024-05-08T21:17:34.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.504+0000 7f7a21ea4700 1 Processor -- start 2024-05-08T21:17:34.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.504+0000 7f7a21ea4700 1 -- start start 2024-05-08T21:17:34.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.504+0000 7f7a21ea4700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7a1c06f1f0 0x7f7a1c0c3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:34.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.504+0000 7f7a21ea4700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a1c154470 0x7f7a1c1f03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:34.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.504+0000 7f7a21ea4700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a1c15ba50 0x7f7a1c156c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:34.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.504+0000 7f7a21ea4700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1c0c4330 con 0x7f7a1c15ba50 2024-05-08T21:17:34.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.504+0000 7f7a21ea4700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1c1f08e0 con 0x7f7a1c154470 2024-05-08T21:17:34.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.504+0000 7f7a21ea4700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1c151370 con 0x7f7a1c06f1f0 2024-05-08T21:17:34.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.505+0000 7f7a1bfff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a1c15ba50 0x7f7a1c156c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:34.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.505+0000 7f7a1bfff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a1c15ba50 0x7f7a1c156c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37492/0 (socket says 172.21.15.80:37492) 2024-05-08T21:17:34.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.505+0000 7f7a1bfff700 1 -- 172.21.15.80:0/3739237085 learned_addr learned my addr 172.21.15.80:0/3739237085 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:17:34.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.505+0000 7f7a1b7fe700 1 --2- 172.21.15.80:0/3739237085 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7a1c06f1f0 0x7f7a1c0c3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:34.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.505+0000 7f7a1affd700 1 --2- 172.21.15.80:0/3739237085 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a1c154470 0x7f7a1c1f03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:34.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.505+0000 7f7a1bfff700 1 -- 172.21.15.80:0/3739237085 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7a1c06f1f0 msgr2=0x7f7a1c0c3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:34.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.505+0000 7f7a1bfff700 1 --2- 172.21.15.80:0/3739237085 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7a1c06f1f0 0x7f7a1c0c3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:34.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.505+0000 7f7a1bfff700 1 -- 172.21.15.80:0/3739237085 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a1c154470 msgr2=0x7f7a1c1f03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:34.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.505+0000 7f7a1bfff700 1 --2- 172.21.15.80:0/3739237085 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a1c154470 0x7f7a1c1f03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:34.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.505+0000 7f7a1bfff700 1 -- 172.21.15.80:0/3739237085 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a14009b30 con 0x7f7a1c15ba50 2024-05-08T21:17:34.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.505+0000 7f7a1bfff700 1 --2- 172.21.15.80:0/3739237085 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a1c15ba50 0x7f7a1c156c40 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c15c560 tx=0x7f7a14004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:17:34.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.505+0000 7f7a13fff700 1 -- 172.21.15.80:0/3739237085 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a14004840 con 0x7f7a1c15ba50 2024-05-08T21:17:34.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.505+0000 7f7a13fff700 1 -- 172.21.15.80:0/3739237085 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a140099b0 con 0x7f7a1c15ba50 2024-05-08T21:17:34.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.505+0000 7f7a21ea4700 1 -- 172.21.15.80:0/3739237085 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a1c1ef920 con 0x7f7a1c15ba50 2024-05-08T21:17:34.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.505+0000 7f7a13fff700 1 -- 172.21.15.80:0/3739237085 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1401c650 con 0x7f7a1c15ba50 2024-05-08T21:17:34.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.505+0000 7f7a21ea4700 1 -- 172.21.15.80:0/3739237085 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a1c1518a0 con 0x7f7a1c15ba50 2024-05-08T21:17:34.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.506+0000 7f7a21ea4700 1 -- 172.21.15.80:0/3739237085 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a1c151a60 con 0x7f7a1c15ba50 2024-05-08T21:17:34.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.507+0000 7f7a13fff700 1 -- 172.21.15.80:0/3739237085 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7a1401c7b0 con 0x7f7a1c15ba50 2024-05-08T21:17:34.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.507+0000 7f7a13fff700 1 --2- 172.21.15.80:0/3739237085 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f79fc06ac90 0x7f79fc06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:34.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.507+0000 7f7a13fff700 1 -- 172.21.15.80:0/3739237085 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6921+0+0 (secure 0 0 0) 0x7f7a1408a9e0 con 0x7f7a1c15ba50 2024-05-08T21:17:34.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.507+0000 7f7a1b7fe700 1 --2- 172.21.15.80:0/3739237085 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f79fc06ac90 0x7f79fc06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:34.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.508+0000 7f7a1b7fe700 1 --2- 172.21.15.80:0/3739237085 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f79fc06ac90 0x7f79fc06d150 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7a04007fd0 tx=0x7f7a04009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:17:34.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.512+0000 7f7a13fff700 1 -- 172.21.15.80:0/3739237085 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f7a140555d0 con 0x7f7a1c15ba50 2024-05-08T21:17:34.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.759+0000 7f7a21ea4700 1 -- 172.21.15.80:0/3739237085 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7a1c04ec60 con 0x7f7a1c15ba50 2024-05-08T21:17:34.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.760+0000 7f7a13fff700 1 -- 172.21.15.80:0/3739237085 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+5495 (secure 0 0 0) 0x7f7a14058bf0 con 0x7f7a1c15ba50 2024-05-08T21:17:34.763 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:17:34.763 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:17:32.544996+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5086},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5086":{"gid":5086,"name":"b","rank":0,"incarnation":21,"state":"up:rejoin","state_seq":38,"addr":"172.21.15.106:6833/791920806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":791920806},{"type":"v1","addr":"172.21.15.106:6833","nonce":791920806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:17:34.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.762+0000 7f7a21ea4700 1 -- 172.21.15.80:0/3739237085 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f79fc06ac90 msgr2=0x7f79fc06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:34.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.762+0000 7f7a21ea4700 1 --2- 172.21.15.80:0/3739237085 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f79fc06ac90 0x7f79fc06d150 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7a04007fd0 tx=0x7f7a04009040 comp rx=0 tx=0).stop 2024-05-08T21:17:34.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.762+0000 7f7a21ea4700 1 -- 172.21.15.80:0/3739237085 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a1c15ba50 msgr2=0x7f7a1c156c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:34.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.762+0000 7f7a21ea4700 1 --2- 172.21.15.80:0/3739237085 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a1c15ba50 0x7f7a1c156c40 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c15c560 tx=0x7f7a14004ad0 comp rx=0 tx=0).stop 2024-05-08T21:17:34.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.762+0000 7f7a21ea4700 1 -- 172.21.15.80:0/3739237085 shutdown_connections 2024-05-08T21:17:34.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.762+0000 7f7a21ea4700 1 --2- 172.21.15.80:0/3739237085 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f79fc06ac90 0x7f79fc06d150 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:34.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.762+0000 7f7a21ea4700 1 --2- 172.21.15.80:0/3739237085 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7a1c15ba50 0x7f7a1c156c40 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:34.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.762+0000 7f7a21ea4700 1 --2- 172.21.15.80:0/3739237085 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7a1c06f1f0 0x7f7a1c0c3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:34.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.762+0000 7f7a21ea4700 1 --2- 172.21.15.80:0/3739237085 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a1c154470 0x7f7a1c1f03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:34.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.762+0000 7f7a21ea4700 1 -- 172.21.15.80:0/3739237085 >> 172.21.15.80:0/3739237085 conn(0x7f7a1c06bad0 msgr2=0x7f7a1c158ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:17:34.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.762+0000 7f7a21ea4700 1 -- 172.21.15.80:0/3739237085 shutdown_connections 2024-05-08T21:17:34.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:34.762+0000 7f7a21ea4700 1 -- 172.21.15.80:0/3739237085 wait complete. 2024-05-08T21:17:34.767 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 23 2024-05-08T21:17:34.780 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 23, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-05-08T21:10:03.725481+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 23, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_5086": { "addr": "172.21.15.106:6833/791920806", "addrs": { "addrvec": [ { "addr": "172.21.15.106:6832", "nonce": 791920806, "type": "v2" }, { "addr": "172.21.15.106:6833", "nonce": 791920806, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5086, "incarnation": 21, "join_fscid": -1, "name": "b", "rank": 0, "state": "up:rejoin", "state_seq": 38 } }, "last_failure": 0, "last_failure_osd_epoch": 31, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-05-08T21:17:32.544996+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5086 } } } ], "standbys": [ { "addr": "172.21.15.106:6837/2762323230", "addrs": { "addrvec": [ { "addr": "172.21.15.106:6835", "nonce": 2762323230, "type": "v2" }, { "addr": "172.21.15.106:6837", "nonce": 2762323230, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4229, "incarnation": 0, "join_fscid": -1, "name": "f", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.80:6837/1121814432", "addrs": { "addrvec": [ { "addr": "172.21.15.80:6834", "nonce": 1121814432, "type": "v2" }, { "addr": "172.21.15.80:6837", "nonce": 1121814432, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4251, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.80:6839/1867024080", "addrs": { "addrvec": [ { "addr": "172.21.15.80:6838", "nonce": 1867024080, "type": "v2" }, { "addr": "172.21.15.80:6839", "nonce": 1867024080, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 2, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4254, "incarnation": 0, "join_fscid": -1, "name": "e", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.80:6836/1947012643", "addrs": { "addrvec": [ { "addr": "172.21.15.80:6835", "nonce": 1947012643, "type": "v2" }, { "addr": "172.21.15.80:6836", "nonce": 1947012643, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4273, "incarnation": 0, "join_fscid": -1, "name": "c", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-05-08T21:17:36.780 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:17:36.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:36.901+0000 7f85bfda1700 1 Processor -- start 2024-05-08T21:17:36.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:36.901+0000 7f85bfda1700 1 -- start start 2024-05-08T21:17:36.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:36.903+0000 7f85bfda1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f85b81508e0 0x7f85b80c6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:36.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:36.903+0000 7f85bfda1700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85b80c1810 con 0x7f85b80c2690 2024-05-08T21:17:36.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:36.903+0000 7f85bfda1700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85b8156b70 con 0x7f85b80c0ea0 2024-05-08T21:17:36.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:36.903+0000 7f85bfda1700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85b8156e50 con 0x7f85b81508e0 2024-05-08T21:17:36.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:36.903+0000 7f85bdb3d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f85b81508e0 0x7f85b80c6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:36.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:36.903+0000 7f85be33e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f85b80c2690 0x7f85b8160f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:35464/0 (socket says 172.21.15.80:35464) 2024-05-08T21:17:36.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:36.903+0000 7f85be33e700 1 -- 172.21.15.80:0/3018491887 learned_addr learned my addr 172.21.15.80:0/3018491887 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:17:36.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:36.903+0000 7f85bdb3d700 1 -- 172.21.15.80:0/3018491887 >> v1:172.21.15.106:6789/0 conn(0x7f85b80c0ea0 legacy=0x7f85b80c1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:36.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:36.903+0000 7f85bdb3d700 1 -- 172.21.15.80:0/3018491887 >> v1:172.21.15.80:6789/0 conn(0x7f85b80c2690 legacy=0x7f85b8160f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:36.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:36.903+0000 7f85bdb3d700 1 -- 172.21.15.80:0/3018491887 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85b8157130 con 0x7f85b81508e0 2024-05-08T21:17:36.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:36.903+0000 7f85bdb3d700 1 --2- 172.21.15.80:0/3018491887 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f85b81508e0 0x7f85b80c6ef0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f85b4009840 tx=0x7f85b4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8de07804604f5be0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:17:36.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:36.903+0000 7f85bcb3b700 1 -- 172.21.15.80:0/3018491887 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b400f940 con 0x7f85b81508e0 2024-05-08T21:17:36.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:36.903+0000 7f85bcb3b700 1 -- 172.21.15.80:0/3018491887 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b400faa0 con 0x7f85b81508e0 2024-05-08T21:17:36.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:36.903+0000 7f85bcb3b700 1 -- 172.21.15.80:0/3018491887 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b400fe30 con 0x7f85b81508e0 2024-05-08T21:17:36.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:36.904+0000 7f85bfda1700 1 -- 172.21.15.80:0/3018491887 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f85b81508e0 msgr2=0x7f85b80c6ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:36.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:36.904+0000 7f85bfda1700 1 --2- 172.21.15.80:0/3018491887 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f85b81508e0 0x7f85b80c6ef0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f85b4009840 tx=0x7f85b4009b50 comp rx=0 tx=0).stop 2024-05-08T21:17:36.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:36.904+0000 7f85bfda1700 1 -- 172.21.15.80:0/3018491887 shutdown_connections 2024-05-08T21:17:36.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:36.904+0000 7f85bfda1700 1 --2- 172.21.15.80:0/3018491887 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f85b81508e0 0x7f85b80c6ef0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:36.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:36.904+0000 7f85bfda1700 1 -- 172.21.15.80:0/3018491887 >> 172.21.15.80:0/3018491887 conn(0x7f85b80c8980 msgr2=0x7f85b80c8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:17:36.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:36.904+0000 7f85bfda1700 1 -- 172.21.15.80:0/3018491887 shutdown_connections 2024-05-08T21:17:36.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:36.904+0000 7f85bfda1700 1 -- 172.21.15.80:0/3018491887 wait complete. 2024-05-08T21:17:36.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:36.906+0000 7f85bfda1700 1 Processor -- start 2024-05-08T21:17:36.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:36.906+0000 7f85bfda1700 1 -- start start 2024-05-08T21:17:36.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:36.907+0000 7f85bfda1700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f85b80c0ea0 0x7f85b80c7170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:36.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:36.907+0000 7f85bfda1700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f85b80c2690 0x7f85b814d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:36.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:36.907+0000 7f85bfda1700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85b81508e0 0x7f85b814d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:36.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:36.907+0000 7f85bfda1700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85b8153e90 con 0x7f85b80c0ea0 2024-05-08T21:17:36.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:36.907+0000 7f85bfda1700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85b80c76b0 con 0x7f85b81508e0 2024-05-08T21:17:36.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:36.907+0000 7f85bfda1700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85b8153280 con 0x7f85b80c2690 2024-05-08T21:17:36.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:36.907+0000 7f85bdb3d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f85b80c0ea0 0x7f85b80c7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:36.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:36.907+0000 7f85bdb3d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f85b80c0ea0 0x7f85b80c7170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37508/0 (socket says 172.21.15.80:37508) 2024-05-08T21:17:36.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:36.907+0000 7f85bdb3d700 1 -- 172.21.15.80:0/1139221980 learned_addr learned my addr 172.21.15.80:0/1139221980 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:17:36.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:36.907+0000 7f85bd33c700 1 --2- 172.21.15.80:0/1139221980 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f85b80c2690 0x7f85b814d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:36.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:36.907+0000 7f85be33e700 1 --2- 172.21.15.80:0/1139221980 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85b81508e0 0x7f85b814d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:36.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:36.907+0000 7f85bdb3d700 1 -- 172.21.15.80:0/1139221980 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f85b80c2690 msgr2=0x7f85b814d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:36.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:36.907+0000 7f85bdb3d700 1 --2- 172.21.15.80:0/1139221980 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f85b80c2690 0x7f85b814d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:36.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:36.907+0000 7f85bdb3d700 1 -- 172.21.15.80:0/1139221980 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85b81508e0 msgr2=0x7f85b814d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:36.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:36.907+0000 7f85bdb3d700 1 --2- 172.21.15.80:0/1139221980 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85b81508e0 0x7f85b814d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:36.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:36.907+0000 7f85bdb3d700 1 -- 172.21.15.80:0/1139221980 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85b40094a0 con 0x7f85b80c0ea0 2024-05-08T21:17:36.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:36.907+0000 7f85bd33c700 1 --2- 172.21.15.80:0/1139221980 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f85b80c2690 0x7f85b814d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:17:36.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:36.907+0000 7f85be33e700 1 --2- 172.21.15.80:0/1139221980 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85b81508e0 0x7f85b814d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:17:36.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:36.907+0000 7f85bdb3d700 1 --2- 172.21.15.80:0/1139221980 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f85b80c0ea0 0x7f85b80c7170 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f85b4000c00 tx=0x7f85b4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:17:36.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:36.907+0000 7f85ae7fc700 1 -- 172.21.15.80:0/1139221980 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b4003ab0 con 0x7f85b80c0ea0 2024-05-08T21:17:36.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:36.907+0000 7f85ae7fc700 1 -- 172.21.15.80:0/1139221980 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b4003c10 con 0x7f85b80c0ea0 2024-05-08T21:17:36.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:36.907+0000 7f85bfda1700 1 -- 172.21.15.80:0/1139221980 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85b8153560 con 0x7f85b80c0ea0 2024-05-08T21:17:36.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:36.907+0000 7f85ae7fc700 1 -- 172.21.15.80:0/1139221980 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b4022440 con 0x7f85b80c0ea0 2024-05-08T21:17:36.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:36.907+0000 7f85bfda1700 1 -- 172.21.15.80:0/1139221980 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85b8153b20 con 0x7f85b80c0ea0 2024-05-08T21:17:36.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:36.908+0000 7f85bfda1700 1 -- 172.21.15.80:0/1139221980 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85b80b17a0 con 0x7f85b80c0ea0 2024-05-08T21:17:36.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:36.909+0000 7f85ae7fc700 1 -- 172.21.15.80:0/1139221980 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f85b40225a0 con 0x7f85b80c0ea0 2024-05-08T21:17:36.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:36.909+0000 7f85ae7fc700 1 --2- 172.21.15.80:0/1139221980 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f859c06acc0 0x7f859c06d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:36.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:36.910+0000 7f85bd33c700 1 --2- 172.21.15.80:0/1139221980 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f859c06acc0 0x7f859c06d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:36.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:36.910+0000 7f85ae7fc700 1 -- 172.21.15.80:0/1139221980 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6921+0+0 (secure 0 0 0) 0x7f85b4013070 con 0x7f85b80c0ea0 2024-05-08T21:17:36.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:36.910+0000 7f85bd33c700 1 --2- 172.21.15.80:0/1139221980 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f859c06acc0 0x7f859c06d180 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f85b80c96f0 tx=0x7f85a8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:17:36.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:36.914+0000 7f85ae7fc700 1 -- 172.21.15.80:0/1139221980 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f85b40583f0 con 0x7f85b80c0ea0 2024-05-08T21:17:37.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:37.162+0000 7f85bfda1700 1 -- 172.21.15.80:0/1139221980 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f85b81eeff0 con 0x7f85b80c0ea0 2024-05-08T21:17:37.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:37.163+0000 7f85ae7fc700 1 -- 172.21.15.80:0/1139221980 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+5495 (secure 0 0 0) 0x7f85b405ba10 con 0x7f85b80c0ea0 2024-05-08T21:17:37.166 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:17:37.166 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:17:32.544996+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5086},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5086":{"gid":5086,"name":"b","rank":0,"incarnation":21,"state":"up:rejoin","state_seq":38,"addr":"172.21.15.106:6833/791920806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":791920806},{"type":"v1","addr":"172.21.15.106:6833","nonce":791920806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:17:37.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:37.165+0000 7f85bfda1700 1 -- 172.21.15.80:0/1139221980 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f859c06acc0 msgr2=0x7f859c06d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:37.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:37.165+0000 7f85bfda1700 1 --2- 172.21.15.80:0/1139221980 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f859c06acc0 0x7f859c06d180 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f85b80c96f0 tx=0x7f85a8009040 comp rx=0 tx=0).stop 2024-05-08T21:17:37.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:37.165+0000 7f85bfda1700 1 -- 172.21.15.80:0/1139221980 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f85b80c0ea0 msgr2=0x7f85b80c7170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:37.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:37.165+0000 7f85bfda1700 1 --2- 172.21.15.80:0/1139221980 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f85b80c0ea0 0x7f85b80c7170 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f85b4000c00 tx=0x7f85b4004750 comp rx=0 tx=0).stop 2024-05-08T21:17:37.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:37.165+0000 7f85bfda1700 1 -- 172.21.15.80:0/1139221980 shutdown_connections 2024-05-08T21:17:37.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:37.165+0000 7f85bfda1700 1 --2- 172.21.15.80:0/1139221980 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f859c06acc0 0x7f859c06d180 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:37.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:37.165+0000 7f85bfda1700 1 --2- 172.21.15.80:0/1139221980 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f85b80c0ea0 0x7f85b80c7170 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:37.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:37.165+0000 7f85bfda1700 1 --2- 172.21.15.80:0/1139221980 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85b81508e0 0x7f85b814d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:37.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:37.165+0000 7f85bfda1700 1 --2- 172.21.15.80:0/1139221980 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f85b80c2690 0x7f85b814d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:37.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:37.165+0000 7f85bfda1700 1 -- 172.21.15.80:0/1139221980 >> 172.21.15.80:0/1139221980 conn(0x7f85b80c8980 msgr2=0x7f85b8147ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:17:37.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:37.165+0000 7f85bfda1700 1 -- 172.21.15.80:0/1139221980 shutdown_connections 2024-05-08T21:17:37.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:37.165+0000 7f85bfda1700 1 -- 172.21.15.80:0/1139221980 wait complete. 2024-05-08T21:17:37.169 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 23 2024-05-08T21:17:37.180 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-05-08T21:17:39.182 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:17:39.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.302+0000 7f349b38f700 1 Processor -- start 2024-05-08T21:17:39.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.302+0000 7f349b38f700 1 -- start start 2024-05-08T21:17:39.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.302+0000 7f349b38f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3494154390 0x7f349415ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:39.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.302+0000 7f349b38f700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f34940ca400 0x7f34940cff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:39.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.302+0000 7f349b38f700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f34940ca840 0x7f34940d0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:39.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.302+0000 7f349b38f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f349415b1b0 con 0x7f3494154390 2024-05-08T21:17:39.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.302+0000 7f349b38f700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34940c5d20 con 0x7f34940ca400 2024-05-08T21:17:39.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.302+0000 7f349b38f700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34940732b0 con 0x7f34940ca840 2024-05-08T21:17:39.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.303+0000 7f349912b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3494154390 0x7f349415ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:39.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.303+0000 7f349912b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3494154390 0x7f349415ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37524/0 (socket says 172.21.15.80:37524) 2024-05-08T21:17:39.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.303+0000 7f349912b700 1 -- 172.21.15.80:0/1145244721 learned_addr learned my addr 172.21.15.80:0/1145244721 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:17:39.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.303+0000 7f349992c700 1 --2- 172.21.15.80:0/1145244721 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f34940ca840 0x7f34940d0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:39.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.303+0000 7f349892a700 1 --2- 172.21.15.80:0/1145244721 >> v2:172.21.15.106:3300/0 conn(0x7f34940ca400 0x7f34940cff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:39.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.303+0000 7f349912b700 1 -- 172.21.15.80:0/1145244721 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f34940ca840 msgr2=0x7f34940d0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:17:39.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.303+0000 7f349912b700 1 --2- 172.21.15.80:0/1145244721 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f34940ca840 0x7f34940d0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:39.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.303+0000 7f349912b700 1 -- 172.21.15.80:0/1145244721 >> v2:172.21.15.106:3300/0 conn(0x7f34940ca400 msgr2=0x7f34940cff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:17:39.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.303+0000 7f349912b700 1 --2- 172.21.15.80:0/1145244721 >> v2:172.21.15.106:3300/0 conn(0x7f34940ca400 0x7f34940cff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:39.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.303+0000 7f349912b700 1 -- 172.21.15.80:0/1145244721 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34940c49a0 con 0x7f3494154390 2024-05-08T21:17:39.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.303+0000 7f349912b700 1 --2- 172.21.15.80:0/1145244721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3494154390 0x7f349415ac70 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f34940c6d50 tx=0x7f3490009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd5a2d45e13fbe3f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:17:39.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.303+0000 7f348bfff700 1 -- 172.21.15.80:0/1145244721 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349000b870 con 0x7f3494154390 2024-05-08T21:17:39.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.303+0000 7f348bfff700 1 -- 172.21.15.80:0/1145244721 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f349000b9d0 con 0x7f3494154390 2024-05-08T21:17:39.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.303+0000 7f348bfff700 1 -- 172.21.15.80:0/1145244721 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349000bd60 con 0x7f3494154390 2024-05-08T21:17:39.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.304+0000 7f349b38f700 1 -- 172.21.15.80:0/1145244721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3494154390 msgr2=0x7f349415ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:39.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.304+0000 7f349b38f700 1 --2- 172.21.15.80:0/1145244721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3494154390 0x7f349415ac70 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f34940c6d50 tx=0x7f3490009bd0 comp rx=0 tx=0).stop 2024-05-08T21:17:39.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.304+0000 7f349b38f700 1 -- 172.21.15.80:0/1145244721 shutdown_connections 2024-05-08T21:17:39.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.304+0000 7f349b38f700 1 --2- 172.21.15.80:0/1145244721 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3494154390 0x7f349415ac70 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:39.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.304+0000 7f349b38f700 1 --2- 172.21.15.80:0/1145244721 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f34940ca840 0x7f34940d0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:39.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.304+0000 7f349b38f700 1 --2- 172.21.15.80:0/1145244721 >> v2:172.21.15.106:3300/0 conn(0x7f34940ca400 0x7f34940cff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:39.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.304+0000 7f349b38f700 1 -- 172.21.15.80:0/1145244721 >> 172.21.15.80:0/1145244721 conn(0x7f349406ab90 msgr2=0x7f349406afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:17:39.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.304+0000 7f349b38f700 1 -- 172.21.15.80:0/1145244721 shutdown_connections 2024-05-08T21:17:39.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.304+0000 7f349b38f700 1 -- 172.21.15.80:0/1145244721 wait complete. 2024-05-08T21:17:39.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.305+0000 7f349b38f700 1 Processor -- start 2024-05-08T21:17:39.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.305+0000 7f349b38f700 1 -- start start 2024-05-08T21:17:39.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.306+0000 7f349b38f700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f34940ca400 0x7f34940b46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:39.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.306+0000 7f349b38f700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34940ca840 0x7f34940ce190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:39.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.306+0000 7f349b38f700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3494154390 0x7f3494144490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:39.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.306+0000 7f349b38f700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34940cefc0 con 0x7f34940ca840 2024-05-08T21:17:39.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.306+0000 7f349b38f700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34940cf4f0 con 0x7f34940ca400 2024-05-08T21:17:39.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.306+0000 7f349b38f700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3494158150 con 0x7f3494154390 2024-05-08T21:17:39.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.306+0000 7f349892a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34940ca840 0x7f34940ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:39.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.306+0000 7f349892a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34940ca840 0x7f34940ce190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37540/0 (socket says 172.21.15.80:37540) 2024-05-08T21:17:39.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.306+0000 7f349892a700 1 -- 172.21.15.80:0/1246607278 learned_addr learned my addr 172.21.15.80:0/1246607278 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:17:39.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.306+0000 7f349992c700 1 --2- 172.21.15.80:0/1246607278 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3494154390 0x7f3494144490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:39.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.306+0000 7f349912b700 1 --2- 172.21.15.80:0/1246607278 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f34940ca400 0x7f34940b46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:39.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.306+0000 7f349892a700 1 -- 172.21.15.80:0/1246607278 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3494154390 msgr2=0x7f3494144490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:39.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.306+0000 7f349892a700 1 --2- 172.21.15.80:0/1246607278 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3494154390 0x7f3494144490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:39.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.306+0000 7f349892a700 1 -- 172.21.15.80:0/1246607278 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f34940ca400 msgr2=0x7f34940b46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:39.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.306+0000 7f349892a700 1 --2- 172.21.15.80:0/1246607278 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f34940ca400 0x7f34940b46f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:39.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.306+0000 7f349892a700 1 -- 172.21.15.80:0/1246607278 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3490009550 con 0x7f34940ca840 2024-05-08T21:17:39.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.306+0000 7f349992c700 1 --2- 172.21.15.80:0/1246607278 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3494154390 0x7f3494144490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:17:39.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.306+0000 7f349892a700 1 --2- 172.21.15.80:0/1246607278 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34940ca840 0x7f34940ce190 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f348400e760 tx=0x7f348400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:17:39.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.306+0000 7f3489ffb700 1 -- 172.21.15.80:0/1246607278 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3484013610 con 0x7f34940ca840 2024-05-08T21:17:39.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.306+0000 7f3489ffb700 1 -- 172.21.15.80:0/1246607278 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3484013770 con 0x7f34940ca840 2024-05-08T21:17:39.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.306+0000 7f349b38f700 1 -- 172.21.15.80:0/1246607278 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34940cf210 con 0x7f34940ca840 2024-05-08T21:17:39.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.306+0000 7f3489ffb700 1 -- 172.21.15.80:0/1246607278 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3484013b20 con 0x7f34940ca840 2024-05-08T21:17:39.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.306+0000 7f349b38f700 1 -- 172.21.15.80:0/1246607278 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34940cdc70 con 0x7f34940ca840 2024-05-08T21:17:39.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.307+0000 7f349b38f700 1 -- 172.21.15.80:0/1246607278 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f349404ec60 con 0x7f34940ca840 2024-05-08T21:17:39.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.308+0000 7f3489ffb700 1 -- 172.21.15.80:0/1246607278 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3484013c80 con 0x7f34940ca840 2024-05-08T21:17:39.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.308+0000 7f3489ffb700 1 --2- 172.21.15.80:0/1246607278 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f347806ac90 0x7f347806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:39.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.308+0000 7f3489ffb700 1 -- 172.21.15.80:0/1246607278 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6921+0+0 (secure 0 0 0) 0x7f3484089210 con 0x7f34940ca840 2024-05-08T21:17:39.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.308+0000 7f349912b700 1 --2- 172.21.15.80:0/1246607278 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f347806ac90 0x7f347806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:39.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.309+0000 7f349912b700 1 --2- 172.21.15.80:0/1246607278 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f347806ac90 0x7f347806d150 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3490009c10 tx=0x7f3490008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:17:39.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.316+0000 7f3489ffb700 1 -- 172.21.15.80:0/1246607278 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f3484053ea0 con 0x7f34940ca840 2024-05-08T21:17:39.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.571+0000 7f349b38f700 1 -- 172.21.15.80:0/1246607278 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f34940c9eb0 con 0x7f34940ca840 2024-05-08T21:17:39.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.571+0000 7f3489ffb700 1 -- 172.21.15.80:0/1246607278 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+5495 (secure 0 0 0) 0x7f34840574c0 con 0x7f34940ca840 2024-05-08T21:17:39.574 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:17:39.574 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:17:38.557086+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5086},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5086":{"gid":5086,"name":"b","rank":0,"incarnation":21,"state":"up:active","state_seq":40,"addr":"172.21.15.106:6833/791920806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":791920806},{"type":"v1","addr":"172.21.15.106:6833","nonce":791920806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:17:39.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.573+0000 7f349b38f700 1 -- 172.21.15.80:0/1246607278 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f347806ac90 msgr2=0x7f347806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:39.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.573+0000 7f349b38f700 1 --2- 172.21.15.80:0/1246607278 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f347806ac90 0x7f347806d150 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3490009c10 tx=0x7f3490008030 comp rx=0 tx=0).stop 2024-05-08T21:17:39.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.573+0000 7f349b38f700 1 -- 172.21.15.80:0/1246607278 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34940ca840 msgr2=0x7f34940ce190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:39.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.573+0000 7f349b38f700 1 --2- 172.21.15.80:0/1246607278 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34940ca840 0x7f34940ce190 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f348400e760 tx=0x7f348400eb20 comp rx=0 tx=0).stop 2024-05-08T21:17:39.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.573+0000 7f349b38f700 1 -- 172.21.15.80:0/1246607278 shutdown_connections 2024-05-08T21:17:39.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.573+0000 7f349b38f700 1 --2- 172.21.15.80:0/1246607278 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f347806ac90 0x7f347806d150 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:39.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.573+0000 7f349b38f700 1 --2- 172.21.15.80:0/1246607278 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3494154390 0x7f3494144490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:39.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.573+0000 7f349b38f700 1 --2- 172.21.15.80:0/1246607278 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f34940ca400 0x7f34940b46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:39.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.573+0000 7f349b38f700 1 --2- 172.21.15.80:0/1246607278 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34940ca840 0x7f34940ce190 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:39.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.573+0000 7f349b38f700 1 -- 172.21.15.80:0/1246607278 >> 172.21.15.80:0/1246607278 conn(0x7f349406ab90 msgr2=0x7f34941e3590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:17:39.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.573+0000 7f349b38f700 1 -- 172.21.15.80:0/1246607278 shutdown_connections 2024-05-08T21:17:39.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:39.573+0000 7f349b38f700 1 -- 172.21.15.80:0/1246607278 wait complete. 2024-05-08T21:17:39.577 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 24 2024-05-08T21:17:39.588 INFO:tasks.mds_thrash.fs.[cephfs]:mds.b has gained rank=0, replacing gid=4990 2024-05-08T21:17:39.588 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 4 secs before reviving mds.d 2024-05-08T21:17:43.589 INFO:tasks.mds_thrash.fs.[cephfs]:reviving mds.d 2024-05-08T21:17:43.590 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-08T21:17:43.590 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-08T21:17:43.593 INFO:tasks.ceph.mds.d:Started 2024-05-08T21:17:43.593 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:17:43.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:43.742+0000 7fedd2a37700 1 Processor -- start 2024-05-08T21:17:43.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:43.742+0000 7fedd2a37700 1 -- start start 2024-05-08T21:17:43.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:43.743+0000 7fedd2a37700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fedcc0c73f0 0x7fedcc0c7840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:43.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:43.743+0000 7fedd2a37700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedcc0c7d80 con 0x7fedcc151010 2024-05-08T21:17:43.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:43.743+0000 7fedd2a37700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedcc1572b0 con 0x7fedcc156dc0 2024-05-08T21:17:43.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:43.743+0000 7fedd2a37700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedcc15a3b0 con 0x7fedcc0c73f0 2024-05-08T21:17:43.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:43.743+0000 7fedd0fd4700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fedcc0c73f0 0x7fedcc0c7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:43.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:43.744+0000 7fedcbfff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fedcc151010 0x7fedcc15aab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:55194/0 (socket says 172.21.15.80:55194) 2024-05-08T21:17:43.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:43.744+0000 7fedcbfff700 1 -- 172.21.15.80:0/797735689 learned_addr learned my addr 172.21.15.80:0/797735689 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:17:43.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:43.744+0000 7fedd0fd4700 1 -- 172.21.15.80:0/797735689 >> v1:172.21.15.106:6789/0 conn(0x7fedcc156dc0 legacy=0x7fedcc0c8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:43.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:43.744+0000 7fedd0fd4700 1 -- 172.21.15.80:0/797735689 >> v1:172.21.15.80:6789/0 conn(0x7fedcc151010 legacy=0x7fedcc15aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:43.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:43.744+0000 7fedd0fd4700 1 -- 172.21.15.80:0/797735689 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedcc157590 con 0x7fedcc0c73f0 2024-05-08T21:17:43.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:43.744+0000 7fedd0fd4700 1 --2- 172.21.15.80:0/797735689 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fedcc0c73f0 0x7fedcc0c7840 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fedc4009d90 tx=0x7fedc400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=796bae27b340945b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:17:43.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:43.744+0000 7fedcaffd700 1 -- 172.21.15.80:0/797735689 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc400e070 con 0x7fedcc0c73f0 2024-05-08T21:17:43.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:43.744+0000 7fedcaffd700 1 -- 172.21.15.80:0/797735689 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedc400bbd0 con 0x7fedcc0c73f0 2024-05-08T21:17:43.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:43.744+0000 7fedcaffd700 1 -- 172.21.15.80:0/797735689 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc4012430 con 0x7fedcc0c73f0 2024-05-08T21:17:43.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:43.745+0000 7fedd2a37700 1 -- 172.21.15.80:0/797735689 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fedcc0c73f0 msgr2=0x7fedcc0c7840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:43.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:43.745+0000 7fedd2a37700 1 --2- 172.21.15.80:0/797735689 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fedcc0c73f0 0x7fedcc0c7840 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fedc4009d90 tx=0x7fedc400b330 comp rx=0 tx=0).stop 2024-05-08T21:17:43.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:43.745+0000 7fedd2a37700 1 -- 172.21.15.80:0/797735689 shutdown_connections 2024-05-08T21:17:43.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:43.745+0000 7fedd2a37700 1 --2- 172.21.15.80:0/797735689 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fedcc0c73f0 0x7fedcc0c7840 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:43.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:43.745+0000 7fedd2a37700 1 -- 172.21.15.80:0/797735689 >> 172.21.15.80:0/797735689 conn(0x7fedcc0c9310 msgr2=0x7fedcc0c9720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:17:43.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:43.745+0000 7fedd2a37700 1 -- 172.21.15.80:0/797735689 shutdown_connections 2024-05-08T21:17:43.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:43.745+0000 7fedd2a37700 1 -- 172.21.15.80:0/797735689 wait complete. 2024-05-08T21:17:43.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:43.746+0000 7fedd2a37700 1 Processor -- start 2024-05-08T21:17:43.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:43.746+0000 7fedd2a37700 1 -- start start 2024-05-08T21:17:43.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:43.747+0000 7fedd2a37700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fedcc0c73f0 0x7fedcc06b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:43.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:43.747+0000 7fedd2a37700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fedcc151010 0x7fedcc06bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:43.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:43.747+0000 7fedd2a37700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fedcc156dc0 0x7fedcc158e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:43.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:43.747+0000 7fedd2a37700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedcc15a690 con 0x7fedcc0c73f0 2024-05-08T21:17:43.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:43.747+0000 7fedd2a37700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedcc1eff80 con 0x7fedcc156dc0 2024-05-08T21:17:43.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:43.747+0000 7fedd2a37700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedcc1f0e00 con 0x7fedcc151010 2024-05-08T21:17:43.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:43.747+0000 7fedcbfff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fedcc0c73f0 0x7fedcc06b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:43.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:43.747+0000 7fedcbfff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fedcc0c73f0 0x7fedcc06b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44020/0 (socket says 172.21.15.80:44020) 2024-05-08T21:17:43.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:43.747+0000 7fedcbfff700 1 -- 172.21.15.80:0/3248872019 learned_addr learned my addr 172.21.15.80:0/3248872019 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:17:43.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:43.747+0000 7fedcb7fe700 1 --2- 172.21.15.80:0/3248872019 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fedcc151010 0x7fedcc06bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:43.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:43.747+0000 7fedd0fd4700 1 --2- 172.21.15.80:0/3248872019 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fedcc156dc0 0x7fedcc158e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:43.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:43.747+0000 7fedcbfff700 1 -- 172.21.15.80:0/3248872019 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fedcc151010 msgr2=0x7fedcc06bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:43.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:43.747+0000 7fedcbfff700 1 --2- 172.21.15.80:0/3248872019 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fedcc151010 0x7fedcc06bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:43.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:43.747+0000 7fedcbfff700 1 -- 172.21.15.80:0/3248872019 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fedcc156dc0 msgr2=0x7fedcc158e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:43.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:43.747+0000 7fedcbfff700 1 --2- 172.21.15.80:0/3248872019 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fedcc156dc0 0x7fedcc158e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:43.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:43.747+0000 7fedcbfff700 1 -- 172.21.15.80:0/3248872019 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc4009a70 con 0x7fedcc0c73f0 2024-05-08T21:17:43.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:43.747+0000 7fedd0fd4700 1 --2- 172.21.15.80:0/3248872019 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fedcc156dc0 0x7fedcc158e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:17:43.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:43.747+0000 7fedcbfff700 1 --2- 172.21.15.80:0/3248872019 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fedcc0c73f0 0x7fedcc06b6b0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fedbc00c580 tx=0x7fedbc00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:17:43.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:43.747+0000 7fedc8ff9700 1 -- 172.21.15.80:0/3248872019 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedbc005d70 con 0x7fedcc0c73f0 2024-05-08T21:17:43.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:43.748+0000 7fedc8ff9700 1 -- 172.21.15.80:0/3248872019 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedbc0070d0 con 0x7fedcc0c73f0 2024-05-08T21:17:43.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:43.748+0000 7fedd2a37700 1 -- 172.21.15.80:0/3248872019 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedcc1f01f0 con 0x7fedcc0c73f0 2024-05-08T21:17:43.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:43.748+0000 7fedc8ff9700 1 -- 172.21.15.80:0/3248872019 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedbc007440 con 0x7fedcc0c73f0 2024-05-08T21:17:43.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:43.748+0000 7fedd2a37700 1 -- 172.21.15.80:0/3248872019 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedcc1f07b0 con 0x7fedcc0c73f0 2024-05-08T21:17:43.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:43.749+0000 7fedd2a37700 1 -- 172.21.15.80:0/3248872019 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedcc04ec60 con 0x7fedcc0c73f0 2024-05-08T21:17:43.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:43.749+0000 7fedc8ff9700 1 -- 172.21.15.80:0/3248872019 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fedbc0075a0 con 0x7fedcc0c73f0 2024-05-08T21:17:43.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:43.749+0000 7fedc8ff9700 1 --2- 172.21.15.80:0/3248872019 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fedb806acc0 0x7fedb806d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:43.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:43.750+0000 7fedc8ff9700 1 -- 172.21.15.80:0/3248872019 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6921+0+0 (secure 0 0 0) 0x7fedbc088ad0 con 0x7fedcc0c73f0 2024-05-08T21:17:43.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:43.750+0000 7fedcb7fe700 1 --2- 172.21.15.80:0/3248872019 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fedb806acc0 0x7fedb806d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:43.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:43.750+0000 7fedcb7fe700 1 --2- 172.21.15.80:0/3248872019 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fedb806acc0 0x7fedb806d180 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fedcc14aff0 tx=0x7fedc0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:17:43.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:43.754+0000 7fedc8ff9700 1 -- 172.21.15.80:0/3248872019 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fedbc0538a0 con 0x7fedcc0c73f0 2024-05-08T21:17:43.838 INFO:tasks.ceph.mds.d.smithi106.stdout:starting mds.d at 2024-05-08T21:17:44.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:44.060+0000 7fedd2a37700 1 -- 172.21.15.80:0/3248872019 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fedcc15b190 con 0x7fedcc0c73f0 2024-05-08T21:17:44.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:44.061+0000 7fedc8ff9700 1 -- 172.21.15.80:0/3248872019 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+5495 (secure 0 0 0) 0x7fedbc056ec0 con 0x7fedcc0c73f0 2024-05-08T21:17:44.064 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:17:44.064 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:17:38.557086+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5086},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5086":{"gid":5086,"name":"b","rank":0,"incarnation":21,"state":"up:active","state_seq":40,"addr":"172.21.15.106:6833/791920806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":791920806},{"type":"v1","addr":"172.21.15.106:6833","nonce":791920806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:17:44.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:44.063+0000 7fedd2a37700 1 -- 172.21.15.80:0/3248872019 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fedb806acc0 msgr2=0x7fedb806d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:44.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:44.063+0000 7fedd2a37700 1 --2- 172.21.15.80:0/3248872019 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fedb806acc0 0x7fedb806d180 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fedcc14aff0 tx=0x7fedc0009040 comp rx=0 tx=0).stop 2024-05-08T21:17:44.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:44.063+0000 7fedd2a37700 1 -- 172.21.15.80:0/3248872019 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fedcc0c73f0 msgr2=0x7fedcc06b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:44.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:44.063+0000 7fedd2a37700 1 --2- 172.21.15.80:0/3248872019 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fedcc0c73f0 0x7fedcc06b6b0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fedbc00c580 tx=0x7fedbc00c890 comp rx=0 tx=0).stop 2024-05-08T21:17:44.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:44.063+0000 7fedd2a37700 1 -- 172.21.15.80:0/3248872019 shutdown_connections 2024-05-08T21:17:44.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:44.063+0000 7fedd2a37700 1 --2- 172.21.15.80:0/3248872019 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fedb806acc0 0x7fedb806d180 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:44.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:44.063+0000 7fedd2a37700 1 --2- 172.21.15.80:0/3248872019 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fedcc0c73f0 0x7fedcc06b6b0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:44.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:44.063+0000 7fedd2a37700 1 --2- 172.21.15.80:0/3248872019 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fedcc156dc0 0x7fedcc158e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:44.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:44.063+0000 7fedd2a37700 1 --2- 172.21.15.80:0/3248872019 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fedcc151010 0x7fedcc06bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:44.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:44.063+0000 7fedd2a37700 1 -- 172.21.15.80:0/3248872019 >> 172.21.15.80:0/3248872019 conn(0x7fedcc0c9310 msgr2=0x7fedcc1564b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:17:44.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:44.063+0000 7fedd2a37700 1 -- 172.21.15.80:0/3248872019 shutdown_connections 2024-05-08T21:17:44.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:44.063+0000 7fedd2a37700 1 -- 172.21.15.80:0/3248872019 wait complete. 2024-05-08T21:17:44.067 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 24 2024-05-08T21:17:44.078 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.d is in active, standby or standby-replay 2024-05-08T21:17:44.471 INFO:tasks.ceph.mds.b.smithi106.stderr:2024-05-08T21:17:44.469+0000 7f0cb3839700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-08T21:17:46.079 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:17:46.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:46.392+0000 7f75fce80700 1 Processor -- start 2024-05-08T21:17:46.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:46.392+0000 7f75fce80700 1 -- start start 2024-05-08T21:17:46.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:46.393+0000 7f75fce80700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f75f8150410 0x7f75f8156dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:46.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:46.393+0000 7f75fce80700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f75f80c6af0 0x7f75f80c3100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:46.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:46.393+0000 7f75fce80700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75f8157300 con 0x7f75f80c3640 2024-05-08T21:17:46.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:46.393+0000 7f75fce80700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75f80c3a50 con 0x7f75f8150410 2024-05-08T21:17:46.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:46.393+0000 7f75fce80700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75f80c2bf0 con 0x7f75f80c6af0 2024-05-08T21:17:46.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:46.394+0000 7f75f6d9d700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f75f80c3640 0x7f75f80cb960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.80:58866/0 (socket says 172.21.15.80:58866) 2024-05-08T21:17:46.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:46.394+0000 7f75f6d9d700 1 -- 172.21.15.80:0/531031244 learned_addr learned my addr 172.21.15.80:0/531031244 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:17:46.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:46.394+0000 7f75f659c700 1 --2- 172.21.15.80:0/531031244 >> v2:172.21.15.80:3300/0 conn(0x7f75f8150410 0x7f75f8156dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:46.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:46.394+0000 7f75f559a700 1 -- 172.21.15.80:0/531031244 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4155708153 0 0) 0x7f75f8157300 con 0x7f75f80c3640 2024-05-08T21:17:46.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:46.394+0000 7f75f559a700 1 -- 172.21.15.80:0/531031244 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75e00057c0 con 0x7f75f80c3640 2024-05-08T21:17:46.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:46.395+0000 7f75f659c700 1 -- 172.21.15.80:0/531031244 >> v2:172.21.15.106:3300/0 conn(0x7f75f80c6af0 msgr2=0x7f75f80c3100 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T21:17:46.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:46.395+0000 7f75f659c700 1 --2- 172.21.15.80:0/531031244 >> v2:172.21.15.106:3300/0 conn(0x7f75f80c6af0 0x7f75f80c3100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:46.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:46.395+0000 7f75f659c700 1 -- 172.21.15.80:0/531031244 >> v1:172.21.15.106:6789/0 conn(0x7f75f80c3640 legacy=0x7f75f80cb960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:46.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:46.395+0000 7f75f659c700 1 -- 172.21.15.80:0/531031244 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f81507f0 con 0x7f75f8150410 2024-05-08T21:17:46.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:46.395+0000 7f75f659c700 1 --2- 172.21.15.80:0/531031244 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75f8150410 0x7f75f8156dc0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f75f80c2ea0 tx=0x7f75e8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97350a8459b93e72 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:17:46.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:46.396+0000 7f75f559a700 1 -- 172.21.15.80:0/531031244 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e801d420 con 0x7f75f8150410 2024-05-08T21:17:46.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:46.396+0000 7f75f559a700 1 -- 172.21.15.80:0/531031244 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75e801d580 con 0x7f75f8150410 2024-05-08T21:17:46.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:46.396+0000 7f75f559a700 1 -- 172.21.15.80:0/531031244 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e801d8f0 con 0x7f75f8150410 2024-05-08T21:17:46.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:46.400+0000 7f75fce80700 1 -- 172.21.15.80:0/531031244 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75f8150410 msgr2=0x7f75f8156dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:46.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:46.400+0000 7f75fce80700 1 --2- 172.21.15.80:0/531031244 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75f8150410 0x7f75f8156dc0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f75f80c2ea0 tx=0x7f75e8009b50 comp rx=0 tx=0).stop 2024-05-08T21:17:46.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:46.432+0000 7f75fce80700 1 -- 172.21.15.80:0/531031244 shutdown_connections 2024-05-08T21:17:46.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:46.432+0000 7f75fce80700 1 --2- 172.21.15.80:0/531031244 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75f8150410 0x7f75f8156dc0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:46.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:46.432+0000 7f75fce80700 1 --2- 172.21.15.80:0/531031244 >> v2:172.21.15.106:3300/0 conn(0x7f75f80c6af0 0x7f75f80c3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:46.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:46.432+0000 7f75fce80700 1 -- 172.21.15.80:0/531031244 >> 172.21.15.80:0/531031244 conn(0x7f75f806a9c0 msgr2=0x7f75f806ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:17:46.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:46.440+0000 7f75fce80700 1 -- 172.21.15.80:0/531031244 shutdown_connections 2024-05-08T21:17:46.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:46.440+0000 7f75fce80700 1 -- 172.21.15.80:0/531031244 wait complete. 2024-05-08T21:17:46.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:46.441+0000 7f75fce80700 1 Processor -- start 2024-05-08T21:17:46.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:46.442+0000 7f75fce80700 1 -- start start 2024-05-08T21:17:46.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:46.442+0000 7f75fce80700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75f80c3640 0x7f75f81538b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:46.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:46.442+0000 7f75fce80700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f75f80c6af0 0x7f75f814a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:46.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:46.442+0000 7f75fce80700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75f8150410 0x7f75f8147f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:46.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:46.442+0000 7f75fce80700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f8154710 con 0x7f75f80c3640 2024-05-08T21:17:46.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:46.442+0000 7f75fce80700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f8151fb0 con 0x7f75f8150410 2024-05-08T21:17:46.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:46.442+0000 7f75fce80700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75f81567d0 con 0x7f75f80c6af0 2024-05-08T21:17:46.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:46.443+0000 7f75f5d9b700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f75f80c6af0 0x7f75f814a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:46.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:46.446+0000 7f75f6d9d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75f8150410 0x7f75f8147f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:46.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:46.446+0000 7f75f6d9d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75f8150410 0x7f75f8147f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.80:40926/0 (socket says 172.21.15.80:40926) 2024-05-08T21:17:46.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:46.446+0000 7f75f6d9d700 1 -- 172.21.15.80:0/2255979731 learned_addr learned my addr 172.21.15.80:0/2255979731 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:17:46.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:46.449+0000 7f75f6d9d700 1 -- 172.21.15.80:0/2255979731 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f75f80c6af0 msgr2=0x7f75f814a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:46.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:46.449+0000 7f75f6d9d700 1 --2- 172.21.15.80:0/2255979731 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f75f80c6af0 0x7f75f814a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:46.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:46.449+0000 7f75f6d9d700 1 -- 172.21.15.80:0/2255979731 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75f80c3640 msgr2=0x7f75f81538b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:46.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:46.449+0000 7f75f6d9d700 1 --2- 172.21.15.80:0/2255979731 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75f80c3640 0x7f75f81538b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:46.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:46.449+0000 7f75f6d9d700 1 -- 172.21.15.80:0/2255979731 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e80094a0 con 0x7f75f8150410 2024-05-08T21:17:46.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:46.455+0000 7f75f6d9d700 1 --2- 172.21.15.80:0/2255979731 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75f8150410 0x7f75f8147f60 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f75f0008fd0 tx=0x7f75f0001d80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:17:46.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:46.466+0000 7f75e6ffd700 1 -- 172.21.15.80:0/2255979731 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f00064f0 con 0x7f75f8150410 2024-05-08T21:17:46.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:46.466+0000 7f75e6ffd700 1 -- 172.21.15.80:0/2255979731 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75f0006670 con 0x7f75f8150410 2024-05-08T21:17:46.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:46.466+0000 7f75e6ffd700 1 -- 172.21.15.80:0/2255979731 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f0006a20 con 0x7f75f8150410 2024-05-08T21:17:46.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:46.466+0000 7f75fce80700 1 -- 172.21.15.80:0/2255979731 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75f81521b0 con 0x7f75f8150410 2024-05-08T21:17:46.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:46.466+0000 7f75fce80700 1 -- 172.21.15.80:0/2255979731 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75f8156a90 con 0x7f75f8150410 2024-05-08T21:17:46.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:46.468+0000 7f75fce80700 1 -- 172.21.15.80:0/2255979731 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75f8154850 con 0x7f75f8150410 2024-05-08T21:17:46.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:46.492+0000 7f75e6ffd700 1 -- 172.21.15.80:0/2255979731 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f75f0006b80 con 0x7f75f8150410 2024-05-08T21:17:46.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:46.502+0000 7f75e6ffd700 1 --2- 172.21.15.80:0/2255979731 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f75d806ad90 0x7f75d806d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:17:46.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:46.502+0000 7f75e6ffd700 1 -- 172.21.15.80:0/2255979731 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6921+0+0 (secure 0 0 0) 0x7f75f00893f0 con 0x7f75f8150410 2024-05-08T21:17:46.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:46.503+0000 7f75e6ffd700 1 -- 172.21.15.80:0/2255979731 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f75f0089870 con 0x7f75f8150410 2024-05-08T21:17:46.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:46.503+0000 7f75f659c700 1 --2- 172.21.15.80:0/2255979731 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f75d806ad90 0x7f75d806d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:17:46.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:46.519+0000 7f75f659c700 1 --2- 172.21.15.80:0/2255979731 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f75d806ad90 0x7f75d806d250 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f75f80c99e0 tx=0x7f75e8018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:17:47.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:47.021+0000 7f75fce80700 1 -- 172.21.15.80:0/2255979731 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f75f8154850 con 0x7f75f8150410 2024-05-08T21:17:47.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:47.024+0000 7f75e6ffd700 1 -- 172.21.15.80:0/2255979731 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+6252 (secure 0 0 0) 0x7f75f8154850 con 0x7f75f8150410 2024-05-08T21:17:47.030 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:17:47.030 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":5158,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/959295764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":959295764},{"type":"v1","addr":"172.21.15.106:6836","nonce":959295764}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:17:38.557086+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5086},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5086":{"gid":5086,"name":"b","rank":0,"incarnation":21,"state":"up:active","state_seq":40,"addr":"172.21.15.106:6833/791920806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":791920806},{"type":"v1","addr":"172.21.15.106:6833","nonce":791920806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:17:47.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:47.039+0000 7f75fce80700 1 -- 172.21.15.80:0/2255979731 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f75d806ad90 msgr2=0x7f75d806d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:47.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:47.039+0000 7f75fce80700 1 --2- 172.21.15.80:0/2255979731 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f75d806ad90 0x7f75d806d250 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f75f80c99e0 tx=0x7f75e8018000 comp rx=0 tx=0).stop 2024-05-08T21:17:47.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:47.039+0000 7f75fce80700 1 -- 172.21.15.80:0/2255979731 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75f8150410 msgr2=0x7f75f8147f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:17:47.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:47.039+0000 7f75fce80700 1 --2- 172.21.15.80:0/2255979731 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75f8150410 0x7f75f8147f60 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f75f0008fd0 tx=0x7f75f0001d80 comp rx=0 tx=0).stop 2024-05-08T21:17:47.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:47.056+0000 7f75fce80700 1 -- 172.21.15.80:0/2255979731 shutdown_connections 2024-05-08T21:17:47.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:47.056+0000 7f75fce80700 1 --2- 172.21.15.80:0/2255979731 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f75d806ad90 0x7f75d806d250 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:47.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:47.056+0000 7f75fce80700 1 --2- 172.21.15.80:0/2255979731 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75f80c3640 0x7f75f81538b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:47.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:47.056+0000 7f75fce80700 1 --2- 172.21.15.80:0/2255979731 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75f8150410 0x7f75f8147f60 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:47.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:47.056+0000 7f75fce80700 1 --2- 172.21.15.80:0/2255979731 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f75f80c6af0 0x7f75f814a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:17:47.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:47.056+0000 7f75fce80700 1 -- 172.21.15.80:0/2255979731 >> 172.21.15.80:0/2255979731 conn(0x7f75f806a9c0 msgr2=0x7f75f806ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:17:47.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:47.056+0000 7f75fce80700 1 -- 172.21.15.80:0/2255979731 shutdown_connections 2024-05-08T21:17:47.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:17:47.057+0000 7f75fce80700 1 -- 172.21.15.80:0/2255979731 wait complete. 2024-05-08T21:17:47.063 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 25 2024-05-08T21:17:47.082 INFO:tasks.mds_thrash.fs.[cephfs]:mds.d reported in up:standby state 2024-05-08T21:17:47.082 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 64 secs before thrashing 2024-05-08T21:18:51.083 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:18:51.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:51.886+0000 7f75f7e03700 1 Processor -- start 2024-05-08T21:18:51.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:51.886+0000 7f75f7e03700 1 -- start start 2024-05-08T21:18:51.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:51.887+0000 7f75f7e03700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f75f0154580 0x7f75f015abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:18:51.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:51.887+0000 7f75f7e03700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f75f00cbe40 0x7f75f00c48c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:18:51.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:51.887+0000 7f75f7e03700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75f00cad60 con 0x7f75f00c4e00 2024-05-08T21:18:51.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:51.887+0000 7f75f7e03700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75f00b2c60 con 0x7f75f0154580 2024-05-08T21:18:51.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:51.887+0000 7f75f7e03700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75f015d750 con 0x7f75f00cbe40 2024-05-08T21:18:51.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:51.887+0000 7f75f5b9f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f75f0154580 0x7f75f015abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:18:51.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:51.887+0000 7f75f63a0700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f75f00c4e00 0x7f75f00cc3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39236/0 (socket says 172.21.15.80:39236) 2024-05-08T21:18:51.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:51.887+0000 7f75f63a0700 1 -- 172.21.15.80:0/2215573279 learned_addr learned my addr 172.21.15.80:0/2215573279 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:18:51.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:51.887+0000 7f75f539e700 1 --2- 172.21.15.80:0/2215573279 >> v2:172.21.15.106:3300/0 conn(0x7f75f00cbe40 0x7f75f00c48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:18:51.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:51.887+0000 7f75f5b9f700 1 -- 172.21.15.80:0/2215573279 >> v2:172.21.15.106:3300/0 conn(0x7f75f00cbe40 msgr2=0x7f75f00c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:18:51.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:51.888+0000 7f75f5b9f700 1 --2- 172.21.15.80:0/2215573279 >> v2:172.21.15.106:3300/0 conn(0x7f75f00cbe40 0x7f75f00c48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:18:51.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:51.888+0000 7f75f5b9f700 1 -- 172.21.15.80:0/2215573279 >> v1:172.21.15.80:6789/0 conn(0x7f75f00c4e00 legacy=0x7f75f00cc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:18:51.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:51.888+0000 7f75f5b9f700 1 -- 172.21.15.80:0/2215573279 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f015d930 con 0x7f75f0154580 2024-05-08T21:18:51.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:51.888+0000 7f75f5b9f700 1 --2- 172.21.15.80:0/2215573279 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75f0154580 0x7f75f015abe0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f75f00c6be0 tx=0x7f75ec009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d98064f612ca80b3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:18:51.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:51.888+0000 7f75f4b9d700 1 -- 172.21.15.80:0/2215573279 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ec011830 con 0x7f75f0154580 2024-05-08T21:18:51.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:51.888+0000 7f75f4b9d700 1 -- 172.21.15.80:0/2215573279 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75ec011990 con 0x7f75f0154580 2024-05-08T21:18:51.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:51.888+0000 7f75f4b9d700 1 -- 172.21.15.80:0/2215573279 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ec011d20 con 0x7f75f0154580 2024-05-08T21:18:51.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:51.888+0000 7f75f7e03700 1 -- 172.21.15.80:0/2215573279 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75f0154580 msgr2=0x7f75f015abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:18:51.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:51.888+0000 7f75f7e03700 1 --2- 172.21.15.80:0/2215573279 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75f0154580 0x7f75f015abe0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f75f00c6be0 tx=0x7f75ec009b50 comp rx=0 tx=0).stop 2024-05-08T21:18:51.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:51.888+0000 7f75f7e03700 1 -- 172.21.15.80:0/2215573279 shutdown_connections 2024-05-08T21:18:51.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:51.888+0000 7f75f7e03700 1 --2- 172.21.15.80:0/2215573279 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75f0154580 0x7f75f015abe0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:18:51.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:51.888+0000 7f75f7e03700 1 --2- 172.21.15.80:0/2215573279 >> v2:172.21.15.106:3300/0 conn(0x7f75f00cbe40 0x7f75f00c48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:18:51.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:51.888+0000 7f75f7e03700 1 -- 172.21.15.80:0/2215573279 >> 172.21.15.80:0/2215573279 conn(0x7f75f006c6a0 msgr2=0x7f75f006cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:18:51.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:51.888+0000 7f75f7e03700 1 -- 172.21.15.80:0/2215573279 shutdown_connections 2024-05-08T21:18:51.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:51.888+0000 7f75f7e03700 1 -- 172.21.15.80:0/2215573279 wait complete. 2024-05-08T21:18:51.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:51.890+0000 7f75f7e03700 1 Processor -- start 2024-05-08T21:18:51.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:51.890+0000 7f75f7e03700 1 -- start start 2024-05-08T21:18:51.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:51.890+0000 7f75f7e03700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75f00c4e00 0x7f75f00ced80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:18:51.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:51.890+0000 7f75f7e03700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f75f00cbe40 0x7f75f00cf910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:18:51.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:51.890+0000 7f75f7e03700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75f0154580 0x7f75f01554a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:18:51.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:51.890+0000 7f75f7e03700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f01f04b0 con 0x7f75f00c4e00 2024-05-08T21:18:51.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:51.890+0000 7f75f7e03700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f00ce020 con 0x7f75f0154580 2024-05-08T21:18:51.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:51.890+0000 7f75f7e03700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75f00cf2c0 con 0x7f75f00cbe40 2024-05-08T21:18:51.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:51.890+0000 7f75f5b9f700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75f00c4e00 0x7f75f00ced80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:18:51.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:51.890+0000 7f75f5b9f700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75f00c4e00 0x7f75f00ced80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51752/0 (socket says 172.21.15.80:51752) 2024-05-08T21:18:51.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:51.890+0000 7f75f5b9f700 1 -- 172.21.15.80:0/4276544923 learned_addr learned my addr 172.21.15.80:0/4276544923 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:18:51.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:51.891+0000 7f75f539e700 1 --2- 172.21.15.80:0/4276544923 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f75f00cbe40 0x7f75f00cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:18:51.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:51.891+0000 7f75f63a0700 1 --2- 172.21.15.80:0/4276544923 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75f0154580 0x7f75f01554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:18:51.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:51.891+0000 7f75f5b9f700 1 -- 172.21.15.80:0/4276544923 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f75f00cbe40 msgr2=0x7f75f00cf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:18:51.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:51.891+0000 7f75f5b9f700 1 --2- 172.21.15.80:0/4276544923 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f75f00cbe40 0x7f75f00cf910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:18:51.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:51.891+0000 7f75f5b9f700 1 -- 172.21.15.80:0/4276544923 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75f0154580 msgr2=0x7f75f01554a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:18:51.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:51.891+0000 7f75f5b9f700 1 --2- 172.21.15.80:0/4276544923 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75f0154580 0x7f75f01554a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:18:51.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:51.891+0000 7f75f5b9f700 1 -- 172.21.15.80:0/4276544923 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75ec0094a0 con 0x7f75f00c4e00 2024-05-08T21:18:51.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:51.891+0000 7f75f5b9f700 1 --2- 172.21.15.80:0/4276544923 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75f00c4e00 0x7f75f00ced80 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f75ec0090b0 tx=0x7f75ec004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:18:51.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:51.891+0000 7f75e67fc700 1 -- 172.21.15.80:0/4276544923 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ec0036a0 con 0x7f75f00c4e00 2024-05-08T21:18:51.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:51.891+0000 7f75e67fc700 1 -- 172.21.15.80:0/4276544923 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75ec01e070 con 0x7f75f00c4e00 2024-05-08T21:18:51.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:51.891+0000 7f75f7e03700 1 -- 172.21.15.80:0/4276544923 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75f01f0970 con 0x7f75f00c4e00 2024-05-08T21:18:51.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:51.891+0000 7f75e67fc700 1 -- 172.21.15.80:0/4276544923 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ec003a40 con 0x7f75f00c4e00 2024-05-08T21:18:51.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:51.891+0000 7f75f7e03700 1 -- 172.21.15.80:0/4276544923 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75f00cd960 con 0x7f75f00c4e00 2024-05-08T21:18:51.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:51.892+0000 7f75f7e03700 1 -- 172.21.15.80:0/4276544923 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75f004ec60 con 0x7f75f00c4e00 2024-05-08T21:18:51.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:51.893+0000 7f75e67fc700 1 -- 172.21.15.80:0/4276544923 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f75ec003ba0 con 0x7f75f00c4e00 2024-05-08T21:18:51.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:51.893+0000 7f75e67fc700 1 --2- 172.21.15.80:0/4276544923 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f75d406acc0 0x7f75d406d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:18:51.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:51.893+0000 7f75e67fc700 1 -- 172.21.15.80:0/4276544923 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6921+0+0 (secure 0 0 0) 0x7f75ec08a950 con 0x7f75f00c4e00 2024-05-08T21:18:51.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:51.893+0000 7f75f539e700 1 --2- 172.21.15.80:0/4276544923 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f75d406acc0 0x7f75d406d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:18:51.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:51.894+0000 7f75f539e700 1 --2- 172.21.15.80:0/4276544923 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f75d406acc0 0x7f75d406d180 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f75f00ca1b0 tx=0x7f75e0009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:18:51.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:51.897+0000 7f75e67fc700 1 -- 172.21.15.80:0/4276544923 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f75ec0557e0 con 0x7f75f00c4e00 2024-05-08T21:18:52.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.145+0000 7f75f7e03700 1 -- 172.21.15.80:0/4276544923 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f75f00cb4a0 con 0x7f75f00c4e00 2024-05-08T21:18:52.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.146+0000 7f75e67fc700 1 -- 172.21.15.80:0/4276544923 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+6252 (secure 0 0 0) 0x7f75ec020020 con 0x7f75f00c4e00 2024-05-08T21:18:52.149 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:18:52.149 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":5158,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/959295764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":959295764},{"type":"v1","addr":"172.21.15.106:6836","nonce":959295764}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:17:38.557086+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5086},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5086":{"gid":5086,"name":"b","rank":0,"incarnation":21,"state":"up:active","state_seq":40,"addr":"172.21.15.106:6833/791920806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":791920806},{"type":"v1","addr":"172.21.15.106:6833","nonce":791920806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:18:52.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.148+0000 7f75f7e03700 1 -- 172.21.15.80:0/4276544923 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f75d406acc0 msgr2=0x7f75d406d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:18:52.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.148+0000 7f75f7e03700 1 --2- 172.21.15.80:0/4276544923 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f75d406acc0 0x7f75d406d180 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f75f00ca1b0 tx=0x7f75e0009210 comp rx=0 tx=0).stop 2024-05-08T21:18:52.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.148+0000 7f75f7e03700 1 -- 172.21.15.80:0/4276544923 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75f00c4e00 msgr2=0x7f75f00ced80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:18:52.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.148+0000 7f75f7e03700 1 --2- 172.21.15.80:0/4276544923 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75f00c4e00 0x7f75f00ced80 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f75ec0090b0 tx=0x7f75ec004750 comp rx=0 tx=0).stop 2024-05-08T21:18:52.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.148+0000 7f75f7e03700 1 -- 172.21.15.80:0/4276544923 shutdown_connections 2024-05-08T21:18:52.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.148+0000 7f75f7e03700 1 --2- 172.21.15.80:0/4276544923 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f75d406acc0 0x7f75d406d180 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:18:52.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.148+0000 7f75f7e03700 1 --2- 172.21.15.80:0/4276544923 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75f00c4e00 0x7f75f00ced80 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:18:52.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.148+0000 7f75f7e03700 1 --2- 172.21.15.80:0/4276544923 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75f0154580 0x7f75f01554a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:18:52.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.148+0000 7f75f7e03700 1 --2- 172.21.15.80:0/4276544923 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f75f00cbe40 0x7f75f00cf910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:18:52.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.148+0000 7f75f7e03700 1 -- 172.21.15.80:0/4276544923 >> 172.21.15.80:0/4276544923 conn(0x7f75f006c6a0 msgr2=0x7f75f0152f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:18:52.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.149+0000 7f75f7e03700 1 -- 172.21.15.80:0/4276544923 shutdown_connections 2024-05-08T21:18:52.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.149+0000 7f75f7e03700 1 -- 172.21.15.80:0/4276544923 wait complete. 2024-05-08T21:18:52.153 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 25 2024-05-08T21:18:52.163 INFO:tasks.mds_thrash.fs.[cephfs]:kill mds.b (rank=0) 2024-05-08T21:18:52.164 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-08T21:18:52.164 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:18:52.195 INFO:tasks.ceph.mds.b:Stopped 2024-05-08T21:18:52.195 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:18:52.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.319+0000 7fd5b99ae700 1 Processor -- start 2024-05-08T21:18:52.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.319+0000 7fd5b99ae700 1 -- start start 2024-05-08T21:18:52.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.319+0000 7fd5b99ae700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd5b40c75e0 0x7fd5b415ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:18:52.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.319+0000 7fd5b99ae700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd5b40c87b0 0x7fd5b4071400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:18:52.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.319+0000 7fd5b99ae700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5b40c7e50 con 0x7fd5b40c79c0 2024-05-08T21:18:52.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.319+0000 7fd5b99ae700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5b4157550 con 0x7fd5b40c87b0 2024-05-08T21:18:52.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.319+0000 7fd5b99ae700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b4157830 con 0x7fd5b40c75e0 2024-05-08T21:18:52.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.320+0000 7fd5b2ffd700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd5b40c75e0 0x7fd5b415ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:18:52.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.320+0000 7fd5b27fc700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd5b40c87b0 0x7fd5b4071400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:18:52.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.320+0000 7fd5b2ffd700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd5b40c75e0 0x7fd5b415ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:47936/0 (socket says 172.21.15.80:47936) 2024-05-08T21:18:52.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.320+0000 7fd5b2ffd700 1 -- 172.21.15.80:0/218918973 learned_addr learned my addr 172.21.15.80:0/218918973 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:18:52.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.320+0000 7fd5b27fc700 1 -- 172.21.15.80:0/218918973 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd5b40c75e0 msgr2=0x7fd5b415ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:18:52.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.320+0000 7fd5b27fc700 1 --2- 172.21.15.80:0/218918973 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd5b40c75e0 0x7fd5b415ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:18:52.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.320+0000 7fd5b27fc700 1 -- 172.21.15.80:0/218918973 >> v1:172.21.15.106:6789/0 conn(0x7fd5b40c79c0 legacy=0x7fd5b4156d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:18:52.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.320+0000 7fd5b27fc700 1 -- 172.21.15.80:0/218918973 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5b4157b10 con 0x7fd5b40c87b0 2024-05-08T21:18:52.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.320+0000 7fd5b2ffd700 1 --2- 172.21.15.80:0/218918973 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd5b40c75e0 0x7fd5b415ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:18:52.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.320+0000 7fd5b27fc700 1 --2- 172.21.15.80:0/218918973 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5b40c87b0 0x7fd5b4071400 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd5a8009840 tx=0x7fd5a8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=210343733675fd67 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:18:52.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.320+0000 7fd5b1ffb700 1 -- 172.21.15.80:0/218918973 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a8011830 con 0x7fd5b40c87b0 2024-05-08T21:18:52.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.321+0000 7fd5b1ffb700 1 -- 172.21.15.80:0/218918973 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5a8011990 con 0x7fd5b40c87b0 2024-05-08T21:18:52.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.321+0000 7fd5b1ffb700 1 -- 172.21.15.80:0/218918973 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a8011d20 con 0x7fd5b40c87b0 2024-05-08T21:18:52.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.321+0000 7fd5b99ae700 1 -- 172.21.15.80:0/218918973 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5b40c87b0 msgr2=0x7fd5b4071400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:18:52.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.321+0000 7fd5b99ae700 1 --2- 172.21.15.80:0/218918973 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5b40c87b0 0x7fd5b4071400 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd5a8009840 tx=0x7fd5a8009b50 comp rx=0 tx=0).stop 2024-05-08T21:18:52.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.321+0000 7fd5b99ae700 1 -- 172.21.15.80:0/218918973 shutdown_connections 2024-05-08T21:18:52.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.321+0000 7fd5b99ae700 1 --2- 172.21.15.80:0/218918973 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd5b40c75e0 0x7fd5b415ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:18:52.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.321+0000 7fd5b99ae700 1 --2- 172.21.15.80:0/218918973 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5b40c87b0 0x7fd5b4071400 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:18:52.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.321+0000 7fd5b99ae700 1 -- 172.21.15.80:0/218918973 >> 172.21.15.80:0/218918973 conn(0x7fd5b406bad0 msgr2=0x7fd5b406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:18:52.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.321+0000 7fd5b99ae700 1 -- 172.21.15.80:0/218918973 shutdown_connections 2024-05-08T21:18:52.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.321+0000 7fd5b99ae700 1 -- 172.21.15.80:0/218918973 wait complete. 2024-05-08T21:18:52.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.322+0000 7fd5b99ae700 1 Processor -- start 2024-05-08T21:18:52.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.322+0000 7fd5b99ae700 1 -- start start 2024-05-08T21:18:52.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.323+0000 7fd5b99ae700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5b40c75e0 0x7fd5b4161750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:18:52.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.323+0000 7fd5b99ae700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd5b40c79c0 0x7fd5b4152140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:18:52.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.323+0000 7fd5b99ae700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd5b40c87b0 0x7fd5b4153550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:18:52.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.323+0000 7fd5b99ae700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b4162d90 con 0x7fd5b40c87b0 2024-05-08T21:18:52.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.323+0000 7fd5b99ae700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b4071560 con 0x7fd5b40c75e0 2024-05-08T21:18:52.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.323+0000 7fd5b99ae700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b4159640 con 0x7fd5b40c79c0 2024-05-08T21:18:52.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.323+0000 7fd5b37fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd5b40c87b0 0x7fd5b4153550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:18:52.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.323+0000 7fd5b37fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd5b40c87b0 0x7fd5b4153550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43622/0 (socket says 172.21.15.80:43622) 2024-05-08T21:18:52.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.323+0000 7fd5b37fe700 1 -- 172.21.15.80:0/3376311498 learned_addr learned my addr 172.21.15.80:0/3376311498 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:18:52.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.323+0000 7fd5b27fc700 1 --2- 172.21.15.80:0/3376311498 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd5b40c79c0 0x7fd5b4152140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:18:52.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.323+0000 7fd5b2ffd700 1 --2- 172.21.15.80:0/3376311498 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5b40c75e0 0x7fd5b4161750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:18:52.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.323+0000 7fd5b37fe700 1 -- 172.21.15.80:0/3376311498 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd5b40c79c0 msgr2=0x7fd5b4152140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:18:52.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.323+0000 7fd5b37fe700 1 --2- 172.21.15.80:0/3376311498 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd5b40c79c0 0x7fd5b4152140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:18:52.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.323+0000 7fd5b37fe700 1 -- 172.21.15.80:0/3376311498 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5b40c75e0 msgr2=0x7fd5b4161750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:18:52.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.323+0000 7fd5b37fe700 1 --2- 172.21.15.80:0/3376311498 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5b40c75e0 0x7fd5b4161750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:18:52.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.323+0000 7fd5b37fe700 1 -- 172.21.15.80:0/3376311498 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a4009550 con 0x7fd5b40c87b0 2024-05-08T21:18:52.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.323+0000 7fd5b37fe700 1 --2- 172.21.15.80:0/3376311498 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd5b40c87b0 0x7fd5b4153550 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac00cc80 tx=0x7fd5ac00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:18:52.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.324+0000 7fd59bfff700 1 -- 172.21.15.80:0/3376311498 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5ac003c00 con 0x7fd5b40c87b0 2024-05-08T21:18:52.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.324+0000 7fd59bfff700 1 -- 172.21.15.80:0/3376311498 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5ac003d60 con 0x7fd5b40c87b0 2024-05-08T21:18:52.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.324+0000 7fd5b99ae700 1 -- 172.21.15.80:0/3376311498 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5a80094a0 con 0x7fd5b40c87b0 2024-05-08T21:18:52.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.324+0000 7fd59bfff700 1 -- 172.21.15.80:0/3376311498 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5ac00aaa0 con 0x7fd5b40c87b0 2024-05-08T21:18:52.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.324+0000 7fd5b99ae700 1 -- 172.21.15.80:0/3376311498 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5b4161de0 con 0x7fd5b40c87b0 2024-05-08T21:18:52.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.325+0000 7fd5b99ae700 1 -- 172.21.15.80:0/3376311498 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5b40ca0f0 con 0x7fd5b40c87b0 2024-05-08T21:18:52.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.325+0000 7fd59bfff700 1 -- 172.21.15.80:0/3376311498 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd5ac00ac00 con 0x7fd5b40c87b0 2024-05-08T21:18:52.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.326+0000 7fd59bfff700 1 --2- 172.21.15.80:0/3376311498 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fd5a006ac90 0x7fd5a006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:18:52.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.326+0000 7fd5b2ffd700 1 --2- 172.21.15.80:0/3376311498 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fd5a006ac90 0x7fd5a006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:18:52.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.326+0000 7fd59bfff700 1 -- 172.21.15.80:0/3376311498 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6921+0+0 (secure 0 0 0) 0x7fd5ac089780 con 0x7fd5b40c87b0 2024-05-08T21:18:52.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.326+0000 7fd5b2ffd700 1 --2- 172.21.15.80:0/3376311498 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fd5a006ac90 0x7fd5a006d150 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd5a4006d30 tx=0x7fd5a40092c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:18:52.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.330+0000 7fd59bfff700 1 -- 172.21.15.80:0/3376311498 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fd5ac0544a0 con 0x7fd5b40c87b0 2024-05-08T21:18:52.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.581+0000 7fd5b99ae700 1 -- 172.21.15.80:0/3376311498 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd5b406d0d0 con 0x7fd5b40c87b0 2024-05-08T21:18:52.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.581+0000 7fd59bfff700 1 -- 172.21.15.80:0/3376311498 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+6252 (secure 0 0 0) 0x7fd5ac057ac0 con 0x7fd5b40c87b0 2024-05-08T21:18:52.584 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:18:52.584 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":5158,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/959295764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":959295764},{"type":"v1","addr":"172.21.15.106:6836","nonce":959295764}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:17:38.557086+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5086},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5086":{"gid":5086,"name":"b","rank":0,"incarnation":21,"state":"up:active","state_seq":40,"addr":"172.21.15.106:6833/791920806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":791920806},{"type":"v1","addr":"172.21.15.106:6833","nonce":791920806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:18:52.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.584+0000 7fd5b99ae700 1 -- 172.21.15.80:0/3376311498 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fd5a006ac90 msgr2=0x7fd5a006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:18:52.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.584+0000 7fd5b99ae700 1 --2- 172.21.15.80:0/3376311498 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fd5a006ac90 0x7fd5a006d150 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd5a4006d30 tx=0x7fd5a40092c0 comp rx=0 tx=0).stop 2024-05-08T21:18:52.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.584+0000 7fd5b99ae700 1 -- 172.21.15.80:0/3376311498 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd5b40c87b0 msgr2=0x7fd5b4153550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:18:52.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.584+0000 7fd5b99ae700 1 --2- 172.21.15.80:0/3376311498 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd5b40c87b0 0x7fd5b4153550 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac00cc80 tx=0x7fd5ac00cf90 comp rx=0 tx=0).stop 2024-05-08T21:18:52.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.584+0000 7fd5b99ae700 1 -- 172.21.15.80:0/3376311498 shutdown_connections 2024-05-08T21:18:52.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.584+0000 7fd5b99ae700 1 --2- 172.21.15.80:0/3376311498 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fd5a006ac90 0x7fd5a006d150 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:18:52.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.584+0000 7fd5b99ae700 1 --2- 172.21.15.80:0/3376311498 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd5b40c87b0 0x7fd5b4153550 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:18:52.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.584+0000 7fd5b99ae700 1 --2- 172.21.15.80:0/3376311498 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5b40c75e0 0x7fd5b4161750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:18:52.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.584+0000 7fd5b99ae700 1 --2- 172.21.15.80:0/3376311498 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd5b40c79c0 0x7fd5b4152140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:18:52.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.584+0000 7fd5b99ae700 1 -- 172.21.15.80:0/3376311498 >> 172.21.15.80:0/3376311498 conn(0x7fd5b406bad0 msgr2=0x7fd5b406f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:18:52.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.584+0000 7fd5b99ae700 1 -- 172.21.15.80:0/3376311498 shutdown_connections 2024-05-08T21:18:52.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:52.584+0000 7fd5b99ae700 1 -- 172.21.15.80:0/3376311498 wait complete. 2024-05-08T21:18:52.588 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 25 2024-05-08T21:18:52.599 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-05-08T21:18:54.600 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:18:54.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.721+0000 7fbe54c14700 1 Processor -- start 2024-05-08T21:18:54.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.721+0000 7fbe54c14700 1 -- start start 2024-05-08T21:18:54.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.722+0000 7fbe54c14700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fbe500ccc00 0x7fbe50071be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:18:54.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.722+0000 7fbe54c14700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe500c9150 con 0x7fbe500ccfe0 2024-05-08T21:18:54.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.722+0000 7fbe54c14700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe500c99f0 con 0x7fbe500c8380 2024-05-08T21:18:54.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.722+0000 7fbe54c14700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe501579c0 con 0x7fbe500ccc00 2024-05-08T21:18:54.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.722+0000 7fbe4dd9b700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fbe500ccfe0 0x7fbe50156ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39722/0 (socket says 172.21.15.80:39722) 2024-05-08T21:18:54.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.722+0000 7fbe4dd9b700 1 -- 172.21.15.80:0/1359332787 learned_addr learned my addr 172.21.15.80:0/1359332787 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:18:54.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.722+0000 7fbe4e59c700 1 --2- 172.21.15.80:0/1359332787 >> v2:172.21.15.106:3300/0 conn(0x7fbe500ccc00 0x7fbe50071be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:18:54.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.722+0000 7fbe4d59a700 1 -- 172.21.15.80:0/1359332787 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2557667048 0 0) 0x7fbe500c9150 con 0x7fbe500ccfe0 2024-05-08T21:18:54.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.722+0000 7fbe4d59a700 1 -- 172.21.15.80:0/1359332787 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe380035b0 con 0x7fbe500ccfe0 2024-05-08T21:18:54.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.723+0000 7fbe4d59a700 1 -- 172.21.15.80:0/1359332787 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2360610959 0 0) 0x7fbe380035b0 con 0x7fbe500ccfe0 2024-05-08T21:18:54.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.723+0000 7fbe4d59a700 1 -- 172.21.15.80:0/1359332787 >> v2:172.21.15.106:3300/0 conn(0x7fbe500ccc00 msgr2=0x7fbe50071be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:18:54.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.723+0000 7fbe4d59a700 1 --2- 172.21.15.80:0/1359332787 >> v2:172.21.15.106:3300/0 conn(0x7fbe500ccc00 0x7fbe50071be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:18:54.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.723+0000 7fbe4d59a700 1 -- 172.21.15.80:0/1359332787 >> v1:172.21.15.106:6789/0 conn(0x7fbe500c8380 legacy=0x7fbe5014d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:18:54.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.723+0000 7fbe4d59a700 1 -- 172.21.15.80:0/1359332787 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe50157ca0 con 0x7fbe500ccfe0 2024-05-08T21:18:54.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.723+0000 7fbe4d59a700 1 -- 172.21.15.80:0/1359332787 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3520646302 0 0) 0x7fbe44001670 con 0x7fbe500ccfe0 2024-05-08T21:18:54.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.723+0000 7fbe4d59a700 1 -- 172.21.15.80:0/1359332787 >> v1:172.21.15.80:6789/0 conn(0x7fbe500ccfe0 legacy=0x7fbe50156ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:18:54.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.723+0000 7fbe4d59a700 1 --2- 172.21.15.80:0/1359332787 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbe38003a00 0x7fbe38003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:18:54.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.723+0000 7fbe4d59a700 1 --2- 172.21.15.80:0/1359332787 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbe38004850 0x7fbe38004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:18:54.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.723+0000 7fbe4d59a700 1 --2- 172.21.15.80:0/1359332787 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe38005210 0x7fbe3800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:18:54.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.723+0000 7fbe4d59a700 1 -- 172.21.15.80:0/1359332787 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe501579c0 con 0x7fbe38005210 2024-05-08T21:18:54.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.723+0000 7fbe4d59a700 1 -- 172.21.15.80:0/1359332787 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3800c0b0 con 0x7fbe38003a00 2024-05-08T21:18:54.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.723+0000 7fbe4d59a700 1 -- 172.21.15.80:0/1359332787 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3800c270 con 0x7fbe38004850 2024-05-08T21:18:54.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.723+0000 7fbe4e59c700 1 --2- 172.21.15.80:0/1359332787 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbe38003a00 0x7fbe38003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:18:54.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.723+0000 7fbe4ed9d700 1 --2- 172.21.15.80:0/1359332787 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe38005210 0x7fbe3800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:18:54.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.723+0000 7fbe4dd9b700 1 --2- 172.21.15.80:0/1359332787 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbe38004850 0x7fbe38004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:18:54.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.723+0000 7fbe4ed9d700 1 -- 172.21.15.80:0/1359332787 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbe38004850 msgr2=0x7fbe38004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:18:54.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.723+0000 7fbe4ed9d700 1 --2- 172.21.15.80:0/1359332787 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbe38004850 0x7fbe38004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:18:54.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.723+0000 7fbe4ed9d700 1 -- 172.21.15.80:0/1359332787 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbe38003a00 msgr2=0x7fbe38003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:18:54.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.723+0000 7fbe4ed9d700 1 --2- 172.21.15.80:0/1359332787 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbe38003a00 0x7fbe38003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:18:54.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.723+0000 7fbe4ed9d700 1 -- 172.21.15.80:0/1359332787 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe380035b0 con 0x7fbe38005210 2024-05-08T21:18:54.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.723+0000 7fbe4e59c700 1 --2- 172.21.15.80:0/1359332787 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbe38003a00 0x7fbe38003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:18:54.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.723+0000 7fbe4ed9d700 1 -- 172.21.15.80:0/1359332787 reap_dead start 2024-05-08T21:18:54.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.723+0000 7fbe4ed9d700 1 --2- 172.21.15.80:0/1359332787 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe38005210 0x7fbe3800ba10 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fbe4800c190 tx=0x7fbe38005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daec59e8ba57a967 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:18:54.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.723+0000 7fbe4d59a700 1 -- 172.21.15.80:0/1359332787 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe48001db0 con 0x7fbe38005210 2024-05-08T21:18:54.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.723+0000 7fbe4d59a700 1 -- 172.21.15.80:0/1359332787 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe4800ccf0 con 0x7fbe38005210 2024-05-08T21:18:54.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.723+0000 7fbe4d59a700 1 -- 172.21.15.80:0/1359332787 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe48003c40 con 0x7fbe38005210 2024-05-08T21:18:54.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.724+0000 7fbe54c14700 1 -- 172.21.15.80:0/1359332787 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe38005210 msgr2=0x7fbe3800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:18:54.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.724+0000 7fbe54c14700 1 --2- 172.21.15.80:0/1359332787 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe38005210 0x7fbe3800ba10 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fbe4800c190 tx=0x7fbe38005880 comp rx=0 tx=0).stop 2024-05-08T21:18:54.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.724+0000 7fbe54c14700 1 -- 172.21.15.80:0/1359332787 shutdown_connections 2024-05-08T21:18:54.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.724+0000 7fbe54c14700 1 --2- 172.21.15.80:0/1359332787 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe38005210 0x7fbe3800ba10 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:18:54.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.724+0000 7fbe54c14700 1 -- 172.21.15.80:0/1359332787 >> 172.21.15.80:0/1359332787 conn(0x7fbe5006f140 msgr2=0x7fbe5006f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:18:54.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.724+0000 7fbe54c14700 1 -- 172.21.15.80:0/1359332787 shutdown_connections 2024-05-08T21:18:54.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.724+0000 7fbe54c14700 1 -- 172.21.15.80:0/1359332787 wait complete. 2024-05-08T21:18:54.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.725+0000 7fbe54c14700 1 Processor -- start 2024-05-08T21:18:54.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.725+0000 7fbe54c14700 1 -- start start 2024-05-08T21:18:54.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.726+0000 7fbe54c14700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbe38005210 0x7fbe5014f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:18:54.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.726+0000 7fbe54c14700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe5015b040 0x7fbe500c69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:18:54.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.726+0000 7fbe54c14700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbe5014b7f0 0x7fbe5014bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:18:54.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.726+0000 7fbe54c14700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe50149160 con 0x7fbe5015b040 2024-05-08T21:18:54.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.726+0000 7fbe54c14700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5014c1b0 con 0x7fbe38005210 2024-05-08T21:18:54.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.726+0000 7fbe54c14700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe501f0c10 con 0x7fbe5014b7f0 2024-05-08T21:18:54.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.726+0000 7fbe4dd9b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe5015b040 0x7fbe500c69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:18:54.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.726+0000 7fbe4dd9b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe5015b040 0x7fbe500c69a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43640/0 (socket says 172.21.15.80:43640) 2024-05-08T21:18:54.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.726+0000 7fbe4dd9b700 1 -- 172.21.15.80:0/1703674032 learned_addr learned my addr 172.21.15.80:0/1703674032 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:18:54.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.726+0000 7fbe4ed9d700 1 --2- 172.21.15.80:0/1703674032 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbe5014b7f0 0x7fbe5014bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:18:54.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.726+0000 7fbe4e59c700 1 --2- 172.21.15.80:0/1703674032 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbe38005210 0x7fbe5014f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:18:54.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.726+0000 7fbe4dd9b700 1 -- 172.21.15.80:0/1703674032 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbe5014b7f0 msgr2=0x7fbe5014bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:18:54.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.726+0000 7fbe4dd9b700 1 --2- 172.21.15.80:0/1703674032 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbe5014b7f0 0x7fbe5014bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:18:54.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.726+0000 7fbe4dd9b700 1 -- 172.21.15.80:0/1703674032 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbe38005210 msgr2=0x7fbe5014f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:18:54.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.726+0000 7fbe4dd9b700 1 --2- 172.21.15.80:0/1703674032 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbe38005210 0x7fbe5014f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:18:54.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.726+0000 7fbe4dd9b700 1 -- 172.21.15.80:0/1703674032 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe501f0ef0 con 0x7fbe5015b040 2024-05-08T21:18:54.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.726+0000 7fbe4dd9b700 1 --2- 172.21.15.80:0/1703674032 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe5015b040 0x7fbe500c69a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fbe440072c0 tx=0x7fbe440075d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:18:54.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.727+0000 7fbe3effd700 1 -- 172.21.15.80:0/1703674032 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4400f5c0 con 0x7fbe5015b040 2024-05-08T21:18:54.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.727+0000 7fbe3effd700 1 -- 172.21.15.80:0/1703674032 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe4400f760 con 0x7fbe5015b040 2024-05-08T21:18:54.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.727+0000 7fbe54c14700 1 -- 172.21.15.80:0/1703674032 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe501f11d0 con 0x7fbe5015b040 2024-05-08T21:18:54.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.727+0000 7fbe3effd700 1 -- 172.21.15.80:0/1703674032 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4400fb10 con 0x7fbe5015b040 2024-05-08T21:18:54.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.727+0000 7fbe54c14700 1 -- 172.21.15.80:0/1703674032 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe501f1790 con 0x7fbe5015b040 2024-05-08T21:18:54.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.728+0000 7fbe54c14700 1 -- 172.21.15.80:0/1703674032 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe501f1920 con 0x7fbe5015b040 2024-05-08T21:18:54.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.728+0000 7fbe3effd700 1 -- 172.21.15.80:0/1703674032 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbe4400fc70 con 0x7fbe5015b040 2024-05-08T21:18:54.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.729+0000 7fbe3effd700 1 --2- 172.21.15.80:0/1703674032 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fbe3006ac90 0x7fbe3006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:18:54.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.729+0000 7fbe3effd700 1 -- 172.21.15.80:0/1703674032 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6921+0+0 (secure 0 0 0) 0x7fbe44089650 con 0x7fbe5015b040 2024-05-08T21:18:54.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.729+0000 7fbe4e59c700 1 --2- 172.21.15.80:0/1703674032 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fbe3006ac90 0x7fbe3006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:18:54.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.729+0000 7fbe4e59c700 1 --2- 172.21.15.80:0/1703674032 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fbe3006ac90 0x7fbe3006d150 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbe40009d80 tx=0x7fbe40009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:18:54.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.733+0000 7fbe3effd700 1 -- 172.21.15.80:0/1703674032 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fbe44054370 con 0x7fbe5015b040 2024-05-08T21:18:54.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.977+0000 7fbe54c14700 1 -- 172.21.15.80:0/1703674032 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbe5004ec60 con 0x7fbe5015b040 2024-05-08T21:18:54.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.977+0000 7fbe3effd700 1 -- 172.21.15.80:0/1703674032 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+6252 (secure 0 0 0) 0x7fbe44057990 con 0x7fbe5015b040 2024-05-08T21:18:54.980 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:18:54.980 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":5158,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/959295764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":959295764},{"type":"v1","addr":"172.21.15.106:6836","nonce":959295764}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:17:38.557086+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5086},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5086":{"gid":5086,"name":"b","rank":0,"incarnation":21,"state":"up:active","state_seq":40,"addr":"172.21.15.106:6833/791920806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":791920806},{"type":"v1","addr":"172.21.15.106:6833","nonce":791920806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:18:54.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.979+0000 7fbe54c14700 1 -- 172.21.15.80:0/1703674032 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fbe3006ac90 msgr2=0x7fbe3006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:18:54.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.979+0000 7fbe54c14700 1 --2- 172.21.15.80:0/1703674032 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fbe3006ac90 0x7fbe3006d150 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbe40009d80 tx=0x7fbe40009210 comp rx=0 tx=0).stop 2024-05-08T21:18:54.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.979+0000 7fbe54c14700 1 -- 172.21.15.80:0/1703674032 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe5015b040 msgr2=0x7fbe500c69a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:18:54.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.979+0000 7fbe54c14700 1 --2- 172.21.15.80:0/1703674032 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe5015b040 0x7fbe500c69a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fbe440072c0 tx=0x7fbe440075d0 comp rx=0 tx=0).stop 2024-05-08T21:18:54.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.979+0000 7fbe54c14700 1 -- 172.21.15.80:0/1703674032 shutdown_connections 2024-05-08T21:18:54.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.979+0000 7fbe54c14700 1 --2- 172.21.15.80:0/1703674032 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fbe3006ac90 0x7fbe3006d150 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:18:54.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.979+0000 7fbe54c14700 1 --2- 172.21.15.80:0/1703674032 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbe5014b7f0 0x7fbe5014bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:18:54.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.979+0000 7fbe54c14700 1 --2- 172.21.15.80:0/1703674032 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbe38005210 0x7fbe5014f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:18:54.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.979+0000 7fbe54c14700 1 --2- 172.21.15.80:0/1703674032 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe5015b040 0x7fbe500c69a0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:18:54.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.979+0000 7fbe54c14700 1 -- 172.21.15.80:0/1703674032 >> 172.21.15.80:0/1703674032 conn(0x7fbe5006f140 msgr2=0x7fbe50156cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:18:54.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.979+0000 7fbe54c14700 1 -- 172.21.15.80:0/1703674032 shutdown_connections 2024-05-08T21:18:54.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:54.979+0000 7fbe54c14700 1 -- 172.21.15.80:0/1703674032 wait complete. 2024-05-08T21:18:54.983 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 25 2024-05-08T21:18:54.995 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-05-08T21:18:56.996 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:18:57.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.117+0000 7f5cfc722700 1 Processor -- start 2024-05-08T21:18:57.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.117+0000 7f5cfc722700 1 -- start start 2024-05-08T21:18:57.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.118+0000 7f5cfc722700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f5cf406c5d0 0x7f5cf406bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:18:57.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.118+0000 7f5cfc722700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5cf406c010 0x7f5cf415a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:18:57.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.118+0000 7f5cfc722700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cf415b290 con 0x7f5cf4154300 2024-05-08T21:18:57.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.118+0000 7f5cfc722700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cf415e7e0 con 0x7f5cf406c010 2024-05-08T21:18:57.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.118+0000 7f5cfc722700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cf415afb0 con 0x7f5cf406c5d0 2024-05-08T21:18:57.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.118+0000 7f5cfacbf700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5cf406c010 0x7f5cf415a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:18:57.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.118+0000 7f5cfa4be700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f5cf4154300 0x7f5cf40cc6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39736/0 (socket says 172.21.15.80:39736) 2024-05-08T21:18:57.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.118+0000 7f5cfa4be700 1 -- 172.21.15.80:0/3726092049 learned_addr learned my addr 172.21.15.80:0/3726092049 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:18:57.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.119+0000 7f5cfacbf700 1 -- 172.21.15.80:0/3726092049 >> v2:172.21.15.106:3300/0 conn(0x7f5cf406c5d0 msgr2=0x7f5cf406bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:18:57.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.119+0000 7f5cf9cbd700 1 --2- 172.21.15.80:0/3726092049 >> v2:172.21.15.106:3300/0 conn(0x7f5cf406c5d0 0x7f5cf406bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:18:57.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.119+0000 7f5cf94bc700 1 -- 172.21.15.80:0/3726092049 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2911653515 0 0) 0x7f5cf415b290 con 0x7f5cf4154300 2024-05-08T21:18:57.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.119+0000 7f5cfacbf700 1 --2- 172.21.15.80:0/3726092049 >> v2:172.21.15.106:3300/0 conn(0x7f5cf406c5d0 0x7f5cf406bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:18:57.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.119+0000 7f5cfacbf700 1 -- 172.21.15.80:0/3726092049 >> v1:172.21.15.80:6789/0 conn(0x7f5cf4154300 legacy=0x7f5cf40cc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:18:57.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.119+0000 7f5cfacbf700 1 -- 172.21.15.80:0/3726092049 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf415da20 con 0x7f5cf406c010 2024-05-08T21:18:57.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.119+0000 7f5cfacbf700 1 --2- 172.21.15.80:0/3726092049 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5cf406c010 0x7f5cf415a300 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f5cf406f570 tx=0x7f5cec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5eff611a24b817e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:18:57.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.119+0000 7f5cf94bc700 1 -- 172.21.15.80:0/3726092049 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cec00e070 con 0x7f5cf406c010 2024-05-08T21:18:57.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.119+0000 7f5cf94bc700 1 -- 172.21.15.80:0/3726092049 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cec00bbd0 con 0x7f5cf406c010 2024-05-08T21:18:57.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.119+0000 7f5cf94bc700 1 -- 172.21.15.80:0/3726092049 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cec012430 con 0x7f5cf406c010 2024-05-08T21:18:57.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.119+0000 7f5cfc722700 1 -- 172.21.15.80:0/3726092049 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5cf406c010 msgr2=0x7f5cf415a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:18:57.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.119+0000 7f5cfc722700 1 --2- 172.21.15.80:0/3726092049 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5cf406c010 0x7f5cf415a300 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f5cf406f570 tx=0x7f5cec00b330 comp rx=0 tx=0).stop 2024-05-08T21:18:57.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.119+0000 7f5cfc722700 1 -- 172.21.15.80:0/3726092049 shutdown_connections 2024-05-08T21:18:57.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.119+0000 7f5cfc722700 1 --2- 172.21.15.80:0/3726092049 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5cf406c010 0x7f5cf415a300 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:18:57.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.119+0000 7f5cfc722700 1 --2- 172.21.15.80:0/3726092049 >> v2:172.21.15.106:3300/0 conn(0x7f5cf406c5d0 0x7f5cf406bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:18:57.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.119+0000 7f5cfc722700 1 -- 172.21.15.80:0/3726092049 >> 172.21.15.80:0/3726092049 conn(0x7f5cf4066780 msgr2=0x7f5cf4066b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:18:57.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.119+0000 7f5cfc722700 1 -- 172.21.15.80:0/3726092049 shutdown_connections 2024-05-08T21:18:57.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.119+0000 7f5cfc722700 1 -- 172.21.15.80:0/3726092049 wait complete. 2024-05-08T21:18:57.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.121+0000 7f5cfc722700 1 Processor -- start 2024-05-08T21:18:57.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.121+0000 7f5cfc722700 1 -- start start 2024-05-08T21:18:57.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.121+0000 7f5cfc722700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5cf406c010 0x7f5cf4157690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:18:57.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.121+0000 7f5cfc722700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5cf406c5d0 0x7f5cf4156ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:18:57.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.121+0000 7f5cfc722700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5cf4154300 0x7f5cf4152b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:18:57.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.121+0000 7f5cfc722700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf4157d40 con 0x7f5cf406c010 2024-05-08T21:18:57.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.121+0000 7f5cfc722700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf4156ff0 con 0x7f5cf406c5d0 2024-05-08T21:18:57.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.121+0000 7f5cfc722700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf40ca530 con 0x7f5cf4154300 2024-05-08T21:18:57.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.121+0000 7f5cfa4be700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5cf406c010 0x7f5cf4157690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:18:57.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.121+0000 7f5cfa4be700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5cf406c010 0x7f5cf4157690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43656/0 (socket says 172.21.15.80:43656) 2024-05-08T21:18:57.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.121+0000 7f5cfa4be700 1 -- 172.21.15.80:0/2412292825 learned_addr learned my addr 172.21.15.80:0/2412292825 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:18:57.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.122+0000 7f5cf9cbd700 1 --2- 172.21.15.80:0/2412292825 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5cf406c5d0 0x7f5cf4156ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:18:57.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.122+0000 7f5cfacbf700 1 --2- 172.21.15.80:0/2412292825 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5cf4154300 0x7f5cf4152b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:18:57.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.122+0000 7f5cfa4be700 1 -- 172.21.15.80:0/2412292825 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5cf4154300 msgr2=0x7f5cf4152b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:18:57.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.122+0000 7f5cfa4be700 1 --2- 172.21.15.80:0/2412292825 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5cf4154300 0x7f5cf4152b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:18:57.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.122+0000 7f5cfa4be700 1 -- 172.21.15.80:0/2412292825 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5cf406c5d0 msgr2=0x7f5cf4156ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:18:57.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.122+0000 7f5cfa4be700 1 --2- 172.21.15.80:0/2412292825 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5cf406c5d0 0x7f5cf4156ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:18:57.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.122+0000 7f5cfa4be700 1 -- 172.21.15.80:0/2412292825 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cec009a70 con 0x7f5cf406c010 2024-05-08T21:18:57.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.122+0000 7f5cfa4be700 1 --2- 172.21.15.80:0/2412292825 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5cf406c010 0x7f5cf4157690 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f5ce800c550 tx=0x7f5ce800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:18:57.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.122+0000 7f5ce6ffd700 1 -- 172.21.15.80:0/2412292825 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce8004c80 con 0x7f5cf406c010 2024-05-08T21:18:57.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.122+0000 7f5ce6ffd700 1 -- 172.21.15.80:0/2412292825 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ce8004e00 con 0x7f5cf406c010 2024-05-08T21:18:57.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.122+0000 7f5ce6ffd700 1 -- 172.21.15.80:0/2412292825 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce8007310 con 0x7f5cf406c010 2024-05-08T21:18:57.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.122+0000 7f5cfc722700 1 -- 172.21.15.80:0/2412292825 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cf40ca810 con 0x7f5cf406c010 2024-05-08T21:18:57.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.122+0000 7f5cfc722700 1 -- 172.21.15.80:0/2412292825 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cf40cadd0 con 0x7f5cf406c010 2024-05-08T21:18:57.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.123+0000 7f5cfc722700 1 -- 172.21.15.80:0/2412292825 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cf404ec60 con 0x7f5cf406c010 2024-05-08T21:18:57.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.123+0000 7f5ce6ffd700 1 -- 172.21.15.80:0/2412292825 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5ce8007470 con 0x7f5cf406c010 2024-05-08T21:18:57.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.124+0000 7f5ce6ffd700 1 --2- 172.21.15.80:0/2412292825 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f5cd806acc0 0x7f5cd806d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:18:57.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.124+0000 7f5ce6ffd700 1 -- 172.21.15.80:0/2412292825 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6921+0+0 (secure 0 0 0) 0x7f5ce8089430 con 0x7f5cf406c010 2024-05-08T21:18:57.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.124+0000 7f5cf9cbd700 1 --2- 172.21.15.80:0/2412292825 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f5cd806acc0 0x7f5cd806d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:18:57.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.124+0000 7f5cf9cbd700 1 --2- 172.21.15.80:0/2412292825 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f5cd806acc0 0x7f5cd806d180 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5cf415b670 tx=0x7f5cf0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:18:57.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.128+0000 7f5ce6ffd700 1 -- 172.21.15.80:0/2412292825 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f5ce80541e0 con 0x7f5cf406c010 2024-05-08T21:18:57.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.394+0000 7f5cfc722700 1 -- 172.21.15.80:0/2412292825 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5cf40cb980 con 0x7f5cf406c010 2024-05-08T21:18:57.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.394+0000 7f5ce6ffd700 1 -- 172.21.15.80:0/2412292825 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+6252 (secure 0 0 0) 0x7f5ce8057800 con 0x7f5cf406c010 2024-05-08T21:18:57.397 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:18:57.397 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":5158,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/959295764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":959295764},{"type":"v1","addr":"172.21.15.106:6836","nonce":959295764}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:17:38.557086+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5086},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5086":{"gid":5086,"name":"b","rank":0,"incarnation":21,"state":"up:active","state_seq":40,"addr":"172.21.15.106:6833/791920806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":791920806},{"type":"v1","addr":"172.21.15.106:6833","nonce":791920806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:18:57.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.396+0000 7f5cfc722700 1 -- 172.21.15.80:0/2412292825 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f5cd806acc0 msgr2=0x7f5cd806d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:18:57.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.396+0000 7f5cfc722700 1 --2- 172.21.15.80:0/2412292825 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f5cd806acc0 0x7f5cd806d180 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5cf415b670 tx=0x7f5cf0008040 comp rx=0 tx=0).stop 2024-05-08T21:18:57.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.396+0000 7f5cfc722700 1 -- 172.21.15.80:0/2412292825 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5cf406c010 msgr2=0x7f5cf4157690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:18:57.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.396+0000 7f5cfc722700 1 --2- 172.21.15.80:0/2412292825 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5cf406c010 0x7f5cf4157690 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f5ce800c550 tx=0x7f5ce800c910 comp rx=0 tx=0).stop 2024-05-08T21:18:57.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.396+0000 7f5cfc722700 1 -- 172.21.15.80:0/2412292825 shutdown_connections 2024-05-08T21:18:57.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.396+0000 7f5cfc722700 1 --2- 172.21.15.80:0/2412292825 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f5cd806acc0 0x7f5cd806d180 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:18:57.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.396+0000 7f5cfc722700 1 --2- 172.21.15.80:0/2412292825 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5cf406c010 0x7f5cf4157690 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:18:57.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.396+0000 7f5cfc722700 1 --2- 172.21.15.80:0/2412292825 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5cf4154300 0x7f5cf4152b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:18:57.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.396+0000 7f5cfc722700 1 --2- 172.21.15.80:0/2412292825 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5cf406c5d0 0x7f5cf4156ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:18:57.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.396+0000 7f5cfc722700 1 -- 172.21.15.80:0/2412292825 >> 172.21.15.80:0/2412292825 conn(0x7f5cf4066780 msgr2=0x7f5cf40c52a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:18:57.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.396+0000 7f5cfc722700 1 -- 172.21.15.80:0/2412292825 shutdown_connections 2024-05-08T21:18:57.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:57.396+0000 7f5cfc722700 1 -- 172.21.15.80:0/2412292825 wait complete. 2024-05-08T21:18:57.401 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 25 2024-05-08T21:18:57.412 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-05-08T21:18:59.413 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:18:59.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.535+0000 7f7f49f14700 1 Processor -- start 2024-05-08T21:18:59.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.535+0000 7f7f49f14700 1 -- start start 2024-05-08T21:18:59.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.536+0000 7f7f49f14700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7f44072d80 0x7f7f44073210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:18:59.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.536+0000 7f7f49f14700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7f440cbba0 0x7f7f440cbff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:18:59.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.536+0000 7f7f49f14700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f4415b6d0 con 0x7f7f441520b0 2024-05-08T21:18:59.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.536+0000 7f7f49f14700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f440cc530 con 0x7f7f44072d80 2024-05-08T21:18:59.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.536+0000 7f7f49f14700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f441580e0 con 0x7f7f440cbba0 2024-05-08T21:18:59.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.536+0000 7f7f437fe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f7f441520b0 0x7f7f44158810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:39750/0 (socket says 172.21.15.80:39750) 2024-05-08T21:18:59.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.536+0000 7f7f437fe700 1 -- 172.21.15.80:0/4019943711 learned_addr learned my addr 172.21.15.80:0/4019943711 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:18:59.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.536+0000 7f7f43fff700 1 --2- 172.21.15.80:0/4019943711 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7f440cbba0 0x7f7f440cbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:18:59.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.536+0000 7f7f42ffd700 1 --2- 172.21.15.80:0/4019943711 >> v2:172.21.15.106:3300/0 conn(0x7f7f44072d80 0x7f7f44073210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:18:59.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.536+0000 7f7f427fc700 1 -- 172.21.15.80:0/4019943711 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 85289462 0 0) 0x7f7f4415b6d0 con 0x7f7f441520b0 2024-05-08T21:18:59.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.536+0000 7f7f427fc700 1 -- 172.21.15.80:0/4019943711 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f2c0035b0 con 0x7f7f441520b0 2024-05-08T21:18:59.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.536+0000 7f7f427fc700 1 -- 172.21.15.80:0/4019943711 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3852019023 0 0) 0x7f7f2c0035b0 con 0x7f7f441520b0 2024-05-08T21:18:59.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.537+0000 7f7f427fc700 1 -- 172.21.15.80:0/4019943711 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7f440cbba0 msgr2=0x7f7f440cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:18:59.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.537+0000 7f7f427fc700 1 --2- 172.21.15.80:0/4019943711 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7f440cbba0 0x7f7f440cbff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:18:59.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.537+0000 7f7f427fc700 1 -- 172.21.15.80:0/4019943711 >> v2:172.21.15.106:3300/0 conn(0x7f7f44072d80 msgr2=0x7f7f44073210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:18:59.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.537+0000 7f7f427fc700 1 --2- 172.21.15.80:0/4019943711 >> v2:172.21.15.106:3300/0 conn(0x7f7f44072d80 0x7f7f44073210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:18:59.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.537+0000 7f7f427fc700 1 -- 172.21.15.80:0/4019943711 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f4415c650 con 0x7f7f441520b0 2024-05-08T21:18:59.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.537+0000 7f7f427fc700 1 -- 172.21.15.80:0/4019943711 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3520646302 0 0) 0x7f7f34001670 con 0x7f7f441520b0 2024-05-08T21:18:59.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.537+0000 7f7f42ffd700 1 --2- 172.21.15.80:0/4019943711 >> v2:172.21.15.106:3300/0 conn(0x7f7f44072d80 0x7f7f44073210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:18:59.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.537+0000 7f7f43fff700 1 --2- 172.21.15.80:0/4019943711 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7f440cbba0 0x7f7f440cbff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:18:59.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.537+0000 7f7f427fc700 1 -- 172.21.15.80:0/4019943711 >> v1:172.21.15.80:6789/0 conn(0x7f7f441520b0 legacy=0x7f7f44158810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:18:59.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.537+0000 7f7f427fc700 1 --2- 172.21.15.80:0/4019943711 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7f440cbba0 0x7f7f2c003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:18:59.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.537+0000 7f7f427fc700 1 --2- 172.21.15.80:0/4019943711 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7f2c003f40 0x7f7f2c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:18:59.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.537+0000 7f7f427fc700 1 --2- 172.21.15.80:0/4019943711 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7f2c004d90 0x7f7f2c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:18:59.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.537+0000 7f7f427fc700 1 -- 172.21.15.80:0/4019943711 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f441580e0 con 0x7f7f2c004d90 2024-05-08T21:18:59.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.537+0000 7f7f427fc700 1 -- 172.21.15.80:0/4019943711 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2c00ba10 con 0x7f7f2c003f40 2024-05-08T21:18:59.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.537+0000 7f7f427fc700 1 -- 172.21.15.80:0/4019943711 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2c00bb50 con 0x7f7f440cbba0 2024-05-08T21:18:59.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.537+0000 7f7f43fff700 1 --2- 172.21.15.80:0/4019943711 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7f2c004d90 0x7f7f2c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:18:59.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.537+0000 7f7f437fe700 1 --2- 172.21.15.80:0/4019943711 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7f440cbba0 0x7f7f2c003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:18:59.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.537+0000 7f7f42ffd700 1 --2- 172.21.15.80:0/4019943711 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7f2c003f40 0x7f7f2c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:18:59.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.537+0000 7f7f43fff700 1 -- 172.21.15.80:0/4019943711 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7f440cbba0 msgr2=0x7f7f2c003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:18:59.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.537+0000 7f7f43fff700 1 --2- 172.21.15.80:0/4019943711 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7f440cbba0 0x7f7f2c003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:18:59.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.537+0000 7f7f43fff700 1 -- 172.21.15.80:0/4019943711 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7f2c003f40 msgr2=0x7f7f2c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:18:59.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.537+0000 7f7f43fff700 1 --2- 172.21.15.80:0/4019943711 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7f2c003f40 0x7f7f2c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:18:59.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.537+0000 7f7f43fff700 1 -- 172.21.15.80:0/4019943711 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f3c009a70 con 0x7f7f2c004d90 2024-05-08T21:18:59.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.537+0000 7f7f43fff700 1 --2- 172.21.15.80:0/4019943711 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7f2c004d90 0x7f7f2c005210 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c00e380 tx=0x7f7f2c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b151a08f86c49b0e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:18:59.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.537+0000 7f7f427fc700 1 -- 172.21.15.80:0/4019943711 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c00ee20 con 0x7f7f2c004d90 2024-05-08T21:18:59.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.537+0000 7f7f427fc700 1 -- 172.21.15.80:0/4019943711 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f3c00f040 con 0x7f7f2c004d90 2024-05-08T21:18:59.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.537+0000 7f7f427fc700 1 -- 172.21.15.80:0/4019943711 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c0146a0 con 0x7f7f2c004d90 2024-05-08T21:18:59.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.538+0000 7f7f49f14700 1 -- 172.21.15.80:0/4019943711 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7f2c004d90 msgr2=0x7f7f2c005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:18:59.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.538+0000 7f7f49f14700 1 --2- 172.21.15.80:0/4019943711 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7f2c004d90 0x7f7f2c005210 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c00e380 tx=0x7f7f2c005880 comp rx=0 tx=0).stop 2024-05-08T21:18:59.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.538+0000 7f7f43fff700 1 -- 172.21.15.80:0/4019943711 reap_dead start 2024-05-08T21:18:59.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.538+0000 7f7f49f14700 1 -- 172.21.15.80:0/4019943711 shutdown_connections 2024-05-08T21:18:59.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.538+0000 7f7f49f14700 1 -- 172.21.15.80:0/4019943711 >> 172.21.15.80:0/4019943711 conn(0x7f7f44066780 msgr2=0x7f7f44066b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:18:59.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.538+0000 7f7f49f14700 1 -- 172.21.15.80:0/4019943711 shutdown_connections 2024-05-08T21:18:59.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.538+0000 7f7f49f14700 1 -- 172.21.15.80:0/4019943711 wait complete. 2024-05-08T21:18:59.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.540+0000 7f7f49f14700 1 Processor -- start 2024-05-08T21:18:59.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.540+0000 7f7f49f14700 1 -- start start 2024-05-08T21:18:59.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.541+0000 7f7f49f14700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7f44153410 0x7f7f441537f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:18:59.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.541+0000 7f7f49f14700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7f440c3ba0 0x7f7f4415b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:18:59.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.541+0000 7f7f49f14700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7f44153d30 0x7f7f4415b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:18:59.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.541+0000 7f7f49f14700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f4415ac20 con 0x7f7f44153d30 2024-05-08T21:18:59.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.541+0000 7f7f49f14700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f44155cf0 con 0x7f7f440c3ba0 2024-05-08T21:18:59.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.541+0000 7f7f49f14700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f44154f70 con 0x7f7f44153410 2024-05-08T21:18:59.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.541+0000 7f7f43fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7f44153d30 0x7f7f4415b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:18:59.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.541+0000 7f7f43fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7f44153d30 0x7f7f4415b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43670/0 (socket says 172.21.15.80:43670) 2024-05-08T21:18:59.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.541+0000 7f7f43fff700 1 -- 172.21.15.80:0/3579458563 learned_addr learned my addr 172.21.15.80:0/3579458563 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:18:59.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.541+0000 7f7f437fe700 1 --2- 172.21.15.80:0/3579458563 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7f44153410 0x7f7f441537f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:18:59.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.541+0000 7f7f42ffd700 1 --2- 172.21.15.80:0/3579458563 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7f440c3ba0 0x7f7f4415b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:18:59.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.541+0000 7f7f43fff700 1 -- 172.21.15.80:0/3579458563 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7f44153410 msgr2=0x7f7f441537f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:18:59.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.541+0000 7f7f43fff700 1 --2- 172.21.15.80:0/3579458563 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7f44153410 0x7f7f441537f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:18:59.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.542+0000 7f7f43fff700 1 -- 172.21.15.80:0/3579458563 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7f440c3ba0 msgr2=0x7f7f4415b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:18:59.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.542+0000 7f7f43fff700 1 --2- 172.21.15.80:0/3579458563 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7f440c3ba0 0x7f7f4415b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:18:59.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.542+0000 7f7f43fff700 1 -- 172.21.15.80:0/3579458563 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f441f1320 con 0x7f7f44153d30 2024-05-08T21:18:59.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.542+0000 7f7f43fff700 1 --2- 172.21.15.80:0/3579458563 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7f44153d30 0x7f7f4415b5b0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c00b010 tx=0x7f7f3c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:18:59.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.542+0000 7f7f2bfff700 1 -- 172.21.15.80:0/3579458563 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c007000 con 0x7f7f44153d30 2024-05-08T21:18:59.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.542+0000 7f7f2bfff700 1 -- 172.21.15.80:0/3579458563 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f3c009410 con 0x7f7f44153d30 2024-05-08T21:18:59.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.542+0000 7f7f49f14700 1 -- 172.21.15.80:0/3579458563 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f44155730 con 0x7f7f44153d30 2024-05-08T21:18:59.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.542+0000 7f7f2bfff700 1 -- 172.21.15.80:0/3579458563 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c01d420 con 0x7f7f44153d30 2024-05-08T21:18:59.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.542+0000 7f7f49f14700 1 -- 172.21.15.80:0/3579458563 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f4414fb30 con 0x7f7f44153d30 2024-05-08T21:18:59.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.543+0000 7f7f49f14700 1 -- 172.21.15.80:0/3579458563 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f4404ec60 con 0x7f7f44153d30 2024-05-08T21:18:59.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.544+0000 7f7f2bfff700 1 -- 172.21.15.80:0/3579458563 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7f3c01d580 con 0x7f7f44153d30 2024-05-08T21:18:59.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.544+0000 7f7f2bfff700 1 --2- 172.21.15.80:0/3579458563 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f7f3006ac90 0x7f7f3006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:18:59.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.544+0000 7f7f2bfff700 1 -- 172.21.15.80:0/3579458563 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6921+0+0 (secure 0 0 0) 0x7f7f3c08af70 con 0x7f7f44153d30 2024-05-08T21:18:59.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.544+0000 7f7f437fe700 1 --2- 172.21.15.80:0/3579458563 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f7f3006ac90 0x7f7f3006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:18:59.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.545+0000 7f7f437fe700 1 --2- 172.21.15.80:0/3579458563 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f7f3006ac90 0x7f7f3006d150 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7f340048d0 tx=0x7f7f34009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:18:59.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.552+0000 7f7f2bfff700 1 -- 172.21.15.80:0/3579458563 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f7f3c055c00 con 0x7f7f44153d30 2024-05-08T21:18:59.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.804+0000 7f7f49f14700 1 -- 172.21.15.80:0/3579458563 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7f440cb980 con 0x7f7f44153d30 2024-05-08T21:18:59.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.805+0000 7f7f2bfff700 1 -- 172.21.15.80:0/3579458563 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+6252 (secure 0 0 0) 0x7f7f3c059220 con 0x7f7f44153d30 2024-05-08T21:18:59.807 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:18:59.808 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":5158,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/959295764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":959295764},{"type":"v1","addr":"172.21.15.106:6836","nonce":959295764}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:17:38.557086+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5086},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5086":{"gid":5086,"name":"b","rank":0,"incarnation":21,"state":"up:active","state_seq":40,"addr":"172.21.15.106:6833/791920806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":791920806},{"type":"v1","addr":"172.21.15.106:6833","nonce":791920806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:18:59.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.807+0000 7f7f49f14700 1 -- 172.21.15.80:0/3579458563 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f7f3006ac90 msgr2=0x7f7f3006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:18:59.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.807+0000 7f7f49f14700 1 --2- 172.21.15.80:0/3579458563 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f7f3006ac90 0x7f7f3006d150 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7f340048d0 tx=0x7f7f34009040 comp rx=0 tx=0).stop 2024-05-08T21:18:59.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.807+0000 7f7f49f14700 1 -- 172.21.15.80:0/3579458563 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7f44153d30 msgr2=0x7f7f4415b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:18:59.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.807+0000 7f7f49f14700 1 --2- 172.21.15.80:0/3579458563 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7f44153d30 0x7f7f4415b5b0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c00b010 tx=0x7f7f3c009750 comp rx=0 tx=0).stop 2024-05-08T21:18:59.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.807+0000 7f7f49f14700 1 -- 172.21.15.80:0/3579458563 shutdown_connections 2024-05-08T21:18:59.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.807+0000 7f7f49f14700 1 --2- 172.21.15.80:0/3579458563 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f7f3006ac90 0x7f7f3006d150 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:18:59.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.807+0000 7f7f49f14700 1 --2- 172.21.15.80:0/3579458563 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7f44153d30 0x7f7f4415b5b0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:18:59.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.807+0000 7f7f49f14700 1 --2- 172.21.15.80:0/3579458563 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7f44153410 0x7f7f441537f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:18:59.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.807+0000 7f7f49f14700 1 --2- 172.21.15.80:0/3579458563 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7f440c3ba0 0x7f7f4415b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:18:59.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.807+0000 7f7f49f14700 1 -- 172.21.15.80:0/3579458563 >> 172.21.15.80:0/3579458563 conn(0x7f7f44066780 msgr2=0x7f7f441508a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:18:59.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.807+0000 7f7f49f14700 1 -- 172.21.15.80:0/3579458563 shutdown_connections 2024-05-08T21:18:59.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:18:59.807+0000 7f7f49f14700 1 -- 172.21.15.80:0/3579458563 wait complete. 2024-05-08T21:18:59.811 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 25 2024-05-08T21:18:59.822 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-05-08T21:19:01.822 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:19:01.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:01.994+0000 7f3c97b79700 1 Processor -- start 2024-05-08T21:19:01.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:01.994+0000 7f3c97b79700 1 -- start start 2024-05-08T21:19:01.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:01.995+0000 7f3c97b79700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3c900cbe40 0x7f3c9015abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:01.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:01.995+0000 7f3c97b79700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f3c900cc3d0 0x7f3c900cc800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:01.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:01.995+0000 7f3c97b79700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c900cad60 con 0x7f3c90154580 2024-05-08T21:19:01.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:01.995+0000 7f3c97b79700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c900b2c60 con 0x7f3c900cbe40 2024-05-08T21:19:01.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:01.995+0000 7f3c97b79700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c9015d750 con 0x7f3c900cc3d0 2024-05-08T21:19:01.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:01.995+0000 7f3c95114700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3c900cbe40 0x7f3c9015abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:01.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:01.995+0000 7f3c95114700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3c900cbe40 0x7f3c9015abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43682/0 (socket says 172.21.15.80:43682) 2024-05-08T21:19:01.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:01.995+0000 7f3c95114700 1 -- 172.21.15.80:0/4112352305 learned_addr learned my addr 172.21.15.80:0/4112352305 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:19:01.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:01.995+0000 7f3c96116700 1 --2- 172.21.15.80:0/4112352305 >> v2:172.21.15.106:3300/0 conn(0x7f3c900cc3d0 0x7f3c900cc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:02.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:01.995+0000 7f3c95114700 1 -- 172.21.15.80:0/4112352305 >> v2:172.21.15.106:3300/0 conn(0x7f3c900cc3d0 msgr2=0x7f3c900cc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:19:02.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:01.995+0000 7f3c95114700 1 --2- 172.21.15.80:0/4112352305 >> v2:172.21.15.106:3300/0 conn(0x7f3c900cc3d0 0x7f3c900cc800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:02.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:01.995+0000 7f3c95114700 1 -- 172.21.15.80:0/4112352305 >> v1:172.21.15.106:6789/0 conn(0x7f3c90154580 legacy=0x7f3c900c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:19:02.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:01.995+0000 7f3c95114700 1 -- 172.21.15.80:0/4112352305 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c9015d930 con 0x7f3c900cbe40 2024-05-08T21:19:02.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:01.996+0000 7f3c95114700 1 --2- 172.21.15.80:0/4112352305 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c900cbe40 0x7f3c9015abe0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f3c90073100 tx=0x7f3c80009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9db03822c1ac9069 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:02.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:01.996+0000 7f3c94913700 1 -- 172.21.15.80:0/4112352305 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c80004230 con 0x7f3c900cbe40 2024-05-08T21:19:02.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:01.996+0000 7f3c94913700 1 -- 172.21.15.80:0/4112352305 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c80004390 con 0x7f3c900cbe40 2024-05-08T21:19:02.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:01.996+0000 7f3c94913700 1 -- 172.21.15.80:0/4112352305 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c800036a0 con 0x7f3c900cbe40 2024-05-08T21:19:02.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:01.996+0000 7f3c97b79700 1 -- 172.21.15.80:0/4112352305 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c900cbe40 msgr2=0x7f3c9015abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:02.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:01.996+0000 7f3c97b79700 1 --2- 172.21.15.80:0/4112352305 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c900cbe40 0x7f3c9015abe0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f3c90073100 tx=0x7f3c80009c00 comp rx=0 tx=0).stop 2024-05-08T21:19:02.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:01.996+0000 7f3c97b79700 1 -- 172.21.15.80:0/4112352305 shutdown_connections 2024-05-08T21:19:02.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:01.996+0000 7f3c97b79700 1 --2- 172.21.15.80:0/4112352305 >> v2:172.21.15.106:3300/0 conn(0x7f3c900cc3d0 0x7f3c900cc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:02.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:01.996+0000 7f3c97b79700 1 --2- 172.21.15.80:0/4112352305 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c900cbe40 0x7f3c9015abe0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:02.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:01.996+0000 7f3c97b79700 1 -- 172.21.15.80:0/4112352305 >> 172.21.15.80:0/4112352305 conn(0x7f3c9006c6a0 msgr2=0x7f3c9006cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:02.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:01.996+0000 7f3c97b79700 1 -- 172.21.15.80:0/4112352305 shutdown_connections 2024-05-08T21:19:02.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:01.996+0000 7f3c97b79700 1 -- 172.21.15.80:0/4112352305 wait complete. 2024-05-08T21:19:02.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:01.998+0000 7f3c97b79700 1 Processor -- start 2024-05-08T21:19:02.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:01.998+0000 7f3c97b79700 1 -- start start 2024-05-08T21:19:02.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:01.999+0000 7f3c97b79700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c900cbe40 0x7f3c900c7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:02.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:01.999+0000 7f3c97b79700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3c900cc3d0 0x7f3c900cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:02.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:01.999+0000 7f3c97b79700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c90154580 0x7f3c901efd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:02.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:01.999+0000 7f3c97b79700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c900c8330 con 0x7f3c90154580 2024-05-08T21:19:02.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:01.999+0000 7f3c97b79700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c900ce5a0 con 0x7f3c900cbe40 2024-05-08T21:19:02.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:01.999+0000 7f3c97b79700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c90151710 con 0x7f3c900cc3d0 2024-05-08T21:19:02.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:01.999+0000 7f3c96116700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c90154580 0x7f3c901efd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:02.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:01.999+0000 7f3c96116700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c90154580 0x7f3c901efd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43690/0 (socket says 172.21.15.80:43690) 2024-05-08T21:19:02.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:01.999+0000 7f3c96116700 1 -- 172.21.15.80:0/187591304 learned_addr learned my addr 172.21.15.80:0/187591304 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:19:02.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:01.999+0000 7f3c95114700 1 --2- 172.21.15.80:0/187591304 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3c900cc3d0 0x7f3c900cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:02.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:01.999+0000 7f3c95915700 1 --2- 172.21.15.80:0/187591304 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c900cbe40 0x7f3c900c7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:02.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:01.999+0000 7f3c96116700 1 -- 172.21.15.80:0/187591304 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3c900cc3d0 msgr2=0x7f3c900cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:02.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:01.999+0000 7f3c96116700 1 --2- 172.21.15.80:0/187591304 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3c900cc3d0 0x7f3c900cdb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:02.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:01.999+0000 7f3c96116700 1 -- 172.21.15.80:0/187591304 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c900cbe40 msgr2=0x7f3c900c7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:02.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:01.999+0000 7f3c96116700 1 --2- 172.21.15.80:0/187591304 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c900cbe40 0x7f3c900c7df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:02.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:01.999+0000 7f3c96116700 1 -- 172.21.15.80:0/187591304 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c80009550 con 0x7f3c90154580 2024-05-08T21:19:02.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:01.999+0000 7f3c96116700 1 --2- 172.21.15.80:0/187591304 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c90154580 0x7f3c901efd40 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f3c88007e40 tx=0x7f3c8800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:02.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:01.999+0000 7f3c867fc700 1 -- 172.21.15.80:0/187591304 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c8800ed30 con 0x7f3c90154580 2024-05-08T21:19:02.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:01.999+0000 7f3c867fc700 1 -- 172.21.15.80:0/187591304 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c88014420 con 0x7f3c90154580 2024-05-08T21:19:02.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:01.999+0000 7f3c867fc700 1 -- 172.21.15.80:0/187591304 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c880147d0 con 0x7f3c90154580 2024-05-08T21:19:02.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:01.999+0000 7f3c97b79700 1 -- 172.21.15.80:0/187591304 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c900d0770 con 0x7f3c90154580 2024-05-08T21:19:02.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:02.000+0000 7f3c97b79700 1 -- 172.21.15.80:0/187591304 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c900ceac0 con 0x7f3c90154580 2024-05-08T21:19:02.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:02.000+0000 7f3c97b79700 1 -- 172.21.15.80:0/187591304 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c9006a110 con 0x7f3c90154580 2024-05-08T21:19:02.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:02.001+0000 7f3c867fc700 1 -- 172.21.15.80:0/187591304 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3c88014930 con 0x7f3c90154580 2024-05-08T21:19:02.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:02.001+0000 7f3c867fc700 1 --2- 172.21.15.80:0/187591304 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f3c7406ac90 0x7f3c7406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:02.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:02.002+0000 7f3c95915700 1 --2- 172.21.15.80:0/187591304 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f3c7406ac90 0x7f3c7406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:02.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:02.002+0000 7f3c867fc700 1 -- 172.21.15.80:0/187591304 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6921+0+0 (secure 0 0 0) 0x7f3c88089640 con 0x7f3c90154580 2024-05-08T21:19:02.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:02.002+0000 7f3c95915700 1 --2- 172.21.15.80:0/187591304 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f3c7406ac90 0x7f3c7406d150 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c009960 tx=0x7f3c8c0090e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:02.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:02.006+0000 7f3c867fc700 1 -- 172.21.15.80:0/187591304 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f3c8808e060 con 0x7f3c90154580 2024-05-08T21:19:02.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:02.255+0000 7f3c97b79700 1 -- 172.21.15.80:0/187591304 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3c9004ec60 con 0x7f3c90154580 2024-05-08T21:19:02.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:02.256+0000 7f3c867fc700 1 -- 172.21.15.80:0/187591304 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+6252 (secure 0 0 0) 0x7f3c88054360 con 0x7f3c90154580 2024-05-08T21:19:02.259 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:19:02.259 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":5158,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/959295764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":959295764},{"type":"v1","addr":"172.21.15.106:6836","nonce":959295764}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:17:38.557086+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5086},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5086":{"gid":5086,"name":"b","rank":0,"incarnation":21,"state":"up:active","state_seq":40,"addr":"172.21.15.106:6833/791920806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":791920806},{"type":"v1","addr":"172.21.15.106:6833","nonce":791920806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:19:02.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:02.258+0000 7f3c97b79700 1 -- 172.21.15.80:0/187591304 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f3c7406ac90 msgr2=0x7f3c7406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:02.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:02.258+0000 7f3c97b79700 1 --2- 172.21.15.80:0/187591304 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f3c7406ac90 0x7f3c7406d150 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c009960 tx=0x7f3c8c0090e0 comp rx=0 tx=0).stop 2024-05-08T21:19:02.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:02.258+0000 7f3c97b79700 1 -- 172.21.15.80:0/187591304 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c90154580 msgr2=0x7f3c901efd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:02.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:02.258+0000 7f3c97b79700 1 --2- 172.21.15.80:0/187591304 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c90154580 0x7f3c901efd40 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f3c88007e40 tx=0x7f3c8800e3c0 comp rx=0 tx=0).stop 2024-05-08T21:19:02.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:02.258+0000 7f3c97b79700 1 -- 172.21.15.80:0/187591304 shutdown_connections 2024-05-08T21:19:02.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:02.258+0000 7f3c97b79700 1 --2- 172.21.15.80:0/187591304 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f3c7406ac90 0x7f3c7406d150 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:02.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:02.258+0000 7f3c97b79700 1 --2- 172.21.15.80:0/187591304 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c90154580 0x7f3c901efd40 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:02.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:02.258+0000 7f3c97b79700 1 --2- 172.21.15.80:0/187591304 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c900cbe40 0x7f3c900c7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:02.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:02.258+0000 7f3c97b79700 1 --2- 172.21.15.80:0/187591304 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3c900cc3d0 0x7f3c900cdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:02.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:02.258+0000 7f3c97b79700 1 -- 172.21.15.80:0/187591304 >> 172.21.15.80:0/187591304 conn(0x7f3c9006c6a0 msgr2=0x7f3c900c48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:02.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:02.258+0000 7f3c97b79700 1 -- 172.21.15.80:0/187591304 shutdown_connections 2024-05-08T21:19:02.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:02.258+0000 7f3c97b79700 1 -- 172.21.15.80:0/187591304 wait complete. 2024-05-08T21:19:02.262 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 25 2024-05-08T21:19:02.273 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-05-08T21:19:04.275 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:19:04.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.398+0000 7fa4fa38b700 1 Processor -- start 2024-05-08T21:19:04.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.398+0000 7fa4fa38b700 1 -- start start 2024-05-08T21:19:04.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.399+0000 7fa4fa38b700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa4f406ac30 0x7fa4f4158600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:04.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.399+0000 7fa4fa38b700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4f40c6100 con 0x7fa4f41523a0 2024-05-08T21:19:04.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.399+0000 7fa4fa38b700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4f40c6350 con 0x7fa4f406b010 2024-05-08T21:19:04.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.399+0000 7fa4fa38b700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4f40c6ed0 con 0x7fa4f406ac30 2024-05-08T21:19:04.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.399+0000 7fa4f8928700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fa4f41523a0 0x7fa4f40c9960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42026/0 (socket says 172.21.15.80:42026) 2024-05-08T21:19:04.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.399+0000 7fa4f8928700 1 -- 172.21.15.80:0/3414249469 learned_addr learned my addr 172.21.15.80:0/3414249469 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:19:04.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.399+0000 7fa4f3fff700 1 --2- 172.21.15.80:0/3414249469 >> v2:172.21.15.106:3300/0 conn(0x7fa4f406ac30 0x7fa4f4158600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:04.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.399+0000 7fa4f2ffd700 1 -- 172.21.15.80:0/3414249469 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3233635499 0 0) 0x7fa4f40c6100 con 0x7fa4f41523a0 2024-05-08T21:19:04.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.399+0000 7fa4f2ffd700 1 -- 172.21.15.80:0/3414249469 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4dc0035b0 con 0x7fa4f41523a0 2024-05-08T21:19:04.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.400+0000 7fa4f2ffd700 1 -- 172.21.15.80:0/3414249469 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 147839979 0 0) 0x7fa4dc0035b0 con 0x7fa4f41523a0 2024-05-08T21:19:04.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.400+0000 7fa4f2ffd700 1 -- 172.21.15.80:0/3414249469 >> v2:172.21.15.106:3300/0 conn(0x7fa4f406ac30 msgr2=0x7fa4f4158600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:19:04.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.400+0000 7fa4f2ffd700 1 --2- 172.21.15.80:0/3414249469 >> v2:172.21.15.106:3300/0 conn(0x7fa4f406ac30 0x7fa4f4158600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:04.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.400+0000 7fa4f2ffd700 1 -- 172.21.15.80:0/3414249469 >> v1:172.21.15.106:6789/0 conn(0x7fa4f406b010 legacy=0x7fa4f4151c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:04.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.400+0000 7fa4f2ffd700 1 -- 172.21.15.80:0/3414249469 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4f40c6630 con 0x7fa4f41523a0 2024-05-08T21:19:04.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.400+0000 7fa4f2ffd700 1 -- 172.21.15.80:0/3414249469 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3520646302 0 0) 0x7fa4ec0019f0 con 0x7fa4f41523a0 2024-05-08T21:19:04.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.400+0000 7fa4f2ffd700 1 -- 172.21.15.80:0/3414249469 >> v1:172.21.15.80:6789/0 conn(0x7fa4f41523a0 legacy=0x7fa4f40c9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:04.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.400+0000 7fa4f2ffd700 1 --2- 172.21.15.80:0/3414249469 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4dc003a00 0x7fa4dc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:04.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.400+0000 7fa4f2ffd700 1 --2- 172.21.15.80:0/3414249469 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa4dc004850 0x7fa4dc004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:04.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.400+0000 7fa4f2ffd700 1 --2- 172.21.15.80:0/3414249469 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa4dc005210 0x7fa4dc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:04.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.400+0000 7fa4f2ffd700 1 -- 172.21.15.80:0/3414249469 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f40c6ed0 con 0x7fa4dc003a00 2024-05-08T21:19:04.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.400+0000 7fa4f2ffd700 1 -- 172.21.15.80:0/3414249469 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4dc00c0c0 con 0x7fa4dc005210 2024-05-08T21:19:04.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.400+0000 7fa4f3fff700 1 --2- 172.21.15.80:0/3414249469 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4dc003a00 0x7fa4dc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:04.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.400+0000 7fa4f2ffd700 1 -- 172.21.15.80:0/3414249469 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4dc00c280 con 0x7fa4dc004850 2024-05-08T21:19:04.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.400+0000 7fa4f8928700 1 --2- 172.21.15.80:0/3414249469 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa4dc005210 0x7fa4dc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:04.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.400+0000 7fa4f37fe700 1 --2- 172.21.15.80:0/3414249469 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa4dc004850 0x7fa4dc004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:04.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.400+0000 7fa4f3fff700 1 -- 172.21.15.80:0/3414249469 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa4dc004850 msgr2=0x7fa4dc004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:19:04.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.400+0000 7fa4f3fff700 1 --2- 172.21.15.80:0/3414249469 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa4dc004850 0x7fa4dc004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:04.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.400+0000 7fa4f3fff700 1 -- 172.21.15.80:0/3414249469 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa4dc005210 msgr2=0x7fa4dc00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:19:04.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.400+0000 7fa4f3fff700 1 --2- 172.21.15.80:0/3414249469 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa4dc005210 0x7fa4dc00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:04.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.400+0000 7fa4f3fff700 1 -- 172.21.15.80:0/3414249469 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4dc0035b0 con 0x7fa4dc003a00 2024-05-08T21:19:04.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.400+0000 7fa4f8928700 1 --2- 172.21.15.80:0/3414249469 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa4dc005210 0x7fa4dc00ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:19:04.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.400+0000 7fa4f8928700 1 -- 172.21.15.80:0/3414249469 reap_dead start 2024-05-08T21:19:04.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.400+0000 7fa4f3fff700 1 --2- 172.21.15.80:0/3414249469 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4dc003a00 0x7fa4dc003e20 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fa4e8009b60 tx=0x7fa4dc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e998a13ea0a86d2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:04.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.400+0000 7fa4f2ffd700 1 -- 172.21.15.80:0/3414249469 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e800e6c0 con 0x7fa4dc003a00 2024-05-08T21:19:04.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.400+0000 7fa4f2ffd700 1 -- 172.21.15.80:0/3414249469 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4e800e820 con 0x7fa4dc003a00 2024-05-08T21:19:04.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.400+0000 7fa4f2ffd700 1 -- 172.21.15.80:0/3414249469 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e800eb90 con 0x7fa4dc003a00 2024-05-08T21:19:04.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.401+0000 7fa4fa38b700 1 -- 172.21.15.80:0/3414249469 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4dc003a00 msgr2=0x7fa4dc003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:04.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.401+0000 7fa4fa38b700 1 --2- 172.21.15.80:0/3414249469 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4dc003a00 0x7fa4dc003e20 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fa4e8009b60 tx=0x7fa4dc005880 comp rx=0 tx=0).stop 2024-05-08T21:19:04.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.401+0000 7fa4fa38b700 1 -- 172.21.15.80:0/3414249469 shutdown_connections 2024-05-08T21:19:04.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.401+0000 7fa4fa38b700 1 --2- 172.21.15.80:0/3414249469 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4dc003a00 0x7fa4dc003e20 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:04.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.401+0000 7fa4fa38b700 1 -- 172.21.15.80:0/3414249469 >> 172.21.15.80:0/3414249469 conn(0x7fa4f406f140 msgr2=0x7fa4f406f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:04.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.401+0000 7fa4fa38b700 1 -- 172.21.15.80:0/3414249469 shutdown_connections 2024-05-08T21:19:04.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.401+0000 7fa4fa38b700 1 -- 172.21.15.80:0/3414249469 wait complete. 2024-05-08T21:19:04.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.402+0000 7fa4fa38b700 1 Processor -- start 2024-05-08T21:19:04.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.402+0000 7fa4fa38b700 1 -- start start 2024-05-08T21:19:04.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.403+0000 7fa4fa38b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4dc003a00 0x7fa4f40cd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:04.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.403+0000 7fa4fa38b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa4f41ee5a0 0x7fa4f4159a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:04.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.403+0000 7fa4fa38b700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa4f40cb810 0x7fa4f40c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:04.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.403+0000 7fa4fa38b700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f40cbc90 con 0x7fa4dc003a00 2024-05-08T21:19:04.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.403+0000 7fa4fa38b700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f415a690 con 0x7fa4f41ee5a0 2024-05-08T21:19:04.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.403+0000 7fa4fa38b700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f4149140 con 0x7fa4f40cb810 2024-05-08T21:19:04.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.403+0000 7fa4f3fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4dc003a00 0x7fa4f40cd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:04.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.403+0000 7fa4f3fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4dc003a00 0x7fa4f40cd4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34420/0 (socket says 172.21.15.80:34420) 2024-05-08T21:19:04.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.403+0000 7fa4f3fff700 1 -- 172.21.15.80:0/119281609 learned_addr learned my addr 172.21.15.80:0/119281609 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:19:04.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.403+0000 7fa4f3fff700 1 -- 172.21.15.80:0/119281609 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa4f40cb810 msgr2=0x7fa4f40c89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:04.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.403+0000 7fa4f3fff700 1 --2- 172.21.15.80:0/119281609 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa4f40cb810 0x7fa4f40c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:04.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.403+0000 7fa4f3fff700 1 -- 172.21.15.80:0/119281609 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa4f41ee5a0 msgr2=0x7fa4f4159a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:04.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.403+0000 7fa4f3fff700 1 --2- 172.21.15.80:0/119281609 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa4f41ee5a0 0x7fa4f4159a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:04.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.403+0000 7fa4f3fff700 1 -- 172.21.15.80:0/119281609 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4f415a0d0 con 0x7fa4dc003a00 2024-05-08T21:19:04.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.403+0000 7fa4f3fff700 1 --2- 172.21.15.80:0/119281609 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4dc003a00 0x7fa4f40cd4e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc00c090 tx=0x7fa4e80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:04.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.403+0000 7fa4f0ff9700 1 -- 172.21.15.80:0/119281609 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e800e6c0 con 0x7fa4dc003a00 2024-05-08T21:19:04.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.403+0000 7fa4f0ff9700 1 -- 172.21.15.80:0/119281609 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4e8003ad0 con 0x7fa4dc003a00 2024-05-08T21:19:04.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.403+0000 7fa4fa38b700 1 -- 172.21.15.80:0/119281609 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4f415a3b0 con 0x7fa4dc003a00 2024-05-08T21:19:04.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.403+0000 7fa4f0ff9700 1 -- 172.21.15.80:0/119281609 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e80045d0 con 0x7fa4dc003a00 2024-05-08T21:19:04.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.404+0000 7fa4fa38b700 1 -- 172.21.15.80:0/119281609 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4f41edda0 con 0x7fa4dc003a00 2024-05-08T21:19:04.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.404+0000 7fa4fa38b700 1 -- 172.21.15.80:0/119281609 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4f40cbc30 con 0x7fa4dc003a00 2024-05-08T21:19:04.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.405+0000 7fa4f0ff9700 1 -- 172.21.15.80:0/119281609 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa4e8013470 con 0x7fa4dc003a00 2024-05-08T21:19:04.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.405+0000 7fa4f0ff9700 1 --2- 172.21.15.80:0/119281609 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fa4e006ac90 0x7fa4e006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:04.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.405+0000 7fa4f0ff9700 1 -- 172.21.15.80:0/119281609 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6921+0+0 (secure 0 0 0) 0x7fa4e808af40 con 0x7fa4dc003a00 2024-05-08T21:19:04.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.405+0000 7fa4f37fe700 1 --2- 172.21.15.80:0/119281609 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fa4e006ac90 0x7fa4e006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:04.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.406+0000 7fa4f37fe700 1 --2- 172.21.15.80:0/119281609 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fa4e006ac90 0x7fa4e006d150 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa4f415c550 tx=0x7fa4e4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:04.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.410+0000 7fa4f0ff9700 1 -- 172.21.15.80:0/119281609 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fa4f40cbc30 con 0x7fa4dc003a00 2024-05-08T21:19:04.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.657+0000 7fa4fa38b700 1 -- 172.21.15.80:0/119281609 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa4f41580a0 con 0x7fa4dc003a00 2024-05-08T21:19:04.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.658+0000 7fa4f0ff9700 1 -- 172.21.15.80:0/119281609 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+6252 (secure 0 0 0) 0x7fa4e8017020 con 0x7fa4dc003a00 2024-05-08T21:19:04.660 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:19:04.661 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":5158,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/959295764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":959295764},{"type":"v1","addr":"172.21.15.106:6836","nonce":959295764}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:17:38.557086+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5086},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5086":{"gid":5086,"name":"b","rank":0,"incarnation":21,"state":"up:active","state_seq":40,"addr":"172.21.15.106:6833/791920806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":791920806},{"type":"v1","addr":"172.21.15.106:6833","nonce":791920806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:19:04.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.660+0000 7fa4fa38b700 1 -- 172.21.15.80:0/119281609 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fa4e006ac90 msgr2=0x7fa4e006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:04.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.660+0000 7fa4fa38b700 1 --2- 172.21.15.80:0/119281609 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fa4e006ac90 0x7fa4e006d150 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa4f415c550 tx=0x7fa4e4009040 comp rx=0 tx=0).stop 2024-05-08T21:19:04.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.660+0000 7fa4fa38b700 1 -- 172.21.15.80:0/119281609 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4dc003a00 msgr2=0x7fa4f40cd4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:04.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.660+0000 7fa4fa38b700 1 --2- 172.21.15.80:0/119281609 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4dc003a00 0x7fa4f40cd4e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc00c090 tx=0x7fa4e80047c0 comp rx=0 tx=0).stop 2024-05-08T21:19:04.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.660+0000 7fa4fa38b700 1 -- 172.21.15.80:0/119281609 shutdown_connections 2024-05-08T21:19:04.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.660+0000 7fa4fa38b700 1 --2- 172.21.15.80:0/119281609 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fa4e006ac90 0x7fa4e006d150 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:04.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.660+0000 7fa4fa38b700 1 --2- 172.21.15.80:0/119281609 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4dc003a00 0x7fa4f40cd4e0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:04.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.660+0000 7fa4fa38b700 1 --2- 172.21.15.80:0/119281609 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa4f40cb810 0x7fa4f40c89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:04.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.660+0000 7fa4fa38b700 1 --2- 172.21.15.80:0/119281609 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa4f41ee5a0 0x7fa4f4159a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:04.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.660+0000 7fa4fa38b700 1 -- 172.21.15.80:0/119281609 >> 172.21.15.80:0/119281609 conn(0x7fa4f406f140 msgr2=0x7fa4f4158500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:04.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.660+0000 7fa4fa38b700 1 -- 172.21.15.80:0/119281609 shutdown_connections 2024-05-08T21:19:04.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:04.660+0000 7fa4fa38b700 1 -- 172.21.15.80:0/119281609 wait complete. 2024-05-08T21:19:04.664 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 25 2024-05-08T21:19:04.675 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-05-08T21:19:06.676 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:19:06.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.803+0000 7fd20fac1700 1 Processor -- start 2024-05-08T21:19:06.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.804+0000 7fd20fac1700 1 -- start start 2024-05-08T21:19:06.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.804+0000 7fd20fac1700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd2080cbe40 0x7fd20815abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:06.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.805+0000 7fd20fac1700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd2080cc3d0 0x7fd2080cc840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:06.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.805+0000 7fd20fac1700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2080cad60 con 0x7fd208154580 2024-05-08T21:19:06.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.805+0000 7fd20fac1700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2080b2c60 con 0x7fd2080cbe40 2024-05-08T21:19:06.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.805+0000 7fd20fac1700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd20815d750 con 0x7fd2080cc3d0 2024-05-08T21:19:06.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.805+0000 7fd20d85d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd208154580 0x7fd2080c48c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:42028/0 (socket says 172.21.15.80:42028) 2024-05-08T21:19:06.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.805+0000 7fd20d85d700 1 -- 172.21.15.80:0/3414802991 learned_addr learned my addr 172.21.15.80:0/3414802991 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:19:06.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.805+0000 7fd20e05e700 1 --2- 172.21.15.80:0/3414802991 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd2080cc3d0 0x7fd2080cc840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:06.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.805+0000 7fd20c85b700 1 -- 172.21.15.80:0/3414802991 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2683136242 0 0) 0x7fd2080cad60 con 0x7fd208154580 2024-05-08T21:19:06.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.805+0000 7fd20c85b700 1 -- 172.21.15.80:0/3414802991 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1f40035b0 con 0x7fd208154580 2024-05-08T21:19:06.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.805+0000 7fd20d05c700 1 --2- 172.21.15.80:0/3414802991 >> v2:172.21.15.106:3300/0 conn(0x7fd2080cbe40 0x7fd20815abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:06.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.805+0000 7fd20c85b700 1 -- 172.21.15.80:0/3414802991 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1044661588 0 0) 0x7fd1f40035b0 con 0x7fd208154580 2024-05-08T21:19:06.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.805+0000 7fd20c85b700 1 -- 172.21.15.80:0/3414802991 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd2080cc3d0 msgr2=0x7fd2080cc840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:19:06.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.805+0000 7fd20c85b700 1 --2- 172.21.15.80:0/3414802991 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd2080cc3d0 0x7fd2080cc840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:06.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.805+0000 7fd20c85b700 1 -- 172.21.15.80:0/3414802991 >> v2:172.21.15.106:3300/0 conn(0x7fd2080cbe40 msgr2=0x7fd20815abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:19:06.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.805+0000 7fd20c85b700 1 --2- 172.21.15.80:0/3414802991 >> v2:172.21.15.106:3300/0 conn(0x7fd2080cbe40 0x7fd20815abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:06.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.805+0000 7fd20c85b700 1 -- 172.21.15.80:0/3414802991 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd20815d930 con 0x7fd208154580 2024-05-08T21:19:06.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.805+0000 7fd20c85b700 1 -- 172.21.15.80:0/3414802991 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3520646302 0 0) 0x7fd204001670 con 0x7fd208154580 2024-05-08T21:19:06.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.805+0000 7fd20c85b700 1 -- 172.21.15.80:0/3414802991 >> v1:172.21.15.80:6789/0 conn(0x7fd208154580 legacy=0x7fd2080c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:06.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.805+0000 7fd20c85b700 1 --2- 172.21.15.80:0/3414802991 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd1f4003a00 0x7fd1f4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:06.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.805+0000 7fd20c85b700 1 --2- 172.21.15.80:0/3414802991 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd2080cc3d0 0x7fd1f4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:06.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.805+0000 7fd20c85b700 1 --2- 172.21.15.80:0/3414802991 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1f4004d90 0x7fd1f4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:06.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.805+0000 7fd20c85b700 1 -- 172.21.15.80:0/3414802991 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2080b2c60 con 0x7fd1f4004d90 2024-05-08T21:19:06.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.805+0000 7fd20c85b700 1 -- 172.21.15.80:0/3414802991 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20815d750 con 0x7fd1f4003a00 2024-05-08T21:19:06.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.805+0000 7fd20c85b700 1 -- 172.21.15.80:0/3414802991 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f400ba10 con 0x7fd2080cc3d0 2024-05-08T21:19:06.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.805+0000 7fd20e05e700 1 --2- 172.21.15.80:0/3414802991 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1f4004d90 0x7fd1f4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:06.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.805+0000 7fd20d85d700 1 --2- 172.21.15.80:0/3414802991 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd1f4003a00 0x7fd1f4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:06.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.806+0000 7fd20d05c700 1 --2- 172.21.15.80:0/3414802991 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd2080cc3d0 0x7fd1f4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:06.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.806+0000 7fd20e05e700 1 -- 172.21.15.80:0/3414802991 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd2080cc3d0 msgr2=0x7fd1f4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:19:06.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.806+0000 7fd20e05e700 1 --2- 172.21.15.80:0/3414802991 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd2080cc3d0 0x7fd1f4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:06.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.806+0000 7fd20e05e700 1 -- 172.21.15.80:0/3414802991 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd1f4003a00 msgr2=0x7fd1f4003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:19:06.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.806+0000 7fd20e05e700 1 --2- 172.21.15.80:0/3414802991 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd1f4003a00 0x7fd1f4003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:06.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.806+0000 7fd20e05e700 1 -- 172.21.15.80:0/3414802991 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1f40035b0 con 0x7fd1f4004d90 2024-05-08T21:19:06.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.806+0000 7fd20e05e700 1 --2- 172.21.15.80:0/3414802991 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1f4004d90 0x7fd1f4005210 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd200009fc0 tx=0x7fd1f4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5843fb2c4d61c30 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:06.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.806+0000 7fd20c85b700 1 -- 172.21.15.80:0/3414802991 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20000ec30 con 0x7fd1f4004d90 2024-05-08T21:19:06.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.806+0000 7fd20c85b700 1 -- 172.21.15.80:0/3414802991 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20000f040 con 0x7fd1f4004d90 2024-05-08T21:19:06.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.806+0000 7fd20c85b700 1 -- 172.21.15.80:0/3414802991 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd200014480 con 0x7fd1f4004d90 2024-05-08T21:19:06.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.807+0000 7fd20fac1700 1 -- 172.21.15.80:0/3414802991 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1f4004d90 msgr2=0x7fd1f4005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:06.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.807+0000 7fd20fac1700 1 --2- 172.21.15.80:0/3414802991 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1f4004d90 0x7fd1f4005210 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd200009fc0 tx=0x7fd1f4005880 comp rx=0 tx=0).stop 2024-05-08T21:19:06.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.807+0000 7fd20e05e700 1 -- 172.21.15.80:0/3414802991 reap_dead start 2024-05-08T21:19:06.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.807+0000 7fd20fac1700 1 -- 172.21.15.80:0/3414802991 shutdown_connections 2024-05-08T21:19:06.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.807+0000 7fd20fac1700 1 -- 172.21.15.80:0/3414802991 >> 172.21.15.80:0/3414802991 conn(0x7fd20806c6a0 msgr2=0x7fd20806cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:06.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.807+0000 7fd20fac1700 1 -- 172.21.15.80:0/3414802991 shutdown_connections 2024-05-08T21:19:06.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.807+0000 7fd20fac1700 1 -- 172.21.15.80:0/3414802991 wait complete. 2024-05-08T21:19:06.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.808+0000 7fd20fac1700 1 Processor -- start 2024-05-08T21:19:06.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.808+0000 7fd20fac1700 1 -- start start 2024-05-08T21:19:06.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.809+0000 7fd20fac1700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd208156e50 0x7fd208157230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:06.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.809+0000 7fd20fac1700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd208157770 0x7fd208155780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:06.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.809+0000 7fd20fac1700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd208157d30 0x7fd208155cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:06.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.809+0000 7fd20fac1700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20814a300 con 0x7fd208156e50 2024-05-08T21:19:06.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.809+0000 7fd20fac1700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20815ace0 con 0x7fd208157d30 2024-05-08T21:19:06.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.809+0000 7fd20fac1700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd208154a50 con 0x7fd208157770 2024-05-08T21:19:06.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.809+0000 7fd20d85d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd208156e50 0x7fd208157230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:06.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.809+0000 7fd20d85d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd208156e50 0x7fd208157230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34444/0 (socket says 172.21.15.80:34444) 2024-05-08T21:19:06.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.809+0000 7fd20d85d700 1 -- 172.21.15.80:0/2627619860 learned_addr learned my addr 172.21.15.80:0/2627619860 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:19:06.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.809+0000 7fd20d05c700 1 --2- 172.21.15.80:0/2627619860 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd208157770 0x7fd208155780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:06.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.809+0000 7fd20e05e700 1 --2- 172.21.15.80:0/2627619860 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd208157d30 0x7fd208155cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:06.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.809+0000 7fd20d85d700 1 -- 172.21.15.80:0/2627619860 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd208157770 msgr2=0x7fd208155780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:06.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.809+0000 7fd20d85d700 1 --2- 172.21.15.80:0/2627619860 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd208157770 0x7fd208155780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:06.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.809+0000 7fd20d85d700 1 -- 172.21.15.80:0/2627619860 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd208157d30 msgr2=0x7fd208155cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:06.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.809+0000 7fd20d85d700 1 --2- 172.21.15.80:0/2627619860 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd208157d30 0x7fd208155cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:06.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.809+0000 7fd20d85d700 1 -- 172.21.15.80:0/2627619860 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2081f0370 con 0x7fd208156e50 2024-05-08T21:19:06.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.809+0000 7fd20e05e700 1 --2- 172.21.15.80:0/2627619860 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd208157d30 0x7fd208155cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:19:06.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.809+0000 7fd20d05c700 1 --2- 172.21.15.80:0/2627619860 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd208157770 0x7fd208155780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:19:06.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.809+0000 7fd20d85d700 1 --2- 172.21.15.80:0/2627619860 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd208156e50 0x7fd208157230 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd204000fd0 tx=0x7fd204007620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:06.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.809+0000 7fd1fe7fc700 1 -- 172.21.15.80:0/2627619860 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd204007800 con 0x7fd208156e50 2024-05-08T21:19:06.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.809+0000 7fd1fe7fc700 1 -- 172.21.15.80:0/2627619860 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20400f8a0 con 0x7fd208156e50 2024-05-08T21:19:06.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.809+0000 7fd20fac1700 1 -- 172.21.15.80:0/2627619860 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2081f0650 con 0x7fd208156e50 2024-05-08T21:19:06.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.809+0000 7fd1fe7fc700 1 -- 172.21.15.80:0/2627619860 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20400fc30 con 0x7fd208156e50 2024-05-08T21:19:06.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.809+0000 7fd20fac1700 1 -- 172.21.15.80:0/2627619860 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd208154f80 con 0x7fd208156e50 2024-05-08T21:19:06.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.811+0000 7fd20fac1700 1 -- 172.21.15.80:0/2627619860 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd20804ec60 con 0x7fd208156e50 2024-05-08T21:19:06.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.811+0000 7fd1fe7fc700 1 -- 172.21.15.80:0/2627619860 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd20400fd90 con 0x7fd208156e50 2024-05-08T21:19:06.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.811+0000 7fd1fe7fc700 1 --2- 172.21.15.80:0/2627619860 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fd1ec06ac90 0x7fd1ec06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:06.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.811+0000 7fd1fe7fc700 1 -- 172.21.15.80:0/2627619860 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7007+0+0 (secure 0 0 0) 0x7fd2040898c0 con 0x7fd208156e50 2024-05-08T21:19:06.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.811+0000 7fd20d05c700 1 --2- 172.21.15.80:0/2627619860 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fd1ec06ac90 0x7fd1ec06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:06.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.812+0000 7fd20d05c700 1 --2- 172.21.15.80:0/2627619860 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fd1ec06ac90 0x7fd1ec06d150 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd208157b50 tx=0x7fd1f8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:06.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:06.816+0000 7fd1fe7fc700 1 -- 172.21.15.80:0/2627619860 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fd204054640 con 0x7fd208156e50 2024-05-08T21:19:07.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.064+0000 7fd20fac1700 1 -- 172.21.15.80:0/2627619860 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd2080cb4a0 con 0x7fd208156e50 2024-05-08T21:19:07.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.064+0000 7fd1fe7fc700 1 -- 172.21.15.80:0/2627619860 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+5494 (secure 0 0 0) 0x7fd204057c60 con 0x7fd208156e50 2024-05-08T21:19:07.067 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:19:07.067 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:19:06.331004+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5158},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5158":{"gid":5158,"name":"d","rank":0,"incarnation":26,"state":"up:replay","state_seq":1,"addr":"172.21.15.106:6836/959295764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":959295764},{"type":"v1","addr":"172.21.15.106:6836","nonce":959295764}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:19:07.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.067+0000 7fd20fac1700 1 -- 172.21.15.80:0/2627619860 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fd1ec06ac90 msgr2=0x7fd1ec06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:07.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.067+0000 7fd20fac1700 1 --2- 172.21.15.80:0/2627619860 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fd1ec06ac90 0x7fd1ec06d150 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd208157b50 tx=0x7fd1f8008040 comp rx=0 tx=0).stop 2024-05-08T21:19:07.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.067+0000 7fd20fac1700 1 -- 172.21.15.80:0/2627619860 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd208156e50 msgr2=0x7fd208157230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:07.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.067+0000 7fd20fac1700 1 --2- 172.21.15.80:0/2627619860 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd208156e50 0x7fd208157230 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd204000fd0 tx=0x7fd204007620 comp rx=0 tx=0).stop 2024-05-08T21:19:07.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.067+0000 7fd20fac1700 1 -- 172.21.15.80:0/2627619860 shutdown_connections 2024-05-08T21:19:07.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.067+0000 7fd20fac1700 1 --2- 172.21.15.80:0/2627619860 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fd1ec06ac90 0x7fd1ec06d150 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:07.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.067+0000 7fd20fac1700 1 --2- 172.21.15.80:0/2627619860 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd208156e50 0x7fd208157230 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:07.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.067+0000 7fd20fac1700 1 --2- 172.21.15.80:0/2627619860 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd208157d30 0x7fd208155cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:07.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.067+0000 7fd20fac1700 1 --2- 172.21.15.80:0/2627619860 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd208157770 0x7fd208155780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:07.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.067+0000 7fd20fac1700 1 -- 172.21.15.80:0/2627619860 >> 172.21.15.80:0/2627619860 conn(0x7fd20806c6a0 msgr2=0x7fd2080cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:07.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.067+0000 7fd20fac1700 1 -- 172.21.15.80:0/2627619860 shutdown_connections 2024-05-08T21:19:07.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.067+0000 7fd20fac1700 1 -- 172.21.15.80:0/2627619860 wait complete. 2024-05-08T21:19:07.071 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 26 2024-05-08T21:19:07.081 INFO:tasks.mds_thrash.fs.[cephfs]:mds.b down, removed from mdsmap 2024-05-08T21:19:07.081 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for mds cluster to stabilize... 2024-05-08T21:19:07.082 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:19:07.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.200+0000 7f7fc51ac700 1 Processor -- start 2024-05-08T21:19:07.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.201+0000 7f7fc51ac700 1 -- start start 2024-05-08T21:19:07.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.201+0000 7f7fc51ac700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7fc0154390 0x7f7fc015ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:07.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.201+0000 7f7fc51ac700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7fc00ca400 0x7f7fc00cff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:07.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.201+0000 7f7fc51ac700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7fc00ca840 0x7f7fc00d0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:07.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.201+0000 7f7fc51ac700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fc015b1b0 con 0x7f7fc0154390 2024-05-08T21:19:07.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.201+0000 7f7fc51ac700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fc00c5d20 con 0x7f7fc00ca840 2024-05-08T21:19:07.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.201+0000 7f7fc51ac700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc00732b0 con 0x7f7fc00ca400 2024-05-08T21:19:07.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.201+0000 7f7fbed9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7fc0154390 0x7f7fc015ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:07.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.201+0000 7f7fbed9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7fc0154390 0x7f7fc015ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34454/0 (socket says 172.21.15.80:34454) 2024-05-08T21:19:07.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.201+0000 7f7fbed9d700 1 -- 172.21.15.80:0/3065090286 learned_addr learned my addr 172.21.15.80:0/3065090286 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:19:07.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.202+0000 7f7fbe59c700 1 --2- 172.21.15.80:0/3065090286 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7fc00ca400 0x7f7fc00cff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:07.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.202+0000 7f7fbf59e700 1 --2- 172.21.15.80:0/3065090286 >> v2:172.21.15.106:3300/0 conn(0x7f7fc00ca840 0x7f7fc00d0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:07.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.202+0000 7f7fbed9d700 1 -- 172.21.15.80:0/3065090286 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7fc00ca400 msgr2=0x7f7fc00cff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:19:07.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.202+0000 7f7fbed9d700 1 --2- 172.21.15.80:0/3065090286 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7fc00ca400 0x7f7fc00cff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:07.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.202+0000 7f7fbed9d700 1 -- 172.21.15.80:0/3065090286 >> v2:172.21.15.106:3300/0 conn(0x7f7fc00ca840 msgr2=0x7f7fc00d0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:19:07.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.202+0000 7f7fbed9d700 1 --2- 172.21.15.80:0/3065090286 >> v2:172.21.15.106:3300/0 conn(0x7f7fc00ca840 0x7f7fc00d0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:07.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.202+0000 7f7fbed9d700 1 -- 172.21.15.80:0/3065090286 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fc00c49a0 con 0x7f7fc0154390 2024-05-08T21:19:07.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.202+0000 7f7fbed9d700 1 --2- 172.21.15.80:0/3065090286 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7fc0154390 0x7f7fc015ac70 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f7fc00b2500 tx=0x7f7fb0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0e70dabdecbfc1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:07.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.202+0000 7f7fbdd9b700 1 -- 172.21.15.80:0/3065090286 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb0011830 con 0x7f7fc0154390 2024-05-08T21:19:07.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.202+0000 7f7fbdd9b700 1 -- 172.21.15.80:0/3065090286 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fb0011990 con 0x7f7fc0154390 2024-05-08T21:19:07.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.202+0000 7f7fbdd9b700 1 -- 172.21.15.80:0/3065090286 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb0011d20 con 0x7f7fc0154390 2024-05-08T21:19:07.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.203+0000 7f7fc51ac700 1 -- 172.21.15.80:0/3065090286 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7fc0154390 msgr2=0x7f7fc015ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:07.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.203+0000 7f7fc51ac700 1 --2- 172.21.15.80:0/3065090286 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7fc0154390 0x7f7fc015ac70 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f7fc00b2500 tx=0x7f7fb0009c00 comp rx=0 tx=0).stop 2024-05-08T21:19:07.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.203+0000 7f7fc51ac700 1 -- 172.21.15.80:0/3065090286 shutdown_connections 2024-05-08T21:19:07.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.203+0000 7f7fc51ac700 1 --2- 172.21.15.80:0/3065090286 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7fc0154390 0x7f7fc015ac70 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:07.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.203+0000 7f7fc51ac700 1 --2- 172.21.15.80:0/3065090286 >> v2:172.21.15.106:3300/0 conn(0x7f7fc00ca840 0x7f7fc00d0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:07.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.203+0000 7f7fc51ac700 1 --2- 172.21.15.80:0/3065090286 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7fc00ca400 0x7f7fc00cff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:07.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.203+0000 7f7fc51ac700 1 -- 172.21.15.80:0/3065090286 >> 172.21.15.80:0/3065090286 conn(0x7f7fc006ab90 msgr2=0x7f7fc006afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:07.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.203+0000 7f7fc51ac700 1 -- 172.21.15.80:0/3065090286 shutdown_connections 2024-05-08T21:19:07.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.203+0000 7f7fc51ac700 1 -- 172.21.15.80:0/3065090286 wait complete. 2024-05-08T21:19:07.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.204+0000 7f7fc51ac700 1 Processor -- start 2024-05-08T21:19:07.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.204+0000 7f7fc51ac700 1 -- start start 2024-05-08T21:19:07.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.205+0000 7f7fc51ac700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7fc00ca400 0x7f7fc00c9500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:07.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.205+0000 7f7fc51ac700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7fc00ca840 0x7f7fc00cc970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:07.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.205+0000 7f7fc51ac700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7fc0154390 0x7f7fc00cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:07.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.205+0000 7f7fc51ac700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc00c9a40 con 0x7f7fc0154390 2024-05-08T21:19:07.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.205+0000 7f7fc51ac700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc00cb860 con 0x7f7fc00ca840 2024-05-08T21:19:07.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.205+0000 7f7fc51ac700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc00cbb40 con 0x7f7fc00ca400 2024-05-08T21:19:07.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.205+0000 7f7fbf59e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7fc0154390 0x7f7fc00cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:07.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.205+0000 7f7fbed9d700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7fc00ca400 0x7f7fc00c9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:07.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.205+0000 7f7fbe59c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7fc00ca840 0x7f7fc00cc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:07.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.206+0000 7f7fbf59e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7fc0154390 0x7f7fc00cceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34458/0 (socket says 172.21.15.80:34458) 2024-05-08T21:19:07.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.206+0000 7f7fbed9d700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7fc00ca400 0x7f7fc00c9500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:34470/0 (socket says 172.21.15.80:34470) 2024-05-08T21:19:07.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.206+0000 7f7fbf59e700 1 -- 172.21.15.80:0/1396140846 learned_addr learned my addr 172.21.15.80:0/1396140846 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:19:07.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.206+0000 7f7fbf59e700 1 -- 172.21.15.80:0/1396140846 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7fc00ca400 msgr2=0x7f7fc00c9500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:07.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.206+0000 7f7fbf59e700 1 --2- 172.21.15.80:0/1396140846 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7fc00ca400 0x7f7fc00c9500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:07.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.206+0000 7f7fbf59e700 1 -- 172.21.15.80:0/1396140846 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7fc00ca840 msgr2=0x7f7fc00cc970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:07.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.206+0000 7f7fbf59e700 1 --2- 172.21.15.80:0/1396140846 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7fc00ca840 0x7f7fc00cc970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:07.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.206+0000 7f7fbf59e700 1 -- 172.21.15.80:0/1396140846 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb0009550 con 0x7f7fc0154390 2024-05-08T21:19:07.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.206+0000 7f7fbe59c700 1 --2- 172.21.15.80:0/1396140846 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7fc00ca840 0x7f7fc00cc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:19:07.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.206+0000 7f7fbf59e700 1 --2- 172.21.15.80:0/1396140846 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7fc0154390 0x7f7fc00cceb0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f7fb800ef90 tx=0x7f7fb800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:07.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.206+0000 7f7fa77fe700 1 -- 172.21.15.80:0/1396140846 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb800cc90 con 0x7f7fc0154390 2024-05-08T21:19:07.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.206+0000 7f7fa77fe700 1 -- 172.21.15.80:0/1396140846 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fb800f040 con 0x7f7fc0154390 2024-05-08T21:19:07.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.206+0000 7f7fc51ac700 1 -- 172.21.15.80:0/1396140846 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fc00cbe20 con 0x7f7fc0154390 2024-05-08T21:19:07.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.206+0000 7f7fa77fe700 1 -- 172.21.15.80:0/1396140846 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb8014480 con 0x7f7fc0154390 2024-05-08T21:19:07.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.206+0000 7f7fc51ac700 1 -- 172.21.15.80:0/1396140846 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fc00b4a20 con 0x7f7fc0154390 2024-05-08T21:19:07.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.207+0000 7f7fc51ac700 1 -- 172.21.15.80:0/1396140846 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fc00cc340 con 0x7f7fc0154390 2024-05-08T21:19:07.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.208+0000 7f7fa77fe700 1 -- 172.21.15.80:0/1396140846 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7fb80145e0 con 0x7f7fc0154390 2024-05-08T21:19:07.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.208+0000 7f7fa77fe700 1 --2- 172.21.15.80:0/1396140846 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f7fac06ac90 0x7f7fac06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:07.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.208+0000 7f7fa77fe700 1 -- 172.21.15.80:0/1396140846 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f7fb808a2c0 con 0x7f7fc0154390 2024-05-08T21:19:07.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.208+0000 7f7fbed9d700 1 --2- 172.21.15.80:0/1396140846 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f7fac06ac90 0x7f7fac06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:07.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.209+0000 7f7fbed9d700 1 --2- 172.21.15.80:0/1396140846 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f7fac06ac90 0x7f7fac06d150 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7fb0009870 tx=0x7f7fb0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:07.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.213+0000 7f7fa77fe700 1 -- 172.21.15.80:0/1396140846 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f7fb8054f90 con 0x7f7fc0154390 2024-05-08T21:19:07.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.494+0000 7f7fc51ac700 1 -- 172.21.15.80:0/1396140846 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7fc004ec60 con 0x7f7fc0154390 2024-05-08T21:19:07.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.494+0000 7f7fa77fe700 1 -- 172.21.15.80:0/1396140846 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+5494 (secure 0 0 0) 0x7f7fb8009ca0 con 0x7f7fc0154390 2024-05-08T21:19:07.497 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:19:07.497 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:19:06.331004+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5158},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5158":{"gid":5158,"name":"d","rank":0,"incarnation":26,"state":"up:replay","state_seq":1,"addr":"172.21.15.106:6836/959295764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":959295764},{"type":"v1","addr":"172.21.15.106:6836","nonce":959295764}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:19:07.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.496+0000 7f7fc51ac700 1 -- 172.21.15.80:0/1396140846 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f7fac06ac90 msgr2=0x7f7fac06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:07.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.496+0000 7f7fc51ac700 1 --2- 172.21.15.80:0/1396140846 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f7fac06ac90 0x7f7fac06d150 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7fb0009870 tx=0x7f7fb0008030 comp rx=0 tx=0).stop 2024-05-08T21:19:07.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.496+0000 7f7fc51ac700 1 -- 172.21.15.80:0/1396140846 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7fc0154390 msgr2=0x7f7fc00cceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:07.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.496+0000 7f7fc51ac700 1 --2- 172.21.15.80:0/1396140846 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7fc0154390 0x7f7fc00cceb0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f7fb800ef90 tx=0x7f7fb800c3a0 comp rx=0 tx=0).stop 2024-05-08T21:19:07.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.497+0000 7f7fc51ac700 1 -- 172.21.15.80:0/1396140846 shutdown_connections 2024-05-08T21:19:07.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.497+0000 7f7fc51ac700 1 --2- 172.21.15.80:0/1396140846 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f7fac06ac90 0x7f7fac06d150 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:07.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.497+0000 7f7fc51ac700 1 --2- 172.21.15.80:0/1396140846 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7fc0154390 0x7f7fc00cceb0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:07.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.497+0000 7f7fc51ac700 1 --2- 172.21.15.80:0/1396140846 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7fc00ca400 0x7f7fc00c9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:07.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.497+0000 7f7fc51ac700 1 --2- 172.21.15.80:0/1396140846 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7fc00ca840 0x7f7fc00cc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:07.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.497+0000 7f7fc51ac700 1 -- 172.21.15.80:0/1396140846 >> 172.21.15.80:0/1396140846 conn(0x7f7fc006ab90 msgr2=0x7f7fc014ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:07.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.497+0000 7f7fc51ac700 1 -- 172.21.15.80:0/1396140846 shutdown_connections 2024-05-08T21:19:07.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:07.497+0000 7f7fc51ac700 1 -- 172.21.15.80:0/1396140846 wait complete. 2024-05-08T21:19:07.501 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 26 2024-05-08T21:19:07.512 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 26, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-05-08T21:10:03.725481+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 26, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_5158": { "addr": "172.21.15.106:6836/959295764", "addrs": { "addrvec": [ { "addr": "172.21.15.106:6834", "nonce": 959295764, "type": "v2" }, { "addr": "172.21.15.106:6836", "nonce": 959295764, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5158, "incarnation": 26, "join_fscid": -1, "name": "d", "rank": 0, "state": "up:replay", "state_seq": 1 } }, "last_failure": 0, "last_failure_osd_epoch": 32, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-05-08T21:19:06.331004+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5158 } } } ], "standbys": [ { "addr": "172.21.15.106:6837/2762323230", "addrs": { "addrvec": [ { "addr": "172.21.15.106:6835", "nonce": 2762323230, "type": "v2" }, { "addr": "172.21.15.106:6837", "nonce": 2762323230, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4229, "incarnation": 0, "join_fscid": -1, "name": "f", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.80:6837/1121814432", "addrs": { "addrvec": [ { "addr": "172.21.15.80:6834", "nonce": 1121814432, "type": "v2" }, { "addr": "172.21.15.80:6837", "nonce": 1121814432, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4251, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.80:6839/1867024080", "addrs": { "addrvec": [ { "addr": "172.21.15.80:6838", "nonce": 1867024080, "type": "v2" }, { "addr": "172.21.15.80:6839", "nonce": 1867024080, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 2, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4254, "incarnation": 0, "join_fscid": -1, "name": "e", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.80:6836/1947012643", "addrs": { "addrvec": [ { "addr": "172.21.15.80:6835", "nonce": 1947012643, "type": "v2" }, { "addr": "172.21.15.80:6836", "nonce": 1947012643, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4273, "incarnation": 0, "join_fscid": -1, "name": "c", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-05-08T21:19:09.513 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:19:09.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.632+0000 7f559a93c700 1 Processor -- start 2024-05-08T21:19:09.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.632+0000 7f559a93c700 1 -- start start 2024-05-08T21:19:09.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.633+0000 7f559a93c700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5594151010 0x7f559415aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:09.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.633+0000 7f559a93c700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f559415aff0 0x7f55940c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:09.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.633+0000 7f559a93c700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55941572b0 con 0x7f5594156dc0 2024-05-08T21:19:09.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.633+0000 7f559a93c700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f559415a3b0 con 0x7f559415aff0 2024-05-08T21:19:09.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.633+0000 7f559a93c700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f559415a690 con 0x7f5594151010 2024-05-08T21:19:09.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.634+0000 7f5593fff700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5594151010 0x7f559415aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:09.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.634+0000 7f5598ed9700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f559415aff0 0x7f55940c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:09.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.634+0000 7f5593fff700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5594151010 0x7f559415aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:34478/0 (socket says 172.21.15.80:34478) 2024-05-08T21:19:09.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.634+0000 7f5593fff700 1 -- 172.21.15.80:0/497671288 learned_addr learned my addr 172.21.15.80:0/497671288 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:19:09.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.634+0000 7f5593fff700 1 -- 172.21.15.80:0/497671288 >> v2:172.21.15.106:3300/0 conn(0x7f559415aff0 msgr2=0x7f55940c73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:19:09.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.634+0000 7f5593fff700 1 --2- 172.21.15.80:0/497671288 >> v2:172.21.15.106:3300/0 conn(0x7f559415aff0 0x7f55940c73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:09.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.634+0000 7f5593fff700 1 -- 172.21.15.80:0/497671288 >> v1:172.21.15.106:6789/0 conn(0x7f5594156dc0 legacy=0x7f55940c8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:09.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.634+0000 7f5593fff700 1 -- 172.21.15.80:0/497671288 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5594157590 con 0x7f5594151010 2024-05-08T21:19:09.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.634+0000 7f5598ed9700 1 --2- 172.21.15.80:0/497671288 >> v2:172.21.15.106:3300/0 conn(0x7f559415aff0 0x7f55940c73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:19:09.637 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.634+0000 7f5593fff700 1 --2- 172.21.15.80:0/497671288 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5594151010 0x7f559415aab0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f55840098f0 tx=0x7f5584009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12700f732c4ca4ce server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:09.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.634+0000 7f5592ffd700 1 -- 172.21.15.80:0/497671288 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5584011830 con 0x7f5594151010 2024-05-08T21:19:09.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.634+0000 7f5592ffd700 1 -- 172.21.15.80:0/497671288 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5584011990 con 0x7f5594151010 2024-05-08T21:19:09.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.634+0000 7f5592ffd700 1 -- 172.21.15.80:0/497671288 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5584011d20 con 0x7f5594151010 2024-05-08T21:19:09.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.635+0000 7f559a93c700 1 -- 172.21.15.80:0/497671288 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5594151010 msgr2=0x7f559415aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:09.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.635+0000 7f559a93c700 1 --2- 172.21.15.80:0/497671288 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5594151010 0x7f559415aab0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f55840098f0 tx=0x7f5584009c00 comp rx=0 tx=0).stop 2024-05-08T21:19:09.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.635+0000 7f559a93c700 1 -- 172.21.15.80:0/497671288 shutdown_connections 2024-05-08T21:19:09.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.635+0000 7f559a93c700 1 --2- 172.21.15.80:0/497671288 >> v2:172.21.15.106:3300/0 conn(0x7f559415aff0 0x7f55940c73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:09.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.635+0000 7f559a93c700 1 --2- 172.21.15.80:0/497671288 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5594151010 0x7f559415aab0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:09.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.635+0000 7f559a93c700 1 -- 172.21.15.80:0/497671288 >> 172.21.15.80:0/497671288 conn(0x7f55940c9310 msgr2=0x7f55940c9720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:09.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.635+0000 7f559a93c700 1 -- 172.21.15.80:0/497671288 shutdown_connections 2024-05-08T21:19:09.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.635+0000 7f559a93c700 1 -- 172.21.15.80:0/497671288 wait complete. 2024-05-08T21:19:09.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.636+0000 7f559a93c700 1 Processor -- start 2024-05-08T21:19:09.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.636+0000 7f559a93c700 1 -- start start 2024-05-08T21:19:09.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.637+0000 7f559a93c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5594151010 0x7f55941e47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:09.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.637+0000 7f559a93c700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5594156dc0 0x7f5594147cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:09.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.637+0000 7f559a93c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f559415aff0 0x7f5594146f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:09.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.637+0000 7f559a93c700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5594156440 con 0x7f5594151010 2024-05-08T21:19:09.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.637+0000 7f559a93c700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55941f0fc0 con 0x7f559415aff0 2024-05-08T21:19:09.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.637+0000 7f559a93c700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55941f0160 con 0x7f5594156dc0 2024-05-08T21:19:09.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.637+0000 7f5593fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5594151010 0x7f55941e47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:09.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.637+0000 7f5593fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5594151010 0x7f55941e47b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34466/0 (socket says 172.21.15.80:34466) 2024-05-08T21:19:09.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.637+0000 7f5593fff700 1 -- 172.21.15.80:0/2444761027 learned_addr learned my addr 172.21.15.80:0/2444761027 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:19:09.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.637+0000 7f55937fe700 1 --2- 172.21.15.80:0/2444761027 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5594156dc0 0x7f5594147cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:09.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.637+0000 7f5598ed9700 1 --2- 172.21.15.80:0/2444761027 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f559415aff0 0x7f5594146f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:09.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.637+0000 7f5593fff700 1 -- 172.21.15.80:0/2444761027 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5594156dc0 msgr2=0x7f5594147cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:09.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.637+0000 7f5593fff700 1 --2- 172.21.15.80:0/2444761027 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5594156dc0 0x7f5594147cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:09.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.637+0000 7f5593fff700 1 -- 172.21.15.80:0/2444761027 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f559415aff0 msgr2=0x7f5594146f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:09.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.637+0000 7f5593fff700 1 --2- 172.21.15.80:0/2444761027 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f559415aff0 0x7f5594146f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:09.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.637+0000 7f5593fff700 1 -- 172.21.15.80:0/2444761027 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f558c009a70 con 0x7f5594151010 2024-05-08T21:19:09.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.638+0000 7f5593fff700 1 --2- 172.21.15.80:0/2444761027 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5594151010 0x7f55941e47b0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f55940c7030 tx=0x7f5584004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:09.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.638+0000 7f5590ff9700 1 -- 172.21.15.80:0/2444761027 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55840045d0 con 0x7f5594151010 2024-05-08T21:19:09.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.638+0000 7f5590ff9700 1 -- 172.21.15.80:0/2444761027 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f558401f070 con 0x7f5594151010 2024-05-08T21:19:09.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.638+0000 7f559a93c700 1 -- 172.21.15.80:0/2444761027 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5584009550 con 0x7f5594151010 2024-05-08T21:19:09.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.638+0000 7f5590ff9700 1 -- 172.21.15.80:0/2444761027 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55840038c0 con 0x7f5594151010 2024-05-08T21:19:09.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.638+0000 7f559a93c700 1 -- 172.21.15.80:0/2444761027 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55941f0720 con 0x7f5594151010 2024-05-08T21:19:09.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.639+0000 7f559a93c700 1 -- 172.21.15.80:0/2444761027 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f559404ec60 con 0x7f5594151010 2024-05-08T21:19:09.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.639+0000 7f5590ff9700 1 -- 172.21.15.80:0/2444761027 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5584003a20 con 0x7f5594151010 2024-05-08T21:19:09.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.639+0000 7f5590ff9700 1 --2- 172.21.15.80:0/2444761027 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f558006acc0 0x7f558006d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:09.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.640+0000 7f5590ff9700 1 -- 172.21.15.80:0/2444761027 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f5584021070 con 0x7f5594151010 2024-05-08T21:19:09.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.640+0000 7f55937fe700 1 --2- 172.21.15.80:0/2444761027 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f558006acc0 0x7f558006d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:09.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.640+0000 7f55937fe700 1 --2- 172.21.15.80:0/2444761027 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f558006acc0 0x7f558006d180 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f55941f4610 tx=0x7f5588009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:09.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.644+0000 7f5590ff9700 1 -- 172.21.15.80:0/2444761027 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f5584055d70 con 0x7f5594151010 2024-05-08T21:19:09.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.893+0000 7f559a93c700 1 -- 172.21.15.80:0/2444761027 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f55940c3670 con 0x7f5594151010 2024-05-08T21:19:09.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.893+0000 7f5590ff9700 1 -- 172.21.15.80:0/2444761027 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+5494 (secure 0 0 0) 0x7f5584015070 con 0x7f5594151010 2024-05-08T21:19:09.896 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:19:09.896 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:19:06.331004+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5158},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5158":{"gid":5158,"name":"d","rank":0,"incarnation":26,"state":"up:replay","state_seq":1,"addr":"172.21.15.106:6836/959295764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":959295764},{"type":"v1","addr":"172.21.15.106:6836","nonce":959295764}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:19:09.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.895+0000 7f559a93c700 1 -- 172.21.15.80:0/2444761027 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f558006acc0 msgr2=0x7f558006d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:09.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.895+0000 7f559a93c700 1 --2- 172.21.15.80:0/2444761027 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f558006acc0 0x7f558006d180 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f55941f4610 tx=0x7f5588009040 comp rx=0 tx=0).stop 2024-05-08T21:19:09.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.895+0000 7f559a93c700 1 -- 172.21.15.80:0/2444761027 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5594151010 msgr2=0x7f55941e47b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:09.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.895+0000 7f559a93c700 1 --2- 172.21.15.80:0/2444761027 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5594151010 0x7f55941e47b0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f55940c7030 tx=0x7f5584004750 comp rx=0 tx=0).stop 2024-05-08T21:19:09.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.895+0000 7f559a93c700 1 -- 172.21.15.80:0/2444761027 shutdown_connections 2024-05-08T21:19:09.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.895+0000 7f559a93c700 1 --2- 172.21.15.80:0/2444761027 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f558006acc0 0x7f558006d180 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:09.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.895+0000 7f559a93c700 1 --2- 172.21.15.80:0/2444761027 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5594151010 0x7f55941e47b0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:09.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.895+0000 7f559a93c700 1 --2- 172.21.15.80:0/2444761027 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f559415aff0 0x7f5594146f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:09.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.895+0000 7f559a93c700 1 --2- 172.21.15.80:0/2444761027 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5594156dc0 0x7f5594147cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:09.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.895+0000 7f559a93c700 1 -- 172.21.15.80:0/2444761027 >> 172.21.15.80:0/2444761027 conn(0x7f55940c9310 msgr2=0x7f55940728f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:09.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.895+0000 7f559a93c700 1 -- 172.21.15.80:0/2444761027 shutdown_connections 2024-05-08T21:19:09.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:09.895+0000 7f559a93c700 1 -- 172.21.15.80:0/2444761027 wait complete. 2024-05-08T21:19:09.899 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 26 2024-05-08T21:19:09.910 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-05-08T21:19:11.911 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:19:12.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.031+0000 7f902e8c4700 1 Processor -- start 2024-05-08T21:19:12.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.031+0000 7f902e8c4700 1 -- start start 2024-05-08T21:19:12.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.031+0000 7f902e8c4700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f90281520b0 0x7f9028158810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:12.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.031+0000 7f902e8c4700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f9028158d50 0x7f9028072d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:12.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.031+0000 7f902e8c4700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f902815b6d0 con 0x7f90280732c0 2024-05-08T21:19:12.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.031+0000 7f902e8c4700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90281580e0 con 0x7f90281520b0 2024-05-08T21:19:12.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.031+0000 7f902e8c4700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f902815c650 con 0x7f9028158d50 2024-05-08T21:19:12.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.032+0000 7f9027fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f90281520b0 0x7f9028158810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:12.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.032+0000 7f9027fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f90281520b0 0x7f9028158810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34476/0 (socket says 172.21.15.80:34476) 2024-05-08T21:19:12.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.032+0000 7f9027fff700 1 -- 172.21.15.80:0/2646622872 learned_addr learned my addr 172.21.15.80:0/2646622872 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:19:12.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.032+0000 7f90277fe700 1 --2- 172.21.15.80:0/2646622872 >> v2:172.21.15.106:3300/0 conn(0x7f9028158d50 0x7f9028072d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:12.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.032+0000 7f9027fff700 1 -- 172.21.15.80:0/2646622872 >> v2:172.21.15.106:3300/0 conn(0x7f9028158d50 msgr2=0x7f9028072d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:19:12.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.032+0000 7f9027fff700 1 --2- 172.21.15.80:0/2646622872 >> v2:172.21.15.106:3300/0 conn(0x7f9028158d50 0x7f9028072d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:12.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.032+0000 7f9027fff700 1 -- 172.21.15.80:0/2646622872 >> v1:172.21.15.106:6789/0 conn(0x7f90280732c0 legacy=0x7f90280cbba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:12.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.032+0000 7f9027fff700 1 -- 172.21.15.80:0/2646622872 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90280c5cd0 con 0x7f90281520b0 2024-05-08T21:19:12.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.032+0000 7f9027fff700 1 --2- 172.21.15.80:0/2646622872 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90281520b0 0x7f9028158810 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f90280ce520 tx=0x7f9018009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=810a3a7188df4937 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:12.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.032+0000 7f9026ffd700 1 -- 172.21.15.80:0/2646622872 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9018011830 con 0x7f90281520b0 2024-05-08T21:19:12.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.032+0000 7f9026ffd700 1 -- 172.21.15.80:0/2646622872 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9018011990 con 0x7f90281520b0 2024-05-08T21:19:12.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.032+0000 7f9026ffd700 1 -- 172.21.15.80:0/2646622872 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9018011d20 con 0x7f90281520b0 2024-05-08T21:19:12.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.033+0000 7f902e8c4700 1 -- 172.21.15.80:0/2646622872 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90281520b0 msgr2=0x7f9028158810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:12.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.033+0000 7f902e8c4700 1 --2- 172.21.15.80:0/2646622872 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90281520b0 0x7f9028158810 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f90280ce520 tx=0x7f9018009bd0 comp rx=0 tx=0).stop 2024-05-08T21:19:12.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.033+0000 7f902e8c4700 1 -- 172.21.15.80:0/2646622872 shutdown_connections 2024-05-08T21:19:12.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.033+0000 7f902e8c4700 1 --2- 172.21.15.80:0/2646622872 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90281520b0 0x7f9028158810 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:12.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.033+0000 7f902e8c4700 1 --2- 172.21.15.80:0/2646622872 >> v2:172.21.15.106:3300/0 conn(0x7f9028158d50 0x7f9028072d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:12.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.033+0000 7f902e8c4700 1 -- 172.21.15.80:0/2646622872 >> 172.21.15.80:0/2646622872 conn(0x7f9028066780 msgr2=0x7f9028066b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:12.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.033+0000 7f902e8c4700 1 -- 172.21.15.80:0/2646622872 shutdown_connections 2024-05-08T21:19:12.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.033+0000 7f902e8c4700 1 -- 172.21.15.80:0/2646622872 wait complete. 2024-05-08T21:19:12.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.034+0000 7f902e8c4700 1 Processor -- start 2024-05-08T21:19:12.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.034+0000 7f902e8c4700 1 -- start start 2024-05-08T21:19:12.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.035+0000 7f902e8c4700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90280732c0 0x7f902814c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:12.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.035+0000 7f902e8c4700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f90281520b0 0x7f90280ca600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:12.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.035+0000 7f902e8c4700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9028158d50 0x7f90281f2f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:12.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.035+0000 7f902e8c4700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f902814b6d0 con 0x7f90280732c0 2024-05-08T21:19:12.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.035+0000 7f902e8c4700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f902814c1d0 con 0x7f90281520b0 2024-05-08T21:19:12.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.035+0000 7f902e8c4700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f902806d330 con 0x7f9028158d50 2024-05-08T21:19:12.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.035+0000 7f9027fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90280732c0 0x7f902814c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:12.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.035+0000 7f9027fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90280732c0 0x7f902814c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34484/0 (socket says 172.21.15.80:34484) 2024-05-08T21:19:12.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.035+0000 7f9027fff700 1 -- 172.21.15.80:0/3467425122 learned_addr learned my addr 172.21.15.80:0/3467425122 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:19:12.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.035+0000 7f902ce61700 1 --2- 172.21.15.80:0/3467425122 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9028158d50 0x7f90281f2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:12.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.035+0000 7f90277fe700 1 --2- 172.21.15.80:0/3467425122 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f90281520b0 0x7f90280ca600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:12.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.035+0000 7f9027fff700 1 -- 172.21.15.80:0/3467425122 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9028158d50 msgr2=0x7f90281f2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:12.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.035+0000 7f9027fff700 1 --2- 172.21.15.80:0/3467425122 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9028158d50 0x7f90281f2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:12.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.035+0000 7f9027fff700 1 -- 172.21.15.80:0/3467425122 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f90281520b0 msgr2=0x7f90280ca600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:12.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.035+0000 7f9027fff700 1 --2- 172.21.15.80:0/3467425122 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f90281520b0 0x7f90280ca600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:12.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.035+0000 7f9027fff700 1 -- 172.21.15.80:0/3467425122 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9018009550 con 0x7f90280732c0 2024-05-08T21:19:12.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.035+0000 7f90277fe700 1 --2- 172.21.15.80:0/3467425122 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f90281520b0 0x7f90280ca600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:19:12.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.035+0000 7f9027fff700 1 --2- 172.21.15.80:0/3467425122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90280732c0 0x7f902814c820 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f9018009c10 tx=0x7f9018004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:12.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.036+0000 7f9024ff9700 1 -- 172.21.15.80:0/3467425122 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9018004530 con 0x7f90280732c0 2024-05-08T21:19:12.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.036+0000 7f9024ff9700 1 -- 172.21.15.80:0/3467425122 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f901801f070 con 0x7f90280732c0 2024-05-08T21:19:12.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.036+0000 7f902e8c4700 1 -- 172.21.15.80:0/3467425122 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f902806c5e0 con 0x7f90280732c0 2024-05-08T21:19:12.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.036+0000 7f9024ff9700 1 -- 172.21.15.80:0/3467425122 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90180038e0 con 0x7f90280732c0 2024-05-08T21:19:12.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.036+0000 7f902e8c4700 1 -- 172.21.15.80:0/3467425122 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f902806cb30 con 0x7f90280732c0 2024-05-08T21:19:12.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.037+0000 7f902e8c4700 1 -- 172.21.15.80:0/3467425122 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f902804ec60 con 0x7f90280732c0 2024-05-08T21:19:12.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.037+0000 7f9024ff9700 1 -- 172.21.15.80:0/3467425122 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9018021030 con 0x7f90280732c0 2024-05-08T21:19:12.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.037+0000 7f9024ff9700 1 --2- 172.21.15.80:0/3467425122 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f901406ac90 0x7f901406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:12.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.037+0000 7f9024ff9700 1 -- 172.21.15.80:0/3467425122 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f901808a7c0 con 0x7f90280732c0 2024-05-08T21:19:12.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.037+0000 7f90277fe700 1 --2- 172.21.15.80:0/3467425122 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f901406ac90 0x7f901406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:12.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.038+0000 7f90277fe700 1 --2- 172.21.15.80:0/3467425122 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f901406ac90 0x7f901406d150 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f902806c4d0 tx=0x7f901c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:12.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.042+0000 7f9024ff9700 1 -- 172.21.15.80:0/3467425122 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f9018055400 con 0x7f90280732c0 2024-05-08T21:19:12.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.287+0000 7f902e8c4700 1 -- 172.21.15.80:0/3467425122 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9028158a20 con 0x7f90280732c0 2024-05-08T21:19:12.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.287+0000 7f9024ff9700 1 -- 172.21.15.80:0/3467425122 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+5494 (secure 0 0 0) 0x7f901802a090 con 0x7f90280732c0 2024-05-08T21:19:12.290 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:19:12.290 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:19:06.331004+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5158},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5158":{"gid":5158,"name":"d","rank":0,"incarnation":26,"state":"up:replay","state_seq":1,"addr":"172.21.15.106:6836/959295764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":959295764},{"type":"v1","addr":"172.21.15.106:6836","nonce":959295764}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:19:12.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.289+0000 7f902e8c4700 1 -- 172.21.15.80:0/3467425122 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f901406ac90 msgr2=0x7f901406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:12.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.289+0000 7f902e8c4700 1 --2- 172.21.15.80:0/3467425122 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f901406ac90 0x7f901406d150 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f902806c4d0 tx=0x7f901c008040 comp rx=0 tx=0).stop 2024-05-08T21:19:12.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.289+0000 7f902e8c4700 1 -- 172.21.15.80:0/3467425122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90280732c0 msgr2=0x7f902814c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:12.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.289+0000 7f902e8c4700 1 --2- 172.21.15.80:0/3467425122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90280732c0 0x7f902814c820 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f9018009c10 tx=0x7f9018004750 comp rx=0 tx=0).stop 2024-05-08T21:19:12.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.290+0000 7f902e8c4700 1 -- 172.21.15.80:0/3467425122 shutdown_connections 2024-05-08T21:19:12.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.290+0000 7f902e8c4700 1 --2- 172.21.15.80:0/3467425122 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f901406ac90 0x7f901406d150 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:12.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.290+0000 7f902e8c4700 1 --2- 172.21.15.80:0/3467425122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90280732c0 0x7f902814c820 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:12.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.290+0000 7f902e8c4700 1 --2- 172.21.15.80:0/3467425122 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9028158d50 0x7f90281f2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:12.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.290+0000 7f902e8c4700 1 --2- 172.21.15.80:0/3467425122 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f90281520b0 0x7f90280ca600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:12.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.290+0000 7f902e8c4700 1 -- 172.21.15.80:0/3467425122 >> 172.21.15.80:0/3467425122 conn(0x7f9028066780 msgr2=0x7f90281567a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:12.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.290+0000 7f902e8c4700 1 -- 172.21.15.80:0/3467425122 shutdown_connections 2024-05-08T21:19:12.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:12.290+0000 7f902e8c4700 1 -- 172.21.15.80:0/3467425122 wait complete. 2024-05-08T21:19:12.294 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 26 2024-05-08T21:19:12.306 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-05-08T21:19:14.307 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:19:14.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.440+0000 7f8cc2ff7700 1 Processor -- start 2024-05-08T21:19:14.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.440+0000 7f8cc2ff7700 1 -- start start 2024-05-08T21:19:14.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.441+0000 7f8cc2ff7700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8cbc0c73d0 0x7f8cbc071f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:14.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.441+0000 7f8cc2ff7700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cbc15b1b0 con 0x7f8cbc142a70 2024-05-08T21:19:14.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.441+0000 7f8cc2ff7700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cbc15a630 con 0x7f8cbc0c9cb0 2024-05-08T21:19:14.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.441+0000 7f8cc2ff7700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cbc15a910 con 0x7f8cbc0c73d0 2024-05-08T21:19:14.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.441+0000 7f8cc0d93700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f8cbc142a70 0x7f8cbc06a9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:51320/0 (socket says 172.21.15.80:51320) 2024-05-08T21:19:14.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.441+0000 7f8cc0d93700 1 -- 172.21.15.80:0/2390821266 learned_addr learned my addr 172.21.15.80:0/2390821266 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:19:14.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.441+0000 7f8cbbfff700 1 --2- 172.21.15.80:0/2390821266 >> v2:172.21.15.106:3300/0 conn(0x7f8cbc0c73d0 0x7f8cbc071f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:14.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.441+0000 7f8cbb7fe700 1 -- 172.21.15.80:0/2390821266 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2241975475 0 0) 0x7f8cbc15b1b0 con 0x7f8cbc142a70 2024-05-08T21:19:14.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.441+0000 7f8cbb7fe700 1 -- 172.21.15.80:0/2390821266 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8cac0035b0 con 0x7f8cbc142a70 2024-05-08T21:19:14.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.441+0000 7f8cbb7fe700 1 -- 172.21.15.80:0/2390821266 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4107875143 0 0) 0x7f8cac0035b0 con 0x7f8cbc142a70 2024-05-08T21:19:14.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.441+0000 7f8cbb7fe700 1 -- 172.21.15.80:0/2390821266 >> v2:172.21.15.106:3300/0 conn(0x7f8cbc0c73d0 msgr2=0x7f8cbc071f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:19:14.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.441+0000 7f8cbb7fe700 1 --2- 172.21.15.80:0/2390821266 >> v2:172.21.15.106:3300/0 conn(0x7f8cbc0c73d0 0x7f8cbc071f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:14.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.441+0000 7f8cbb7fe700 1 -- 172.21.15.80:0/2390821266 >> v1:172.21.15.106:6789/0 conn(0x7f8cbc0c9cb0 legacy=0x7f8cbc15ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:14.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.441+0000 7f8cbb7fe700 1 -- 172.21.15.80:0/2390821266 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cbc15abf0 con 0x7f8cbc142a70 2024-05-08T21:19:14.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.441+0000 7f8cbb7fe700 1 -- 172.21.15.80:0/2390821266 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3520646302 0 0) 0x7f8cb0001670 con 0x7f8cbc142a70 2024-05-08T21:19:14.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.441+0000 7f8cbb7fe700 1 -- 172.21.15.80:0/2390821266 >> v1:172.21.15.80:6789/0 conn(0x7f8cbc142a70 legacy=0x7f8cbc06a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:14.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.441+0000 7f8cbb7fe700 1 --2- 172.21.15.80:0/2390821266 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8cac003a00 0x7f8cac003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:14.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.441+0000 7f8cbb7fe700 1 --2- 172.21.15.80:0/2390821266 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8cac004400 0x7f8cac0048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:14.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.442+0000 7f8cbb7fe700 1 --2- 172.21.15.80:0/2390821266 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8cac0050d0 0x7f8cac00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:14.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.442+0000 7f8cbb7fe700 1 -- 172.21.15.80:0/2390821266 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cbc15a910 con 0x7f8cac0050d0 2024-05-08T21:19:14.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.442+0000 7f8cbb7fe700 1 -- 172.21.15.80:0/2390821266 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cac00c010 con 0x7f8cac003a00 2024-05-08T21:19:14.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.442+0000 7f8cbb7fe700 1 -- 172.21.15.80:0/2390821266 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cac00c1d0 con 0x7f8cac004400 2024-05-08T21:19:14.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.442+0000 7f8cc1594700 1 --2- 172.21.15.80:0/2390821266 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8cac0050d0 0x7f8cac00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:14.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.442+0000 7f8cc0d93700 1 --2- 172.21.15.80:0/2390821266 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8cac003a00 0x7f8cac003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:14.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.442+0000 7f8cbbfff700 1 --2- 172.21.15.80:0/2390821266 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8cac004400 0x7f8cac0048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:14.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.442+0000 7f8cc1594700 1 -- 172.21.15.80:0/2390821266 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8cac004400 msgr2=0x7f8cac0048d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:19:14.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.442+0000 7f8cc1594700 1 --2- 172.21.15.80:0/2390821266 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8cac004400 0x7f8cac0048d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:14.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.442+0000 7f8cc1594700 1 -- 172.21.15.80:0/2390821266 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8cac003a00 msgr2=0x7f8cac003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:19:14.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.442+0000 7f8cc1594700 1 --2- 172.21.15.80:0/2390821266 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8cac003a00 0x7f8cac003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:14.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.442+0000 7f8cc1594700 1 -- 172.21.15.80:0/2390821266 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cac0035b0 con 0x7f8cac0050d0 2024-05-08T21:19:14.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.442+0000 7f8cc1594700 1 -- 172.21.15.80:0/2390821266 reap_dead start 2024-05-08T21:19:14.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.442+0000 7f8cc1594700 1 --2- 172.21.15.80:0/2390821266 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8cac0050d0 0x7f8cac00ba10 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f8cb400c190 tx=0x7f8cac005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c652c296ad829eec server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:14.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.442+0000 7f8cbb7fe700 1 -- 172.21.15.80:0/2390821266 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb4001db0 con 0x7f8cac0050d0 2024-05-08T21:19:14.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.442+0000 7f8cbb7fe700 1 -- 172.21.15.80:0/2390821266 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cb400ccf0 con 0x7f8cac0050d0 2024-05-08T21:19:14.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.442+0000 7f8cbb7fe700 1 -- 172.21.15.80:0/2390821266 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb4003c40 con 0x7f8cac0050d0 2024-05-08T21:19:14.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.443+0000 7f8cc2ff7700 1 -- 172.21.15.80:0/2390821266 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8cac0050d0 msgr2=0x7f8cac00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:14.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.443+0000 7f8cc2ff7700 1 --2- 172.21.15.80:0/2390821266 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8cac0050d0 0x7f8cac00ba10 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f8cb400c190 tx=0x7f8cac005880 comp rx=0 tx=0).stop 2024-05-08T21:19:14.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.443+0000 7f8cc2ff7700 1 -- 172.21.15.80:0/2390821266 shutdown_connections 2024-05-08T21:19:14.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.443+0000 7f8cc2ff7700 1 --2- 172.21.15.80:0/2390821266 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8cac0050d0 0x7f8cac00ba10 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:14.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.443+0000 7f8cc2ff7700 1 -- 172.21.15.80:0/2390821266 >> 172.21.15.80:0/2390821266 conn(0x7f8cbc06f140 msgr2=0x7f8cbc06f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:14.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.443+0000 7f8cc2ff7700 1 -- 172.21.15.80:0/2390821266 shutdown_connections 2024-05-08T21:19:14.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.443+0000 7f8cc2ff7700 1 -- 172.21.15.80:0/2390821266 wait complete. 2024-05-08T21:19:14.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.444+0000 7f8cc2ff7700 1 Processor -- start 2024-05-08T21:19:14.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.444+0000 7f8cc2ff7700 1 -- start start 2024-05-08T21:19:14.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.445+0000 7f8cc2ff7700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8cac0050d0 0x7f8cbc1f35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:14.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.445+0000 7f8cc2ff7700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8cbc1e4560 0x7f8cbc0c5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:14.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.445+0000 7f8cc2ff7700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8cbc1f02f0 0x7f8cbc138b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:14.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.445+0000 7f8cc2ff7700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cbc1efe60 con 0x7f8cbc1f02f0 2024-05-08T21:19:14.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.445+0000 7f8cc2ff7700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cbc1f3b30 con 0x7f8cac0050d0 2024-05-08T21:19:14.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.445+0000 7f8cc2ff7700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cbc1e5390 con 0x7f8cbc1e4560 2024-05-08T21:19:14.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.445+0000 7f8cc1594700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8cbc1f02f0 0x7f8cbc138b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:14.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.445+0000 7f8cc1594700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8cbc1f02f0 0x7f8cbc138b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33768/0 (socket says 172.21.15.80:33768) 2024-05-08T21:19:14.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.445+0000 7f8cc1594700 1 -- 172.21.15.80:0/1540669165 learned_addr learned my addr 172.21.15.80:0/1540669165 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:19:14.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.445+0000 7f8cc0d93700 1 --2- 172.21.15.80:0/1540669165 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8cac0050d0 0x7f8cbc1f35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:14.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.445+0000 7f8cbbfff700 1 --2- 172.21.15.80:0/1540669165 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8cbc1e4560 0x7f8cbc0c5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:14.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.445+0000 7f8cc1594700 1 -- 172.21.15.80:0/1540669165 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8cbc1e4560 msgr2=0x7f8cbc0c5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:14.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.445+0000 7f8cc1594700 1 --2- 172.21.15.80:0/1540669165 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8cbc1e4560 0x7f8cbc0c5610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:14.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.445+0000 7f8cc1594700 1 -- 172.21.15.80:0/1540669165 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8cac0050d0 msgr2=0x7f8cbc1f35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:14.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.445+0000 7f8cc1594700 1 --2- 172.21.15.80:0/1540669165 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8cac0050d0 0x7f8cbc1f35f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:14.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.445+0000 7f8cc1594700 1 -- 172.21.15.80:0/1540669165 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cbc0c6760 con 0x7f8cbc1f02f0 2024-05-08T21:19:14.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.445+0000 7f8cc1594700 1 --2- 172.21.15.80:0/1540669165 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8cbc1f02f0 0x7f8cbc138b10 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f8cb4005040 tx=0x7f8cb40014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:14.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.445+0000 7f8cb97fa700 1 -- 172.21.15.80:0/1540669165 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb40052d0 con 0x7f8cbc1f02f0 2024-05-08T21:19:14.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.445+0000 7f8cb97fa700 1 -- 172.21.15.80:0/1540669165 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cb4005430 con 0x7f8cbc1f02f0 2024-05-08T21:19:14.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.445+0000 7f8cb97fa700 1 -- 172.21.15.80:0/1540669165 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb40057a0 con 0x7f8cbc1f02f0 2024-05-08T21:19:14.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.445+0000 7f8cc2ff7700 1 -- 172.21.15.80:0/1540669165 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cbc0c5b50 con 0x7f8cbc1f02f0 2024-05-08T21:19:14.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.446+0000 7f8cc2ff7700 1 -- 172.21.15.80:0/1540669165 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cbc137280 con 0x7f8cbc1f02f0 2024-05-08T21:19:14.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.446+0000 7f8cc2ff7700 1 -- 172.21.15.80:0/1540669165 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cbc04ec60 con 0x7f8cbc1f02f0 2024-05-08T21:19:14.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.447+0000 7f8cb97fa700 1 -- 172.21.15.80:0/1540669165 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8cb401d480 con 0x7f8cbc1f02f0 2024-05-08T21:19:14.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.447+0000 7f8cb97fa700 1 --2- 172.21.15.80:0/1540669165 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f8ca006acc0 0x7f8ca006d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:14.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.447+0000 7f8cb97fa700 1 -- 172.21.15.80:0/1540669165 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f8cb408a3b0 con 0x7f8cbc1f02f0 2024-05-08T21:19:14.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.447+0000 7f8cc0d93700 1 --2- 172.21.15.80:0/1540669165 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f8ca006acc0 0x7f8ca006d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:14.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.448+0000 7f8cc0d93700 1 --2- 172.21.15.80:0/1540669165 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f8ca006acc0 0x7f8ca006d180 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8cb0001aa0 tx=0x7f8cb0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:14.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.452+0000 7f8cb97fa700 1 -- 172.21.15.80:0/1540669165 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f8cb40551c0 con 0x7f8cbc1f02f0 2024-05-08T21:19:14.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.693+0000 7f8cc2ff7700 1 -- 172.21.15.80:0/1540669165 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8cbc1e50b0 con 0x7f8cbc1f02f0 2024-05-08T21:19:14.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.694+0000 7f8cb97fa700 1 -- 172.21.15.80:0/1540669165 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+5498 (secure 0 0 0) 0x7f8cb40587e0 con 0x7f8cbc1f02f0 2024-05-08T21:19:14.697 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:19:14.697 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:19:12.685009+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5158},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5158":{"gid":5158,"name":"d","rank":0,"incarnation":26,"state":"up:reconnect","state_seq":23,"addr":"172.21.15.106:6836/959295764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":959295764},{"type":"v1","addr":"172.21.15.106:6836","nonce":959295764}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:19:14.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.696+0000 7f8cc2ff7700 1 -- 172.21.15.80:0/1540669165 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f8ca006acc0 msgr2=0x7f8ca006d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:14.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.696+0000 7f8cc2ff7700 1 --2- 172.21.15.80:0/1540669165 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f8ca006acc0 0x7f8ca006d180 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8cb0001aa0 tx=0x7f8cb0009040 comp rx=0 tx=0).stop 2024-05-08T21:19:14.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.696+0000 7f8cc2ff7700 1 -- 172.21.15.80:0/1540669165 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8cbc1f02f0 msgr2=0x7f8cbc138b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:14.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.696+0000 7f8cc2ff7700 1 --2- 172.21.15.80:0/1540669165 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8cbc1f02f0 0x7f8cbc138b10 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f8cb4005040 tx=0x7f8cb40014a0 comp rx=0 tx=0).stop 2024-05-08T21:19:14.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.696+0000 7f8cc2ff7700 1 -- 172.21.15.80:0/1540669165 shutdown_connections 2024-05-08T21:19:14.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.696+0000 7f8cc2ff7700 1 --2- 172.21.15.80:0/1540669165 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f8ca006acc0 0x7f8ca006d180 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:14.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.696+0000 7f8cc2ff7700 1 --2- 172.21.15.80:0/1540669165 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8cbc1f02f0 0x7f8cbc138b10 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:14.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.696+0000 7f8cc2ff7700 1 --2- 172.21.15.80:0/1540669165 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8cac0050d0 0x7f8cbc1f35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:14.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.696+0000 7f8cc2ff7700 1 --2- 172.21.15.80:0/1540669165 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8cbc1e4560 0x7f8cbc0c5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:14.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.696+0000 7f8cc2ff7700 1 -- 172.21.15.80:0/1540669165 >> 172.21.15.80:0/1540669165 conn(0x7f8cbc06f140 msgr2=0x7f8cbc1593c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:14.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.696+0000 7f8cc2ff7700 1 -- 172.21.15.80:0/1540669165 shutdown_connections 2024-05-08T21:19:14.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:14.696+0000 7f8cc2ff7700 1 -- 172.21.15.80:0/1540669165 wait complete. 2024-05-08T21:19:14.700 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 27 2024-05-08T21:19:14.711 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-05-08T21:19:16.712 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:19:16.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:16.835+0000 7fad5031f700 1 Processor -- start 2024-05-08T21:19:16.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:16.835+0000 7fad5031f700 1 -- start start 2024-05-08T21:19:16.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:16.836+0000 7fad5031f700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fad48154300 0x7fad480cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:16.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:16.836+0000 7fad5031f700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fad480ccc20 0x7fad4806bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:16.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:16.836+0000 7fad5031f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fad4806c5d0 0x7fad4806c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:16.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:16.836+0000 7fad5031f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad4815b290 con 0x7fad4806c5d0 2024-05-08T21:19:16.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:16.836+0000 7fad5031f700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad4815e7e0 con 0x7fad480ccc20 2024-05-08T21:19:16.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:16.836+0000 7fad5031f700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad4815afb0 con 0x7fad48154300 2024-05-08T21:19:16.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:16.836+0000 7fad4e8bc700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fad4806c5d0 0x7fad4806c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:16.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:16.836+0000 7fad4e8bc700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fad4806c5d0 0x7fad4806c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33774/0 (socket says 172.21.15.80:33774) 2024-05-08T21:19:16.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:16.836+0000 7fad4e8bc700 1 -- 172.21.15.80:0/56311832 learned_addr learned my addr 172.21.15.80:0/56311832 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:19:16.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:16.836+0000 7fad4e0bb700 1 --2- 172.21.15.80:0/56311832 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fad48154300 0x7fad480cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:16.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:16.836+0000 7fad4d8ba700 1 --2- 172.21.15.80:0/56311832 >> v2:172.21.15.106:3300/0 conn(0x7fad480ccc20 0x7fad4806bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:16.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:16.836+0000 7fad4e8bc700 1 -- 172.21.15.80:0/56311832 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fad48154300 msgr2=0x7fad480cc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:19:16.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:16.836+0000 7fad4e8bc700 1 --2- 172.21.15.80:0/56311832 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fad48154300 0x7fad480cc6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:16.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:16.836+0000 7fad4e8bc700 1 -- 172.21.15.80:0/56311832 >> v2:172.21.15.106:3300/0 conn(0x7fad480ccc20 msgr2=0x7fad4806bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:19:16.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:16.836+0000 7fad4e8bc700 1 --2- 172.21.15.80:0/56311832 >> v2:172.21.15.106:3300/0 conn(0x7fad480ccc20 0x7fad4806bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:16.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:16.836+0000 7fad4e8bc700 1 -- 172.21.15.80:0/56311832 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad4815da20 con 0x7fad4806c5d0 2024-05-08T21:19:16.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:16.836+0000 7fad4d8ba700 1 --2- 172.21.15.80:0/56311832 >> v2:172.21.15.106:3300/0 conn(0x7fad480ccc20 0x7fad4806bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:19:16.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:16.836+0000 7fad4e8bc700 1 --2- 172.21.15.80:0/56311832 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad4806c5d0 0x7fad4806c010 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fad48071e40 tx=0x7fad4000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e8f6ebd3b236977 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:16.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:16.836+0000 7fad4d0b9700 1 -- 172.21.15.80:0/56311832 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad4000e070 con 0x7fad4806c5d0 2024-05-08T21:19:16.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:16.836+0000 7fad4d0b9700 1 -- 172.21.15.80:0/56311832 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad4000b9c0 con 0x7fad4806c5d0 2024-05-08T21:19:16.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:16.836+0000 7fad4d0b9700 1 -- 172.21.15.80:0/56311832 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad4000bd70 con 0x7fad4806c5d0 2024-05-08T21:19:16.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:16.837+0000 7fad5031f700 1 -- 172.21.15.80:0/56311832 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad4806c5d0 msgr2=0x7fad4806c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:16.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:16.837+0000 7fad5031f700 1 --2- 172.21.15.80:0/56311832 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad4806c5d0 0x7fad4806c010 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fad48071e40 tx=0x7fad4000b330 comp rx=0 tx=0).stop 2024-05-08T21:19:16.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:16.837+0000 7fad5031f700 1 -- 172.21.15.80:0/56311832 shutdown_connections 2024-05-08T21:19:16.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:16.837+0000 7fad5031f700 1 --2- 172.21.15.80:0/56311832 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad4806c5d0 0x7fad4806c010 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:16.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:16.837+0000 7fad5031f700 1 --2- 172.21.15.80:0/56311832 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fad48154300 0x7fad480cc6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:16.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:16.837+0000 7fad5031f700 1 --2- 172.21.15.80:0/56311832 >> v2:172.21.15.106:3300/0 conn(0x7fad480ccc20 0x7fad4806bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:16.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:16.837+0000 7fad5031f700 1 -- 172.21.15.80:0/56311832 >> 172.21.15.80:0/56311832 conn(0x7fad48066780 msgr2=0x7fad48066b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:16.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:16.837+0000 7fad5031f700 1 -- 172.21.15.80:0/56311832 shutdown_connections 2024-05-08T21:19:16.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:16.837+0000 7fad5031f700 1 -- 172.21.15.80:0/56311832 wait complete. 2024-05-08T21:19:16.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:16.838+0000 7fad5031f700 1 Processor -- start 2024-05-08T21:19:16.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:16.838+0000 7fad5031f700 1 -- start start 2024-05-08T21:19:16.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:16.839+0000 7fad5031f700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad4806c5d0 0x7fad4814d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:16.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:16.839+0000 7fad5031f700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fad480ccc20 0x7fad4814dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:16.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:16.839+0000 7fad5031f700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad48154300 0x7fad4815b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:16.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:16.839+0000 7fad5031f700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad48155470 con 0x7fad4806c5d0 2024-05-08T21:19:16.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:16.839+0000 7fad5031f700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad48156300 con 0x7fad48154300 2024-05-08T21:19:16.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:16.839+0000 7fad5031f700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad4814ef10 con 0x7fad480ccc20 2024-05-08T21:19:16.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:16.839+0000 7fad4e0bb700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad4806c5d0 0x7fad4814d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:16.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:16.839+0000 7fad4e0bb700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad4806c5d0 0x7fad4814d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33786/0 (socket says 172.21.15.80:33786) 2024-05-08T21:19:16.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:16.839+0000 7fad4e0bb700 1 -- 172.21.15.80:0/823083393 learned_addr learned my addr 172.21.15.80:0/823083393 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:19:16.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:16.839+0000 7fad4d8ba700 1 --2- 172.21.15.80:0/823083393 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fad480ccc20 0x7fad4814dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:16.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:16.839+0000 7fad4e8bc700 1 --2- 172.21.15.80:0/823083393 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad48154300 0x7fad4815b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:16.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:16.839+0000 7fad4e0bb700 1 -- 172.21.15.80:0/823083393 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fad480ccc20 msgr2=0x7fad4814dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:16.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:16.839+0000 7fad4e0bb700 1 --2- 172.21.15.80:0/823083393 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fad480ccc20 0x7fad4814dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:16.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:16.839+0000 7fad4e0bb700 1 -- 172.21.15.80:0/823083393 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad48154300 msgr2=0x7fad4815b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:16.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:16.839+0000 7fad4e0bb700 1 --2- 172.21.15.80:0/823083393 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad48154300 0x7fad4815b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:16.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:16.839+0000 7fad4e0bb700 1 -- 172.21.15.80:0/823083393 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad40009b30 con 0x7fad4806c5d0 2024-05-08T21:19:16.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:16.839+0000 7fad4e0bb700 1 --2- 172.21.15.80:0/823083393 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad4806c5d0 0x7fad4814d3e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fad4400d800 tx=0x7fad4400db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:16.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:16.840+0000 7fad3effd700 1 -- 172.21.15.80:0/823083393 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad440125f0 con 0x7fad4806c5d0 2024-05-08T21:19:16.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:16.840+0000 7fad3effd700 1 -- 172.21.15.80:0/823083393 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad44012750 con 0x7fad4806c5d0 2024-05-08T21:19:16.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:16.840+0000 7fad5031f700 1 -- 172.21.15.80:0/823083393 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad48155ec0 con 0x7fad4806c5d0 2024-05-08T21:19:16.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:16.840+0000 7fad3effd700 1 -- 172.21.15.80:0/823083393 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad44012b00 con 0x7fad4806c5d0 2024-05-08T21:19:16.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:16.840+0000 7fad5031f700 1 -- 172.21.15.80:0/823083393 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad4814f3a0 con 0x7fad4806c5d0 2024-05-08T21:19:16.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:16.840+0000 7fad5031f700 1 -- 172.21.15.80:0/823083393 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad4806a110 con 0x7fad4806c5d0 2024-05-08T21:19:16.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:16.841+0000 7fad3effd700 1 -- 172.21.15.80:0/823083393 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fad44012c60 con 0x7fad4806c5d0 2024-05-08T21:19:16.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:16.841+0000 7fad3effd700 1 --2- 172.21.15.80:0/823083393 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fad2c06acc0 0x7fad2c06d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:16.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:16.841+0000 7fad3effd700 1 -- 172.21.15.80:0/823083393 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7007+0+0 (secure 0 0 0) 0x7fad44089790 con 0x7fad4806c5d0 2024-05-08T21:19:16.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:16.841+0000 7fad4d8ba700 1 --2- 172.21.15.80:0/823083393 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fad2c06acc0 0x7fad2c06d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:16.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:16.842+0000 7fad4d8ba700 1 --2- 172.21.15.80:0/823083393 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fad2c06acc0 0x7fad2c06d180 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fad480ca240 tx=0x7fad38008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:16.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:16.846+0000 7fad3effd700 1 -- 172.21.15.80:0/823083393 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fad440544f0 con 0x7fad4806c5d0 2024-05-08T21:19:17.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:17.091+0000 7fad5031f700 1 -- 172.21.15.80:0/823083393 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fad4804ec60 con 0x7fad4806c5d0 2024-05-08T21:19:17.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:17.091+0000 7fad3effd700 1 -- 172.21.15.80:0/823083393 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+5498 (secure 0 0 0) 0x7fad44057b10 con 0x7fad4806c5d0 2024-05-08T21:19:17.094 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:19:17.094 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:19:12.685009+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5158},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5158":{"gid":5158,"name":"d","rank":0,"incarnation":26,"state":"up:reconnect","state_seq":23,"addr":"172.21.15.106:6836/959295764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":959295764},{"type":"v1","addr":"172.21.15.106:6836","nonce":959295764}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:19:17.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:17.093+0000 7fad5031f700 1 -- 172.21.15.80:0/823083393 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fad2c06acc0 msgr2=0x7fad2c06d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:17.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:17.093+0000 7fad5031f700 1 --2- 172.21.15.80:0/823083393 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fad2c06acc0 0x7fad2c06d180 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fad480ca240 tx=0x7fad38008040 comp rx=0 tx=0).stop 2024-05-08T21:19:17.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:17.093+0000 7fad5031f700 1 -- 172.21.15.80:0/823083393 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad4806c5d0 msgr2=0x7fad4814d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:17.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:17.093+0000 7fad5031f700 1 --2- 172.21.15.80:0/823083393 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad4806c5d0 0x7fad4814d3e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fad4400d800 tx=0x7fad4400db10 comp rx=0 tx=0).stop 2024-05-08T21:19:17.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:17.093+0000 7fad5031f700 1 -- 172.21.15.80:0/823083393 shutdown_connections 2024-05-08T21:19:17.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:17.093+0000 7fad5031f700 1 --2- 172.21.15.80:0/823083393 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fad2c06acc0 0x7fad2c06d180 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:17.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:17.093+0000 7fad5031f700 1 --2- 172.21.15.80:0/823083393 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad4806c5d0 0x7fad4814d3e0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:17.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:17.093+0000 7fad5031f700 1 --2- 172.21.15.80:0/823083393 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad48154300 0x7fad4815b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:17.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:17.093+0000 7fad5031f700 1 --2- 172.21.15.80:0/823083393 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fad480ccc20 0x7fad4814dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:17.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:17.093+0000 7fad5031f700 1 -- 172.21.15.80:0/823083393 >> 172.21.15.80:0/823083393 conn(0x7fad48066780 msgr2=0x7fad48158af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:17.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:17.094+0000 7fad5031f700 1 -- 172.21.15.80:0/823083393 shutdown_connections 2024-05-08T21:19:17.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:17.094+0000 7fad5031f700 1 -- 172.21.15.80:0/823083393 wait complete. 2024-05-08T21:19:17.098 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 27 2024-05-08T21:19:17.109 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-05-08T21:19:19.109 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:19:19.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.229+0000 7f5ed684a700 1 Processor -- start 2024-05-08T21:19:19.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.229+0000 7f5ed684a700 1 -- start start 2024-05-08T21:19:19.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.230+0000 7f5ed684a700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5ed00c7bd0 0x7f5ed0072d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:19.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.230+0000 7f5ed684a700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ed00c7030 con 0x7f5ed006ef50 2024-05-08T21:19:19.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.230+0000 7f5ecffff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f5ed006ef50 0x7f5ed015abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:51332/0 (socket says 172.21.15.80:51332) 2024-05-08T21:19:19.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.230+0000 7f5ed684a700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ed0072ab0 con 0x7f5ed006f330 2024-05-08T21:19:19.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.230+0000 7f5ecffff700 1 -- 172.21.15.80:0/1241718847 learned_addr learned my addr 172.21.15.80:0/1241718847 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:19:19.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.230+0000 7f5ed684a700 1 -- 172.21.15.80:0/1241718847 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed0071390 con 0x7f5ed00c7bd0 2024-05-08T21:19:19.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.230+0000 7f5ed4de7700 1 --2- 172.21.15.80:0/1241718847 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5ed00c7bd0 0x7f5ed0072d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:19.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.230+0000 7f5eceffd700 1 -- 172.21.15.80:0/1241718847 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 999127642 0 0) 0x7f5ed00c7030 con 0x7f5ed006ef50 2024-05-08T21:19:19.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.230+0000 7f5eceffd700 1 -- 172.21.15.80:0/1241718847 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5eb80035b0 con 0x7f5ed006ef50 2024-05-08T21:19:19.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.230+0000 7f5eceffd700 1 -- 172.21.15.80:0/1241718847 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 438153034 0 0) 0x7f5ed0072ab0 con 0x7f5ed006f330 2024-05-08T21:19:19.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.230+0000 7f5eceffd700 1 -- 172.21.15.80:0/1241718847 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ed00c7030 con 0x7f5ed006f330 2024-05-08T21:19:19.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.230+0000 7f5ed4de7700 1 -- 172.21.15.80:0/1241718847 >> v1:172.21.15.106:6789/0 conn(0x7f5ed006f330 legacy=0x7f5ed00c74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:19.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.230+0000 7f5ed4de7700 1 -- 172.21.15.80:0/1241718847 >> v1:172.21.15.80:6789/0 conn(0x7f5ed006ef50 legacy=0x7f5ed015abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:19.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.230+0000 7f5ed4de7700 1 -- 172.21.15.80:0/1241718847 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed00c8b30 con 0x7f5ed00c7bd0 2024-05-08T21:19:19.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.230+0000 7f5ed4de7700 1 --2- 172.21.15.80:0/1241718847 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5ed00c7bd0 0x7f5ed0072d40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5ec8009dc0 tx=0x7f5ec800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=296f6a007d739372 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:19.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.231+0000 7f5eceffd700 1 -- 172.21.15.80:0/1241718847 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec800e070 con 0x7f5ed00c7bd0 2024-05-08T21:19:19.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.231+0000 7f5eceffd700 1 -- 172.21.15.80:0/1241718847 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ec800bb20 con 0x7f5ed00c7bd0 2024-05-08T21:19:19.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.231+0000 7f5eceffd700 1 -- 172.21.15.80:0/1241718847 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec8012430 con 0x7f5ed00c7bd0 2024-05-08T21:19:19.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.231+0000 7f5ed684a700 1 -- 172.21.15.80:0/1241718847 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5ed00c7bd0 msgr2=0x7f5ed0072d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:19.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.231+0000 7f5ed684a700 1 --2- 172.21.15.80:0/1241718847 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5ed00c7bd0 0x7f5ed0072d40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5ec8009dc0 tx=0x7f5ec800b330 comp rx=0 tx=0).stop 2024-05-08T21:19:19.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.231+0000 7f5ed684a700 1 -- 172.21.15.80:0/1241718847 shutdown_connections 2024-05-08T21:19:19.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.231+0000 7f5ed684a700 1 --2- 172.21.15.80:0/1241718847 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5ed00c7bd0 0x7f5ed0072d40 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:19.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.231+0000 7f5ed684a700 1 -- 172.21.15.80:0/1241718847 >> 172.21.15.80:0/1241718847 conn(0x7f5ed00c9310 msgr2=0x7f5ed00c9720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:19.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.231+0000 7f5ed684a700 1 -- 172.21.15.80:0/1241718847 shutdown_connections 2024-05-08T21:19:19.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.231+0000 7f5ed684a700 1 -- 172.21.15.80:0/1241718847 wait complete. 2024-05-08T21:19:19.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.232+0000 7f5ed684a700 1 Processor -- start 2024-05-08T21:19:19.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.233+0000 7f5ed684a700 1 -- start start 2024-05-08T21:19:19.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.233+0000 7f5ed684a700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ed006ef50 0x7f5ed0157fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:19.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.233+0000 7f5ed684a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ed006f330 0x7f5ed00cb940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:19.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.233+0000 7f5ed684a700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5ed00c7bd0 0x7f5ed01ef380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:19.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.233+0000 7f5ed684a700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed01f3860 con 0x7f5ed006f330 2024-05-08T21:19:19.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.233+0000 7f5ed684a700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed0158a80 con 0x7f5ed006ef50 2024-05-08T21:19:19.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.233+0000 7f5ed684a700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed01f33d0 con 0x7f5ed00c7bd0 2024-05-08T21:19:19.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.233+0000 7f5ecf7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ed006f330 0x7f5ed00cb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:19.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.233+0000 7f5ecf7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ed006f330 0x7f5ed00cb940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33796/0 (socket says 172.21.15.80:33796) 2024-05-08T21:19:19.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.233+0000 7f5ecffff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ed006ef50 0x7f5ed0157fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:19.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.233+0000 7f5ecf7fe700 1 -- 172.21.15.80:0/2736102276 learned_addr learned my addr 172.21.15.80:0/2736102276 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:19:19.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.233+0000 7f5ed4de7700 1 --2- 172.21.15.80:0/2736102276 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5ed00c7bd0 0x7f5ed01ef380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:19.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.234+0000 7f5ecf7fe700 1 -- 172.21.15.80:0/2736102276 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5ed00c7bd0 msgr2=0x7f5ed01ef380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:19.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.234+0000 7f5ecf7fe700 1 --2- 172.21.15.80:0/2736102276 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5ed00c7bd0 0x7f5ed01ef380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:19.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.234+0000 7f5ecf7fe700 1 -- 172.21.15.80:0/2736102276 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ed006ef50 msgr2=0x7f5ed0157fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:19.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.234+0000 7f5ecf7fe700 1 --2- 172.21.15.80:0/2736102276 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ed006ef50 0x7f5ed0157fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:19.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.234+0000 7f5ecf7fe700 1 -- 172.21.15.80:0/2736102276 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec8009a70 con 0x7f5ed006f330 2024-05-08T21:19:19.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.234+0000 7f5ecf7fe700 1 --2- 172.21.15.80:0/2736102276 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ed006f330 0x7f5ed00cb940 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f5ec400c560 tx=0x7f5ec400c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:19.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.234+0000 7f5eccff9700 1 -- 172.21.15.80:0/2736102276 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec40052d0 con 0x7f5ed006f330 2024-05-08T21:19:19.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.234+0000 7f5eccff9700 1 -- 172.21.15.80:0/2736102276 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ec4005430 con 0x7f5ed006f330 2024-05-08T21:19:19.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.234+0000 7f5ed684a700 1 -- 172.21.15.80:0/2736102276 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ed0158510 con 0x7f5ed006f330 2024-05-08T21:19:19.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.234+0000 7f5eccff9700 1 -- 172.21.15.80:0/2736102276 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec40038c0 con 0x7f5ed006f330 2024-05-08T21:19:19.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.234+0000 7f5ed684a700 1 -- 172.21.15.80:0/2736102276 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ed01587a0 con 0x7f5ed006f330 2024-05-08T21:19:19.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.235+0000 7f5ed684a700 1 -- 172.21.15.80:0/2736102276 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ed00723e0 con 0x7f5ed006f330 2024-05-08T21:19:19.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.236+0000 7f5eccff9700 1 -- 172.21.15.80:0/2736102276 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5ec4003a20 con 0x7f5ed006f330 2024-05-08T21:19:19.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.236+0000 7f5eccff9700 1 --2- 172.21.15.80:0/2736102276 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f5ebc06ac90 0x7f5ebc06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:19.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.236+0000 7f5eccff9700 1 -- 172.21.15.80:0/2736102276 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f5ec4088b90 con 0x7f5ed006f330 2024-05-08T21:19:19.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.236+0000 7f5ecffff700 1 --2- 172.21.15.80:0/2736102276 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f5ebc06ac90 0x7f5ebc06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:19.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.236+0000 7f5ecffff700 1 --2- 172.21.15.80:0/2736102276 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f5ebc06ac90 0x7f5ebc06d150 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5ec0007fd0 tx=0x7f5ec0007dc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:19.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.240+0000 7f5eccff9700 1 -- 172.21.15.80:0/2736102276 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f5ec40539b0 con 0x7f5ed006f330 2024-05-08T21:19:19.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.490+0000 7f5ed684a700 1 -- 172.21.15.80:0/2736102276 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5ed004ec60 con 0x7f5ed006f330 2024-05-08T21:19:19.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.491+0000 7f5eccff9700 1 -- 172.21.15.80:0/2736102276 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+5495 (secure 0 0 0) 0x7f5ec4056fd0 con 0x7f5ed006f330 2024-05-08T21:19:19.492 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:19:19.492 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:19:17.746368+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5158},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5158":{"gid":5158,"name":"d","rank":0,"incarnation":26,"state":"up:rejoin","state_seq":25,"addr":"172.21.15.106:6836/959295764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":959295764},{"type":"v1","addr":"172.21.15.106:6836","nonce":959295764}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:19:19.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.493+0000 7f5ed684a700 1 -- 172.21.15.80:0/2736102276 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f5ebc06ac90 msgr2=0x7f5ebc06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:19.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.493+0000 7f5ed684a700 1 --2- 172.21.15.80:0/2736102276 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f5ebc06ac90 0x7f5ebc06d150 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5ec0007fd0 tx=0x7f5ec0007dc0 comp rx=0 tx=0).stop 2024-05-08T21:19:19.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.493+0000 7f5ed684a700 1 -- 172.21.15.80:0/2736102276 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ed006f330 msgr2=0x7f5ed00cb940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:19.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.493+0000 7f5ed684a700 1 --2- 172.21.15.80:0/2736102276 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ed006f330 0x7f5ed00cb940 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f5ec400c560 tx=0x7f5ec400c870 comp rx=0 tx=0).stop 2024-05-08T21:19:19.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.493+0000 7f5ed684a700 1 -- 172.21.15.80:0/2736102276 shutdown_connections 2024-05-08T21:19:19.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.493+0000 7f5ed684a700 1 --2- 172.21.15.80:0/2736102276 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f5ebc06ac90 0x7f5ebc06d150 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:19.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.493+0000 7f5ed684a700 1 --2- 172.21.15.80:0/2736102276 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5ed00c7bd0 0x7f5ed01ef380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:19.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.493+0000 7f5ed684a700 1 --2- 172.21.15.80:0/2736102276 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ed006ef50 0x7f5ed0157fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:19.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.493+0000 7f5ed684a700 1 --2- 172.21.15.80:0/2736102276 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5ed006f330 0x7f5ed00cb940 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:19.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.493+0000 7f5ed684a700 1 -- 172.21.15.80:0/2736102276 >> 172.21.15.80:0/2736102276 conn(0x7f5ed00c9310 msgr2=0x7f5ed014f040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:19.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.493+0000 7f5ed684a700 1 -- 172.21.15.80:0/2736102276 shutdown_connections 2024-05-08T21:19:19.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:19.493+0000 7f5ed684a700 1 -- 172.21.15.80:0/2736102276 wait complete. 2024-05-08T21:19:19.496 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 28 2024-05-08T21:19:19.508 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 28, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-05-08T21:10:03.725481+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 28, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_5158": { "addr": "172.21.15.106:6836/959295764", "addrs": { "addrvec": [ { "addr": "172.21.15.106:6834", "nonce": 959295764, "type": "v2" }, { "addr": "172.21.15.106:6836", "nonce": 959295764, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5158, "incarnation": 26, "join_fscid": -1, "name": "d", "rank": 0, "state": "up:rejoin", "state_seq": 25 } }, "last_failure": 0, "last_failure_osd_epoch": 32, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-05-08T21:19:17.746368+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5158 } } } ], "standbys": [ { "addr": "172.21.15.106:6837/2762323230", "addrs": { "addrvec": [ { "addr": "172.21.15.106:6835", "nonce": 2762323230, "type": "v2" }, { "addr": "172.21.15.106:6837", "nonce": 2762323230, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4229, "incarnation": 0, "join_fscid": -1, "name": "f", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.80:6837/1121814432", "addrs": { "addrvec": [ { "addr": "172.21.15.80:6834", "nonce": 1121814432, "type": "v2" }, { "addr": "172.21.15.80:6837", "nonce": 1121814432, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4251, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.80:6839/1867024080", "addrs": { "addrvec": [ { "addr": "172.21.15.80:6838", "nonce": 1867024080, "type": "v2" }, { "addr": "172.21.15.80:6839", "nonce": 1867024080, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 2, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4254, "incarnation": 0, "join_fscid": -1, "name": "e", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.80:6836/1947012643", "addrs": { "addrvec": [ { "addr": "172.21.15.80:6835", "nonce": 1947012643, "type": "v2" }, { "addr": "172.21.15.80:6836", "nonce": 1947012643, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4273, "incarnation": 0, "join_fscid": -1, "name": "c", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-05-08T21:19:21.509 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:19:21.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:21.630+0000 7fe6b5209700 1 Processor -- start 2024-05-08T21:19:21.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:21.631+0000 7fe6b5209700 1 -- start start 2024-05-08T21:19:21.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:21.631+0000 7fe6b5209700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe6b00cbe40 0x7fe6b015abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:21.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:21.631+0000 7fe6b5209700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6b00cad60 con 0x7fe6b0154580 2024-05-08T21:19:21.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:21.631+0000 7fe6b5209700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6b015d930 con 0x7fe6b00cc3d0 2024-05-08T21:19:21.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:21.631+0000 7fe6b5209700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6b00b2c60 con 0x7fe6b00cbe40 2024-05-08T21:19:21.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:21.631+0000 7fe6ae59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe6b00cbe40 0x7fe6b015abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:21.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:21.632+0000 7fe6aed9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe6b0154580 0x7fe6b00c48c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:51344/0 (socket says 172.21.15.80:51344) 2024-05-08T21:19:21.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:21.632+0000 7fe6aed9d700 1 -- 172.21.15.80:0/4158624690 learned_addr learned my addr 172.21.15.80:0/4158624690 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:19:21.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:21.632+0000 7fe6ae59c700 1 -- 172.21.15.80:0/4158624690 >> v1:172.21.15.106:6789/0 conn(0x7fe6b00cc3d0 legacy=0x7fe6b0164ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:21.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:21.632+0000 7fe6ae59c700 1 -- 172.21.15.80:0/4158624690 >> v1:172.21.15.80:6789/0 conn(0x7fe6b0154580 legacy=0x7fe6b00c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:21.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:21.632+0000 7fe6ae59c700 1 -- 172.21.15.80:0/4158624690 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6b015dc10 con 0x7fe6b00cbe40 2024-05-08T21:19:21.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:21.632+0000 7fe6ae59c700 1 --2- 172.21.15.80:0/4158624690 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6b00cbe40 0x7fe6b015abe0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4009840 tx=0x7fe6a4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6596d9560ed3854f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:21.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:21.632+0000 7fe6add9b700 1 -- 172.21.15.80:0/4158624690 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a4011830 con 0x7fe6b00cbe40 2024-05-08T21:19:21.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:21.632+0000 7fe6add9b700 1 -- 172.21.15.80:0/4158624690 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6a4011990 con 0x7fe6b00cbe40 2024-05-08T21:19:21.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:21.632+0000 7fe6add9b700 1 -- 172.21.15.80:0/4158624690 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a4011d20 con 0x7fe6b00cbe40 2024-05-08T21:19:21.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:21.633+0000 7fe6b5209700 1 -- 172.21.15.80:0/4158624690 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6b00cbe40 msgr2=0x7fe6b015abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:21.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:21.633+0000 7fe6b5209700 1 --2- 172.21.15.80:0/4158624690 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6b00cbe40 0x7fe6b015abe0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4009840 tx=0x7fe6a4009b50 comp rx=0 tx=0).stop 2024-05-08T21:19:21.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:21.633+0000 7fe6b5209700 1 -- 172.21.15.80:0/4158624690 shutdown_connections 2024-05-08T21:19:21.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:21.633+0000 7fe6b5209700 1 --2- 172.21.15.80:0/4158624690 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6b00cbe40 0x7fe6b015abe0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:21.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:21.633+0000 7fe6b5209700 1 -- 172.21.15.80:0/4158624690 >> 172.21.15.80:0/4158624690 conn(0x7fe6b006c6a0 msgr2=0x7fe6b006cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:21.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:21.633+0000 7fe6b5209700 1 -- 172.21.15.80:0/4158624690 shutdown_connections 2024-05-08T21:19:21.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:21.633+0000 7fe6b5209700 1 -- 172.21.15.80:0/4158624690 wait complete. 2024-05-08T21:19:21.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:21.634+0000 7fe6b5209700 1 Processor -- start 2024-05-08T21:19:21.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:21.634+0000 7fe6b5209700 1 -- start start 2024-05-08T21:19:21.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:21.635+0000 7fe6b5209700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe6b00cbe40 0x7fe6b01f3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:21.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:21.635+0000 7fe6b5209700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6b00cc3d0 0x7fe6b01e6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:21.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:21.635+0000 7fe6b5209700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6b0154580 0x7fe6b01e4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:21.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:21.635+0000 7fe6b5209700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b015d750 con 0x7fe6b0154580 2024-05-08T21:19:21.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:21.635+0000 7fe6b5209700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b01f0a50 con 0x7fe6b00cc3d0 2024-05-08T21:19:21.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:21.635+0000 7fe6b5209700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b01e5fa0 con 0x7fe6b00cbe40 2024-05-08T21:19:21.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:21.635+0000 7fe6af59e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6b0154580 0x7fe6b01e4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:21.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:21.635+0000 7fe6af59e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6b0154580 0x7fe6b01e4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:33808/0 (socket says 172.21.15.80:33808) 2024-05-08T21:19:21.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:21.635+0000 7fe6af59e700 1 -- 172.21.15.80:0/1473141620 learned_addr learned my addr 172.21.15.80:0/1473141620 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:19:21.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:21.635+0000 7fe6ae59c700 1 --2- 172.21.15.80:0/1473141620 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6b00cc3d0 0x7fe6b01e6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:21.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:21.635+0000 7fe6aed9d700 1 --2- 172.21.15.80:0/1473141620 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe6b00cbe40 0x7fe6b01f3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:21.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:21.635+0000 7fe6af59e700 1 -- 172.21.15.80:0/1473141620 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe6b00cbe40 msgr2=0x7fe6b01f3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:21.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:21.635+0000 7fe6af59e700 1 --2- 172.21.15.80:0/1473141620 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe6b00cbe40 0x7fe6b01f3ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:21.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:21.635+0000 7fe6af59e700 1 -- 172.21.15.80:0/1473141620 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6b00cc3d0 msgr2=0x7fe6b01e6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:21.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:21.635+0000 7fe6af59e700 1 --2- 172.21.15.80:0/1473141620 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6b00cc3d0 0x7fe6b01e6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:21.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:21.635+0000 7fe6af59e700 1 -- 172.21.15.80:0/1473141620 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6a40094a0 con 0x7fe6b0154580 2024-05-08T21:19:21.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:21.635+0000 7fe6aed9d700 1 --2- 172.21.15.80:0/1473141620 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe6b00cbe40 0x7fe6b01f3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:19:21.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:21.635+0000 7fe6ae59c700 1 --2- 172.21.15.80:0/1473141620 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6b00cc3d0 0x7fe6b01e6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:19:21.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:21.636+0000 7fe6af59e700 1 --2- 172.21.15.80:0/1473141620 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6b0154580 0x7fe6b01e4e20 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fe6a800cc80 tx=0x7fe6a800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:21.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:21.636+0000 7fe6977fe700 1 -- 172.21.15.80:0/1473141620 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a800ad40 con 0x7fe6b0154580 2024-05-08T21:19:21.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:21.636+0000 7fe6977fe700 1 -- 172.21.15.80:0/1473141620 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6a800ce80 con 0x7fe6b0154580 2024-05-08T21:19:21.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:21.636+0000 7fe6b5209700 1 -- 172.21.15.80:0/1473141620 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6b01f4410 con 0x7fe6b0154580 2024-05-08T21:19:21.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:21.636+0000 7fe6977fe700 1 -- 172.21.15.80:0/1473141620 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a800aea0 con 0x7fe6b0154580 2024-05-08T21:19:21.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:21.636+0000 7fe6b5209700 1 -- 172.21.15.80:0/1473141620 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6b0159fb0 con 0x7fe6b0154580 2024-05-08T21:19:21.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:21.637+0000 7fe6b5209700 1 -- 172.21.15.80:0/1473141620 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6b01f0b90 con 0x7fe6b0154580 2024-05-08T21:19:21.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:21.638+0000 7fe6977fe700 1 -- 172.21.15.80:0/1473141620 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe6a8003c40 con 0x7fe6b0154580 2024-05-08T21:19:21.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:21.638+0000 7fe6977fe700 1 --2- 172.21.15.80:0/1473141620 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe69c06acc0 0x7fe69c06d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:21.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:21.638+0000 7fe6977fe700 1 -- 172.21.15.80:0/1473141620 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7007+0+0 (secure 0 0 0) 0x7fe6a8089960 con 0x7fe6b0154580 2024-05-08T21:19:21.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:21.638+0000 7fe6aed9d700 1 --2- 172.21.15.80:0/1473141620 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe69c06acc0 0x7fe69c06d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:21.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:21.638+0000 7fe6aed9d700 1 --2- 172.21.15.80:0/1473141620 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe69c06acc0 0x7fe69c06d180 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe6a0007fd0 tx=0x7fe6a0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:21.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:21.642+0000 7fe6977fe700 1 -- 172.21.15.80:0/1473141620 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fe6b01f0b90 con 0x7fe6b0154580 2024-05-08T21:19:21.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:21.892+0000 7fe6b5209700 1 -- 172.21.15.80:0/1473141620 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe6b01f0b90 con 0x7fe6b0154580 2024-05-08T21:19:21.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:21.892+0000 7fe6977fe700 1 -- 172.21.15.80:0/1473141620 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+5495 (secure 0 0 0) 0x7fe6b01f0b90 con 0x7fe6b0154580 2024-05-08T21:19:21.894 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:19:21.894 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:19:17.746368+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5158},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5158":{"gid":5158,"name":"d","rank":0,"incarnation":26,"state":"up:rejoin","state_seq":25,"addr":"172.21.15.106:6836/959295764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":959295764},{"type":"v1","addr":"172.21.15.106:6836","nonce":959295764}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:19:21.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:21.895+0000 7fe6b5209700 1 -- 172.21.15.80:0/1473141620 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe69c06acc0 msgr2=0x7fe69c06d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:21.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:21.895+0000 7fe6b5209700 1 --2- 172.21.15.80:0/1473141620 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe69c06acc0 0x7fe69c06d180 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe6a0007fd0 tx=0x7fe6a0009040 comp rx=0 tx=0).stop 2024-05-08T21:19:21.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:21.895+0000 7fe6b5209700 1 -- 172.21.15.80:0/1473141620 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6b0154580 msgr2=0x7fe6b01e4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:21.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:21.895+0000 7fe6b5209700 1 --2- 172.21.15.80:0/1473141620 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6b0154580 0x7fe6b01e4e20 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fe6a800cc80 tx=0x7fe6a800a340 comp rx=0 tx=0).stop 2024-05-08T21:19:21.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:21.895+0000 7fe6b5209700 1 -- 172.21.15.80:0/1473141620 shutdown_connections 2024-05-08T21:19:21.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:21.895+0000 7fe6b5209700 1 --2- 172.21.15.80:0/1473141620 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe69c06acc0 0x7fe69c06d180 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:21.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:21.895+0000 7fe6b5209700 1 --2- 172.21.15.80:0/1473141620 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6b0154580 0x7fe6b01e4e20 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:21.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:21.895+0000 7fe6b5209700 1 --2- 172.21.15.80:0/1473141620 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe6b00cbe40 0x7fe6b01f3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:21.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:21.895+0000 7fe6b5209700 1 --2- 172.21.15.80:0/1473141620 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6b00cc3d0 0x7fe6b01e6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:21.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:21.895+0000 7fe6b5209700 1 -- 172.21.15.80:0/1473141620 >> 172.21.15.80:0/1473141620 conn(0x7fe6b006c6a0 msgr2=0x7fe6b0072980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:21.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:21.895+0000 7fe6b5209700 1 -- 172.21.15.80:0/1473141620 shutdown_connections 2024-05-08T21:19:21.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:21.895+0000 7fe6b5209700 1 -- 172.21.15.80:0/1473141620 wait complete. 2024-05-08T21:19:21.898 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 28 2024-05-08T21:19:21.909 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-05-08T21:19:23.910 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:19:24.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.031+0000 7f9c6cc82700 1 Processor -- start 2024-05-08T21:19:24.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.031+0000 7f9c6cc82700 1 -- start start 2024-05-08T21:19:24.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.032+0000 7f9c6cc82700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9c68154390 0x7f9c6815ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:24.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.032+0000 7f9c6cc82700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f9c680ca400 0x7f9c680cff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:24.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.032+0000 7f9c6cc82700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c680732b0 con 0x7f9c680ca840 2024-05-08T21:19:24.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.032+0000 7f9c6cc82700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c6815b1b0 con 0x7f9c68154390 2024-05-08T21:19:24.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.032+0000 7f9c6cc82700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c680c5d20 con 0x7f9c680ca400 2024-05-08T21:19:24.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.032+0000 7f9c6659c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9c68154390 0x7f9c6815ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:24.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.032+0000 7f9c66d9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f9c680ca840 0x7f9c6815b650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44644/0 (socket says 172.21.15.80:44644) 2024-05-08T21:19:24.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.032+0000 7f9c66d9d700 1 -- 172.21.15.80:0/610549221 learned_addr learned my addr 172.21.15.80:0/610549221 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:19:24.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.033+0000 7f9c65d9b700 1 --2- 172.21.15.80:0/610549221 >> v2:172.21.15.106:3300/0 conn(0x7f9c680ca400 0x7f9c680cff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:24.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.033+0000 7f9c6659c700 1 -- 172.21.15.80:0/610549221 >> v2:172.21.15.106:3300/0 conn(0x7f9c680ca400 msgr2=0x7f9c680cff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:19:24.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.033+0000 7f9c6659c700 1 --2- 172.21.15.80:0/610549221 >> v2:172.21.15.106:3300/0 conn(0x7f9c680ca400 0x7f9c680cff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:24.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.033+0000 7f9c6659c700 1 -- 172.21.15.80:0/610549221 >> v1:172.21.15.80:6789/0 conn(0x7f9c680ca840 legacy=0x7f9c6815b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:24.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.033+0000 7f9c6659c700 1 -- 172.21.15.80:0/610549221 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c680c49a0 con 0x7f9c68154390 2024-05-08T21:19:24.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.033+0000 7f9c6559a700 1 -- 172.21.15.80:0/610549221 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2255458795 0 0) 0x7f9c680732b0 con 0x7f9c680ca840 2024-05-08T21:19:24.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.033+0000 7f9c65d9b700 1 --2- 172.21.15.80:0/610549221 >> v2:172.21.15.106:3300/0 conn(0x7f9c680ca400 0x7f9c680cff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:19:24.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.033+0000 7f9c6659c700 1 --2- 172.21.15.80:0/610549221 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9c68154390 0x7f9c6815ac70 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f9c680c6d50 tx=0x7f9c58009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7060e9d613e4f7d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:24.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.033+0000 7f9c6559a700 1 -- 172.21.15.80:0/610549221 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c58011830 con 0x7f9c68154390 2024-05-08T21:19:24.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.033+0000 7f9c6559a700 1 -- 172.21.15.80:0/610549221 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c58011990 con 0x7f9c68154390 2024-05-08T21:19:24.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.033+0000 7f9c6559a700 1 -- 172.21.15.80:0/610549221 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c58011d20 con 0x7f9c68154390 2024-05-08T21:19:24.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.033+0000 7f9c6cc82700 1 -- 172.21.15.80:0/610549221 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9c68154390 msgr2=0x7f9c6815ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:24.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.033+0000 7f9c6cc82700 1 --2- 172.21.15.80:0/610549221 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9c68154390 0x7f9c6815ac70 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f9c680c6d50 tx=0x7f9c58009b20 comp rx=0 tx=0).stop 2024-05-08T21:19:24.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.034+0000 7f9c6cc82700 1 -- 172.21.15.80:0/610549221 shutdown_connections 2024-05-08T21:19:24.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.034+0000 7f9c6cc82700 1 --2- 172.21.15.80:0/610549221 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9c68154390 0x7f9c6815ac70 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:24.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.034+0000 7f9c6cc82700 1 --2- 172.21.15.80:0/610549221 >> v2:172.21.15.106:3300/0 conn(0x7f9c680ca400 0x7f9c680cff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:24.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.034+0000 7f9c6cc82700 1 -- 172.21.15.80:0/610549221 >> 172.21.15.80:0/610549221 conn(0x7f9c6806ab90 msgr2=0x7f9c6806afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:24.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.034+0000 7f9c6cc82700 1 -- 172.21.15.80:0/610549221 shutdown_connections 2024-05-08T21:19:24.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.034+0000 7f9c6cc82700 1 -- 172.21.15.80:0/610549221 wait complete. 2024-05-08T21:19:24.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.035+0000 7f9c6cc82700 1 Processor -- start 2024-05-08T21:19:24.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.035+0000 7f9c6cc82700 1 -- start start 2024-05-08T21:19:24.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.036+0000 7f9c6cc82700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9c680ca400 0x7f9c680b4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:24.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.036+0000 7f9c6cc82700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9c680ca840 0x7f9c68148fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:24.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.036+0000 7f9c6cc82700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9c68154390 0x7f9c681494e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:24.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.036+0000 7f9c6cc82700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c681f3770 con 0x7f9c680ca400 2024-05-08T21:19:24.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.036+0000 7f9c6cc82700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c681f3b90 con 0x7f9c680ca840 2024-05-08T21:19:24.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.036+0000 7f9c6cc82700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c680cba50 con 0x7f9c68154390 2024-05-08T21:19:24.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.036+0000 7f9c6659c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9c680ca400 0x7f9c680b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:24.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.036+0000 7f9c6659c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9c680ca400 0x7f9c680b4310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51692/0 (socket says 172.21.15.80:51692) 2024-05-08T21:19:24.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.036+0000 7f9c6659c700 1 -- 172.21.15.80:0/2204955389 learned_addr learned my addr 172.21.15.80:0/2204955389 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:19:24.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.036+0000 7f9c65d9b700 1 --2- 172.21.15.80:0/2204955389 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9c680ca840 0x7f9c68148fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:24.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.036+0000 7f9c66d9d700 1 --2- 172.21.15.80:0/2204955389 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9c68154390 0x7f9c681494e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:24.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.036+0000 7f9c6659c700 1 -- 172.21.15.80:0/2204955389 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9c68154390 msgr2=0x7f9c681494e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:24.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.036+0000 7f9c6659c700 1 --2- 172.21.15.80:0/2204955389 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9c68154390 0x7f9c681494e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:24.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.036+0000 7f9c6659c700 1 -- 172.21.15.80:0/2204955389 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9c680ca840 msgr2=0x7f9c68148fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:24.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.036+0000 7f9c6659c700 1 --2- 172.21.15.80:0/2204955389 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9c680ca840 0x7f9c68148fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:24.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.036+0000 7f9c6659c700 1 -- 172.21.15.80:0/2204955389 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c580094a0 con 0x7f9c680ca400 2024-05-08T21:19:24.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.036+0000 7f9c6659c700 1 --2- 172.21.15.80:0/2204955389 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9c680ca400 0x7f9c680b4310 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f9c58014040 tx=0x7f9c58004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:24.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.036+0000 7f9c56ffd700 1 -- 172.21.15.80:0/2204955389 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c580038a0 con 0x7f9c680ca400 2024-05-08T21:19:24.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.036+0000 7f9c56ffd700 1 -- 172.21.15.80:0/2204955389 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c5801e070 con 0x7f9c680ca400 2024-05-08T21:19:24.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.036+0000 7f9c6cc82700 1 -- 172.21.15.80:0/2204955389 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c68148cc0 con 0x7f9c680ca400 2024-05-08T21:19:24.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.036+0000 7f9c56ffd700 1 -- 172.21.15.80:0/2204955389 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c58003c40 con 0x7f9c680ca400 2024-05-08T21:19:24.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.036+0000 7f9c6cc82700 1 -- 172.21.15.80:0/2204955389 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c681f30b0 con 0x7f9c680ca400 2024-05-08T21:19:24.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.037+0000 7f9c6cc82700 1 -- 172.21.15.80:0/2204955389 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c681f38b0 con 0x7f9c680ca400 2024-05-08T21:19:24.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.038+0000 7f9c56ffd700 1 -- 172.21.15.80:0/2204955389 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9c5801a420 con 0x7f9c680ca400 2024-05-08T21:19:24.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.038+0000 7f9c56ffd700 1 --2- 172.21.15.80:0/2204955389 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f9c4806ac90 0x7f9c4806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:24.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.038+0000 7f9c56ffd700 1 -- 172.21.15.80:0/2204955389 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f9c5808a960 con 0x7f9c680ca400 2024-05-08T21:19:24.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.038+0000 7f9c65d9b700 1 --2- 172.21.15.80:0/2204955389 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f9c4806ac90 0x7f9c4806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:24.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.038+0000 7f9c65d9b700 1 --2- 172.21.15.80:0/2204955389 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f9c4806ac90 0x7f9c4806d150 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9c680ccd80 tx=0x7f9c5c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:24.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.043+0000 7f9c56ffd700 1 -- 172.21.15.80:0/2204955389 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f9c580556c0 con 0x7f9c680ca400 2024-05-08T21:19:24.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.293+0000 7f9c6cc82700 1 -- 172.21.15.80:0/2204955389 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9c6804ec60 con 0x7f9c680ca400 2024-05-08T21:19:24.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.294+0000 7f9c56ffd700 1 -- 172.21.15.80:0/2204955389 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+5495 (secure 0 0 0) 0x7f9c58015090 con 0x7f9c680ca400 2024-05-08T21:19:24.296 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:19:24.296 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:19:22.807886+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5158},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5158":{"gid":5158,"name":"d","rank":0,"incarnation":26,"state":"up:active","state_seq":27,"addr":"172.21.15.106:6836/959295764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":959295764},{"type":"v1","addr":"172.21.15.106:6836","nonce":959295764}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:19:24.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.296+0000 7f9c6cc82700 1 -- 172.21.15.80:0/2204955389 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f9c4806ac90 msgr2=0x7f9c4806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:24.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.296+0000 7f9c6cc82700 1 --2- 172.21.15.80:0/2204955389 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f9c4806ac90 0x7f9c4806d150 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9c680ccd80 tx=0x7f9c5c008040 comp rx=0 tx=0).stop 2024-05-08T21:19:24.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.296+0000 7f9c6cc82700 1 -- 172.21.15.80:0/2204955389 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9c680ca400 msgr2=0x7f9c680b4310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:24.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.296+0000 7f9c6cc82700 1 --2- 172.21.15.80:0/2204955389 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9c680ca400 0x7f9c680b4310 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f9c58014040 tx=0x7f9c58004750 comp rx=0 tx=0).stop 2024-05-08T21:19:24.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.296+0000 7f9c6cc82700 1 -- 172.21.15.80:0/2204955389 shutdown_connections 2024-05-08T21:19:24.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.296+0000 7f9c6cc82700 1 --2- 172.21.15.80:0/2204955389 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f9c4806ac90 0x7f9c4806d150 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:24.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.296+0000 7f9c6cc82700 1 --2- 172.21.15.80:0/2204955389 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9c680ca400 0x7f9c680b4310 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:24.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.296+0000 7f9c6cc82700 1 --2- 172.21.15.80:0/2204955389 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9c68154390 0x7f9c681494e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:24.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.296+0000 7f9c6cc82700 1 --2- 172.21.15.80:0/2204955389 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9c680ca840 0x7f9c68148fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:24.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.296+0000 7f9c6cc82700 1 -- 172.21.15.80:0/2204955389 >> 172.21.15.80:0/2204955389 conn(0x7f9c6806ab90 msgr2=0x7f9c6806cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:24.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.296+0000 7f9c6cc82700 1 -- 172.21.15.80:0/2204955389 shutdown_connections 2024-05-08T21:19:24.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:24.296+0000 7f9c6cc82700 1 -- 172.21.15.80:0/2204955389 wait complete. 2024-05-08T21:19:24.299 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 29 2024-05-08T21:19:24.310 INFO:tasks.mds_thrash.fs.[cephfs]:mds.d has gained rank=0, replacing gid=5086 2024-05-08T21:19:24.310 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 5 secs before reviving mds.b 2024-05-08T21:19:29.311 INFO:tasks.mds_thrash.fs.[cephfs]:reviving mds.b 2024-05-08T21:19:29.311 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-08T21:19:29.311 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-08T21:19:29.334 INFO:tasks.ceph.mds.b:Started 2024-05-08T21:19:29.334 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:19:29.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.457+0000 7f16e5a27700 1 Processor -- start 2024-05-08T21:19:29.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.457+0000 7f16e5a27700 1 -- start start 2024-05-08T21:19:29.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.458+0000 7f16e5a27700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f16e0154390 0x7f16e015ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:29.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.458+0000 7f16e5a27700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f16e00ca400 0x7f16e00cff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:29.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.458+0000 7f16e5a27700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16e00732b0 con 0x7f16e00ca840 2024-05-08T21:19:29.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.458+0000 7f16e5a27700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16e015b1b0 con 0x7f16e0154390 2024-05-08T21:19:29.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.458+0000 7f16e5a27700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16e00c5d20 con 0x7f16e00ca400 2024-05-08T21:19:29.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.458+0000 7f16deffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f16e0154390 0x7f16e015ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:29.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.459+0000 7f16deffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f16e0154390 0x7f16e015ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51706/0 (socket says 172.21.15.80:51706) 2024-05-08T21:19:29.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.459+0000 7f16deffd700 1 -- 172.21.15.80:0/564435740 learned_addr learned my addr 172.21.15.80:0/564435740 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:19:29.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.459+0000 7f16de7fc700 1 --2- 172.21.15.80:0/564435740 >> v2:172.21.15.106:3300/0 conn(0x7f16e00ca400 0x7f16e00cff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:29.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.459+0000 7f16deffd700 1 -- 172.21.15.80:0/564435740 >> v2:172.21.15.106:3300/0 conn(0x7f16e00ca400 msgr2=0x7f16e00cff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:19:29.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.459+0000 7f16deffd700 1 --2- 172.21.15.80:0/564435740 >> v2:172.21.15.106:3300/0 conn(0x7f16e00ca400 0x7f16e00cff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:29.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.459+0000 7f16deffd700 1 -- 172.21.15.80:0/564435740 >> v1:172.21.15.106:6789/0 conn(0x7f16e00ca840 legacy=0x7f16e015b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:19:29.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.459+0000 7f16deffd700 1 -- 172.21.15.80:0/564435740 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e00c49a0 con 0x7f16e0154390 2024-05-08T21:19:29.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.459+0000 7f16deffd700 1 --2- 172.21.15.80:0/564435740 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16e0154390 0x7f16e015ac70 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f16e00c6d50 tx=0x7f16d8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f167daf16d12a811 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:29.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.459+0000 7f16ddffb700 1 -- 172.21.15.80:0/564435740 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d8004230 con 0x7f16e0154390 2024-05-08T21:19:29.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.459+0000 7f16ddffb700 1 -- 172.21.15.80:0/564435740 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16d8004390 con 0x7f16e0154390 2024-05-08T21:19:29.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.459+0000 7f16ddffb700 1 -- 172.21.15.80:0/564435740 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d80036a0 con 0x7f16e0154390 2024-05-08T21:19:29.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.460+0000 7f16e5a27700 1 -- 172.21.15.80:0/564435740 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16e0154390 msgr2=0x7f16e015ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:29.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.460+0000 7f16e5a27700 1 --2- 172.21.15.80:0/564435740 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16e0154390 0x7f16e015ac70 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f16e00c6d50 tx=0x7f16d8009bd0 comp rx=0 tx=0).stop 2024-05-08T21:19:29.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.460+0000 7f16e5a27700 1 -- 172.21.15.80:0/564435740 shutdown_connections 2024-05-08T21:19:29.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.460+0000 7f16e5a27700 1 --2- 172.21.15.80:0/564435740 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16e0154390 0x7f16e015ac70 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:29.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.460+0000 7f16e5a27700 1 --2- 172.21.15.80:0/564435740 >> v2:172.21.15.106:3300/0 conn(0x7f16e00ca400 0x7f16e00cff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:29.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.460+0000 7f16e5a27700 1 -- 172.21.15.80:0/564435740 >> 172.21.15.80:0/564435740 conn(0x7f16e006ab90 msgr2=0x7f16e006afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:29.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.460+0000 7f16e5a27700 1 -- 172.21.15.80:0/564435740 shutdown_connections 2024-05-08T21:19:29.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.460+0000 7f16e5a27700 1 -- 172.21.15.80:0/564435740 wait complete. 2024-05-08T21:19:29.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.461+0000 7f16e5a27700 1 Processor -- start 2024-05-08T21:19:29.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.461+0000 7f16e5a27700 1 -- start start 2024-05-08T21:19:29.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.462+0000 7f16e5a27700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f16e00ca400 0x7f16e01f0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:29.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.462+0000 7f16e5a27700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16e00ca840 0x7f16e01485d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:29.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.462+0000 7f16e5a27700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f16e0154390 0x7f16e00c6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:29.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.462+0000 7f16e5a27700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e01efff0 con 0x7f16e00ca840 2024-05-08T21:19:29.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.462+0000 7f16e5a27700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e01ef9e0 con 0x7f16e00ca400 2024-05-08T21:19:29.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.462+0000 7f16e5a27700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16e00cf120 con 0x7f16e0154390 2024-05-08T21:19:29.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.462+0000 7f16de7fc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16e00ca840 0x7f16e01485d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:29.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.462+0000 7f16de7fc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16e00ca840 0x7f16e01485d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51714/0 (socket says 172.21.15.80:51714) 2024-05-08T21:19:29.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.462+0000 7f16de7fc700 1 -- 172.21.15.80:0/1438559280 learned_addr learned my addr 172.21.15.80:0/1438559280 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:19:29.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.462+0000 7f16deffd700 1 --2- 172.21.15.80:0/1438559280 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f16e00ca400 0x7f16e01f0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:29.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.462+0000 7f16df7fe700 1 --2- 172.21.15.80:0/1438559280 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f16e0154390 0x7f16e00c6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:29.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.462+0000 7f16de7fc700 1 -- 172.21.15.80:0/1438559280 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f16e0154390 msgr2=0x7f16e00c6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:29.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.462+0000 7f16de7fc700 1 --2- 172.21.15.80:0/1438559280 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f16e0154390 0x7f16e00c6d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:29.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.462+0000 7f16de7fc700 1 -- 172.21.15.80:0/1438559280 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f16e00ca400 msgr2=0x7f16e01f0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:29.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.462+0000 7f16de7fc700 1 --2- 172.21.15.80:0/1438559280 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f16e00ca400 0x7f16e01f0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:29.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.462+0000 7f16de7fc700 1 -- 172.21.15.80:0/1438559280 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16d8009550 con 0x7f16e00ca840 2024-05-08T21:19:29.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.462+0000 7f16de7fc700 1 --2- 172.21.15.80:0/1438559280 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16e00ca840 0x7f16e01485d0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f16c800e730 tx=0x7f16c800ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:29.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.462+0000 7f16d7fff700 1 -- 172.21.15.80:0/1438559280 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c8013610 con 0x7f16e00ca840 2024-05-08T21:19:29.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.462+0000 7f16d7fff700 1 -- 172.21.15.80:0/1438559280 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16c8013770 con 0x7f16e00ca840 2024-05-08T21:19:29.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.462+0000 7f16e5a27700 1 -- 172.21.15.80:0/1438559280 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16e00cf400 con 0x7f16e00ca840 2024-05-08T21:19:29.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.462+0000 7f16d7fff700 1 -- 172.21.15.80:0/1438559280 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c8013b20 con 0x7f16e00ca840 2024-05-08T21:19:29.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.463+0000 7f16e5a27700 1 -- 172.21.15.80:0/1438559280 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16e00cf6e0 con 0x7f16e00ca840 2024-05-08T21:19:29.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.463+0000 7f16e5a27700 1 -- 172.21.15.80:0/1438559280 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16e004ec60 con 0x7f16e00ca840 2024-05-08T21:19:29.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.464+0000 7f16d7fff700 1 -- 172.21.15.80:0/1438559280 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f16c8013c80 con 0x7f16e00ca840 2024-05-08T21:19:29.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.464+0000 7f16d7fff700 1 --2- 172.21.15.80:0/1438559280 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f16c006ac90 0x7f16c006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:29.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.464+0000 7f16d7fff700 1 -- 172.21.15.80:0/1438559280 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f16c80890e0 con 0x7f16e00ca840 2024-05-08T21:19:29.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.464+0000 7f16deffd700 1 --2- 172.21.15.80:0/1438559280 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f16c006ac90 0x7f16c006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:29.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.465+0000 7f16deffd700 1 --2- 172.21.15.80:0/1438559280 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f16c006ac90 0x7f16c006d150 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f16d8009130 tx=0x7f16d8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:29.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.469+0000 7f16d7fff700 1 -- 172.21.15.80:0/1438559280 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f16c8053dc0 con 0x7f16e00ca840 2024-05-08T21:19:29.565 INFO:tasks.ceph.mds.b.smithi106.stdout:starting mds.b at 2024-05-08T21:19:29.643 INFO:tasks.ceph.mds.d.smithi106.stderr:2024-05-08T21:19:29.641+0000 7fbd98eb0700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-08T21:19:29.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.713+0000 7f16e5a27700 1 -- 172.21.15.80:0/1438559280 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f16e0149700 con 0x7f16e00ca840 2024-05-08T21:19:29.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.714+0000 7f16d7fff700 1 -- 172.21.15.80:0/1438559280 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+5495 (secure 0 0 0) 0x7f16c80573e0 con 0x7f16e00ca840 2024-05-08T21:19:29.717 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:19:29.717 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:19:22.807886+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5158},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5158":{"gid":5158,"name":"d","rank":0,"incarnation":26,"state":"up:active","state_seq":27,"addr":"172.21.15.106:6836/959295764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":959295764},{"type":"v1","addr":"172.21.15.106:6836","nonce":959295764}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:19:29.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.716+0000 7f16e5a27700 1 -- 172.21.15.80:0/1438559280 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f16c006ac90 msgr2=0x7f16c006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:29.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.716+0000 7f16e5a27700 1 --2- 172.21.15.80:0/1438559280 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f16c006ac90 0x7f16c006d150 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f16d8009130 tx=0x7f16d8008030 comp rx=0 tx=0).stop 2024-05-08T21:19:29.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.716+0000 7f16e5a27700 1 -- 172.21.15.80:0/1438559280 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16e00ca840 msgr2=0x7f16e01485d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:29.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.716+0000 7f16e5a27700 1 --2- 172.21.15.80:0/1438559280 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16e00ca840 0x7f16e01485d0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f16c800e730 tx=0x7f16c800ea40 comp rx=0 tx=0).stop 2024-05-08T21:19:29.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.716+0000 7f16e5a27700 1 -- 172.21.15.80:0/1438559280 shutdown_connections 2024-05-08T21:19:29.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.716+0000 7f16e5a27700 1 --2- 172.21.15.80:0/1438559280 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f16c006ac90 0x7f16c006d150 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:29.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.716+0000 7f16e5a27700 1 --2- 172.21.15.80:0/1438559280 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f16e0154390 0x7f16e00c6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:29.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.716+0000 7f16e5a27700 1 --2- 172.21.15.80:0/1438559280 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f16e00ca400 0x7f16e01f0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:29.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.716+0000 7f16e5a27700 1 --2- 172.21.15.80:0/1438559280 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16e00ca840 0x7f16e01485d0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:29.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.716+0000 7f16e5a27700 1 -- 172.21.15.80:0/1438559280 >> 172.21.15.80:0/1438559280 conn(0x7f16e006ab90 msgr2=0x7f16e015cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:29.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.716+0000 7f16e5a27700 1 -- 172.21.15.80:0/1438559280 shutdown_connections 2024-05-08T21:19:29.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:29.716+0000 7f16e5a27700 1 -- 172.21.15.80:0/1438559280 wait complete. 2024-05-08T21:19:29.720 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 29 2024-05-08T21:19:29.731 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.b is in active, standby or standby-replay 2024-05-08T21:19:29.804 INFO:tasks.workunit.client.0.smithi080.stdout:Syncing()...46 sec 2024-05-08T21:19:29.804 INFO:tasks.workunit.client.0.smithi080.stdout:FFSB benchmark finished at: Wed May 8 21:19:29 2024 2024-05-08T21:19:29.804 INFO:tasks.workunit.client.0.smithi080.stdout: 2024-05-08T21:19:29.804 INFO:tasks.workunit.client.0.smithi080.stdout:Results: 2024-05-08T21:19:29.804 INFO:tasks.workunit.client.0.smithi080.stdout:Benchmark took 374.86 sec 2024-05-08T21:19:29.804 INFO:tasks.workunit.client.0.smithi080.stdout: 2024-05-08T21:19:29.804 INFO:tasks.workunit.client.0.smithi080.stdout:Total Results 2024-05-08T21:19:29.804 INFO:tasks.workunit.client.0.smithi080.stdout:=============== 2024-05-08T21:19:29.804 INFO:tasks.workunit.client.0.smithi080.stdout: Op Name Transactions Trans/sec % Trans % Op Weight Throughput 2024-05-08T21:19:29.804 INFO:tasks.workunit.client.0.smithi080.stdout: ======= ============ ========= ======= =========== ========== 2024-05-08T21:19:29.804 INFO:tasks.workunit.client.0.smithi080.stdout: write : 2647040 7061.33 100.000% 100.000% 27.6MB/sec 2024-05-08T21:19:29.804 INFO:tasks.workunit.client.0.smithi080.stdout:- 2024-05-08T21:19:29.805 INFO:tasks.workunit.client.0.smithi080.stdout:7061.33 Transactions per Second 2024-05-08T21:19:29.805 INFO:tasks.workunit.client.0.smithi080.stdout: 2024-05-08T21:19:29.805 INFO:tasks.workunit.client.0.smithi080.stdout:Throughput Results 2024-05-08T21:19:29.805 INFO:tasks.workunit.client.0.smithi080.stdout:=================== 2024-05-08T21:19:29.805 INFO:tasks.workunit.client.0.smithi080.stdout:Write Throughput: 27.6MB/sec 2024-05-08T21:19:29.814 INFO:tasks.workunit.client.0.smithi080.stdout: 2024-05-08T21:19:29.814 INFO:tasks.workunit.client.0.smithi080.stdout:System Call Latency statistics in millisecs 2024-05-08T21:19:29.814 INFO:tasks.workunit.client.0.smithi080.stdout:===== 2024-05-08T21:19:29.814 INFO:tasks.workunit.client.0.smithi080.stdout: Min Avg Max Total Calls 2024-05-08T21:19:29.814 INFO:tasks.workunit.client.0.smithi080.stdout: ======== ======== ======== ============ 2024-05-08T21:19:29.814 INFO:tasks.workunit.client.0.smithi080.stdout:[ open] 0.004000 6.518394 356.286987 2068 2024-05-08T21:19:29.814 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-05-08T21:19:29.814 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-05-08T21:19:29.814 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-05-08T21:19:29.814 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-05-08T21:19:29.814 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[4] 200.000000 - 500.000000 : 34 2024-05-08T21:19:29.814 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[5] 100.000000 - 200.000000 : 9 2024-05-08T21:19:29.814 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[6] 50.000000 - 100.000000 : 5 2024-05-08T21:19:29.815 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[7] 20.000000 - 50.000000 : 53 2024-05-08T21:19:29.815 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[8] 10.000000 - 20.000000 : 73 2024-05-08T21:19:29.815 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[9] 5.000000 - 10.000000 : 40 2024-05-08T21:19:29.815 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[10] 2.000000 - 5.000000 : 8 2024-05-08T21:19:29.815 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[11] 1.000000 - 2.000000 : 7 2024-05-08T21:19:29.815 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[12] 0.500000 - 1.000000 : 6 2024-05-08T21:19:29.815 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[13] 0.200000 - 0.500000 : 4 2024-05-08T21:19:29.815 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[14] 0.100000 - 0.200000 : 5 2024-05-08T21:19:29.815 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[15] 0.050000 - 0.100000 : 1 2024-05-08T21:19:29.815 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[16] 0.020000 - 0.050000 : 142 2024-05-08T21:19:29.815 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[17] 0.010000 - 0.020000 : 734 2024-05-08T21:19:29.815 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[18] 0.000000 - 0.010000 : 947 2024-05-08T21:19:29.815 INFO:tasks.workunit.client.0.smithi080.stdout: 2024-05-08T21:19:29.815 INFO:tasks.workunit.client.0.smithi080.stdout:[ write] 0.001000 3.484808 64949.968750 2647040 2024-05-08T21:19:29.815 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[0] 5000.000000 - 10000.000000 : 137 2024-05-08T21:19:29.816 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[1] 2000.000000 - 5000.000000 : 290 2024-05-08T21:19:29.816 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[2] 1000.000000 - 2000.000000 : 200 2024-05-08T21:19:29.816 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[3] 500.000000 - 1000.000000 : 124 2024-05-08T21:19:29.816 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[4] 200.000000 - 500.000000 : 252 2024-05-08T21:19:29.816 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[5] 100.000000 - 200.000000 : 133 2024-05-08T21:19:29.816 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[6] 50.000000 - 100.000000 : 169 2024-05-08T21:19:29.816 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[7] 20.000000 - 50.000000 : 278 2024-05-08T21:19:29.816 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[8] 10.000000 - 20.000000 : 212 2024-05-08T21:19:29.816 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[9] 5.000000 - 10.000000 : 151 2024-05-08T21:19:29.816 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[10] 2.000000 - 5.000000 : 118 2024-05-08T21:19:29.816 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[11] 1.000000 - 2.000000 : 52 2024-05-08T21:19:29.816 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[12] 0.500000 - 1.000000 : 52 2024-05-08T21:19:29.816 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[13] 0.200000 - 0.500000 : 76 2024-05-08T21:19:29.816 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[14] 0.100000 - 0.200000 : 144 2024-05-08T21:19:29.817 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[15] 0.050000 - 0.100000 : 182 2024-05-08T21:19:29.817 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[16] 0.020000 - 0.050000 : 1874 2024-05-08T21:19:29.817 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[17] 0.010000 - 0.020000 : 13564 2024-05-08T21:19:29.817 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[18] 0.000000 - 0.010000 : 2628721 2024-05-08T21:19:29.817 INFO:tasks.workunit.client.0.smithi080.stdout: 2024-05-08T21:19:29.817 INFO:tasks.workunit.client.0.smithi080.stdout:[ lseek] 0.000000 0.000616 71.011002 2647040 2024-05-08T21:19:29.817 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-05-08T21:19:29.817 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-05-08T21:19:29.817 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-05-08T21:19:29.817 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-05-08T21:19:29.817 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-05-08T21:19:29.817 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-05-08T21:19:29.817 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[6] 50.000000 - 100.000000 : 3 2024-05-08T21:19:29.817 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[7] 20.000000 - 50.000000 : 10 2024-05-08T21:19:29.817 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[8] 10.000000 - 20.000000 : 7 2024-05-08T21:19:29.818 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[9] 5.000000 - 10.000000 : 3 2024-05-08T21:19:29.818 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[10] 2.000000 - 5.000000 : 5 2024-05-08T21:19:29.818 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[11] 1.000000 - 2.000000 : 4 2024-05-08T21:19:29.818 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[12] 0.500000 - 1.000000 : 4 2024-05-08T21:19:29.818 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[13] 0.200000 - 0.500000 : 12 2024-05-08T21:19:29.818 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[14] 0.100000 - 0.200000 : 10 2024-05-08T21:19:29.818 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[15] 0.050000 - 0.100000 : 14 2024-05-08T21:19:29.818 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[16] 0.020000 - 0.050000 : 142 2024-05-08T21:19:29.818 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[17] 0.010000 - 0.020000 : 200 2024-05-08T21:19:29.818 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[18] 0.000000 - 0.010000 : 2646626 2024-05-08T21:19:29.818 INFO:tasks.workunit.client.0.smithi080.stdout: 2024-05-08T21:19:29.818 INFO:tasks.workunit.client.0.smithi080.stdout:[ close] 0.001000 0.003463 0.187000 2068 2024-05-08T21:19:29.818 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-05-08T21:19:29.818 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-05-08T21:19:29.819 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-05-08T21:19:29.819 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-05-08T21:19:29.819 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-05-08T21:19:29.819 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-05-08T21:19:29.819 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[6] 50.000000 - 100.000000 : 0 2024-05-08T21:19:29.819 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[7] 20.000000 - 50.000000 : 0 2024-05-08T21:19:29.819 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[8] 10.000000 - 20.000000 : 0 2024-05-08T21:19:29.819 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[9] 5.000000 - 10.000000 : 0 2024-05-08T21:19:29.819 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[10] 2.000000 - 5.000000 : 0 2024-05-08T21:19:29.819 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[11] 1.000000 - 2.000000 : 0 2024-05-08T21:19:29.819 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[12] 0.500000 - 1.000000 : 0 2024-05-08T21:19:29.819 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[13] 0.200000 - 0.500000 : 0 2024-05-08T21:19:29.819 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[14] 0.100000 - 0.200000 : 1 2024-05-08T21:19:29.819 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[15] 0.050000 - 0.100000 : 0 2024-05-08T21:19:29.819 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[16] 0.020000 - 0.050000 : 2 2024-05-08T21:19:29.820 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[17] 0.010000 - 0.020000 : 5 2024-05-08T21:19:29.820 INFO:tasks.workunit.client.0.smithi080.stdout: msec_range[18] 0.000000 - 0.010000 : 2060 2024-05-08T21:19:29.820 INFO:tasks.workunit.client.0.smithi080.stdout: 2024-05-08T21:19:29.820 INFO:tasks.workunit.client.0.smithi080.stdout: 2024-05-08T21:19:29.820 INFO:tasks.workunit.client.0.smithi080.stdout: 2024-05-08T21:19:29.820 INFO:tasks.workunit.client.0.smithi080.stdout: 2024-05-08T21:19:29.820 INFO:tasks.workunit.client.0.smithi080.stdout:0.3% User Time 2024-05-08T21:19:29.820 INFO:tasks.workunit.client.0.smithi080.stdout:2.4% System Time 2024-05-08T21:19:29.820 INFO:tasks.workunit.client.0.smithi080.stdout:2.8% CPU Utilization 2024-05-08T21:19:31.732 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:19:31.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:31.879+0000 7fbff7cf5700 1 Processor -- start 2024-05-08T21:19:31.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:31.879+0000 7fbff7cf5700 1 -- start start 2024-05-08T21:19:31.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:31.880+0000 7fbff7cf5700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbff00c2230 0x7fbff00c6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:31.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:31.880+0000 7fbff7cf5700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbff016af60 0x7fbff00cb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:31.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:31.880+0000 7fbff7cf5700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbff0167f40 con 0x7fbff00cb570 2024-05-08T21:19:31.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:31.880+0000 7fbff7cf5700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbff00c6bc0 con 0x7fbff016af60 2024-05-08T21:19:31.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:31.880+0000 7fbff7cf5700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbff0167330 con 0x7fbff00c2230 2024-05-08T21:19:31.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:31.880+0000 7fbff5290700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fbff00cb570 0x7fbff016a850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44646/0 (socket says 172.21.15.80:44646) 2024-05-08T21:19:31.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:31.880+0000 7fbff5290700 1 -- 172.21.15.80:0/4192699315 learned_addr learned my addr 172.21.15.80:0/4192699315 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:19:31.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:31.880+0000 7fbff6292700 1 --2- 172.21.15.80:0/4192699315 >> v2:172.21.15.80:3300/0 conn(0x7fbff016af60 0x7fbff00cb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:31.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:31.881+0000 7fbff6292700 1 -- 172.21.15.80:0/4192699315 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbff00c2230 msgr2=0x7fbff00c6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:19:31.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:31.881+0000 7fbff6292700 1 --2- 172.21.15.80:0/4192699315 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbff00c2230 0x7fbff00c6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:31.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:31.881+0000 7fbff6292700 1 -- 172.21.15.80:0/4192699315 >> v1:172.21.15.80:6789/0 conn(0x7fbff00cb570 legacy=0x7fbff016a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:31.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:31.881+0000 7fbff6292700 1 -- 172.21.15.80:0/4192699315 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff0167610 con 0x7fbff016af60 2024-05-08T21:19:31.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:31.881+0000 7fbff6292700 1 --2- 172.21.15.80:0/4192699315 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbff016af60 0x7fbff00cb9b0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fbfe8009d90 tx=0x7fbfe800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5c7901a2a6ffed0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:31.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:31.882+0000 7fbff4a8f700 1 -- 172.21.15.80:0/4192699315 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe800bbd0 con 0x7fbff016af60 2024-05-08T21:19:31.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:31.882+0000 7fbff4a8f700 1 -- 172.21.15.80:0/4192699315 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfe800bd30 con 0x7fbff016af60 2024-05-08T21:19:31.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:31.882+0000 7fbff4a8f700 1 -- 172.21.15.80:0/4192699315 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe800bea0 con 0x7fbff016af60 2024-05-08T21:19:31.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:31.883+0000 7fbff7cf5700 1 -- 172.21.15.80:0/4192699315 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbff016af60 msgr2=0x7fbff00cb9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:31.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:31.883+0000 7fbff7cf5700 1 --2- 172.21.15.80:0/4192699315 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbff016af60 0x7fbff00cb9b0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fbfe8009d90 tx=0x7fbfe800b330 comp rx=0 tx=0).stop 2024-05-08T21:19:31.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:31.887+0000 7fbff7cf5700 1 -- 172.21.15.80:0/4192699315 shutdown_connections 2024-05-08T21:19:31.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:31.887+0000 7fbff7cf5700 1 --2- 172.21.15.80:0/4192699315 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbff016af60 0x7fbff00cb9b0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:31.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:31.887+0000 7fbff7cf5700 1 --2- 172.21.15.80:0/4192699315 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbff00c2230 0x7fbff00c6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:31.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:31.887+0000 7fbff7cf5700 1 -- 172.21.15.80:0/4192699315 >> 172.21.15.80:0/4192699315 conn(0x7fbff006a9c0 msgr2=0x7fbff006ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:31.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:31.893+0000 7fbff7cf5700 1 -- 172.21.15.80:0/4192699315 shutdown_connections 2024-05-08T21:19:31.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:31.893+0000 7fbff7cf5700 1 -- 172.21.15.80:0/4192699315 wait complete. 2024-05-08T21:19:31.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:31.895+0000 7fbff7cf5700 1 Processor -- start 2024-05-08T21:19:31.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:31.902+0000 7fbff7cf5700 1 -- start start 2024-05-08T21:19:31.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:31.903+0000 7fbff7cf5700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbff00c2230 0x7fbff00c0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:31.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:31.903+0000 7fbff7cf5700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbff00cb570 0x7fbff008b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:31.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:31.903+0000 7fbff7cf5700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbff016af60 0x7fbff008bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:31.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:31.903+0000 7fbff7cf5700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff00bfa10 con 0x7fbff00cb570 2024-05-08T21:19:31.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:31.903+0000 7fbff7cf5700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff0169430 con 0x7fbff016af60 2024-05-08T21:19:31.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:31.903+0000 7fbff7cf5700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbff00c0880 con 0x7fbff00c2230 2024-05-08T21:19:31.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:31.903+0000 7fbff5290700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbff00cb570 0x7fbff008b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:31.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:31.903+0000 7fbff5290700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbff00cb570 0x7fbff008b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51738/0 (socket says 172.21.15.80:51738) 2024-05-08T21:19:31.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:31.903+0000 7fbff5290700 1 -- 172.21.15.80:0/1778478241 learned_addr learned my addr 172.21.15.80:0/1778478241 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:19:31.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:31.903+0000 7fbff5290700 1 -- 172.21.15.80:0/1778478241 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbff00c2230 msgr2=0x7fbff00c0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:31.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:31.903+0000 7fbff5290700 1 --2- 172.21.15.80:0/1778478241 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbff00c2230 0x7fbff00c0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:31.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:31.903+0000 7fbff5290700 1 -- 172.21.15.80:0/1778478241 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbff016af60 msgr2=0x7fbff008bc70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T21:19:31.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:31.903+0000 7fbff5290700 1 --2- 172.21.15.80:0/1778478241 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbff016af60 0x7fbff008bc70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:31.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:31.903+0000 7fbff5290700 1 -- 172.21.15.80:0/1778478241 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe8009a70 con 0x7fbff00cb570 2024-05-08T21:19:31.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:31.903+0000 7fbff5290700 1 --2- 172.21.15.80:0/1778478241 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbff00cb570 0x7fbff008b730 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fbfe000bcc0 tx=0x7fbfe0009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:31.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:31.904+0000 7fbfe67fc700 1 -- 172.21.15.80:0/1778478241 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe000ce00 con 0x7fbff00cb570 2024-05-08T21:19:31.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:31.904+0000 7fbfe67fc700 1 -- 172.21.15.80:0/1778478241 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfe0015470 con 0x7fbff00cb570 2024-05-08T21:19:31.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:31.904+0000 7fbfe67fc700 1 -- 172.21.15.80:0/1778478241 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe00157e0 con 0x7fbff00cb570 2024-05-08T21:19:31.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:31.905+0000 7fbff7cf5700 1 -- 172.21.15.80:0/1778478241 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbff0168560 con 0x7fbff00cb570 2024-05-08T21:19:31.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:31.905+0000 7fbff7cf5700 1 -- 172.21.15.80:0/1778478241 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbff0168b00 con 0x7fbff00cb570 2024-05-08T21:19:31.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:31.907+0000 7fbfe67fc700 1 -- 172.21.15.80:0/1778478241 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbfe0012070 con 0x7fbff00cb570 2024-05-08T21:19:31.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:31.908+0000 7fbfe67fc700 1 --2- 172.21.15.80:0/1778478241 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fbfd406ac90 0x7fbfd406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:31.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:31.908+0000 7fbfe67fc700 1 -- 172.21.15.80:0/1778478241 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7007+0+0 (secure 0 0 0) 0x7fbfe00898e0 con 0x7fbff00cb570 2024-05-08T21:19:31.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:31.908+0000 7fbff5a91700 1 --2- 172.21.15.80:0/1778478241 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fbfd406ac90 0x7fbfd406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:31.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:31.909+0000 7fbff5a91700 1 --2- 172.21.15.80:0/1778478241 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fbfd406ac90 0x7fbfd406d150 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fbfec009710 tx=0x7fbfec006c80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:31.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:31.913+0000 7fbff7cf5700 1 -- 172.21.15.80:0/1778478241 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbff004ec60 con 0x7fbff00cb570 2024-05-08T21:19:31.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:31.918+0000 7fbfe67fc700 1 -- 172.21.15.80:0/1778478241 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fbfe00545a0 con 0x7fbff00cb570 2024-05-08T21:19:32.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:32.431+0000 7fbff7cf5700 1 -- 172.21.15.80:0/1778478241 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbff00c71e0 con 0x7fbff00cb570 2024-05-08T21:19:32.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:32.435+0000 7fbfe67fc700 1 -- 172.21.15.80:0/1778478241 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+6255 (secure 0 0 0) 0x7fbfe001a030 con 0x7fbff00cb570 2024-05-08T21:19:32.439 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:19:32.439 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4937,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/1705999583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":1705999583},{"type":"v1","addr":"172.21.15.106:6833","nonce":1705999583}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:19:22.807886+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5158},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5158":{"gid":5158,"name":"d","rank":0,"incarnation":26,"state":"up:active","state_seq":27,"addr":"172.21.15.106:6836/959295764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":959295764},{"type":"v1","addr":"172.21.15.106:6836","nonce":959295764}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:19:32.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:32.441+0000 7fbff7cf5700 1 -- 172.21.15.80:0/1778478241 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fbfd406ac90 msgr2=0x7fbfd406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:32.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:32.441+0000 7fbff7cf5700 1 --2- 172.21.15.80:0/1778478241 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fbfd406ac90 0x7fbfd406d150 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fbfec009710 tx=0x7fbfec006c80 comp rx=0 tx=0).stop 2024-05-08T21:19:32.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:32.441+0000 7fbff7cf5700 1 -- 172.21.15.80:0/1778478241 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbff00cb570 msgr2=0x7fbff008b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:32.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:32.441+0000 7fbff7cf5700 1 --2- 172.21.15.80:0/1778478241 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbff00cb570 0x7fbff008b730 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fbfe000bcc0 tx=0x7fbfe0009e60 comp rx=0 tx=0).stop 2024-05-08T21:19:32.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:32.441+0000 7fbff7cf5700 1 -- 172.21.15.80:0/1778478241 shutdown_connections 2024-05-08T21:19:32.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:32.441+0000 7fbff7cf5700 1 --2- 172.21.15.80:0/1778478241 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fbfd406ac90 0x7fbfd406d150 secure :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fbfec009710 tx=0x7fbfec006c80 comp rx=0 tx=0).stop 2024-05-08T21:19:32.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:32.441+0000 7fbff7cf5700 1 --2- 172.21.15.80:0/1778478241 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbff016af60 0x7fbff008bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:32.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:32.441+0000 7fbff7cf5700 1 --2- 172.21.15.80:0/1778478241 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbff00c2230 0x7fbff00c0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:32.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:32.441+0000 7fbff7cf5700 1 --2- 172.21.15.80:0/1778478241 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbff00cb570 0x7fbff008b730 secure :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fbfe000bcc0 tx=0x7fbfe0009e60 comp rx=0 tx=0).stop 2024-05-08T21:19:32.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:32.441+0000 7fbff7cf5700 1 -- 172.21.15.80:0/1778478241 >> 172.21.15.80:0/1778478241 conn(0x7fbff006a9c0 msgr2=0x7fbff01799b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:32.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:32.444+0000 7fbff7cf5700 1 -- 172.21.15.80:0/1778478241 shutdown_connections 2024-05-08T21:19:32.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:32.444+0000 7fbff7cf5700 1 -- 172.21.15.80:0/1778478241 wait complete. 2024-05-08T21:19:32.447 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 30 2024-05-08T21:19:32.466 INFO:tasks.mds_thrash.fs.[cephfs]:mds.b reported in up:standby state 2024-05-08T21:19:32.466 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 94 secs before thrashing 2024-05-08T21:19:38.613 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-05-08T21:19:38.614 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-05-08T21:19:38.826 INFO:tasks.workunit:Stopping ['suites/ffsb.sh'] on client.0... 2024-05-08T21:19:38.826 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-05-08T21:19:39.355 DEBUG:teuthology.parallel:result is None 2024-05-08T21:19:39.356 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-05-08T21:19:39.473 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-05-08T21:19:39.473 DEBUG:teuthology.run_tasks:Unwinding manager mds_thrash 2024-05-08T21:19:39.483 INFO:tasks.mds_thrash:joining mds_thrasher 2024-05-08T21:19:39.483 INFO:tasks.mds_thrash.fs.[cephfs]:stat['max_mds'] = 0 2024-05-08T21:19:39.483 INFO:tasks.mds_thrash.fs.[cephfs]:stat['deactivate'] = 0 2024-05-08T21:19:39.483 INFO:tasks.mds_thrash.fs.[cephfs]:stat['kill'] = 4 2024-05-08T21:19:39.484 INFO:tasks.mds_thrash:done joining 2024-05-08T21:19:39.484 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-05-08T21:19:39.523 INFO:tasks.kclient:Unmounting kernel clients... 2024-05-08T21:19:39.524 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T21:19:39.524 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T21:19:39.639 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T21:19:39.639 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T21:19:39.729 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T21:19:40.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.032+0000 7fb0d32e1700 1 Processor -- start 2024-05-08T21:19:40.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.032+0000 7fb0d32e1700 1 -- start start 2024-05-08T21:19:40.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.033+0000 7fb0d32e1700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb0cc150410 0x7fb0cc156dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:40.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.033+0000 7fb0d32e1700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb0cc0cb960 0x7fb0cc0cbd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:40.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.033+0000 7fb0d32e1700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0cc157300 con 0x7fb0cc0c6af0 2024-05-08T21:19:40.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.033+0000 7fb0d32e1700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0cc0cc2b0 con 0x7fb0cc150410 2024-05-08T21:19:40.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.033+0000 7fb0d32e1700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0cc0c2bf0 con 0x7fb0cc0cb960 2024-05-08T21:19:40.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.034+0000 7fb0d187e700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb0cc0cb960 0x7fb0cc0cbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:40.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.034+0000 7fb0d187e700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb0cc0cb960 0x7fb0cc0cbd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.80:55826/0 (socket says 172.21.15.80:55826) 2024-05-08T21:19:40.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.034+0000 7fb0d187e700 1 -- 172.21.15.80:0/1734204761 learned_addr learned my addr 172.21.15.80:0/1734204761 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:19:40.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.035+0000 7fb0d187e700 1 -- 172.21.15.80:0/1734204761 >> v2:172.21.15.80:3300/0 conn(0x7fb0cc150410 msgr2=0x7fb0cc156dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:19:40.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.035+0000 7fb0d187e700 1 --2- 172.21.15.80:0/1734204761 >> v2:172.21.15.80:3300/0 conn(0x7fb0cc150410 0x7fb0cc156dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:40.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.035+0000 7fb0d187e700 1 -- 172.21.15.80:0/1734204761 >> v1:172.21.15.106:6789/0 conn(0x7fb0cc0c6af0 legacy=0x7fb0cc0c3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:19:40.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.035+0000 7fb0d187e700 1 -- 172.21.15.80:0/1734204761 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0cc1507f0 con 0x7fb0cc0cb960 2024-05-08T21:19:40.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.035+0000 7fb0d187e700 1 --2- 172.21.15.80:0/1734204761 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0cc0cb960 0x7fb0cc0cbd70 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc0c6a30 tx=0x7fb0c400d650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5831f4790eb688b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:40.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.035+0000 7fb0c3fff700 1 -- 172.21.15.80:0/1734204761 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c4010070 con 0x7fb0cc0cb960 2024-05-08T21:19:40.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.035+0000 7fb0c3fff700 1 -- 172.21.15.80:0/1734204761 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0c400dca0 con 0x7fb0cc0cb960 2024-05-08T21:19:40.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.035+0000 7fb0c3fff700 1 -- 172.21.15.80:0/1734204761 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c4007d50 con 0x7fb0cc0cb960 2024-05-08T21:19:40.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.036+0000 7fb0d32e1700 1 -- 172.21.15.80:0/1734204761 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0cc0cb960 msgr2=0x7fb0cc0cbd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:40.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.036+0000 7fb0d32e1700 1 --2- 172.21.15.80:0/1734204761 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0cc0cb960 0x7fb0cc0cbd70 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc0c6a30 tx=0x7fb0c400d650 comp rx=0 tx=0).stop 2024-05-08T21:19:40.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.038+0000 7fb0d32e1700 1 -- 172.21.15.80:0/1734204761 shutdown_connections 2024-05-08T21:19:40.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.038+0000 7fb0d32e1700 1 --2- 172.21.15.80:0/1734204761 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0cc0cb960 0x7fb0cc0cbd70 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:40.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.038+0000 7fb0d32e1700 1 --2- 172.21.15.80:0/1734204761 >> v2:172.21.15.80:3300/0 conn(0x7fb0cc150410 0x7fb0cc156dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:40.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.038+0000 7fb0d32e1700 1 -- 172.21.15.80:0/1734204761 >> 172.21.15.80:0/1734204761 conn(0x7fb0cc06a9c0 msgr2=0x7fb0cc06ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:40.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.038+0000 7fb0d32e1700 1 -- 172.21.15.80:0/1734204761 shutdown_connections 2024-05-08T21:19:40.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.038+0000 7fb0d32e1700 1 -- 172.21.15.80:0/1734204761 wait complete. 2024-05-08T21:19:40.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.040+0000 7fb0d32e1700 1 Processor -- start 2024-05-08T21:19:40.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.040+0000 7fb0d32e1700 1 -- start start 2024-05-08T21:19:40.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.041+0000 7fb0d32e1700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0cc0c6af0 0x7fb0cc149490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:40.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.041+0000 7fb0d32e1700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb0cc0cb960 0x7fb0cc1f7c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:40.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.041+0000 7fb0d32e1700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb0cc150410 0x7fb0cc1f8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:40.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.041+0000 7fb0d32e1700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0cc148a80 con 0x7fb0cc0cb960 2024-05-08T21:19:40.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.041+0000 7fb0d32e1700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0cc1f87b0 con 0x7fb0cc0c6af0 2024-05-08T21:19:40.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.041+0000 7fb0d32e1700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0cc147d80 con 0x7fb0cc150410 2024-05-08T21:19:40.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.042+0000 7fb0d187e700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb0cc150410 0x7fb0cc1f8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:40.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.042+0000 7fb0d187e700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb0cc150410 0x7fb0cc1f8170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:43176/0 (socket says 172.21.15.80:43176) 2024-05-08T21:19:40.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.042+0000 7fb0d187e700 1 -- 172.21.15.80:0/1452461202 learned_addr learned my addr 172.21.15.80:0/1452461202 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:19:40.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.042+0000 7fb0d187e700 1 -- 172.21.15.80:0/1452461202 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0cc0c6af0 msgr2=0x7fb0cc149490 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T21:19:40.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.042+0000 7fb0d187e700 1 --2- 172.21.15.80:0/1452461202 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0cc0c6af0 0x7fb0cc149490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:40.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.042+0000 7fb0d187e700 1 -- 172.21.15.80:0/1452461202 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb0cc0cb960 msgr2=0x7fb0cc1f7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:40.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.042+0000 7fb0d187e700 1 --2- 172.21.15.80:0/1452461202 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb0cc0cb960 0x7fb0cc1f7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:40.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.042+0000 7fb0d187e700 1 -- 172.21.15.80:0/1452461202 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0c400d050 con 0x7fb0cc150410 2024-05-08T21:19:40.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.042+0000 7fb0d187e700 1 --2- 172.21.15.80:0/1452461202 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb0cc150410 0x7fb0cc1f8170 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb0c4018040 tx=0x7fb0c4004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:40.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.049+0000 7fb0c1ffb700 1 -- 172.21.15.80:0/1452461202 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c4004390 con 0x7fb0cc150410 2024-05-08T21:19:40.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.049+0000 7fb0c1ffb700 1 -- 172.21.15.80:0/1452461202 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0c40044f0 con 0x7fb0cc150410 2024-05-08T21:19:40.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.049+0000 7fb0c1ffb700 1 -- 172.21.15.80:0/1452461202 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c40048a0 con 0x7fb0cc150410 2024-05-08T21:19:40.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.051+0000 7fb0d32e1700 1 -- 172.21.15.80:0/1452461202 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0cc148060 con 0x7fb0cc150410 2024-05-08T21:19:40.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.051+0000 7fb0d32e1700 1 -- 172.21.15.80:0/1452461202 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0cc148f70 con 0x7fb0cc150410 2024-05-08T21:19:40.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.052+0000 7fb0d32e1700 1 -- 172.21.15.80:0/1452461202 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0cc149160 con 0x7fb0cc150410 2024-05-08T21:19:40.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.058+0000 7fb0c1ffb700 1 -- 172.21.15.80:0/1452461202 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb0c402f070 con 0x7fb0cc150410 2024-05-08T21:19:40.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.059+0000 7fb0c1ffb700 1 --2- 172.21.15.80:0/1452461202 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fb0b006ad60 0x7fb0b006d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:40.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.059+0000 7fb0c1ffb700 1 -- 172.21.15.80:0/1452461202 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7007+0+0 (secure 0 0 0) 0x7fb0c409c300 con 0x7fb0cc150410 2024-05-08T21:19:40.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.060+0000 7fb0d107d700 1 --2- 172.21.15.80:0/1452461202 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fb0b006ad60 0x7fb0b006d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:40.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.060+0000 7fb0c1ffb700 1 -- 172.21.15.80:0/1452461202 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fb0c4067210 con 0x7fb0cc150410 2024-05-08T21:19:40.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.061+0000 7fb0d107d700 1 --2- 172.21.15.80:0/1452461202 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fb0b006ad60 0x7fb0b006d220 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb0c8009730 tx=0x7fb0c8006cb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:40.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.443+0000 7fb0d32e1700 1 -- 172.21.15.80:0/1452461202 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb0cc0c1b50 con 0x7fb0cc150410 2024-05-08T21:19:40.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.445+0000 7fb0c1ffb700 1 -- 172.21.15.80:0/1452461202 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+18793 (secure 0 0 0) 0x7fb0c4040090 con 0x7fb0cc150410 2024-05-08T21:19:40.455 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:19:40.455 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":32,"fsid":"44d31c1e-aad3-47ca-a4fa-85a63d4a60aa","created":"2024-05-08T21:09:46.467038+0000","modified":"2024-05-08T21:19:06.330550+0000","last_up_change":"2024-05-08T21:09:57.284675+0000","last_in_change":"2024-05-08T21:09:49.125444+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T21:09:58.238951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T21:10:02.177476+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T21:10:02.685535+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-08T21:10:05.753779+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c3f9d93e-ed6d-4a0c-b5c0-0e8d44c65fdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":47011},{"type":"v1","addr":"172.21.15.80:6817","nonce":47011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":47011},{"type":"v1","addr":"172.21.15.80:6819","nonce":47011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":47011},{"type":"v1","addr":"172.21.15.80:6823","nonce":47011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":47011},{"type":"v1","addr":"172.21.15.80:6821","nonce":47011}]},"public_addr":"172.21.15.80:6817/47011","cluster_addr":"172.21.15.80:6819/47011","heartbeat_back_addr":"172.21.15.80:6823/47011","heartbeat_front_addr":"172.21.15.80:6821/47011","state":["exists","up"]},{"osd":1,"uuid":"4ce2b4d6-6c40-43aa-8dd1-743fef8915df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":47010},{"type":"v1","addr":"172.21.15.80:6809","nonce":47010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":47010},{"type":"v1","addr":"172.21.15.80:6811","nonce":47010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":47010},{"type":"v1","addr":"172.21.15.80:6815","nonce":47010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":47010},{"type":"v1","addr":"172.21.15.80:6813","nonce":47010}]},"public_addr":"172.21.15.80:6809/47010","cluster_addr":"172.21.15.80:6811/47010","heartbeat_back_addr":"172.21.15.80:6815/47010","heartbeat_front_addr":"172.21.15.80:6813/47010","state":["exists","up"]},{"osd":2,"uuid":"e30cc3bc-6461-4fac-960a-de00c9488d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":47009},{"type":"v1","addr":"172.21.15.80:6801","nonce":47009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":47009},{"type":"v1","addr":"172.21.15.80:6803","nonce":47009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":47009},{"type":"v1","addr":"172.21.15.80:6807","nonce":47009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":47009},{"type":"v1","addr":"172.21.15.80:6805","nonce":47009}]},"public_addr":"172.21.15.80:6801/47009","cluster_addr":"172.21.15.80:6803/47009","heartbeat_back_addr":"172.21.15.80:6807/47009","heartbeat_front_addr":"172.21.15.80:6805/47009","state":["exists","up"]},{"osd":3,"uuid":"a415c099-9ea6-40be-98ed-f2932f98dfd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":47012},{"type":"v1","addr":"172.21.15.80:6825","nonce":47012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":47012},{"type":"v1","addr":"172.21.15.80:6827","nonce":47012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":47012},{"type":"v1","addr":"172.21.15.80:6831","nonce":47012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":47012},{"type":"v1","addr":"172.21.15.80:6829","nonce":47012}]},"public_addr":"172.21.15.80:6825/47012","cluster_addr":"172.21.15.80:6827/47012","heartbeat_back_addr":"172.21.15.80:6831/47012","heartbeat_front_addr":"172.21.15.80:6829/47012","state":["exists","up"]},{"osd":4,"uuid":"5ae1d51f-0918-4571-b79b-154308d46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6823","nonce":47114},{"type":"v1","addr":"172.21.15.106:6825","nonce":47114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":47114},{"type":"v1","addr":"172.21.15.106:6827","nonce":47114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":47114},{"type":"v1","addr":"172.21.15.106:6831","nonce":47114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":47114},{"type":"v1","addr":"172.21.15.106:6829","nonce":47114}]},"public_addr":"172.21.15.106:6825/47114","cluster_addr":"172.21.15.106:6827/47114","heartbeat_back_addr":"172.21.15.106:6831/47114","heartbeat_front_addr":"172.21.15.106:6829/47114","state":["exists","up"]},{"osd":5,"uuid":"a19ac74e-4282-4428-b167-26ba6b92f732","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6807","nonce":47111},{"type":"v1","addr":"172.21.15.106:6809","nonce":47111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":47111},{"type":"v1","addr":"172.21.15.106:6811","nonce":47111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":47111},{"type":"v1","addr":"172.21.15.106:6815","nonce":47111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":47111},{"type":"v1","addr":"172.21.15.106:6813","nonce":47111}]},"public_addr":"172.21.15.106:6809/47111","cluster_addr":"172.21.15.106:6811/47111","heartbeat_back_addr":"172.21.15.106:6815/47111","heartbeat_front_addr":"172.21.15.106:6813/47111","state":["exists","up"]},{"osd":6,"uuid":"bfe72edd-7acc-4805-807d-2000e76f2feb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":47112},{"type":"v1","addr":"172.21.15.106:6817","nonce":47112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":47112},{"type":"v1","addr":"172.21.15.106:6819","nonce":47112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":47112},{"type":"v1","addr":"172.21.15.106:6824","nonce":47112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":47112},{"type":"v1","addr":"172.21.15.106:6821","nonce":47112}]},"public_addr":"172.21.15.106:6817/47112","cluster_addr":"172.21.15.106:6819/47112","heartbeat_back_addr":"172.21.15.106:6824/47112","heartbeat_front_addr":"172.21.15.106:6821/47112","state":["exists","up"]},{"osd":7,"uuid":"99897f22-ed17-4c7c-9088-cc0c4a51f786","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":47113},{"type":"v1","addr":"172.21.15.106:6801","nonce":47113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":47113},{"type":"v1","addr":"172.21.15.106:6803","nonce":47113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":47113},{"type":"v1","addr":"172.21.15.106:6808","nonce":47113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":47113},{"type":"v1","addr":"172.21.15.106:6805","nonce":47113}]},"public_addr":"172.21.15.106:6801/47113","cluster_addr":"172.21.15.106:6803/47113","heartbeat_back_addr":"172.21.15.106:6808/47113","heartbeat_front_addr":"172.21.15.106:6805/47113","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.232670+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.277753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.050087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.349312+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.344080+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.348781+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.352539+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.275013+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.27","mappings":[{"from":3,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.106:6833/791920806":"2024-05-09T21:19:06.330456+0000","172.21.15.106:6832/791920806":"2024-05-09T21:19:06.330456+0000","172.21.15.106:6836/1949999190":"2024-05-09T21:12:06.228867+0000","172.21.15.106:6834/1949999190":"2024-05-09T21:12:06.228867+0000","172.21.15.106:6834/1499761952":"2024-05-09T21:17:21.292339+0000","172.21.15.106:6832/2289230272":"2024-05-09T21:14:41.256000+0000","172.21.15.106:6833/2289230272":"2024-05-09T21:14:41.256000+0000","172.21.15.106:6836/1499761952":"2024-05-09T21:17:21.292339+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T21:19:40.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.455+0000 7fb0d32e1700 1 -- 172.21.15.80:0/1452461202 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fb0b006ad60 msgr2=0x7fb0b006d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:40.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.455+0000 7fb0d32e1700 1 --2- 172.21.15.80:0/1452461202 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fb0b006ad60 0x7fb0b006d220 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb0c8009730 tx=0x7fb0c8006cb0 comp rx=0 tx=0).stop 2024-05-08T21:19:40.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.455+0000 7fb0d32e1700 1 -- 172.21.15.80:0/1452461202 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb0cc150410 msgr2=0x7fb0cc1f8170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:40.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.455+0000 7fb0d32e1700 1 --2- 172.21.15.80:0/1452461202 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb0cc150410 0x7fb0cc1f8170 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb0c4018040 tx=0x7fb0c4004ad0 comp rx=0 tx=0).stop 2024-05-08T21:19:40.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.462+0000 7fb0d32e1700 1 -- 172.21.15.80:0/1452461202 shutdown_connections 2024-05-08T21:19:40.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.462+0000 7fb0d32e1700 1 --2- 172.21.15.80:0/1452461202 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fb0b006ad60 0x7fb0b006d220 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:40.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.462+0000 7fb0d32e1700 1 --2- 172.21.15.80:0/1452461202 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb0cc150410 0x7fb0cc1f8170 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:40.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.462+0000 7fb0d32e1700 1 --2- 172.21.15.80:0/1452461202 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0cc0c6af0 0x7fb0cc149490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:40.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.462+0000 7fb0d32e1700 1 --2- 172.21.15.80:0/1452461202 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb0cc0cb960 0x7fb0cc1f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:40.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.462+0000 7fb0d32e1700 1 -- 172.21.15.80:0/1452461202 >> 172.21.15.80:0/1452461202 conn(0x7fb0cc06a9c0 msgr2=0x7fb0cc14f2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:40.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.464+0000 7fb0d32e1700 1 -- 172.21.15.80:0/1452461202 shutdown_connections 2024-05-08T21:19:40.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.468+0000 7fb0d32e1700 1 -- 172.21.15.80:0/1452461202 wait complete. 2024-05-08T21:19:40.499 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T21:09:58.238951+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T21:10:02.177476+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T21:10:02.685535+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-08T21:10:05.753779+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-08T21:19:40.500 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T21:19:40.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.875+0000 7f8395c41700 1 Processor -- start 2024-05-08T21:19:40.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.877+0000 7f8395c41700 1 -- start start 2024-05-08T21:19:40.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.878+0000 7f8395c41700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f83901544e0 0x7f83900cb640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:40.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.878+0000 7f8395c41700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f83901548c0 0x7f83900ca850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:40.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.878+0000 7f8395c41700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f839015e610 con 0x7f83900c7270 2024-05-08T21:19:40.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.878+0000 7f8395c41700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83900cbe80 con 0x7f83901548c0 2024-05-08T21:19:40.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.878+0000 7f8395c41700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f839015da00 con 0x7f83901544e0 2024-05-08T21:19:40.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.879+0000 7f838effd700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f83901548c0 0x7f83900ca850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:40.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.879+0000 7f838effd700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f83901548c0 0x7f83900ca850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.80:55844/0 (socket says 172.21.15.80:55844) 2024-05-08T21:19:40.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.879+0000 7f838effd700 1 -- 172.21.15.80:0/3717446773 learned_addr learned my addr 172.21.15.80:0/3717446773 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:19:40.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.880+0000 7f838f7fe700 1 --2- 172.21.15.80:0/3717446773 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f83901544e0 0x7f83900cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:40.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.880+0000 7f838effd700 1 -- 172.21.15.80:0/3717446773 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f83901544e0 msgr2=0x7f83900cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:19:40.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.880+0000 7f838effd700 1 --2- 172.21.15.80:0/3717446773 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f83901544e0 0x7f83900cb640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:40.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.880+0000 7f838effd700 1 -- 172.21.15.80:0/3717446773 >> v1:172.21.15.80:6789/0 conn(0x7f83900c7270 legacy=0x7f83900cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:40.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.880+0000 7f838effd700 1 -- 172.21.15.80:0/3717446773 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f839015dce0 con 0x7f83901548c0 2024-05-08T21:19:40.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.880+0000 7f838effd700 1 --2- 172.21.15.80:0/3717446773 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f83901548c0 0x7f83900ca850 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f83840098f0 tx=0x7f8384009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d782551bfd4820e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:40.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.882+0000 7f838e7fc700 1 -- 172.21.15.80:0/3717446773 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838400b8a0 con 0x7f83901548c0 2024-05-08T21:19:40.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.882+0000 7f838e7fc700 1 -- 172.21.15.80:0/3717446773 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f838400ba00 con 0x7f83901548c0 2024-05-08T21:19:40.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.882+0000 7f838e7fc700 1 -- 172.21.15.80:0/3717446773 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838400bd70 con 0x7f83901548c0 2024-05-08T21:19:40.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.883+0000 7f8395c41700 1 -- 172.21.15.80:0/3717446773 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f83901548c0 msgr2=0x7f83900ca850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:40.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.883+0000 7f8395c41700 1 --2- 172.21.15.80:0/3717446773 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f83901548c0 0x7f83900ca850 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f83840098f0 tx=0x7f8384009c00 comp rx=0 tx=0).stop 2024-05-08T21:19:40.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.917+0000 7f8395c41700 1 -- 172.21.15.80:0/3717446773 shutdown_connections 2024-05-08T21:19:40.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.917+0000 7f8395c41700 1 --2- 172.21.15.80:0/3717446773 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f83901544e0 0x7f83900cb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:40.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.917+0000 7f8395c41700 1 --2- 172.21.15.80:0/3717446773 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f83901548c0 0x7f83900ca850 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:40.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.917+0000 7f8395c41700 1 -- 172.21.15.80:0/3717446773 >> 172.21.15.80:0/3717446773 conn(0x7f839006c810 msgr2=0x7f839006cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:40.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.917+0000 7f8395c41700 1 -- 172.21.15.80:0/3717446773 shutdown_connections 2024-05-08T21:19:40.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.917+0000 7f8395c41700 1 -- 172.21.15.80:0/3717446773 wait complete. 2024-05-08T21:19:40.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.919+0000 7f8395c41700 1 Processor -- start 2024-05-08T21:19:40.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.919+0000 7f8395c41700 1 -- start start 2024-05-08T21:19:40.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.921+0000 7f8395c41700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f83900c7270 0x7f83900c40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:40.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.921+0000 7f8395c41700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83901544e0 0x7f83901f6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:40.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.921+0000 7f8395c41700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f83901548c0 0x7f8390156b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:40.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.921+0000 7f8395c41700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f839015b2e0 con 0x7f83901544e0 2024-05-08T21:19:40.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.921+0000 7f8395c41700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83900caf90 con 0x7f83901548c0 2024-05-08T21:19:40.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.921+0000 7f8395c41700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8390200000 con 0x7f83900c7270 2024-05-08T21:19:40.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.921+0000 7f838ffff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f83901548c0 0x7f8390156b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:40.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.921+0000 7f838ffff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f83901548c0 0x7f8390156b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.80:55850/0 (socket says 172.21.15.80:55850) 2024-05-08T21:19:40.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.921+0000 7f838ffff700 1 -- 172.21.15.80:0/834803312 learned_addr learned my addr 172.21.15.80:0/834803312 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:19:40.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.921+0000 7f838f7fe700 1 --2- 172.21.15.80:0/834803312 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f83900c7270 0x7f83900c40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:40.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.922+0000 7f838f7fe700 1 -- 172.21.15.80:0/834803312 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f83901548c0 msgr2=0x7f8390156b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:40.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.922+0000 7f838f7fe700 1 --2- 172.21.15.80:0/834803312 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f83901548c0 0x7f8390156b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:40.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.922+0000 7f838f7fe700 1 -- 172.21.15.80:0/834803312 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83901544e0 msgr2=0x7f83901f6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:40.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.922+0000 7f838f7fe700 1 --2- 172.21.15.80:0/834803312 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83901544e0 0x7f83901f6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:40.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.922+0000 7f838f7fe700 1 -- 172.21.15.80:0/834803312 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8384009550 con 0x7f83900c7270 2024-05-08T21:19:40.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.922+0000 7f838f7fe700 1 --2- 172.21.15.80:0/834803312 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f83900c7270 0x7f83900c40c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f838800cd90 tx=0x7f838800a570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:40.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.927+0000 7f837ffff700 1 -- 172.21.15.80:0/834803312 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8388003a20 con 0x7f83900c7270 2024-05-08T21:19:40.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.927+0000 7f837ffff700 1 -- 172.21.15.80:0/834803312 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8388003b80 con 0x7f83900c7270 2024-05-08T21:19:40.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.927+0000 7f837ffff700 1 -- 172.21.15.80:0/834803312 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8388004020 con 0x7f83900c7270 2024-05-08T21:19:40.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.927+0000 7f8395c41700 1 -- 172.21.15.80:0/834803312 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83902002e0 con 0x7f83900c7270 2024-05-08T21:19:40.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.928+0000 7f8395c41700 1 -- 172.21.15.80:0/834803312 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83902008a0 con 0x7f83900c7270 2024-05-08T21:19:40.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.930+0000 7f8395c41700 1 -- 172.21.15.80:0/834803312 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f836c0052f0 con 0x7f83900c7270 2024-05-08T21:19:40.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.935+0000 7f837ffff700 1 -- 172.21.15.80:0/834803312 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8388004180 con 0x7f83900c7270 2024-05-08T21:19:40.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.935+0000 7f837ffff700 1 --2- 172.21.15.80:0/834803312 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f837406ad60 0x7f837406d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:40.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.935+0000 7f837ffff700 1 -- 172.21.15.80:0/834803312 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f8388012070 con 0x7f83900c7270 2024-05-08T21:19:40.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.936+0000 7f838effd700 1 --2- 172.21.15.80:0/834803312 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f837406ad60 0x7f837406d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:40.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.937+0000 7f838effd700 1 --2- 172.21.15.80:0/834803312 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f837406ad60 0x7f837406d220 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f83840098f0 tx=0x7f8384010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:40.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:40.943+0000 7f837ffff700 1 -- 172.21.15.80:0/834803312 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f8388054b70 con 0x7f83900c7270 2024-05-08T21:19:41.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:41.326+0000 7f8395c41700 1 -- 172.21.15.80:0/834803312 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f836c005b20 con 0x7f83900c7270 2024-05-08T21:19:41.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:41.331+0000 7f837ffff700 1 -- 172.21.15.80:0/834803312 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v32) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8388058190 con 0x7f83900c7270 2024-05-08T21:19:41.337 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-05-08T21:19:41.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:41.361+0000 7f8395c41700 1 -- 172.21.15.80:0/834803312 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f837406ad60 msgr2=0x7f837406d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:41.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:41.361+0000 7f8395c41700 1 --2- 172.21.15.80:0/834803312 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f837406ad60 0x7f837406d220 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f83840098f0 tx=0x7f8384010000 comp rx=0 tx=0).stop 2024-05-08T21:19:41.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:41.361+0000 7f8395c41700 1 -- 172.21.15.80:0/834803312 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f83900c7270 msgr2=0x7f83900c40c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:41.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:41.361+0000 7f8395c41700 1 --2- 172.21.15.80:0/834803312 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f83900c7270 0x7f83900c40c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f838800cd90 tx=0x7f838800a570 comp rx=0 tx=0).stop 2024-05-08T21:19:41.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:41.365+0000 7f8395c41700 1 -- 172.21.15.80:0/834803312 shutdown_connections 2024-05-08T21:19:41.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:41.365+0000 7f8395c41700 1 --2- 172.21.15.80:0/834803312 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f837406ad60 0x7f837406d220 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:41.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:41.365+0000 7f8395c41700 1 --2- 172.21.15.80:0/834803312 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f83901548c0 0x7f8390156b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:41.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:41.365+0000 7f8395c41700 1 --2- 172.21.15.80:0/834803312 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f83900c7270 0x7f83900c40c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:41.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:41.365+0000 7f8395c41700 1 --2- 172.21.15.80:0/834803312 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83901544e0 0x7f83901f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:41.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:41.365+0000 7f8395c41700 1 -- 172.21.15.80:0/834803312 >> 172.21.15.80:0/834803312 conn(0x7f839006c810 msgr2=0x7f83900d0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:41.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:41.365+0000 7f8395c41700 1 -- 172.21.15.80:0/834803312 shutdown_connections 2024-05-08T21:19:41.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:41.365+0000 7f8395c41700 1 -- 172.21.15.80:0/834803312 wait complete. 2024-05-08T21:19:41.407 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T21:19:41.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:41.714+0000 7fd31fa76700 1 Processor -- start 2024-05-08T21:19:41.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:41.715+0000 7fd31fa76700 1 -- start start 2024-05-08T21:19:41.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:41.716+0000 7fd31fa76700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd3180cba70 0x7fd3180c30e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:41.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:41.716+0000 7fd31fa76700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd318162860 0x7fd3180c7100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:41.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:41.716+0000 7fd31fa76700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3180c7640 con 0x7fd3180cbe50 2024-05-08T21:19:41.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:41.716+0000 7fd31fa76700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3180c2df0 con 0x7fd318162860 2024-05-08T21:19:41.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:41.716+0000 7fd31fa76700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd318162cd0 con 0x7fd3180cba70 2024-05-08T21:19:41.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:41.716+0000 7fd31d812700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd3180cba70 0x7fd3180c30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:41.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:41.716+0000 7fd31d812700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd3180cba70 0x7fd3180c30e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.80:55852/0 (socket says 172.21.15.80:55852) 2024-05-08T21:19:41.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:41.716+0000 7fd31d812700 1 -- 172.21.15.80:0/867137701 learned_addr learned my addr 172.21.15.80:0/867137701 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:19:41.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:41.717+0000 7fd31d812700 1 -- 172.21.15.80:0/867137701 >> v2:172.21.15.80:3300/0 conn(0x7fd318162860 msgr2=0x7fd3180c7100 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T21:19:41.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:41.717+0000 7fd31d812700 1 --2- 172.21.15.80:0/867137701 >> v2:172.21.15.80:3300/0 conn(0x7fd318162860 0x7fd3180c7100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:41.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:41.717+0000 7fd31d812700 1 -- 172.21.15.80:0/867137701 >> v1:172.21.15.106:6789/0 conn(0x7fd3180cbe50 legacy=0x7fd31815e750 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T21:19:41.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:41.717+0000 7fd31d812700 1 -- 172.21.15.80:0/867137701 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd31815f030 con 0x7fd3180cba70 2024-05-08T21:19:41.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:41.717+0000 7fd31d812700 1 --2- 172.21.15.80:0/867137701 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd3180cba70 0x7fd3180c30e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd3180cc3e0 tx=0x7fd308009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a8ee8e0ce7bd787 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:41.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:41.717+0000 7fd31c810700 1 -- 172.21.15.80:0/867137701 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd308004230 con 0x7fd3180cba70 2024-05-08T21:19:41.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:41.717+0000 7fd31c810700 1 -- 172.21.15.80:0/867137701 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd308004390 con 0x7fd3180cba70 2024-05-08T21:19:41.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:41.718+0000 7fd31c810700 1 -- 172.21.15.80:0/867137701 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3080036a0 con 0x7fd3180cba70 2024-05-08T21:19:41.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:41.719+0000 7fd31fa76700 1 -- 172.21.15.80:0/867137701 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd3180cba70 msgr2=0x7fd3180c30e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:41.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:41.719+0000 7fd31fa76700 1 --2- 172.21.15.80:0/867137701 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd3180cba70 0x7fd3180c30e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd3180cc3e0 tx=0x7fd308009bd0 comp rx=0 tx=0).stop 2024-05-08T21:19:41.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:41.719+0000 7fd31fa76700 1 -- 172.21.15.80:0/867137701 shutdown_connections 2024-05-08T21:19:41.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:41.719+0000 7fd31fa76700 1 --2- 172.21.15.80:0/867137701 >> v2:172.21.15.80:3300/0 conn(0x7fd318162860 0x7fd3180c7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:41.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:41.719+0000 7fd31fa76700 1 --2- 172.21.15.80:0/867137701 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd3180cba70 0x7fd3180c30e0 secure :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd3180cc3e0 tx=0x7fd308009bd0 comp rx=0 tx=0).stop 2024-05-08T21:19:41.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:41.719+0000 7fd31fa76700 1 -- 172.21.15.80:0/867137701 >> 172.21.15.80:0/867137701 conn(0x7fd31806a9c0 msgr2=0x7fd31806ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:41.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:41.726+0000 7fd31fa76700 1 -- 172.21.15.80:0/867137701 shutdown_connections 2024-05-08T21:19:41.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:41.726+0000 7fd31fa76700 1 -- 172.21.15.80:0/867137701 wait complete. 2024-05-08T21:19:41.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:41.727+0000 7fd31fa76700 1 Processor -- start 2024-05-08T21:19:41.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:41.729+0000 7fd31fa76700 1 -- start start 2024-05-08T21:19:41.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:41.730+0000 7fd31fa76700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd318162860 0x7fd3181495c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:41.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:41.730+0000 7fd31fa76700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd3180bf890 0x7fd31815d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:41.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:41.730+0000 7fd31fa76700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd3180729a0 0x7fd31815db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:41.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:41.730+0000 7fd31fa76700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd318071e60 con 0x7fd318162860 2024-05-08T21:19:41.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:41.730+0000 7fd31fa76700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd318072ff0 con 0x7fd3180729a0 2024-05-08T21:19:41.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:41.730+0000 7fd31fa76700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3180c0b10 con 0x7fd3180bf890 2024-05-08T21:19:41.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:41.730+0000 7fd31d011700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd3180bf890 0x7fd31815d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:41.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:41.730+0000 7fd31d011700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd3180bf890 0x7fd31815d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:43196/0 (socket says 172.21.15.80:43196) 2024-05-08T21:19:41.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:41.730+0000 7fd31d011700 1 -- 172.21.15.80:0/193353488 learned_addr learned my addr 172.21.15.80:0/193353488 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:19:41.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:41.731+0000 7fd31d812700 1 --2- 172.21.15.80:0/193353488 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd318162860 0x7fd3181495c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:41.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:41.731+0000 7fd31d011700 1 -- 172.21.15.80:0/193353488 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd3180729a0 msgr2=0x7fd31815db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:41.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:41.731+0000 7fd31d011700 1 --2- 172.21.15.80:0/193353488 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd3180729a0 0x7fd31815db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:41.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:41.731+0000 7fd31d011700 1 -- 172.21.15.80:0/193353488 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd318162860 msgr2=0x7fd3181495c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:41.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:41.731+0000 7fd31d011700 1 --2- 172.21.15.80:0/193353488 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd318162860 0x7fd3181495c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:41.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:41.731+0000 7fd31d011700 1 -- 172.21.15.80:0/193353488 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd308009550 con 0x7fd3180bf890 2024-05-08T21:19:41.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:41.731+0000 7fd31d011700 1 --2- 172.21.15.80:0/193353488 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd3180bf890 0x7fd31815d610 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd31400b4b0 tx=0x7fd31400b7c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:41.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:41.731+0000 7fd30e7fc700 1 -- 172.21.15.80:0/193353488 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd314011830 con 0x7fd3180bf890 2024-05-08T21:19:41.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:41.731+0000 7fd30e7fc700 1 -- 172.21.15.80:0/193353488 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd31400be90 con 0x7fd3180bf890 2024-05-08T21:19:41.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:41.731+0000 7fd30e7fc700 1 -- 172.21.15.80:0/193353488 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd314011bd0 con 0x7fd3180bf890 2024-05-08T21:19:41.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:41.732+0000 7fd31fa76700 1 -- 172.21.15.80:0/193353488 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3180c0db0 con 0x7fd3180bf890 2024-05-08T21:19:41.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:41.732+0000 7fd31fa76700 1 -- 172.21.15.80:0/193353488 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3180c1650 con 0x7fd3180bf890 2024-05-08T21:19:41.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:41.743+0000 7fd31fa76700 1 -- 172.21.15.80:0/193353488 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3180c11b0 con 0x7fd3180bf890 2024-05-08T21:19:41.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:41.769+0000 7fd30e7fc700 1 -- 172.21.15.80:0/193353488 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd314011d30 con 0x7fd3180bf890 2024-05-08T21:19:41.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:41.770+0000 7fd30e7fc700 1 --2- 172.21.15.80:0/193353488 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fd2fc06acc0 0x7fd2fc06d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:41.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:41.770+0000 7fd30e7fc700 1 -- 172.21.15.80:0/193353488 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7007+0+0 (secure 0 0 0) 0x7fd3140897c0 con 0x7fd3180bf890 2024-05-08T21:19:41.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:41.770+0000 7fd30e7fc700 1 -- 172.21.15.80:0/193353488 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fd31408bd50 con 0x7fd3180bf890 2024-05-08T21:19:41.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:41.770+0000 7fd31d812700 1 --2- 172.21.15.80:0/193353488 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fd2fc06acc0 0x7fd2fc06d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:41.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:41.771+0000 7fd31d812700 1 --2- 172.21.15.80:0/193353488 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fd2fc06acc0 0x7fd2fc06d180 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd3180c91c0 tx=0x7fd308008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:42.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.175+0000 7fd31fa76700 1 -- 172.21.15.80:0/193353488 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd31804ec60 con 0x7fd3180bf890 2024-05-08T21:19:42.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.179+0000 7fd30e7fc700 1 -- 172.21.15.80:0/193353488 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v32) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd314057e80 con 0x7fd3180bf890 2024-05-08T21:19:42.186 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-05-08T21:19:42.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.195+0000 7fd31fa76700 1 -- 172.21.15.80:0/193353488 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fd2fc06acc0 msgr2=0x7fd2fc06d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:42.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.195+0000 7fd31fa76700 1 --2- 172.21.15.80:0/193353488 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fd2fc06acc0 0x7fd2fc06d180 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd3180c91c0 tx=0x7fd308008030 comp rx=0 tx=0).stop 2024-05-08T21:19:42.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.195+0000 7fd31fa76700 1 -- 172.21.15.80:0/193353488 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd3180bf890 msgr2=0x7fd31815d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:42.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.195+0000 7fd31fa76700 1 --2- 172.21.15.80:0/193353488 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd3180bf890 0x7fd31815d610 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd31400b4b0 tx=0x7fd31400b7c0 comp rx=0 tx=0).stop 2024-05-08T21:19:42.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.196+0000 7fd31fa76700 1 -- 172.21.15.80:0/193353488 shutdown_connections 2024-05-08T21:19:42.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.196+0000 7fd31fa76700 1 --2- 172.21.15.80:0/193353488 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fd2fc06acc0 0x7fd2fc06d180 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:42.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.196+0000 7fd31fa76700 1 --2- 172.21.15.80:0/193353488 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd318162860 0x7fd3181495c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:42.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.196+0000 7fd31fa76700 1 --2- 172.21.15.80:0/193353488 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd3180729a0 0x7fd31815db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:42.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.196+0000 7fd31fa76700 1 --2- 172.21.15.80:0/193353488 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd3180bf890 0x7fd31815d610 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:42.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.196+0000 7fd31fa76700 1 -- 172.21.15.80:0/193353488 >> 172.21.15.80:0/193353488 conn(0x7fd31806a9c0 msgr2=0x7fd3180c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:42.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.198+0000 7fd31fa76700 1 -- 172.21.15.80:0/193353488 shutdown_connections 2024-05-08T21:19:42.200 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.198+0000 7fd31fa76700 1 -- 172.21.15.80:0/193353488 wait complete. 2024-05-08T21:19:42.232 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T21:19:42.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.575+0000 7fb0cd0c2700 1 Processor -- start 2024-05-08T21:19:42.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.575+0000 7fb0cd0c2700 1 -- start start 2024-05-08T21:19:42.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.576+0000 7fb0cd0c2700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb0c8162800 0x7fb0c80b4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:42.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.576+0000 7fb0cd0c2700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0c815e930 con 0x7fb0c80b45b0 2024-05-08T21:19:42.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.576+0000 7fb0cd0c2700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0c815ec10 con 0x7fb0c81587c0 2024-05-08T21:19:42.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.576+0000 7fb0cd0c2700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c815eef0 con 0x7fb0c8162800 2024-05-08T21:19:42.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.577+0000 7fb0c659c700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb0c80b45b0 0x7fb0c81620f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:51976/0 (socket says 172.21.15.80:51976) 2024-05-08T21:19:42.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.577+0000 7fb0c659c700 1 -- 172.21.15.80:0/2596756962 learned_addr learned my addr 172.21.15.80:0/2596756962 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:19:42.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.577+0000 7fb0c759e700 1 --2- 172.21.15.80:0/2596756962 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb0c8162800 0x7fb0c80b4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:42.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.577+0000 7fb0c5d9b700 1 -- 172.21.15.80:0/2596756962 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3412279901 0 0) 0x7fb0c815e930 con 0x7fb0c80b45b0 2024-05-08T21:19:42.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.577+0000 7fb0c5d9b700 1 -- 172.21.15.80:0/2596756962 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0b40035b0 con 0x7fb0c80b45b0 2024-05-08T21:19:42.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.577+0000 7fb0c5d9b700 1 -- 172.21.15.80:0/2596756962 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2305233866 0 0) 0x7fb0b40035b0 con 0x7fb0c80b45b0 2024-05-08T21:19:42.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.577+0000 7fb0c5d9b700 1 -- 172.21.15.80:0/2596756962 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb0c8162800 msgr2=0x7fb0c80b4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:19:42.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.577+0000 7fb0c5d9b700 1 --2- 172.21.15.80:0/2596756962 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb0c8162800 0x7fb0c80b4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:42.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.577+0000 7fb0c5d9b700 1 -- 172.21.15.80:0/2596756962 >> v1:172.21.15.106:6789/0 conn(0x7fb0c81587c0 legacy=0x7fb0c80cc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:42.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.577+0000 7fb0c5d9b700 1 -- 172.21.15.80:0/2596756962 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0c815f1d0 con 0x7fb0c80b45b0 2024-05-08T21:19:42.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.577+0000 7fb0c5d9b700 1 -- 172.21.15.80:0/2596756962 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3520646302 0 0) 0x7fb0c00016c0 con 0x7fb0c80b45b0 2024-05-08T21:19:42.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.577+0000 7fb0c5d9b700 1 -- 172.21.15.80:0/2596756962 >> v1:172.21.15.80:6789/0 conn(0x7fb0c80b45b0 legacy=0x7fb0c81620f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:42.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.577+0000 7fb0c5d9b700 1 --2- 172.21.15.80:0/2596756962 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb0b4003a30 0x7fb0b4003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:42.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.577+0000 7fb0c5d9b700 1 --2- 172.21.15.80:0/2596756962 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0b4004850 0x7fb0b4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:42.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.577+0000 7fb0c5d9b700 1 --2- 172.21.15.80:0/2596756962 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb0b4005210 0x7fb0b400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:42.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.577+0000 7fb0c5d9b700 1 -- 172.21.15.80:0/2596756962 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c815eef0 con 0x7fb0b4003a30 2024-05-08T21:19:42.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.577+0000 7fb0c5d9b700 1 -- 172.21.15.80:0/2596756962 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b400c060 con 0x7fb0b4004850 2024-05-08T21:19:42.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.577+0000 7fb0c5d9b700 1 -- 172.21.15.80:0/2596756962 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b400c220 con 0x7fb0b4005210 2024-05-08T21:19:42.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.577+0000 7fb0c659c700 1 --2- 172.21.15.80:0/2596756962 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0b4004850 0x7fb0b4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:42.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.578+0000 7fb0c659c700 1 -- 172.21.15.80:0/2596756962 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb0b4005210 msgr2=0x7fb0b400ba10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T21:19:42.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.578+0000 7fb0c659c700 1 --2- 172.21.15.80:0/2596756962 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb0b4005210 0x7fb0b400ba10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:42.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.578+0000 7fb0c659c700 1 -- 172.21.15.80:0/2596756962 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb0b4003a30 msgr2=0x7fb0b4003e50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T21:19:42.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.578+0000 7fb0c659c700 1 --2- 172.21.15.80:0/2596756962 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb0b4003a30 0x7fb0b4003e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:42.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.578+0000 7fb0c659c700 1 -- 172.21.15.80:0/2596756962 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b40035b0 con 0x7fb0b4004850 2024-05-08T21:19:42.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.578+0000 7fb0c659c700 1 --2- 172.21.15.80:0/2596756962 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0b4004850 0x7fb0b4004cd0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb0c000c160 tx=0x7fb0b4005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc6700292adf1d89 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:42.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.578+0000 7fb0c5d9b700 1 -- 172.21.15.80:0/2596756962 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c000cd00 con 0x7fb0b4004850 2024-05-08T21:19:42.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.578+0000 7fb0c5d9b700 1 -- 172.21.15.80:0/2596756962 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0c000ce60 con 0x7fb0b4004850 2024-05-08T21:19:42.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.578+0000 7fb0c5d9b700 1 -- 172.21.15.80:0/2596756962 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c0005ba0 con 0x7fb0b4004850 2024-05-08T21:19:42.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.579+0000 7fb0cd0c2700 1 -- 172.21.15.80:0/2596756962 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0b4004850 msgr2=0x7fb0b4004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:42.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.579+0000 7fb0cd0c2700 1 --2- 172.21.15.80:0/2596756962 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0b4004850 0x7fb0b4004cd0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb0c000c160 tx=0x7fb0b4005880 comp rx=0 tx=0).stop 2024-05-08T21:19:42.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.579+0000 7fb0c759e700 1 -- 172.21.15.80:0/2596756962 reap_dead start 2024-05-08T21:19:42.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.579+0000 7fb0cd0c2700 1 -- 172.21.15.80:0/2596756962 shutdown_connections 2024-05-08T21:19:42.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.579+0000 7fb0cd0c2700 1 -- 172.21.15.80:0/2596756962 >> 172.21.15.80:0/2596756962 conn(0x7fb0c806ad70 msgr2=0x7fb0c806c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:42.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.579+0000 7fb0cd0c2700 1 -- 172.21.15.80:0/2596756962 shutdown_connections 2024-05-08T21:19:42.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.579+0000 7fb0cd0c2700 1 -- 172.21.15.80:0/2596756962 wait complete. 2024-05-08T21:19:42.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.581+0000 7fb0cd0c2700 1 Processor -- start 2024-05-08T21:19:42.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.581+0000 7fb0cd0c2700 1 -- start start 2024-05-08T21:19:42.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.582+0000 7fb0cd0c2700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0b4004850 0x7fb0c81574d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:42.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.582+0000 7fb0cd0c2700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb0c815dfd0 0x7fb0c814a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:42.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.582+0000 7fb0cd0c2700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb0c81f7c00 0x7fb0c8152720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:42.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.582+0000 7fb0cd0c2700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c8156660 con 0x7fb0c81f7c00 2024-05-08T21:19:42.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.582+0000 7fb0cd0c2700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c81559c0 con 0x7fb0b4004850 2024-05-08T21:19:42.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.582+0000 7fb0cd0c2700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c80cf4d0 con 0x7fb0c815dfd0 2024-05-08T21:19:42.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.586+0000 7fb0c6d9d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0b4004850 0x7fb0c81574d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:42.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.586+0000 7fb0c6d9d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0b4004850 0x7fb0c81574d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.80:37216/0 (socket says 172.21.15.80:37216) 2024-05-08T21:19:42.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.586+0000 7fb0c6d9d700 1 -- 172.21.15.80:0/1385059097 learned_addr learned my addr 172.21.15.80:0/1385059097 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:19:42.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.587+0000 7fb0c659c700 1 --2- 172.21.15.80:0/1385059097 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb0c815dfd0 0x7fb0c814a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:42.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.587+0000 7fb0c759e700 1 --2- 172.21.15.80:0/1385059097 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb0c81f7c00 0x7fb0c8152720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:42.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.587+0000 7fb0c759e700 1 -- 172.21.15.80:0/1385059097 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb0c815dfd0 msgr2=0x7fb0c814a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:42.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.587+0000 7fb0c759e700 1 --2- 172.21.15.80:0/1385059097 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb0c815dfd0 0x7fb0c814a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:42.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.587+0000 7fb0c759e700 1 -- 172.21.15.80:0/1385059097 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0b4004850 msgr2=0x7fb0c81574d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:42.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.587+0000 7fb0c759e700 1 --2- 172.21.15.80:0/1385059097 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0b4004850 0x7fb0c81574d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:42.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.587+0000 7fb0c759e700 1 -- 172.21.15.80:0/1385059097 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0c8157a10 con 0x7fb0c81f7c00 2024-05-08T21:19:42.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.588+0000 7fb0c759e700 1 --2- 172.21.15.80:0/1385059097 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb0c81f7c00 0x7fb0c8152720 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fb0c815c1f0 tx=0x7fb0b800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:42.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.588+0000 7fb0bf7fe700 1 -- 172.21.15.80:0/1385059097 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b8009bc0 con 0x7fb0c81f7c00 2024-05-08T21:19:42.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.588+0000 7fb0bf7fe700 1 -- 172.21.15.80:0/1385059097 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0b800f040 con 0x7fb0c81f7c00 2024-05-08T21:19:42.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.588+0000 7fb0bf7fe700 1 -- 172.21.15.80:0/1385059097 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b800c860 con 0x7fb0c81f7c00 2024-05-08T21:19:42.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.589+0000 7fb0cd0c2700 1 -- 172.21.15.80:0/1385059097 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0c80c9630 con 0x7fb0c81f7c00 2024-05-08T21:19:42.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.589+0000 7fb0cd0c2700 1 -- 172.21.15.80:0/1385059097 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0c8155300 con 0x7fb0c81f7c00 2024-05-08T21:19:42.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.590+0000 7fb0cd0c2700 1 -- 172.21.15.80:0/1385059097 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0c8157fb0 con 0x7fb0c81f7c00 2024-05-08T21:19:42.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.592+0000 7fb0bf7fe700 1 -- 172.21.15.80:0/1385059097 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb0b800c9c0 con 0x7fb0c81f7c00 2024-05-08T21:19:42.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.593+0000 7fb0bf7fe700 1 --2- 172.21.15.80:0/1385059097 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fb0a806ad60 0x7fb0a806d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:42.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.593+0000 7fb0bf7fe700 1 -- 172.21.15.80:0/1385059097 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7007+0+0 (secure 0 0 0) 0x7fb0b809b360 con 0x7fb0c81f7c00 2024-05-08T21:19:42.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.599+0000 7fb0bf7fe700 1 -- 172.21.15.80:0/1385059097 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fb0b8066010 con 0x7fb0c81f7c00 2024-05-08T21:19:42.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.604+0000 7fb0c6d9d700 1 --2- 172.21.15.80:0/1385059097 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fb0a806ad60 0x7fb0a806d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:42.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.605+0000 7fb0c6d9d700 1 --2- 172.21.15.80:0/1385059097 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fb0a806ad60 0x7fb0a806d220 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb0b00019b0 tx=0x7fb0b0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:42.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.970+0000 7fb0cd0c2700 1 -- 172.21.15.80:0/1385059097 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb0c804ec60 con 0x7fb0c81f7c00 2024-05-08T21:19:42.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:42.973+0000 7fb0bf7fe700 1 -- 172.21.15.80:0/1385059097 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v32) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb0b8069630 con 0x7fb0c81f7c00 2024-05-08T21:19:42.978 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-05-08T21:19:43.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:43.001+0000 7fb0cd0c2700 1 -- 172.21.15.80:0/1385059097 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fb0a806ad60 msgr2=0x7fb0a806d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:43.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:43.001+0000 7fb0cd0c2700 1 --2- 172.21.15.80:0/1385059097 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fb0a806ad60 0x7fb0a806d220 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb0b00019b0 tx=0x7fb0b0009040 comp rx=0 tx=0).stop 2024-05-08T21:19:43.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:43.001+0000 7fb0cd0c2700 1 -- 172.21.15.80:0/1385059097 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb0c81f7c00 msgr2=0x7fb0c8152720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:43.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:43.001+0000 7fb0cd0c2700 1 --2- 172.21.15.80:0/1385059097 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb0c81f7c00 0x7fb0c8152720 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fb0c815c1f0 tx=0x7fb0b800ef60 comp rx=0 tx=0).stop 2024-05-08T21:19:43.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:43.008+0000 7fb0cd0c2700 1 -- 172.21.15.80:0/1385059097 shutdown_connections 2024-05-08T21:19:43.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:43.008+0000 7fb0cd0c2700 1 --2- 172.21.15.80:0/1385059097 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fb0a806ad60 0x7fb0a806d220 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:43.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:43.008+0000 7fb0cd0c2700 1 --2- 172.21.15.80:0/1385059097 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb0c81f7c00 0x7fb0c8152720 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:43.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:43.008+0000 7fb0cd0c2700 1 --2- 172.21.15.80:0/1385059097 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0b4004850 0x7fb0c81574d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:43.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:43.008+0000 7fb0cd0c2700 1 --2- 172.21.15.80:0/1385059097 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb0c815dfd0 0x7fb0c814a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:43.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:43.008+0000 7fb0cd0c2700 1 -- 172.21.15.80:0/1385059097 >> 172.21.15.80:0/1385059097 conn(0x7fb0c806ad70 msgr2=0x7fb0c8151770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:43.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:43.019+0000 7fb0cd0c2700 1 -- 172.21.15.80:0/1385059097 shutdown_connections 2024-05-08T21:19:43.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:43.025+0000 7fb0cd0c2700 1 -- 172.21.15.80:0/1385059097 wait complete. 2024-05-08T21:19:43.074 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-08T21:19:43.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:43.467+0000 7f84c125a700 1 Processor -- start 2024-05-08T21:19:43.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:43.468+0000 7f84c125a700 1 -- start start 2024-05-08T21:19:43.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:43.468+0000 7f84c125a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f84bc0c83a0 0x7f84bc0711f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:43.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:43.468+0000 7f84c125a700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84bc152800 con 0x7f84bc158ac0 2024-05-08T21:19:43.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:43.468+0000 7f84c125a700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84bc0c7800 con 0x7f84bc152420 2024-05-08T21:19:43.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:43.468+0000 7f84c125a700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84bc0729b0 con 0x7f84bc0c83a0 2024-05-08T21:19:43.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:43.469+0000 7f84ba59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f84bc0c83a0 0x7f84bc0711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:43.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:43.469+0000 7f84ba59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f84bc0c83a0 0x7f84bc0711f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59726/0 (socket says 172.21.15.80:59726) 2024-05-08T21:19:43.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:43.469+0000 7f84bb59e700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f84bc158ac0 0x7f84bc071730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:51984/0 (socket says 172.21.15.80:51984) 2024-05-08T21:19:43.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:43.469+0000 7f84ba59c700 1 -- 172.21.15.80:0/2367802245 learned_addr learned my addr 172.21.15.80:0/2367802245 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:19:43.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:43.469+0000 7f84ba59c700 1 -- 172.21.15.80:0/2367802245 >> v1:172.21.15.106:6789/0 conn(0x7f84bc152420 legacy=0x7f84bc0c7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:43.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:43.469+0000 7f84ba59c700 1 -- 172.21.15.80:0/2367802245 >> v1:172.21.15.80:6789/0 conn(0x7f84bc158ac0 legacy=0x7f84bc071730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:43.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:43.469+0000 7f84ba59c700 1 -- 172.21.15.80:0/2367802245 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84bc066d80 con 0x7f84bc0c83a0 2024-05-08T21:19:43.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:43.469+0000 7f84ba59c700 1 --2- 172.21.15.80:0/2367802245 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f84bc0c83a0 0x7f84bc0711f0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f84b00098f0 tx=0x7f84b0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83418475f7bafe4a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:43.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:43.469+0000 7f84b9d9b700 1 -- 172.21.15.80:0/2367802245 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b000b8a0 con 0x7f84bc0c83a0 2024-05-08T21:19:43.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:43.469+0000 7f84b9d9b700 1 -- 172.21.15.80:0/2367802245 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84b000ba00 con 0x7f84bc0c83a0 2024-05-08T21:19:43.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:43.469+0000 7f84b9d9b700 1 -- 172.21.15.80:0/2367802245 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b000bd90 con 0x7f84bc0c83a0 2024-05-08T21:19:43.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:43.470+0000 7f84c125a700 1 -- 172.21.15.80:0/2367802245 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f84bc0c83a0 msgr2=0x7f84bc0711f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:43.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:43.470+0000 7f84c125a700 1 --2- 172.21.15.80:0/2367802245 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f84bc0c83a0 0x7f84bc0711f0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f84b00098f0 tx=0x7f84b0009c00 comp rx=0 tx=0).stop 2024-05-08T21:19:43.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:43.470+0000 7f84c125a700 1 -- 172.21.15.80:0/2367802245 shutdown_connections 2024-05-08T21:19:43.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:43.470+0000 7f84c125a700 1 --2- 172.21.15.80:0/2367802245 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f84bc0c83a0 0x7f84bc0711f0 secure :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f84b00098f0 tx=0x7f84b0009c00 comp rx=0 tx=0).stop 2024-05-08T21:19:43.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:43.470+0000 7f84c125a700 1 -- 172.21.15.80:0/2367802245 >> 172.21.15.80:0/2367802245 conn(0x7f84bc0c8980 msgr2=0x7f84bc0c8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:43.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:43.470+0000 7f84c125a700 1 -- 172.21.15.80:0/2367802245 shutdown_connections 2024-05-08T21:19:43.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:43.470+0000 7f84c125a700 1 -- 172.21.15.80:0/2367802245 wait complete. 2024-05-08T21:19:43.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:43.472+0000 7f84c125a700 1 Processor -- start 2024-05-08T21:19:43.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:43.473+0000 7f84c125a700 1 -- start start 2024-05-08T21:19:43.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:43.473+0000 7f84c125a700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f84bc152420 0x7f84bc1f7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:43.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:43.473+0000 7f84c125a700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f84bc158ac0 0x7f84bc1f7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:43.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:43.473+0000 7f84c125a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f84bc06ba30 0x7f84bc156a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:43.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:43.473+0000 7f84c125a700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc0c5e70 con 0x7f84bc06ba30 2024-05-08T21:19:43.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:43.473+0000 7f84c125a700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc1516e0 con 0x7f84bc158ac0 2024-05-08T21:19:43.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:43.474+0000 7f84c125a700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc14d7c0 con 0x7f84bc152420 2024-05-08T21:19:43.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:43.474+0000 7f84ba59c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f84bc158ac0 0x7f84bc1f7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:43.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:43.474+0000 7f84bb59e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f84bc06ba30 0x7f84bc156a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:43.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:43.474+0000 7f84ba59c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f84bc158ac0 0x7f84bc1f7e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.80:37224/0 (socket says 172.21.15.80:37224) 2024-05-08T21:19:43.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:43.474+0000 7f84ba59c700 1 -- 172.21.15.80:0/2032684889 learned_addr learned my addr 172.21.15.80:0/2032684889 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:19:43.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:43.474+0000 7f84ba59c700 1 -- 172.21.15.80:0/2032684889 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f84bc152420 msgr2=0x7f84bc1f7920 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T21:19:43.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:43.474+0000 7f84ba59c700 1 --2- 172.21.15.80:0/2032684889 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f84bc152420 0x7f84bc1f7920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:43.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:43.474+0000 7f84ba59c700 1 -- 172.21.15.80:0/2032684889 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f84bc06ba30 msgr2=0x7f84bc156a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:43.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:43.474+0000 7f84ba59c700 1 --2- 172.21.15.80:0/2032684889 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f84bc06ba30 0x7f84bc156a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:43.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:43.474+0000 7f84ba59c700 1 -- 172.21.15.80:0/2032684889 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b0009550 con 0x7f84bc158ac0 2024-05-08T21:19:43.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:43.474+0000 7f84ba59c700 1 --2- 172.21.15.80:0/2032684889 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f84bc158ac0 0x7f84bc1f7e60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f84b0013000 tx=0x7f84b0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:43.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:43.481+0000 7f84a37fe700 1 -- 172.21.15.80:0/2032684889 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b0004450 con 0x7f84bc158ac0 2024-05-08T21:19:43.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:43.481+0000 7f84a37fe700 1 -- 172.21.15.80:0/2032684889 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84b00045d0 con 0x7f84bc158ac0 2024-05-08T21:19:43.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:43.481+0000 7f84a37fe700 1 -- 172.21.15.80:0/2032684889 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b00038e0 con 0x7f84bc158ac0 2024-05-08T21:19:43.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:43.482+0000 7f84c125a700 1 -- 172.21.15.80:0/2032684889 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84bc1f8440 con 0x7f84bc158ac0 2024-05-08T21:19:43.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:43.482+0000 7f84c125a700 1 -- 172.21.15.80:0/2032684889 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84bc0c54d0 con 0x7f84bc158ac0 2024-05-08T21:19:43.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:43.485+0000 7f84c125a700 1 -- 172.21.15.80:0/2032684889 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f849c0052f0 con 0x7f84bc158ac0 2024-05-08T21:19:43.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:43.486+0000 7f84a37fe700 1 -- 172.21.15.80:0/2032684889 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f84b0003a40 con 0x7f84bc158ac0 2024-05-08T21:19:43.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:43.487+0000 7f84a37fe700 1 --2- 172.21.15.80:0/2032684889 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f84a806ad90 0x7f84a806d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:43.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:43.487+0000 7f84a37fe700 1 -- 172.21.15.80:0/2032684889 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f84b008a990 con 0x7f84bc158ac0 2024-05-08T21:19:43.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:43.488+0000 7f84bad9d700 1 --2- 172.21.15.80:0/2032684889 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f84a806ad90 0x7f84a806d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:43.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:43.495+0000 7f84bad9d700 1 --2- 172.21.15.80:0/2032684889 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f84a806ad90 0x7f84a806d250 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f84ac0015c0 tx=0x7f84ac007a40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:43.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:43.524+0000 7f84a37fe700 1 -- 172.21.15.80:0/2032684889 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f84b0055760 con 0x7f84bc158ac0 2024-05-08T21:19:43.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:43.985+0000 7f84c125a700 1 -- 172.21.15.80:0/2032684889 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f849c005b20 con 0x7f84bc158ac0 2024-05-08T21:19:43.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:43.989+0000 7f84a37fe700 1 -- 172.21.15.80:0/2032684889 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v32) v1 ==== 103+0+11 (secure 0 0 0) 0x7f84b005f030 con 0x7f84bc158ac0 2024-05-08T21:19:43.993 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-05-08T21:19:44.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:44.006+0000 7f84c125a700 1 -- 172.21.15.80:0/2032684889 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f84a806ad90 msgr2=0x7f84a806d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:44.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:44.006+0000 7f84c125a700 1 --2- 172.21.15.80:0/2032684889 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f84a806ad90 0x7f84a806d250 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f84ac0015c0 tx=0x7f84ac007a40 comp rx=0 tx=0).stop 2024-05-08T21:19:44.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:44.006+0000 7f84c125a700 1 -- 172.21.15.80:0/2032684889 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f84bc158ac0 msgr2=0x7f84bc1f7e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:44.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:44.006+0000 7f84c125a700 1 --2- 172.21.15.80:0/2032684889 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f84bc158ac0 0x7f84bc1f7e60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f84b0013000 tx=0x7f84b0004750 comp rx=0 tx=0).stop 2024-05-08T21:19:44.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:44.006+0000 7f84c125a700 1 -- 172.21.15.80:0/2032684889 shutdown_connections 2024-05-08T21:19:44.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:44.006+0000 7f84c125a700 1 --2- 172.21.15.80:0/2032684889 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f84a806ad90 0x7f84a806d250 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:44.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:44.006+0000 7f84c125a700 1 --2- 172.21.15.80:0/2032684889 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f84bc06ba30 0x7f84bc156a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:44.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:44.006+0000 7f84c125a700 1 --2- 172.21.15.80:0/2032684889 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f84bc152420 0x7f84bc1f7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:44.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:44.006+0000 7f84c125a700 1 --2- 172.21.15.80:0/2032684889 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f84bc158ac0 0x7f84bc1f7e60 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:44.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:44.006+0000 7f84c125a700 1 -- 172.21.15.80:0/2032684889 >> 172.21.15.80:0/2032684889 conn(0x7f84bc0c8980 msgr2=0x7f84bc14fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:44.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:44.006+0000 7f84c125a700 1 -- 172.21.15.80:0/2032684889 shutdown_connections 2024-05-08T21:19:44.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:44.006+0000 7f84c125a700 1 -- 172.21.15.80:0/2032684889 wait complete. 2024-05-08T21:19:44.111 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-08T21:19:46.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:46.403+0000 7f3e4ecd0700 1 Processor -- start 2024-05-08T21:19:46.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:46.403+0000 7f3e4ecd0700 1 -- start start 2024-05-08T21:19:46.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:46.404+0000 7f3e4ecd0700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f3e48150ea0 0x7f3e480cb830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:46.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:46.404+0000 7f3e4ecd0700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e480c70e0 con 0x7f3e48150ac0 2024-05-08T21:19:46.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:46.404+0000 7f3e4ecd0700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e480c8820 con 0x7f3e480c8cb0 2024-05-08T21:19:46.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:46.404+0000 7f3e4ecd0700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e480c6b60 con 0x7f3e48150ea0 2024-05-08T21:19:46.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:46.409+0000 7f3e47fff700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f3e480c8cb0 0x7f3e480c3f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.80:50416/0 (socket says 172.21.15.80:50416) 2024-05-08T21:19:46.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:46.409+0000 7f3e47fff700 1 -- 172.21.15.80:0/2335658257 learned_addr learned my addr 172.21.15.80:0/2335658257 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:19:46.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:46.409+0000 7f3e4d26d700 1 --2- 172.21.15.80:0/2335658257 >> v2:172.21.15.106:3300/0 conn(0x7f3e48150ea0 0x7f3e480cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:46.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:46.409+0000 7f3e4d26d700 1 -- 172.21.15.80:0/2335658257 >> v1:172.21.15.106:6789/0 conn(0x7f3e480c8cb0 legacy=0x7f3e480c3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:46.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:46.409+0000 7f3e4d26d700 1 -- 172.21.15.80:0/2335658257 >> v1:172.21.15.80:6789/0 conn(0x7f3e48150ac0 legacy=0x7f3e4815ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:19:46.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:46.409+0000 7f3e4d26d700 1 -- 172.21.15.80:0/2335658257 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e480c6e00 con 0x7f3e48150ea0 2024-05-08T21:19:46.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:46.410+0000 7f3e4d26d700 1 --2- 172.21.15.80:0/2335658257 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e48150ea0 0x7f3e480cb830 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3e40009dc0 tx=0x7f3e4000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf8cba75e21b19c8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:46.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:46.413+0000 7f3e477fe700 1 -- 172.21.15.80:0/2335658257 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4000e070 con 0x7f3e48150ea0 2024-05-08T21:19:46.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:46.413+0000 7f3e477fe700 1 -- 172.21.15.80:0/2335658257 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e4000bad0 con 0x7f3e48150ea0 2024-05-08T21:19:46.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:46.413+0000 7f3e477fe700 1 -- 172.21.15.80:0/2335658257 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4000be60 con 0x7f3e48150ea0 2024-05-08T21:19:46.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:46.415+0000 7f3e4ecd0700 1 -- 172.21.15.80:0/2335658257 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e48150ea0 msgr2=0x7f3e480cb830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:46.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:46.415+0000 7f3e4ecd0700 1 --2- 172.21.15.80:0/2335658257 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e48150ea0 0x7f3e480cb830 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3e40009dc0 tx=0x7f3e4000b330 comp rx=0 tx=0).stop 2024-05-08T21:19:46.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:46.415+0000 7f3e4ecd0700 1 -- 172.21.15.80:0/2335658257 shutdown_connections 2024-05-08T21:19:46.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:46.415+0000 7f3e4ecd0700 1 --2- 172.21.15.80:0/2335658257 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e48150ea0 0x7f3e480cb830 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:46.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:46.415+0000 7f3e4ecd0700 1 -- 172.21.15.80:0/2335658257 >> 172.21.15.80:0/2335658257 conn(0x7f3e4806a9c0 msgr2=0x7f3e4806ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:46.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:46.425+0000 7f3e4ecd0700 1 -- 172.21.15.80:0/2335658257 shutdown_connections 2024-05-08T21:19:46.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:46.426+0000 7f3e4ecd0700 1 -- 172.21.15.80:0/2335658257 wait complete. 2024-05-08T21:19:46.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:46.428+0000 7f3e4ecd0700 1 Processor -- start 2024-05-08T21:19:46.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:46.430+0000 7f3e4ecd0700 1 -- start start 2024-05-08T21:19:46.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:46.431+0000 7f3e4ecd0700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e480c8cb0 0x7f3e48142170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:46.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:46.431+0000 7f3e4ecd0700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e48150ea0 0x7f3e4813ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:46.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:46.431+0000 7f3e4ecd0700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3e481578b0 0x7f3e48140440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:46.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:46.431+0000 7f3e4ecd0700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e480bfa90 con 0x7f3e48150ea0 2024-05-08T21:19:46.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:46.431+0000 7f3e4ecd0700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e480c0ef0 con 0x7f3e480c8cb0 2024-05-08T21:19:46.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:46.431+0000 7f3e4ecd0700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e481f7700 con 0x7f3e481578b0 2024-05-08T21:19:46.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:46.432+0000 7f3e4d26d700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3e481578b0 0x7f3e48140440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:46.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:46.432+0000 7f3e4d26d700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3e481578b0 0x7f3e48140440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:57164/0 (socket says 172.21.15.80:57164) 2024-05-08T21:19:46.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:46.432+0000 7f3e4d26d700 1 -- 172.21.15.80:0/2988098291 learned_addr learned my addr 172.21.15.80:0/2988098291 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:19:46.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:46.432+0000 7f3e4d26d700 1 -- 172.21.15.80:0/2988098291 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e480c8cb0 msgr2=0x7f3e48142170 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T21:19:46.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:46.432+0000 7f3e4d26d700 1 --2- 172.21.15.80:0/2988098291 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e480c8cb0 0x7f3e48142170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:46.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:46.432+0000 7f3e4d26d700 1 -- 172.21.15.80:0/2988098291 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e48150ea0 msgr2=0x7f3e4813ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:46.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:46.432+0000 7f3e4d26d700 1 --2- 172.21.15.80:0/2988098291 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e48150ea0 0x7f3e4813ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:46.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:46.432+0000 7f3e4d26d700 1 -- 172.21.15.80:0/2988098291 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e40009a70 con 0x7f3e481578b0 2024-05-08T21:19:46.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:46.432+0000 7f3e4d26d700 1 --2- 172.21.15.80:0/2988098291 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3e481578b0 0x7f3e48140440 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3e4000b370 tx=0x7f3e40004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:46.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:46.438+0000 7f3e457fa700 1 -- 172.21.15.80:0/2988098291 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e40004950 con 0x7f3e481578b0 2024-05-08T21:19:46.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:46.438+0000 7f3e457fa700 1 -- 172.21.15.80:0/2988098291 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e40003e30 con 0x7f3e481578b0 2024-05-08T21:19:46.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:46.438+0000 7f3e457fa700 1 -- 172.21.15.80:0/2988098291 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e40012690 con 0x7f3e481578b0 2024-05-08T21:19:46.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:46.438+0000 7f3e4ecd0700 1 -- 172.21.15.80:0/2988098291 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e481f79e0 con 0x7f3e481578b0 2024-05-08T21:19:46.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:46.438+0000 7f3e4ecd0700 1 -- 172.21.15.80:0/2988098291 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e481f7fa0 con 0x7f3e481578b0 2024-05-08T21:19:46.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:46.441+0000 7f3e4ecd0700 1 -- 172.21.15.80:0/2988098291 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e480c1030 con 0x7f3e481578b0 2024-05-08T21:19:46.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:46.442+0000 7f3e457fa700 1 -- 172.21.15.80:0/2988098291 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3e400127f0 con 0x7f3e481578b0 2024-05-08T21:19:46.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:46.443+0000 7f3e457fa700 1 --2- 172.21.15.80:0/2988098291 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f3e3406ad60 0x7f3e3406d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:46.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:46.443+0000 7f3e457fa700 1 -- 172.21.15.80:0/2988098291 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f3e4008baa0 con 0x7f3e481578b0 2024-05-08T21:19:46.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:46.445+0000 7f3e4ca6c700 1 --2- 172.21.15.80:0/2988098291 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f3e3406ad60 0x7f3e3406d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:46.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:46.446+0000 7f3e4ca6c700 1 --2- 172.21.15.80:0/2988098291 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f3e3406ad60 0x7f3e3406d220 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3e480c9130 tx=0x7f3e38007a20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:46.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:46.447+0000 7f3e457fa700 1 -- 172.21.15.80:0/2988098291 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f3e480c1030 con 0x7f3e481578b0 2024-05-08T21:19:46.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:46.828+0000 7f3e4ecd0700 1 -- 172.21.15.80:0/2988098291 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3e480c1030 con 0x7f3e481578b0 2024-05-08T21:19:46.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:46.834+0000 7f3e457fa700 1 -- 172.21.15.80:0/2988098291 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 8 entries v32) v1 ==== 80+0+494 (secure 0 0 0) 0x7f3e480c1030 con 0x7f3e481578b0 2024-05-08T21:19:46.838 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.106:6833/791920806 2024-05-09T21:19:06.330456+0000 2024-05-08T21:19:46.838 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.106:6832/791920806 2024-05-09T21:19:06.330456+0000 2024-05-08T21:19:46.838 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.106:6836/1949999190 2024-05-09T21:12:06.228867+0000 2024-05-08T21:19:46.838 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.106:6834/1949999190 2024-05-09T21:12:06.228867+0000 2024-05-08T21:19:46.838 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.106:6834/1499761952 2024-05-09T21:17:21.292339+0000 2024-05-08T21:19:46.838 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.106:6832/2289230272 2024-05-09T21:14:41.256000+0000 2024-05-08T21:19:46.838 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.106:6833/2289230272 2024-05-09T21:14:41.256000+0000 2024-05-08T21:19:46.839 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.106:6836/1499761952 2024-05-09T21:17:21.292339+0000 2024-05-08T21:19:46.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:46.836+0000 7f3e4ecd0700 1 -- 172.21.15.80:0/2988098291 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f3e3406ad60 msgr2=0x7f3e3406d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:46.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:46.836+0000 7f3e4ecd0700 1 --2- 172.21.15.80:0/2988098291 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f3e3406ad60 0x7f3e3406d220 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3e480c9130 tx=0x7f3e38007a20 comp rx=0 tx=0).stop 2024-05-08T21:19:46.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:46.836+0000 7f3e4ecd0700 1 -- 172.21.15.80:0/2988098291 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3e481578b0 msgr2=0x7f3e48140440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:46.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:46.836+0000 7f3e4ecd0700 1 --2- 172.21.15.80:0/2988098291 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3e481578b0 0x7f3e48140440 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3e4000b370 tx=0x7f3e40004ad0 comp rx=0 tx=0).stop 2024-05-08T21:19:46.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:46.836+0000 7f3e4ecd0700 1 -- 172.21.15.80:0/2988098291 shutdown_connections 2024-05-08T21:19:46.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:46.836+0000 7f3e4ecd0700 1 --2- 172.21.15.80:0/2988098291 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f3e3406ad60 0x7f3e3406d220 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:46.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:46.837+0000 7f3e4ecd0700 1 --2- 172.21.15.80:0/2988098291 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3e481578b0 0x7f3e48140440 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:46.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:46.837+0000 7f3e4ecd0700 1 --2- 172.21.15.80:0/2988098291 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e480c8cb0 0x7f3e48142170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:46.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:46.837+0000 7f3e4ecd0700 1 --2- 172.21.15.80:0/2988098291 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e48150ea0 0x7f3e4813ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:46.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:46.837+0000 7f3e4ecd0700 1 -- 172.21.15.80:0/2988098291 >> 172.21.15.80:0/2988098291 conn(0x7f3e4806a9c0 msgr2=0x7f3e4815ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:46.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:46.837+0000 7f3e4ecd0700 1 -- 172.21.15.80:0/2988098291 shutdown_connections 2024-05-08T21:19:46.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:46.837+0000 7f3e4ecd0700 1 -- 172.21.15.80:0/2988098291 wait complete. 2024-05-08T21:19:46.855 INFO:teuthology.orchestra.run.smithi080.stderr:listed 8 entries 2024-05-08T21:19:47.009 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-08T21:19:47.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:19:47.009 DEBUG:teuthology.orchestra.run.smithi080:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-08T21:19:47.531 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi080.front.sepia.ceph.com 2024-05-08T21:19:47.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:19:47.532 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-08T21:19:47.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:19:47.706 DEBUG:teuthology.orchestra.run.smithi080:> ip netns list 2024-05-08T21:19:48.292 INFO:teuthology.orchestra.run.smithi080.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-08T21:19:48.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:19:48.293 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-08T21:19:48.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:19:48.860 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link delete ceph-brx 2024-05-08T21:19:48.995 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-05-08T21:19:49.006 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-08T21:19:49.006 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T21:19:49.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:49.451+0000 7fc3d94ae700 1 Processor -- start 2024-05-08T21:19:49.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:49.452+0000 7fc3d94ae700 1 -- start start 2024-05-08T21:19:49.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:49.453+0000 7fc3d94ae700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc3d41520b0 0x7fc3d4158810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:49.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:49.454+0000 7fc3d94ae700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc3d4158d50 0x7fc3d4072d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:49.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:49.454+0000 7fc3d94ae700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3d415b6d0 con 0x7fc3d40732c0 2024-05-08T21:19:49.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:49.454+0000 7fc3d94ae700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3d41580e0 con 0x7fc3d41520b0 2024-05-08T21:19:49.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:49.454+0000 7fc3d94ae700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d415c650 con 0x7fc3d4158d50 2024-05-08T21:19:49.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:49.456+0000 7fc3d27fc700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc3d4158d50 0x7fc3d4072d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:49.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:49.456+0000 7fc3d27fc700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc3d4158d50 0x7fc3d4072d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:57180/0 (socket says 172.21.15.80:57180) 2024-05-08T21:19:49.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:49.456+0000 7fc3d27fc700 1 -- 172.21.15.80:0/348277221 learned_addr learned my addr 172.21.15.80:0/348277221 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:19:49.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:49.457+0000 7fc3d27fc700 1 -- 172.21.15.80:0/348277221 >> v2:172.21.15.106:3300/0 conn(0x7fc3d41520b0 msgr2=0x7fc3d4158810 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T21:19:49.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:49.457+0000 7fc3d27fc700 1 --2- 172.21.15.80:0/348277221 >> v2:172.21.15.106:3300/0 conn(0x7fc3d41520b0 0x7fc3d4158810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:49.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:49.457+0000 7fc3d27fc700 1 -- 172.21.15.80:0/348277221 >> v1:172.21.15.106:6789/0 conn(0x7fc3d40732c0 legacy=0x7fc3d40cbba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T21:19:49.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:49.457+0000 7fc3d27fc700 1 -- 172.21.15.80:0/348277221 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3d40c5cd0 con 0x7fc3d4158d50 2024-05-08T21:19:49.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:49.469+0000 7fc3d27fc700 1 --2- 172.21.15.80:0/348277221 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc3d4158d50 0x7fc3d4072d80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc3c80098f0 tx=0x7fc3c8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b55dc34368196e7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:49.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:49.476+0000 7fc3d1ffb700 1 -- 172.21.15.80:0/348277221 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c8004230 con 0x7fc3d4158d50 2024-05-08T21:19:49.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:49.476+0000 7fc3d1ffb700 1 -- 172.21.15.80:0/348277221 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3c8004390 con 0x7fc3d4158d50 2024-05-08T21:19:49.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:49.476+0000 7fc3d1ffb700 1 -- 172.21.15.80:0/348277221 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c80036a0 con 0x7fc3d4158d50 2024-05-08T21:19:49.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:49.478+0000 7fc3d94ae700 1 -- 172.21.15.80:0/348277221 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc3d4158d50 msgr2=0x7fc3d4072d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:49.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:49.478+0000 7fc3d94ae700 1 --2- 172.21.15.80:0/348277221 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc3d4158d50 0x7fc3d4072d80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc3c80098f0 tx=0x7fc3c8009c00 comp rx=0 tx=0).stop 2024-05-08T21:19:49.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:49.478+0000 7fc3d94ae700 1 -- 172.21.15.80:0/348277221 shutdown_connections 2024-05-08T21:19:49.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:49.478+0000 7fc3d94ae700 1 --2- 172.21.15.80:0/348277221 >> v2:172.21.15.106:3300/0 conn(0x7fc3d41520b0 0x7fc3d4158810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:49.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:49.478+0000 7fc3d94ae700 1 --2- 172.21.15.80:0/348277221 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc3d4158d50 0x7fc3d4072d80 secure :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc3c80098f0 tx=0x7fc3c8009c00 comp rx=0 tx=0).stop 2024-05-08T21:19:49.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:49.478+0000 7fc3d94ae700 1 -- 172.21.15.80:0/348277221 >> 172.21.15.80:0/348277221 conn(0x7fc3d4066780 msgr2=0x7fc3d4066b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:49.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:49.483+0000 7fc3d94ae700 1 -- 172.21.15.80:0/348277221 shutdown_connections 2024-05-08T21:19:49.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:49.483+0000 7fc3d94ae700 1 -- 172.21.15.80:0/348277221 wait complete. 2024-05-08T21:19:49.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:49.484+0000 7fc3d94ae700 1 Processor -- start 2024-05-08T21:19:49.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:49.485+0000 7fc3d94ae700 1 -- start start 2024-05-08T21:19:49.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:49.486+0000 7fc3d94ae700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3d40732c0 0x7fc3d414a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:49.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:49.486+0000 7fc3d94ae700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3d41520b0 0x7fc3d41fca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:49.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:49.486+0000 7fc3d94ae700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc3d41460e0 0x7fc3d4147b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:49.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:49.486+0000 7fc3d94ae700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d4145270 con 0x7fc3d41520b0 2024-05-08T21:19:49.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:49.486+0000 7fc3d94ae700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d4144470 con 0x7fc3d40732c0 2024-05-08T21:19:49.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:49.486+0000 7fc3d94ae700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d4149910 con 0x7fc3d41460e0 2024-05-08T21:19:49.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:49.487+0000 7fc3d37fe700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc3d41460e0 0x7fc3d4147b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:49.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:49.487+0000 7fc3d37fe700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc3d41460e0 0x7fc3d4147b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:57190/0 (socket says 172.21.15.80:57190) 2024-05-08T21:19:49.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:49.487+0000 7fc3d37fe700 1 -- 172.21.15.80:0/447581296 learned_addr learned my addr 172.21.15.80:0/447581296 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:19:49.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:49.488+0000 7fc3d37fe700 1 -- 172.21.15.80:0/447581296 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3d40732c0 msgr2=0x7fc3d414a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:49.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:49.488+0000 7fc3d37fe700 1 --2- 172.21.15.80:0/447581296 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3d40732c0 0x7fc3d414a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:49.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:49.488+0000 7fc3d37fe700 1 -- 172.21.15.80:0/447581296 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3d41520b0 msgr2=0x7fc3d41fca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:49.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:49.488+0000 7fc3d37fe700 1 --2- 172.21.15.80:0/447581296 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3d41520b0 0x7fc3d41fca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:49.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:49.488+0000 7fc3d37fe700 1 -- 172.21.15.80:0/447581296 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c8009550 con 0x7fc3d41460e0 2024-05-08T21:19:49.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:49.490+0000 7fc3d37fe700 1 --2- 172.21.15.80:0/447581296 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc3d41460e0 0x7fc3d4147b60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc3c400b4a0 tx=0x7fc3c400b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:49.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:49.490+0000 7fc3bb7fe700 1 -- 172.21.15.80:0/447581296 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c4011830 con 0x7fc3d41460e0 2024-05-08T21:19:49.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:49.490+0000 7fc3bb7fe700 1 -- 172.21.15.80:0/447581296 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3c40119b0 con 0x7fc3d41460e0 2024-05-08T21:19:49.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:49.490+0000 7fc3bb7fe700 1 -- 172.21.15.80:0/447581296 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c4011d60 con 0x7fc3d41460e0 2024-05-08T21:19:49.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:49.492+0000 7fc3d94ae700 1 -- 172.21.15.80:0/447581296 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3d4148850 con 0x7fc3d41460e0 2024-05-08T21:19:49.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:49.492+0000 7fc3d94ae700 1 -- 172.21.15.80:0/447581296 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3d41449a0 con 0x7fc3d41460e0 2024-05-08T21:19:49.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:49.495+0000 7fc3bb7fe700 1 -- 172.21.15.80:0/447581296 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc3c401a400 con 0x7fc3d41460e0 2024-05-08T21:19:49.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:49.496+0000 7fc3bb7fe700 1 --2- 172.21.15.80:0/447581296 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fc3c006ad60 0x7fc3c006d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:49.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:49.496+0000 7fc3bb7fe700 1 -- 172.21.15.80:0/447581296 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7007+0+0 (secure 0 0 0) 0x7fc3c4089880 con 0x7fc3d41460e0 2024-05-08T21:19:49.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:49.497+0000 7fc3d94ae700 1 -- 172.21.15.80:0/447581296 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3b40052f0 con 0x7fc3d41460e0 2024-05-08T21:19:49.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:49.498+0000 7fc3d2ffd700 1 --2- 172.21.15.80:0/447581296 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fc3c006ad60 0x7fc3c006d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:49.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:49.499+0000 7fc3d2ffd700 1 --2- 172.21.15.80:0/447581296 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fc3c006ad60 0x7fc3c006d220 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc00abb0 tx=0x7fc3cc009250 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:49.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:49.503+0000 7fc3bb7fe700 1 -- 172.21.15.80:0/447581296 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fc3c4054530 con 0x7fc3d41460e0 2024-05-08T21:19:49.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:49.881+0000 7fc3d94ae700 1 -- 172.21.15.80:0/447581296 --> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc3b4000bc0 con 0x7fc3c006ad60 2024-05-08T21:19:49.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:49.929+0000 7fc3bb7fe700 1 -- 172.21.15.80:0/447581296 <== mgr.4100 v2:172.21.15.80:6832/46731 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+370857 (secure 0 0 0) 0x7fc3b4000bc0 con 0x7fc3c006ad60 2024-05-08T21:19:49.936 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:19:49.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:49.935+0000 7fc3d94ae700 1 -- 172.21.15.80:0/447581296 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fc3c006ad60 msgr2=0x7fc3c006d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:49.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:49.935+0000 7fc3d94ae700 1 --2- 172.21.15.80:0/447581296 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fc3c006ad60 0x7fc3c006d220 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc00abb0 tx=0x7fc3cc009250 comp rx=0 tx=0).stop 2024-05-08T21:19:49.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:49.935+0000 7fc3d94ae700 1 -- 172.21.15.80:0/447581296 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc3d41460e0 msgr2=0x7fc3d4147b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:49.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:49.935+0000 7fc3d94ae700 1 --2- 172.21.15.80:0/447581296 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc3d41460e0 0x7fc3d4147b60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc3c400b4a0 tx=0x7fc3c400b860 comp rx=0 tx=0).stop 2024-05-08T21:19:49.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:49.936+0000 7fc3d94ae700 1 -- 172.21.15.80:0/447581296 shutdown_connections 2024-05-08T21:19:49.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:49.936+0000 7fc3d94ae700 1 --2- 172.21.15.80:0/447581296 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fc3c006ad60 0x7fc3c006d220 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:49.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:49.936+0000 7fc3d94ae700 1 --2- 172.21.15.80:0/447581296 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc3d41460e0 0x7fc3d4147b60 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:49.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:49.936+0000 7fc3d94ae700 1 --2- 172.21.15.80:0/447581296 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3d40732c0 0x7fc3d414a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:49.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:49.936+0000 7fc3d94ae700 1 --2- 172.21.15.80:0/447581296 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc3d41520b0 0x7fc3d41fca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:49.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:49.936+0000 7fc3d94ae700 1 -- 172.21.15.80:0/447581296 >> 172.21.15.80:0/447581296 conn(0x7fc3d4066780 msgr2=0x7fc3d41569f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:49.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:49.936+0000 7fc3d94ae700 1 -- 172.21.15.80:0/447581296 shutdown_connections 2024-05-08T21:19:49.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:49.936+0000 7fc3d94ae700 1 -- 172.21.15.80:0/447581296 wait complete. 2024-05-08T21:19:49.944 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-05-08T21:19:49.969 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":322,"stamp":"2024-05-08T21:19:48.497204+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4829871080,"num_objects":1374,"num_object_clones":0,"num_object_copies":5422,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1374,"num_whiteouts":0,"num_read":2254,"num_read_kb":39820,"num_write":1716091,"num_write_kb":22166550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":134545,"ondisk_log_size":134545,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":13305108,"kb_used_data":6142664,"kb_used_omap":12,"kb_used_meta":7152115,"kb_avail":741669612,"statfs":{"total":773094113280,"available":759469682688,"internally_reserved":0,"allocated":6290087936,"data_stored":10128470679,"data_compressed":608532561,"data_compressed_allocated":1861603328,"data_compressed_original":5701611520,"omap_allocated":12743,"internal_metadata":7323766329},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,2,5,12,13,6,18,5],"upper_bound":512},"perf_stat":{"commit_latency_ms":152,"apply_latency_ms":152,"commit_latency_ns":152000000,"apply_latency_ns":152000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-7402127885,"num_objects":-1765,"num_object_clones":0,"num_object_copies":-7060,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1765,"num_whiteouts":0,"num_read":2,"num_read_kb":19,"num_write":1858,"num_write_kb":843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004481"},"pg_stats":[{"pgid":"3.3f","version":"29'5","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T21:18:28.723440+0000","last_change":"2024-05-08T21:10:03.747477+0000","last_active":"2024-05-08T21:18:28.723440+0000","last_peered":"2024-05-08T21:18:28.723440+0000","last_clean":"2024-05-08T21:18:28.723440+0000","last_became_active":"2024-05-08T21:10:03.747059+0000","last_became_peered":"2024-05-08T21:10:03.747059+0000","last_unstale":"2024-05-08T21:18:28.723440+0000","last_undegraded":"2024-05-08T21:18:28.723440+0000","last_fullsized":"2024-05-08T21:18:28.723440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:15:24.340135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"32'3","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.752000+0000","last_change":"2024-05-08T21:10:03.738974+0000","last_active":"2024-05-08T21:19:06.752000+0000","last_peered":"2024-05-08T21:19:06.752000+0000","last_clean":"2024-05-08T21:19:06.752000+0000","last_became_active":"2024-05-08T21:10:03.738466+0000","last_became_peered":"2024-05-08T21:10:03.738466+0000","last_unstale":"2024-05-08T21:19:06.752000+0000","last_undegraded":"2024-05-08T21:19:06.752000+0000","last_fullsized":"2024-05-08T21:19:06.752000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:59.683039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"32'8","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.754392+0000","last_change":"2024-05-08T21:10:03.740146+0000","last_active":"2024-05-08T21:19:06.754392+0000","last_peered":"2024-05-08T21:19:06.754392+0000","last_clean":"2024-05-08T21:19:06.754392+0000","last_became_active":"2024-05-08T21:10:03.739884+0000","last_became_peered":"2024-05-08T21:10:03.739884+0000","last_unstale":"2024-05-08T21:19:06.754392+0000","last_undegraded":"2024-05-08T21:19:06.754392+0000","last_fullsized":"2024-05-08T21:19:06.754392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:51:44.301305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"32'5","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:34.408287+0000","last_change":"2024-05-08T21:10:03.754159+0000","last_active":"2024-05-08T21:19:34.408287+0000","last_peered":"2024-05-08T21:19:34.408287+0000","last_clean":"2024-05-08T21:19:34.408287+0000","last_became_active":"2024-05-08T21:10:03.753800+0000","last_became_peered":"2024-05-08T21:10:03.753800+0000","last_unstale":"2024-05-08T21:19:34.408287+0000","last_undegraded":"2024-05-08T21:19:34.408287+0000","last_fullsized":"2024-05-08T21:19:34.408287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:41:02.625080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"29'5","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T21:17:38.105415+0000","last_change":"2024-05-08T21:10:03.750051+0000","last_active":"2024-05-08T21:17:38.105415+0000","last_peered":"2024-05-08T21:17:38.105415+0000","last_clean":"2024-05-08T21:17:38.105415+0000","last_became_active":"2024-05-08T21:10:03.749730+0000","last_became_peered":"2024-05-08T21:10:03.749730+0000","last_unstale":"2024-05-08T21:17:38.105415+0000","last_undegraded":"2024-05-08T21:17:38.105415+0000","last_fullsized":"2024-05-08T21:17:38.105415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:49.402253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"32'9","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.751115+0000","last_change":"2024-05-08T21:10:53.473952+0000","last_active":"2024-05-08T21:19:06.751115+0000","last_peered":"2024-05-08T21:19:06.751115+0000","last_clean":"2024-05-08T21:19:06.751115+0000","last_became_active":"2024-05-08T21:10:53.473632+0000","last_became_peered":"2024-05-08T21:10:53.473632+0000","last_unstale":"2024-05-08T21:19:06.751115+0000","last_undegraded":"2024-05-08T21:19:06.751115+0000","last_fullsized":"2024-05-08T21:19:06.751115+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:09.558205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"29'3","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T21:17:38.105391+0000","last_change":"2024-05-08T21:10:03.743802+0000","last_active":"2024-05-08T21:17:38.105391+0000","last_peered":"2024-05-08T21:17:38.105391+0000","last_clean":"2024-05-08T21:17:38.105391+0000","last_became_active":"2024-05-08T21:10:03.743349+0000","last_became_peered":"2024-05-08T21:10:03.743349+0000","last_unstale":"2024-05-08T21:17:38.105391+0000","last_undegraded":"2024-05-08T21:17:38.105391+0000","last_fullsized":"2024-05-08T21:17:38.105391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:08:06.408724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"32'4","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.753828+0000","last_change":"2024-05-08T21:10:03.747558+0000","last_active":"2024-05-08T21:19:06.753828+0000","last_peered":"2024-05-08T21:19:06.753828+0000","last_clean":"2024-05-08T21:19:06.753828+0000","last_became_active":"2024-05-08T21:10:03.747300+0000","last_became_peered":"2024-05-08T21:10:03.747300+0000","last_unstale":"2024-05-08T21:19:06.753828+0000","last_undegraded":"2024-05-08T21:19:06.753828+0000","last_fullsized":"2024-05-08T21:19:06.753828+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:07:50.266894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"32'14","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:39.890025+0000","last_change":"2024-05-08T21:10:03.748221+0000","last_active":"2024-05-08T21:19:39.890025+0000","last_peered":"2024-05-08T21:19:39.890025+0000","last_clean":"2024-05-08T21:19:39.890025+0000","last_became_active":"2024-05-08T21:10:03.747956+0000","last_became_peered":"2024-05-08T21:10:03.747956+0000","last_unstale":"2024-05-08T21:19:39.890025+0000","last_undegraded":"2024-05-08T21:19:39.890025+0000","last_fullsized":"2024-05-08T21:19:39.890025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:27:35.947884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"29'8","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T21:17:27.493158+0000","last_change":"2024-05-08T21:10:03.745291+0000","last_active":"2024-05-08T21:17:27.493158+0000","last_peered":"2024-05-08T21:17:27.493158+0000","last_clean":"2024-05-08T21:17:27.493158+0000","last_became_active":"2024-05-08T21:10:03.744976+0000","last_became_peered":"2024-05-08T21:10:03.744976+0000","last_unstale":"2024-05-08T21:17:27.493158+0000","last_undegraded":"2024-05-08T21:17:27.493158+0000","last_fullsized":"2024-05-08T21:17:27.493158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:36:54.983642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"32'12","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.751492+0000","last_change":"2024-05-08T21:10:03.748518+0000","last_active":"2024-05-08T21:19:06.751492+0000","last_peered":"2024-05-08T21:19:06.751492+0000","last_clean":"2024-05-08T21:19:06.751492+0000","last_became_active":"2024-05-08T21:10:03.748253+0000","last_became_peered":"2024-05-08T21:10:03.748253+0000","last_unstale":"2024-05-08T21:19:06.751492+0000","last_undegraded":"2024-05-08T21:19:06.751492+0000","last_fullsized":"2024-05-08T21:19:06.751492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:03:26.013122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"29'6","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T21:17:23.563171+0000","last_change":"2024-05-08T21:10:03.745985+0000","last_active":"2024-05-08T21:17:23.563171+0000","last_peered":"2024-05-08T21:17:23.563171+0000","last_clean":"2024-05-08T21:17:23.563171+0000","last_became_active":"2024-05-08T21:10:03.745247+0000","last_became_peered":"2024-05-08T21:10:03.745247+0000","last_unstale":"2024-05-08T21:17:23.563171+0000","last_undegraded":"2024-05-08T21:17:23.563171+0000","last_fullsized":"2024-05-08T21:17:23.563171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:59:42.506304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"29'7","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.754219+0000","last_change":"2024-05-08T21:10:03.747016+0000","last_active":"2024-05-08T21:19:06.754219+0000","last_peered":"2024-05-08T21:19:06.754219+0000","last_clean":"2024-05-08T21:19:06.754219+0000","last_became_active":"2024-05-08T21:10:03.746848+0000","last_became_peered":"2024-05-08T21:10:03.746848+0000","last_unstale":"2024-05-08T21:19:06.754219+0000","last_undegraded":"2024-05-08T21:19:06.754219+0000","last_fullsized":"2024-05-08T21:19:06.754219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:41:21.081035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"32'13","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:35.756438+0000","last_change":"2024-05-08T21:10:03.737984+0000","last_active":"2024-05-08T21:19:35.756438+0000","last_peered":"2024-05-08T21:19:35.756438+0000","last_clean":"2024-05-08T21:19:35.756438+0000","last_became_active":"2024-05-08T21:10:03.737716+0000","last_became_peered":"2024-05-08T21:10:03.737716+0000","last_unstale":"2024-05-08T21:19:35.756438+0000","last_undegraded":"2024-05-08T21:19:35.756438+0000","last_fullsized":"2024-05-08T21:19:35.756438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:09:47.758272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"32'11","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:39.528797+0000","last_change":"2024-05-08T21:10:03.744543+0000","last_active":"2024-05-08T21:19:39.528797+0000","last_peered":"2024-05-08T21:19:39.528797+0000","last_clean":"2024-05-08T21:19:39.528797+0000","last_became_active":"2024-05-08T21:10:03.744276+0000","last_became_peered":"2024-05-08T21:10:03.744276+0000","last_unstale":"2024-05-08T21:19:39.528797+0000","last_undegraded":"2024-05-08T21:19:39.528797+0000","last_fullsized":"2024-05-08T21:19:39.528797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:25:04.113297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"32'9","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:39.151636+0000","last_change":"2024-05-08T21:10:03.746547+0000","last_active":"2024-05-08T21:19:39.151636+0000","last_peered":"2024-05-08T21:19:39.151636+0000","last_clean":"2024-05-08T21:19:39.151636+0000","last_became_active":"2024-05-08T21:10:03.745862+0000","last_became_peered":"2024-05-08T21:10:03.745862+0000","last_unstale":"2024-05-08T21:19:39.151636+0000","last_undegraded":"2024-05-08T21:19:39.151636+0000","last_fullsized":"2024-05-08T21:19:39.151636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:12.776310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"32'10","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:38.816584+0000","last_change":"2024-05-08T21:10:54.028844+0000","last_active":"2024-05-08T21:19:38.816584+0000","last_peered":"2024-05-08T21:19:38.816584+0000","last_clean":"2024-05-08T21:19:38.816584+0000","last_became_active":"2024-05-08T21:10:54.028630+0000","last_became_peered":"2024-05-08T21:10:54.028630+0000","last_unstale":"2024-05-08T21:19:38.816584+0000","last_undegraded":"2024-05-08T21:19:38.816584+0000","last_fullsized":"2024-05-08T21:19:38.816584+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:04:12.556157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"29'11","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.752206+0000","last_change":"2024-05-08T21:10:03.743889+0000","last_active":"2024-05-08T21:19:06.752206+0000","last_peered":"2024-05-08T21:19:06.752206+0000","last_clean":"2024-05-08T21:19:06.752206+0000","last_became_active":"2024-05-08T21:10:03.743596+0000","last_became_peered":"2024-05-08T21:10:03.743596+0000","last_unstale":"2024-05-08T21:19:06.752206+0000","last_undegraded":"2024-05-08T21:19:06.752206+0000","last_fullsized":"2024-05-08T21:19:06.752206+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:53.981781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"32'12","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:32.410973+0000","last_change":"2024-05-08T21:10:03.743893+0000","last_active":"2024-05-08T21:19:32.410973+0000","last_peered":"2024-05-08T21:19:32.410973+0000","last_clean":"2024-05-08T21:19:32.410973+0000","last_became_active":"2024-05-08T21:10:03.743580+0000","last_became_peered":"2024-05-08T21:10:03.743580+0000","last_unstale":"2024-05-08T21:19:32.410973+0000","last_undegraded":"2024-05-08T21:19:32.410973+0000","last_fullsized":"2024-05-08T21:19:32.410973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:44:21.747625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"32'4243","reported_seq":4331,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:43.447853+0000","last_change":"2024-05-08T21:10:08.052394+0000","last_active":"2024-05-08T21:19:43.447853+0000","last_peered":"2024-05-08T21:19:43.447853+0000","last_clean":"2024-05-08T21:19:43.447853+0000","last_became_active":"2024-05-08T21:10:08.052009+0000","last_became_peered":"2024-05-08T21:10:08.052009+0000","last_unstale":"2024-05-08T21:19:43.447853+0000","last_undegraded":"2024-05-08T21:19:43.447853+0000","last_fullsized":"2024-05-08T21:19:43.447853+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4243,"log_dups_size":0,"ondisk_log_size":4243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:47:20.148683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218150091,"num_objects":60,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":67,"num_read_kb":0,"num_write":56100,"num_write_kb":728959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"32'466","reported_seq":503,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:47.502458+0000","last_change":"2024-05-08T21:10:03.340118+0000","last_active":"2024-05-08T21:19:47.502458+0000","last_peered":"2024-05-08T21:19:47.502458+0000","last_clean":"2024-05-08T21:19:47.502458+0000","last_became_active":"2024-05-08T21:10:03.339847+0000","last_became_peered":"2024-05-08T21:10:03.339847+0000","last_unstale":"2024-05-08T21:19:47.502458+0000","last_undegraded":"2024-05-08T21:19:47.502458+0000","last_fullsized":"2024-05-08T21:19:47.502458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:05:56.369631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3158419,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":20,"num_read_kb":1370,"num_write":463,"num_write_kb":3343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"29'3","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T21:18:16.811988+0000","last_change":"2024-05-08T21:10:03.746516+0000","last_active":"2024-05-08T21:18:16.811988+0000","last_peered":"2024-05-08T21:18:16.811988+0000","last_clean":"2024-05-08T21:18:16.811988+0000","last_became_active":"2024-05-08T21:10:03.746383+0000","last_became_peered":"2024-05-08T21:10:03.746383+0000","last_unstale":"2024-05-08T21:18:16.811988+0000","last_undegraded":"2024-05-08T21:18:16.811988+0000","last_fullsized":"2024-05-08T21:18:16.811988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:29:05.305134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'4129","reported_seq":4217,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:44.763923+0000","last_change":"2024-05-08T21:10:53.484902+0000","last_active":"2024-05-08T21:19:44.763923+0000","last_peered":"2024-05-08T21:19:44.763923+0000","last_clean":"2024-05-08T21:19:44.763923+0000","last_became_active":"2024-05-08T21:10:53.484437+0000","last_became_peered":"2024-05-08T21:10:53.484437+0000","last_unstale":"2024-05-08T21:19:44.763923+0000","last_undegraded":"2024-05-08T21:19:44.763923+0000","last_fullsized":"2024-05-08T21:19:44.763923+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4129,"log_dups_size":0,"ondisk_log_size":4129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:51:42.307075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167862860,"num_objects":45,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":57,"num_read_kb":0,"num_write":53666,"num_write_kb":702965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2,3],"acting":[4,6,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"32'5","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.755018+0000","last_change":"2024-05-08T21:10:03.329414+0000","last_active":"2024-05-08T21:19:06.755018+0000","last_peered":"2024-05-08T21:19:06.755018+0000","last_clean":"2024-05-08T21:19:06.755018+0000","last_became_active":"2024-05-08T21:10:03.328970+0000","last_became_peered":"2024-05-08T21:10:03.328970+0000","last_unstale":"2024-05-08T21:19:06.755018+0000","last_undegraded":"2024-05-08T21:19:06.755018+0000","last_fullsized":"2024-05-08T21:19:06.755018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:34:32.820755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"32'7","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.755829+0000","last_change":"2024-05-08T21:10:03.748566+0000","last_active":"2024-05-08T21:19:06.755829+0000","last_peered":"2024-05-08T21:19:06.755829+0000","last_clean":"2024-05-08T21:19:06.755829+0000","last_became_active":"2024-05-08T21:10:03.747989+0000","last_became_peered":"2024-05-08T21:10:03.747989+0000","last_unstale":"2024-05-08T21:19:06.755829+0000","last_undegraded":"2024-05-08T21:19:06.755829+0000","last_fullsized":"2024-05-08T21:19:06.755829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:19:03.468394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"32'4100","reported_seq":4183,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:44.605673+0000","last_change":"2024-05-08T21:10:07.770390+0000","last_active":"2024-05-08T21:19:44.605673+0000","last_peered":"2024-05-08T21:19:44.605673+0000","last_clean":"2024-05-08T21:19:44.605673+0000","last_became_active":"2024-05-08T21:10:07.770017+0000","last_became_peered":"2024-05-08T21:10:07.770017+0000","last_unstale":"2024-05-08T21:19:44.605673+0000","last_undegraded":"2024-05-08T21:19:44.605673+0000","last_fullsized":"2024-05-08T21:19:44.605673+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4100,"log_dups_size":0,"ondisk_log_size":4100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:12:00.200848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180414866,"num_objects":51,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":62,"num_read_kb":0,"num_write":52787,"num_write_kb":674205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"32'14","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:27.848897+0000","last_change":"2024-05-08T21:10:03.339207+0000","last_active":"2024-05-08T21:19:27.848897+0000","last_peered":"2024-05-08T21:19:27.848897+0000","last_clean":"2024-05-08T21:19:27.848897+0000","last_became_active":"2024-05-08T21:10:03.338917+0000","last_became_peered":"2024-05-08T21:10:03.338917+0000","last_unstale":"2024-05-08T21:19:27.848897+0000","last_undegraded":"2024-05-08T21:19:27.848897+0000","last_fullsized":"2024-05-08T21:19:27.848897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:20.676853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":7,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"29'7","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T21:18:26.326830+0000","last_change":"2024-05-08T21:10:53.477056+0000","last_active":"2024-05-08T21:18:26.326830+0000","last_peered":"2024-05-08T21:18:26.326830+0000","last_clean":"2024-05-08T21:18:26.326830+0000","last_became_active":"2024-05-08T21:10:53.476785+0000","last_became_peered":"2024-05-08T21:10:53.476785+0000","last_unstale":"2024-05-08T21:18:26.326830+0000","last_undegraded":"2024-05-08T21:18:26.326830+0000","last_fullsized":"2024-05-08T21:18:26.326830+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:21:49.813110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"32'3512","reported_seq":3577,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:44.408166+0000","last_change":"2024-05-08T21:10:07.776367+0000","last_active":"2024-05-08T21:19:44.408166+0000","last_peered":"2024-05-08T21:19:44.408166+0000","last_clean":"2024-05-08T21:19:44.408166+0000","last_became_active":"2024-05-08T21:10:07.775998+0000","last_became_peered":"2024-05-08T21:10:07.775998+0000","last_unstale":"2024-05-08T21:19:44.408166+0000","last_undegraded":"2024-05-08T21:19:44.408166+0000","last_fullsized":"2024-05-08T21:19:44.408166+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":3512,"log_dups_size":0,"ondisk_log_size":3512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:24:18.845560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130036453,"num_objects":33,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":44,"num_read_kb":0,"num_write":46305,"num_write_kb":599175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"29'4","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:27.838760+0000","last_change":"2024-05-08T21:10:03.339182+0000","last_active":"2024-05-08T21:19:27.838760+0000","last_peered":"2024-05-08T21:19:27.838760+0000","last_clean":"2024-05-08T21:19:27.838760+0000","last_became_active":"2024-05-08T21:10:03.338899+0000","last_became_peered":"2024-05-08T21:10:03.338899+0000","last_unstale":"2024-05-08T21:19:27.838760+0000","last_undegraded":"2024-05-08T21:19:27.838760+0000","last_fullsized":"2024-05-08T21:19:27.838760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:55:53.368546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":5,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"32'9","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:42.391573+0000","last_change":"2024-05-08T21:10:03.750724+0000","last_active":"2024-05-08T21:19:42.391573+0000","last_peered":"2024-05-08T21:19:42.391573+0000","last_clean":"2024-05-08T21:19:42.391573+0000","last_became_active":"2024-05-08T21:10:03.750371+0000","last_became_peered":"2024-05-08T21:10:03.750371+0000","last_unstale":"2024-05-08T21:19:42.391573+0000","last_undegraded":"2024-05-08T21:19:42.391573+0000","last_fullsized":"2024-05-08T21:19:42.391573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:14:01.935211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"32'4412","reported_seq":4499,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:43.105400+0000","last_change":"2024-05-08T21:10:07.767604+0000","last_active":"2024-05-08T21:19:43.105400+0000","last_peered":"2024-05-08T21:19:43.105400+0000","last_clean":"2024-05-08T21:19:43.105400+0000","last_became_active":"2024-05-08T21:10:07.767234+0000","last_became_peered":"2024-05-08T21:10:07.767234+0000","last_unstale":"2024-05-08T21:19:43.105400+0000","last_undegraded":"2024-05-08T21:19:43.105400+0000","last_fullsized":"2024-05-08T21:19:43.105400+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4412,"log_dups_size":0,"ondisk_log_size":4412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:30:21.411491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":251686841,"num_objects":68,"num_object_clones":0,"num_object_copies":272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":66,"num_read_kb":0,"num_write":57833,"num_write_kb":753617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"29'1290","reported_seq":1318,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.754424+0000","last_change":"2024-05-08T21:10:03.338149+0000","last_active":"2024-05-08T21:19:06.754424+0000","last_peered":"2024-05-08T21:19:06.754424+0000","last_clean":"2024-05-08T21:19:06.754424+0000","last_became_active":"2024-05-08T21:10:03.337860+0000","last_became_peered":"2024-05-08T21:10:03.337860+0000","last_unstale":"2024-05-08T21:19:06.754424+0000","last_undegraded":"2024-05-08T21:19:06.754424+0000","last_fullsized":"2024-05-08T21:19:06.754424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":1290,"log_dups_size":0,"ondisk_log_size":1290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:07:39.052625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":1289,"num_write_kb":5292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"32'10","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.337623+0000","last_change":"2024-05-08T21:10:03.743506+0000","last_active":"2024-05-08T21:19:06.337623+0000","last_peered":"2024-05-08T21:19:06.337623+0000","last_clean":"2024-05-08T21:19:06.337623+0000","last_became_active":"2024-05-08T21:10:03.743227+0000","last_became_peered":"2024-05-08T21:10:03.743227+0000","last_unstale":"2024-05-08T21:19:06.337623+0000","last_undegraded":"2024-05-08T21:19:06.337623+0000","last_fullsized":"2024-05-08T21:19:06.337623+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:45:47.977619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"32'3330","reported_seq":3393,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:46.040379+0000","last_change":"2024-05-08T21:10:07.768424+0000","last_active":"2024-05-08T21:19:46.040379+0000","last_peered":"2024-05-08T21:19:46.040379+0000","last_clean":"2024-05-08T21:19:46.040379+0000","last_became_active":"2024-05-08T21:10:07.768160+0000","last_became_peered":"2024-05-08T21:10:07.768160+0000","last_unstale":"2024-05-08T21:19:46.040379+0000","last_undegraded":"2024-05-08T21:19:46.040379+0000","last_fullsized":"2024-05-08T21:19:46.040379+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":3330,"log_dups_size":0,"ondisk_log_size":3330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:42:44.327080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121646859,"num_objects":31,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":42,"num_read_kb":0,"num_write":43324,"num_write_kb":562121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"32'5","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.751975+0000","last_change":"2024-05-08T21:10:03.333647+0000","last_active":"2024-05-08T21:19:06.751975+0000","last_peered":"2024-05-08T21:19:06.751975+0000","last_clean":"2024-05-08T21:19:06.751975+0000","last_became_active":"2024-05-08T21:10:03.332844+0000","last_became_peered":"2024-05-08T21:10:03.332844+0000","last_unstale":"2024-05-08T21:19:06.751975+0000","last_undegraded":"2024-05-08T21:19:06.751975+0000","last_fullsized":"2024-05-08T21:19:06.751975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:47:40.344808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"32'9","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.753644+0000","last_change":"2024-05-08T21:10:03.743003+0000","last_active":"2024-05-08T21:19:06.753644+0000","last_peered":"2024-05-08T21:19:06.753644+0000","last_clean":"2024-05-08T21:19:06.753644+0000","last_became_active":"2024-05-08T21:10:03.742753+0000","last_became_peered":"2024-05-08T21:10:03.742753+0000","last_unstale":"2024-05-08T21:19:06.753644+0000","last_undegraded":"2024-05-08T21:19:06.753644+0000","last_fullsized":"2024-05-08T21:19:06.753644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:45:49.575877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4200","reported_seq":4293,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:44.646349+0000","last_change":"2024-05-08T21:10:07.770105+0000","last_active":"2024-05-08T21:19:44.646349+0000","last_peered":"2024-05-08T21:19:44.646349+0000","last_clean":"2024-05-08T21:19:44.646349+0000","last_became_active":"2024-05-08T21:10:07.769668+0000","last_became_peered":"2024-05-08T21:10:07.769668+0000","last_unstale":"2024-05-08T21:19:44.646349+0000","last_undegraded":"2024-05-08T21:19:44.646349+0000","last_fullsized":"2024-05-08T21:19:44.646349+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4200,"log_dups_size":0,"ondisk_log_size":4200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:07:21.560031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134315032,"num_objects":40,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":71,"num_read_kb":0,"num_write":54914,"num_write_kb":711961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"29'1","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T21:17:26.765527+0000","last_change":"2024-05-08T21:10:03.333025+0000","last_active":"2024-05-08T21:17:26.765527+0000","last_peered":"2024-05-08T21:17:26.765527+0000","last_clean":"2024-05-08T21:17:26.765527+0000","last_became_active":"2024-05-08T21:10:03.332750+0000","last_became_peered":"2024-05-08T21:10:03.332750+0000","last_unstale":"2024-05-08T21:17:26.765527+0000","last_undegraded":"2024-05-08T21:17:26.765527+0000","last_fullsized":"2024-05-08T21:17:26.765527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:20:50.134647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"29'14","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T21:17:26.765478+0000","last_change":"2024-05-08T21:10:03.744023+0000","last_active":"2024-05-08T21:17:26.765478+0000","last_peered":"2024-05-08T21:17:26.765478+0000","last_clean":"2024-05-08T21:17:26.765478+0000","last_became_active":"2024-05-08T21:10:03.743724+0000","last_became_peered":"2024-05-08T21:10:03.743724+0000","last_unstale":"2024-05-08T21:17:26.765478+0000","last_undegraded":"2024-05-08T21:17:26.765478+0000","last_fullsized":"2024-05-08T21:17:26.765478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:50:36.857245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"32'4795","reported_seq":4889,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:47.509016+0000","last_change":"2024-05-08T21:10:08.052307+0000","last_active":"2024-05-08T21:19:47.509016+0000","last_peered":"2024-05-08T21:19:47.509016+0000","last_clean":"2024-05-08T21:19:47.509016+0000","last_became_active":"2024-05-08T21:10:08.051924+0000","last_became_peered":"2024-05-08T21:10:08.051924+0000","last_unstale":"2024-05-08T21:19:47.509016+0000","last_undegraded":"2024-05-08T21:19:47.509016+0000","last_fullsized":"2024-05-08T21:19:47.509016+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4795,"log_dups_size":0,"ondisk_log_size":4795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:56:37.264246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142632158,"num_objects":40,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":72,"num_read_kb":0,"num_write":62600,"num_write_kb":808641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.335214+0000","last_change":"2024-05-08T21:10:03.330304+0000","last_active":"2024-05-08T21:19:06.335214+0000","last_peered":"2024-05-08T21:19:06.335214+0000","last_clean":"2024-05-08T21:19:06.335214+0000","last_became_active":"2024-05-08T21:10:03.330054+0000","last_became_peered":"2024-05-08T21:10:03.330054+0000","last_unstale":"2024-05-08T21:19:06.335214+0000","last_undegraded":"2024-05-08T21:19:06.335214+0000","last_fullsized":"2024-05-08T21:19:06.335214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:30.518935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"29'4","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T21:17:28.857915+0000","last_change":"2024-05-08T21:10:03.739687+0000","last_active":"2024-05-08T21:17:28.857915+0000","last_peered":"2024-05-08T21:17:28.857915+0000","last_clean":"2024-05-08T21:17:28.857915+0000","last_became_active":"2024-05-08T21:10:03.739425+0000","last_became_peered":"2024-05-08T21:10:03.739425+0000","last_unstale":"2024-05-08T21:17:28.857915+0000","last_undegraded":"2024-05-08T21:17:28.857915+0000","last_fullsized":"2024-05-08T21:17:28.857915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:45:59.295081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"32'4179","reported_seq":4259,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:43.330456+0000","last_change":"2024-05-08T21:10:08.050980+0000","last_active":"2024-05-08T21:19:43.330456+0000","last_peered":"2024-05-08T21:19:43.330456+0000","last_clean":"2024-05-08T21:19:43.330456+0000","last_became_active":"2024-05-08T21:10:08.050625+0000","last_became_peered":"2024-05-08T21:10:08.050625+0000","last_unstale":"2024-05-08T21:19:43.330456+0000","last_undegraded":"2024-05-08T21:19:43.330456+0000","last_fullsized":"2024-05-08T21:19:43.330456+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4179,"log_dups_size":0,"ondisk_log_size":4179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:39:43.917363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134253327,"num_objects":37,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":58,"num_read_kb":0,"num_write":54012,"num_write_kb":693342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"32'2","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.751502+0000","last_change":"2024-05-08T21:10:03.331297+0000","last_active":"2024-05-08T21:19:06.751502+0000","last_peered":"2024-05-08T21:19:06.751502+0000","last_clean":"2024-05-08T21:19:06.751502+0000","last_became_active":"2024-05-08T21:10:03.330973+0000","last_became_peered":"2024-05-08T21:10:03.330973+0000","last_unstale":"2024-05-08T21:19:06.751502+0000","last_undegraded":"2024-05-08T21:19:06.751502+0000","last_fullsized":"2024-05-08T21:19:06.751502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:57:26.190186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"29'5","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T21:17:26.420223+0000","last_change":"2024-05-08T21:10:03.751746+0000","last_active":"2024-05-08T21:17:26.420223+0000","last_peered":"2024-05-08T21:17:26.420223+0000","last_clean":"2024-05-08T21:17:26.420223+0000","last_became_active":"2024-05-08T21:10:03.751426+0000","last_became_peered":"2024-05-08T21:10:03.751426+0000","last_unstale":"2024-05-08T21:17:26.420223+0000","last_undegraded":"2024-05-08T21:17:26.420223+0000","last_fullsized":"2024-05-08T21:17:26.420223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:00:23.529543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"32'4024","reported_seq":4116,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:43.528314+0000","last_change":"2024-05-08T21:10:53.484721+0000","last_active":"2024-05-08T21:19:43.528314+0000","last_peered":"2024-05-08T21:19:43.528314+0000","last_clean":"2024-05-08T21:19:43.528314+0000","last_became_active":"2024-05-08T21:10:53.484313+0000","last_became_peered":"2024-05-08T21:10:53.484313+0000","last_unstale":"2024-05-08T21:19:43.528314+0000","last_undegraded":"2024-05-08T21:19:43.528314+0000","last_fullsized":"2024-05-08T21:19:43.528314+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4024,"log_dups_size":0,"ondisk_log_size":4024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:20:10.055442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159399280,"num_objects":43,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":61,"num_read_kb":0,"num_write":52736,"num_write_kb":673924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"29'1","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.335681+0000","last_change":"2024-05-08T21:10:03.332049+0000","last_active":"2024-05-08T21:19:06.335681+0000","last_peered":"2024-05-08T21:19:06.335681+0000","last_clean":"2024-05-08T21:19:06.335681+0000","last_became_active":"2024-05-08T21:10:03.331712+0000","last_became_peered":"2024-05-08T21:10:03.331712+0000","last_unstale":"2024-05-08T21:19:06.335681+0000","last_undegraded":"2024-05-08T21:19:06.335681+0000","last_fullsized":"2024-05-08T21:19:06.335681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:30:16.135672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"32'12","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:40.321291+0000","last_change":"2024-05-08T21:10:03.748728+0000","last_active":"2024-05-08T21:19:40.321291+0000","last_peered":"2024-05-08T21:19:40.321291+0000","last_clean":"2024-05-08T21:19:40.321291+0000","last_became_active":"2024-05-08T21:10:03.748315+0000","last_became_peered":"2024-05-08T21:10:03.748315+0000","last_unstale":"2024-05-08T21:19:40.321291+0000","last_undegraded":"2024-05-08T21:19:40.321291+0000","last_fullsized":"2024-05-08T21:19:40.321291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:14:15.224603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"32'4151","reported_seq":4230,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:44.621382+0000","last_change":"2024-05-08T21:10:07.761559+0000","last_active":"2024-05-08T21:19:44.621382+0000","last_peered":"2024-05-08T21:19:44.621382+0000","last_clean":"2024-05-08T21:19:44.621382+0000","last_became_active":"2024-05-08T21:10:07.761129+0000","last_became_peered":"2024-05-08T21:10:07.761129+0000","last_unstale":"2024-05-08T21:19:44.621382+0000","last_undegraded":"2024-05-08T21:19:44.621382+0000","last_fullsized":"2024-05-08T21:19:44.621382+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4151,"log_dups_size":0,"ondisk_log_size":4151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:29:03.444853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":193058296,"num_objects":58,"num_object_clones":0,"num_object_copies":232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":57,"num_read_kb":0,"num_write":55159,"num_write_kb":706687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"32'15","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:38.064532+0000","last_change":"2024-05-08T21:10:03.333077+0000","last_active":"2024-05-08T21:19:38.064532+0000","last_peered":"2024-05-08T21:19:38.064532+0000","last_clean":"2024-05-08T21:19:38.064532+0000","last_became_active":"2024-05-08T21:10:03.332796+0000","last_became_peered":"2024-05-08T21:10:03.332796+0000","last_unstale":"2024-05-08T21:19:38.064532+0000","last_undegraded":"2024-05-08T21:19:38.064532+0000","last_fullsized":"2024-05-08T21:19:38.064532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:30:16.135672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":17,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"32'5","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:34.845663+0000","last_change":"2024-05-08T21:10:03.751370+0000","last_active":"2024-05-08T21:19:34.845663+0000","last_peered":"2024-05-08T21:19:34.845663+0000","last_clean":"2024-05-08T21:19:34.845663+0000","last_became_active":"2024-05-08T21:10:03.750394+0000","last_became_peered":"2024-05-08T21:10:03.750394+0000","last_unstale":"2024-05-08T21:19:34.845663+0000","last_undegraded":"2024-05-08T21:19:34.845663+0000","last_fullsized":"2024-05-08T21:19:34.845663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:31:06.682543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"32'3871","reported_seq":3935,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:48.059290+0000","last_change":"2024-05-08T21:10:07.764815+0000","last_active":"2024-05-08T21:19:48.059290+0000","last_peered":"2024-05-08T21:19:48.059290+0000","last_clean":"2024-05-08T21:19:48.059290+0000","last_became_active":"2024-05-08T21:10:07.763591+0000","last_became_peered":"2024-05-08T21:10:07.763591+0000","last_unstale":"2024-05-08T21:19:48.059290+0000","last_undegraded":"2024-05-08T21:19:48.059290+0000","last_fullsized":"2024-05-08T21:19:48.059290+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":3871,"log_dups_size":0,"ondisk_log_size":3871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:47.977517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92290339,"num_objects":27,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":42,"num_read_kb":0,"num_write":50132,"num_write_kb":657283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"32'218","reported_seq":263,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:31.819804+0000","last_change":"2024-05-08T21:10:03.342400+0000","last_active":"2024-05-08T21:19:31.819804+0000","last_peered":"2024-05-08T21:19:31.819804+0000","last_clean":"2024-05-08T21:19:31.819804+0000","last_became_active":"2024-05-08T21:10:03.342202+0000","last_became_peered":"2024-05-08T21:10:03.342202+0000","last_unstale":"2024-05-08T21:19:31.819804+0000","last_undegraded":"2024-05-08T21:19:31.819804+0000","last_fullsized":"2024-05-08T21:19:31.819804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:10:04.668029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":37,"num_read_kb":12328,"num_write":217,"num_write_kb":4276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"32'10","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.752454+0000","last_change":"2024-05-08T21:10:03.752144+0000","last_active":"2024-05-08T21:19:06.752454+0000","last_peered":"2024-05-08T21:19:06.752454+0000","last_clean":"2024-05-08T21:19:06.752454+0000","last_became_active":"2024-05-08T21:10:03.751868+0000","last_became_peered":"2024-05-08T21:10:03.751868+0000","last_unstale":"2024-05-08T21:19:06.752454+0000","last_undegraded":"2024-05-08T21:19:06.752454+0000","last_fullsized":"2024-05-08T21:19:06.752454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:40:43.168591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"32'3924","reported_seq":3998,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:47.426816+0000","last_change":"2024-05-08T21:10:08.052390+0000","last_active":"2024-05-08T21:19:47.426816+0000","last_peered":"2024-05-08T21:19:47.426816+0000","last_clean":"2024-05-08T21:19:47.426816+0000","last_became_active":"2024-05-08T21:10:08.051967+0000","last_became_peered":"2024-05-08T21:10:08.051967+0000","last_unstale":"2024-05-08T21:19:47.426816+0000","last_undegraded":"2024-05-08T21:19:47.426816+0000","last_fullsized":"2024-05-08T21:19:47.426816+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":3924,"log_dups_size":0,"ondisk_log_size":3924,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:40:07.127492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":52,"num_read_kb":0,"num_write":50165,"num_write_kb":654171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"29'4","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:27.812950+0000","last_change":"2024-05-08T21:10:03.330102+0000","last_active":"2024-05-08T21:19:27.812950+0000","last_peered":"2024-05-08T21:19:27.812950+0000","last_clean":"2024-05-08T21:19:27.812950+0000","last_became_active":"2024-05-08T21:10:03.329761+0000","last_became_peered":"2024-05-08T21:10:03.329761+0000","last_unstale":"2024-05-08T21:19:27.812950+0000","last_undegraded":"2024-05-08T21:19:27.812950+0000","last_fullsized":"2024-05-08T21:19:27.812950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:37:14.930549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":16,"num_read_kb":32,"num_write":5,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"32'13","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:42.040056+0000","last_change":"2024-05-08T21:10:03.749332+0000","last_active":"2024-05-08T21:19:42.040056+0000","last_peered":"2024-05-08T21:19:42.040056+0000","last_clean":"2024-05-08T21:19:42.040056+0000","last_became_active":"2024-05-08T21:10:03.749094+0000","last_became_peered":"2024-05-08T21:10:03.749094+0000","last_unstale":"2024-05-08T21:19:42.040056+0000","last_undegraded":"2024-05-08T21:19:42.040056+0000","last_fullsized":"2024-05-08T21:19:42.040056+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:25.969085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"32'4332","reported_seq":4409,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:43.283204+0000","last_change":"2024-05-08T21:10:08.048331+0000","last_active":"2024-05-08T21:19:43.283204+0000","last_peered":"2024-05-08T21:19:43.283204+0000","last_clean":"2024-05-08T21:19:43.283204+0000","last_became_active":"2024-05-08T21:10:08.047505+0000","last_became_peered":"2024-05-08T21:10:08.047505+0000","last_unstale":"2024-05-08T21:19:43.283204+0000","last_undegraded":"2024-05-08T21:19:43.283204+0000","last_fullsized":"2024-05-08T21:19:43.283204+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4332,"log_dups_size":0,"ondisk_log_size":4332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:18:39.268730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188836984,"num_objects":55,"num_object_clones":0,"num_object_copies":220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":55,"num_read_kb":0,"num_write":56743,"num_write_kb":743616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"29'1","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.335436+0000","last_change":"2024-05-08T21:10:03.328021+0000","last_active":"2024-05-08T21:19:06.335436+0000","last_peered":"2024-05-08T21:19:06.335436+0000","last_clean":"2024-05-08T21:19:06.335436+0000","last_became_active":"2024-05-08T21:10:03.327648+0000","last_became_peered":"2024-05-08T21:10:03.327648+0000","last_unstale":"2024-05-08T21:19:06.335436+0000","last_undegraded":"2024-05-08T21:19:06.335436+0000","last_fullsized":"2024-05-08T21:19:06.335436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:37:54.491930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"29'10","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.751890+0000","last_change":"2024-05-08T21:10:03.750560+0000","last_active":"2024-05-08T21:19:06.751890+0000","last_peered":"2024-05-08T21:19:06.751890+0000","last_clean":"2024-05-08T21:19:06.751890+0000","last_became_active":"2024-05-08T21:10:03.750294+0000","last_became_peered":"2024-05-08T21:10:03.750294+0000","last_unstale":"2024-05-08T21:19:06.751890+0000","last_undegraded":"2024-05-08T21:19:06.751890+0000","last_fullsized":"2024-05-08T21:19:06.751890+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:30:47.937326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"32'4291","reported_seq":4362,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:43.360341+0000","last_change":"2024-05-08T21:10:08.052318+0000","last_active":"2024-05-08T21:19:43.360341+0000","last_peered":"2024-05-08T21:19:43.360341+0000","last_clean":"2024-05-08T21:19:43.360341+0000","last_became_active":"2024-05-08T21:10:08.051920+0000","last_became_peered":"2024-05-08T21:10:08.051920+0000","last_unstale":"2024-05-08T21:19:43.360341+0000","last_undegraded":"2024-05-08T21:19:43.360341+0000","last_fullsized":"2024-05-08T21:19:43.360341+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4291,"log_dups_size":0,"ondisk_log_size":4291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:25:27.669768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205562731,"num_objects":53,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":50,"num_read_kb":0,"num_write":56421,"num_write_kb":728506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"32'2","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:19.849641+0000","last_change":"2024-05-08T21:10:03.332390+0000","last_active":"2024-05-08T21:19:19.849641+0000","last_peered":"2024-05-08T21:19:19.849641+0000","last_clean":"2024-05-08T21:19:19.849641+0000","last_became_active":"2024-05-08T21:10:03.332105+0000","last_became_peered":"2024-05-08T21:10:03.332105+0000","last_unstale":"2024-05-08T21:19:19.849641+0000","last_undegraded":"2024-05-08T21:19:19.849641+0000","last_fullsized":"2024-05-08T21:19:19.849641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:32:44.705682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"32'8","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:40.607990+0000","last_change":"2024-05-08T21:10:03.742100+0000","last_active":"2024-05-08T21:19:40.607990+0000","last_peered":"2024-05-08T21:19:40.607990+0000","last_clean":"2024-05-08T21:19:40.607990+0000","last_became_active":"2024-05-08T21:10:03.741742+0000","last_became_peered":"2024-05-08T21:10:03.741742+0000","last_unstale":"2024-05-08T21:19:40.607990+0000","last_undegraded":"2024-05-08T21:19:40.607990+0000","last_fullsized":"2024-05-08T21:19:40.607990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:53:19.394126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"32'4435","reported_seq":4525,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:47.551207+0000","last_change":"2024-05-08T21:10:07.769850+0000","last_active":"2024-05-08T21:19:47.551207+0000","last_peered":"2024-05-08T21:19:47.551207+0000","last_clean":"2024-05-08T21:19:47.551207+0000","last_became_active":"2024-05-08T21:10:07.769016+0000","last_became_peered":"2024-05-08T21:10:07.769016+0000","last_unstale":"2024-05-08T21:19:47.551207+0000","last_undegraded":"2024-05-08T21:19:47.551207+0000","last_fullsized":"2024-05-08T21:19:47.551207+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4435,"log_dups_size":0,"ondisk_log_size":4435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:31:52.621418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117542773,"num_objects":37,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":68,"num_read_kb":0,"num_write":57721,"num_write_kb":734684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"29'10","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:27.844484+0000","last_change":"2024-05-08T21:10:03.331783+0000","last_active":"2024-05-08T21:19:27.844484+0000","last_peered":"2024-05-08T21:19:27.844484+0000","last_clean":"2024-05-08T21:19:27.844484+0000","last_became_active":"2024-05-08T21:10:03.331501+0000","last_became_peered":"2024-05-08T21:10:03.331501+0000","last_unstale":"2024-05-08T21:19:27.844484+0000","last_undegraded":"2024-05-08T21:19:27.844484+0000","last_fullsized":"2024-05-08T21:19:27.844484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:41:28.137295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":69,"num_read_kb":69,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"29'9","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.751368+0000","last_change":"2024-05-08T21:10:03.744007+0000","last_active":"2024-05-08T21:19:06.751368+0000","last_peered":"2024-05-08T21:19:06.751368+0000","last_clean":"2024-05-08T21:19:06.751368+0000","last_became_active":"2024-05-08T21:10:03.743557+0000","last_became_peered":"2024-05-08T21:10:03.743557+0000","last_unstale":"2024-05-08T21:19:06.751368+0000","last_undegraded":"2024-05-08T21:19:06.751368+0000","last_fullsized":"2024-05-08T21:19:06.751368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:45:26.458377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"32'3637","reported_seq":3713,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:44.757648+0000","last_change":"2024-05-08T21:10:07.777283+0000","last_active":"2024-05-08T21:19:44.757648+0000","last_peered":"2024-05-08T21:19:44.757648+0000","last_clean":"2024-05-08T21:19:44.757648+0000","last_became_active":"2024-05-08T21:10:07.776858+0000","last_became_peered":"2024-05-08T21:10:07.776858+0000","last_unstale":"2024-05-08T21:19:44.757648+0000","last_undegraded":"2024-05-08T21:19:44.757648+0000","last_fullsized":"2024-05-08T21:19:44.757648+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":3637,"log_dups_size":0,"ondisk_log_size":3637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:51.725885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":197320434,"num_objects":53,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":54,"num_read_kb":0,"num_write":47373,"num_write_kb":636696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"29'2","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:09.842867+0000","last_change":"2024-05-08T21:10:03.326892+0000","last_active":"2024-05-08T21:19:09.842867+0000","last_peered":"2024-05-08T21:19:09.842867+0000","last_clean":"2024-05-08T21:19:09.842867+0000","last_became_active":"2024-05-08T21:10:03.326608+0000","last_became_peered":"2024-05-08T21:10:03.326608+0000","last_unstale":"2024-05-08T21:19:09.842867+0000","last_undegraded":"2024-05-08T21:19:09.842867+0000","last_fullsized":"2024-05-08T21:19:09.842867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:33.441985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"29'4","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.752532+0000","last_change":"2024-05-08T21:10:03.749221+0000","last_active":"2024-05-08T21:19:06.752532+0000","last_peered":"2024-05-08T21:19:06.752532+0000","last_clean":"2024-05-08T21:19:06.752532+0000","last_became_active":"2024-05-08T21:10:03.748915+0000","last_became_peered":"2024-05-08T21:10:03.748915+0000","last_unstale":"2024-05-08T21:19:06.752532+0000","last_undegraded":"2024-05-08T21:19:06.752532+0000","last_fullsized":"2024-05-08T21:19:06.752532+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:03:10.791535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"32'4701","reported_seq":4794,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:47.978772+0000","last_change":"2024-05-08T21:10:07.759492+0000","last_active":"2024-05-08T21:19:47.978772+0000","last_peered":"2024-05-08T21:19:47.978772+0000","last_clean":"2024-05-08T21:19:47.978772+0000","last_became_active":"2024-05-08T21:10:07.759139+0000","last_became_peered":"2024-05-08T21:10:07.759139+0000","last_unstale":"2024-05-08T21:19:47.978772+0000","last_undegraded":"2024-05-08T21:19:47.978772+0000","last_fullsized":"2024-05-08T21:19:47.978772+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4701,"log_dups_size":0,"ondisk_log_size":4701,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:10.579105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79798076,"num_objects":26,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":71,"num_read_kb":0,"num_write":61787,"num_write_kb":787262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"29'1","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T21:18:26.799734+0000","last_change":"2024-05-08T21:10:03.329020+0000","last_active":"2024-05-08T21:18:26.799734+0000","last_peered":"2024-05-08T21:18:26.799734+0000","last_clean":"2024-05-08T21:18:26.799734+0000","last_became_active":"2024-05-08T21:10:03.328739+0000","last_became_peered":"2024-05-08T21:10:03.328739+0000","last_unstale":"2024-05-08T21:18:26.799734+0000","last_undegraded":"2024-05-08T21:18:26.799734+0000","last_fullsized":"2024-05-08T21:18:26.799734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:27:11.168780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"32'9","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:40.268874+0000","last_change":"2024-05-08T21:10:03.744662+0000","last_active":"2024-05-08T21:19:40.268874+0000","last_peered":"2024-05-08T21:19:40.268874+0000","last_clean":"2024-05-08T21:19:40.268874+0000","last_became_active":"2024-05-08T21:10:03.744398+0000","last_became_peered":"2024-05-08T21:10:03.744398+0000","last_unstale":"2024-05-08T21:19:40.268874+0000","last_undegraded":"2024-05-08T21:19:40.268874+0000","last_fullsized":"2024-05-08T21:19:40.268874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:05:28.046055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"32'4102","reported_seq":4172,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:48.278465+0000","last_change":"2024-05-08T21:10:07.776566+0000","last_active":"2024-05-08T21:19:48.278465+0000","last_peered":"2024-05-08T21:19:48.278465+0000","last_clean":"2024-05-08T21:19:48.278465+0000","last_became_active":"2024-05-08T21:10:07.776080+0000","last_became_peered":"2024-05-08T21:10:07.776080+0000","last_unstale":"2024-05-08T21:19:48.278465+0000","last_undegraded":"2024-05-08T21:19:48.278465+0000","last_fullsized":"2024-05-08T21:19:48.278465+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4102,"log_dups_size":0,"ondisk_log_size":4102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:26:09.323466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83899507,"num_objects":24,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":48,"num_read_kb":0,"num_write":53735,"num_write_kb":696170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T21:18:27.827601+0000","last_change":"2024-05-08T21:10:03.332953+0000","last_active":"2024-05-08T21:18:27.827601+0000","last_peered":"2024-05-08T21:18:27.827601+0000","last_clean":"2024-05-08T21:18:27.827601+0000","last_became_active":"2024-05-08T21:10:03.332689+0000","last_became_peered":"2024-05-08T21:10:03.332689+0000","last_unstale":"2024-05-08T21:18:27.827601+0000","last_undegraded":"2024-05-08T21:18:27.827601+0000","last_fullsized":"2024-05-08T21:18:27.827601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:15:32.058369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"29'6","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T21:18:34.750930+0000","last_change":"2024-05-08T21:10:03.745651+0000","last_active":"2024-05-08T21:18:34.750930+0000","last_peered":"2024-05-08T21:18:34.750930+0000","last_clean":"2024-05-08T21:18:34.750930+0000","last_became_active":"2024-05-08T21:10:03.742744+0000","last_became_peered":"2024-05-08T21:10:03.742744+0000","last_unstale":"2024-05-08T21:18:34.750930+0000","last_undegraded":"2024-05-08T21:18:34.750930+0000","last_fullsized":"2024-05-08T21:18:34.750930+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:32:31.689490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"32'4616","reported_seq":4706,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:47.885183+0000","last_change":"2024-05-08T21:10:07.776527+0000","last_active":"2024-05-08T21:19:47.885183+0000","last_peered":"2024-05-08T21:19:47.885183+0000","last_clean":"2024-05-08T21:19:47.885183+0000","last_became_active":"2024-05-08T21:10:07.776053+0000","last_became_peered":"2024-05-08T21:10:07.776053+0000","last_unstale":"2024-05-08T21:19:47.885183+0000","last_undegraded":"2024-05-08T21:19:47.885183+0000","last_fullsized":"2024-05-08T21:19:47.885183+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4616,"log_dups_size":0,"ondisk_log_size":4616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:08:26.401358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104914124,"num_objects":33,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":68,"num_read_kb":0,"num_write":59795,"num_write_kb":758247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"29'10","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T21:18:16.068937+0000","last_change":"2024-05-08T21:10:03.738421+0000","last_active":"2024-05-08T21:18:16.068937+0000","last_peered":"2024-05-08T21:18:16.068937+0000","last_clean":"2024-05-08T21:18:16.068937+0000","last_became_active":"2024-05-08T21:10:03.738000+0000","last_became_peered":"2024-05-08T21:10:03.738000+0000","last_unstale":"2024-05-08T21:18:16.068937+0000","last_undegraded":"2024-05-08T21:18:16.068937+0000","last_fullsized":"2024-05-08T21:18:16.068937+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:38:05.948755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"32'25","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:46.067041+0000","last_change":"2024-05-08T21:10:03.331141+0000","last_active":"2024-05-08T21:19:46.067041+0000","last_peered":"2024-05-08T21:19:46.067041+0000","last_clean":"2024-05-08T21:19:46.067041+0000","last_became_active":"2024-05-08T21:10:03.330842+0000","last_became_peered":"2024-05-08T21:10:03.330842+0000","last_unstale":"2024-05-08T21:19:46.067041+0000","last_undegraded":"2024-05-08T21:19:46.067041+0000","last_fullsized":"2024-05-08T21:19:46.067041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:42:52.648932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94059,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":26,"num_read_kb":107,"num_write":23,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"32'4076","reported_seq":4154,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:44.419279+0000","last_change":"2024-05-08T21:10:08.049274+0000","last_active":"2024-05-08T21:19:44.419279+0000","last_peered":"2024-05-08T21:19:44.419279+0000","last_clean":"2024-05-08T21:19:44.419279+0000","last_became_active":"2024-05-08T21:10:08.048763+0000","last_became_peered":"2024-05-08T21:10:08.048763+0000","last_unstale":"2024-05-08T21:19:44.419279+0000","last_undegraded":"2024-05-08T21:19:44.419279+0000","last_fullsized":"2024-05-08T21:19:44.419279+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4076,"log_dups_size":0,"ondisk_log_size":4076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:00:41.257040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163623502,"num_objects":47,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":56,"num_read_kb":0,"num_write":53590,"num_write_kb":684025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"32'6","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:35.891691+0000","last_change":"2024-05-08T21:10:03.747594+0000","last_active":"2024-05-08T21:19:35.891691+0000","last_peered":"2024-05-08T21:19:35.891691+0000","last_clean":"2024-05-08T21:19:35.891691+0000","last_became_active":"2024-05-08T21:10:03.747360+0000","last_became_peered":"2024-05-08T21:10:03.747360+0000","last_unstale":"2024-05-08T21:19:35.891691+0000","last_undegraded":"2024-05-08T21:19:35.891691+0000","last_fullsized":"2024-05-08T21:19:35.891691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:31:12.357348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T21:18:27.827642+0000","last_change":"2024-05-08T21:10:03.327847+0000","last_active":"2024-05-08T21:18:27.827642+0000","last_peered":"2024-05-08T21:18:27.827642+0000","last_clean":"2024-05-08T21:18:27.827642+0000","last_became_active":"2024-05-08T21:10:03.327530+0000","last_became_peered":"2024-05-08T21:10:03.327530+0000","last_unstale":"2024-05-08T21:18:27.827642+0000","last_undegraded":"2024-05-08T21:18:27.827642+0000","last_fullsized":"2024-05-08T21:18:27.827642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:46.232166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T21:18:03.705532+0000","last_change":"2024-05-08T21:09:59.333990+0000","last_active":"2024-05-08T21:18:03.705532+0000","last_peered":"2024-05-08T21:18:03.705532+0000","last_clean":"2024-05-08T21:18:03.705532+0000","last_became_active":"2024-05-08T21:09:59.332929+0000","last_became_peered":"2024-05-08T21:09:59.332929+0000","last_unstale":"2024-05-08T21:18:03.705532+0000","last_undegraded":"2024-05-08T21:18:03.705532+0000","last_fullsized":"2024-05-08T21:18:03.705532+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:09:58.287675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:09:58.287675+0000","last_clean_scrub_stamp":"2024-05-08T21:09:58.287675+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:47.595380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"32'3560","reported_seq":3628,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:47.312167+0000","last_change":"2024-05-08T21:10:08.049848+0000","last_active":"2024-05-08T21:19:47.312167+0000","last_peered":"2024-05-08T21:19:47.312167+0000","last_clean":"2024-05-08T21:19:47.312167+0000","last_became_active":"2024-05-08T21:10:08.049153+0000","last_became_peered":"2024-05-08T21:10:08.049153+0000","last_unstale":"2024-05-08T21:19:47.312167+0000","last_undegraded":"2024-05-08T21:19:47.312167+0000","last_fullsized":"2024-05-08T21:19:47.312167+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":3560,"log_dups_size":0,"ondisk_log_size":3560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:23.704112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79714880,"num_objects":26,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":46,"num_read_kb":0,"num_write":45721,"num_write_kb":586385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"32'4","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.754392+0000","last_change":"2024-05-08T21:10:03.743094+0000","last_active":"2024-05-08T21:19:06.754392+0000","last_peered":"2024-05-08T21:19:06.754392+0000","last_clean":"2024-05-08T21:19:06.754392+0000","last_became_active":"2024-05-08T21:10:03.742819+0000","last_became_peered":"2024-05-08T21:10:03.742819+0000","last_unstale":"2024-05-08T21:19:06.754392+0000","last_undegraded":"2024-05-08T21:19:06.754392+0000","last_fullsized":"2024-05-08T21:19:06.754392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:41:25.593884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"32'3","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.751156+0000","last_change":"2024-05-08T21:10:03.340259+0000","last_active":"2024-05-08T21:19:06.751156+0000","last_peered":"2024-05-08T21:19:06.751156+0000","last_clean":"2024-05-08T21:19:06.751156+0000","last_became_active":"2024-05-08T21:10:03.339957+0000","last_became_peered":"2024-05-08T21:10:03.339957+0000","last_unstale":"2024-05-08T21:19:06.751156+0000","last_undegraded":"2024-05-08T21:19:06.751156+0000","last_fullsized":"2024-05-08T21:19:06.751156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:38:36.535689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"32'3595","reported_seq":3659,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:47.350416+0000","last_change":"2024-05-08T21:10:08.050370+0000","last_active":"2024-05-08T21:19:47.350416+0000","last_peered":"2024-05-08T21:19:47.350416+0000","last_clean":"2024-05-08T21:19:47.350416+0000","last_became_active":"2024-05-08T21:10:08.049962+0000","last_became_peered":"2024-05-08T21:10:08.049962+0000","last_unstale":"2024-05-08T21:19:47.350416+0000","last_undegraded":"2024-05-08T21:19:47.350416+0000","last_fullsized":"2024-05-08T21:19:47.350416+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":3595,"log_dups_size":0,"ondisk_log_size":3595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:11:35.394334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101093947,"num_objects":26,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":42,"num_read_kb":0,"num_write":47638,"num_write_kb":629817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"29'1","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T21:18:28.723333+0000","last_change":"2024-05-08T21:10:03.337949+0000","last_active":"2024-05-08T21:18:28.723333+0000","last_peered":"2024-05-08T21:18:28.723333+0000","last_clean":"2024-05-08T21:18:28.723333+0000","last_became_active":"2024-05-08T21:10:03.337627+0000","last_became_peered":"2024-05-08T21:10:03.337627+0000","last_unstale":"2024-05-08T21:18:28.723333+0000","last_undegraded":"2024-05-08T21:18:28.723333+0000","last_fullsized":"2024-05-08T21:18:28.723333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:17:36.792731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"32'6","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.751956+0000","last_change":"2024-05-08T21:10:03.738212+0000","last_active":"2024-05-08T21:19:06.751956+0000","last_peered":"2024-05-08T21:19:06.751956+0000","last_clean":"2024-05-08T21:19:06.751956+0000","last_became_active":"2024-05-08T21:10:03.737927+0000","last_became_peered":"2024-05-08T21:10:03.737927+0000","last_unstale":"2024-05-08T21:19:06.751956+0000","last_undegraded":"2024-05-08T21:19:06.751956+0000","last_fullsized":"2024-05-08T21:19:06.751956+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:03:08.031584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"32'4656","reported_seq":4752,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:42.889909+0000","last_change":"2024-05-08T21:10:08.052270+0000","last_active":"2024-05-08T21:19:42.889909+0000","last_peered":"2024-05-08T21:19:42.889909+0000","last_clean":"2024-05-08T21:19:42.889909+0000","last_became_active":"2024-05-08T21:10:08.051881+0000","last_became_peered":"2024-05-08T21:10:08.051881+0000","last_unstale":"2024-05-08T21:19:42.889909+0000","last_undegraded":"2024-05-08T21:19:42.889909+0000","last_fullsized":"2024-05-08T21:19:42.889909+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4656,"log_dups_size":0,"ondisk_log_size":4656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:39:07.929942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239145044,"num_objects":63,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":74,"num_read_kb":0,"num_write":60642,"num_write_kb":757240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"32'66","reported_seq":95,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:42.838264+0000","last_change":"2024-05-08T21:10:03.333696+0000","last_active":"2024-05-08T21:19:42.838264+0000","last_peered":"2024-05-08T21:19:42.838264+0000","last_clean":"2024-05-08T21:19:42.838264+0000","last_became_active":"2024-05-08T21:10:03.333368+0000","last_became_peered":"2024-05-08T21:10:03.333368+0000","last_unstale":"2024-05-08T21:19:42.838264+0000","last_undegraded":"2024-05-08T21:19:42.838264+0000","last_fullsized":"2024-05-08T21:19:42.838264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:00:08.459270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":34,"num_write":151,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"32'10","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:37.785783+0000","last_change":"2024-05-08T21:10:03.752578+0000","last_active":"2024-05-08T21:19:37.785783+0000","last_peered":"2024-05-08T21:19:37.785783+0000","last_clean":"2024-05-08T21:19:37.785783+0000","last_became_active":"2024-05-08T21:10:03.752389+0000","last_became_peered":"2024-05-08T21:10:03.752389+0000","last_unstale":"2024-05-08T21:19:37.785783+0000","last_undegraded":"2024-05-08T21:19:37.785783+0000","last_fullsized":"2024-05-08T21:19:37.785783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:54:02.318162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"32'3907","reported_seq":3974,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:44.404438+0000","last_change":"2024-05-08T21:10:08.048081+0000","last_active":"2024-05-08T21:19:44.404438+0000","last_peered":"2024-05-08T21:19:44.404438+0000","last_clean":"2024-05-08T21:19:44.404438+0000","last_became_active":"2024-05-08T21:10:08.047632+0000","last_became_peered":"2024-05-08T21:10:08.047632+0000","last_unstale":"2024-05-08T21:19:44.404438+0000","last_undegraded":"2024-05-08T21:19:44.404438+0000","last_fullsized":"2024-05-08T21:19:44.404438+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":3907,"log_dups_size":0,"ondisk_log_size":3907,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:26:05.857718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":172065554,"num_objects":44,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":45,"num_read_kb":0,"num_write":51528,"num_write_kb":672103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"29'4","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:27.841501+0000","last_change":"2024-05-08T21:10:03.340553+0000","last_active":"2024-05-08T21:19:27.841501+0000","last_peered":"2024-05-08T21:19:27.841501+0000","last_clean":"2024-05-08T21:19:27.841501+0000","last_became_active":"2024-05-08T21:10:03.340280+0000","last_became_peered":"2024-05-08T21:10:03.340280+0000","last_unstale":"2024-05-08T21:19:27.841501+0000","last_undegraded":"2024-05-08T21:19:27.841501+0000","last_fullsized":"2024-05-08T21:19:27.841501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:36:24.866220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"32'15","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:45.825747+0000","last_change":"2024-05-08T21:10:03.736316+0000","last_active":"2024-05-08T21:19:45.825747+0000","last_peered":"2024-05-08T21:19:45.825747+0000","last_clean":"2024-05-08T21:19:45.825747+0000","last_became_active":"2024-05-08T21:10:03.736049+0000","last_became_peered":"2024-05-08T21:10:03.736049+0000","last_unstale":"2024-05-08T21:19:45.825747+0000","last_undegraded":"2024-05-08T21:19:45.825747+0000","last_fullsized":"2024-05-08T21:19:45.825747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:09:48.973609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'3499","reported_seq":3586,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:44.319404+0000","last_change":"2024-05-08T21:10:53.484914+0000","last_active":"2024-05-08T21:19:44.319404+0000","last_peered":"2024-05-08T21:19:44.319404+0000","last_clean":"2024-05-08T21:19:44.319404+0000","last_became_active":"2024-05-08T21:10:53.484443+0000","last_became_peered":"2024-05-08T21:10:53.484443+0000","last_unstale":"2024-05-08T21:19:44.319404+0000","last_undegraded":"2024-05-08T21:19:44.319404+0000","last_fullsized":"2024-05-08T21:19:44.319404+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":3499,"log_dups_size":0,"ondisk_log_size":3499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:09:00.867177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163711458,"num_objects":47,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":55,"num_read_kb":0,"num_write":45421,"num_write_kb":601547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T21:18:48.750694+0000","last_change":"2024-05-08T21:10:03.340078+0000","last_active":"2024-05-08T21:18:48.750694+0000","last_peered":"2024-05-08T21:18:48.750694+0000","last_clean":"2024-05-08T21:18:48.750694+0000","last_became_active":"2024-05-08T21:10:03.339690+0000","last_became_peered":"2024-05-08T21:10:03.339690+0000","last_unstale":"2024-05-08T21:18:48.750694+0000","last_undegraded":"2024-05-08T21:18:48.750694+0000","last_fullsized":"2024-05-08T21:18:48.750694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:01:33.991878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"32'6","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:35.411053+0000","last_change":"2024-05-08T21:10:03.744606+0000","last_active":"2024-05-08T21:19:35.411053+0000","last_peered":"2024-05-08T21:19:35.411053+0000","last_clean":"2024-05-08T21:19:35.411053+0000","last_became_active":"2024-05-08T21:10:03.744160+0000","last_became_peered":"2024-05-08T21:10:03.744160+0000","last_unstale":"2024-05-08T21:19:35.411053+0000","last_undegraded":"2024-05-08T21:19:35.411053+0000","last_fullsized":"2024-05-08T21:19:35.411053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:10:25.144058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'5102","reported_seq":5196,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:48.092722+0000","last_change":"2024-05-08T21:10:08.049224+0000","last_active":"2024-05-08T21:19:48.092722+0000","last_peered":"2024-05-08T21:19:48.092722+0000","last_clean":"2024-05-08T21:19:48.092722+0000","last_became_active":"2024-05-08T21:10:08.048866+0000","last_became_peered":"2024-05-08T21:10:08.048866+0000","last_unstale":"2024-05-08T21:19:48.092722+0000","last_undegraded":"2024-05-08T21:19:48.092722+0000","last_fullsized":"2024-05-08T21:19:48.092722+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":5102,"log_dups_size":0,"ondisk_log_size":5102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:38:20.601167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100678611,"num_objects":28,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":72,"num_read_kb":0,"num_write":66073,"num_write_kb":843075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T21:18:47.261015+0000","last_change":"2024-05-08T21:10:03.339344+0000","last_active":"2024-05-08T21:18:47.261015+0000","last_peered":"2024-05-08T21:18:47.261015+0000","last_clean":"2024-05-08T21:18:47.261015+0000","last_became_active":"2024-05-08T21:10:03.339136+0000","last_became_peered":"2024-05-08T21:10:03.339136+0000","last_unstale":"2024-05-08T21:18:47.261015+0000","last_undegraded":"2024-05-08T21:18:47.261015+0000","last_fullsized":"2024-05-08T21:18:47.261015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:02:55.623727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"32'9","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.753228+0000","last_change":"2024-05-08T21:10:03.737684+0000","last_active":"2024-05-08T21:19:06.753228+0000","last_peered":"2024-05-08T21:19:06.753228+0000","last_clean":"2024-05-08T21:19:06.753228+0000","last_became_active":"2024-05-08T21:10:03.737459+0000","last_became_peered":"2024-05-08T21:10:03.737459+0000","last_unstale":"2024-05-08T21:19:06.753228+0000","last_undegraded":"2024-05-08T21:19:06.753228+0000","last_fullsized":"2024-05-08T21:19:06.753228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:39.662018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"32'4204","reported_seq":4279,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:44.826152+0000","last_change":"2024-05-08T21:10:07.776483+0000","last_active":"2024-05-08T21:19:44.826152+0000","last_peered":"2024-05-08T21:19:44.826152+0000","last_clean":"2024-05-08T21:19:44.826152+0000","last_became_active":"2024-05-08T21:10:07.775956+0000","last_became_peered":"2024-05-08T21:10:07.775956+0000","last_unstale":"2024-05-08T21:19:44.826152+0000","last_undegraded":"2024-05-08T21:19:44.826152+0000","last_fullsized":"2024-05-08T21:19:44.826152+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4204,"log_dups_size":0,"ondisk_log_size":4204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:28:17.332488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159400953,"num_objects":44,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":53,"num_read_kb":0,"num_write":55040,"num_write_kb":703369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"29'1","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T21:18:52.261484+0000","last_change":"2024-05-08T21:10:03.331695+0000","last_active":"2024-05-08T21:18:52.261484+0000","last_peered":"2024-05-08T21:18:52.261484+0000","last_clean":"2024-05-08T21:18:52.261484+0000","last_became_active":"2024-05-08T21:10:03.331198+0000","last_became_peered":"2024-05-08T21:10:03.331198+0000","last_unstale":"2024-05-08T21:18:52.261484+0000","last_undegraded":"2024-05-08T21:18:52.261484+0000","last_fullsized":"2024-05-08T21:18:52.261484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:37:54.491930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"29'8","reported_seq":32,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T21:19:03.183686+0000","last_change":"2024-05-08T21:10:03.744562+0000","last_active":"2024-05-08T21:19:03.183686+0000","last_peered":"2024-05-08T21:19:03.183686+0000","last_clean":"2024-05-08T21:19:03.183686+0000","last_became_active":"2024-05-08T21:10:03.744326+0000","last_became_peered":"2024-05-08T21:10:03.744326+0000","last_unstale":"2024-05-08T21:19:03.183686+0000","last_undegraded":"2024-05-08T21:19:03.183686+0000","last_fullsized":"2024-05-08T21:19:03.183686+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:21:52.947209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'4068","reported_seq":4144,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:44.156427+0000","last_change":"2024-05-08T21:10:07.763204+0000","last_active":"2024-05-08T21:19:44.156427+0000","last_peered":"2024-05-08T21:19:44.156427+0000","last_clean":"2024-05-08T21:19:44.156427+0000","last_became_active":"2024-05-08T21:10:07.762886+0000","last_became_peered":"2024-05-08T21:10:07.762886+0000","last_unstale":"2024-05-08T21:19:44.156427+0000","last_undegraded":"2024-05-08T21:19:44.156427+0000","last_fullsized":"2024-05-08T21:19:44.156427+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4068,"log_dups_size":0,"ondisk_log_size":4068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:01.599700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184769074,"num_objects":51,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":54,"num_read_kb":0,"num_write":53621,"num_write_kb":692300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"32'671","reported_seq":705,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:11.351259+0000","last_change":"2024-05-08T21:10:03.337993+0000","last_active":"2024-05-08T21:19:11.351259+0000","last_peered":"2024-05-08T21:19:11.351259+0000","last_clean":"2024-05-08T21:19:11.351259+0000","last_became_active":"2024-05-08T21:10:03.337654+0000","last_became_peered":"2024-05-08T21:10:03.337654+0000","last_unstale":"2024-05-08T21:19:11.351259+0000","last_undegraded":"2024-05-08T21:19:11.351259+0000","last_fullsized":"2024-05-08T21:19:11.351259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":671,"log_dups_size":0,"ondisk_log_size":671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:23:20.536178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":13,"num_read_kb":9261,"num_write":667,"num_write_kb":4529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"32'7","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.752034+0000","last_change":"2024-05-08T21:10:03.744871+0000","last_active":"2024-05-08T21:19:06.752034+0000","last_peered":"2024-05-08T21:19:06.752034+0000","last_clean":"2024-05-08T21:19:06.752034+0000","last_became_active":"2024-05-08T21:10:03.744589+0000","last_became_peered":"2024-05-08T21:10:03.744589+0000","last_unstale":"2024-05-08T21:19:06.752034+0000","last_undegraded":"2024-05-08T21:19:06.752034+0000","last_fullsized":"2024-05-08T21:19:06.752034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:41.090204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"32'3957","reported_seq":4027,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:44.457979+0000","last_change":"2024-05-08T21:10:08.047735+0000","last_active":"2024-05-08T21:19:44.457979+0000","last_peered":"2024-05-08T21:19:44.457979+0000","last_clean":"2024-05-08T21:19:44.457979+0000","last_became_active":"2024-05-08T21:10:08.047331+0000","last_became_peered":"2024-05-08T21:10:08.047331+0000","last_unstale":"2024-05-08T21:19:44.457979+0000","last_undegraded":"2024-05-08T21:19:44.457979+0000","last_fullsized":"2024-05-08T21:19:44.457979+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":3957,"log_dups_size":0,"ondisk_log_size":3957,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:44:22.797154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192992866,"num_objects":51,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":48,"num_read_kb":0,"num_write":52570,"num_write_kb":688417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.362283+0000","last_change":"2024-05-08T21:10:03.333117+0000","last_active":"2024-05-08T21:19:06.362283+0000","last_peered":"2024-05-08T21:19:06.362283+0000","last_clean":"2024-05-08T21:19:06.362283+0000","last_became_active":"2024-05-08T21:10:03.332790+0000","last_became_peered":"2024-05-08T21:10:03.332790+0000","last_unstale":"2024-05-08T21:19:06.362283+0000","last_undegraded":"2024-05-08T21:19:06.362283+0000","last_fullsized":"2024-05-08T21:19:06.362283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:52:36.355804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'9","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:39.554404+0000","last_change":"2024-05-08T21:10:03.748047+0000","last_active":"2024-05-08T21:19:39.554404+0000","last_peered":"2024-05-08T21:19:39.554404+0000","last_clean":"2024-05-08T21:19:39.554404+0000","last_became_active":"2024-05-08T21:10:03.747759+0000","last_became_peered":"2024-05-08T21:10:03.747759+0000","last_unstale":"2024-05-08T21:19:39.554404+0000","last_undegraded":"2024-05-08T21:19:39.554404+0000","last_fullsized":"2024-05-08T21:19:39.554404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:11:05.309278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"32'3761","reported_seq":3840,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:47.350916+0000","last_change":"2024-05-08T21:10:07.761000+0000","last_active":"2024-05-08T21:19:47.350916+0000","last_peered":"2024-05-08T21:19:47.350916+0000","last_clean":"2024-05-08T21:19:47.350916+0000","last_became_active":"2024-05-08T21:10:07.760566+0000","last_became_peered":"2024-05-08T21:10:07.760566+0000","last_unstale":"2024-05-08T21:19:47.350916+0000","last_undegraded":"2024-05-08T21:19:47.350916+0000","last_fullsized":"2024-05-08T21:19:47.350916+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":3761,"log_dups_size":0,"ondisk_log_size":3761,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:48:27.435678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100952383,"num_objects":32,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":57,"num_read_kb":0,"num_write":48613,"num_write_kb":636437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"26'1","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.751644+0000","last_change":"2024-05-08T21:10:03.331358+0000","last_active":"2024-05-08T21:19:06.751644+0000","last_peered":"2024-05-08T21:19:06.751644+0000","last_clean":"2024-05-08T21:19:06.751644+0000","last_became_active":"2024-05-08T21:10:03.331028+0000","last_became_peered":"2024-05-08T21:10:03.331028+0000","last_unstale":"2024-05-08T21:19:06.751644+0000","last_undegraded":"2024-05-08T21:19:06.751644+0000","last_fullsized":"2024-05-08T21:19:06.751644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:18:47.922157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"32'8","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:12.888041+0000","last_change":"2024-05-08T21:10:03.751285+0000","last_active":"2024-05-08T21:19:12.888041+0000","last_peered":"2024-05-08T21:19:12.888041+0000","last_clean":"2024-05-08T21:19:12.888041+0000","last_became_active":"2024-05-08T21:10:03.746557+0000","last_became_peered":"2024-05-08T21:10:03.746557+0000","last_unstale":"2024-05-08T21:19:12.888041+0000","last_undegraded":"2024-05-08T21:19:12.888041+0000","last_fullsized":"2024-05-08T21:19:12.888041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:50:27.241404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"32'3702","reported_seq":3767,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:47.314738+0000","last_change":"2024-05-08T21:10:08.048830+0000","last_active":"2024-05-08T21:19:47.314738+0000","last_peered":"2024-05-08T21:19:47.314738+0000","last_clean":"2024-05-08T21:19:47.314738+0000","last_became_active":"2024-05-08T21:10:08.048453+0000","last_became_peered":"2024-05-08T21:10:08.048453+0000","last_unstale":"2024-05-08T21:19:47.314738+0000","last_undegraded":"2024-05-08T21:19:47.314738+0000","last_fullsized":"2024-05-08T21:19:47.314738+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":3702,"log_dups_size":0,"ondisk_log_size":3702,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:19:28.758712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138428923,"num_objects":37,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":43,"num_read_kb":0,"num_write":49303,"num_write_kb":639424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"29'3","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:27.840261+0000","last_change":"2024-05-08T21:10:03.330419+0000","last_active":"2024-05-08T21:19:27.840261+0000","last_peered":"2024-05-08T21:19:27.840261+0000","last_clean":"2024-05-08T21:19:27.840261+0000","last_became_active":"2024-05-08T21:10:03.330082+0000","last_became_peered":"2024-05-08T21:10:03.330082+0000","last_unstale":"2024-05-08T21:19:27.840261+0000","last_undegraded":"2024-05-08T21:19:27.840261+0000","last_fullsized":"2024-05-08T21:19:27.840261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:09:20.516386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"32'9","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:08.753609+0000","last_change":"2024-05-08T21:10:03.747306+0000","last_active":"2024-05-08T21:19:08.753609+0000","last_peered":"2024-05-08T21:19:08.753609+0000","last_clean":"2024-05-08T21:19:08.753609+0000","last_became_active":"2024-05-08T21:10:03.746755+0000","last_became_peered":"2024-05-08T21:10:03.746755+0000","last_unstale":"2024-05-08T21:19:08.753609+0000","last_undegraded":"2024-05-08T21:19:08.753609+0000","last_fullsized":"2024-05-08T21:19:08.753609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:17:51.344821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"32'10","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:35.895502+0000","last_change":"2024-05-08T21:10:03.738627+0000","last_active":"2024-05-08T21:19:35.895502+0000","last_peered":"2024-05-08T21:19:35.895502+0000","last_clean":"2024-05-08T21:19:35.895502+0000","last_became_active":"2024-05-08T21:10:03.738338+0000","last_became_peered":"2024-05-08T21:10:03.738338+0000","last_unstale":"2024-05-08T21:19:35.895502+0000","last_undegraded":"2024-05-08T21:19:35.895502+0000","last_fullsized":"2024-05-08T21:19:35.895502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:34.088831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"32'13","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:44.614454+0000","last_change":"2024-05-08T21:10:03.745607+0000","last_active":"2024-05-08T21:19:44.614454+0000","last_peered":"2024-05-08T21:19:44.614454+0000","last_clean":"2024-05-08T21:19:44.614454+0000","last_became_active":"2024-05-08T21:10:03.745362+0000","last_became_peered":"2024-05-08T21:10:03.745362+0000","last_unstale":"2024-05-08T21:19:44.614454+0000","last_undegraded":"2024-05-08T21:19:44.614454+0000","last_fullsized":"2024-05-08T21:19:44.614454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:54.399930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"32'13","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:41.631427+0000","last_change":"2024-05-08T21:10:03.745137+0000","last_active":"2024-05-08T21:19:41.631427+0000","last_peered":"2024-05-08T21:19:41.631427+0000","last_clean":"2024-05-08T21:19:41.631427+0000","last_became_active":"2024-05-08T21:10:03.744844+0000","last_became_peered":"2024-05-08T21:10:03.744844+0000","last_unstale":"2024-05-08T21:19:41.631427+0000","last_undegraded":"2024-05-08T21:19:41.631427+0000","last_fullsized":"2024-05-08T21:19:41.631427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:06.853429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"32'10","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.753771+0000","last_change":"2024-05-08T21:10:03.745163+0000","last_active":"2024-05-08T21:19:06.753771+0000","last_peered":"2024-05-08T21:19:06.753771+0000","last_clean":"2024-05-08T21:19:06.753771+0000","last_became_active":"2024-05-08T21:10:03.744908+0000","last_became_peered":"2024-05-08T21:10:03.744908+0000","last_unstale":"2024-05-08T21:19:06.753771+0000","last_undegraded":"2024-05-08T21:19:06.753771+0000","last_fullsized":"2024-05-08T21:19:06.753771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:06.593989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'7","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.753879+0000","last_change":"2024-05-08T21:10:03.748542+0000","last_active":"2024-05-08T21:19:06.753879+0000","last_peered":"2024-05-08T21:19:06.753879+0000","last_clean":"2024-05-08T21:19:06.753879+0000","last_became_active":"2024-05-08T21:10:03.748284+0000","last_became_peered":"2024-05-08T21:10:03.748284+0000","last_unstale":"2024-05-08T21:19:06.753879+0000","last_undegraded":"2024-05-08T21:19:06.753879+0000","last_fullsized":"2024-05-08T21:19:06.753879+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:49:10.430406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"32'8","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:41.799210+0000","last_change":"2024-05-08T21:10:03.739778+0000","last_active":"2024-05-08T21:19:41.799210+0000","last_peered":"2024-05-08T21:19:41.799210+0000","last_clean":"2024-05-08T21:19:41.799210+0000","last_became_active":"2024-05-08T21:10:03.739522+0000","last_became_peered":"2024-05-08T21:10:03.739522+0000","last_unstale":"2024-05-08T21:19:41.799210+0000","last_undegraded":"2024-05-08T21:19:41.799210+0000","last_fullsized":"2024-05-08T21:19:41.799210+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:07:42.115999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"32'7","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:32.484326+0000","last_change":"2024-05-08T21:10:03.746126+0000","last_active":"2024-05-08T21:19:32.484326+0000","last_peered":"2024-05-08T21:19:32.484326+0000","last_clean":"2024-05-08T21:19:32.484326+0000","last_became_active":"2024-05-08T21:10:03.745842+0000","last_became_peered":"2024-05-08T21:10:03.745842+0000","last_unstale":"2024-05-08T21:19:32.484326+0000","last_undegraded":"2024-05-08T21:19:32.484326+0000","last_fullsized":"2024-05-08T21:19:32.484326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:51:06.176371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"32'7","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:32.220655+0000","last_change":"2024-05-08T21:10:53.473916+0000","last_active":"2024-05-08T21:19:32.220655+0000","last_peered":"2024-05-08T21:19:32.220655+0000","last_clean":"2024-05-08T21:19:32.220655+0000","last_became_active":"2024-05-08T21:10:53.473615+0000","last_became_peered":"2024-05-08T21:10:53.473615+0000","last_unstale":"2024-05-08T21:19:32.220655+0000","last_undegraded":"2024-05-08T21:19:32.220655+0000","last_fullsized":"2024-05-08T21:19:32.220655+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:58:21.728711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"32'9","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:46.085484+0000","last_change":"2024-05-08T21:10:03.751111+0000","last_active":"2024-05-08T21:19:46.085484+0000","last_peered":"2024-05-08T21:19:46.085484+0000","last_clean":"2024-05-08T21:19:46.085484+0000","last_became_active":"2024-05-08T21:10:03.747059+0000","last_became_peered":"2024-05-08T21:10:03.747059+0000","last_unstale":"2024-05-08T21:19:46.085484+0000","last_undegraded":"2024-05-08T21:19:46.085484+0000","last_fullsized":"2024-05-08T21:19:46.085484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:43.254221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"32'12","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:41.438674+0000","last_change":"2024-05-08T21:10:03.747207+0000","last_active":"2024-05-08T21:19:41.438674+0000","last_peered":"2024-05-08T21:19:41.438674+0000","last_clean":"2024-05-08T21:19:41.438674+0000","last_became_active":"2024-05-08T21:10:03.746942+0000","last_became_peered":"2024-05-08T21:10:03.746942+0000","last_unstale":"2024-05-08T21:19:41.438674+0000","last_undegraded":"2024-05-08T21:19:41.438674+0000","last_fullsized":"2024-05-08T21:19:41.438674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:33:52.317273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"32'11","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:44.490151+0000","last_change":"2024-05-08T21:10:03.753663+0000","last_active":"2024-05-08T21:19:44.490151+0000","last_peered":"2024-05-08T21:19:44.490151+0000","last_clean":"2024-05-08T21:19:44.490151+0000","last_became_active":"2024-05-08T21:10:03.752486+0000","last_became_peered":"2024-05-08T21:10:03.752486+0000","last_unstale":"2024-05-08T21:19:44.490151+0000","last_undegraded":"2024-05-08T21:19:44.490151+0000","last_fullsized":"2024-05-08T21:19:44.490151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:21:45.895154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"32'11","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:12.559115+0000","last_change":"2024-05-08T21:10:03.753849+0000","last_active":"2024-05-08T21:19:12.559115+0000","last_peered":"2024-05-08T21:19:12.559115+0000","last_clean":"2024-05-08T21:19:12.559115+0000","last_became_active":"2024-05-08T21:10:03.753616+0000","last_became_peered":"2024-05-08T21:10:03.753616+0000","last_unstale":"2024-05-08T21:19:12.559115+0000","last_undegraded":"2024-05-08T21:19:12.559115+0000","last_fullsized":"2024-05-08T21:19:12.559115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:02:58.650310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"29'7","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.751337+0000","last_change":"2024-05-08T21:10:03.744906+0000","last_active":"2024-05-08T21:19:06.751337+0000","last_peered":"2024-05-08T21:19:06.751337+0000","last_clean":"2024-05-08T21:19:06.751337+0000","last_became_active":"2024-05-08T21:10:03.744562+0000","last_became_peered":"2024-05-08T21:10:03.744562+0000","last_unstale":"2024-05-08T21:19:06.751337+0000","last_undegraded":"2024-05-08T21:19:06.751337+0000","last_fullsized":"2024-05-08T21:19:06.751337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:21:30.416392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":4813444434,"num_objects":1337,"num_object_clones":0,"num_object_copies":5348,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1337,"num_whiteouts":0,"num_read":1810,"num_read_kb":0,"num_write":1713068,"num_write_kb":22146371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":5956182016,"data_stored":9597403136,"data_compressed":575771364,"data_compressed_allocated":1764438016,"data_compressed_original":5405659136,"omap_allocated":0,"internal_metadata":0},"log_size":131071,"ondisk_log_size":131071,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":541,"ondisk_log_size":541,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64612,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":15836278,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":328,"num_read_kb":39720,"num_write":2864,"num_write_kb":17763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17801216,"data_stored":31671683,"data_compressed":2933172,"data_compressed_allocated":3907584,"data_compressed_original":17833984,"omap_allocated":0,"internal_metadata":0},"log_size":2816,"ondisk_log_size":2816,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509559,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1851612,"kb_used_data":962324,"kb_used_omap":1,"kb_used_meta":889278,"kb_avail":92520228,"statfs":{"total":96636764160,"available":94740713472,"internally_reserved":0,"allocated":985419776,"data_stored":1592739867,"data_compressed":95964760,"data_compressed_allocated":292941824,"data_compressed_original":900464640,"omap_allocated":1593,"internal_metadata":910621127},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:19:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.9790000000000001,"15min":1.603},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":5.5289999999999999,"5min":13.432,"15min":17.978999999999999},"last":2.6400000000000001},{"interface":"front","average":{"1min":0.91700000000000004,"5min":1.4750000000000001,"15min":1.0800000000000001},"min":{"1min":0.24299999999999999,"5min":0.219,"15min":0.219},"max":{"1min":5.2889999999999997,"5min":10.097,"15min":11.362},"last":0.39100000000000001}]},{"osd":1,"last update":"Wed May 8 21:19:07 2024","interfaces":[{"interface":"back","average":{"1min":2.2170000000000001,"5min":2.831,"15min":1.863},"min":{"1min":0.247,"5min":0.219,"15min":0.219},"max":{"1min":9.7360000000000007,"5min":49.942999999999998,"15min":49.942999999999998},"last":2.5739999999999998},{"interface":"front","average":{"1min":1.726,"5min":2.5259999999999998,"15min":1.516},"min":{"1min":0.45100000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":5.2789999999999999,"5min":27.733000000000001,"15min":27.733000000000001},"last":4.0300000000000002}]},{"osd":2,"last update":"Wed May 8 21:19:07 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":1.583,"15min":1.6970000000000001},"min":{"1min":0.27100000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":2.7189999999999999,"5min":17.858000000000001,"15min":58.450000000000003},"last":2.4620000000000002},{"interface":"front","average":{"1min":1.165,"5min":1.639,"15min":1.1319999999999999},"min":{"1min":0.32000000000000001,"5min":0.30199999999999999,"15min":0.27400000000000002},"max":{"1min":4.6559999999999997,"5min":13.568,"15min":14.746},"last":0.70999999999999996}]},{"osd":3,"last update":"Wed May 8 21:19:07 2024","interfaces":[{"interface":"back","average":{"1min":1.6379999999999999,"5min":4.3520000000000003,"15min":2.617},"min":{"1min":0.35499999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":6.1879999999999997,"5min":68.728999999999999,"15min":74.570999999999998},"last":6.7800000000000002},{"interface":"front","average":{"1min":1.173,"5min":2.3490000000000002,"15min":1.6279999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":11.816000000000001,"5min":27.358000000000001,"15min":28.099},"last":3.3679999999999999}]},{"osd":4,"last update":"Wed May 8 21:19:07 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":1.5580000000000001,"15min":1.1319999999999999},"min":{"1min":0.23300000000000001,"5min":0.223,"15min":0.223},"max":{"1min":8.0869999999999997,"5min":27.963000000000001,"15min":29.731000000000002},"last":0.28100000000000003},{"interface":"front","average":{"1min":1.258,"5min":1.5660000000000001,"15min":1.1519999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":10.657999999999999,"5min":17.835999999999999,"15min":26.454999999999998},"last":0.35299999999999998}]},{"osd":5,"last update":"Wed May 8 21:19:07 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":1.1000000000000001,"15min":1.177},"min":{"1min":0.30099999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":2.4510000000000001,"5min":17.780999999999999,"15min":65.373000000000005},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":1.2809999999999999,"15min":1.046},"min":{"1min":0.28399999999999997,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.357,"5min":13.509,"15min":26.498999999999999},"last":0.43099999999999999}]},{"osd":7,"last update":"Wed May 8 21:19:07 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":1.7889999999999999,"15min":1.0589999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.9450000000000001,"5min":16.808,"15min":16.808},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":1.4770000000000001,"15min":0.96499999999999997},"min":{"1min":0.33600000000000002,"5min":0.314,"15min":0.314},"max":{"1min":1.821,"5min":18.100999999999999,"15min":18.100999999999999},"last":0.41199999999999998}]}]},{"osd":5,"up_from":15,"seq":64424509561,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1087120,"kb_used_data":413448,"kb_used_omap":1,"kb_used_meta":673662,"kb_avail":93284720,"statfs":{"total":96636764160,"available":95523553280,"internally_reserved":0,"allocated":423370752,"data_stored":688813525,"data_compressed":41956954,"data_compressed_allocated":130084864,"data_compressed_original":395726848,"omap_allocated":1594,"internal_metadata":689830342},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":1.8360000000000001,"15min":1.4450000000000001},"min":{"1min":0.24199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":7.8029999999999999,"5min":17.295999999999999,"15min":48.481999999999999},"last":2.738},{"interface":"front","average":{"1min":1.619,"5min":2.0600000000000001,"15min":1.522},"min":{"1min":0.36299999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":13.234999999999999,"5min":17.164000000000001,"15min":30.004999999999999},"last":4.4900000000000002}]},{"osd":1,"last update":"Wed May 8 21:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":2.7120000000000002,"15min":1.7310000000000001},"min":{"1min":0.26800000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":3.0550000000000002,"5min":21.702999999999999,"15min":25.228000000000002},"last":6.6870000000000003},{"interface":"front","average":{"1min":0.86299999999999999,"5min":2.4710000000000001,"15min":1.403},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":4.0670000000000002,"5min":21.869,"15min":21.869},"last":6.766}]},{"osd":2,"last update":"Wed May 8 21:19:19 2024","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":3.0019999999999998,"15min":1.6699999999999999},"min":{"1min":0.29399999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":10.689,"5min":34.850000000000001,"15min":34.850000000000001},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":2.4430000000000001,"15min":1.4690000000000001},"min":{"1min":0.28899999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.617,"5min":29.623000000000001,"15min":29.623000000000001},"last":0.93200000000000005}]},{"osd":3,"last update":"Wed May 8 21:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":1.8029999999999999,"15min":1.377},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":4.1070000000000002,"5min":19.395,"15min":23.234999999999999},"last":6.7999999999999998},{"interface":"front","average":{"1min":1.55,"5min":3.6520000000000001,"15min":2.0489999999999999},"min":{"1min":0.34399999999999997,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":20.013000000000002,"5min":40.954999999999998,"15min":40.954999999999998},"last":6.9980000000000002}]},{"osd":4,"last update":"Wed May 8 21:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":1.0369999999999999,"15min":0.89800000000000002},"min":{"1min":0.27500000000000002,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.95599999999999996,"5min":12.390000000000001,"15min":23.254000000000001},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":1.0820000000000001,"15min":0.93999999999999995},"min":{"1min":0.32300000000000001,"5min":0.27600000000000002,"15min":0.26600000000000001},"max":{"1min":3.0859999999999999,"5min":7.7370000000000001,"15min":17.550999999999998},"last":0.34599999999999997}]},{"osd":6,"last update":"Wed May 8 21:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.95299999999999996,"15min":0.89100000000000001},"min":{"1min":0.26900000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.747,"5min":8.7249999999999996,"15min":17.856000000000002},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":1.1619999999999999,"15min":1.0029999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.26900000000000002},"max":{"1min":0.77700000000000002,"5min":8.9269999999999996,"15min":17.827999999999999},"last":0.40999999999999998}]},{"osd":7,"last update":"Wed May 8 21:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":1.1739999999999999,"15min":0.92900000000000005},"min":{"1min":0.311,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.98499999999999999,"5min":11.183999999999999,"15min":18.079000000000001},"last":0.371},{"interface":"front","average":{"1min":0.73499999999999999,"5min":1.464,"15min":1.1659999999999999},"min":{"1min":0.30599999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":4.8819999999999997,"5min":13.496,"15min":30.050000000000001},"last":0.39300000000000002}]}]},{"osd":0,"up_from":14,"seq":60129542265,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1273124,"kb_used_data":511068,"kb_used_omap":1,"kb_used_meta":762046,"kb_avail":93098716,"statfs":{"total":96636764160,"available":95333085184,"internally_reserved":0,"allocated":523333632,"data_stored":837461602,"data_compressed":50494929,"data_compressed_allocated":155848704,"data_compressed_original":470188032,"omap_allocated":1594,"internal_metadata":780335558},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 8 21:19:14 2024","interfaces":[{"interface":"back","average":{"1min":3.8900000000000001,"5min":2.9590000000000001,"15min":1.925},"min":{"1min":0.193,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":24.199999999999999,"5min":24.199999999999999,"15min":98.899000000000001},"last":2.4279999999999999},{"interface":"front","average":{"1min":2.4420000000000002,"5min":2.8100000000000001,"15min":1.6519999999999999},"min":{"1min":0.24199999999999999,"5min":0.185,"15min":0.185},"max":{"1min":13.778,"5min":25.295999999999999,"15min":39.594000000000001},"last":1.9390000000000001}]},{"osd":2,"last update":"Wed May 8 21:19:14 2024","interfaces":[{"interface":"back","average":{"1min":3.2759999999999998,"5min":2.4390000000000001,"15min":1.6479999999999999},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.224},"max":{"1min":21.695,"5min":27.657,"15min":33.238999999999997},"last":0.25600000000000001},{"interface":"front","average":{"1min":1.7949999999999999,"5min":1.8240000000000001,"15min":1.0800000000000001},"min":{"1min":0.26500000000000001,"5min":0.22500000000000001,"15min":0.223},"max":{"1min":17.302,"5min":27.027000000000001,"15min":27.027000000000001},"last":0.218}]},{"osd":3,"last update":"Wed May 8 21:19:14 2024","interfaces":[{"interface":"back","average":{"1min":1.7090000000000001,"5min":2.9100000000000001,"15min":2.1909999999999998},"min":{"1min":0.28499999999999998,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":17.355,"5min":30.341999999999999,"15min":77.010999999999996},"last":1.9750000000000001},{"interface":"front","average":{"1min":1.879,"5min":2.069,"15min":1.653},"min":{"1min":0.33400000000000002,"5min":0.29199999999999998,"15min":0.28899999999999998},"max":{"1min":17.271000000000001,"5min":29.155999999999999,"15min":93.995999999999995},"last":2.464}]},{"osd":4,"last update":"Wed May 8 21:19:14 2024","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":2.0990000000000002,"15min":1.7330000000000001},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":6.8259999999999996,"5min":27.513999999999999,"15min":33.121000000000002},"last":0.53100000000000003},{"interface":"front","average":{"1min":1.196,"5min":2.149,"15min":1.474},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":9.1869999999999994,"5min":27.48,"15min":27.48},"last":5.1340000000000003}]},{"osd":5,"last update":"Wed May 8 21:19:14 2024","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":2.1440000000000001,"15min":1.5009999999999999},"min":{"1min":0.32100000000000001,"5min":0.311,"15min":0.311},"max":{"1min":7.3339999999999996,"5min":13.412000000000001,"15min":29.919},"last":6.4020000000000001},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.923,"15min":1.714},"min":{"1min":0.34100000000000003,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":9.3979999999999997,"5min":20.626999999999999,"15min":33.209000000000003},"last":5.1799999999999997}]},{"osd":6,"last update":"Wed May 8 21:19:14 2024","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":1.738,"15min":1.4159999999999999},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":7.702,"5min":11.276999999999999,"15min":19.527999999999999},"last":6.4279999999999999},{"interface":"front","average":{"1min":1.599,"5min":2.2690000000000001,"15min":1.4390000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":9.2219999999999995,"5min":15.829000000000001,"15min":29.800000000000001},"last":5.1630000000000003}]},{"osd":7,"last update":"Wed May 8 21:19:14 2024","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":2.0179999999999998,"15min":1.639},"min":{"1min":0.35699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":8.952,"5min":11.372999999999999,"15min":33.174999999999997},"last":0.62},{"interface":"front","average":{"1min":1.0089999999999999,"5min":2.351,"15min":1.4690000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":4.7450000000000001,"5min":21.097999999999999,"15min":21.097999999999999},"last":0.63500000000000001}]}]},{"osd":7,"up_from":14,"seq":60129542264,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1685536,"kb_used_data":865368,"kb_used_omap":1,"kb_used_meta":820158,"kb_avail":92686304,"statfs":{"total":96636764160,"available":94910775296,"internally_reserved":0,"allocated":886136832,"data_stored":1428555306,"data_compressed":86022480,"data_compressed_allocated":262336512,"data_compressed_original":804958208,"omap_allocated":1589,"internal_metadata":839842251},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:19:08 2024","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":2.21,"15min":1.1799999999999999},"min":{"1min":0.217,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":10.747999999999999,"5min":20.876999999999999,"15min":20.876999999999999},"last":4.1699999999999999},{"interface":"front","average":{"1min":1.343,"5min":2.1579999999999999,"15min":1.4730000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":4.0570000000000004,"5min":23.748999999999999,"15min":62.033000000000001},"last":1.2549999999999999}]},{"osd":1,"last update":"Wed May 8 21:19:17 2024","interfaces":[{"interface":"back","average":{"1min":1.9350000000000001,"5min":2.8330000000000002,"15min":2.04},"min":{"1min":0.251,"5min":0.251,"15min":0.246},"max":{"1min":23.103999999999999,"5min":44.164000000000001,"15min":44.645000000000003},"last":6.0430000000000001},{"interface":"front","average":{"1min":1.7050000000000001,"5min":2.395,"15min":1.3720000000000001},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":8.3339999999999996,"5min":44.091000000000001,"15min":44.091000000000001},"last":20.672999999999998}]},{"osd":2,"last update":"Wed May 8 21:19:08 2024","interfaces":[{"interface":"back","average":{"1min":2.3740000000000001,"5min":2.0870000000000002,"15min":1.131},"min":{"1min":0.34599999999999997,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":11.388999999999999,"5min":15.986000000000001,"15min":15.986000000000001},"last":0.35599999999999998},{"interface":"front","average":{"1min":2.121,"5min":1.833,"15min":1.028},"min":{"1min":0.45000000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":9.3949999999999996,"5min":11.112,"15min":11.112},"last":0.41699999999999998}]},{"osd":3,"last update":"Wed May 8 21:19:08 2024","interfaces":[{"interface":"back","average":{"1min":2.3969999999999998,"5min":3.1320000000000001,"15min":1.5880000000000001},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":9.8789999999999996,"5min":44.064999999999998,"15min":44.064999999999998},"last":1.867},{"interface":"front","average":{"1min":1.7649999999999999,"5min":2.661,"15min":1.7050000000000001},"min":{"1min":0.379,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":15.789,"5min":44.607999999999997,"15min":44.607999999999997},"last":0.38}]},{"osd":4,"last update":"Wed May 8 21:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":1.0549999999999999,"15min":0.82699999999999996},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":3.1850000000000001,"5min":10.51,"15min":21.338000000000001},"last":1.2210000000000001},{"interface":"front","average":{"1min":0.80200000000000005,"5min":1.302,"15min":0.94799999999999995},"min":{"1min":0.27900000000000003,"5min":0.216,"15min":0.216},"max":{"1min":3.242,"5min":16.082999999999998,"15min":22.827000000000002},"last":0.34000000000000002}]},{"osd":5,"last update":"Wed May 8 21:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.079,"15min":0.85299999999999998},"min":{"1min":0.28899999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":10.785,"5min":10.785,"15min":10.880000000000001},"last":1.2909999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":1.026,"15min":0.84699999999999998},"min":{"1min":0.32700000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.613,"5min":7.4939999999999998,"15min":8.157},"last":1.2729999999999999}]},{"osd":6,"last update":"Wed May 8 21:19:17 2024","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.2909999999999999,"15min":0.86099999999999999},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":12.433,"5min":12.433,"15min":12.433},"last":0.5},{"interface":"front","average":{"1min":1.252,"5min":1.546,"15min":1.052},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":12.182,"5min":19.864999999999998,"15min":19.864999999999998},"last":1.6659999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574968,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1245820,"kb_used_data":520372,"kb_used_omap":1,"kb_used_meta":725438,"kb_avail":93126020,"statfs":{"total":96636764160,"available":95361044480,"internally_reserved":0,"allocated":532860928,"data_stored":864867558,"data_compressed":51795822,"data_compressed_allocated":157683712,"data_compressed_original":489885696,"omap_allocated":1594,"internal_metadata":742848966},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,2,2,2,1,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:19:12 2024","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":2.6640000000000001,"15min":1.5049999999999999},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.20399999999999999},"max":{"1min":7.3049999999999997,"5min":17.789000000000001,"15min":24.859999999999999},"last":17.690000000000001},{"interface":"front","average":{"1min":1.486,"5min":2.1960000000000002,"15min":1.3759999999999999},"min":{"1min":0.27200000000000002,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":7.4560000000000004,"5min":17.835999999999999,"15min":49.606000000000002},"last":11.759}]},{"osd":1,"last update":"Wed May 8 21:19:12 2024","interfaces":[{"interface":"back","average":{"1min":3.0430000000000001,"5min":2.6960000000000002,"15min":1.7470000000000001},"min":{"1min":0.26500000000000001,"5min":0.218,"15min":0.19800000000000001},"max":{"1min":24.321999999999999,"5min":25.135999999999999,"15min":55.296999999999997},"last":9.5289999999999999},{"interface":"front","average":{"1min":2.706,"5min":2.4990000000000001,"15min":1.7090000000000001},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":24.149999999999999,"5min":24.149999999999999,"15min":79.221000000000004},"last":3.117}]},{"osd":3,"last update":"Wed May 8 21:19:12 2024","interfaces":[{"interface":"back","average":{"1min":2.1440000000000001,"5min":4.8819999999999997,"15min":2.1600000000000001},"min":{"1min":0.32000000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":7.7510000000000003,"5min":69.888000000000005,"15min":69.888000000000005},"last":0.82899999999999996},{"interface":"front","average":{"1min":2.1829999999999998,"5min":4.931,"15min":2.198},"min":{"1min":0.33900000000000002,"5min":0.30199999999999999,"15min":0.23699999999999999},"max":{"1min":7.7850000000000001,"5min":69.959000000000003,"15min":69.959000000000003},"last":1.4159999999999999}]},{"osd":4,"last update":"Wed May 8 21:19:12 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":1.8979999999999999,"15min":1.4319999999999999},"min":{"1min":0.34999999999999998,"5min":0.253,"15min":0.253},"max":{"1min":2.2170000000000001,"5min":17.716999999999999,"15min":32.457999999999998},"last":0.33700000000000002},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.823,"15min":1.171},"min":{"1min":0.25700000000000001,"5min":0.255,"15min":0.255},"max":{"1min":7.3940000000000001,"5min":13.827,"15min":18.315000000000001},"last":0.28299999999999997}]},{"osd":5,"last update":"Wed May 8 21:19:12 2024","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.655,"15min":1.079},"min":{"1min":0.38500000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":4.4219999999999997,"5min":17.507999999999999,"15min":17.507999999999999},"last":1.4430000000000001},{"interface":"front","average":{"1min":0.72399999999999998,"5min":2.6200000000000001,"15min":1.6200000000000001},"min":{"1min":0.30299999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.744,"5min":48.560000000000002,"15min":48.560000000000002},"last":0.318}]},{"osd":6,"last update":"Wed May 8 21:19:12 2024","interfaces":[{"interface":"back","average":{"1min":1.4770000000000001,"5min":1.911,"15min":1.246},"min":{"1min":0.39300000000000002,"5min":0.308,"15min":0.308},"max":{"1min":7.4290000000000003,"5min":13.933999999999999,"15min":16.399999999999999},"last":0.30199999999999999},{"interface":"front","average":{"1min":1.196,"5min":1.9970000000000001,"15min":1.2909999999999999},"min":{"1min":0.46800000000000003,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":4.4649999999999999,"5min":17.536000000000001,"15min":23.216000000000001},"last":1.381}]},{"osd":7,"last update":"Wed May 8 21:19:12 2024","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.9750000000000001,"15min":1.2929999999999999},"min":{"1min":0.42499999999999999,"5min":0.33200000000000002,"15min":0.33000000000000002},"max":{"1min":4.492,"5min":11.041,"15min":16.366},"last":1.4710000000000001},{"interface":"front","average":{"1min":1.6499999999999999,"5min":1.7509999999999999,"15min":1.1439999999999999},"min":{"1min":0.46200000000000002,"5min":0.313,"15min":0.313},"max":{"1min":7.4820000000000002,"5min":13.903,"15min":13.903},"last":1.494}]}]},{"osd":3,"up_from":14,"seq":60129542260,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2541788,"kb_used_data":1313800,"kb_used_omap":1,"kb_used_meta":1217726,"kb_avail":91830052,"statfs":{"total":96636764160,"available":94033973248,"internally_reserved":0,"allocated":1345331200,"data_stored":2154886945,"data_compressed":128738368,"data_compressed_allocated":393650176,"data_compressed_original":1203408896,"omap_allocated":1592,"internal_metadata":1246951880},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,2,1,5,0,12,3],"upper_bound":512},"perf_stat":{"commit_latency_ms":44,"apply_latency_ms":44,"commit_latency_ns":44000000,"apply_latency_ns":44000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:19:20 2024","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":2.9950000000000001,"15min":1.3879999999999999},"min":{"1min":0.24299999999999999,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":7.2930000000000001,"5min":39.801000000000002,"15min":39.801000000000002},"last":0.64100000000000001},{"interface":"front","average":{"1min":1.3049999999999999,"5min":2.0680000000000001,"15min":1.7569999999999999},"min":{"1min":0.26000000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":10.782,"5min":14.497,"15min":60.847999999999999},"last":3.335}]},{"osd":1,"last update":"Wed May 8 21:19:20 2024","interfaces":[{"interface":"back","average":{"1min":2.5249999999999999,"5min":3.3759999999999999,"15min":1.851},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":15.603,"5min":47.418999999999997,"15min":57.020000000000003},"last":0.91200000000000003},{"interface":"front","average":{"1min":4.6790000000000003,"5min":4.5030000000000001,"15min":2.0070000000000001},"min":{"1min":0.26300000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":29.669,"5min":43.317,"15min":43.317},"last":20.542000000000002}]},{"osd":2,"last update":"Wed May 8 21:19:20 2024","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.714,"15min":1.105},"min":{"1min":0.32000000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":10.712999999999999,"5min":10.938000000000001,"15min":32.247999999999998},"last":20.440000000000001},{"interface":"front","average":{"1min":1.5029999999999999,"5min":3.1099999999999999,"15min":1.5780000000000001},"min":{"1min":0.33300000000000002,"5min":0.31,"15min":0.26200000000000001},"max":{"1min":7.2030000000000003,"5min":39.386000000000003,"15min":39.386000000000003},"last":0.55500000000000005}]},{"osd":4,"last update":"Wed May 8 21:19:20 2024","interfaces":[{"interface":"back","average":{"1min":1.446,"5min":1.6639999999999999,"15min":1.639},"min":{"1min":0.39300000000000002,"5min":0.309,"15min":0.309},"max":{"1min":10.755000000000001,"5min":10.755000000000001,"15min":58.072000000000003},"last":5.2130000000000001},{"interface":"front","average":{"1min":1.387,"5min":2.3650000000000002,"15min":1.367},"min":{"1min":0.46700000000000003,"5min":0.314,"15min":0.314},"max":{"1min":7.2430000000000003,"5min":15.712,"15min":26.311},"last":0.59199999999999997}]},{"osd":5,"last update":"Wed May 8 21:19:20 2024","interfaces":[{"interface":"back","average":{"1min":1.5760000000000001,"5min":1.786,"15min":1.6200000000000001},"min":{"1min":0.438,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":10.842000000000001,"5min":14.584,"15min":60.375999999999998},"last":5.2610000000000001},{"interface":"front","average":{"1min":1.4139999999999999,"5min":2.9359999999999999,"15min":1.6080000000000001},"min":{"1min":0.45500000000000002,"5min":0.31,"15min":0.31},"max":{"1min":7.2679999999999998,"5min":39.274000000000001,"15min":39.274000000000001},"last":0.94299999999999995}]},{"osd":6,"last update":"Wed May 8 21:19:20 2024","interfaces":[{"interface":"back","average":{"1min":2.9710000000000001,"5min":3.452,"15min":1.8580000000000001},"min":{"1min":0.34499999999999997,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":30.25,"5min":30.25,"15min":30.25},"last":5.2779999999999996},{"interface":"front","average":{"1min":1.6499999999999999,"5min":3.4319999999999999,"15min":1.861},"min":{"1min":0.48099999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":11.914,"5min":41.323999999999998,"15min":41.323999999999998},"last":0.61799999999999999}]},{"osd":7,"last update":"Wed May 8 21:19:20 2024","interfaces":[{"interface":"back","average":{"1min":2.907,"5min":3.5510000000000002,"15min":1.829},"min":{"1min":0.40100000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":30.295000000000002,"5min":30.295000000000002,"15min":30.295000000000002},"last":5.3070000000000004},{"interface":"front","average":{"1min":3.0310000000000001,"5min":3.9180000000000001,"15min":2.0110000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":30.201000000000001,"5min":30.201000000000001,"15min":30.201000000000001},"last":5.3310000000000004}]}]},{"osd":1,"up_from":15,"seq":64424509558,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1812528,"kb_used_data":663848,"kb_used_omap":1,"kb_used_meta":1148670,"kb_avail":92559312,"statfs":{"total":96636764160,"available":94780735488,"internally_reserved":0,"allocated":679780352,"data_stored":1092003355,"data_compressed":65660496,"data_compressed_allocated":202670080,"data_compressed_original":615096320,"omap_allocated":1594,"internal_metadata":1176238534},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,1,3,3,2,2,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":2.2400000000000002,"15min":1.653},"min":{"1min":0.22800000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.77300000000000002,"5min":16.692,"15min":68.346999999999994},"last":1.623},{"interface":"front","average":{"1min":0.97399999999999998,"5min":2.5630000000000002,"15min":1.486},"min":{"1min":0.22,"5min":0.21199999999999999,"15min":0.19800000000000001},"max":{"1min":6.6589999999999998,"5min":16.875,"15min":25.786000000000001},"last":1.5}]},{"osd":2,"last update":"Wed May 8 21:19:16 2024","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":2.552,"15min":2.2440000000000002},"min":{"1min":0.22700000000000001,"5min":0.191,"15min":0.191},"max":{"1min":7.5350000000000001,"5min":18.373000000000001,"15min":70.688000000000002},"last":9.8689999999999998},{"interface":"front","average":{"1min":1.151,"5min":2.0419999999999998,"15min":1.796},"min":{"1min":0.25600000000000001,"5min":0.22800000000000001,"15min":0.219},"max":{"1min":9.0779999999999994,"5min":14.207000000000001,"15min":35.401000000000003},"last":6.8650000000000002}]},{"osd":3,"last update":"Wed May 8 21:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":2.3690000000000002,"15min":1.599},"min":{"1min":0.26600000000000001,"5min":0.224,"15min":0.224},"max":{"1min":6.4299999999999997,"5min":14.621,"15min":35.658000000000001},"last":9.7759999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":1.96,"15min":1.6200000000000001},"min":{"1min":0.316,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":2.5609999999999999,"5min":14.189,"15min":27.207999999999998},"last":1.5449999999999999}]},{"osd":4,"last update":"Wed May 8 21:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":1.8580000000000001,"15min":1.4830000000000001},"min":{"1min":0.34999999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":2.5209999999999999,"5min":16.561,"15min":43.401000000000003},"last":1.46},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.9550000000000001,"15min":1.351},"min":{"1min":0.37,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":6.702,"5min":10.372999999999999,"15min":27.239000000000001},"last":1.5700000000000001}]},{"osd":5,"last update":"Wed May 8 21:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":2.2040000000000002,"15min":1.7509999999999999},"min":{"1min":0.36199999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.1399999999999999,"5min":18.241,"15min":43.515000000000001},"last":1.5249999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":1.8620000000000001,"15min":1.633},"min":{"1min":0.40500000000000003,"5min":0.34899999999999998,"15min":0.32300000000000001},"max":{"1min":0.80300000000000005,"5min":19.843,"15min":27.352},"last":1.516}]},{"osd":6,"last update":"Wed May 8 21:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":2.6589999999999998,"15min":1.748},"min":{"1min":0.34300000000000003,"5min":0.307,"15min":0.307},"max":{"1min":1.1879999999999999,"5min":18.268999999999998,"15min":43.472999999999999},"last":1.5629999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":1.9319999999999999,"15min":1.425},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35499999999999998},"max":{"1min":2.4710000000000001,"5min":16.155000000000001,"15min":27.376999999999999},"last":1.599}]},{"osd":7,"last update":"Wed May 8 21:19:16 2024","interfaces":[{"interface":"back","average":{"1min":1.544,"5min":2.5390000000000001,"15min":1.9910000000000001},"min":{"1min":0.39000000000000001,"5min":0.315,"15min":0.315},"max":{"1min":6.7309999999999999,"5min":13.484999999999999,"15min":68.287999999999997},"last":6.9189999999999996},{"interface":"front","average":{"1min":0.95599999999999996,"5min":1.8280000000000001,"15min":1.6000000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":4.2450000000000001,"5min":13.592000000000001,"15min":27.312999999999999},"last":4.6980000000000004}]}]},{"osd":4,"up_from":15,"seq":64424509559,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1807580,"kb_used_data":892436,"kb_used_omap":1,"kb_used_meta":915134,"kb_avail":92564260,"statfs":{"total":96636764160,"available":94785802240,"internally_reserved":0,"allocated":913854464,"data_stored":1469142521,"data_compressed":87898752,"data_compressed_allocated":266387456,"data_compressed_original":821882880,"omap_allocated":1593,"internal_metadata":937097671},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,2,3,3,1,3],"upper_bound":256},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:19:19 2024","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.5580000000000001,"15min":1.0549999999999999},"min":{"1min":0.28299999999999997,"5min":0.218,"15min":0.218},"max":{"1min":7.6849999999999996,"5min":20.606999999999999,"15min":20.606999999999999},"last":1.6759999999999999},{"interface":"front","average":{"1min":1.7769999999999999,"5min":2.7770000000000001,"15min":1.758},"min":{"1min":0.316,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":18.945,"5min":45.499000000000002,"15min":45.499000000000002},"last":1.7090000000000001}]},{"osd":1,"last update":"Wed May 8 21:19:19 2024","interfaces":[{"interface":"back","average":{"1min":2.4870000000000001,"5min":5.0439999999999996,"15min":2.5},"min":{"1min":0.28100000000000003,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":18.905999999999999,"5min":273.69299999999998,"15min":273.69299999999998},"last":7.7460000000000004},{"interface":"front","average":{"1min":1.0409999999999999,"5min":4.907,"15min":3.069},"min":{"1min":0.35499999999999998,"5min":0.28699999999999998,"15min":0.26200000000000001},"max":{"1min":5.2290000000000001,"5min":281.21699999999998,"15min":281.21699999999998},"last":7.7249999999999996}]},{"osd":2,"last update":"Wed May 8 21:19:19 2024","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.8089999999999999,"15min":1.395},"min":{"1min":0.26200000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":7.4119999999999999,"5min":46.542000000000002,"15min":96.177999999999997},"last":1.5489999999999999},{"interface":"front","average":{"1min":0.64100000000000001,"5min":1.415,"15min":1.361},"min":{"1min":0.35399999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.7070000000000001,"5min":16.183,"15min":94.947000000000003},"last":0.69999999999999996}]},{"osd":3,"last update":"Wed May 8 21:19:19 2024","interfaces":[{"interface":"back","average":{"1min":1.8999999999999999,"5min":2.3540000000000001,"15min":1.429},"min":{"1min":0.33500000000000002,"5min":0.245,"15min":0.23899999999999999},"max":{"1min":18.632000000000001,"5min":18.632000000000001,"15min":30.596},"last":3.1349999999999998},{"interface":"front","average":{"1min":1.111,"5min":3.4340000000000002,"15min":1.804},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":5.2089999999999996,"5min":42.969000000000001,"15min":42.969000000000001},"last":3.2000000000000002}]},{"osd":5,"last update":"Wed May 8 21:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":1.7669999999999999,"15min":1.129},"min":{"1min":0.29499999999999998,"5min":0.252,"15min":0.221},"max":{"1min":1.714,"5min":46.488999999999997,"15min":46.488999999999997},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.877,"5min":1.6899999999999999,"15min":0.98599999999999999},"min":{"1min":0.37,"5min":0.28000000000000003,"15min":0.26200000000000001},"max":{"1min":4.9320000000000004,"5min":45.445999999999998,"15min":45.445999999999998},"last":0.78700000000000003}]},{"osd":6,"last update":"Wed May 8 21:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":1.869,"15min":1.1439999999999999},"min":{"1min":0.29699999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.6839999999999999,"5min":35.289999999999999,"15min":35.289999999999999},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":2.145,"15min":1.5029999999999999},"min":{"1min":0.371,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.351,"5min":46.576999999999998,"15min":46.576999999999998},"last":0.81599999999999995}]},{"osd":7,"last update":"Wed May 8 21:19:19 2024","interfaces":[{"interface":"back","average":{"1min":1.5980000000000001,"5min":1.9430000000000001,"15min":1.1259999999999999},"min":{"1min":0.36099999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":19.077999999999999,"5min":19.077999999999999,"15min":19.077999999999999},"last":3.0819999999999999},{"interface":"front","average":{"1min":2.4390000000000001,"5min":1.6319999999999999,"15min":1.0489999999999999},"min":{"1min":0.32300000000000001,"5min":0.30299999999999999,"15min":0.28000000000000003},"max":{"1min":31.617999999999999,"5min":31.617999999999999,"15min":31.617999999999999},"last":3.1589999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32306,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32306,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1581056,"data_stored":3158475,"data_compressed":328373,"data_compressed_allocated":425984,"data_compressed_original":2015232,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":94059,"data_compressed":4766,"data_compressed_allocated":8192,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5066752,"data_stored":8483238,"data_compressed":770600,"data_compressed_allocated":995328,"data_compressed_original":4419584,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2256896,"data_stored":4194430,"data_compressed":367613,"data_compressed_allocated":532480,"data_compressed_original":2482176,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1589248,"data_stored":4194976,"data_compressed":576533,"data_compressed_allocated":724992,"data_compressed_original":3338240,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7217152,"data_stored":11546255,"data_compressed":885287,"data_compressed_allocated":1220608,"data_compressed_original":5554176,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":482086912,"data_stored":772747264,"data_compressed":46560604,"data_compressed_allocated":144330752,"data_compressed_original":434991104,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":619642880,"data_stored":1001676800,"data_compressed":60380065,"data_compressed_allocated":186576896,"data_compressed_original":568610816,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":532439040,"data_stored":864624640,"data_compressed":51791056,"data_compressed_allocated":157675520,"data_compressed_original":489861120,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1314770944,"data_stored":2106408960,"data_compressed":125682248,"data_compressed_allocated":385765376,"data_compressed_original":1177403392,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":865468416,"data_stored":1391398912,"data_compressed":83132556,"data_compressed_allocated":251666432,"data_compressed_original":777596928,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":390811648,"data_stored":636235776,"data_compressed":38654705,"data_compressed_allocated":119525376,"data_compressed_original":364949504,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":889860096,"data_stored":1437401088,"data_compressed":86280878,"data_compressed_allocated":262946816,"data_compressed_original":810487808,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":861102080,"data_stored":1386909696,"data_compressed":83289252,"data_compressed_allocated":255950848,"data_compressed_original":781758464,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T21:19:49.976 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T21:19:50.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.321+0000 7f62e13a0700 1 Processor -- start 2024-05-08T21:19:50.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.326+0000 7f62e13a0700 1 -- start start 2024-05-08T21:19:50.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.327+0000 7f62e13a0700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f62dc150410 0x7f62dc156dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:50.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.327+0000 7f62e13a0700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f62dc0c6af0 0x7f62dc0c3100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:50.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.327+0000 7f62e13a0700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62dc157300 con 0x7f62dc0c3640 2024-05-08T21:19:50.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.327+0000 7f62e13a0700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62dc0c3a50 con 0x7f62dc150410 2024-05-08T21:19:50.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.327+0000 7f62e13a0700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62dc0c2bf0 con 0x7f62dc0c6af0 2024-05-08T21:19:50.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.328+0000 7f62daffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f62dc150410 0x7f62dc156dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:50.330 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.328+0000 7f62da7fc700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f62dc0c6af0 0x7f62dc0c3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:50.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.328+0000 7f62daffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f62dc150410 0x7f62dc156dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59774/0 (socket says 172.21.15.80:59774) 2024-05-08T21:19:50.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.328+0000 7f62da7fc700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f62dc0c6af0 0x7f62dc0c3100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.80:37272/0 (socket says 172.21.15.80:37272) 2024-05-08T21:19:50.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.328+0000 7f62daffd700 1 -- 172.21.15.80:0/1972378206 learned_addr learned my addr 172.21.15.80:0/1972378206 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:19:50.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.328+0000 7f62da7fc700 1 -- 172.21.15.80:0/1972378206 >> v2:172.21.15.80:3300/0 conn(0x7f62dc150410 msgr2=0x7f62dc156dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:19:50.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.328+0000 7f62da7fc700 1 --2- 172.21.15.80:0/1972378206 >> v2:172.21.15.80:3300/0 conn(0x7f62dc150410 0x7f62dc156dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:50.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.328+0000 7f62da7fc700 1 -- 172.21.15.80:0/1972378206 >> v1:172.21.15.80:6789/0 conn(0x7f62dc0c3640 legacy=0x7f62dc0cb960 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T21:19:50.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.328+0000 7f62da7fc700 1 -- 172.21.15.80:0/1972378206 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62dc1507f0 con 0x7f62dc0c6af0 2024-05-08T21:19:50.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.328+0000 7f62da7fc700 1 --2- 172.21.15.80:0/1972378206 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f62dc0c6af0 0x7f62dc0c3100 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f62dc0c2ea0 tx=0x7f62d0007b70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=308908bea716b7a6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:50.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.330+0000 7f62d9ffb700 1 -- 172.21.15.80:0/1972378206 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d0004030 con 0x7f62dc0c6af0 2024-05-08T21:19:50.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.330+0000 7f62d9ffb700 1 -- 172.21.15.80:0/1972378206 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62d0004190 con 0x7f62dc0c6af0 2024-05-08T21:19:50.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.330+0000 7f62d9ffb700 1 -- 172.21.15.80:0/1972378206 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d0004520 con 0x7f62dc0c6af0 2024-05-08T21:19:50.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.331+0000 7f62e13a0700 1 -- 172.21.15.80:0/1972378206 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f62dc0c6af0 msgr2=0x7f62dc0c3100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:50.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.331+0000 7f62e13a0700 1 --2- 172.21.15.80:0/1972378206 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f62dc0c6af0 0x7f62dc0c3100 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f62dc0c2ea0 tx=0x7f62d0007b70 comp rx=0 tx=0).stop 2024-05-08T21:19:50.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.332+0000 7f62e13a0700 1 -- 172.21.15.80:0/1972378206 shutdown_connections 2024-05-08T21:19:50.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.332+0000 7f62e13a0700 1 --2- 172.21.15.80:0/1972378206 >> v2:172.21.15.80:3300/0 conn(0x7f62dc150410 0x7f62dc156dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:50.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.332+0000 7f62e13a0700 1 --2- 172.21.15.80:0/1972378206 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f62dc0c6af0 0x7f62dc0c3100 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:50.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.332+0000 7f62e13a0700 1 -- 172.21.15.80:0/1972378206 >> 172.21.15.80:0/1972378206 conn(0x7f62dc06a9c0 msgr2=0x7f62dc06ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:50.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.332+0000 7f62e13a0700 1 -- 172.21.15.80:0/1972378206 shutdown_connections 2024-05-08T21:19:50.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.332+0000 7f62e13a0700 1 -- 172.21.15.80:0/1972378206 wait complete. 2024-05-08T21:19:50.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.334+0000 7f62e13a0700 1 Processor -- start 2024-05-08T21:19:50.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.334+0000 7f62e13a0700 1 -- start start 2024-05-08T21:19:50.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.335+0000 7f62e13a0700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f62dc0c3640 0x7f62dc155c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:50.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.335+0000 7f62e13a0700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62dc0c6af0 0x7f62dc1f2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:50.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.335+0000 7f62e13a0700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f62dc150410 0x7f62dc1f0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:50.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.335+0000 7f62e13a0700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62dc1fd390 con 0x7f62dc0c6af0 2024-05-08T21:19:50.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.335+0000 7f62e13a0700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62dc1fc7a0 con 0x7f62dc0c3640 2024-05-08T21:19:50.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.335+0000 7f62e13a0700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62dc156560 con 0x7f62dc150410 2024-05-08T21:19:50.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.335+0000 7f62db7fe700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f62dc150410 0x7f62dc1f0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:50.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.335+0000 7f62db7fe700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f62dc150410 0x7f62dc1f0fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:57206/0 (socket says 172.21.15.80:57206) 2024-05-08T21:19:50.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.335+0000 7f62db7fe700 1 -- 172.21.15.80:0/647379751 learned_addr learned my addr 172.21.15.80:0/647379751 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:19:50.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.335+0000 7f62daffd700 1 --2- 172.21.15.80:0/647379751 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f62dc0c3640 0x7f62dc155c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:50.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.336+0000 7f62daffd700 1 -- 172.21.15.80:0/647379751 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f62dc150410 msgr2=0x7f62dc1f0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:50.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.336+0000 7f62daffd700 1 --2- 172.21.15.80:0/647379751 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f62dc150410 0x7f62dc1f0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:50.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.336+0000 7f62daffd700 1 -- 172.21.15.80:0/647379751 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62dc0c6af0 msgr2=0x7f62dc1f2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:50.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.336+0000 7f62daffd700 1 --2- 172.21.15.80:0/647379751 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62dc0c6af0 0x7f62dc1f2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:50.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.336+0000 7f62daffd700 1 -- 172.21.15.80:0/647379751 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d00074f0 con 0x7f62dc0c3640 2024-05-08T21:19:50.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.337+0000 7f62daffd700 1 --2- 172.21.15.80:0/647379751 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f62dc0c3640 0x7f62dc155c30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f62cc00e8e0 tx=0x7f62cc00ebf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:50.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.337+0000 7f62c37fe700 1 -- 172.21.15.80:0/647379751 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62cc00c8e0 con 0x7f62dc0c3640 2024-05-08T21:19:50.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.337+0000 7f62c37fe700 1 -- 172.21.15.80:0/647379751 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62cc00ca40 con 0x7f62dc0c3640 2024-05-08T21:19:50.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.337+0000 7f62c37fe700 1 -- 172.21.15.80:0/647379751 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62cc00cdd0 con 0x7f62dc0c3640 2024-05-08T21:19:50.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.337+0000 7f62e13a0700 1 -- 172.21.15.80:0/647379751 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62dc1fca60 con 0x7f62dc0c3640 2024-05-08T21:19:50.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.337+0000 7f62e13a0700 1 -- 172.21.15.80:0/647379751 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62dc1fd020 con 0x7f62dc0c3640 2024-05-08T21:19:50.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.339+0000 7f62e13a0700 1 -- 172.21.15.80:0/647379751 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62bc0052f0 con 0x7f62dc0c3640 2024-05-08T21:19:50.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.343+0000 7f62c37fe700 1 -- 172.21.15.80:0/647379751 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f62cc0113f0 con 0x7f62dc0c3640 2024-05-08T21:19:50.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.343+0000 7f62c37fe700 1 --2- 172.21.15.80:0/647379751 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f62c806ace0 0x7f62c806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:50.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.344+0000 7f62c37fe700 1 -- 172.21.15.80:0/647379751 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f62cc089480 con 0x7f62dc0c3640 2024-05-08T21:19:50.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.344+0000 7f62da7fc700 1 --2- 172.21.15.80:0/647379751 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f62c806ace0 0x7f62c806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:50.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.344+0000 7f62da7fc700 1 --2- 172.21.15.80:0/647379751 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f62c806ace0 0x7f62c806d1a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f62dc14de20 tx=0x7f62d000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:50.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.348+0000 7f62c37fe700 1 -- 172.21.15.80:0/647379751 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f62cc0540b0 con 0x7f62dc0c3640 2024-05-08T21:19:50.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.787+0000 7f62e13a0700 1 -- 172.21.15.80:0/647379751 --> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f62bc000bc0 con 0x7f62c806ace0 2024-05-08T21:19:50.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.806+0000 7f62c37fe700 1 -- 172.21.15.80:0/647379751 <== mgr.4100 v2:172.21.15.80:6832/46731 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+370655 (secure 0 0 0) 0x7f62bc000bc0 con 0x7f62c806ace0 2024-05-08T21:19:50.812 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:19:50.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.821+0000 7f62e13a0700 1 -- 172.21.15.80:0/647379751 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f62c806ace0 msgr2=0x7f62c806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:50.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.821+0000 7f62e13a0700 1 --2- 172.21.15.80:0/647379751 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f62c806ace0 0x7f62c806d1a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f62dc14de20 tx=0x7f62d000f000 comp rx=0 tx=0).stop 2024-05-08T21:19:50.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.821+0000 7f62e13a0700 1 -- 172.21.15.80:0/647379751 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f62dc0c3640 msgr2=0x7f62dc155c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:50.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.821+0000 7f62e13a0700 1 --2- 172.21.15.80:0/647379751 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f62dc0c3640 0x7f62dc155c30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f62cc00e8e0 tx=0x7f62cc00ebf0 comp rx=0 tx=0).stop 2024-05-08T21:19:50.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.821+0000 7f62e13a0700 1 -- 172.21.15.80:0/647379751 shutdown_connections 2024-05-08T21:19:50.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.821+0000 7f62e13a0700 1 --2- 172.21.15.80:0/647379751 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f62c806ace0 0x7f62c806d1a0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:50.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.821+0000 7f62e13a0700 1 --2- 172.21.15.80:0/647379751 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f62dc150410 0x7f62dc1f0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:50.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.821+0000 7f62e13a0700 1 --2- 172.21.15.80:0/647379751 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f62dc0c3640 0x7f62dc155c30 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:50.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.821+0000 7f62e13a0700 1 --2- 172.21.15.80:0/647379751 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f62dc0c6af0 0x7f62dc1f2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:50.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.821+0000 7f62e13a0700 1 -- 172.21.15.80:0/647379751 >> 172.21.15.80:0/647379751 conn(0x7f62dc06a9c0 msgr2=0x7f62dc0be880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:50.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.822+0000 7f62e13a0700 1 -- 172.21.15.80:0/647379751 shutdown_connections 2024-05-08T21:19:50.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:50.822+0000 7f62e13a0700 1 -- 172.21.15.80:0/647379751 wait complete. 2024-05-08T21:19:50.847 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-05-08T21:19:50.862 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":323,"stamp":"2024-05-08T21:19:50.498638+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2850159592,"num_objects":902,"num_object_clones":0,"num_object_copies":3534,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":902,"num_whiteouts":0,"num_read":2254,"num_read_kb":39820,"num_write":1716563,"num_write_kb":22166550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":135031,"ondisk_log_size":135031,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":11139248,"kb_used_data":3904024,"kb_used_omap":12,"kb_used_meta":7232499,"kb_avail":743835472,"statfs":{"total":773094113280,"available":761687523328,"internally_reserved":0,"allocated":3997720576,"data_stored":6496205426,"data_compressed":393915419,"data_compressed_allocated":1211842560,"data_compressed_original":3711954944,"omap_allocated":12743,"internal_metadata":7406079545},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,2,2,11,10,7,4,2],"upper_bound":512},"perf_stat":{"commit_latency_ms":140,"apply_latency_ms":140,"commit_latency_ns":140000000,"apply_latency_ns":140000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-7620714277,"num_objects":-1817,"num_object_clones":0,"num_object_copies":-7268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1817,"num_whiteouts":0,"num_read":2,"num_read_kb":19,"num_write":1849,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005453"},"pg_stats":[{"pgid":"3.3f","version":"29'5","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T21:18:28.723440+0000","last_change":"2024-05-08T21:10:03.747477+0000","last_active":"2024-05-08T21:18:28.723440+0000","last_peered":"2024-05-08T21:18:28.723440+0000","last_clean":"2024-05-08T21:18:28.723440+0000","last_became_active":"2024-05-08T21:10:03.747059+0000","last_became_peered":"2024-05-08T21:10:03.747059+0000","last_unstale":"2024-05-08T21:18:28.723440+0000","last_undegraded":"2024-05-08T21:18:28.723440+0000","last_fullsized":"2024-05-08T21:18:28.723440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:15:24.340135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"32'3","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.752000+0000","last_change":"2024-05-08T21:10:03.738974+0000","last_active":"2024-05-08T21:19:06.752000+0000","last_peered":"2024-05-08T21:19:06.752000+0000","last_clean":"2024-05-08T21:19:06.752000+0000","last_became_active":"2024-05-08T21:10:03.738466+0000","last_became_peered":"2024-05-08T21:10:03.738466+0000","last_unstale":"2024-05-08T21:19:06.752000+0000","last_undegraded":"2024-05-08T21:19:06.752000+0000","last_fullsized":"2024-05-08T21:19:06.752000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:59.683039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"32'8","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.754392+0000","last_change":"2024-05-08T21:10:03.740146+0000","last_active":"2024-05-08T21:19:06.754392+0000","last_peered":"2024-05-08T21:19:06.754392+0000","last_clean":"2024-05-08T21:19:06.754392+0000","last_became_active":"2024-05-08T21:10:03.739884+0000","last_became_peered":"2024-05-08T21:10:03.739884+0000","last_unstale":"2024-05-08T21:19:06.754392+0000","last_undegraded":"2024-05-08T21:19:06.754392+0000","last_fullsized":"2024-05-08T21:19:06.754392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:51:44.301305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"32'5","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:34.408287+0000","last_change":"2024-05-08T21:10:03.754159+0000","last_active":"2024-05-08T21:19:34.408287+0000","last_peered":"2024-05-08T21:19:34.408287+0000","last_clean":"2024-05-08T21:19:34.408287+0000","last_became_active":"2024-05-08T21:10:03.753800+0000","last_became_peered":"2024-05-08T21:10:03.753800+0000","last_unstale":"2024-05-08T21:19:34.408287+0000","last_undegraded":"2024-05-08T21:19:34.408287+0000","last_fullsized":"2024-05-08T21:19:34.408287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:41:02.625080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"32'6","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.751819+0000","last_change":"2024-05-08T21:10:03.750051+0000","last_active":"2024-05-08T21:19:06.751819+0000","last_peered":"2024-05-08T21:19:06.751819+0000","last_clean":"2024-05-08T21:19:06.751819+0000","last_became_active":"2024-05-08T21:10:03.749730+0000","last_became_peered":"2024-05-08T21:10:03.749730+0000","last_unstale":"2024-05-08T21:19:06.751819+0000","last_undegraded":"2024-05-08T21:19:06.751819+0000","last_fullsized":"2024-05-08T21:19:06.751819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:49.402253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"32'9","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.751115+0000","last_change":"2024-05-08T21:10:53.473952+0000","last_active":"2024-05-08T21:19:06.751115+0000","last_peered":"2024-05-08T21:19:06.751115+0000","last_clean":"2024-05-08T21:19:06.751115+0000","last_became_active":"2024-05-08T21:10:53.473632+0000","last_became_peered":"2024-05-08T21:10:53.473632+0000","last_unstale":"2024-05-08T21:19:06.751115+0000","last_undegraded":"2024-05-08T21:19:06.751115+0000","last_fullsized":"2024-05-08T21:19:06.751115+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:09.558205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"32'5","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:44.102438+0000","last_change":"2024-05-08T21:10:03.743802+0000","last_active":"2024-05-08T21:19:44.102438+0000","last_peered":"2024-05-08T21:19:44.102438+0000","last_clean":"2024-05-08T21:19:44.102438+0000","last_became_active":"2024-05-08T21:10:03.743349+0000","last_became_peered":"2024-05-08T21:10:03.743349+0000","last_unstale":"2024-05-08T21:19:44.102438+0000","last_undegraded":"2024-05-08T21:19:44.102438+0000","last_fullsized":"2024-05-08T21:19:44.102438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:08:06.408724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"32'4","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.753828+0000","last_change":"2024-05-08T21:10:03.747558+0000","last_active":"2024-05-08T21:19:06.753828+0000","last_peered":"2024-05-08T21:19:06.753828+0000","last_clean":"2024-05-08T21:19:06.753828+0000","last_became_active":"2024-05-08T21:10:03.747300+0000","last_became_peered":"2024-05-08T21:10:03.747300+0000","last_unstale":"2024-05-08T21:19:06.753828+0000","last_undegraded":"2024-05-08T21:19:06.753828+0000","last_fullsized":"2024-05-08T21:19:06.753828+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:07:50.266894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"32'14","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:43.241133+0000","last_change":"2024-05-08T21:10:03.748221+0000","last_active":"2024-05-08T21:19:43.241133+0000","last_peered":"2024-05-08T21:19:43.241133+0000","last_clean":"2024-05-08T21:19:43.241133+0000","last_became_active":"2024-05-08T21:10:03.747956+0000","last_became_peered":"2024-05-08T21:10:03.747956+0000","last_unstale":"2024-05-08T21:19:43.241133+0000","last_undegraded":"2024-05-08T21:19:43.241133+0000","last_fullsized":"2024-05-08T21:19:43.241133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:27:35.947884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"29'8","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T21:17:27.493158+0000","last_change":"2024-05-08T21:10:03.745291+0000","last_active":"2024-05-08T21:17:27.493158+0000","last_peered":"2024-05-08T21:17:27.493158+0000","last_clean":"2024-05-08T21:17:27.493158+0000","last_became_active":"2024-05-08T21:10:03.744976+0000","last_became_peered":"2024-05-08T21:10:03.744976+0000","last_unstale":"2024-05-08T21:17:27.493158+0000","last_undegraded":"2024-05-08T21:17:27.493158+0000","last_fullsized":"2024-05-08T21:17:27.493158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:36:54.983642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"32'12","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.751492+0000","last_change":"2024-05-08T21:10:03.748518+0000","last_active":"2024-05-08T21:19:06.751492+0000","last_peered":"2024-05-08T21:19:06.751492+0000","last_clean":"2024-05-08T21:19:06.751492+0000","last_became_active":"2024-05-08T21:10:03.748253+0000","last_became_peered":"2024-05-08T21:10:03.748253+0000","last_unstale":"2024-05-08T21:19:06.751492+0000","last_undegraded":"2024-05-08T21:19:06.751492+0000","last_fullsized":"2024-05-08T21:19:06.751492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:03:26.013122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"32'7","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:45.243846+0000","last_change":"2024-05-08T21:10:03.745985+0000","last_active":"2024-05-08T21:19:45.243846+0000","last_peered":"2024-05-08T21:19:45.243846+0000","last_clean":"2024-05-08T21:19:45.243846+0000","last_became_active":"2024-05-08T21:10:03.745247+0000","last_became_peered":"2024-05-08T21:10:03.745247+0000","last_unstale":"2024-05-08T21:19:45.243846+0000","last_undegraded":"2024-05-08T21:19:45.243846+0000","last_fullsized":"2024-05-08T21:19:45.243846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:59:42.506304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"29'7","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.754219+0000","last_change":"2024-05-08T21:10:03.747016+0000","last_active":"2024-05-08T21:19:06.754219+0000","last_peered":"2024-05-08T21:19:06.754219+0000","last_clean":"2024-05-08T21:19:06.754219+0000","last_became_active":"2024-05-08T21:10:03.746848+0000","last_became_peered":"2024-05-08T21:10:03.746848+0000","last_unstale":"2024-05-08T21:19:06.754219+0000","last_undegraded":"2024-05-08T21:19:06.754219+0000","last_fullsized":"2024-05-08T21:19:06.754219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:41:21.081035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"32'13","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:35.756438+0000","last_change":"2024-05-08T21:10:03.737984+0000","last_active":"2024-05-08T21:19:35.756438+0000","last_peered":"2024-05-08T21:19:35.756438+0000","last_clean":"2024-05-08T21:19:35.756438+0000","last_became_active":"2024-05-08T21:10:03.737716+0000","last_became_peered":"2024-05-08T21:10:03.737716+0000","last_unstale":"2024-05-08T21:19:35.756438+0000","last_undegraded":"2024-05-08T21:19:35.756438+0000","last_fullsized":"2024-05-08T21:19:35.756438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:09:47.758272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"32'11","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:39.528797+0000","last_change":"2024-05-08T21:10:03.744543+0000","last_active":"2024-05-08T21:19:39.528797+0000","last_peered":"2024-05-08T21:19:39.528797+0000","last_clean":"2024-05-08T21:19:39.528797+0000","last_became_active":"2024-05-08T21:10:03.744276+0000","last_became_peered":"2024-05-08T21:10:03.744276+0000","last_unstale":"2024-05-08T21:19:39.528797+0000","last_undegraded":"2024-05-08T21:19:39.528797+0000","last_fullsized":"2024-05-08T21:19:39.528797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:25:04.113297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"32'9","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:39.151636+0000","last_change":"2024-05-08T21:10:03.746547+0000","last_active":"2024-05-08T21:19:39.151636+0000","last_peered":"2024-05-08T21:19:39.151636+0000","last_clean":"2024-05-08T21:19:39.151636+0000","last_became_active":"2024-05-08T21:10:03.745862+0000","last_became_peered":"2024-05-08T21:10:03.745862+0000","last_unstale":"2024-05-08T21:19:39.151636+0000","last_undegraded":"2024-05-08T21:19:39.151636+0000","last_fullsized":"2024-05-08T21:19:39.151636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:12.776310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"32'10","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:38.816584+0000","last_change":"2024-05-08T21:10:54.028844+0000","last_active":"2024-05-08T21:19:38.816584+0000","last_peered":"2024-05-08T21:19:38.816584+0000","last_clean":"2024-05-08T21:19:38.816584+0000","last_became_active":"2024-05-08T21:10:54.028630+0000","last_became_peered":"2024-05-08T21:10:54.028630+0000","last_unstale":"2024-05-08T21:19:38.816584+0000","last_undegraded":"2024-05-08T21:19:38.816584+0000","last_fullsized":"2024-05-08T21:19:38.816584+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:04:12.556157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"29'11","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.752206+0000","last_change":"2024-05-08T21:10:03.743889+0000","last_active":"2024-05-08T21:19:06.752206+0000","last_peered":"2024-05-08T21:19:06.752206+0000","last_clean":"2024-05-08T21:19:06.752206+0000","last_became_active":"2024-05-08T21:10:03.743596+0000","last_became_peered":"2024-05-08T21:10:03.743596+0000","last_unstale":"2024-05-08T21:19:06.752206+0000","last_undegraded":"2024-05-08T21:19:06.752206+0000","last_fullsized":"2024-05-08T21:19:06.752206+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:53.981781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"32'12","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:32.410973+0000","last_change":"2024-05-08T21:10:03.743893+0000","last_active":"2024-05-08T21:19:32.410973+0000","last_peered":"2024-05-08T21:19:32.410973+0000","last_clean":"2024-05-08T21:19:32.410973+0000","last_became_active":"2024-05-08T21:10:03.743580+0000","last_became_peered":"2024-05-08T21:10:03.743580+0000","last_unstale":"2024-05-08T21:19:32.410973+0000","last_undegraded":"2024-05-08T21:19:32.410973+0000","last_fullsized":"2024-05-08T21:19:32.410973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:44:21.747625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"32'4273","reported_seq":4361,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:48.003548+0000","last_change":"2024-05-08T21:10:08.052394+0000","last_active":"2024-05-08T21:19:48.003548+0000","last_peered":"2024-05-08T21:19:48.003548+0000","last_clean":"2024-05-08T21:19:48.003548+0000","last_became_active":"2024-05-08T21:10:08.052009+0000","last_became_peered":"2024-05-08T21:10:08.052009+0000","last_unstale":"2024-05-08T21:19:48.003548+0000","last_undegraded":"2024-05-08T21:19:48.003548+0000","last_fullsized":"2024-05-08T21:19:48.003548+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4273,"log_dups_size":0,"ondisk_log_size":4273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:47:20.148683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92320971,"num_objects":30,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":67,"num_read_kb":0,"num_write":56130,"num_write_kb":728959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"32'466","reported_seq":503,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:47.502458+0000","last_change":"2024-05-08T21:10:03.340118+0000","last_active":"2024-05-08T21:19:47.502458+0000","last_peered":"2024-05-08T21:19:47.502458+0000","last_clean":"2024-05-08T21:19:47.502458+0000","last_became_active":"2024-05-08T21:10:03.339847+0000","last_became_peered":"2024-05-08T21:10:03.339847+0000","last_unstale":"2024-05-08T21:19:47.502458+0000","last_undegraded":"2024-05-08T21:19:47.502458+0000","last_fullsized":"2024-05-08T21:19:47.502458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:05:56.369631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3158419,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":20,"num_read_kb":1370,"num_write":463,"num_write_kb":3343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"29'3","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T21:18:16.811988+0000","last_change":"2024-05-08T21:10:03.746516+0000","last_active":"2024-05-08T21:18:16.811988+0000","last_peered":"2024-05-08T21:18:16.811988+0000","last_clean":"2024-05-08T21:18:16.811988+0000","last_became_active":"2024-05-08T21:10:03.746383+0000","last_became_peered":"2024-05-08T21:10:03.746383+0000","last_unstale":"2024-05-08T21:18:16.811988+0000","last_undegraded":"2024-05-08T21:18:16.811988+0000","last_fullsized":"2024-05-08T21:18:16.811988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:29:05.305134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'4151","reported_seq":4239,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:49.580963+0000","last_change":"2024-05-08T21:10:53.484902+0000","last_active":"2024-05-08T21:19:49.580963+0000","last_peered":"2024-05-08T21:19:49.580963+0000","last_clean":"2024-05-08T21:19:49.580963+0000","last_became_active":"2024-05-08T21:10:53.484437+0000","last_became_peered":"2024-05-08T21:10:53.484437+0000","last_unstale":"2024-05-08T21:19:49.580963+0000","last_undegraded":"2024-05-08T21:19:49.580963+0000","last_fullsized":"2024-05-08T21:19:49.580963+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4151,"log_dups_size":0,"ondisk_log_size":4151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:51:42.307075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75588172,"num_objects":23,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":57,"num_read_kb":0,"num_write":53688,"num_write_kb":702965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2,3],"acting":[4,6,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"32'5","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.755018+0000","last_change":"2024-05-08T21:10:03.329414+0000","last_active":"2024-05-08T21:19:06.755018+0000","last_peered":"2024-05-08T21:19:06.755018+0000","last_clean":"2024-05-08T21:19:06.755018+0000","last_became_active":"2024-05-08T21:10:03.328970+0000","last_became_peered":"2024-05-08T21:10:03.328970+0000","last_unstale":"2024-05-08T21:19:06.755018+0000","last_undegraded":"2024-05-08T21:19:06.755018+0000","last_fullsized":"2024-05-08T21:19:06.755018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:34:32.820755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"32'7","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.755829+0000","last_change":"2024-05-08T21:10:03.748566+0000","last_active":"2024-05-08T21:19:06.755829+0000","last_peered":"2024-05-08T21:19:06.755829+0000","last_clean":"2024-05-08T21:19:06.755829+0000","last_became_active":"2024-05-08T21:10:03.747989+0000","last_became_peered":"2024-05-08T21:10:03.747989+0000","last_unstale":"2024-05-08T21:19:06.755829+0000","last_undegraded":"2024-05-08T21:19:06.755829+0000","last_fullsized":"2024-05-08T21:19:06.755829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:19:03.468394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"32'4125","reported_seq":4208,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:49.516475+0000","last_change":"2024-05-08T21:10:07.770390+0000","last_active":"2024-05-08T21:19:49.516475+0000","last_peered":"2024-05-08T21:19:49.516475+0000","last_clean":"2024-05-08T21:19:49.516475+0000","last_became_active":"2024-05-08T21:10:07.770017+0000","last_became_peered":"2024-05-08T21:10:07.770017+0000","last_unstale":"2024-05-08T21:19:49.516475+0000","last_undegraded":"2024-05-08T21:19:49.516475+0000","last_fullsized":"2024-05-08T21:19:49.516475+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4125,"log_dups_size":0,"ondisk_log_size":4125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:12:00.200848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75557266,"num_objects":26,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":62,"num_read_kb":0,"num_write":52812,"num_write_kb":674205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"32'14","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:27.848897+0000","last_change":"2024-05-08T21:10:03.339207+0000","last_active":"2024-05-08T21:19:27.848897+0000","last_peered":"2024-05-08T21:19:27.848897+0000","last_clean":"2024-05-08T21:19:27.848897+0000","last_became_active":"2024-05-08T21:10:03.338917+0000","last_became_peered":"2024-05-08T21:10:03.338917+0000","last_unstale":"2024-05-08T21:19:27.848897+0000","last_undegraded":"2024-05-08T21:19:27.848897+0000","last_fullsized":"2024-05-08T21:19:27.848897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:20.676853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":7,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"29'7","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T21:18:26.326830+0000","last_change":"2024-05-08T21:10:53.477056+0000","last_active":"2024-05-08T21:18:26.326830+0000","last_peered":"2024-05-08T21:18:26.326830+0000","last_clean":"2024-05-08T21:18:26.326830+0000","last_became_active":"2024-05-08T21:10:53.476785+0000","last_became_peered":"2024-05-08T21:10:53.476785+0000","last_unstale":"2024-05-08T21:18:26.326830+0000","last_undegraded":"2024-05-08T21:18:26.326830+0000","last_fullsized":"2024-05-08T21:18:26.326830+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:21:49.813110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"32'3528","reported_seq":3593,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:49.475287+0000","last_change":"2024-05-08T21:10:07.776367+0000","last_active":"2024-05-08T21:19:49.475287+0000","last_peered":"2024-05-08T21:19:49.475287+0000","last_clean":"2024-05-08T21:19:49.475287+0000","last_became_active":"2024-05-08T21:10:07.775998+0000","last_became_peered":"2024-05-08T21:10:07.775998+0000","last_unstale":"2024-05-08T21:19:49.475287+0000","last_undegraded":"2024-05-08T21:19:49.475287+0000","last_fullsized":"2024-05-08T21:19:49.475287+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":3528,"log_dups_size":0,"ondisk_log_size":3528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:24:18.845560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62927589,"num_objects":17,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":44,"num_read_kb":0,"num_write":46321,"num_write_kb":599175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"29'4","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:27.838760+0000","last_change":"2024-05-08T21:10:03.339182+0000","last_active":"2024-05-08T21:19:27.838760+0000","last_peered":"2024-05-08T21:19:27.838760+0000","last_clean":"2024-05-08T21:19:27.838760+0000","last_became_active":"2024-05-08T21:10:03.338899+0000","last_became_peered":"2024-05-08T21:10:03.338899+0000","last_unstale":"2024-05-08T21:19:27.838760+0000","last_undegraded":"2024-05-08T21:19:27.838760+0000","last_fullsized":"2024-05-08T21:19:27.838760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:55:53.368546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":5,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"32'9","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:42.391573+0000","last_change":"2024-05-08T21:10:03.750724+0000","last_active":"2024-05-08T21:19:42.391573+0000","last_peered":"2024-05-08T21:19:42.391573+0000","last_clean":"2024-05-08T21:19:42.391573+0000","last_became_active":"2024-05-08T21:10:03.750371+0000","last_became_peered":"2024-05-08T21:10:03.750371+0000","last_unstale":"2024-05-08T21:19:42.391573+0000","last_undegraded":"2024-05-08T21:19:42.391573+0000","last_fullsized":"2024-05-08T21:19:42.391573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:14:01.935211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"32'4452","reported_seq":4539,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:48.345804+0000","last_change":"2024-05-08T21:10:07.767604+0000","last_active":"2024-05-08T21:19:48.345804+0000","last_peered":"2024-05-08T21:19:48.345804+0000","last_clean":"2024-05-08T21:19:48.345804+0000","last_became_active":"2024-05-08T21:10:07.767234+0000","last_became_peered":"2024-05-08T21:10:07.767234+0000","last_unstale":"2024-05-08T21:19:48.345804+0000","last_undegraded":"2024-05-08T21:19:48.345804+0000","last_fullsized":"2024-05-08T21:19:48.345804+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4452,"log_dups_size":0,"ondisk_log_size":4452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:30:21.411491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83914681,"num_objects":28,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":66,"num_read_kb":0,"num_write":57873,"num_write_kb":753617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"29'1290","reported_seq":1318,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.754424+0000","last_change":"2024-05-08T21:10:03.338149+0000","last_active":"2024-05-08T21:19:06.754424+0000","last_peered":"2024-05-08T21:19:06.754424+0000","last_clean":"2024-05-08T21:19:06.754424+0000","last_became_active":"2024-05-08T21:10:03.337860+0000","last_became_peered":"2024-05-08T21:10:03.337860+0000","last_unstale":"2024-05-08T21:19:06.754424+0000","last_undegraded":"2024-05-08T21:19:06.754424+0000","last_fullsized":"2024-05-08T21:19:06.754424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":1290,"log_dups_size":0,"ondisk_log_size":1290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:07:39.052625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":1289,"num_write_kb":5292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"32'10","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.337623+0000","last_change":"2024-05-08T21:10:03.743506+0000","last_active":"2024-05-08T21:19:06.337623+0000","last_peered":"2024-05-08T21:19:06.337623+0000","last_clean":"2024-05-08T21:19:06.337623+0000","last_became_active":"2024-05-08T21:10:03.743227+0000","last_became_peered":"2024-05-08T21:10:03.743227+0000","last_unstale":"2024-05-08T21:19:06.337623+0000","last_undegraded":"2024-05-08T21:19:06.337623+0000","last_fullsized":"2024-05-08T21:19:06.337623+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:45:47.977619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"32'3330","reported_seq":3393,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:46.040379+0000","last_change":"2024-05-08T21:10:07.768424+0000","last_active":"2024-05-08T21:19:46.040379+0000","last_peered":"2024-05-08T21:19:46.040379+0000","last_clean":"2024-05-08T21:19:46.040379+0000","last_became_active":"2024-05-08T21:10:07.768160+0000","last_became_peered":"2024-05-08T21:10:07.768160+0000","last_unstale":"2024-05-08T21:19:46.040379+0000","last_undegraded":"2024-05-08T21:19:46.040379+0000","last_fullsized":"2024-05-08T21:19:46.040379+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":3330,"log_dups_size":0,"ondisk_log_size":3330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:42:44.327080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121646859,"num_objects":31,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":42,"num_read_kb":0,"num_write":43324,"num_write_kb":562121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"32'5","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.751975+0000","last_change":"2024-05-08T21:10:03.333647+0000","last_active":"2024-05-08T21:19:06.751975+0000","last_peered":"2024-05-08T21:19:06.751975+0000","last_clean":"2024-05-08T21:19:06.751975+0000","last_became_active":"2024-05-08T21:10:03.332844+0000","last_became_peered":"2024-05-08T21:10:03.332844+0000","last_unstale":"2024-05-08T21:19:06.751975+0000","last_undegraded":"2024-05-08T21:19:06.751975+0000","last_fullsized":"2024-05-08T21:19:06.751975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:47:40.344808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"32'9","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.753644+0000","last_change":"2024-05-08T21:10:03.743003+0000","last_active":"2024-05-08T21:19:06.753644+0000","last_peered":"2024-05-08T21:19:06.753644+0000","last_clean":"2024-05-08T21:19:06.753644+0000","last_became_active":"2024-05-08T21:10:03.742753+0000","last_became_peered":"2024-05-08T21:10:03.742753+0000","last_unstale":"2024-05-08T21:19:06.753644+0000","last_undegraded":"2024-05-08T21:19:06.753644+0000","last_fullsized":"2024-05-08T21:19:06.753644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:45:49.575877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4217","reported_seq":4310,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:49.730623+0000","last_change":"2024-05-08T21:10:07.770105+0000","last_active":"2024-05-08T21:19:49.730623+0000","last_peered":"2024-05-08T21:19:49.730623+0000","last_clean":"2024-05-08T21:19:49.730623+0000","last_became_active":"2024-05-08T21:10:07.769668+0000","last_became_peered":"2024-05-08T21:10:07.769668+0000","last_unstale":"2024-05-08T21:19:49.730623+0000","last_undegraded":"2024-05-08T21:19:49.730623+0000","last_fullsized":"2024-05-08T21:19:49.730623+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4217,"log_dups_size":0,"ondisk_log_size":4217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:07:21.560031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63011864,"num_objects":23,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":71,"num_read_kb":0,"num_write":54931,"num_write_kb":711961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"29'1","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T21:17:26.765527+0000","last_change":"2024-05-08T21:10:03.333025+0000","last_active":"2024-05-08T21:17:26.765527+0000","last_peered":"2024-05-08T21:17:26.765527+0000","last_clean":"2024-05-08T21:17:26.765527+0000","last_became_active":"2024-05-08T21:10:03.332750+0000","last_became_peered":"2024-05-08T21:10:03.332750+0000","last_unstale":"2024-05-08T21:17:26.765527+0000","last_undegraded":"2024-05-08T21:17:26.765527+0000","last_fullsized":"2024-05-08T21:17:26.765527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:20:50.134647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'15","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.752581+0000","last_change":"2024-05-08T21:10:03.744023+0000","last_active":"2024-05-08T21:19:06.752581+0000","last_peered":"2024-05-08T21:19:06.752581+0000","last_clean":"2024-05-08T21:19:06.752581+0000","last_became_active":"2024-05-08T21:10:03.743724+0000","last_became_peered":"2024-05-08T21:10:03.743724+0000","last_unstale":"2024-05-08T21:19:06.752581+0000","last_undegraded":"2024-05-08T21:19:06.752581+0000","last_fullsized":"2024-05-08T21:19:06.752581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:50:36.857245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"32'4795","reported_seq":4889,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:47.509016+0000","last_change":"2024-05-08T21:10:08.052307+0000","last_active":"2024-05-08T21:19:47.509016+0000","last_peered":"2024-05-08T21:19:47.509016+0000","last_clean":"2024-05-08T21:19:47.509016+0000","last_became_active":"2024-05-08T21:10:08.051924+0000","last_became_peered":"2024-05-08T21:10:08.051924+0000","last_unstale":"2024-05-08T21:19:47.509016+0000","last_undegraded":"2024-05-08T21:19:47.509016+0000","last_fullsized":"2024-05-08T21:19:47.509016+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4795,"log_dups_size":0,"ondisk_log_size":4795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:56:37.264246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142632158,"num_objects":40,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":72,"num_read_kb":0,"num_write":62600,"num_write_kb":808641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.335214+0000","last_change":"2024-05-08T21:10:03.330304+0000","last_active":"2024-05-08T21:19:06.335214+0000","last_peered":"2024-05-08T21:19:06.335214+0000","last_clean":"2024-05-08T21:19:06.335214+0000","last_became_active":"2024-05-08T21:10:03.330054+0000","last_became_peered":"2024-05-08T21:10:03.330054+0000","last_unstale":"2024-05-08T21:19:06.335214+0000","last_undegraded":"2024-05-08T21:19:06.335214+0000","last_fullsized":"2024-05-08T21:19:06.335214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:30.518935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"29'4","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T21:17:28.857915+0000","last_change":"2024-05-08T21:10:03.739687+0000","last_active":"2024-05-08T21:17:28.857915+0000","last_peered":"2024-05-08T21:17:28.857915+0000","last_clean":"2024-05-08T21:17:28.857915+0000","last_became_active":"2024-05-08T21:10:03.739425+0000","last_became_peered":"2024-05-08T21:10:03.739425+0000","last_unstale":"2024-05-08T21:17:28.857915+0000","last_undegraded":"2024-05-08T21:17:28.857915+0000","last_fullsized":"2024-05-08T21:17:28.857915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:45:59.295081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"32'4191","reported_seq":4271,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:47.269668+0000","last_change":"2024-05-08T21:10:08.050980+0000","last_active":"2024-05-08T21:19:47.269668+0000","last_peered":"2024-05-08T21:19:47.269668+0000","last_clean":"2024-05-08T21:19:47.269668+0000","last_became_active":"2024-05-08T21:10:08.050625+0000","last_became_peered":"2024-05-08T21:10:08.050625+0000","last_unstale":"2024-05-08T21:19:47.269668+0000","last_undegraded":"2024-05-08T21:19:47.269668+0000","last_fullsized":"2024-05-08T21:19:47.269668+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4191,"log_dups_size":0,"ondisk_log_size":4191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:39:43.917363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83921679,"num_objects":25,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":58,"num_read_kb":0,"num_write":54024,"num_write_kb":693342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"32'2","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:31.819884+0000","last_change":"2024-05-08T21:10:03.331297+0000","last_active":"2024-05-08T21:19:31.819884+0000","last_peered":"2024-05-08T21:19:31.819884+0000","last_clean":"2024-05-08T21:19:31.819884+0000","last_became_active":"2024-05-08T21:10:03.330973+0000","last_became_peered":"2024-05-08T21:10:03.330973+0000","last_unstale":"2024-05-08T21:19:31.819884+0000","last_undegraded":"2024-05-08T21:19:31.819884+0000","last_fullsized":"2024-05-08T21:19:31.819884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:57:26.190186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"29'5","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T21:17:26.420223+0000","last_change":"2024-05-08T21:10:03.751746+0000","last_active":"2024-05-08T21:17:26.420223+0000","last_peered":"2024-05-08T21:17:26.420223+0000","last_clean":"2024-05-08T21:17:26.420223+0000","last_became_active":"2024-05-08T21:10:03.751426+0000","last_became_peered":"2024-05-08T21:10:03.751426+0000","last_unstale":"2024-05-08T21:17:26.420223+0000","last_undegraded":"2024-05-08T21:17:26.420223+0000","last_fullsized":"2024-05-08T21:17:26.420223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:00:23.529543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"32'4044","reported_seq":4137,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:47.707313+0000","last_change":"2024-05-08T21:10:53.484721+0000","last_active":"2024-05-08T21:19:47.707313+0000","last_peered":"2024-05-08T21:19:47.707313+0000","last_clean":"2024-05-08T21:19:47.707313+0000","last_became_active":"2024-05-08T21:10:53.484313+0000","last_became_peered":"2024-05-08T21:10:53.484313+0000","last_unstale":"2024-05-08T21:19:47.707313+0000","last_undegraded":"2024-05-08T21:19:47.707313+0000","last_fullsized":"2024-05-08T21:19:47.707313+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4044,"log_dups_size":0,"ondisk_log_size":4044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:20:10.055442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75513200,"num_objects":23,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":61,"num_read_kb":0,"num_write":52756,"num_write_kb":673924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"29'1","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.335681+0000","last_change":"2024-05-08T21:10:03.332049+0000","last_active":"2024-05-08T21:19:06.335681+0000","last_peered":"2024-05-08T21:19:06.335681+0000","last_clean":"2024-05-08T21:19:06.335681+0000","last_became_active":"2024-05-08T21:10:03.331712+0000","last_became_peered":"2024-05-08T21:10:03.331712+0000","last_unstale":"2024-05-08T21:19:06.335681+0000","last_undegraded":"2024-05-08T21:19:06.335681+0000","last_fullsized":"2024-05-08T21:19:06.335681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:30:16.135672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"32'12","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:40.321291+0000","last_change":"2024-05-08T21:10:03.748728+0000","last_active":"2024-05-08T21:19:40.321291+0000","last_peered":"2024-05-08T21:19:40.321291+0000","last_clean":"2024-05-08T21:19:40.321291+0000","last_became_active":"2024-05-08T21:10:03.748315+0000","last_became_peered":"2024-05-08T21:10:03.748315+0000","last_unstale":"2024-05-08T21:19:40.321291+0000","last_undegraded":"2024-05-08T21:19:40.321291+0000","last_fullsized":"2024-05-08T21:19:40.321291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:14:15.224603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"32'4177","reported_seq":4256,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:49.426046+0000","last_change":"2024-05-08T21:10:07.761559+0000","last_active":"2024-05-08T21:19:49.426046+0000","last_peered":"2024-05-08T21:19:49.426046+0000","last_clean":"2024-05-08T21:19:49.426046+0000","last_became_active":"2024-05-08T21:10:07.761129+0000","last_became_peered":"2024-05-08T21:10:07.761129+0000","last_unstale":"2024-05-08T21:19:49.426046+0000","last_undegraded":"2024-05-08T21:19:49.426046+0000","last_fullsized":"2024-05-08T21:19:49.426046+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4177,"log_dups_size":0,"ondisk_log_size":4177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:29:03.444853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84006392,"num_objects":32,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":57,"num_read_kb":0,"num_write":55185,"num_write_kb":706687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"32'15","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:38.064532+0000","last_change":"2024-05-08T21:10:03.333077+0000","last_active":"2024-05-08T21:19:38.064532+0000","last_peered":"2024-05-08T21:19:38.064532+0000","last_clean":"2024-05-08T21:19:38.064532+0000","last_became_active":"2024-05-08T21:10:03.332796+0000","last_became_peered":"2024-05-08T21:10:03.332796+0000","last_unstale":"2024-05-08T21:19:38.064532+0000","last_undegraded":"2024-05-08T21:19:38.064532+0000","last_fullsized":"2024-05-08T21:19:38.064532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:30:16.135672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":17,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"32'6","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:38.513441+0000","last_change":"2024-05-08T21:10:03.751370+0000","last_active":"2024-05-08T21:19:38.513441+0000","last_peered":"2024-05-08T21:19:38.513441+0000","last_clean":"2024-05-08T21:19:38.513441+0000","last_became_active":"2024-05-08T21:10:03.750394+0000","last_became_peered":"2024-05-08T21:10:03.750394+0000","last_unstale":"2024-05-08T21:19:38.513441+0000","last_undegraded":"2024-05-08T21:19:38.513441+0000","last_fullsized":"2024-05-08T21:19:38.513441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:31:06.682543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"32'3871","reported_seq":3935,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:48.059290+0000","last_change":"2024-05-08T21:10:07.764815+0000","last_active":"2024-05-08T21:19:48.059290+0000","last_peered":"2024-05-08T21:19:48.059290+0000","last_clean":"2024-05-08T21:19:48.059290+0000","last_became_active":"2024-05-08T21:10:07.763591+0000","last_became_peered":"2024-05-08T21:10:07.763591+0000","last_unstale":"2024-05-08T21:19:48.059290+0000","last_undegraded":"2024-05-08T21:19:48.059290+0000","last_fullsized":"2024-05-08T21:19:48.059290+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":3871,"log_dups_size":0,"ondisk_log_size":3871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:47.977517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92290339,"num_objects":27,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":42,"num_read_kb":0,"num_write":50132,"num_write_kb":657283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"32'218","reported_seq":263,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:31.819804+0000","last_change":"2024-05-08T21:10:03.342400+0000","last_active":"2024-05-08T21:19:31.819804+0000","last_peered":"2024-05-08T21:19:31.819804+0000","last_clean":"2024-05-08T21:19:31.819804+0000","last_became_active":"2024-05-08T21:10:03.342202+0000","last_became_peered":"2024-05-08T21:10:03.342202+0000","last_unstale":"2024-05-08T21:19:31.819804+0000","last_undegraded":"2024-05-08T21:19:31.819804+0000","last_fullsized":"2024-05-08T21:19:31.819804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:10:04.668029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":37,"num_read_kb":12328,"num_write":217,"num_write_kb":4276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"32'10","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:37.012101+0000","last_change":"2024-05-08T21:10:03.752144+0000","last_active":"2024-05-08T21:19:37.012101+0000","last_peered":"2024-05-08T21:19:37.012101+0000","last_clean":"2024-05-08T21:19:37.012101+0000","last_became_active":"2024-05-08T21:10:03.751868+0000","last_became_peered":"2024-05-08T21:10:03.751868+0000","last_unstale":"2024-05-08T21:19:37.012101+0000","last_undegraded":"2024-05-08T21:19:37.012101+0000","last_fullsized":"2024-05-08T21:19:37.012101+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:40:43.168591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"32'3924","reported_seq":3998,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:47.426816+0000","last_change":"2024-05-08T21:10:08.052390+0000","last_active":"2024-05-08T21:19:47.426816+0000","last_peered":"2024-05-08T21:19:47.426816+0000","last_clean":"2024-05-08T21:19:47.426816+0000","last_became_active":"2024-05-08T21:10:08.051967+0000","last_became_peered":"2024-05-08T21:10:08.051967+0000","last_unstale":"2024-05-08T21:19:47.426816+0000","last_undegraded":"2024-05-08T21:19:47.426816+0000","last_fullsized":"2024-05-08T21:19:47.426816+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":3924,"log_dups_size":0,"ondisk_log_size":3924,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:40:07.127492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":52,"num_read_kb":0,"num_write":50165,"num_write_kb":654171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"29'4","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:27.812950+0000","last_change":"2024-05-08T21:10:03.330102+0000","last_active":"2024-05-08T21:19:27.812950+0000","last_peered":"2024-05-08T21:19:27.812950+0000","last_clean":"2024-05-08T21:19:27.812950+0000","last_became_active":"2024-05-08T21:10:03.329761+0000","last_became_peered":"2024-05-08T21:10:03.329761+0000","last_unstale":"2024-05-08T21:19:27.812950+0000","last_undegraded":"2024-05-08T21:19:27.812950+0000","last_fullsized":"2024-05-08T21:19:27.812950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:37:14.930549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":16,"num_read_kb":32,"num_write":5,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"32'13","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:42.040056+0000","last_change":"2024-05-08T21:10:03.749332+0000","last_active":"2024-05-08T21:19:42.040056+0000","last_peered":"2024-05-08T21:19:42.040056+0000","last_clean":"2024-05-08T21:19:42.040056+0000","last_became_active":"2024-05-08T21:10:03.749094+0000","last_became_peered":"2024-05-08T21:10:03.749094+0000","last_unstale":"2024-05-08T21:19:42.040056+0000","last_undegraded":"2024-05-08T21:19:42.040056+0000","last_fullsized":"2024-05-08T21:19:42.040056+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:25.969085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"32'4353","reported_seq":4430,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:48.427835+0000","last_change":"2024-05-08T21:10:08.048331+0000","last_active":"2024-05-08T21:19:48.427835+0000","last_peered":"2024-05-08T21:19:48.427835+0000","last_clean":"2024-05-08T21:19:48.427835+0000","last_became_active":"2024-05-08T21:10:08.047505+0000","last_became_peered":"2024-05-08T21:10:08.047505+0000","last_unstale":"2024-05-08T21:19:48.427835+0000","last_undegraded":"2024-05-08T21:19:48.427835+0000","last_fullsized":"2024-05-08T21:19:48.427835+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4353,"log_dups_size":0,"ondisk_log_size":4353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:18:39.268730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100756600,"num_objects":34,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":55,"num_read_kb":0,"num_write":56764,"num_write_kb":743616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"29'1","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.335436+0000","last_change":"2024-05-08T21:10:03.328021+0000","last_active":"2024-05-08T21:19:06.335436+0000","last_peered":"2024-05-08T21:19:06.335436+0000","last_clean":"2024-05-08T21:19:06.335436+0000","last_became_active":"2024-05-08T21:10:03.327648+0000","last_became_peered":"2024-05-08T21:10:03.327648+0000","last_unstale":"2024-05-08T21:19:06.335436+0000","last_undegraded":"2024-05-08T21:19:06.335436+0000","last_fullsized":"2024-05-08T21:19:06.335436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:37:54.491930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"29'10","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.751890+0000","last_change":"2024-05-08T21:10:03.750560+0000","last_active":"2024-05-08T21:19:06.751890+0000","last_peered":"2024-05-08T21:19:06.751890+0000","last_clean":"2024-05-08T21:19:06.751890+0000","last_became_active":"2024-05-08T21:10:03.750294+0000","last_became_peered":"2024-05-08T21:10:03.750294+0000","last_unstale":"2024-05-08T21:19:06.751890+0000","last_undegraded":"2024-05-08T21:19:06.751890+0000","last_fullsized":"2024-05-08T21:19:06.751890+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:30:47.937326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"32'4324","reported_seq":4395,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:48.399776+0000","last_change":"2024-05-08T21:10:08.052318+0000","last_active":"2024-05-08T21:19:48.399776+0000","last_peered":"2024-05-08T21:19:48.399776+0000","last_clean":"2024-05-08T21:19:48.399776+0000","last_became_active":"2024-05-08T21:10:08.051920+0000","last_became_peered":"2024-05-08T21:10:08.051920+0000","last_unstale":"2024-05-08T21:19:48.399776+0000","last_undegraded":"2024-05-08T21:19:48.399776+0000","last_fullsized":"2024-05-08T21:19:48.399776+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4324,"log_dups_size":0,"ondisk_log_size":4324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:25:27.669768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67150699,"num_objects":20,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":50,"num_read_kb":0,"num_write":56454,"num_write_kb":728506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"32'2","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:19.849641+0000","last_change":"2024-05-08T21:10:03.332390+0000","last_active":"2024-05-08T21:19:19.849641+0000","last_peered":"2024-05-08T21:19:19.849641+0000","last_clean":"2024-05-08T21:19:19.849641+0000","last_became_active":"2024-05-08T21:10:03.332105+0000","last_became_peered":"2024-05-08T21:10:03.332105+0000","last_unstale":"2024-05-08T21:19:19.849641+0000","last_undegraded":"2024-05-08T21:19:19.849641+0000","last_fullsized":"2024-05-08T21:19:19.849641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:32:44.705682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"32'8","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:40.607990+0000","last_change":"2024-05-08T21:10:03.742100+0000","last_active":"2024-05-08T21:19:40.607990+0000","last_peered":"2024-05-08T21:19:40.607990+0000","last_clean":"2024-05-08T21:19:40.607990+0000","last_became_active":"2024-05-08T21:10:03.741742+0000","last_became_peered":"2024-05-08T21:10:03.741742+0000","last_unstale":"2024-05-08T21:19:40.607990+0000","last_undegraded":"2024-05-08T21:19:40.607990+0000","last_fullsized":"2024-05-08T21:19:40.607990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:53:19.394126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"32'4435","reported_seq":4525,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:47.551207+0000","last_change":"2024-05-08T21:10:07.769850+0000","last_active":"2024-05-08T21:19:47.551207+0000","last_peered":"2024-05-08T21:19:47.551207+0000","last_clean":"2024-05-08T21:19:47.551207+0000","last_became_active":"2024-05-08T21:10:07.769016+0000","last_became_peered":"2024-05-08T21:10:07.769016+0000","last_unstale":"2024-05-08T21:19:47.551207+0000","last_undegraded":"2024-05-08T21:19:47.551207+0000","last_fullsized":"2024-05-08T21:19:47.551207+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4435,"log_dups_size":0,"ondisk_log_size":4435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:31:52.621418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117542773,"num_objects":37,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":68,"num_read_kb":0,"num_write":57721,"num_write_kb":734684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"29'10","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:27.844484+0000","last_change":"2024-05-08T21:10:03.331783+0000","last_active":"2024-05-08T21:19:27.844484+0000","last_peered":"2024-05-08T21:19:27.844484+0000","last_clean":"2024-05-08T21:19:27.844484+0000","last_became_active":"2024-05-08T21:10:03.331501+0000","last_became_peered":"2024-05-08T21:10:03.331501+0000","last_unstale":"2024-05-08T21:19:27.844484+0000","last_undegraded":"2024-05-08T21:19:27.844484+0000","last_fullsized":"2024-05-08T21:19:27.844484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:41:28.137295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":69,"num_read_kb":69,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"29'9","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.751368+0000","last_change":"2024-05-08T21:10:03.744007+0000","last_active":"2024-05-08T21:19:06.751368+0000","last_peered":"2024-05-08T21:19:06.751368+0000","last_clean":"2024-05-08T21:19:06.751368+0000","last_became_active":"2024-05-08T21:10:03.743557+0000","last_became_peered":"2024-05-08T21:10:03.743557+0000","last_unstale":"2024-05-08T21:19:06.751368+0000","last_undegraded":"2024-05-08T21:19:06.751368+0000","last_fullsized":"2024-05-08T21:19:06.751368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:45:26.458377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"32'3664","reported_seq":3740,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:49.539847+0000","last_change":"2024-05-08T21:10:07.777283+0000","last_active":"2024-05-08T21:19:49.539847+0000","last_peered":"2024-05-08T21:19:49.539847+0000","last_clean":"2024-05-08T21:19:49.539847+0000","last_became_active":"2024-05-08T21:10:07.776858+0000","last_became_peered":"2024-05-08T21:10:07.776858+0000","last_unstale":"2024-05-08T21:19:49.539847+0000","last_undegraded":"2024-05-08T21:19:49.539847+0000","last_fullsized":"2024-05-08T21:19:49.539847+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":3664,"log_dups_size":0,"ondisk_log_size":3664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:51.725885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84074226,"num_objects":26,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":54,"num_read_kb":0,"num_write":47400,"num_write_kb":636696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"29'2","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:09.842867+0000","last_change":"2024-05-08T21:10:03.326892+0000","last_active":"2024-05-08T21:19:09.842867+0000","last_peered":"2024-05-08T21:19:09.842867+0000","last_clean":"2024-05-08T21:19:09.842867+0000","last_became_active":"2024-05-08T21:10:03.326608+0000","last_became_peered":"2024-05-08T21:10:03.326608+0000","last_unstale":"2024-05-08T21:19:09.842867+0000","last_undegraded":"2024-05-08T21:19:09.842867+0000","last_fullsized":"2024-05-08T21:19:09.842867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:33.441985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"32'5","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:08.753595+0000","last_change":"2024-05-08T21:10:03.749221+0000","last_active":"2024-05-08T21:19:08.753595+0000","last_peered":"2024-05-08T21:19:08.753595+0000","last_clean":"2024-05-08T21:19:08.753595+0000","last_became_active":"2024-05-08T21:10:03.748915+0000","last_became_peered":"2024-05-08T21:10:03.748915+0000","last_unstale":"2024-05-08T21:19:08.753595+0000","last_undegraded":"2024-05-08T21:19:08.753595+0000","last_fullsized":"2024-05-08T21:19:08.753595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:03:10.791535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"32'4701","reported_seq":4794,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:47.978772+0000","last_change":"2024-05-08T21:10:07.759492+0000","last_active":"2024-05-08T21:19:47.978772+0000","last_peered":"2024-05-08T21:19:47.978772+0000","last_clean":"2024-05-08T21:19:47.978772+0000","last_became_active":"2024-05-08T21:10:07.759139+0000","last_became_peered":"2024-05-08T21:10:07.759139+0000","last_unstale":"2024-05-08T21:19:47.978772+0000","last_undegraded":"2024-05-08T21:19:47.978772+0000","last_fullsized":"2024-05-08T21:19:47.978772+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4701,"log_dups_size":0,"ondisk_log_size":4701,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:10.579105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79798076,"num_objects":26,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":71,"num_read_kb":0,"num_write":61787,"num_write_kb":787262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"29'1","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T21:18:26.799734+0000","last_change":"2024-05-08T21:10:03.329020+0000","last_active":"2024-05-08T21:18:26.799734+0000","last_peered":"2024-05-08T21:18:26.799734+0000","last_clean":"2024-05-08T21:18:26.799734+0000","last_became_active":"2024-05-08T21:10:03.328739+0000","last_became_peered":"2024-05-08T21:10:03.328739+0000","last_unstale":"2024-05-08T21:18:26.799734+0000","last_undegraded":"2024-05-08T21:18:26.799734+0000","last_fullsized":"2024-05-08T21:18:26.799734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:27:11.168780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"32'9","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:40.268874+0000","last_change":"2024-05-08T21:10:03.744662+0000","last_active":"2024-05-08T21:19:40.268874+0000","last_peered":"2024-05-08T21:19:40.268874+0000","last_clean":"2024-05-08T21:19:40.268874+0000","last_became_active":"2024-05-08T21:10:03.744398+0000","last_became_peered":"2024-05-08T21:10:03.744398+0000","last_unstale":"2024-05-08T21:19:40.268874+0000","last_undegraded":"2024-05-08T21:19:40.268874+0000","last_fullsized":"2024-05-08T21:19:40.268874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:05:28.046055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"32'4102","reported_seq":4172,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:48.278465+0000","last_change":"2024-05-08T21:10:07.776566+0000","last_active":"2024-05-08T21:19:48.278465+0000","last_peered":"2024-05-08T21:19:48.278465+0000","last_clean":"2024-05-08T21:19:48.278465+0000","last_became_active":"2024-05-08T21:10:07.776080+0000","last_became_peered":"2024-05-08T21:10:07.776080+0000","last_unstale":"2024-05-08T21:19:48.278465+0000","last_undegraded":"2024-05-08T21:19:48.278465+0000","last_fullsized":"2024-05-08T21:19:48.278465+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4102,"log_dups_size":0,"ondisk_log_size":4102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:26:09.323466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83899507,"num_objects":24,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":48,"num_read_kb":0,"num_write":53735,"num_write_kb":696170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T21:18:27.827601+0000","last_change":"2024-05-08T21:10:03.332953+0000","last_active":"2024-05-08T21:18:27.827601+0000","last_peered":"2024-05-08T21:18:27.827601+0000","last_clean":"2024-05-08T21:18:27.827601+0000","last_became_active":"2024-05-08T21:10:03.332689+0000","last_became_peered":"2024-05-08T21:10:03.332689+0000","last_unstale":"2024-05-08T21:18:27.827601+0000","last_undegraded":"2024-05-08T21:18:27.827601+0000","last_fullsized":"2024-05-08T21:18:27.827601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:15:32.058369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"32'7","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.337681+0000","last_change":"2024-05-08T21:10:03.745651+0000","last_active":"2024-05-08T21:19:06.337681+0000","last_peered":"2024-05-08T21:19:06.337681+0000","last_clean":"2024-05-08T21:19:06.337681+0000","last_became_active":"2024-05-08T21:10:03.742744+0000","last_became_peered":"2024-05-08T21:10:03.742744+0000","last_unstale":"2024-05-08T21:19:06.337681+0000","last_undegraded":"2024-05-08T21:19:06.337681+0000","last_fullsized":"2024-05-08T21:19:06.337681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:32:31.689490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"32'4616","reported_seq":4706,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:47.885183+0000","last_change":"2024-05-08T21:10:07.776527+0000","last_active":"2024-05-08T21:19:47.885183+0000","last_peered":"2024-05-08T21:19:47.885183+0000","last_clean":"2024-05-08T21:19:47.885183+0000","last_became_active":"2024-05-08T21:10:07.776053+0000","last_became_peered":"2024-05-08T21:10:07.776053+0000","last_unstale":"2024-05-08T21:19:47.885183+0000","last_undegraded":"2024-05-08T21:19:47.885183+0000","last_fullsized":"2024-05-08T21:19:47.885183+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4616,"log_dups_size":0,"ondisk_log_size":4616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:08:26.401358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104914124,"num_objects":33,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":68,"num_read_kb":0,"num_write":59795,"num_write_kb":758247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"29'10","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T21:18:16.068937+0000","last_change":"2024-05-08T21:10:03.738421+0000","last_active":"2024-05-08T21:18:16.068937+0000","last_peered":"2024-05-08T21:18:16.068937+0000","last_clean":"2024-05-08T21:18:16.068937+0000","last_became_active":"2024-05-08T21:10:03.738000+0000","last_became_peered":"2024-05-08T21:10:03.738000+0000","last_unstale":"2024-05-08T21:18:16.068937+0000","last_undegraded":"2024-05-08T21:18:16.068937+0000","last_fullsized":"2024-05-08T21:18:16.068937+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:38:05.948755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"32'25","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:46.067041+0000","last_change":"2024-05-08T21:10:03.331141+0000","last_active":"2024-05-08T21:19:46.067041+0000","last_peered":"2024-05-08T21:19:46.067041+0000","last_clean":"2024-05-08T21:19:46.067041+0000","last_became_active":"2024-05-08T21:10:03.330842+0000","last_became_peered":"2024-05-08T21:10:03.330842+0000","last_unstale":"2024-05-08T21:19:46.067041+0000","last_undegraded":"2024-05-08T21:19:46.067041+0000","last_fullsized":"2024-05-08T21:19:46.067041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:42:52.648932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94059,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":26,"num_read_kb":107,"num_write":23,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"32'4099","reported_seq":4177,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:48.943194+0000","last_change":"2024-05-08T21:10:08.049274+0000","last_active":"2024-05-08T21:19:48.943194+0000","last_peered":"2024-05-08T21:19:48.943194+0000","last_clean":"2024-05-08T21:19:48.943194+0000","last_became_active":"2024-05-08T21:10:08.048763+0000","last_became_peered":"2024-05-08T21:10:08.048763+0000","last_unstale":"2024-05-08T21:19:48.943194+0000","last_undegraded":"2024-05-08T21:19:48.943194+0000","last_fullsized":"2024-05-08T21:19:48.943194+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4099,"log_dups_size":0,"ondisk_log_size":4099,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:00:41.257040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67154510,"num_objects":24,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":56,"num_read_kb":0,"num_write":53613,"num_write_kb":684025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"32'7","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:41.301996+0000","last_change":"2024-05-08T21:10:03.747594+0000","last_active":"2024-05-08T21:19:41.301996+0000","last_peered":"2024-05-08T21:19:41.301996+0000","last_clean":"2024-05-08T21:19:41.301996+0000","last_became_active":"2024-05-08T21:10:03.747360+0000","last_became_peered":"2024-05-08T21:10:03.747360+0000","last_unstale":"2024-05-08T21:19:41.301996+0000","last_undegraded":"2024-05-08T21:19:41.301996+0000","last_fullsized":"2024-05-08T21:19:41.301996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:31:12.357348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T21:18:27.827642+0000","last_change":"2024-05-08T21:10:03.327847+0000","last_active":"2024-05-08T21:18:27.827642+0000","last_peered":"2024-05-08T21:18:27.827642+0000","last_clean":"2024-05-08T21:18:27.827642+0000","last_became_active":"2024-05-08T21:10:03.327530+0000","last_became_peered":"2024-05-08T21:10:03.327530+0000","last_unstale":"2024-05-08T21:18:27.827642+0000","last_undegraded":"2024-05-08T21:18:27.827642+0000","last_fullsized":"2024-05-08T21:18:27.827642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:46.232166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T21:18:03.705532+0000","last_change":"2024-05-08T21:09:59.333990+0000","last_active":"2024-05-08T21:18:03.705532+0000","last_peered":"2024-05-08T21:18:03.705532+0000","last_clean":"2024-05-08T21:18:03.705532+0000","last_became_active":"2024-05-08T21:09:59.332929+0000","last_became_peered":"2024-05-08T21:09:59.332929+0000","last_unstale":"2024-05-08T21:18:03.705532+0000","last_undegraded":"2024-05-08T21:18:03.705532+0000","last_fullsized":"2024-05-08T21:18:03.705532+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:09:58.287675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:09:58.287675+0000","last_clean_scrub_stamp":"2024-05-08T21:09:58.287675+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:47.595380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"32'3560","reported_seq":3628,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:47.312167+0000","last_change":"2024-05-08T21:10:08.049848+0000","last_active":"2024-05-08T21:19:47.312167+0000","last_peered":"2024-05-08T21:19:47.312167+0000","last_clean":"2024-05-08T21:19:47.312167+0000","last_became_active":"2024-05-08T21:10:08.049153+0000","last_became_peered":"2024-05-08T21:10:08.049153+0000","last_unstale":"2024-05-08T21:19:47.312167+0000","last_undegraded":"2024-05-08T21:19:47.312167+0000","last_fullsized":"2024-05-08T21:19:47.312167+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":3560,"log_dups_size":0,"ondisk_log_size":3560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:23.704112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79714880,"num_objects":26,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":46,"num_read_kb":0,"num_write":45721,"num_write_kb":586385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"32'4","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.754392+0000","last_change":"2024-05-08T21:10:03.743094+0000","last_active":"2024-05-08T21:19:06.754392+0000","last_peered":"2024-05-08T21:19:06.754392+0000","last_clean":"2024-05-08T21:19:06.754392+0000","last_became_active":"2024-05-08T21:10:03.742819+0000","last_became_peered":"2024-05-08T21:10:03.742819+0000","last_unstale":"2024-05-08T21:19:06.754392+0000","last_undegraded":"2024-05-08T21:19:06.754392+0000","last_fullsized":"2024-05-08T21:19:06.754392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:41:25.593884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"32'3","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.751156+0000","last_change":"2024-05-08T21:10:03.340259+0000","last_active":"2024-05-08T21:19:06.751156+0000","last_peered":"2024-05-08T21:19:06.751156+0000","last_clean":"2024-05-08T21:19:06.751156+0000","last_became_active":"2024-05-08T21:10:03.339957+0000","last_became_peered":"2024-05-08T21:10:03.339957+0000","last_unstale":"2024-05-08T21:19:06.751156+0000","last_undegraded":"2024-05-08T21:19:06.751156+0000","last_fullsized":"2024-05-08T21:19:06.751156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:38:36.535689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"32'3595","reported_seq":3659,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:47.350416+0000","last_change":"2024-05-08T21:10:08.050370+0000","last_active":"2024-05-08T21:19:47.350416+0000","last_peered":"2024-05-08T21:19:47.350416+0000","last_clean":"2024-05-08T21:19:47.350416+0000","last_became_active":"2024-05-08T21:10:08.049962+0000","last_became_peered":"2024-05-08T21:10:08.049962+0000","last_unstale":"2024-05-08T21:19:47.350416+0000","last_undegraded":"2024-05-08T21:19:47.350416+0000","last_fullsized":"2024-05-08T21:19:47.350416+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":3595,"log_dups_size":0,"ondisk_log_size":3595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:11:35.394334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101093947,"num_objects":26,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":42,"num_read_kb":0,"num_write":47638,"num_write_kb":629817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"29'1","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T21:18:28.723333+0000","last_change":"2024-05-08T21:10:03.337949+0000","last_active":"2024-05-08T21:18:28.723333+0000","last_peered":"2024-05-08T21:18:28.723333+0000","last_clean":"2024-05-08T21:18:28.723333+0000","last_became_active":"2024-05-08T21:10:03.337627+0000","last_became_peered":"2024-05-08T21:10:03.337627+0000","last_unstale":"2024-05-08T21:18:28.723333+0000","last_undegraded":"2024-05-08T21:18:28.723333+0000","last_fullsized":"2024-05-08T21:18:28.723333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:17:36.792731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"32'6","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.751956+0000","last_change":"2024-05-08T21:10:03.738212+0000","last_active":"2024-05-08T21:19:06.751956+0000","last_peered":"2024-05-08T21:19:06.751956+0000","last_clean":"2024-05-08T21:19:06.751956+0000","last_became_active":"2024-05-08T21:10:03.737927+0000","last_became_peered":"2024-05-08T21:10:03.737927+0000","last_unstale":"2024-05-08T21:19:06.751956+0000","last_undegraded":"2024-05-08T21:19:06.751956+0000","last_fullsized":"2024-05-08T21:19:06.751956+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:03:08.031584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"32'4690","reported_seq":4786,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:48.321172+0000","last_change":"2024-05-08T21:10:08.052270+0000","last_active":"2024-05-08T21:19:48.321172+0000","last_peered":"2024-05-08T21:19:48.321172+0000","last_clean":"2024-05-08T21:19:48.321172+0000","last_became_active":"2024-05-08T21:10:08.051881+0000","last_became_peered":"2024-05-08T21:10:08.051881+0000","last_unstale":"2024-05-08T21:19:48.321172+0000","last_undegraded":"2024-05-08T21:19:48.321172+0000","last_fullsized":"2024-05-08T21:19:48.321172+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4690,"log_dups_size":0,"ondisk_log_size":4690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:39:07.929942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96538708,"num_objects":29,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":74,"num_read_kb":0,"num_write":60676,"num_write_kb":757240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"32'66","reported_seq":95,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:42.838264+0000","last_change":"2024-05-08T21:10:03.333696+0000","last_active":"2024-05-08T21:19:42.838264+0000","last_peered":"2024-05-08T21:19:42.838264+0000","last_clean":"2024-05-08T21:19:42.838264+0000","last_became_active":"2024-05-08T21:10:03.333368+0000","last_became_peered":"2024-05-08T21:10:03.333368+0000","last_unstale":"2024-05-08T21:19:42.838264+0000","last_undegraded":"2024-05-08T21:19:42.838264+0000","last_fullsized":"2024-05-08T21:19:42.838264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:00:08.459270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":34,"num_write":151,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"32'10","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:37.785783+0000","last_change":"2024-05-08T21:10:03.752578+0000","last_active":"2024-05-08T21:19:37.785783+0000","last_peered":"2024-05-08T21:19:37.785783+0000","last_clean":"2024-05-08T21:19:37.785783+0000","last_became_active":"2024-05-08T21:10:03.752389+0000","last_became_peered":"2024-05-08T21:10:03.752389+0000","last_unstale":"2024-05-08T21:19:37.785783+0000","last_undegraded":"2024-05-08T21:19:37.785783+0000","last_fullsized":"2024-05-08T21:19:37.785783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:54:02.318162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"32'3929","reported_seq":3996,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:49.588791+0000","last_change":"2024-05-08T21:10:08.048081+0000","last_active":"2024-05-08T21:19:49.588791+0000","last_peered":"2024-05-08T21:19:49.588791+0000","last_clean":"2024-05-08T21:19:49.588791+0000","last_became_active":"2024-05-08T21:10:08.047632+0000","last_became_peered":"2024-05-08T21:10:08.047632+0000","last_unstale":"2024-05-08T21:19:49.588791+0000","last_undegraded":"2024-05-08T21:19:49.588791+0000","last_fullsized":"2024-05-08T21:19:49.588791+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":3929,"log_dups_size":0,"ondisk_log_size":3929,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:26:05.857718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79790866,"num_objects":22,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":45,"num_read_kb":0,"num_write":51550,"num_write_kb":672103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"29'4","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:27.841501+0000","last_change":"2024-05-08T21:10:03.340553+0000","last_active":"2024-05-08T21:19:27.841501+0000","last_peered":"2024-05-08T21:19:27.841501+0000","last_clean":"2024-05-08T21:19:27.841501+0000","last_became_active":"2024-05-08T21:10:03.340280+0000","last_became_peered":"2024-05-08T21:10:03.340280+0000","last_unstale":"2024-05-08T21:19:27.841501+0000","last_undegraded":"2024-05-08T21:19:27.841501+0000","last_fullsized":"2024-05-08T21:19:27.841501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:36:24.866220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"32'15","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:45.825747+0000","last_change":"2024-05-08T21:10:03.736316+0000","last_active":"2024-05-08T21:19:45.825747+0000","last_peered":"2024-05-08T21:19:45.825747+0000","last_clean":"2024-05-08T21:19:45.825747+0000","last_became_active":"2024-05-08T21:10:03.736049+0000","last_became_peered":"2024-05-08T21:10:03.736049+0000","last_unstale":"2024-05-08T21:19:45.825747+0000","last_undegraded":"2024-05-08T21:19:45.825747+0000","last_fullsized":"2024-05-08T21:19:45.825747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:09:48.973609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'3520","reported_seq":3607,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:49.394723+0000","last_change":"2024-05-08T21:10:53.484914+0000","last_active":"2024-05-08T21:19:49.394723+0000","last_peered":"2024-05-08T21:19:49.394723+0000","last_clean":"2024-05-08T21:19:49.394723+0000","last_became_active":"2024-05-08T21:10:53.484443+0000","last_became_peered":"2024-05-08T21:10:53.484443+0000","last_unstale":"2024-05-08T21:19:49.394723+0000","last_undegraded":"2024-05-08T21:19:49.394723+0000","last_fullsized":"2024-05-08T21:19:49.394723+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":3520,"log_dups_size":0,"ondisk_log_size":3520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:09:00.867177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75631074,"num_objects":26,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":55,"num_read_kb":0,"num_write":45442,"num_write_kb":601547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T21:18:48.750694+0000","last_change":"2024-05-08T21:10:03.340078+0000","last_active":"2024-05-08T21:18:48.750694+0000","last_peered":"2024-05-08T21:18:48.750694+0000","last_clean":"2024-05-08T21:18:48.750694+0000","last_became_active":"2024-05-08T21:10:03.339690+0000","last_became_peered":"2024-05-08T21:10:03.339690+0000","last_unstale":"2024-05-08T21:18:48.750694+0000","last_undegraded":"2024-05-08T21:18:48.750694+0000","last_fullsized":"2024-05-08T21:18:48.750694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:01:33.991878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"32'6","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:35.411053+0000","last_change":"2024-05-08T21:10:03.744606+0000","last_active":"2024-05-08T21:19:35.411053+0000","last_peered":"2024-05-08T21:19:35.411053+0000","last_clean":"2024-05-08T21:19:35.411053+0000","last_became_active":"2024-05-08T21:10:03.744160+0000","last_became_peered":"2024-05-08T21:10:03.744160+0000","last_unstale":"2024-05-08T21:19:35.411053+0000","last_undegraded":"2024-05-08T21:19:35.411053+0000","last_fullsized":"2024-05-08T21:19:35.411053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:10:25.144058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'5102","reported_seq":5196,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:48.092722+0000","last_change":"2024-05-08T21:10:08.049224+0000","last_active":"2024-05-08T21:19:48.092722+0000","last_peered":"2024-05-08T21:19:48.092722+0000","last_clean":"2024-05-08T21:19:48.092722+0000","last_became_active":"2024-05-08T21:10:08.048866+0000","last_became_peered":"2024-05-08T21:10:08.048866+0000","last_unstale":"2024-05-08T21:19:48.092722+0000","last_undegraded":"2024-05-08T21:19:48.092722+0000","last_fullsized":"2024-05-08T21:19:48.092722+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":5102,"log_dups_size":0,"ondisk_log_size":5102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:38:20.601167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100678611,"num_objects":28,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":72,"num_read_kb":0,"num_write":66073,"num_write_kb":843075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T21:18:47.261015+0000","last_change":"2024-05-08T21:10:03.339344+0000","last_active":"2024-05-08T21:18:47.261015+0000","last_peered":"2024-05-08T21:18:47.261015+0000","last_clean":"2024-05-08T21:18:47.261015+0000","last_became_active":"2024-05-08T21:10:03.339136+0000","last_became_peered":"2024-05-08T21:10:03.339136+0000","last_unstale":"2024-05-08T21:18:47.261015+0000","last_undegraded":"2024-05-08T21:18:47.261015+0000","last_fullsized":"2024-05-08T21:18:47.261015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:02:55.623727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"32'9","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.753228+0000","last_change":"2024-05-08T21:10:03.737684+0000","last_active":"2024-05-08T21:19:06.753228+0000","last_peered":"2024-05-08T21:19:06.753228+0000","last_clean":"2024-05-08T21:19:06.753228+0000","last_became_active":"2024-05-08T21:10:03.737459+0000","last_became_peered":"2024-05-08T21:10:03.737459+0000","last_unstale":"2024-05-08T21:19:06.753228+0000","last_undegraded":"2024-05-08T21:19:06.753228+0000","last_fullsized":"2024-05-08T21:19:06.753228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:39.662018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"32'4228","reported_seq":4303,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:49.474196+0000","last_change":"2024-05-08T21:10:07.776483+0000","last_active":"2024-05-08T21:19:49.474196+0000","last_peered":"2024-05-08T21:19:49.474196+0000","last_clean":"2024-05-08T21:19:49.474196+0000","last_became_active":"2024-05-08T21:10:07.775956+0000","last_became_peered":"2024-05-08T21:10:07.775956+0000","last_unstale":"2024-05-08T21:19:49.474196+0000","last_undegraded":"2024-05-08T21:19:49.474196+0000","last_fullsized":"2024-05-08T21:19:49.474196+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4228,"log_dups_size":0,"ondisk_log_size":4228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:28:17.332488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58737657,"num_objects":20,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":53,"num_read_kb":0,"num_write":55064,"num_write_kb":703369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"29'1","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T21:18:52.261484+0000","last_change":"2024-05-08T21:10:03.331695+0000","last_active":"2024-05-08T21:18:52.261484+0000","last_peered":"2024-05-08T21:18:52.261484+0000","last_clean":"2024-05-08T21:18:52.261484+0000","last_became_active":"2024-05-08T21:10:03.331198+0000","last_became_peered":"2024-05-08T21:10:03.331198+0000","last_unstale":"2024-05-08T21:18:52.261484+0000","last_undegraded":"2024-05-08T21:18:52.261484+0000","last_fullsized":"2024-05-08T21:18:52.261484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:37:54.491930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"32'9","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.754603+0000","last_change":"2024-05-08T21:10:03.744562+0000","last_active":"2024-05-08T21:19:06.754603+0000","last_peered":"2024-05-08T21:19:06.754603+0000","last_clean":"2024-05-08T21:19:06.754603+0000","last_became_active":"2024-05-08T21:10:03.744326+0000","last_became_peered":"2024-05-08T21:10:03.744326+0000","last_unstale":"2024-05-08T21:19:06.754603+0000","last_undegraded":"2024-05-08T21:19:06.754603+0000","last_fullsized":"2024-05-08T21:19:06.754603+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:21:52.947209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'4098","reported_seq":4174,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:49.137569+0000","last_change":"2024-05-08T21:10:07.763204+0000","last_active":"2024-05-08T21:19:49.137569+0000","last_peered":"2024-05-08T21:19:49.137569+0000","last_clean":"2024-05-08T21:19:49.137569+0000","last_became_active":"2024-05-08T21:10:07.762886+0000","last_became_peered":"2024-05-08T21:10:07.762886+0000","last_unstale":"2024-05-08T21:19:49.137569+0000","last_undegraded":"2024-05-08T21:19:49.137569+0000","last_fullsized":"2024-05-08T21:19:49.137569+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4098,"log_dups_size":0,"ondisk_log_size":4098,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:01.599700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58939954,"num_objects":21,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":54,"num_read_kb":0,"num_write":53651,"num_write_kb":692300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"32'671","reported_seq":705,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:11.351259+0000","last_change":"2024-05-08T21:10:03.337993+0000","last_active":"2024-05-08T21:19:11.351259+0000","last_peered":"2024-05-08T21:19:11.351259+0000","last_clean":"2024-05-08T21:19:11.351259+0000","last_became_active":"2024-05-08T21:10:03.337654+0000","last_became_peered":"2024-05-08T21:10:03.337654+0000","last_unstale":"2024-05-08T21:19:11.351259+0000","last_undegraded":"2024-05-08T21:19:11.351259+0000","last_fullsized":"2024-05-08T21:19:11.351259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":671,"log_dups_size":0,"ondisk_log_size":671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:23:20.536178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":13,"num_read_kb":9261,"num_write":667,"num_write_kb":4529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"32'7","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.752034+0000","last_change":"2024-05-08T21:10:03.744871+0000","last_active":"2024-05-08T21:19:06.752034+0000","last_peered":"2024-05-08T21:19:06.752034+0000","last_clean":"2024-05-08T21:19:06.752034+0000","last_became_active":"2024-05-08T21:10:03.744589+0000","last_became_peered":"2024-05-08T21:10:03.744589+0000","last_unstale":"2024-05-08T21:19:06.752034+0000","last_undegraded":"2024-05-08T21:19:06.752034+0000","last_fullsized":"2024-05-08T21:19:06.752034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:41.090204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"32'3986","reported_seq":4056,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:49.451711+0000","last_change":"2024-05-08T21:10:08.047735+0000","last_active":"2024-05-08T21:19:49.451711+0000","last_peered":"2024-05-08T21:19:49.451711+0000","last_clean":"2024-05-08T21:19:49.451711+0000","last_became_active":"2024-05-08T21:10:08.047331+0000","last_became_peered":"2024-05-08T21:10:08.047331+0000","last_unstale":"2024-05-08T21:19:49.451711+0000","last_undegraded":"2024-05-08T21:19:49.451711+0000","last_fullsized":"2024-05-08T21:19:49.451711+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":3986,"log_dups_size":0,"ondisk_log_size":3986,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:44:22.797154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71358050,"num_objects":22,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":48,"num_read_kb":0,"num_write":52599,"num_write_kb":688417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.362283+0000","last_change":"2024-05-08T21:10:03.333117+0000","last_active":"2024-05-08T21:19:06.362283+0000","last_peered":"2024-05-08T21:19:06.362283+0000","last_clean":"2024-05-08T21:19:06.362283+0000","last_became_active":"2024-05-08T21:10:03.332790+0000","last_became_peered":"2024-05-08T21:10:03.332790+0000","last_unstale":"2024-05-08T21:19:06.362283+0000","last_undegraded":"2024-05-08T21:19:06.362283+0000","last_fullsized":"2024-05-08T21:19:06.362283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:52:36.355804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'10","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:42.545945+0000","last_change":"2024-05-08T21:10:03.748047+0000","last_active":"2024-05-08T21:19:42.545945+0000","last_peered":"2024-05-08T21:19:42.545945+0000","last_clean":"2024-05-08T21:19:42.545945+0000","last_became_active":"2024-05-08T21:10:03.747759+0000","last_became_peered":"2024-05-08T21:10:03.747759+0000","last_unstale":"2024-05-08T21:19:42.545945+0000","last_undegraded":"2024-05-08T21:19:42.545945+0000","last_fullsized":"2024-05-08T21:19:42.545945+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:11:05.309278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"32'3761","reported_seq":3840,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:47.350916+0000","last_change":"2024-05-08T21:10:07.761000+0000","last_active":"2024-05-08T21:19:47.350916+0000","last_peered":"2024-05-08T21:19:47.350916+0000","last_clean":"2024-05-08T21:19:47.350916+0000","last_became_active":"2024-05-08T21:10:07.760566+0000","last_became_peered":"2024-05-08T21:10:07.760566+0000","last_unstale":"2024-05-08T21:19:47.350916+0000","last_undegraded":"2024-05-08T21:19:47.350916+0000","last_fullsized":"2024-05-08T21:19:47.350916+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":3761,"log_dups_size":0,"ondisk_log_size":3761,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:48:27.435678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100952383,"num_objects":32,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":57,"num_read_kb":0,"num_write":48613,"num_write_kb":636437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"26'1","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.751644+0000","last_change":"2024-05-08T21:10:03.331358+0000","last_active":"2024-05-08T21:19:06.751644+0000","last_peered":"2024-05-08T21:19:06.751644+0000","last_clean":"2024-05-08T21:19:06.751644+0000","last_became_active":"2024-05-08T21:10:03.331028+0000","last_became_peered":"2024-05-08T21:10:03.331028+0000","last_unstale":"2024-05-08T21:19:06.751644+0000","last_undegraded":"2024-05-08T21:19:06.751644+0000","last_fullsized":"2024-05-08T21:19:06.751644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:18:47.922157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"32'8","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:12.888041+0000","last_change":"2024-05-08T21:10:03.751285+0000","last_active":"2024-05-08T21:19:12.888041+0000","last_peered":"2024-05-08T21:19:12.888041+0000","last_clean":"2024-05-08T21:19:12.888041+0000","last_became_active":"2024-05-08T21:10:03.746557+0000","last_became_peered":"2024-05-08T21:10:03.746557+0000","last_unstale":"2024-05-08T21:19:12.888041+0000","last_undegraded":"2024-05-08T21:19:12.888041+0000","last_fullsized":"2024-05-08T21:19:12.888041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:50:27.241404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"32'3702","reported_seq":3767,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:47.314738+0000","last_change":"2024-05-08T21:10:08.048830+0000","last_active":"2024-05-08T21:19:47.314738+0000","last_peered":"2024-05-08T21:19:47.314738+0000","last_clean":"2024-05-08T21:19:47.314738+0000","last_became_active":"2024-05-08T21:10:08.048453+0000","last_became_peered":"2024-05-08T21:10:08.048453+0000","last_unstale":"2024-05-08T21:19:47.314738+0000","last_undegraded":"2024-05-08T21:19:47.314738+0000","last_fullsized":"2024-05-08T21:19:47.314738+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":3702,"log_dups_size":0,"ondisk_log_size":3702,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:19:28.758712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138428923,"num_objects":37,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":43,"num_read_kb":0,"num_write":49303,"num_write_kb":639424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"29'3","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:27.840261+0000","last_change":"2024-05-08T21:10:03.330419+0000","last_active":"2024-05-08T21:19:27.840261+0000","last_peered":"2024-05-08T21:19:27.840261+0000","last_clean":"2024-05-08T21:19:27.840261+0000","last_became_active":"2024-05-08T21:10:03.330082+0000","last_became_peered":"2024-05-08T21:10:03.330082+0000","last_unstale":"2024-05-08T21:19:27.840261+0000","last_undegraded":"2024-05-08T21:19:27.840261+0000","last_fullsized":"2024-05-08T21:19:27.840261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:09:20.516386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"32'10","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:39.926986+0000","last_change":"2024-05-08T21:10:03.747306+0000","last_active":"2024-05-08T21:19:39.926986+0000","last_peered":"2024-05-08T21:19:39.926986+0000","last_clean":"2024-05-08T21:19:39.926986+0000","last_became_active":"2024-05-08T21:10:03.746755+0000","last_became_peered":"2024-05-08T21:10:03.746755+0000","last_unstale":"2024-05-08T21:19:39.926986+0000","last_undegraded":"2024-05-08T21:19:39.926986+0000","last_fullsized":"2024-05-08T21:19:39.926986+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:17:51.344821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"32'12","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:45.387079+0000","last_change":"2024-05-08T21:10:03.738627+0000","last_active":"2024-05-08T21:19:45.387079+0000","last_peered":"2024-05-08T21:19:45.387079+0000","last_clean":"2024-05-08T21:19:45.387079+0000","last_became_active":"2024-05-08T21:10:03.738338+0000","last_became_peered":"2024-05-08T21:10:03.738338+0000","last_unstale":"2024-05-08T21:19:45.387079+0000","last_undegraded":"2024-05-08T21:19:45.387079+0000","last_fullsized":"2024-05-08T21:19:45.387079+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:34.088831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"32'13","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:44.614454+0000","last_change":"2024-05-08T21:10:03.745607+0000","last_active":"2024-05-08T21:19:44.614454+0000","last_peered":"2024-05-08T21:19:44.614454+0000","last_clean":"2024-05-08T21:19:44.614454+0000","last_became_active":"2024-05-08T21:10:03.745362+0000","last_became_peered":"2024-05-08T21:10:03.745362+0000","last_unstale":"2024-05-08T21:19:44.614454+0000","last_undegraded":"2024-05-08T21:19:44.614454+0000","last_fullsized":"2024-05-08T21:19:44.614454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:54.399930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"32'13","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:41.631427+0000","last_change":"2024-05-08T21:10:03.745137+0000","last_active":"2024-05-08T21:19:41.631427+0000","last_peered":"2024-05-08T21:19:41.631427+0000","last_clean":"2024-05-08T21:19:41.631427+0000","last_became_active":"2024-05-08T21:10:03.744844+0000","last_became_peered":"2024-05-08T21:10:03.744844+0000","last_unstale":"2024-05-08T21:19:41.631427+0000","last_undegraded":"2024-05-08T21:19:41.631427+0000","last_fullsized":"2024-05-08T21:19:41.631427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:06.853429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"32'10","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.753771+0000","last_change":"2024-05-08T21:10:03.745163+0000","last_active":"2024-05-08T21:19:06.753771+0000","last_peered":"2024-05-08T21:19:06.753771+0000","last_clean":"2024-05-08T21:19:06.753771+0000","last_became_active":"2024-05-08T21:10:03.744908+0000","last_became_peered":"2024-05-08T21:10:03.744908+0000","last_unstale":"2024-05-08T21:19:06.753771+0000","last_undegraded":"2024-05-08T21:19:06.753771+0000","last_fullsized":"2024-05-08T21:19:06.753771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:06.593989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'7","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.753879+0000","last_change":"2024-05-08T21:10:03.748542+0000","last_active":"2024-05-08T21:19:06.753879+0000","last_peered":"2024-05-08T21:19:06.753879+0000","last_clean":"2024-05-08T21:19:06.753879+0000","last_became_active":"2024-05-08T21:10:03.748284+0000","last_became_peered":"2024-05-08T21:10:03.748284+0000","last_unstale":"2024-05-08T21:19:06.753879+0000","last_undegraded":"2024-05-08T21:19:06.753879+0000","last_fullsized":"2024-05-08T21:19:06.753879+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:49:10.430406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"32'8","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:41.799210+0000","last_change":"2024-05-08T21:10:03.739778+0000","last_active":"2024-05-08T21:19:41.799210+0000","last_peered":"2024-05-08T21:19:41.799210+0000","last_clean":"2024-05-08T21:19:41.799210+0000","last_became_active":"2024-05-08T21:10:03.739522+0000","last_became_peered":"2024-05-08T21:10:03.739522+0000","last_unstale":"2024-05-08T21:19:41.799210+0000","last_undegraded":"2024-05-08T21:19:41.799210+0000","last_fullsized":"2024-05-08T21:19:41.799210+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:07:42.115999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"32'7","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:32.484326+0000","last_change":"2024-05-08T21:10:03.746126+0000","last_active":"2024-05-08T21:19:32.484326+0000","last_peered":"2024-05-08T21:19:32.484326+0000","last_clean":"2024-05-08T21:19:32.484326+0000","last_became_active":"2024-05-08T21:10:03.745842+0000","last_became_peered":"2024-05-08T21:10:03.745842+0000","last_unstale":"2024-05-08T21:19:32.484326+0000","last_undegraded":"2024-05-08T21:19:32.484326+0000","last_fullsized":"2024-05-08T21:19:32.484326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:51:06.176371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"32'7","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:32.220655+0000","last_change":"2024-05-08T21:10:53.473916+0000","last_active":"2024-05-08T21:19:32.220655+0000","last_peered":"2024-05-08T21:19:32.220655+0000","last_clean":"2024-05-08T21:19:32.220655+0000","last_became_active":"2024-05-08T21:10:53.473615+0000","last_became_peered":"2024-05-08T21:10:53.473615+0000","last_unstale":"2024-05-08T21:19:32.220655+0000","last_undegraded":"2024-05-08T21:19:32.220655+0000","last_fullsized":"2024-05-08T21:19:32.220655+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:58:21.728711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"32'9","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:46.085484+0000","last_change":"2024-05-08T21:10:03.751111+0000","last_active":"2024-05-08T21:19:46.085484+0000","last_peered":"2024-05-08T21:19:46.085484+0000","last_clean":"2024-05-08T21:19:46.085484+0000","last_became_active":"2024-05-08T21:10:03.747059+0000","last_became_peered":"2024-05-08T21:10:03.747059+0000","last_unstale":"2024-05-08T21:19:46.085484+0000","last_undegraded":"2024-05-08T21:19:46.085484+0000","last_fullsized":"2024-05-08T21:19:46.085484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:43.254221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"32'12","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:41.438674+0000","last_change":"2024-05-08T21:10:03.747207+0000","last_active":"2024-05-08T21:19:41.438674+0000","last_peered":"2024-05-08T21:19:41.438674+0000","last_clean":"2024-05-08T21:19:41.438674+0000","last_became_active":"2024-05-08T21:10:03.746942+0000","last_became_peered":"2024-05-08T21:10:03.746942+0000","last_unstale":"2024-05-08T21:19:41.438674+0000","last_undegraded":"2024-05-08T21:19:41.438674+0000","last_fullsized":"2024-05-08T21:19:41.438674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:33:52.317273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"32'11","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:44.490151+0000","last_change":"2024-05-08T21:10:03.753663+0000","last_active":"2024-05-08T21:19:44.490151+0000","last_peered":"2024-05-08T21:19:44.490151+0000","last_clean":"2024-05-08T21:19:44.490151+0000","last_became_active":"2024-05-08T21:10:03.752486+0000","last_became_peered":"2024-05-08T21:10:03.752486+0000","last_unstale":"2024-05-08T21:19:44.490151+0000","last_undegraded":"2024-05-08T21:19:44.490151+0000","last_fullsized":"2024-05-08T21:19:44.490151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:21:45.895154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"32'11","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:12.559115+0000","last_change":"2024-05-08T21:10:03.753849+0000","last_active":"2024-05-08T21:19:12.559115+0000","last_peered":"2024-05-08T21:19:12.559115+0000","last_clean":"2024-05-08T21:19:12.559115+0000","last_became_active":"2024-05-08T21:10:03.753616+0000","last_became_peered":"2024-05-08T21:10:03.753616+0000","last_unstale":"2024-05-08T21:19:12.559115+0000","last_undegraded":"2024-05-08T21:19:12.559115+0000","last_fullsized":"2024-05-08T21:19:12.559115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:02:58.650310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"29'7","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.751337+0000","last_change":"2024-05-08T21:10:03.744906+0000","last_active":"2024-05-08T21:19:06.751337+0000","last_peered":"2024-05-08T21:19:06.751337+0000","last_clean":"2024-05-08T21:19:06.751337+0000","last_became_active":"2024-05-08T21:10:03.744562+0000","last_became_peered":"2024-05-08T21:10:03.744562+0000","last_unstale":"2024-05-08T21:19:06.751337+0000","last_undegraded":"2024-05-08T21:19:06.751337+0000","last_fullsized":"2024-05-08T21:19:06.751337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:21:30.416392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2833732946,"num_objects":865,"num_object_clones":0,"num_object_copies":3460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":865,"num_whiteouts":0,"num_read":1810,"num_read_kb":0,"num_write":1713540,"num_write_kb":22146371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3705786368,"data_stored":6040633344,"data_compressed":366210703,"data_compressed_allocated":1132269568,"data_compressed_original":3467116544,"omap_allocated":0,"internal_metadata":0},"log_size":131543,"ondisk_log_size":131543,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":555,"ondisk_log_size":555,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64612,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":15836278,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":328,"num_read_kb":39720,"num_write":2864,"num_write_kb":17763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17805312,"data_stored":31673694,"data_compressed":2933172,"data_compressed_allocated":3907584,"data_compressed_original":17833984,"omap_allocated":0,"internal_metadata":0},"log_size":2816,"ondisk_log_size":2816,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509560,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1358248,"kb_used_data":450912,"kb_used_omap":1,"kb_used_meta":907326,"kb_avail":93013592,"statfs":{"total":96636764160,"available":95245918208,"internally_reserved":0,"allocated":461733888,"data_stored":766461979,"data_compressed":47292655,"data_compressed_allocated":144924672,"data_compressed_original":449855488,"omap_allocated":1593,"internal_metadata":929102279},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:19:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.9790000000000001,"15min":1.603},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":5.5289999999999999,"5min":13.432,"15min":17.978999999999999},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.91700000000000004,"5min":1.4750000000000001,"15min":1.0800000000000001},"min":{"1min":0.24299999999999999,"5min":0.219,"15min":0.219},"max":{"1min":5.2889999999999997,"5min":10.097,"15min":11.362},"last":0.375}]},{"osd":1,"last update":"Wed May 8 21:19:07 2024","interfaces":[{"interface":"back","average":{"1min":2.2170000000000001,"5min":2.831,"15min":1.863},"min":{"1min":0.247,"5min":0.219,"15min":0.219},"max":{"1min":9.7360000000000007,"5min":49.942999999999998,"15min":49.942999999999998},"last":17.797000000000001},{"interface":"front","average":{"1min":1.726,"5min":2.5259999999999998,"15min":1.516},"min":{"1min":0.45100000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":5.2789999999999999,"5min":27.733000000000001,"15min":27.733000000000001},"last":2.5379999999999998}]},{"osd":2,"last update":"Wed May 8 21:19:07 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":1.583,"15min":1.6970000000000001},"min":{"1min":0.27100000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":2.7189999999999999,"5min":17.858000000000001,"15min":58.450000000000003},"last":0.80100000000000005},{"interface":"front","average":{"1min":1.165,"5min":1.639,"15min":1.1319999999999999},"min":{"1min":0.32000000000000001,"5min":0.30199999999999999,"15min":0.27400000000000002},"max":{"1min":4.6559999999999997,"5min":13.568,"15min":14.746},"last":0.51000000000000001}]},{"osd":3,"last update":"Wed May 8 21:19:07 2024","interfaces":[{"interface":"back","average":{"1min":1.6379999999999999,"5min":4.3520000000000003,"15min":2.617},"min":{"1min":0.35499999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":6.1879999999999997,"5min":68.728999999999999,"15min":74.570999999999998},"last":3.847},{"interface":"front","average":{"1min":1.173,"5min":2.3490000000000002,"15min":1.6279999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":11.816000000000001,"5min":27.358000000000001,"15min":28.099},"last":16.302}]},{"osd":4,"last update":"Wed May 8 21:19:07 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":1.5580000000000001,"15min":1.1319999999999999},"min":{"1min":0.23300000000000001,"5min":0.223,"15min":0.223},"max":{"1min":8.0869999999999997,"5min":27.963000000000001,"15min":29.731000000000002},"last":0.25},{"interface":"front","average":{"1min":1.258,"5min":1.5660000000000001,"15min":1.1519999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":10.657999999999999,"5min":17.835999999999999,"15min":26.454999999999998},"last":0.39000000000000001}]},{"osd":5,"last update":"Wed May 8 21:19:07 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":1.1000000000000001,"15min":1.177},"min":{"1min":0.30099999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":2.4510000000000001,"5min":17.780999999999999,"15min":65.373000000000005},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":1.2809999999999999,"15min":1.046},"min":{"1min":0.28399999999999997,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.357,"5min":13.509,"15min":26.498999999999999},"last":0.35699999999999998}]},{"osd":7,"last update":"Wed May 8 21:19:07 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":1.7889999999999999,"15min":1.0589999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.9450000000000001,"5min":16.808,"15min":16.808},"last":0.318},{"interface":"front","average":{"1min":0.57599999999999996,"5min":1.4770000000000001,"15min":0.96499999999999997},"min":{"1min":0.33600000000000002,"5min":0.314,"15min":0.314},"max":{"1min":1.821,"5min":18.100999999999999,"15min":18.100999999999999},"last":0.32900000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509561,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1087120,"kb_used_data":413448,"kb_used_omap":1,"kb_used_meta":673662,"kb_avail":93284720,"statfs":{"total":96636764160,"available":95523553280,"internally_reserved":0,"allocated":423370752,"data_stored":688813525,"data_compressed":41956954,"data_compressed_allocated":130084864,"data_compressed_original":395726848,"omap_allocated":1594,"internal_metadata":689830342},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":1.8360000000000001,"15min":1.4450000000000001},"min":{"1min":0.24199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":7.8029999999999999,"5min":17.295999999999999,"15min":48.481999999999999},"last":2.738},{"interface":"front","average":{"1min":1.619,"5min":2.0600000000000001,"15min":1.522},"min":{"1min":0.36299999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":13.234999999999999,"5min":17.164000000000001,"15min":30.004999999999999},"last":4.4900000000000002}]},{"osd":1,"last update":"Wed May 8 21:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":2.7120000000000002,"15min":1.7310000000000001},"min":{"1min":0.26800000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":3.0550000000000002,"5min":21.702999999999999,"15min":25.228000000000002},"last":6.6870000000000003},{"interface":"front","average":{"1min":0.86299999999999999,"5min":2.4710000000000001,"15min":1.403},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":4.0670000000000002,"5min":21.869,"15min":21.869},"last":6.766}]},{"osd":2,"last update":"Wed May 8 21:19:19 2024","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":3.0019999999999998,"15min":1.6699999999999999},"min":{"1min":0.29399999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":10.689,"5min":34.850000000000001,"15min":34.850000000000001},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":2.4430000000000001,"15min":1.4690000000000001},"min":{"1min":0.28899999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.617,"5min":29.623000000000001,"15min":29.623000000000001},"last":0.93200000000000005}]},{"osd":3,"last update":"Wed May 8 21:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":1.8029999999999999,"15min":1.377},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":4.1070000000000002,"5min":19.395,"15min":23.234999999999999},"last":6.7999999999999998},{"interface":"front","average":{"1min":1.55,"5min":3.6520000000000001,"15min":2.0489999999999999},"min":{"1min":0.34399999999999997,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":20.013000000000002,"5min":40.954999999999998,"15min":40.954999999999998},"last":6.9980000000000002}]},{"osd":4,"last update":"Wed May 8 21:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":1.0369999999999999,"15min":0.89800000000000002},"min":{"1min":0.27500000000000002,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.95599999999999996,"5min":12.390000000000001,"15min":23.254000000000001},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":1.0820000000000001,"15min":0.93999999999999995},"min":{"1min":0.32300000000000001,"5min":0.27600000000000002,"15min":0.26600000000000001},"max":{"1min":3.0859999999999999,"5min":7.7370000000000001,"15min":17.550999999999998},"last":0.34599999999999997}]},{"osd":6,"last update":"Wed May 8 21:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.95299999999999996,"15min":0.89100000000000001},"min":{"1min":0.26900000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.747,"5min":8.7249999999999996,"15min":17.856000000000002},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":1.1619999999999999,"15min":1.0029999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.26900000000000002},"max":{"1min":0.77700000000000002,"5min":8.9269999999999996,"15min":17.827999999999999},"last":0.40999999999999998}]},{"osd":7,"last update":"Wed May 8 21:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":1.1739999999999999,"15min":0.92900000000000005},"min":{"1min":0.311,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.98499999999999999,"5min":11.183999999999999,"15min":18.079000000000001},"last":0.371},{"interface":"front","average":{"1min":0.73499999999999999,"5min":1.464,"15min":1.1659999999999999},"min":{"1min":0.30599999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":4.8819999999999997,"5min":13.496,"15min":30.050000000000001},"last":0.39300000000000002}]}]},{"osd":0,"up_from":14,"seq":60129542265,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1273124,"kb_used_data":511068,"kb_used_omap":1,"kb_used_meta":762046,"kb_avail":93098716,"statfs":{"total":96636764160,"available":95333085184,"internally_reserved":0,"allocated":523333632,"data_stored":837461602,"data_compressed":50494929,"data_compressed_allocated":155848704,"data_compressed_original":470188032,"omap_allocated":1594,"internal_metadata":780335558},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 8 21:19:14 2024","interfaces":[{"interface":"back","average":{"1min":3.8900000000000001,"5min":2.9590000000000001,"15min":1.925},"min":{"1min":0.193,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":24.199999999999999,"5min":24.199999999999999,"15min":98.899000000000001},"last":2.4279999999999999},{"interface":"front","average":{"1min":2.4420000000000002,"5min":2.8100000000000001,"15min":1.6519999999999999},"min":{"1min":0.24199999999999999,"5min":0.185,"15min":0.185},"max":{"1min":13.778,"5min":25.295999999999999,"15min":39.594000000000001},"last":1.9390000000000001}]},{"osd":2,"last update":"Wed May 8 21:19:14 2024","interfaces":[{"interface":"back","average":{"1min":3.2759999999999998,"5min":2.4390000000000001,"15min":1.6479999999999999},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.224},"max":{"1min":21.695,"5min":27.657,"15min":33.238999999999997},"last":0.25600000000000001},{"interface":"front","average":{"1min":1.7949999999999999,"5min":1.8240000000000001,"15min":1.0800000000000001},"min":{"1min":0.26500000000000001,"5min":0.22500000000000001,"15min":0.223},"max":{"1min":17.302,"5min":27.027000000000001,"15min":27.027000000000001},"last":0.218}]},{"osd":3,"last update":"Wed May 8 21:19:14 2024","interfaces":[{"interface":"back","average":{"1min":1.7090000000000001,"5min":2.9100000000000001,"15min":2.1909999999999998},"min":{"1min":0.28499999999999998,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":17.355,"5min":30.341999999999999,"15min":77.010999999999996},"last":1.9750000000000001},{"interface":"front","average":{"1min":1.879,"5min":2.069,"15min":1.653},"min":{"1min":0.33400000000000002,"5min":0.29199999999999998,"15min":0.28899999999999998},"max":{"1min":17.271000000000001,"5min":29.155999999999999,"15min":93.995999999999995},"last":2.464}]},{"osd":4,"last update":"Wed May 8 21:19:14 2024","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":2.0990000000000002,"15min":1.7330000000000001},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":6.8259999999999996,"5min":27.513999999999999,"15min":33.121000000000002},"last":0.53100000000000003},{"interface":"front","average":{"1min":1.196,"5min":2.149,"15min":1.474},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":9.1869999999999994,"5min":27.48,"15min":27.48},"last":5.1340000000000003}]},{"osd":5,"last update":"Wed May 8 21:19:14 2024","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":2.1440000000000001,"15min":1.5009999999999999},"min":{"1min":0.32100000000000001,"5min":0.311,"15min":0.311},"max":{"1min":7.3339999999999996,"5min":13.412000000000001,"15min":29.919},"last":6.4020000000000001},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.923,"15min":1.714},"min":{"1min":0.34100000000000003,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":9.3979999999999997,"5min":20.626999999999999,"15min":33.209000000000003},"last":5.1799999999999997}]},{"osd":6,"last update":"Wed May 8 21:19:14 2024","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":1.738,"15min":1.4159999999999999},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":7.702,"5min":11.276999999999999,"15min":19.527999999999999},"last":6.4279999999999999},{"interface":"front","average":{"1min":1.599,"5min":2.2690000000000001,"15min":1.4390000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":9.2219999999999995,"5min":15.829000000000001,"15min":29.800000000000001},"last":5.1630000000000003}]},{"osd":7,"last update":"Wed May 8 21:19:14 2024","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":2.0179999999999998,"15min":1.639},"min":{"1min":0.35699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":8.952,"5min":11.372999999999999,"15min":33.174999999999997},"last":0.62},{"interface":"front","average":{"1min":1.0089999999999999,"5min":2.351,"15min":1.4690000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":4.7450000000000001,"5min":21.097999999999999,"15min":21.097999999999999},"last":0.63500000000000001}]}]},{"osd":7,"up_from":14,"seq":60129542265,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1245688,"kb_used_data":383856,"kb_used_omap":1,"kb_used_meta":860350,"kb_avail":93126152,"statfs":{"total":96636764160,"available":95361179648,"internally_reserved":0,"allocated":393068544,"data_stored":644222368,"data_compressed":39380739,"data_compressed_allocated":120668160,"data_compressed_original":372027392,"omap_allocated":1589,"internal_metadata":880998859},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:19:08 2024","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":2.21,"15min":1.1799999999999999},"min":{"1min":0.217,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":10.747999999999999,"5min":20.876999999999999,"15min":20.876999999999999},"last":0.26800000000000002},{"interface":"front","average":{"1min":1.343,"5min":2.1579999999999999,"15min":1.4730000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":4.0570000000000004,"5min":23.748999999999999,"15min":62.033000000000001},"last":1.5129999999999999}]},{"osd":1,"last update":"Wed May 8 21:19:17 2024","interfaces":[{"interface":"back","average":{"1min":1.9350000000000001,"5min":2.8330000000000002,"15min":2.04},"min":{"1min":0.251,"5min":0.251,"15min":0.246},"max":{"1min":23.103999999999999,"5min":44.164000000000001,"15min":44.645000000000003},"last":2.2280000000000002},{"interface":"front","average":{"1min":1.7050000000000001,"5min":2.395,"15min":1.3720000000000001},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":8.3339999999999996,"5min":44.091000000000001,"15min":44.091000000000001},"last":16.209}]},{"osd":2,"last update":"Wed May 8 21:19:08 2024","interfaces":[{"interface":"back","average":{"1min":2.3740000000000001,"5min":2.0870000000000002,"15min":1.131},"min":{"1min":0.34599999999999997,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":11.388999999999999,"5min":15.986000000000001,"15min":15.986000000000001},"last":1.4139999999999999},{"interface":"front","average":{"1min":2.121,"5min":1.833,"15min":1.028},"min":{"1min":0.45000000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":9.3949999999999996,"5min":11.112,"15min":11.112},"last":1.4410000000000001}]},{"osd":3,"last update":"Wed May 8 21:19:08 2024","interfaces":[{"interface":"back","average":{"1min":2.3969999999999998,"5min":3.1320000000000001,"15min":1.5880000000000001},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":9.8789999999999996,"5min":44.064999999999998,"15min":44.064999999999998},"last":2.415},{"interface":"front","average":{"1min":1.7649999999999999,"5min":2.661,"15min":1.7050000000000001},"min":{"1min":0.379,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":15.789,"5min":44.607999999999997,"15min":44.607999999999997},"last":2.3029999999999999}]},{"osd":4,"last update":"Wed May 8 21:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":1.0549999999999999,"15min":0.82699999999999996},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":3.1850000000000001,"5min":10.51,"15min":21.338000000000001},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.80200000000000005,"5min":1.302,"15min":0.94799999999999995},"min":{"1min":0.27900000000000003,"5min":0.216,"15min":0.216},"max":{"1min":3.242,"5min":16.082999999999998,"15min":22.827000000000002},"last":0.29799999999999999}]},{"osd":5,"last update":"Wed May 8 21:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.079,"15min":0.85299999999999998},"min":{"1min":0.28899999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":10.785,"5min":10.785,"15min":10.880000000000001},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.60899999999999999,"5min":1.026,"15min":0.84699999999999998},"min":{"1min":0.32700000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.613,"5min":7.4939999999999998,"15min":8.157},"last":0.36699999999999999}]},{"osd":6,"last update":"Wed May 8 21:19:17 2024","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.2909999999999999,"15min":0.86099999999999999},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":12.433,"5min":12.433,"15min":12.433},"last":0.32100000000000001},{"interface":"front","average":{"1min":1.252,"5min":1.546,"15min":1.052},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":12.182,"5min":19.864999999999998,"15min":19.864999999999998},"last":0.38500000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574968,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1245820,"kb_used_data":520372,"kb_used_omap":1,"kb_used_meta":725438,"kb_avail":93126020,"statfs":{"total":96636764160,"available":95361044480,"internally_reserved":0,"allocated":532860928,"data_stored":864867558,"data_compressed":51795822,"data_compressed_allocated":157683712,"data_compressed_original":489885696,"omap_allocated":1594,"internal_metadata":742848966},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,2,2,2,1,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:19:12 2024","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":2.6640000000000001,"15min":1.5049999999999999},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.20399999999999999},"max":{"1min":7.3049999999999997,"5min":17.789000000000001,"15min":24.859999999999999},"last":17.690000000000001},{"interface":"front","average":{"1min":1.486,"5min":2.1960000000000002,"15min":1.3759999999999999},"min":{"1min":0.27200000000000002,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":7.4560000000000004,"5min":17.835999999999999,"15min":49.606000000000002},"last":11.759}]},{"osd":1,"last update":"Wed May 8 21:19:12 2024","interfaces":[{"interface":"back","average":{"1min":3.0430000000000001,"5min":2.6960000000000002,"15min":1.7470000000000001},"min":{"1min":0.26500000000000001,"5min":0.218,"15min":0.19800000000000001},"max":{"1min":24.321999999999999,"5min":25.135999999999999,"15min":55.296999999999997},"last":9.5289999999999999},{"interface":"front","average":{"1min":2.706,"5min":2.4990000000000001,"15min":1.7090000000000001},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":24.149999999999999,"5min":24.149999999999999,"15min":79.221000000000004},"last":3.117}]},{"osd":3,"last update":"Wed May 8 21:19:12 2024","interfaces":[{"interface":"back","average":{"1min":2.1440000000000001,"5min":4.8819999999999997,"15min":2.1600000000000001},"min":{"1min":0.32000000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":7.7510000000000003,"5min":69.888000000000005,"15min":69.888000000000005},"last":0.82899999999999996},{"interface":"front","average":{"1min":2.1829999999999998,"5min":4.931,"15min":2.198},"min":{"1min":0.33900000000000002,"5min":0.30199999999999999,"15min":0.23699999999999999},"max":{"1min":7.7850000000000001,"5min":69.959000000000003,"15min":69.959000000000003},"last":1.4159999999999999}]},{"osd":4,"last update":"Wed May 8 21:19:12 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":1.8979999999999999,"15min":1.4319999999999999},"min":{"1min":0.34999999999999998,"5min":0.253,"15min":0.253},"max":{"1min":2.2170000000000001,"5min":17.716999999999999,"15min":32.457999999999998},"last":0.33700000000000002},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.823,"15min":1.171},"min":{"1min":0.25700000000000001,"5min":0.255,"15min":0.255},"max":{"1min":7.3940000000000001,"5min":13.827,"15min":18.315000000000001},"last":0.28299999999999997}]},{"osd":5,"last update":"Wed May 8 21:19:12 2024","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.655,"15min":1.079},"min":{"1min":0.38500000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":4.4219999999999997,"5min":17.507999999999999,"15min":17.507999999999999},"last":1.4430000000000001},{"interface":"front","average":{"1min":0.72399999999999998,"5min":2.6200000000000001,"15min":1.6200000000000001},"min":{"1min":0.30299999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.744,"5min":48.560000000000002,"15min":48.560000000000002},"last":0.318}]},{"osd":6,"last update":"Wed May 8 21:19:12 2024","interfaces":[{"interface":"back","average":{"1min":1.4770000000000001,"5min":1.911,"15min":1.246},"min":{"1min":0.39300000000000002,"5min":0.308,"15min":0.308},"max":{"1min":7.4290000000000003,"5min":13.933999999999999,"15min":16.399999999999999},"last":0.30199999999999999},{"interface":"front","average":{"1min":1.196,"5min":1.9970000000000001,"15min":1.2909999999999999},"min":{"1min":0.46800000000000003,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":4.4649999999999999,"5min":17.536000000000001,"15min":23.216000000000001},"last":1.381}]},{"osd":7,"last update":"Wed May 8 21:19:12 2024","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.9750000000000001,"15min":1.2929999999999999},"min":{"1min":0.42499999999999999,"5min":0.33200000000000002,"15min":0.33000000000000002},"max":{"1min":4.492,"5min":11.041,"15min":16.366},"last":1.4710000000000001},{"interface":"front","average":{"1min":1.6499999999999999,"5min":1.7509999999999999,"15min":1.1439999999999999},"min":{"1min":0.46200000000000002,"5min":0.313,"15min":0.313},"max":{"1min":7.4820000000000002,"5min":13.903,"15min":13.903},"last":1.494}]}]},{"osd":3,"up_from":14,"seq":60129542261,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1811820,"kb_used_data":588812,"kb_used_omap":1,"kb_used_meta":1221822,"kb_avail":92560020,"statfs":{"total":96636764160,"available":94781460480,"internally_reserved":0,"allocated":602943488,"data_stored":976287622,"data_compressed":58864613,"data_compressed_allocated":181178368,"data_compressed_original":554725376,"omap_allocated":1592,"internal_metadata":1251146184},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,1,2,5,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:19:20 2024","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":2.9950000000000001,"15min":1.3879999999999999},"min":{"1min":0.24299999999999999,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":7.2930000000000001,"5min":39.801000000000002,"15min":39.801000000000002},"last":5.5},{"interface":"front","average":{"1min":1.3049999999999999,"5min":2.0680000000000001,"15min":1.7569999999999999},"min":{"1min":0.26000000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":10.782,"5min":14.497,"15min":60.847999999999999},"last":5.5170000000000003}]},{"osd":1,"last update":"Wed May 8 21:19:20 2024","interfaces":[{"interface":"back","average":{"1min":2.5249999999999999,"5min":3.3759999999999999,"15min":1.851},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":15.603,"5min":47.418999999999997,"15min":57.020000000000003},"last":5.5519999999999996},{"interface":"front","average":{"1min":4.6790000000000003,"5min":4.5030000000000001,"15min":2.0070000000000001},"min":{"1min":0.26300000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":29.669,"5min":43.317,"15min":43.317},"last":14.468999999999999}]},{"osd":2,"last update":"Wed May 8 21:19:20 2024","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.714,"15min":1.105},"min":{"1min":0.32000000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":10.712999999999999,"5min":10.938000000000001,"15min":32.247999999999998},"last":5.4649999999999999},{"interface":"front","average":{"1min":1.5029999999999999,"5min":3.1099999999999999,"15min":1.5780000000000001},"min":{"1min":0.33300000000000002,"5min":0.31,"15min":0.26200000000000001},"max":{"1min":7.2030000000000003,"5min":39.386000000000003,"15min":39.386000000000003},"last":0.67400000000000004}]},{"osd":4,"last update":"Wed May 8 21:19:20 2024","interfaces":[{"interface":"back","average":{"1min":1.446,"5min":1.6639999999999999,"15min":1.639},"min":{"1min":0.39300000000000002,"5min":0.309,"15min":0.309},"max":{"1min":10.755000000000001,"5min":10.755000000000001,"15min":58.072000000000003},"last":5.569},{"interface":"front","average":{"1min":1.387,"5min":2.3650000000000002,"15min":1.367},"min":{"1min":0.46700000000000003,"5min":0.314,"15min":0.314},"max":{"1min":7.2430000000000003,"5min":15.712,"15min":26.311},"last":5.4470000000000001}]},{"osd":5,"last update":"Wed May 8 21:19:20 2024","interfaces":[{"interface":"back","average":{"1min":1.5760000000000001,"5min":1.786,"15min":1.6200000000000001},"min":{"1min":0.438,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":10.842000000000001,"5min":14.584,"15min":60.375999999999998},"last":5.5430000000000001},{"interface":"front","average":{"1min":1.4139999999999999,"5min":2.9359999999999999,"15min":1.6080000000000001},"min":{"1min":0.45500000000000002,"5min":0.31,"15min":0.31},"max":{"1min":7.2679999999999998,"5min":39.274000000000001,"15min":39.274000000000001},"last":0.69599999999999995}]},{"osd":6,"last update":"Wed May 8 21:19:20 2024","interfaces":[{"interface":"back","average":{"1min":2.9710000000000001,"5min":3.452,"15min":1.8580000000000001},"min":{"1min":0.34499999999999997,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":30.25,"5min":30.25,"15min":30.25},"last":4.8330000000000002},{"interface":"front","average":{"1min":1.6499999999999999,"5min":3.4319999999999999,"15min":1.861},"min":{"1min":0.48099999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":11.914,"5min":41.323999999999998,"15min":41.323999999999998},"last":5.5279999999999996}]},{"osd":7,"last update":"Wed May 8 21:19:20 2024","interfaces":[{"interface":"back","average":{"1min":2.907,"5min":3.5510000000000002,"15min":1.829},"min":{"1min":0.40100000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":30.295000000000002,"5min":30.295000000000002,"15min":30.295000000000002},"last":4.8680000000000003},{"interface":"front","average":{"1min":3.0310000000000001,"5min":3.9180000000000001,"15min":2.0110000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":30.201000000000001,"5min":30.201000000000001,"15min":30.201000000000001},"last":8.25}]}]},{"osd":1,"up_from":15,"seq":64424509558,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1812528,"kb_used_data":663848,"kb_used_omap":1,"kb_used_meta":1148670,"kb_avail":92559312,"statfs":{"total":96636764160,"available":94780735488,"internally_reserved":0,"allocated":679780352,"data_stored":1092003355,"data_compressed":65660496,"data_compressed_allocated":202670080,"data_compressed_original":615096320,"omap_allocated":1594,"internal_metadata":1176238534},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,1,3,3,2,2,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":2.2400000000000002,"15min":1.653},"min":{"1min":0.22800000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.77300000000000002,"5min":16.692,"15min":68.346999999999994},"last":1.623},{"interface":"front","average":{"1min":0.97399999999999998,"5min":2.5630000000000002,"15min":1.486},"min":{"1min":0.22,"5min":0.21199999999999999,"15min":0.19800000000000001},"max":{"1min":6.6589999999999998,"5min":16.875,"15min":25.786000000000001},"last":1.5}]},{"osd":2,"last update":"Wed May 8 21:19:16 2024","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":2.552,"15min":2.2440000000000002},"min":{"1min":0.22700000000000001,"5min":0.191,"15min":0.191},"max":{"1min":7.5350000000000001,"5min":18.373000000000001,"15min":70.688000000000002},"last":9.8689999999999998},{"interface":"front","average":{"1min":1.151,"5min":2.0419999999999998,"15min":1.796},"min":{"1min":0.25600000000000001,"5min":0.22800000000000001,"15min":0.219},"max":{"1min":9.0779999999999994,"5min":14.207000000000001,"15min":35.401000000000003},"last":6.8650000000000002}]},{"osd":3,"last update":"Wed May 8 21:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":2.3690000000000002,"15min":1.599},"min":{"1min":0.26600000000000001,"5min":0.224,"15min":0.224},"max":{"1min":6.4299999999999997,"5min":14.621,"15min":35.658000000000001},"last":9.7759999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":1.96,"15min":1.6200000000000001},"min":{"1min":0.316,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":2.5609999999999999,"5min":14.189,"15min":27.207999999999998},"last":1.5449999999999999}]},{"osd":4,"last update":"Wed May 8 21:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":1.8580000000000001,"15min":1.4830000000000001},"min":{"1min":0.34999999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":2.5209999999999999,"5min":16.561,"15min":43.401000000000003},"last":1.46},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.9550000000000001,"15min":1.351},"min":{"1min":0.37,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":6.702,"5min":10.372999999999999,"15min":27.239000000000001},"last":1.5700000000000001}]},{"osd":5,"last update":"Wed May 8 21:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":2.2040000000000002,"15min":1.7509999999999999},"min":{"1min":0.36199999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.1399999999999999,"5min":18.241,"15min":43.515000000000001},"last":1.5249999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":1.8620000000000001,"15min":1.633},"min":{"1min":0.40500000000000003,"5min":0.34899999999999998,"15min":0.32300000000000001},"max":{"1min":0.80300000000000005,"5min":19.843,"15min":27.352},"last":1.516}]},{"osd":6,"last update":"Wed May 8 21:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":2.6589999999999998,"15min":1.748},"min":{"1min":0.34300000000000003,"5min":0.307,"15min":0.307},"max":{"1min":1.1879999999999999,"5min":18.268999999999998,"15min":43.472999999999999},"last":1.5629999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":1.9319999999999999,"15min":1.425},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35499999999999998},"max":{"1min":2.4710000000000001,"5min":16.155000000000001,"15min":27.376999999999999},"last":1.599}]},{"osd":7,"last update":"Wed May 8 21:19:16 2024","interfaces":[{"interface":"back","average":{"1min":1.544,"5min":2.5390000000000001,"15min":1.9910000000000001},"min":{"1min":0.39000000000000001,"5min":0.315,"15min":0.315},"max":{"1min":6.7309999999999999,"5min":13.484999999999999,"15min":68.287999999999997},"last":6.9189999999999996},{"interface":"front","average":{"1min":0.95599999999999996,"5min":1.8280000000000001,"15min":1.6000000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":4.2450000000000001,"5min":13.592000000000001,"15min":27.312999999999999},"last":4.6980000000000004}]}]},{"osd":4,"up_from":15,"seq":64424509560,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1304900,"kb_used_data":371708,"kb_used_omap":1,"kb_used_meta":933182,"kb_avail":93066940,"statfs":{"total":96636764160,"available":95300546560,"internally_reserved":0,"allocated":380628992,"data_stored":626087417,"data_compressed":38469211,"data_compressed_allocated":118784000,"data_compressed_original":364449792,"omap_allocated":1593,"internal_metadata":955578823},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1,0,1,0,1,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:19:19 2024","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.5580000000000001,"15min":1.0549999999999999},"min":{"1min":0.28299999999999997,"5min":0.218,"15min":0.218},"max":{"1min":7.6849999999999996,"5min":20.606999999999999,"15min":20.606999999999999},"last":12.94},{"interface":"front","average":{"1min":1.7769999999999999,"5min":2.7770000000000001,"15min":1.758},"min":{"1min":0.316,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":18.945,"5min":45.499000000000002,"15min":45.499000000000002},"last":0.23799999999999999}]},{"osd":1,"last update":"Wed May 8 21:19:19 2024","interfaces":[{"interface":"back","average":{"1min":2.4870000000000001,"5min":5.0439999999999996,"15min":2.5},"min":{"1min":0.28100000000000003,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":18.905999999999999,"5min":273.69299999999998,"15min":273.69299999999998},"last":11.542},{"interface":"front","average":{"1min":1.0409999999999999,"5min":4.907,"15min":3.069},"min":{"1min":0.35499999999999998,"5min":0.28699999999999998,"15min":0.26200000000000001},"max":{"1min":5.2290000000000001,"5min":281.21699999999998,"15min":281.21699999999998},"last":11.993}]},{"osd":2,"last update":"Wed May 8 21:19:19 2024","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.8089999999999999,"15min":1.395},"min":{"1min":0.26200000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":7.4119999999999999,"5min":46.542000000000002,"15min":96.177999999999997},"last":3.1160000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":1.415,"15min":1.361},"min":{"1min":0.35399999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.7070000000000001,"5min":16.183,"15min":94.947000000000003},"last":0.45200000000000001}]},{"osd":3,"last update":"Wed May 8 21:19:19 2024","interfaces":[{"interface":"back","average":{"1min":1.8999999999999999,"5min":2.3540000000000001,"15min":1.429},"min":{"1min":0.33500000000000002,"5min":0.245,"15min":0.23899999999999999},"max":{"1min":18.632000000000001,"5min":18.632000000000001,"15min":30.596},"last":11.496},{"interface":"front","average":{"1min":1.111,"5min":3.4340000000000002,"15min":1.804},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":5.2089999999999996,"5min":42.969000000000001,"15min":42.969000000000001},"last":3.3410000000000002}]},{"osd":5,"last update":"Wed May 8 21:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":1.7669999999999999,"15min":1.129},"min":{"1min":0.29499999999999998,"5min":0.252,"15min":0.221},"max":{"1min":1.714,"5min":46.488999999999997,"15min":46.488999999999997},"last":4.7640000000000002},{"interface":"front","average":{"1min":0.877,"5min":1.6899999999999999,"15min":0.98599999999999999},"min":{"1min":0.37,"5min":0.28000000000000003,"15min":0.26200000000000001},"max":{"1min":4.9320000000000004,"5min":45.445999999999998,"15min":45.445999999999998},"last":1.859}]},{"osd":6,"last update":"Wed May 8 21:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":1.869,"15min":1.1439999999999999},"min":{"1min":0.29699999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.6839999999999999,"5min":35.289999999999999,"15min":35.289999999999999},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":2.145,"15min":1.5029999999999999},"min":{"1min":0.371,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.351,"5min":46.576999999999998,"15min":46.576999999999998},"last":4.0910000000000002}]},{"osd":7,"last update":"Wed May 8 21:19:19 2024","interfaces":[{"interface":"back","average":{"1min":1.5980000000000001,"5min":1.9430000000000001,"15min":1.1259999999999999},"min":{"1min":0.36099999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":19.077999999999999,"5min":19.077999999999999,"15min":19.077999999999999},"last":0.438},{"interface":"front","average":{"1min":2.4390000000000001,"5min":1.6319999999999999,"15min":1.0489999999999999},"min":{"1min":0.32300000000000001,"5min":0.30299999999999999,"15min":0.28000000000000003},"max":{"1min":31.617999999999999,"5min":31.617999999999999,"15min":31.617999999999999},"last":0.48699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32306,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32306,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1581056,"data_stored":3158475,"data_compressed":328373,"data_compressed_allocated":425984,"data_compressed_original":2015232,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":94059,"data_compressed":4766,"data_compressed_allocated":8192,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5066752,"data_stored":8483339,"data_compressed":770600,"data_compressed_allocated":995328,"data_compressed_original":4419584,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2256896,"data_stored":4194430,"data_compressed":367613,"data_compressed_allocated":532480,"data_compressed_original":2482176,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1589248,"data_stored":4194976,"data_compressed":576533,"data_compressed_allocated":724992,"data_compressed_original":3338240,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7221248,"data_stored":11548165,"data_compressed":885287,"data_compressed_allocated":1220608,"data_compressed_original":5554176,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":482086912,"data_stored":772747264,"data_compressed":46560604,"data_compressed_allocated":144330752,"data_compressed_original":434991104,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":619642880,"data_stored":1001676800,"data_compressed":60380065,"data_compressed_allocated":186576896,"data_compressed_original":568610816,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":532439040,"data_stored":864624640,"data_compressed":51791056,"data_compressed_allocated":157675520,"data_compressed_original":489861120,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":597532672,"data_stored":967655424,"data_compressed":58094013,"data_compressed_allocated":180183040,"data_compressed_original":550305792,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":341811200,"data_stored":565121024,"data_compressed":34767024,"data_compressed_allocated":108322816,"data_compressed_original":331632640,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":390811648,"data_stored":636235776,"data_compressed":38654705,"data_compressed_allocated":119525376,"data_compressed_original":364949504,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":367538176,"data_stored":617414656,"data_compressed":38390940,"data_compressed_allocated":119353344,"data_compressed_original":369229824,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":373923840,"data_stored":615157760,"data_compressed":37572296,"data_compressed_allocated":116301824,"data_compressed_original":357535744,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T21:19:50.868 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-08T21:19:50.868 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T21:19:52.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.334+0000 7efdbd924700 1 Processor -- start 2024-05-08T21:19:52.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.334+0000 7efdbd924700 1 -- start start 2024-05-08T21:19:52.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.335+0000 7efdbd924700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efdb8158800 0x7efdb81623f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:52.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.335+0000 7efdbd924700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efdb806f4f0 0x7efdb806a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:52.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.336+0000 7efdbd924700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdb8162930 con 0x7efdb806af00 2024-05-08T21:19:52.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.336+0000 7efdbd924700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdb815fab0 con 0x7efdb806f4f0 2024-05-08T21:19:52.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.336+0000 7efdbd924700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdb8073590 con 0x7efdb8158800 2024-05-08T21:19:52.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.340+0000 7efdb77fe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7efdb806af00 0x7efdb815fed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46468/0 (socket says 172.21.15.80:46468) 2024-05-08T21:19:52.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.340+0000 7efdb77fe700 1 -- 172.21.15.80:0/3095830245 learned_addr learned my addr 172.21.15.80:0/3095830245 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:19:52.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.340+0000 7efdb5ffb700 1 -- 172.21.15.80:0/3095830245 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4031455854 0 0) 0x7efdb8162930 con 0x7efdb806af00 2024-05-08T21:19:52.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.340+0000 7efdb5ffb700 1 -- 172.21.15.80:0/3095830245 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efda00035b0 con 0x7efdb806af00 2024-05-08T21:19:52.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.345+0000 7efdb67fc700 1 --2- 172.21.15.80:0/3095830245 >> v2:172.21.15.80:3300/0 conn(0x7efdb806f4f0 0x7efdb806a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:52.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.345+0000 7efdb67fc700 1 -- 172.21.15.80:0/3095830245 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efdb8158800 msgr2=0x7efdb81623f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T21:19:52.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.345+0000 7efdb67fc700 1 --2- 172.21.15.80:0/3095830245 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efdb8158800 0x7efdb81623f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:52.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.345+0000 7efdb67fc700 1 -- 172.21.15.80:0/3095830245 >> v1:172.21.15.80:6789/0 conn(0x7efdb806af00 legacy=0x7efdb815fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:52.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.345+0000 7efdb67fc700 1 -- 172.21.15.80:0/3095830245 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb806fe00 con 0x7efdb806f4f0 2024-05-08T21:19:52.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.345+0000 7efdb67fc700 1 --2- 172.21.15.80:0/3095830245 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efdb806f4f0 0x7efdb806a9c0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7efdac009840 tx=0x7efdac009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84b42013087d5228 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:52.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.347+0000 7efdb5ffb700 1 -- 172.21.15.80:0/3095830245 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb00019f0 con 0x7efdb806f4f0 2024-05-08T21:19:52.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.347+0000 7efdb5ffb700 1 -- 172.21.15.80:0/3095830245 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdac004030 con 0x7efdb806f4f0 2024-05-08T21:19:52.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.347+0000 7efdb5ffb700 1 -- 172.21.15.80:0/3095830245 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdac0043c0 con 0x7efdb806f4f0 2024-05-08T21:19:52.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.348+0000 7efdbd924700 1 -- 172.21.15.80:0/3095830245 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efdb806f4f0 msgr2=0x7efdb806a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:52.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.348+0000 7efdbd924700 1 --2- 172.21.15.80:0/3095830245 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efdb806f4f0 0x7efdb806a9c0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7efdac009840 tx=0x7efdac009b50 comp rx=0 tx=0).stop 2024-05-08T21:19:52.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.348+0000 7efdbd924700 1 -- 172.21.15.80:0/3095830245 shutdown_connections 2024-05-08T21:19:52.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.348+0000 7efdbd924700 1 --2- 172.21.15.80:0/3095830245 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efdb8158800 0x7efdb81623f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:52.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.348+0000 7efdbd924700 1 --2- 172.21.15.80:0/3095830245 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efdb806f4f0 0x7efdb806a9c0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:52.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.348+0000 7efdbd924700 1 -- 172.21.15.80:0/3095830245 >> 172.21.15.80:0/3095830245 conn(0x7efdb806bad0 msgr2=0x7efdb806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:52.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.348+0000 7efdbd924700 1 -- 172.21.15.80:0/3095830245 shutdown_connections 2024-05-08T21:19:52.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.348+0000 7efdbd924700 1 -- 172.21.15.80:0/3095830245 wait complete. 2024-05-08T21:19:52.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.350+0000 7efdbd924700 1 Processor -- start 2024-05-08T21:19:52.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.350+0000 7efdbd924700 1 -- start start 2024-05-08T21:19:52.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.351+0000 7efdbd924700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efdb806af00 0x7efdb80c61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:52.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.351+0000 7efdbd924700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efdb806f4f0 0x7efdb814f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:52.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.351+0000 7efdbd924700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efdb8158800 0x7efdb814d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:52.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.351+0000 7efdbd924700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb8151340 con 0x7efdb806af00 2024-05-08T21:19:52.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.351+0000 7efdbd924700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb814f7f0 con 0x7efdb806f4f0 2024-05-08T21:19:52.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.351+0000 7efdbd924700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdb814dc50 con 0x7efdb8158800 2024-05-08T21:19:52.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.351+0000 7efdb77fe700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efdb8158800 0x7efdb814d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:52.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.352+0000 7efdb77fe700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efdb8158800 0x7efdb814d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:50524/0 (socket says 172.21.15.80:50524) 2024-05-08T21:19:52.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.352+0000 7efdb77fe700 1 -- 172.21.15.80:0/288150317 learned_addr learned my addr 172.21.15.80:0/288150317 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:19:52.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.352+0000 7efdb67fc700 1 --2- 172.21.15.80:0/288150317 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efdb806f4f0 0x7efdb814f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:52.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.352+0000 7efdb6ffd700 1 --2- 172.21.15.80:0/288150317 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efdb806af00 0x7efdb80c61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:52.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.352+0000 7efdb6ffd700 1 -- 172.21.15.80:0/288150317 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efdb8158800 msgr2=0x7efdb814d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:52.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.352+0000 7efdb6ffd700 1 --2- 172.21.15.80:0/288150317 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efdb8158800 0x7efdb814d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:52.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.352+0000 7efdb6ffd700 1 -- 172.21.15.80:0/288150317 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efdb806f4f0 msgr2=0x7efdb814f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:52.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.352+0000 7efdb6ffd700 1 --2- 172.21.15.80:0/288150317 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efdb806f4f0 0x7efdb814f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:52.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.352+0000 7efdb6ffd700 1 -- 172.21.15.80:0/288150317 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdac0094a0 con 0x7efdb806af00 2024-05-08T21:19:52.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.353+0000 7efdb6ffd700 1 --2- 172.21.15.80:0/288150317 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efdb806af00 0x7efdb80c61f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7efda8006fd0 tx=0x7efda800b730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:52.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.356+0000 7efd9ffff700 1 -- 172.21.15.80:0/288150317 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda8011830 con 0x7efdb806af00 2024-05-08T21:19:52.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.356+0000 7efd9ffff700 1 -- 172.21.15.80:0/288150317 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efda8011990 con 0x7efdb806af00 2024-05-08T21:19:52.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.356+0000 7efd9ffff700 1 -- 172.21.15.80:0/288150317 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda8011d00 con 0x7efdb806af00 2024-05-08T21:19:52.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.356+0000 7efdbd924700 1 -- 172.21.15.80:0/288150317 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdb8150dc0 con 0x7efdb806af00 2024-05-08T21:19:52.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.356+0000 7efdbd924700 1 -- 172.21.15.80:0/288150317 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdb8150750 con 0x7efdb806af00 2024-05-08T21:19:52.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.364+0000 7efd9ffff700 1 -- 172.21.15.80:0/288150317 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7efda801a410 con 0x7efdb806af00 2024-05-08T21:19:52.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.364+0000 7efd9ffff700 1 --2- 172.21.15.80:0/288150317 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7efda406ad90 0x7efda406d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:52.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.364+0000 7efd9ffff700 1 -- 172.21.15.80:0/288150317 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7007+0+0 (secure 0 0 0) 0x7efda80892b0 con 0x7efdb806af00 2024-05-08T21:19:52.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.365+0000 7efdb67fc700 1 --2- 172.21.15.80:0/288150317 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7efda406ad90 0x7efda406d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:52.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.365+0000 7efdb67fc700 1 --2- 172.21.15.80:0/288150317 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7efda406ad90 0x7efda406d250 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7efdac00a010 tx=0x7efdac008000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:52.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.366+0000 7efdbd924700 1 -- 172.21.15.80:0/288150317 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdb806f220 con 0x7efdb806af00 2024-05-08T21:19:52.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.384+0000 7efd9ffff700 1 -- 172.21.15.80:0/288150317 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7efda8053ed0 con 0x7efdb806af00 2024-05-08T21:19:52.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.819+0000 7efdbd924700 1 -- 172.21.15.80:0/288150317 --> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efdb815edb0 con 0x7efda406ad90 2024-05-08T21:19:52.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.841+0000 7efd9ffff700 1 -- 172.21.15.80:0/288150317 <== mgr.4100 v2:172.21.15.80:6832/46731 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+370693 (secure 0 0 0) 0x7efdac021070 con 0x7efda406ad90 2024-05-08T21:19:52.852 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:19:52.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.864+0000 7efdbd924700 1 -- 172.21.15.80:0/288150317 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7efda406ad90 msgr2=0x7efda406d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:52.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.864+0000 7efdbd924700 1 --2- 172.21.15.80:0/288150317 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7efda406ad90 0x7efda406d250 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7efdac00a010 tx=0x7efdac008000 comp rx=0 tx=0).stop 2024-05-08T21:19:52.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.864+0000 7efdbd924700 1 -- 172.21.15.80:0/288150317 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efdb806af00 msgr2=0x7efdb80c61f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:52.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.864+0000 7efdbd924700 1 --2- 172.21.15.80:0/288150317 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efdb806af00 0x7efdb80c61f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7efda8006fd0 tx=0x7efda800b730 comp rx=0 tx=0).stop 2024-05-08T21:19:52.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.865+0000 7efdbd924700 1 -- 172.21.15.80:0/288150317 shutdown_connections 2024-05-08T21:19:52.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.865+0000 7efdbd924700 1 --2- 172.21.15.80:0/288150317 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7efda406ad90 0x7efda406d250 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:52.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.865+0000 7efdbd924700 1 --2- 172.21.15.80:0/288150317 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efdb806af00 0x7efdb80c61f0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:52.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.865+0000 7efdbd924700 1 --2- 172.21.15.80:0/288150317 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efdb8158800 0x7efdb814d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:52.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.865+0000 7efdbd924700 1 --2- 172.21.15.80:0/288150317 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efdb806f4f0 0x7efdb814f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:52.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.865+0000 7efdbd924700 1 -- 172.21.15.80:0/288150317 >> 172.21.15.80:0/288150317 conn(0x7efdb806bad0 msgr2=0x7efdb80c9550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:52.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.867+0000 7efdbd924700 1 -- 172.21.15.80:0/288150317 shutdown_connections 2024-05-08T21:19:52.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:52.867+0000 7efdbd924700 1 -- 172.21.15.80:0/288150317 wait complete. 2024-05-08T21:19:52.882 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-05-08T21:19:52.967 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":324,"stamp":"2024-05-08T21:19:52.501346+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2753690600,"num_objects":879,"num_object_clones":0,"num_object_copies":3442,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":879,"num_whiteouts":0,"num_read":2254,"num_read_kb":39820,"num_write":1716586,"num_write_kb":22166550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":135056,"ondisk_log_size":135056,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":10761300,"kb_used_data":3517864,"kb_used_omap":12,"kb_used_meta":7236595,"kb_avail":744213420,"statfs":{"total":773094113280,"available":762074542080,"internally_reserved":0,"allocated":3602292736,"data_stored":5867059826,"data_compressed":356585629,"data_compressed_allocated":1098715136,"data_compressed_original":3365109760,"omap_allocated":12743,"internal_metadata":7410273849},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,2,2,9,10,5,3,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":131,"apply_latency_ms":131,"commit_latency_ns":131000000,"apply_latency_ns":131000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6647635749,"num_objects":-1585,"num_object_clones":0,"num_object_copies":-6340,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1585,"num_whiteouts":0,"num_read":2,"num_read_kb":19,"num_write":1616,"num_write_kb":343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007561"},"pg_stats":[{"pgid":"3.3f","version":"29'5","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T21:18:28.723440+0000","last_change":"2024-05-08T21:10:03.747477+0000","last_active":"2024-05-08T21:18:28.723440+0000","last_peered":"2024-05-08T21:18:28.723440+0000","last_clean":"2024-05-08T21:18:28.723440+0000","last_became_active":"2024-05-08T21:10:03.747059+0000","last_became_peered":"2024-05-08T21:10:03.747059+0000","last_unstale":"2024-05-08T21:18:28.723440+0000","last_undegraded":"2024-05-08T21:18:28.723440+0000","last_fullsized":"2024-05-08T21:18:28.723440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:15:24.340135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"32'3","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.752000+0000","last_change":"2024-05-08T21:10:03.738974+0000","last_active":"2024-05-08T21:19:06.752000+0000","last_peered":"2024-05-08T21:19:06.752000+0000","last_clean":"2024-05-08T21:19:06.752000+0000","last_became_active":"2024-05-08T21:10:03.738466+0000","last_became_peered":"2024-05-08T21:10:03.738466+0000","last_unstale":"2024-05-08T21:19:06.752000+0000","last_undegraded":"2024-05-08T21:19:06.752000+0000","last_fullsized":"2024-05-08T21:19:06.752000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:59.683039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"32'8","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.754392+0000","last_change":"2024-05-08T21:10:03.740146+0000","last_active":"2024-05-08T21:19:06.754392+0000","last_peered":"2024-05-08T21:19:06.754392+0000","last_clean":"2024-05-08T21:19:06.754392+0000","last_became_active":"2024-05-08T21:10:03.739884+0000","last_became_peered":"2024-05-08T21:10:03.739884+0000","last_unstale":"2024-05-08T21:19:06.754392+0000","last_undegraded":"2024-05-08T21:19:06.754392+0000","last_fullsized":"2024-05-08T21:19:06.754392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:51:44.301305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"32'5","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:34.408287+0000","last_change":"2024-05-08T21:10:03.754159+0000","last_active":"2024-05-08T21:19:34.408287+0000","last_peered":"2024-05-08T21:19:34.408287+0000","last_clean":"2024-05-08T21:19:34.408287+0000","last_became_active":"2024-05-08T21:10:03.753800+0000","last_became_peered":"2024-05-08T21:10:03.753800+0000","last_unstale":"2024-05-08T21:19:34.408287+0000","last_undegraded":"2024-05-08T21:19:34.408287+0000","last_fullsized":"2024-05-08T21:19:34.408287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:41:02.625080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"32'6","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.751819+0000","last_change":"2024-05-08T21:10:03.750051+0000","last_active":"2024-05-08T21:19:06.751819+0000","last_peered":"2024-05-08T21:19:06.751819+0000","last_clean":"2024-05-08T21:19:06.751819+0000","last_became_active":"2024-05-08T21:10:03.749730+0000","last_became_peered":"2024-05-08T21:10:03.749730+0000","last_unstale":"2024-05-08T21:19:06.751819+0000","last_undegraded":"2024-05-08T21:19:06.751819+0000","last_fullsized":"2024-05-08T21:19:06.751819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:49.402253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"32'10","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:39.278858+0000","last_change":"2024-05-08T21:10:53.473952+0000","last_active":"2024-05-08T21:19:39.278858+0000","last_peered":"2024-05-08T21:19:39.278858+0000","last_clean":"2024-05-08T21:19:39.278858+0000","last_became_active":"2024-05-08T21:10:53.473632+0000","last_became_peered":"2024-05-08T21:10:53.473632+0000","last_unstale":"2024-05-08T21:19:39.278858+0000","last_undegraded":"2024-05-08T21:19:39.278858+0000","last_fullsized":"2024-05-08T21:19:39.278858+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:09.558205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"32'5","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:44.102438+0000","last_change":"2024-05-08T21:10:03.743802+0000","last_active":"2024-05-08T21:19:44.102438+0000","last_peered":"2024-05-08T21:19:44.102438+0000","last_clean":"2024-05-08T21:19:44.102438+0000","last_became_active":"2024-05-08T21:10:03.743349+0000","last_became_peered":"2024-05-08T21:10:03.743349+0000","last_unstale":"2024-05-08T21:19:44.102438+0000","last_undegraded":"2024-05-08T21:19:44.102438+0000","last_fullsized":"2024-05-08T21:19:44.102438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:08:06.408724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"32'4","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.753828+0000","last_change":"2024-05-08T21:10:03.747558+0000","last_active":"2024-05-08T21:19:06.753828+0000","last_peered":"2024-05-08T21:19:06.753828+0000","last_clean":"2024-05-08T21:19:06.753828+0000","last_became_active":"2024-05-08T21:10:03.747300+0000","last_became_peered":"2024-05-08T21:10:03.747300+0000","last_unstale":"2024-05-08T21:19:06.753828+0000","last_undegraded":"2024-05-08T21:19:06.753828+0000","last_fullsized":"2024-05-08T21:19:06.753828+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:07:50.266894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"32'14","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:43.241133+0000","last_change":"2024-05-08T21:10:03.748221+0000","last_active":"2024-05-08T21:19:43.241133+0000","last_peered":"2024-05-08T21:19:43.241133+0000","last_clean":"2024-05-08T21:19:43.241133+0000","last_became_active":"2024-05-08T21:10:03.747956+0000","last_became_peered":"2024-05-08T21:10:03.747956+0000","last_unstale":"2024-05-08T21:19:43.241133+0000","last_undegraded":"2024-05-08T21:19:43.241133+0000","last_fullsized":"2024-05-08T21:19:43.241133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:27:35.947884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"29'8","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T21:17:27.493158+0000","last_change":"2024-05-08T21:10:03.745291+0000","last_active":"2024-05-08T21:17:27.493158+0000","last_peered":"2024-05-08T21:17:27.493158+0000","last_clean":"2024-05-08T21:17:27.493158+0000","last_became_active":"2024-05-08T21:10:03.744976+0000","last_became_peered":"2024-05-08T21:10:03.744976+0000","last_unstale":"2024-05-08T21:17:27.493158+0000","last_undegraded":"2024-05-08T21:17:27.493158+0000","last_fullsized":"2024-05-08T21:17:27.493158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:36:54.983642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"32'12","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.751492+0000","last_change":"2024-05-08T21:10:03.748518+0000","last_active":"2024-05-08T21:19:06.751492+0000","last_peered":"2024-05-08T21:19:06.751492+0000","last_clean":"2024-05-08T21:19:06.751492+0000","last_became_active":"2024-05-08T21:10:03.748253+0000","last_became_peered":"2024-05-08T21:10:03.748253+0000","last_unstale":"2024-05-08T21:19:06.751492+0000","last_undegraded":"2024-05-08T21:19:06.751492+0000","last_fullsized":"2024-05-08T21:19:06.751492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:03:26.013122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"32'7","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:45.243846+0000","last_change":"2024-05-08T21:10:03.745985+0000","last_active":"2024-05-08T21:19:45.243846+0000","last_peered":"2024-05-08T21:19:45.243846+0000","last_clean":"2024-05-08T21:19:45.243846+0000","last_became_active":"2024-05-08T21:10:03.745247+0000","last_became_peered":"2024-05-08T21:10:03.745247+0000","last_unstale":"2024-05-08T21:19:45.243846+0000","last_undegraded":"2024-05-08T21:19:45.243846+0000","last_fullsized":"2024-05-08T21:19:45.243846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:59:42.506304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"29'7","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.754219+0000","last_change":"2024-05-08T21:10:03.747016+0000","last_active":"2024-05-08T21:19:06.754219+0000","last_peered":"2024-05-08T21:19:06.754219+0000","last_clean":"2024-05-08T21:19:06.754219+0000","last_became_active":"2024-05-08T21:10:03.746848+0000","last_became_peered":"2024-05-08T21:10:03.746848+0000","last_unstale":"2024-05-08T21:19:06.754219+0000","last_undegraded":"2024-05-08T21:19:06.754219+0000","last_fullsized":"2024-05-08T21:19:06.754219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:41:21.081035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"32'13","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:35.756438+0000","last_change":"2024-05-08T21:10:03.737984+0000","last_active":"2024-05-08T21:19:35.756438+0000","last_peered":"2024-05-08T21:19:35.756438+0000","last_clean":"2024-05-08T21:19:35.756438+0000","last_became_active":"2024-05-08T21:10:03.737716+0000","last_became_peered":"2024-05-08T21:10:03.737716+0000","last_unstale":"2024-05-08T21:19:35.756438+0000","last_undegraded":"2024-05-08T21:19:35.756438+0000","last_fullsized":"2024-05-08T21:19:35.756438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:09:47.758272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"32'11","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:39.528797+0000","last_change":"2024-05-08T21:10:03.744543+0000","last_active":"2024-05-08T21:19:39.528797+0000","last_peered":"2024-05-08T21:19:39.528797+0000","last_clean":"2024-05-08T21:19:39.528797+0000","last_became_active":"2024-05-08T21:10:03.744276+0000","last_became_peered":"2024-05-08T21:10:03.744276+0000","last_unstale":"2024-05-08T21:19:39.528797+0000","last_undegraded":"2024-05-08T21:19:39.528797+0000","last_fullsized":"2024-05-08T21:19:39.528797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:25:04.113297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"32'9","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:39.151636+0000","last_change":"2024-05-08T21:10:03.746547+0000","last_active":"2024-05-08T21:19:39.151636+0000","last_peered":"2024-05-08T21:19:39.151636+0000","last_clean":"2024-05-08T21:19:39.151636+0000","last_became_active":"2024-05-08T21:10:03.745862+0000","last_became_peered":"2024-05-08T21:10:03.745862+0000","last_unstale":"2024-05-08T21:19:39.151636+0000","last_undegraded":"2024-05-08T21:19:39.151636+0000","last_fullsized":"2024-05-08T21:19:39.151636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:12.776310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"32'10","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:38.816584+0000","last_change":"2024-05-08T21:10:54.028844+0000","last_active":"2024-05-08T21:19:38.816584+0000","last_peered":"2024-05-08T21:19:38.816584+0000","last_clean":"2024-05-08T21:19:38.816584+0000","last_became_active":"2024-05-08T21:10:54.028630+0000","last_became_peered":"2024-05-08T21:10:54.028630+0000","last_unstale":"2024-05-08T21:19:38.816584+0000","last_undegraded":"2024-05-08T21:19:38.816584+0000","last_fullsized":"2024-05-08T21:19:38.816584+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:04:12.556157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"32'12","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:26.364428+0000","last_change":"2024-05-08T21:10:03.743889+0000","last_active":"2024-05-08T21:19:26.364428+0000","last_peered":"2024-05-08T21:19:26.364428+0000","last_clean":"2024-05-08T21:19:26.364428+0000","last_became_active":"2024-05-08T21:10:03.743596+0000","last_became_peered":"2024-05-08T21:10:03.743596+0000","last_unstale":"2024-05-08T21:19:26.364428+0000","last_undegraded":"2024-05-08T21:19:26.364428+0000","last_fullsized":"2024-05-08T21:19:26.364428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:53.981781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"32'12","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:32.410973+0000","last_change":"2024-05-08T21:10:03.743893+0000","last_active":"2024-05-08T21:19:32.410973+0000","last_peered":"2024-05-08T21:19:32.410973+0000","last_clean":"2024-05-08T21:19:32.410973+0000","last_became_active":"2024-05-08T21:10:03.743580+0000","last_became_peered":"2024-05-08T21:10:03.743580+0000","last_unstale":"2024-05-08T21:19:32.410973+0000","last_undegraded":"2024-05-08T21:19:32.410973+0000","last_fullsized":"2024-05-08T21:19:32.410973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:44:21.747625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"32'4273","reported_seq":4361,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:48.003548+0000","last_change":"2024-05-08T21:10:08.052394+0000","last_active":"2024-05-08T21:19:48.003548+0000","last_peered":"2024-05-08T21:19:48.003548+0000","last_clean":"2024-05-08T21:19:48.003548+0000","last_became_active":"2024-05-08T21:10:08.052009+0000","last_became_peered":"2024-05-08T21:10:08.052009+0000","last_unstale":"2024-05-08T21:19:48.003548+0000","last_undegraded":"2024-05-08T21:19:48.003548+0000","last_fullsized":"2024-05-08T21:19:48.003548+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4273,"log_dups_size":0,"ondisk_log_size":4273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:47:20.148683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92320971,"num_objects":30,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":67,"num_read_kb":0,"num_write":56130,"num_write_kb":728959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"32'466","reported_seq":503,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:47.502458+0000","last_change":"2024-05-08T21:10:03.340118+0000","last_active":"2024-05-08T21:19:47.502458+0000","last_peered":"2024-05-08T21:19:47.502458+0000","last_clean":"2024-05-08T21:19:47.502458+0000","last_became_active":"2024-05-08T21:10:03.339847+0000","last_became_peered":"2024-05-08T21:10:03.339847+0000","last_unstale":"2024-05-08T21:19:47.502458+0000","last_undegraded":"2024-05-08T21:19:47.502458+0000","last_fullsized":"2024-05-08T21:19:47.502458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:05:56.369631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3158419,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":20,"num_read_kb":1370,"num_write":463,"num_write_kb":3343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"29'3","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T21:18:16.811988+0000","last_change":"2024-05-08T21:10:03.746516+0000","last_active":"2024-05-08T21:18:16.811988+0000","last_peered":"2024-05-08T21:18:16.811988+0000","last_clean":"2024-05-08T21:18:16.811988+0000","last_became_active":"2024-05-08T21:10:03.746383+0000","last_became_peered":"2024-05-08T21:10:03.746383+0000","last_unstale":"2024-05-08T21:18:16.811988+0000","last_undegraded":"2024-05-08T21:18:16.811988+0000","last_fullsized":"2024-05-08T21:18:16.811988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:29:05.305134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'4151","reported_seq":4239,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:49.580963+0000","last_change":"2024-05-08T21:10:53.484902+0000","last_active":"2024-05-08T21:19:49.580963+0000","last_peered":"2024-05-08T21:19:49.580963+0000","last_clean":"2024-05-08T21:19:49.580963+0000","last_became_active":"2024-05-08T21:10:53.484437+0000","last_became_peered":"2024-05-08T21:10:53.484437+0000","last_unstale":"2024-05-08T21:19:49.580963+0000","last_undegraded":"2024-05-08T21:19:49.580963+0000","last_fullsized":"2024-05-08T21:19:49.580963+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4151,"log_dups_size":0,"ondisk_log_size":4151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:51:42.307075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75588172,"num_objects":23,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":57,"num_read_kb":0,"num_write":53688,"num_write_kb":702965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2,3],"acting":[4,6,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"32'5","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.755018+0000","last_change":"2024-05-08T21:10:03.329414+0000","last_active":"2024-05-08T21:19:06.755018+0000","last_peered":"2024-05-08T21:19:06.755018+0000","last_clean":"2024-05-08T21:19:06.755018+0000","last_became_active":"2024-05-08T21:10:03.328970+0000","last_became_peered":"2024-05-08T21:10:03.328970+0000","last_unstale":"2024-05-08T21:19:06.755018+0000","last_undegraded":"2024-05-08T21:19:06.755018+0000","last_fullsized":"2024-05-08T21:19:06.755018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:34:32.820755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"32'7","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.755829+0000","last_change":"2024-05-08T21:10:03.748566+0000","last_active":"2024-05-08T21:19:06.755829+0000","last_peered":"2024-05-08T21:19:06.755829+0000","last_clean":"2024-05-08T21:19:06.755829+0000","last_became_active":"2024-05-08T21:10:03.747989+0000","last_became_peered":"2024-05-08T21:10:03.747989+0000","last_unstale":"2024-05-08T21:19:06.755829+0000","last_undegraded":"2024-05-08T21:19:06.755829+0000","last_fullsized":"2024-05-08T21:19:06.755829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:19:03.468394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"32'4125","reported_seq":4208,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:49.516475+0000","last_change":"2024-05-08T21:10:07.770390+0000","last_active":"2024-05-08T21:19:49.516475+0000","last_peered":"2024-05-08T21:19:49.516475+0000","last_clean":"2024-05-08T21:19:49.516475+0000","last_became_active":"2024-05-08T21:10:07.770017+0000","last_became_peered":"2024-05-08T21:10:07.770017+0000","last_unstale":"2024-05-08T21:19:49.516475+0000","last_undegraded":"2024-05-08T21:19:49.516475+0000","last_fullsized":"2024-05-08T21:19:49.516475+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4125,"log_dups_size":0,"ondisk_log_size":4125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:12:00.200848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75557266,"num_objects":26,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":62,"num_read_kb":0,"num_write":52812,"num_write_kb":674205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"32'14","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:27.848897+0000","last_change":"2024-05-08T21:10:03.339207+0000","last_active":"2024-05-08T21:19:27.848897+0000","last_peered":"2024-05-08T21:19:27.848897+0000","last_clean":"2024-05-08T21:19:27.848897+0000","last_became_active":"2024-05-08T21:10:03.338917+0000","last_became_peered":"2024-05-08T21:10:03.338917+0000","last_unstale":"2024-05-08T21:19:27.848897+0000","last_undegraded":"2024-05-08T21:19:27.848897+0000","last_fullsized":"2024-05-08T21:19:27.848897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:20.676853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":7,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"29'7","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T21:18:26.326830+0000","last_change":"2024-05-08T21:10:53.477056+0000","last_active":"2024-05-08T21:18:26.326830+0000","last_peered":"2024-05-08T21:18:26.326830+0000","last_clean":"2024-05-08T21:18:26.326830+0000","last_became_active":"2024-05-08T21:10:53.476785+0000","last_became_peered":"2024-05-08T21:10:53.476785+0000","last_unstale":"2024-05-08T21:18:26.326830+0000","last_undegraded":"2024-05-08T21:18:26.326830+0000","last_fullsized":"2024-05-08T21:18:26.326830+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:21:49.813110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"32'3528","reported_seq":3593,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:49.475287+0000","last_change":"2024-05-08T21:10:07.776367+0000","last_active":"2024-05-08T21:19:49.475287+0000","last_peered":"2024-05-08T21:19:49.475287+0000","last_clean":"2024-05-08T21:19:49.475287+0000","last_became_active":"2024-05-08T21:10:07.775998+0000","last_became_peered":"2024-05-08T21:10:07.775998+0000","last_unstale":"2024-05-08T21:19:49.475287+0000","last_undegraded":"2024-05-08T21:19:49.475287+0000","last_fullsized":"2024-05-08T21:19:49.475287+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":3528,"log_dups_size":0,"ondisk_log_size":3528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:24:18.845560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62927589,"num_objects":17,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":44,"num_read_kb":0,"num_write":46321,"num_write_kb":599175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"29'4","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:27.838760+0000","last_change":"2024-05-08T21:10:03.339182+0000","last_active":"2024-05-08T21:19:27.838760+0000","last_peered":"2024-05-08T21:19:27.838760+0000","last_clean":"2024-05-08T21:19:27.838760+0000","last_became_active":"2024-05-08T21:10:03.338899+0000","last_became_peered":"2024-05-08T21:10:03.338899+0000","last_unstale":"2024-05-08T21:19:27.838760+0000","last_undegraded":"2024-05-08T21:19:27.838760+0000","last_fullsized":"2024-05-08T21:19:27.838760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:55:53.368546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":5,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"32'9","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:42.391573+0000","last_change":"2024-05-08T21:10:03.750724+0000","last_active":"2024-05-08T21:19:42.391573+0000","last_peered":"2024-05-08T21:19:42.391573+0000","last_clean":"2024-05-08T21:19:42.391573+0000","last_became_active":"2024-05-08T21:10:03.750371+0000","last_became_peered":"2024-05-08T21:10:03.750371+0000","last_unstale":"2024-05-08T21:19:42.391573+0000","last_undegraded":"2024-05-08T21:19:42.391573+0000","last_fullsized":"2024-05-08T21:19:42.391573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:14:01.935211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"32'4452","reported_seq":4539,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:48.345804+0000","last_change":"2024-05-08T21:10:07.767604+0000","last_active":"2024-05-08T21:19:48.345804+0000","last_peered":"2024-05-08T21:19:48.345804+0000","last_clean":"2024-05-08T21:19:48.345804+0000","last_became_active":"2024-05-08T21:10:07.767234+0000","last_became_peered":"2024-05-08T21:10:07.767234+0000","last_unstale":"2024-05-08T21:19:48.345804+0000","last_undegraded":"2024-05-08T21:19:48.345804+0000","last_fullsized":"2024-05-08T21:19:48.345804+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4452,"log_dups_size":0,"ondisk_log_size":4452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:30:21.411491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83914681,"num_objects":28,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":66,"num_read_kb":0,"num_write":57873,"num_write_kb":753617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"29'1290","reported_seq":1318,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.754424+0000","last_change":"2024-05-08T21:10:03.338149+0000","last_active":"2024-05-08T21:19:06.754424+0000","last_peered":"2024-05-08T21:19:06.754424+0000","last_clean":"2024-05-08T21:19:06.754424+0000","last_became_active":"2024-05-08T21:10:03.337860+0000","last_became_peered":"2024-05-08T21:10:03.337860+0000","last_unstale":"2024-05-08T21:19:06.754424+0000","last_undegraded":"2024-05-08T21:19:06.754424+0000","last_fullsized":"2024-05-08T21:19:06.754424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":1290,"log_dups_size":0,"ondisk_log_size":1290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:07:39.052625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":1289,"num_write_kb":5292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"32'10","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.337623+0000","last_change":"2024-05-08T21:10:03.743506+0000","last_active":"2024-05-08T21:19:06.337623+0000","last_peered":"2024-05-08T21:19:06.337623+0000","last_clean":"2024-05-08T21:19:06.337623+0000","last_became_active":"2024-05-08T21:10:03.743227+0000","last_became_peered":"2024-05-08T21:10:03.743227+0000","last_unstale":"2024-05-08T21:19:06.337623+0000","last_undegraded":"2024-05-08T21:19:06.337623+0000","last_fullsized":"2024-05-08T21:19:06.337623+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:45:47.977619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"32'3353","reported_seq":3415,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:51.343485+0000","last_change":"2024-05-08T21:10:07.768424+0000","last_active":"2024-05-08T21:19:51.343485+0000","last_peered":"2024-05-08T21:19:51.343485+0000","last_clean":"2024-05-08T21:19:51.343485+0000","last_became_active":"2024-05-08T21:10:07.768160+0000","last_became_peered":"2024-05-08T21:10:07.768160+0000","last_unstale":"2024-05-08T21:19:51.343485+0000","last_undegraded":"2024-05-08T21:19:51.343485+0000","last_fullsized":"2024-05-08T21:19:51.343485+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":3353,"log_dups_size":0,"ondisk_log_size":3353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:42:44.327080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25177867,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":42,"num_read_kb":0,"num_write":43347,"num_write_kb":562121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"32'5","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.751975+0000","last_change":"2024-05-08T21:10:03.333647+0000","last_active":"2024-05-08T21:19:06.751975+0000","last_peered":"2024-05-08T21:19:06.751975+0000","last_clean":"2024-05-08T21:19:06.751975+0000","last_became_active":"2024-05-08T21:10:03.332844+0000","last_became_peered":"2024-05-08T21:10:03.332844+0000","last_unstale":"2024-05-08T21:19:06.751975+0000","last_undegraded":"2024-05-08T21:19:06.751975+0000","last_fullsized":"2024-05-08T21:19:06.751975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:47:40.344808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"32'9","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.753644+0000","last_change":"2024-05-08T21:10:03.743003+0000","last_active":"2024-05-08T21:19:06.753644+0000","last_peered":"2024-05-08T21:19:06.753644+0000","last_clean":"2024-05-08T21:19:06.753644+0000","last_became_active":"2024-05-08T21:10:03.742753+0000","last_became_peered":"2024-05-08T21:10:03.742753+0000","last_unstale":"2024-05-08T21:19:06.753644+0000","last_undegraded":"2024-05-08T21:19:06.753644+0000","last_fullsized":"2024-05-08T21:19:06.753644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:45:49.575877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4217","reported_seq":4310,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:49.730623+0000","last_change":"2024-05-08T21:10:07.770105+0000","last_active":"2024-05-08T21:19:49.730623+0000","last_peered":"2024-05-08T21:19:49.730623+0000","last_clean":"2024-05-08T21:19:49.730623+0000","last_became_active":"2024-05-08T21:10:07.769668+0000","last_became_peered":"2024-05-08T21:10:07.769668+0000","last_unstale":"2024-05-08T21:19:49.730623+0000","last_undegraded":"2024-05-08T21:19:49.730623+0000","last_fullsized":"2024-05-08T21:19:49.730623+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4217,"log_dups_size":0,"ondisk_log_size":4217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:07:21.560031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63011864,"num_objects":23,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":71,"num_read_kb":0,"num_write":54931,"num_write_kb":711961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"29'1","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T21:17:26.765527+0000","last_change":"2024-05-08T21:10:03.333025+0000","last_active":"2024-05-08T21:17:26.765527+0000","last_peered":"2024-05-08T21:17:26.765527+0000","last_clean":"2024-05-08T21:17:26.765527+0000","last_became_active":"2024-05-08T21:10:03.332750+0000","last_became_peered":"2024-05-08T21:10:03.332750+0000","last_unstale":"2024-05-08T21:17:26.765527+0000","last_undegraded":"2024-05-08T21:17:26.765527+0000","last_fullsized":"2024-05-08T21:17:26.765527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:20:50.134647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'15","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.752581+0000","last_change":"2024-05-08T21:10:03.744023+0000","last_active":"2024-05-08T21:19:06.752581+0000","last_peered":"2024-05-08T21:19:06.752581+0000","last_clean":"2024-05-08T21:19:06.752581+0000","last_became_active":"2024-05-08T21:10:03.743724+0000","last_became_peered":"2024-05-08T21:10:03.743724+0000","last_unstale":"2024-05-08T21:19:06.752581+0000","last_undegraded":"2024-05-08T21:19:06.752581+0000","last_fullsized":"2024-05-08T21:19:06.752581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:50:36.857245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"32'4795","reported_seq":4889,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:47.509016+0000","last_change":"2024-05-08T21:10:08.052307+0000","last_active":"2024-05-08T21:19:47.509016+0000","last_peered":"2024-05-08T21:19:47.509016+0000","last_clean":"2024-05-08T21:19:47.509016+0000","last_became_active":"2024-05-08T21:10:08.051924+0000","last_became_peered":"2024-05-08T21:10:08.051924+0000","last_unstale":"2024-05-08T21:19:47.509016+0000","last_undegraded":"2024-05-08T21:19:47.509016+0000","last_fullsized":"2024-05-08T21:19:47.509016+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4795,"log_dups_size":0,"ondisk_log_size":4795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:56:37.264246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142632158,"num_objects":40,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":72,"num_read_kb":0,"num_write":62600,"num_write_kb":808641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.335214+0000","last_change":"2024-05-08T21:10:03.330304+0000","last_active":"2024-05-08T21:19:06.335214+0000","last_peered":"2024-05-08T21:19:06.335214+0000","last_clean":"2024-05-08T21:19:06.335214+0000","last_became_active":"2024-05-08T21:10:03.330054+0000","last_became_peered":"2024-05-08T21:10:03.330054+0000","last_unstale":"2024-05-08T21:19:06.335214+0000","last_undegraded":"2024-05-08T21:19:06.335214+0000","last_fullsized":"2024-05-08T21:19:06.335214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:30.518935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"29'4","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T21:17:28.857915+0000","last_change":"2024-05-08T21:10:03.739687+0000","last_active":"2024-05-08T21:17:28.857915+0000","last_peered":"2024-05-08T21:17:28.857915+0000","last_clean":"2024-05-08T21:17:28.857915+0000","last_became_active":"2024-05-08T21:10:03.739425+0000","last_became_peered":"2024-05-08T21:10:03.739425+0000","last_unstale":"2024-05-08T21:17:28.857915+0000","last_undegraded":"2024-05-08T21:17:28.857915+0000","last_fullsized":"2024-05-08T21:17:28.857915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:45:59.295081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"32'4191","reported_seq":4271,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:47.269668+0000","last_change":"2024-05-08T21:10:08.050980+0000","last_active":"2024-05-08T21:19:47.269668+0000","last_peered":"2024-05-08T21:19:47.269668+0000","last_clean":"2024-05-08T21:19:47.269668+0000","last_became_active":"2024-05-08T21:10:08.050625+0000","last_became_peered":"2024-05-08T21:10:08.050625+0000","last_unstale":"2024-05-08T21:19:47.269668+0000","last_undegraded":"2024-05-08T21:19:47.269668+0000","last_fullsized":"2024-05-08T21:19:47.269668+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4191,"log_dups_size":0,"ondisk_log_size":4191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:39:43.917363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83921679,"num_objects":25,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":58,"num_read_kb":0,"num_write":54024,"num_write_kb":693342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"32'2","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:31.819884+0000","last_change":"2024-05-08T21:10:03.331297+0000","last_active":"2024-05-08T21:19:31.819884+0000","last_peered":"2024-05-08T21:19:31.819884+0000","last_clean":"2024-05-08T21:19:31.819884+0000","last_became_active":"2024-05-08T21:10:03.330973+0000","last_became_peered":"2024-05-08T21:10:03.330973+0000","last_unstale":"2024-05-08T21:19:31.819884+0000","last_undegraded":"2024-05-08T21:19:31.819884+0000","last_fullsized":"2024-05-08T21:19:31.819884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:57:26.190186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"29'5","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T21:17:26.420223+0000","last_change":"2024-05-08T21:10:03.751746+0000","last_active":"2024-05-08T21:17:26.420223+0000","last_peered":"2024-05-08T21:17:26.420223+0000","last_clean":"2024-05-08T21:17:26.420223+0000","last_became_active":"2024-05-08T21:10:03.751426+0000","last_became_peered":"2024-05-08T21:10:03.751426+0000","last_unstale":"2024-05-08T21:17:26.420223+0000","last_undegraded":"2024-05-08T21:17:26.420223+0000","last_fullsized":"2024-05-08T21:17:26.420223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:00:23.529543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"32'4044","reported_seq":4137,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:47.707313+0000","last_change":"2024-05-08T21:10:53.484721+0000","last_active":"2024-05-08T21:19:47.707313+0000","last_peered":"2024-05-08T21:19:47.707313+0000","last_clean":"2024-05-08T21:19:47.707313+0000","last_became_active":"2024-05-08T21:10:53.484313+0000","last_became_peered":"2024-05-08T21:10:53.484313+0000","last_unstale":"2024-05-08T21:19:47.707313+0000","last_undegraded":"2024-05-08T21:19:47.707313+0000","last_fullsized":"2024-05-08T21:19:47.707313+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4044,"log_dups_size":0,"ondisk_log_size":4044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:20:10.055442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75513200,"num_objects":23,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":61,"num_read_kb":0,"num_write":52756,"num_write_kb":673924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"29'1","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.335681+0000","last_change":"2024-05-08T21:10:03.332049+0000","last_active":"2024-05-08T21:19:06.335681+0000","last_peered":"2024-05-08T21:19:06.335681+0000","last_clean":"2024-05-08T21:19:06.335681+0000","last_became_active":"2024-05-08T21:10:03.331712+0000","last_became_peered":"2024-05-08T21:10:03.331712+0000","last_unstale":"2024-05-08T21:19:06.335681+0000","last_undegraded":"2024-05-08T21:19:06.335681+0000","last_fullsized":"2024-05-08T21:19:06.335681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:30:16.135672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"32'12","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:40.321291+0000","last_change":"2024-05-08T21:10:03.748728+0000","last_active":"2024-05-08T21:19:40.321291+0000","last_peered":"2024-05-08T21:19:40.321291+0000","last_clean":"2024-05-08T21:19:40.321291+0000","last_became_active":"2024-05-08T21:10:03.748315+0000","last_became_peered":"2024-05-08T21:10:03.748315+0000","last_unstale":"2024-05-08T21:19:40.321291+0000","last_undegraded":"2024-05-08T21:19:40.321291+0000","last_fullsized":"2024-05-08T21:19:40.321291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:14:15.224603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"32'4177","reported_seq":4256,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:49.426046+0000","last_change":"2024-05-08T21:10:07.761559+0000","last_active":"2024-05-08T21:19:49.426046+0000","last_peered":"2024-05-08T21:19:49.426046+0000","last_clean":"2024-05-08T21:19:49.426046+0000","last_became_active":"2024-05-08T21:10:07.761129+0000","last_became_peered":"2024-05-08T21:10:07.761129+0000","last_unstale":"2024-05-08T21:19:49.426046+0000","last_undegraded":"2024-05-08T21:19:49.426046+0000","last_fullsized":"2024-05-08T21:19:49.426046+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4177,"log_dups_size":0,"ondisk_log_size":4177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:29:03.444853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84006392,"num_objects":32,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":57,"num_read_kb":0,"num_write":55185,"num_write_kb":706687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"32'15","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:38.064532+0000","last_change":"2024-05-08T21:10:03.333077+0000","last_active":"2024-05-08T21:19:38.064532+0000","last_peered":"2024-05-08T21:19:38.064532+0000","last_clean":"2024-05-08T21:19:38.064532+0000","last_became_active":"2024-05-08T21:10:03.332796+0000","last_became_peered":"2024-05-08T21:10:03.332796+0000","last_unstale":"2024-05-08T21:19:38.064532+0000","last_undegraded":"2024-05-08T21:19:38.064532+0000","last_fullsized":"2024-05-08T21:19:38.064532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:30:16.135672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":17,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"32'6","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:38.513441+0000","last_change":"2024-05-08T21:10:03.751370+0000","last_active":"2024-05-08T21:19:38.513441+0000","last_peered":"2024-05-08T21:19:38.513441+0000","last_clean":"2024-05-08T21:19:38.513441+0000","last_became_active":"2024-05-08T21:10:03.750394+0000","last_became_peered":"2024-05-08T21:10:03.750394+0000","last_unstale":"2024-05-08T21:19:38.513441+0000","last_undegraded":"2024-05-08T21:19:38.513441+0000","last_fullsized":"2024-05-08T21:19:38.513441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:31:06.682543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"32'3871","reported_seq":3935,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:48.059290+0000","last_change":"2024-05-08T21:10:07.764815+0000","last_active":"2024-05-08T21:19:48.059290+0000","last_peered":"2024-05-08T21:19:48.059290+0000","last_clean":"2024-05-08T21:19:48.059290+0000","last_became_active":"2024-05-08T21:10:07.763591+0000","last_became_peered":"2024-05-08T21:10:07.763591+0000","last_unstale":"2024-05-08T21:19:48.059290+0000","last_undegraded":"2024-05-08T21:19:48.059290+0000","last_fullsized":"2024-05-08T21:19:48.059290+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":3871,"log_dups_size":0,"ondisk_log_size":3871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:47.977517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92290339,"num_objects":27,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":42,"num_read_kb":0,"num_write":50132,"num_write_kb":657283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"32'218","reported_seq":263,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:31.819804+0000","last_change":"2024-05-08T21:10:03.342400+0000","last_active":"2024-05-08T21:19:31.819804+0000","last_peered":"2024-05-08T21:19:31.819804+0000","last_clean":"2024-05-08T21:19:31.819804+0000","last_became_active":"2024-05-08T21:10:03.342202+0000","last_became_peered":"2024-05-08T21:10:03.342202+0000","last_unstale":"2024-05-08T21:19:31.819804+0000","last_undegraded":"2024-05-08T21:19:31.819804+0000","last_fullsized":"2024-05-08T21:19:31.819804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:10:04.668029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":37,"num_read_kb":12328,"num_write":217,"num_write_kb":4276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"32'10","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:37.012101+0000","last_change":"2024-05-08T21:10:03.752144+0000","last_active":"2024-05-08T21:19:37.012101+0000","last_peered":"2024-05-08T21:19:37.012101+0000","last_clean":"2024-05-08T21:19:37.012101+0000","last_became_active":"2024-05-08T21:10:03.751868+0000","last_became_peered":"2024-05-08T21:10:03.751868+0000","last_unstale":"2024-05-08T21:19:37.012101+0000","last_undegraded":"2024-05-08T21:19:37.012101+0000","last_fullsized":"2024-05-08T21:19:37.012101+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:40:43.168591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"32'3924","reported_seq":3998,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:47.426816+0000","last_change":"2024-05-08T21:10:08.052390+0000","last_active":"2024-05-08T21:19:47.426816+0000","last_peered":"2024-05-08T21:19:47.426816+0000","last_clean":"2024-05-08T21:19:47.426816+0000","last_became_active":"2024-05-08T21:10:08.051967+0000","last_became_peered":"2024-05-08T21:10:08.051967+0000","last_unstale":"2024-05-08T21:19:47.426816+0000","last_undegraded":"2024-05-08T21:19:47.426816+0000","last_fullsized":"2024-05-08T21:19:47.426816+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":3924,"log_dups_size":0,"ondisk_log_size":3924,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:40:07.127492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":52,"num_read_kb":0,"num_write":50165,"num_write_kb":654171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"29'4","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:27.812950+0000","last_change":"2024-05-08T21:10:03.330102+0000","last_active":"2024-05-08T21:19:27.812950+0000","last_peered":"2024-05-08T21:19:27.812950+0000","last_clean":"2024-05-08T21:19:27.812950+0000","last_became_active":"2024-05-08T21:10:03.329761+0000","last_became_peered":"2024-05-08T21:10:03.329761+0000","last_unstale":"2024-05-08T21:19:27.812950+0000","last_undegraded":"2024-05-08T21:19:27.812950+0000","last_fullsized":"2024-05-08T21:19:27.812950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:37:14.930549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":16,"num_read_kb":32,"num_write":5,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"32'13","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:42.040056+0000","last_change":"2024-05-08T21:10:03.749332+0000","last_active":"2024-05-08T21:19:42.040056+0000","last_peered":"2024-05-08T21:19:42.040056+0000","last_clean":"2024-05-08T21:19:42.040056+0000","last_became_active":"2024-05-08T21:10:03.749094+0000","last_became_peered":"2024-05-08T21:10:03.749094+0000","last_unstale":"2024-05-08T21:19:42.040056+0000","last_undegraded":"2024-05-08T21:19:42.040056+0000","last_fullsized":"2024-05-08T21:19:42.040056+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:25.969085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"32'4353","reported_seq":4430,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:48.427835+0000","last_change":"2024-05-08T21:10:08.048331+0000","last_active":"2024-05-08T21:19:48.427835+0000","last_peered":"2024-05-08T21:19:48.427835+0000","last_clean":"2024-05-08T21:19:48.427835+0000","last_became_active":"2024-05-08T21:10:08.047505+0000","last_became_peered":"2024-05-08T21:10:08.047505+0000","last_unstale":"2024-05-08T21:19:48.427835+0000","last_undegraded":"2024-05-08T21:19:48.427835+0000","last_fullsized":"2024-05-08T21:19:48.427835+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4353,"log_dups_size":0,"ondisk_log_size":4353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:18:39.268730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100756600,"num_objects":34,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":55,"num_read_kb":0,"num_write":56764,"num_write_kb":743616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"29'1","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.335436+0000","last_change":"2024-05-08T21:10:03.328021+0000","last_active":"2024-05-08T21:19:06.335436+0000","last_peered":"2024-05-08T21:19:06.335436+0000","last_clean":"2024-05-08T21:19:06.335436+0000","last_became_active":"2024-05-08T21:10:03.327648+0000","last_became_peered":"2024-05-08T21:10:03.327648+0000","last_unstale":"2024-05-08T21:19:06.335436+0000","last_undegraded":"2024-05-08T21:19:06.335436+0000","last_fullsized":"2024-05-08T21:19:06.335436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:37:54.491930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"29'10","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.751890+0000","last_change":"2024-05-08T21:10:03.750560+0000","last_active":"2024-05-08T21:19:06.751890+0000","last_peered":"2024-05-08T21:19:06.751890+0000","last_clean":"2024-05-08T21:19:06.751890+0000","last_became_active":"2024-05-08T21:10:03.750294+0000","last_became_peered":"2024-05-08T21:10:03.750294+0000","last_unstale":"2024-05-08T21:19:06.751890+0000","last_undegraded":"2024-05-08T21:19:06.751890+0000","last_fullsized":"2024-05-08T21:19:06.751890+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:30:47.937326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"32'4324","reported_seq":4395,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:48.399776+0000","last_change":"2024-05-08T21:10:08.052318+0000","last_active":"2024-05-08T21:19:48.399776+0000","last_peered":"2024-05-08T21:19:48.399776+0000","last_clean":"2024-05-08T21:19:48.399776+0000","last_became_active":"2024-05-08T21:10:08.051920+0000","last_became_peered":"2024-05-08T21:10:08.051920+0000","last_unstale":"2024-05-08T21:19:48.399776+0000","last_undegraded":"2024-05-08T21:19:48.399776+0000","last_fullsized":"2024-05-08T21:19:48.399776+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4324,"log_dups_size":0,"ondisk_log_size":4324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:25:27.669768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67150699,"num_objects":20,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":50,"num_read_kb":0,"num_write":56454,"num_write_kb":728506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"32'2","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:19.849641+0000","last_change":"2024-05-08T21:10:03.332390+0000","last_active":"2024-05-08T21:19:19.849641+0000","last_peered":"2024-05-08T21:19:19.849641+0000","last_clean":"2024-05-08T21:19:19.849641+0000","last_became_active":"2024-05-08T21:10:03.332105+0000","last_became_peered":"2024-05-08T21:10:03.332105+0000","last_unstale":"2024-05-08T21:19:19.849641+0000","last_undegraded":"2024-05-08T21:19:19.849641+0000","last_fullsized":"2024-05-08T21:19:19.849641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:32:44.705682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"32'8","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:40.607990+0000","last_change":"2024-05-08T21:10:03.742100+0000","last_active":"2024-05-08T21:19:40.607990+0000","last_peered":"2024-05-08T21:19:40.607990+0000","last_clean":"2024-05-08T21:19:40.607990+0000","last_became_active":"2024-05-08T21:10:03.741742+0000","last_became_peered":"2024-05-08T21:10:03.741742+0000","last_unstale":"2024-05-08T21:19:40.607990+0000","last_undegraded":"2024-05-08T21:19:40.607990+0000","last_fullsized":"2024-05-08T21:19:40.607990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:53:19.394126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"32'4435","reported_seq":4525,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:47.551207+0000","last_change":"2024-05-08T21:10:07.769850+0000","last_active":"2024-05-08T21:19:47.551207+0000","last_peered":"2024-05-08T21:19:47.551207+0000","last_clean":"2024-05-08T21:19:47.551207+0000","last_became_active":"2024-05-08T21:10:07.769016+0000","last_became_peered":"2024-05-08T21:10:07.769016+0000","last_unstale":"2024-05-08T21:19:47.551207+0000","last_undegraded":"2024-05-08T21:19:47.551207+0000","last_fullsized":"2024-05-08T21:19:47.551207+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4435,"log_dups_size":0,"ondisk_log_size":4435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:31:52.621418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117542773,"num_objects":37,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":68,"num_read_kb":0,"num_write":57721,"num_write_kb":734684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"29'10","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:27.844484+0000","last_change":"2024-05-08T21:10:03.331783+0000","last_active":"2024-05-08T21:19:27.844484+0000","last_peered":"2024-05-08T21:19:27.844484+0000","last_clean":"2024-05-08T21:19:27.844484+0000","last_became_active":"2024-05-08T21:10:03.331501+0000","last_became_peered":"2024-05-08T21:10:03.331501+0000","last_unstale":"2024-05-08T21:19:27.844484+0000","last_undegraded":"2024-05-08T21:19:27.844484+0000","last_fullsized":"2024-05-08T21:19:27.844484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:41:28.137295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":69,"num_read_kb":69,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"29'9","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.751368+0000","last_change":"2024-05-08T21:10:03.744007+0000","last_active":"2024-05-08T21:19:06.751368+0000","last_peered":"2024-05-08T21:19:06.751368+0000","last_clean":"2024-05-08T21:19:06.751368+0000","last_became_active":"2024-05-08T21:10:03.743557+0000","last_became_peered":"2024-05-08T21:10:03.743557+0000","last_unstale":"2024-05-08T21:19:06.751368+0000","last_undegraded":"2024-05-08T21:19:06.751368+0000","last_fullsized":"2024-05-08T21:19:06.751368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:45:26.458377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"32'3664","reported_seq":3740,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:49.539847+0000","last_change":"2024-05-08T21:10:07.777283+0000","last_active":"2024-05-08T21:19:49.539847+0000","last_peered":"2024-05-08T21:19:49.539847+0000","last_clean":"2024-05-08T21:19:49.539847+0000","last_became_active":"2024-05-08T21:10:07.776858+0000","last_became_peered":"2024-05-08T21:10:07.776858+0000","last_unstale":"2024-05-08T21:19:49.539847+0000","last_undegraded":"2024-05-08T21:19:49.539847+0000","last_fullsized":"2024-05-08T21:19:49.539847+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":3664,"log_dups_size":0,"ondisk_log_size":3664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:51.725885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84074226,"num_objects":26,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":54,"num_read_kb":0,"num_write":47400,"num_write_kb":636696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"29'2","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:09.842867+0000","last_change":"2024-05-08T21:10:03.326892+0000","last_active":"2024-05-08T21:19:09.842867+0000","last_peered":"2024-05-08T21:19:09.842867+0000","last_clean":"2024-05-08T21:19:09.842867+0000","last_became_active":"2024-05-08T21:10:03.326608+0000","last_became_peered":"2024-05-08T21:10:03.326608+0000","last_unstale":"2024-05-08T21:19:09.842867+0000","last_undegraded":"2024-05-08T21:19:09.842867+0000","last_fullsized":"2024-05-08T21:19:09.842867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:33.441985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"32'5","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:08.753595+0000","last_change":"2024-05-08T21:10:03.749221+0000","last_active":"2024-05-08T21:19:08.753595+0000","last_peered":"2024-05-08T21:19:08.753595+0000","last_clean":"2024-05-08T21:19:08.753595+0000","last_became_active":"2024-05-08T21:10:03.748915+0000","last_became_peered":"2024-05-08T21:10:03.748915+0000","last_unstale":"2024-05-08T21:19:08.753595+0000","last_undegraded":"2024-05-08T21:19:08.753595+0000","last_fullsized":"2024-05-08T21:19:08.753595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:03:10.791535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"32'4701","reported_seq":4794,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:47.978772+0000","last_change":"2024-05-08T21:10:07.759492+0000","last_active":"2024-05-08T21:19:47.978772+0000","last_peered":"2024-05-08T21:19:47.978772+0000","last_clean":"2024-05-08T21:19:47.978772+0000","last_became_active":"2024-05-08T21:10:07.759139+0000","last_became_peered":"2024-05-08T21:10:07.759139+0000","last_unstale":"2024-05-08T21:19:47.978772+0000","last_undegraded":"2024-05-08T21:19:47.978772+0000","last_fullsized":"2024-05-08T21:19:47.978772+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4701,"log_dups_size":0,"ondisk_log_size":4701,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:10.579105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79798076,"num_objects":26,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":71,"num_read_kb":0,"num_write":61787,"num_write_kb":787262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"29'1","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T21:18:26.799734+0000","last_change":"2024-05-08T21:10:03.329020+0000","last_active":"2024-05-08T21:18:26.799734+0000","last_peered":"2024-05-08T21:18:26.799734+0000","last_clean":"2024-05-08T21:18:26.799734+0000","last_became_active":"2024-05-08T21:10:03.328739+0000","last_became_peered":"2024-05-08T21:10:03.328739+0000","last_unstale":"2024-05-08T21:18:26.799734+0000","last_undegraded":"2024-05-08T21:18:26.799734+0000","last_fullsized":"2024-05-08T21:18:26.799734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:27:11.168780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"32'9","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:40.268874+0000","last_change":"2024-05-08T21:10:03.744662+0000","last_active":"2024-05-08T21:19:40.268874+0000","last_peered":"2024-05-08T21:19:40.268874+0000","last_clean":"2024-05-08T21:19:40.268874+0000","last_became_active":"2024-05-08T21:10:03.744398+0000","last_became_peered":"2024-05-08T21:10:03.744398+0000","last_unstale":"2024-05-08T21:19:40.268874+0000","last_undegraded":"2024-05-08T21:19:40.268874+0000","last_fullsized":"2024-05-08T21:19:40.268874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:05:28.046055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"32'4102","reported_seq":4172,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:48.278465+0000","last_change":"2024-05-08T21:10:07.776566+0000","last_active":"2024-05-08T21:19:48.278465+0000","last_peered":"2024-05-08T21:19:48.278465+0000","last_clean":"2024-05-08T21:19:48.278465+0000","last_became_active":"2024-05-08T21:10:07.776080+0000","last_became_peered":"2024-05-08T21:10:07.776080+0000","last_unstale":"2024-05-08T21:19:48.278465+0000","last_undegraded":"2024-05-08T21:19:48.278465+0000","last_fullsized":"2024-05-08T21:19:48.278465+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4102,"log_dups_size":0,"ondisk_log_size":4102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:26:09.323466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83899507,"num_objects":24,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":48,"num_read_kb":0,"num_write":53735,"num_write_kb":696170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T21:18:27.827601+0000","last_change":"2024-05-08T21:10:03.332953+0000","last_active":"2024-05-08T21:18:27.827601+0000","last_peered":"2024-05-08T21:18:27.827601+0000","last_clean":"2024-05-08T21:18:27.827601+0000","last_became_active":"2024-05-08T21:10:03.332689+0000","last_became_peered":"2024-05-08T21:10:03.332689+0000","last_unstale":"2024-05-08T21:18:27.827601+0000","last_undegraded":"2024-05-08T21:18:27.827601+0000","last_fullsized":"2024-05-08T21:18:27.827601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:15:32.058369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"32'7","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.337681+0000","last_change":"2024-05-08T21:10:03.745651+0000","last_active":"2024-05-08T21:19:06.337681+0000","last_peered":"2024-05-08T21:19:06.337681+0000","last_clean":"2024-05-08T21:19:06.337681+0000","last_became_active":"2024-05-08T21:10:03.742744+0000","last_became_peered":"2024-05-08T21:10:03.742744+0000","last_unstale":"2024-05-08T21:19:06.337681+0000","last_undegraded":"2024-05-08T21:19:06.337681+0000","last_fullsized":"2024-05-08T21:19:06.337681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:32:31.689490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"32'4616","reported_seq":4706,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:47.885183+0000","last_change":"2024-05-08T21:10:07.776527+0000","last_active":"2024-05-08T21:19:47.885183+0000","last_peered":"2024-05-08T21:19:47.885183+0000","last_clean":"2024-05-08T21:19:47.885183+0000","last_became_active":"2024-05-08T21:10:07.776053+0000","last_became_peered":"2024-05-08T21:10:07.776053+0000","last_unstale":"2024-05-08T21:19:47.885183+0000","last_undegraded":"2024-05-08T21:19:47.885183+0000","last_fullsized":"2024-05-08T21:19:47.885183+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4616,"log_dups_size":0,"ondisk_log_size":4616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:08:26.401358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104914124,"num_objects":33,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":68,"num_read_kb":0,"num_write":59795,"num_write_kb":758247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"29'10","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T21:18:16.068937+0000","last_change":"2024-05-08T21:10:03.738421+0000","last_active":"2024-05-08T21:18:16.068937+0000","last_peered":"2024-05-08T21:18:16.068937+0000","last_clean":"2024-05-08T21:18:16.068937+0000","last_became_active":"2024-05-08T21:10:03.738000+0000","last_became_peered":"2024-05-08T21:10:03.738000+0000","last_unstale":"2024-05-08T21:18:16.068937+0000","last_undegraded":"2024-05-08T21:18:16.068937+0000","last_fullsized":"2024-05-08T21:18:16.068937+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:38:05.948755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"32'25","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:46.067041+0000","last_change":"2024-05-08T21:10:03.331141+0000","last_active":"2024-05-08T21:19:46.067041+0000","last_peered":"2024-05-08T21:19:46.067041+0000","last_clean":"2024-05-08T21:19:46.067041+0000","last_became_active":"2024-05-08T21:10:03.330842+0000","last_became_peered":"2024-05-08T21:10:03.330842+0000","last_unstale":"2024-05-08T21:19:46.067041+0000","last_undegraded":"2024-05-08T21:19:46.067041+0000","last_fullsized":"2024-05-08T21:19:46.067041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:42:52.648932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94059,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":26,"num_read_kb":107,"num_write":23,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"32'4099","reported_seq":4177,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:48.943194+0000","last_change":"2024-05-08T21:10:08.049274+0000","last_active":"2024-05-08T21:19:48.943194+0000","last_peered":"2024-05-08T21:19:48.943194+0000","last_clean":"2024-05-08T21:19:48.943194+0000","last_became_active":"2024-05-08T21:10:08.048763+0000","last_became_peered":"2024-05-08T21:10:08.048763+0000","last_unstale":"2024-05-08T21:19:48.943194+0000","last_undegraded":"2024-05-08T21:19:48.943194+0000","last_fullsized":"2024-05-08T21:19:48.943194+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4099,"log_dups_size":0,"ondisk_log_size":4099,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:00:41.257040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67154510,"num_objects":24,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":56,"num_read_kb":0,"num_write":53613,"num_write_kb":684025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"32'7","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:41.301996+0000","last_change":"2024-05-08T21:10:03.747594+0000","last_active":"2024-05-08T21:19:41.301996+0000","last_peered":"2024-05-08T21:19:41.301996+0000","last_clean":"2024-05-08T21:19:41.301996+0000","last_became_active":"2024-05-08T21:10:03.747360+0000","last_became_peered":"2024-05-08T21:10:03.747360+0000","last_unstale":"2024-05-08T21:19:41.301996+0000","last_undegraded":"2024-05-08T21:19:41.301996+0000","last_fullsized":"2024-05-08T21:19:41.301996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:31:12.357348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T21:18:27.827642+0000","last_change":"2024-05-08T21:10:03.327847+0000","last_active":"2024-05-08T21:18:27.827642+0000","last_peered":"2024-05-08T21:18:27.827642+0000","last_clean":"2024-05-08T21:18:27.827642+0000","last_became_active":"2024-05-08T21:10:03.327530+0000","last_became_peered":"2024-05-08T21:10:03.327530+0000","last_unstale":"2024-05-08T21:18:27.827642+0000","last_undegraded":"2024-05-08T21:18:27.827642+0000","last_fullsized":"2024-05-08T21:18:27.827642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:46.232166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T21:18:03.705532+0000","last_change":"2024-05-08T21:09:59.333990+0000","last_active":"2024-05-08T21:18:03.705532+0000","last_peered":"2024-05-08T21:18:03.705532+0000","last_clean":"2024-05-08T21:18:03.705532+0000","last_became_active":"2024-05-08T21:09:59.332929+0000","last_became_peered":"2024-05-08T21:09:59.332929+0000","last_unstale":"2024-05-08T21:18:03.705532+0000","last_undegraded":"2024-05-08T21:18:03.705532+0000","last_fullsized":"2024-05-08T21:18:03.705532+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:09:58.287675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:09:58.287675+0000","last_clean_scrub_stamp":"2024-05-08T21:09:58.287675+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:47.595380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"32'3560","reported_seq":3628,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:47.312167+0000","last_change":"2024-05-08T21:10:08.049848+0000","last_active":"2024-05-08T21:19:47.312167+0000","last_peered":"2024-05-08T21:19:47.312167+0000","last_clean":"2024-05-08T21:19:47.312167+0000","last_became_active":"2024-05-08T21:10:08.049153+0000","last_became_peered":"2024-05-08T21:10:08.049153+0000","last_unstale":"2024-05-08T21:19:47.312167+0000","last_undegraded":"2024-05-08T21:19:47.312167+0000","last_fullsized":"2024-05-08T21:19:47.312167+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":3560,"log_dups_size":0,"ondisk_log_size":3560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:23.704112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79714880,"num_objects":26,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":46,"num_read_kb":0,"num_write":45721,"num_write_kb":586385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"32'4","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.754392+0000","last_change":"2024-05-08T21:10:03.743094+0000","last_active":"2024-05-08T21:19:06.754392+0000","last_peered":"2024-05-08T21:19:06.754392+0000","last_clean":"2024-05-08T21:19:06.754392+0000","last_became_active":"2024-05-08T21:10:03.742819+0000","last_became_peered":"2024-05-08T21:10:03.742819+0000","last_unstale":"2024-05-08T21:19:06.754392+0000","last_undegraded":"2024-05-08T21:19:06.754392+0000","last_fullsized":"2024-05-08T21:19:06.754392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:41:25.593884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"32'3","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.751156+0000","last_change":"2024-05-08T21:10:03.340259+0000","last_active":"2024-05-08T21:19:06.751156+0000","last_peered":"2024-05-08T21:19:06.751156+0000","last_clean":"2024-05-08T21:19:06.751156+0000","last_became_active":"2024-05-08T21:10:03.339957+0000","last_became_peered":"2024-05-08T21:10:03.339957+0000","last_unstale":"2024-05-08T21:19:06.751156+0000","last_undegraded":"2024-05-08T21:19:06.751156+0000","last_fullsized":"2024-05-08T21:19:06.751156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:38:36.535689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"32'3595","reported_seq":3659,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:47.350416+0000","last_change":"2024-05-08T21:10:08.050370+0000","last_active":"2024-05-08T21:19:47.350416+0000","last_peered":"2024-05-08T21:19:47.350416+0000","last_clean":"2024-05-08T21:19:47.350416+0000","last_became_active":"2024-05-08T21:10:08.049962+0000","last_became_peered":"2024-05-08T21:10:08.049962+0000","last_unstale":"2024-05-08T21:19:47.350416+0000","last_undegraded":"2024-05-08T21:19:47.350416+0000","last_fullsized":"2024-05-08T21:19:47.350416+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":3595,"log_dups_size":0,"ondisk_log_size":3595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:11:35.394334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101093947,"num_objects":26,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":42,"num_read_kb":0,"num_write":47638,"num_write_kb":629817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"29'1","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T21:18:28.723333+0000","last_change":"2024-05-08T21:10:03.337949+0000","last_active":"2024-05-08T21:18:28.723333+0000","last_peered":"2024-05-08T21:18:28.723333+0000","last_clean":"2024-05-08T21:18:28.723333+0000","last_became_active":"2024-05-08T21:10:03.337627+0000","last_became_peered":"2024-05-08T21:10:03.337627+0000","last_unstale":"2024-05-08T21:18:28.723333+0000","last_undegraded":"2024-05-08T21:18:28.723333+0000","last_fullsized":"2024-05-08T21:18:28.723333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:17:36.792731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"32'6","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.751956+0000","last_change":"2024-05-08T21:10:03.738212+0000","last_active":"2024-05-08T21:19:06.751956+0000","last_peered":"2024-05-08T21:19:06.751956+0000","last_clean":"2024-05-08T21:19:06.751956+0000","last_became_active":"2024-05-08T21:10:03.737927+0000","last_became_peered":"2024-05-08T21:10:03.737927+0000","last_unstale":"2024-05-08T21:19:06.751956+0000","last_undegraded":"2024-05-08T21:19:06.751956+0000","last_fullsized":"2024-05-08T21:19:06.751956+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:03:08.031584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"32'4690","reported_seq":4786,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:48.321172+0000","last_change":"2024-05-08T21:10:08.052270+0000","last_active":"2024-05-08T21:19:48.321172+0000","last_peered":"2024-05-08T21:19:48.321172+0000","last_clean":"2024-05-08T21:19:48.321172+0000","last_became_active":"2024-05-08T21:10:08.051881+0000","last_became_peered":"2024-05-08T21:10:08.051881+0000","last_unstale":"2024-05-08T21:19:48.321172+0000","last_undegraded":"2024-05-08T21:19:48.321172+0000","last_fullsized":"2024-05-08T21:19:48.321172+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4690,"log_dups_size":0,"ondisk_log_size":4690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:39:07.929942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96538708,"num_objects":29,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":74,"num_read_kb":0,"num_write":60676,"num_write_kb":757240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"32'66","reported_seq":95,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:42.838264+0000","last_change":"2024-05-08T21:10:03.333696+0000","last_active":"2024-05-08T21:19:42.838264+0000","last_peered":"2024-05-08T21:19:42.838264+0000","last_clean":"2024-05-08T21:19:42.838264+0000","last_became_active":"2024-05-08T21:10:03.333368+0000","last_became_peered":"2024-05-08T21:10:03.333368+0000","last_unstale":"2024-05-08T21:19:42.838264+0000","last_undegraded":"2024-05-08T21:19:42.838264+0000","last_fullsized":"2024-05-08T21:19:42.838264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:00:08.459270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":34,"num_write":151,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"32'10","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:37.785783+0000","last_change":"2024-05-08T21:10:03.752578+0000","last_active":"2024-05-08T21:19:37.785783+0000","last_peered":"2024-05-08T21:19:37.785783+0000","last_clean":"2024-05-08T21:19:37.785783+0000","last_became_active":"2024-05-08T21:10:03.752389+0000","last_became_peered":"2024-05-08T21:10:03.752389+0000","last_unstale":"2024-05-08T21:19:37.785783+0000","last_undegraded":"2024-05-08T21:19:37.785783+0000","last_fullsized":"2024-05-08T21:19:37.785783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:54:02.318162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"32'3929","reported_seq":3996,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:49.588791+0000","last_change":"2024-05-08T21:10:08.048081+0000","last_active":"2024-05-08T21:19:49.588791+0000","last_peered":"2024-05-08T21:19:49.588791+0000","last_clean":"2024-05-08T21:19:49.588791+0000","last_became_active":"2024-05-08T21:10:08.047632+0000","last_became_peered":"2024-05-08T21:10:08.047632+0000","last_unstale":"2024-05-08T21:19:49.588791+0000","last_undegraded":"2024-05-08T21:19:49.588791+0000","last_fullsized":"2024-05-08T21:19:49.588791+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":3929,"log_dups_size":0,"ondisk_log_size":3929,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:26:05.857718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79790866,"num_objects":22,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":45,"num_read_kb":0,"num_write":51550,"num_write_kb":672103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"29'4","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:27.841501+0000","last_change":"2024-05-08T21:10:03.340553+0000","last_active":"2024-05-08T21:19:27.841501+0000","last_peered":"2024-05-08T21:19:27.841501+0000","last_clean":"2024-05-08T21:19:27.841501+0000","last_became_active":"2024-05-08T21:10:03.340280+0000","last_became_peered":"2024-05-08T21:10:03.340280+0000","last_unstale":"2024-05-08T21:19:27.841501+0000","last_undegraded":"2024-05-08T21:19:27.841501+0000","last_fullsized":"2024-05-08T21:19:27.841501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:36:24.866220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"32'15","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:45.825747+0000","last_change":"2024-05-08T21:10:03.736316+0000","last_active":"2024-05-08T21:19:45.825747+0000","last_peered":"2024-05-08T21:19:45.825747+0000","last_clean":"2024-05-08T21:19:45.825747+0000","last_became_active":"2024-05-08T21:10:03.736049+0000","last_became_peered":"2024-05-08T21:10:03.736049+0000","last_unstale":"2024-05-08T21:19:45.825747+0000","last_undegraded":"2024-05-08T21:19:45.825747+0000","last_fullsized":"2024-05-08T21:19:45.825747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:09:48.973609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'3520","reported_seq":3607,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:49.394723+0000","last_change":"2024-05-08T21:10:53.484914+0000","last_active":"2024-05-08T21:19:49.394723+0000","last_peered":"2024-05-08T21:19:49.394723+0000","last_clean":"2024-05-08T21:19:49.394723+0000","last_became_active":"2024-05-08T21:10:53.484443+0000","last_became_peered":"2024-05-08T21:10:53.484443+0000","last_unstale":"2024-05-08T21:19:49.394723+0000","last_undegraded":"2024-05-08T21:19:49.394723+0000","last_fullsized":"2024-05-08T21:19:49.394723+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":3520,"log_dups_size":0,"ondisk_log_size":3520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:09:00.867177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75631074,"num_objects":26,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":55,"num_read_kb":0,"num_write":45442,"num_write_kb":601547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T21:18:48.750694+0000","last_change":"2024-05-08T21:10:03.340078+0000","last_active":"2024-05-08T21:18:48.750694+0000","last_peered":"2024-05-08T21:18:48.750694+0000","last_clean":"2024-05-08T21:18:48.750694+0000","last_became_active":"2024-05-08T21:10:03.339690+0000","last_became_peered":"2024-05-08T21:10:03.339690+0000","last_unstale":"2024-05-08T21:18:48.750694+0000","last_undegraded":"2024-05-08T21:18:48.750694+0000","last_fullsized":"2024-05-08T21:18:48.750694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:01:33.991878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"32'6","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:35.411053+0000","last_change":"2024-05-08T21:10:03.744606+0000","last_active":"2024-05-08T21:19:35.411053+0000","last_peered":"2024-05-08T21:19:35.411053+0000","last_clean":"2024-05-08T21:19:35.411053+0000","last_became_active":"2024-05-08T21:10:03.744160+0000","last_became_peered":"2024-05-08T21:10:03.744160+0000","last_unstale":"2024-05-08T21:19:35.411053+0000","last_undegraded":"2024-05-08T21:19:35.411053+0000","last_fullsized":"2024-05-08T21:19:35.411053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:10:25.144058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'5102","reported_seq":5196,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:48.092722+0000","last_change":"2024-05-08T21:10:08.049224+0000","last_active":"2024-05-08T21:19:48.092722+0000","last_peered":"2024-05-08T21:19:48.092722+0000","last_clean":"2024-05-08T21:19:48.092722+0000","last_became_active":"2024-05-08T21:10:08.048866+0000","last_became_peered":"2024-05-08T21:10:08.048866+0000","last_unstale":"2024-05-08T21:19:48.092722+0000","last_undegraded":"2024-05-08T21:19:48.092722+0000","last_fullsized":"2024-05-08T21:19:48.092722+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":5102,"log_dups_size":0,"ondisk_log_size":5102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:38:20.601167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100678611,"num_objects":28,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":72,"num_read_kb":0,"num_write":66073,"num_write_kb":843075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T21:18:47.261015+0000","last_change":"2024-05-08T21:10:03.339344+0000","last_active":"2024-05-08T21:18:47.261015+0000","last_peered":"2024-05-08T21:18:47.261015+0000","last_clean":"2024-05-08T21:18:47.261015+0000","last_became_active":"2024-05-08T21:10:03.339136+0000","last_became_peered":"2024-05-08T21:10:03.339136+0000","last_unstale":"2024-05-08T21:18:47.261015+0000","last_undegraded":"2024-05-08T21:18:47.261015+0000","last_fullsized":"2024-05-08T21:18:47.261015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:02:55.623727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"32'9","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.753228+0000","last_change":"2024-05-08T21:10:03.737684+0000","last_active":"2024-05-08T21:19:06.753228+0000","last_peered":"2024-05-08T21:19:06.753228+0000","last_clean":"2024-05-08T21:19:06.753228+0000","last_became_active":"2024-05-08T21:10:03.737459+0000","last_became_peered":"2024-05-08T21:10:03.737459+0000","last_unstale":"2024-05-08T21:19:06.753228+0000","last_undegraded":"2024-05-08T21:19:06.753228+0000","last_fullsized":"2024-05-08T21:19:06.753228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:39.662018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"32'4228","reported_seq":4303,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:49.474196+0000","last_change":"2024-05-08T21:10:07.776483+0000","last_active":"2024-05-08T21:19:49.474196+0000","last_peered":"2024-05-08T21:19:49.474196+0000","last_clean":"2024-05-08T21:19:49.474196+0000","last_became_active":"2024-05-08T21:10:07.775956+0000","last_became_peered":"2024-05-08T21:10:07.775956+0000","last_unstale":"2024-05-08T21:19:49.474196+0000","last_undegraded":"2024-05-08T21:19:49.474196+0000","last_fullsized":"2024-05-08T21:19:49.474196+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4228,"log_dups_size":0,"ondisk_log_size":4228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:28:17.332488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58737657,"num_objects":20,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":53,"num_read_kb":0,"num_write":55064,"num_write_kb":703369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"29'1","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T21:18:52.261484+0000","last_change":"2024-05-08T21:10:03.331695+0000","last_active":"2024-05-08T21:18:52.261484+0000","last_peered":"2024-05-08T21:18:52.261484+0000","last_clean":"2024-05-08T21:18:52.261484+0000","last_became_active":"2024-05-08T21:10:03.331198+0000","last_became_peered":"2024-05-08T21:10:03.331198+0000","last_unstale":"2024-05-08T21:18:52.261484+0000","last_undegraded":"2024-05-08T21:18:52.261484+0000","last_fullsized":"2024-05-08T21:18:52.261484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:37:54.491930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"32'9","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.754603+0000","last_change":"2024-05-08T21:10:03.744562+0000","last_active":"2024-05-08T21:19:06.754603+0000","last_peered":"2024-05-08T21:19:06.754603+0000","last_clean":"2024-05-08T21:19:06.754603+0000","last_became_active":"2024-05-08T21:10:03.744326+0000","last_became_peered":"2024-05-08T21:10:03.744326+0000","last_unstale":"2024-05-08T21:19:06.754603+0000","last_undegraded":"2024-05-08T21:19:06.754603+0000","last_fullsized":"2024-05-08T21:19:06.754603+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:21:52.947209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'4098","reported_seq":4174,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:49.137569+0000","last_change":"2024-05-08T21:10:07.763204+0000","last_active":"2024-05-08T21:19:49.137569+0000","last_peered":"2024-05-08T21:19:49.137569+0000","last_clean":"2024-05-08T21:19:49.137569+0000","last_became_active":"2024-05-08T21:10:07.762886+0000","last_became_peered":"2024-05-08T21:10:07.762886+0000","last_unstale":"2024-05-08T21:19:49.137569+0000","last_undegraded":"2024-05-08T21:19:49.137569+0000","last_fullsized":"2024-05-08T21:19:49.137569+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4098,"log_dups_size":0,"ondisk_log_size":4098,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:01.599700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58939954,"num_objects":21,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":54,"num_read_kb":0,"num_write":53651,"num_write_kb":692300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"32'671","reported_seq":705,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:11.351259+0000","last_change":"2024-05-08T21:10:03.337993+0000","last_active":"2024-05-08T21:19:11.351259+0000","last_peered":"2024-05-08T21:19:11.351259+0000","last_clean":"2024-05-08T21:19:11.351259+0000","last_became_active":"2024-05-08T21:10:03.337654+0000","last_became_peered":"2024-05-08T21:10:03.337654+0000","last_unstale":"2024-05-08T21:19:11.351259+0000","last_undegraded":"2024-05-08T21:19:11.351259+0000","last_fullsized":"2024-05-08T21:19:11.351259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":671,"log_dups_size":0,"ondisk_log_size":671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:23:20.536178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":13,"num_read_kb":9261,"num_write":667,"num_write_kb":4529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"32'7","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.752034+0000","last_change":"2024-05-08T21:10:03.744871+0000","last_active":"2024-05-08T21:19:06.752034+0000","last_peered":"2024-05-08T21:19:06.752034+0000","last_clean":"2024-05-08T21:19:06.752034+0000","last_became_active":"2024-05-08T21:10:03.744589+0000","last_became_peered":"2024-05-08T21:10:03.744589+0000","last_unstale":"2024-05-08T21:19:06.752034+0000","last_undegraded":"2024-05-08T21:19:06.752034+0000","last_fullsized":"2024-05-08T21:19:06.752034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:41.090204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"32'3986","reported_seq":4056,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:49.451711+0000","last_change":"2024-05-08T21:10:08.047735+0000","last_active":"2024-05-08T21:19:49.451711+0000","last_peered":"2024-05-08T21:19:49.451711+0000","last_clean":"2024-05-08T21:19:49.451711+0000","last_became_active":"2024-05-08T21:10:08.047331+0000","last_became_peered":"2024-05-08T21:10:08.047331+0000","last_unstale":"2024-05-08T21:19:49.451711+0000","last_undegraded":"2024-05-08T21:19:49.451711+0000","last_fullsized":"2024-05-08T21:19:49.451711+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":3986,"log_dups_size":0,"ondisk_log_size":3986,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:44:22.797154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71358050,"num_objects":22,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":48,"num_read_kb":0,"num_write":52599,"num_write_kb":688417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.362283+0000","last_change":"2024-05-08T21:10:03.333117+0000","last_active":"2024-05-08T21:19:06.362283+0000","last_peered":"2024-05-08T21:19:06.362283+0000","last_clean":"2024-05-08T21:19:06.362283+0000","last_became_active":"2024-05-08T21:10:03.332790+0000","last_became_peered":"2024-05-08T21:10:03.332790+0000","last_unstale":"2024-05-08T21:19:06.362283+0000","last_undegraded":"2024-05-08T21:19:06.362283+0000","last_fullsized":"2024-05-08T21:19:06.362283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:52:36.355804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'10","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:42.545945+0000","last_change":"2024-05-08T21:10:03.748047+0000","last_active":"2024-05-08T21:19:42.545945+0000","last_peered":"2024-05-08T21:19:42.545945+0000","last_clean":"2024-05-08T21:19:42.545945+0000","last_became_active":"2024-05-08T21:10:03.747759+0000","last_became_peered":"2024-05-08T21:10:03.747759+0000","last_unstale":"2024-05-08T21:19:42.545945+0000","last_undegraded":"2024-05-08T21:19:42.545945+0000","last_fullsized":"2024-05-08T21:19:42.545945+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:11:05.309278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"32'3761","reported_seq":3840,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:47.350916+0000","last_change":"2024-05-08T21:10:07.761000+0000","last_active":"2024-05-08T21:19:47.350916+0000","last_peered":"2024-05-08T21:19:47.350916+0000","last_clean":"2024-05-08T21:19:47.350916+0000","last_became_active":"2024-05-08T21:10:07.760566+0000","last_became_peered":"2024-05-08T21:10:07.760566+0000","last_unstale":"2024-05-08T21:19:47.350916+0000","last_undegraded":"2024-05-08T21:19:47.350916+0000","last_fullsized":"2024-05-08T21:19:47.350916+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":3761,"log_dups_size":0,"ondisk_log_size":3761,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:48:27.435678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100952383,"num_objects":32,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":57,"num_read_kb":0,"num_write":48613,"num_write_kb":636437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"26'1","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.751644+0000","last_change":"2024-05-08T21:10:03.331358+0000","last_active":"2024-05-08T21:19:06.751644+0000","last_peered":"2024-05-08T21:19:06.751644+0000","last_clean":"2024-05-08T21:19:06.751644+0000","last_became_active":"2024-05-08T21:10:03.331028+0000","last_became_peered":"2024-05-08T21:10:03.331028+0000","last_unstale":"2024-05-08T21:19:06.751644+0000","last_undegraded":"2024-05-08T21:19:06.751644+0000","last_fullsized":"2024-05-08T21:19:06.751644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:18:47.922157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"32'8","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:12.888041+0000","last_change":"2024-05-08T21:10:03.751285+0000","last_active":"2024-05-08T21:19:12.888041+0000","last_peered":"2024-05-08T21:19:12.888041+0000","last_clean":"2024-05-08T21:19:12.888041+0000","last_became_active":"2024-05-08T21:10:03.746557+0000","last_became_peered":"2024-05-08T21:10:03.746557+0000","last_unstale":"2024-05-08T21:19:12.888041+0000","last_undegraded":"2024-05-08T21:19:12.888041+0000","last_fullsized":"2024-05-08T21:19:12.888041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:50:27.241404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"32'3702","reported_seq":3767,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:47.314738+0000","last_change":"2024-05-08T21:10:08.048830+0000","last_active":"2024-05-08T21:19:47.314738+0000","last_peered":"2024-05-08T21:19:47.314738+0000","last_clean":"2024-05-08T21:19:47.314738+0000","last_became_active":"2024-05-08T21:10:08.048453+0000","last_became_peered":"2024-05-08T21:10:08.048453+0000","last_unstale":"2024-05-08T21:19:47.314738+0000","last_undegraded":"2024-05-08T21:19:47.314738+0000","last_fullsized":"2024-05-08T21:19:47.314738+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":3702,"log_dups_size":0,"ondisk_log_size":3702,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:19:28.758712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138428923,"num_objects":37,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":43,"num_read_kb":0,"num_write":49303,"num_write_kb":639424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"29'3","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:27.840261+0000","last_change":"2024-05-08T21:10:03.330419+0000","last_active":"2024-05-08T21:19:27.840261+0000","last_peered":"2024-05-08T21:19:27.840261+0000","last_clean":"2024-05-08T21:19:27.840261+0000","last_became_active":"2024-05-08T21:10:03.330082+0000","last_became_peered":"2024-05-08T21:10:03.330082+0000","last_unstale":"2024-05-08T21:19:27.840261+0000","last_undegraded":"2024-05-08T21:19:27.840261+0000","last_fullsized":"2024-05-08T21:19:27.840261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:09:20.516386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"32'10","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:39.926986+0000","last_change":"2024-05-08T21:10:03.747306+0000","last_active":"2024-05-08T21:19:39.926986+0000","last_peered":"2024-05-08T21:19:39.926986+0000","last_clean":"2024-05-08T21:19:39.926986+0000","last_became_active":"2024-05-08T21:10:03.746755+0000","last_became_peered":"2024-05-08T21:10:03.746755+0000","last_unstale":"2024-05-08T21:19:39.926986+0000","last_undegraded":"2024-05-08T21:19:39.926986+0000","last_fullsized":"2024-05-08T21:19:39.926986+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:17:51.344821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"32'12","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:45.387079+0000","last_change":"2024-05-08T21:10:03.738627+0000","last_active":"2024-05-08T21:19:45.387079+0000","last_peered":"2024-05-08T21:19:45.387079+0000","last_clean":"2024-05-08T21:19:45.387079+0000","last_became_active":"2024-05-08T21:10:03.738338+0000","last_became_peered":"2024-05-08T21:10:03.738338+0000","last_unstale":"2024-05-08T21:19:45.387079+0000","last_undegraded":"2024-05-08T21:19:45.387079+0000","last_fullsized":"2024-05-08T21:19:45.387079+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:34.088831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"32'13","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:44.614454+0000","last_change":"2024-05-08T21:10:03.745607+0000","last_active":"2024-05-08T21:19:44.614454+0000","last_peered":"2024-05-08T21:19:44.614454+0000","last_clean":"2024-05-08T21:19:44.614454+0000","last_became_active":"2024-05-08T21:10:03.745362+0000","last_became_peered":"2024-05-08T21:10:03.745362+0000","last_unstale":"2024-05-08T21:19:44.614454+0000","last_undegraded":"2024-05-08T21:19:44.614454+0000","last_fullsized":"2024-05-08T21:19:44.614454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:54.399930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"32'13","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:41.631427+0000","last_change":"2024-05-08T21:10:03.745137+0000","last_active":"2024-05-08T21:19:41.631427+0000","last_peered":"2024-05-08T21:19:41.631427+0000","last_clean":"2024-05-08T21:19:41.631427+0000","last_became_active":"2024-05-08T21:10:03.744844+0000","last_became_peered":"2024-05-08T21:10:03.744844+0000","last_unstale":"2024-05-08T21:19:41.631427+0000","last_undegraded":"2024-05-08T21:19:41.631427+0000","last_fullsized":"2024-05-08T21:19:41.631427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:06.853429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"32'10","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.753771+0000","last_change":"2024-05-08T21:10:03.745163+0000","last_active":"2024-05-08T21:19:06.753771+0000","last_peered":"2024-05-08T21:19:06.753771+0000","last_clean":"2024-05-08T21:19:06.753771+0000","last_became_active":"2024-05-08T21:10:03.744908+0000","last_became_peered":"2024-05-08T21:10:03.744908+0000","last_unstale":"2024-05-08T21:19:06.753771+0000","last_undegraded":"2024-05-08T21:19:06.753771+0000","last_fullsized":"2024-05-08T21:19:06.753771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:06.593989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'7","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.753879+0000","last_change":"2024-05-08T21:10:03.748542+0000","last_active":"2024-05-08T21:19:06.753879+0000","last_peered":"2024-05-08T21:19:06.753879+0000","last_clean":"2024-05-08T21:19:06.753879+0000","last_became_active":"2024-05-08T21:10:03.748284+0000","last_became_peered":"2024-05-08T21:10:03.748284+0000","last_unstale":"2024-05-08T21:19:06.753879+0000","last_undegraded":"2024-05-08T21:19:06.753879+0000","last_fullsized":"2024-05-08T21:19:06.753879+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:49:10.430406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"32'8","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:41.799210+0000","last_change":"2024-05-08T21:10:03.739778+0000","last_active":"2024-05-08T21:19:41.799210+0000","last_peered":"2024-05-08T21:19:41.799210+0000","last_clean":"2024-05-08T21:19:41.799210+0000","last_became_active":"2024-05-08T21:10:03.739522+0000","last_became_peered":"2024-05-08T21:10:03.739522+0000","last_unstale":"2024-05-08T21:19:41.799210+0000","last_undegraded":"2024-05-08T21:19:41.799210+0000","last_fullsized":"2024-05-08T21:19:41.799210+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:07:42.115999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"32'7","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:32.484326+0000","last_change":"2024-05-08T21:10:03.746126+0000","last_active":"2024-05-08T21:19:32.484326+0000","last_peered":"2024-05-08T21:19:32.484326+0000","last_clean":"2024-05-08T21:19:32.484326+0000","last_became_active":"2024-05-08T21:10:03.745842+0000","last_became_peered":"2024-05-08T21:10:03.745842+0000","last_unstale":"2024-05-08T21:19:32.484326+0000","last_undegraded":"2024-05-08T21:19:32.484326+0000","last_fullsized":"2024-05-08T21:19:32.484326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:51:06.176371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"32'7","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:32.220655+0000","last_change":"2024-05-08T21:10:53.473916+0000","last_active":"2024-05-08T21:19:32.220655+0000","last_peered":"2024-05-08T21:19:32.220655+0000","last_clean":"2024-05-08T21:19:32.220655+0000","last_became_active":"2024-05-08T21:10:53.473615+0000","last_became_peered":"2024-05-08T21:10:53.473615+0000","last_unstale":"2024-05-08T21:19:32.220655+0000","last_undegraded":"2024-05-08T21:19:32.220655+0000","last_fullsized":"2024-05-08T21:19:32.220655+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:58:21.728711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"32'9","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:46.085484+0000","last_change":"2024-05-08T21:10:03.751111+0000","last_active":"2024-05-08T21:19:46.085484+0000","last_peered":"2024-05-08T21:19:46.085484+0000","last_clean":"2024-05-08T21:19:46.085484+0000","last_became_active":"2024-05-08T21:10:03.747059+0000","last_became_peered":"2024-05-08T21:10:03.747059+0000","last_unstale":"2024-05-08T21:19:46.085484+0000","last_undegraded":"2024-05-08T21:19:46.085484+0000","last_fullsized":"2024-05-08T21:19:46.085484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:43.254221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"32'12","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:41.438674+0000","last_change":"2024-05-08T21:10:03.747207+0000","last_active":"2024-05-08T21:19:41.438674+0000","last_peered":"2024-05-08T21:19:41.438674+0000","last_clean":"2024-05-08T21:19:41.438674+0000","last_became_active":"2024-05-08T21:10:03.746942+0000","last_became_peered":"2024-05-08T21:10:03.746942+0000","last_unstale":"2024-05-08T21:19:41.438674+0000","last_undegraded":"2024-05-08T21:19:41.438674+0000","last_fullsized":"2024-05-08T21:19:41.438674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:33:52.317273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"32'11","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:44.490151+0000","last_change":"2024-05-08T21:10:03.753663+0000","last_active":"2024-05-08T21:19:44.490151+0000","last_peered":"2024-05-08T21:19:44.490151+0000","last_clean":"2024-05-08T21:19:44.490151+0000","last_became_active":"2024-05-08T21:10:03.752486+0000","last_became_peered":"2024-05-08T21:10:03.752486+0000","last_unstale":"2024-05-08T21:19:44.490151+0000","last_undegraded":"2024-05-08T21:19:44.490151+0000","last_fullsized":"2024-05-08T21:19:44.490151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:21:45.895154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"32'11","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:12.559115+0000","last_change":"2024-05-08T21:10:03.753849+0000","last_active":"2024-05-08T21:19:12.559115+0000","last_peered":"2024-05-08T21:19:12.559115+0000","last_clean":"2024-05-08T21:19:12.559115+0000","last_became_active":"2024-05-08T21:10:03.753616+0000","last_became_peered":"2024-05-08T21:10:03.753616+0000","last_unstale":"2024-05-08T21:19:12.559115+0000","last_undegraded":"2024-05-08T21:19:12.559115+0000","last_fullsized":"2024-05-08T21:19:12.559115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:02:58.650310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"29'7","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.751337+0000","last_change":"2024-05-08T21:10:03.744906+0000","last_active":"2024-05-08T21:19:06.751337+0000","last_peered":"2024-05-08T21:19:06.751337+0000","last_clean":"2024-05-08T21:19:06.751337+0000","last_became_active":"2024-05-08T21:10:03.744562+0000","last_became_peered":"2024-05-08T21:10:03.744562+0000","last_unstale":"2024-05-08T21:19:06.751337+0000","last_undegraded":"2024-05-08T21:19:06.751337+0000","last_fullsized":"2024-05-08T21:19:06.751337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:21:30.416392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2737263954,"num_objects":842,"num_object_clones":0,"num_object_copies":3368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":842,"num_whiteouts":0,"num_read":1810,"num_read_kb":0,"num_write":1713563,"num_write_kb":22146371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3309109248,"data_stored":5409390592,"data_compressed":328742466,"data_compressed_allocated":1018662912,"data_compressed_original":3118944256,"omap_allocated":0,"internal_metadata":0},"log_size":131566,"ondisk_log_size":131566,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":557,"ondisk_log_size":557,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64612,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":15836278,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":328,"num_read_kb":39720,"num_write":2864,"num_write_kb":17763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17805312,"data_stored":31673694,"data_compressed":2933172,"data_compressed_allocated":3907584,"data_compressed_original":17833984,"omap_allocated":0,"internal_metadata":0},"log_size":2816,"ondisk_log_size":2816,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509560,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1358248,"kb_used_data":450912,"kb_used_omap":1,"kb_used_meta":907326,"kb_avail":93013592,"statfs":{"total":96636764160,"available":95245918208,"internally_reserved":0,"allocated":461733888,"data_stored":766461979,"data_compressed":47292655,"data_compressed_allocated":144924672,"data_compressed_original":449855488,"omap_allocated":1593,"internal_metadata":929102279},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:19:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.9790000000000001,"15min":1.603},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":5.5289999999999999,"5min":13.432,"15min":17.978999999999999},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.91700000000000004,"5min":1.4750000000000001,"15min":1.0800000000000001},"min":{"1min":0.24299999999999999,"5min":0.219,"15min":0.219},"max":{"1min":5.2889999999999997,"5min":10.097,"15min":11.362},"last":0.375}]},{"osd":1,"last update":"Wed May 8 21:19:07 2024","interfaces":[{"interface":"back","average":{"1min":2.2170000000000001,"5min":2.831,"15min":1.863},"min":{"1min":0.247,"5min":0.219,"15min":0.219},"max":{"1min":9.7360000000000007,"5min":49.942999999999998,"15min":49.942999999999998},"last":17.797000000000001},{"interface":"front","average":{"1min":1.726,"5min":2.5259999999999998,"15min":1.516},"min":{"1min":0.45100000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":5.2789999999999999,"5min":27.733000000000001,"15min":27.733000000000001},"last":2.5379999999999998}]},{"osd":2,"last update":"Wed May 8 21:19:07 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":1.583,"15min":1.6970000000000001},"min":{"1min":0.27100000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":2.7189999999999999,"5min":17.858000000000001,"15min":58.450000000000003},"last":0.80100000000000005},{"interface":"front","average":{"1min":1.165,"5min":1.639,"15min":1.1319999999999999},"min":{"1min":0.32000000000000001,"5min":0.30199999999999999,"15min":0.27400000000000002},"max":{"1min":4.6559999999999997,"5min":13.568,"15min":14.746},"last":0.51000000000000001}]},{"osd":3,"last update":"Wed May 8 21:19:07 2024","interfaces":[{"interface":"back","average":{"1min":1.6379999999999999,"5min":4.3520000000000003,"15min":2.617},"min":{"1min":0.35499999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":6.1879999999999997,"5min":68.728999999999999,"15min":74.570999999999998},"last":3.847},{"interface":"front","average":{"1min":1.173,"5min":2.3490000000000002,"15min":1.6279999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":11.816000000000001,"5min":27.358000000000001,"15min":28.099},"last":16.302}]},{"osd":4,"last update":"Wed May 8 21:19:07 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":1.5580000000000001,"15min":1.1319999999999999},"min":{"1min":0.23300000000000001,"5min":0.223,"15min":0.223},"max":{"1min":8.0869999999999997,"5min":27.963000000000001,"15min":29.731000000000002},"last":0.25},{"interface":"front","average":{"1min":1.258,"5min":1.5660000000000001,"15min":1.1519999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":10.657999999999999,"5min":17.835999999999999,"15min":26.454999999999998},"last":0.39000000000000001}]},{"osd":5,"last update":"Wed May 8 21:19:07 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":1.1000000000000001,"15min":1.177},"min":{"1min":0.30099999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":2.4510000000000001,"5min":17.780999999999999,"15min":65.373000000000005},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":1.2809999999999999,"15min":1.046},"min":{"1min":0.28399999999999997,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.357,"5min":13.509,"15min":26.498999999999999},"last":0.35699999999999998}]},{"osd":7,"last update":"Wed May 8 21:19:07 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":1.7889999999999999,"15min":1.0589999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.9450000000000001,"5min":16.808,"15min":16.808},"last":0.318},{"interface":"front","average":{"1min":0.57599999999999996,"5min":1.4770000000000001,"15min":0.96499999999999997},"min":{"1min":0.33600000000000002,"5min":0.314,"15min":0.314},"max":{"1min":1.821,"5min":18.100999999999999,"15min":18.100999999999999},"last":0.32900000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509561,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1087120,"kb_used_data":413448,"kb_used_omap":1,"kb_used_meta":673662,"kb_avail":93284720,"statfs":{"total":96636764160,"available":95523553280,"internally_reserved":0,"allocated":423370752,"data_stored":688813525,"data_compressed":41956954,"data_compressed_allocated":130084864,"data_compressed_original":395726848,"omap_allocated":1594,"internal_metadata":689830342},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":1.8360000000000001,"15min":1.4450000000000001},"min":{"1min":0.24199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":7.8029999999999999,"5min":17.295999999999999,"15min":48.481999999999999},"last":2.738},{"interface":"front","average":{"1min":1.619,"5min":2.0600000000000001,"15min":1.522},"min":{"1min":0.36299999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":13.234999999999999,"5min":17.164000000000001,"15min":30.004999999999999},"last":4.4900000000000002}]},{"osd":1,"last update":"Wed May 8 21:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":2.7120000000000002,"15min":1.7310000000000001},"min":{"1min":0.26800000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":3.0550000000000002,"5min":21.702999999999999,"15min":25.228000000000002},"last":6.6870000000000003},{"interface":"front","average":{"1min":0.86299999999999999,"5min":2.4710000000000001,"15min":1.403},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":4.0670000000000002,"5min":21.869,"15min":21.869},"last":6.766}]},{"osd":2,"last update":"Wed May 8 21:19:19 2024","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":3.0019999999999998,"15min":1.6699999999999999},"min":{"1min":0.29399999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":10.689,"5min":34.850000000000001,"15min":34.850000000000001},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":2.4430000000000001,"15min":1.4690000000000001},"min":{"1min":0.28899999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.617,"5min":29.623000000000001,"15min":29.623000000000001},"last":0.93200000000000005}]},{"osd":3,"last update":"Wed May 8 21:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":1.8029999999999999,"15min":1.377},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":4.1070000000000002,"5min":19.395,"15min":23.234999999999999},"last":6.7999999999999998},{"interface":"front","average":{"1min":1.55,"5min":3.6520000000000001,"15min":2.0489999999999999},"min":{"1min":0.34399999999999997,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":20.013000000000002,"5min":40.954999999999998,"15min":40.954999999999998},"last":6.9980000000000002}]},{"osd":4,"last update":"Wed May 8 21:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":1.0369999999999999,"15min":0.89800000000000002},"min":{"1min":0.27500000000000002,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.95599999999999996,"5min":12.390000000000001,"15min":23.254000000000001},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":1.0820000000000001,"15min":0.93999999999999995},"min":{"1min":0.32300000000000001,"5min":0.27600000000000002,"15min":0.26600000000000001},"max":{"1min":3.0859999999999999,"5min":7.7370000000000001,"15min":17.550999999999998},"last":0.34599999999999997}]},{"osd":6,"last update":"Wed May 8 21:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.95299999999999996,"15min":0.89100000000000001},"min":{"1min":0.26900000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.747,"5min":8.7249999999999996,"15min":17.856000000000002},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":1.1619999999999999,"15min":1.0029999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.26900000000000002},"max":{"1min":0.77700000000000002,"5min":8.9269999999999996,"15min":17.827999999999999},"last":0.40999999999999998}]},{"osd":7,"last update":"Wed May 8 21:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":1.1739999999999999,"15min":0.92900000000000005},"min":{"1min":0.311,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.98499999999999999,"5min":11.183999999999999,"15min":18.079000000000001},"last":0.371},{"interface":"front","average":{"1min":0.73499999999999999,"5min":1.464,"15min":1.1659999999999999},"min":{"1min":0.30599999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":4.8819999999999997,"5min":13.496,"15min":30.050000000000001},"last":0.39300000000000002}]}]},{"osd":0,"up_from":14,"seq":60129542265,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1273124,"kb_used_data":511068,"kb_used_omap":1,"kb_used_meta":762046,"kb_avail":93098716,"statfs":{"total":96636764160,"available":95333085184,"internally_reserved":0,"allocated":523333632,"data_stored":837461602,"data_compressed":50494929,"data_compressed_allocated":155848704,"data_compressed_original":470188032,"omap_allocated":1594,"internal_metadata":780335558},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 8 21:19:14 2024","interfaces":[{"interface":"back","average":{"1min":3.8900000000000001,"5min":2.9590000000000001,"15min":1.925},"min":{"1min":0.193,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":24.199999999999999,"5min":24.199999999999999,"15min":98.899000000000001},"last":2.4279999999999999},{"interface":"front","average":{"1min":2.4420000000000002,"5min":2.8100000000000001,"15min":1.6519999999999999},"min":{"1min":0.24199999999999999,"5min":0.185,"15min":0.185},"max":{"1min":13.778,"5min":25.295999999999999,"15min":39.594000000000001},"last":1.9390000000000001}]},{"osd":2,"last update":"Wed May 8 21:19:14 2024","interfaces":[{"interface":"back","average":{"1min":3.2759999999999998,"5min":2.4390000000000001,"15min":1.6479999999999999},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.224},"max":{"1min":21.695,"5min":27.657,"15min":33.238999999999997},"last":0.25600000000000001},{"interface":"front","average":{"1min":1.7949999999999999,"5min":1.8240000000000001,"15min":1.0800000000000001},"min":{"1min":0.26500000000000001,"5min":0.22500000000000001,"15min":0.223},"max":{"1min":17.302,"5min":27.027000000000001,"15min":27.027000000000001},"last":0.218}]},{"osd":3,"last update":"Wed May 8 21:19:14 2024","interfaces":[{"interface":"back","average":{"1min":1.7090000000000001,"5min":2.9100000000000001,"15min":2.1909999999999998},"min":{"1min":0.28499999999999998,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":17.355,"5min":30.341999999999999,"15min":77.010999999999996},"last":1.9750000000000001},{"interface":"front","average":{"1min":1.879,"5min":2.069,"15min":1.653},"min":{"1min":0.33400000000000002,"5min":0.29199999999999998,"15min":0.28899999999999998},"max":{"1min":17.271000000000001,"5min":29.155999999999999,"15min":93.995999999999995},"last":2.464}]},{"osd":4,"last update":"Wed May 8 21:19:14 2024","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":2.0990000000000002,"15min":1.7330000000000001},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":6.8259999999999996,"5min":27.513999999999999,"15min":33.121000000000002},"last":0.53100000000000003},{"interface":"front","average":{"1min":1.196,"5min":2.149,"15min":1.474},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":9.1869999999999994,"5min":27.48,"15min":27.48},"last":5.1340000000000003}]},{"osd":5,"last update":"Wed May 8 21:19:14 2024","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":2.1440000000000001,"15min":1.5009999999999999},"min":{"1min":0.32100000000000001,"5min":0.311,"15min":0.311},"max":{"1min":7.3339999999999996,"5min":13.412000000000001,"15min":29.919},"last":6.4020000000000001},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.923,"15min":1.714},"min":{"1min":0.34100000000000003,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":9.3979999999999997,"5min":20.626999999999999,"15min":33.209000000000003},"last":5.1799999999999997}]},{"osd":6,"last update":"Wed May 8 21:19:14 2024","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":1.738,"15min":1.4159999999999999},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":7.702,"5min":11.276999999999999,"15min":19.527999999999999},"last":6.4279999999999999},{"interface":"front","average":{"1min":1.599,"5min":2.2690000000000001,"15min":1.4390000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":9.2219999999999995,"5min":15.829000000000001,"15min":29.800000000000001},"last":5.1630000000000003}]},{"osd":7,"last update":"Wed May 8 21:19:14 2024","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":2.0179999999999998,"15min":1.639},"min":{"1min":0.35699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":8.952,"5min":11.372999999999999,"15min":33.174999999999997},"last":0.62},{"interface":"front","average":{"1min":1.0089999999999999,"5min":2.351,"15min":1.4690000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":4.7450000000000001,"5min":21.097999999999999,"15min":21.097999999999999},"last":0.63500000000000001}]}]},{"osd":7,"up_from":14,"seq":60129542265,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1245688,"kb_used_data":383856,"kb_used_omap":1,"kb_used_meta":860350,"kb_avail":93126152,"statfs":{"total":96636764160,"available":95361179648,"internally_reserved":0,"allocated":393068544,"data_stored":644222368,"data_compressed":39380739,"data_compressed_allocated":120668160,"data_compressed_original":372027392,"omap_allocated":1589,"internal_metadata":880998859},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:19:08 2024","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":2.21,"15min":1.1799999999999999},"min":{"1min":0.217,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":10.747999999999999,"5min":20.876999999999999,"15min":20.876999999999999},"last":0.26800000000000002},{"interface":"front","average":{"1min":1.343,"5min":2.1579999999999999,"15min":1.4730000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":4.0570000000000004,"5min":23.748999999999999,"15min":62.033000000000001},"last":1.5129999999999999}]},{"osd":1,"last update":"Wed May 8 21:19:17 2024","interfaces":[{"interface":"back","average":{"1min":1.9350000000000001,"5min":2.8330000000000002,"15min":2.04},"min":{"1min":0.251,"5min":0.251,"15min":0.246},"max":{"1min":23.103999999999999,"5min":44.164000000000001,"15min":44.645000000000003},"last":2.2280000000000002},{"interface":"front","average":{"1min":1.7050000000000001,"5min":2.395,"15min":1.3720000000000001},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":8.3339999999999996,"5min":44.091000000000001,"15min":44.091000000000001},"last":16.209}]},{"osd":2,"last update":"Wed May 8 21:19:08 2024","interfaces":[{"interface":"back","average":{"1min":2.3740000000000001,"5min":2.0870000000000002,"15min":1.131},"min":{"1min":0.34599999999999997,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":11.388999999999999,"5min":15.986000000000001,"15min":15.986000000000001},"last":1.4139999999999999},{"interface":"front","average":{"1min":2.121,"5min":1.833,"15min":1.028},"min":{"1min":0.45000000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":9.3949999999999996,"5min":11.112,"15min":11.112},"last":1.4410000000000001}]},{"osd":3,"last update":"Wed May 8 21:19:08 2024","interfaces":[{"interface":"back","average":{"1min":2.3969999999999998,"5min":3.1320000000000001,"15min":1.5880000000000001},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":9.8789999999999996,"5min":44.064999999999998,"15min":44.064999999999998},"last":2.415},{"interface":"front","average":{"1min":1.7649999999999999,"5min":2.661,"15min":1.7050000000000001},"min":{"1min":0.379,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":15.789,"5min":44.607999999999997,"15min":44.607999999999997},"last":2.3029999999999999}]},{"osd":4,"last update":"Wed May 8 21:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":1.0549999999999999,"15min":0.82699999999999996},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":3.1850000000000001,"5min":10.51,"15min":21.338000000000001},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.80200000000000005,"5min":1.302,"15min":0.94799999999999995},"min":{"1min":0.27900000000000003,"5min":0.216,"15min":0.216},"max":{"1min":3.242,"5min":16.082999999999998,"15min":22.827000000000002},"last":0.29799999999999999}]},{"osd":5,"last update":"Wed May 8 21:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.079,"15min":0.85299999999999998},"min":{"1min":0.28899999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":10.785,"5min":10.785,"15min":10.880000000000001},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.60899999999999999,"5min":1.026,"15min":0.84699999999999998},"min":{"1min":0.32700000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.613,"5min":7.4939999999999998,"15min":8.157},"last":0.36699999999999999}]},{"osd":6,"last update":"Wed May 8 21:19:17 2024","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.2909999999999999,"15min":0.86099999999999999},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":12.433,"5min":12.433,"15min":12.433},"last":0.32100000000000001},{"interface":"front","average":{"1min":1.252,"5min":1.546,"15min":1.052},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":12.182,"5min":19.864999999999998,"15min":19.864999999999998},"last":0.38500000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574969,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":867872,"kb_used_data":134212,"kb_used_omap":1,"kb_used_meta":729534,"kb_avail":93503968,"statfs":{"total":96636764160,"available":95748063232,"internally_reserved":0,"allocated":137433088,"data_stored":235721958,"data_compressed":14466032,"data_compressed_allocated":44556288,"data_compressed_original":143040512,"omap_allocated":1594,"internal_metadata":747043270},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,2],"upper_bound":64},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:19:12 2024","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":2.6640000000000001,"15min":1.5049999999999999},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.20399999999999999},"max":{"1min":7.3049999999999997,"5min":17.789000000000001,"15min":24.859999999999999},"last":7.3479999999999999},{"interface":"front","average":{"1min":1.486,"5min":2.1960000000000002,"15min":1.3759999999999999},"min":{"1min":0.27200000000000002,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":7.4560000000000004,"5min":17.835999999999999,"15min":49.606000000000002},"last":0.69599999999999995}]},{"osd":1,"last update":"Wed May 8 21:19:12 2024","interfaces":[{"interface":"back","average":{"1min":3.0430000000000001,"5min":2.6960000000000002,"15min":1.7470000000000001},"min":{"1min":0.26500000000000001,"5min":0.218,"15min":0.19800000000000001},"max":{"1min":24.321999999999999,"5min":25.135999999999999,"15min":55.296999999999997},"last":6.3570000000000002},{"interface":"front","average":{"1min":2.706,"5min":2.4990000000000001,"15min":1.7090000000000001},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":24.149999999999999,"5min":24.149999999999999,"15min":79.221000000000004},"last":0.72699999999999998}]},{"osd":3,"last update":"Wed May 8 21:19:12 2024","interfaces":[{"interface":"back","average":{"1min":2.1440000000000001,"5min":4.8819999999999997,"15min":2.1600000000000001},"min":{"1min":0.32000000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":7.7510000000000003,"5min":69.888000000000005,"15min":69.888000000000005},"last":6.4589999999999996},{"interface":"front","average":{"1min":2.1829999999999998,"5min":4.931,"15min":2.198},"min":{"1min":0.33900000000000002,"5min":0.30199999999999999,"15min":0.23699999999999999},"max":{"1min":7.7850000000000001,"5min":69.959000000000003,"15min":69.959000000000003},"last":6.4790000000000001}]},{"osd":4,"last update":"Wed May 8 21:19:12 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":1.8979999999999999,"15min":1.4319999999999999},"min":{"1min":0.34999999999999998,"5min":0.253,"15min":0.253},"max":{"1min":2.2170000000000001,"5min":17.716999999999999,"15min":32.457999999999998},"last":2.5600000000000001},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.823,"15min":1.171},"min":{"1min":0.25700000000000001,"5min":0.255,"15min":0.255},"max":{"1min":7.3940000000000001,"5min":13.827,"15min":18.315000000000001},"last":2.524}]},{"osd":5,"last update":"Wed May 8 21:19:12 2024","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.655,"15min":1.079},"min":{"1min":0.38500000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":4.4219999999999997,"5min":17.507999999999999,"15min":17.507999999999999},"last":6.3049999999999997},{"interface":"front","average":{"1min":0.72399999999999998,"5min":2.6200000000000001,"15min":1.6200000000000001},"min":{"1min":0.30299999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.744,"5min":48.560000000000002,"15min":48.560000000000002},"last":0.58199999999999996}]},{"osd":6,"last update":"Wed May 8 21:19:12 2024","interfaces":[{"interface":"back","average":{"1min":1.4770000000000001,"5min":1.911,"15min":1.246},"min":{"1min":0.39300000000000002,"5min":0.308,"15min":0.308},"max":{"1min":7.4290000000000003,"5min":13.933999999999999,"15min":16.399999999999999},"last":2.7450000000000001},{"interface":"front","average":{"1min":1.196,"5min":1.9970000000000001,"15min":1.2909999999999999},"min":{"1min":0.46800000000000003,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":4.4649999999999999,"5min":17.536000000000001,"15min":23.216000000000001},"last":6.4109999999999996}]},{"osd":7,"last update":"Wed May 8 21:19:12 2024","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.9750000000000001,"15min":1.2929999999999999},"min":{"1min":0.42499999999999999,"5min":0.33200000000000002,"15min":0.33000000000000002},"max":{"1min":4.492,"5min":11.041,"15min":16.366},"last":6.3879999999999999},{"interface":"front","average":{"1min":1.6499999999999999,"5min":1.7509999999999999,"15min":1.1439999999999999},"min":{"1min":0.46200000000000002,"5min":0.313,"15min":0.313},"max":{"1min":7.4820000000000002,"5min":13.903,"15min":13.903},"last":6.4340000000000002}]}]},{"osd":3,"up_from":14,"seq":60129542261,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1811820,"kb_used_data":588812,"kb_used_omap":1,"kb_used_meta":1221822,"kb_avail":92560020,"statfs":{"total":96636764160,"available":94781460480,"internally_reserved":0,"allocated":602943488,"data_stored":976287622,"data_compressed":58864613,"data_compressed_allocated":181178368,"data_compressed_original":554725376,"omap_allocated":1592,"internal_metadata":1251146184},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,1,2,5,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:19:20 2024","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":2.9950000000000001,"15min":1.3879999999999999},"min":{"1min":0.24299999999999999,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":7.2930000000000001,"5min":39.801000000000002,"15min":39.801000000000002},"last":5.5},{"interface":"front","average":{"1min":1.3049999999999999,"5min":2.0680000000000001,"15min":1.7569999999999999},"min":{"1min":0.26000000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":10.782,"5min":14.497,"15min":60.847999999999999},"last":5.5170000000000003}]},{"osd":1,"last update":"Wed May 8 21:19:20 2024","interfaces":[{"interface":"back","average":{"1min":2.5249999999999999,"5min":3.3759999999999999,"15min":1.851},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":15.603,"5min":47.418999999999997,"15min":57.020000000000003},"last":5.5519999999999996},{"interface":"front","average":{"1min":4.6790000000000003,"5min":4.5030000000000001,"15min":2.0070000000000001},"min":{"1min":0.26300000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":29.669,"5min":43.317,"15min":43.317},"last":14.468999999999999}]},{"osd":2,"last update":"Wed May 8 21:19:20 2024","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.714,"15min":1.105},"min":{"1min":0.32000000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":10.712999999999999,"5min":10.938000000000001,"15min":32.247999999999998},"last":5.4649999999999999},{"interface":"front","average":{"1min":1.5029999999999999,"5min":3.1099999999999999,"15min":1.5780000000000001},"min":{"1min":0.33300000000000002,"5min":0.31,"15min":0.26200000000000001},"max":{"1min":7.2030000000000003,"5min":39.386000000000003,"15min":39.386000000000003},"last":0.67400000000000004}]},{"osd":4,"last update":"Wed May 8 21:19:20 2024","interfaces":[{"interface":"back","average":{"1min":1.446,"5min":1.6639999999999999,"15min":1.639},"min":{"1min":0.39300000000000002,"5min":0.309,"15min":0.309},"max":{"1min":10.755000000000001,"5min":10.755000000000001,"15min":58.072000000000003},"last":5.569},{"interface":"front","average":{"1min":1.387,"5min":2.3650000000000002,"15min":1.367},"min":{"1min":0.46700000000000003,"5min":0.314,"15min":0.314},"max":{"1min":7.2430000000000003,"5min":15.712,"15min":26.311},"last":5.4470000000000001}]},{"osd":5,"last update":"Wed May 8 21:19:20 2024","interfaces":[{"interface":"back","average":{"1min":1.5760000000000001,"5min":1.786,"15min":1.6200000000000001},"min":{"1min":0.438,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":10.842000000000001,"5min":14.584,"15min":60.375999999999998},"last":5.5430000000000001},{"interface":"front","average":{"1min":1.4139999999999999,"5min":2.9359999999999999,"15min":1.6080000000000001},"min":{"1min":0.45500000000000002,"5min":0.31,"15min":0.31},"max":{"1min":7.2679999999999998,"5min":39.274000000000001,"15min":39.274000000000001},"last":0.69599999999999995}]},{"osd":6,"last update":"Wed May 8 21:19:20 2024","interfaces":[{"interface":"back","average":{"1min":2.9710000000000001,"5min":3.452,"15min":1.8580000000000001},"min":{"1min":0.34499999999999997,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":30.25,"5min":30.25,"15min":30.25},"last":4.8330000000000002},{"interface":"front","average":{"1min":1.6499999999999999,"5min":3.4319999999999999,"15min":1.861},"min":{"1min":0.48099999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":11.914,"5min":41.323999999999998,"15min":41.323999999999998},"last":5.5279999999999996}]},{"osd":7,"last update":"Wed May 8 21:19:20 2024","interfaces":[{"interface":"back","average":{"1min":2.907,"5min":3.5510000000000002,"15min":1.829},"min":{"1min":0.40100000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":30.295000000000002,"5min":30.295000000000002,"15min":30.295000000000002},"last":4.8680000000000003},{"interface":"front","average":{"1min":3.0310000000000001,"5min":3.9180000000000001,"15min":2.0110000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":30.201000000000001,"5min":30.201000000000001,"15min":30.201000000000001},"last":8.25}]}]},{"osd":1,"up_from":15,"seq":64424509558,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1812528,"kb_used_data":663848,"kb_used_omap":1,"kb_used_meta":1148670,"kb_avail":92559312,"statfs":{"total":96636764160,"available":94780735488,"internally_reserved":0,"allocated":679780352,"data_stored":1092003355,"data_compressed":65660496,"data_compressed_allocated":202670080,"data_compressed_original":615096320,"omap_allocated":1594,"internal_metadata":1176238534},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,1,3,3,2,2,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":2.2400000000000002,"15min":1.653},"min":{"1min":0.22800000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.77300000000000002,"5min":16.692,"15min":68.346999999999994},"last":1.623},{"interface":"front","average":{"1min":0.97399999999999998,"5min":2.5630000000000002,"15min":1.486},"min":{"1min":0.22,"5min":0.21199999999999999,"15min":0.19800000000000001},"max":{"1min":6.6589999999999998,"5min":16.875,"15min":25.786000000000001},"last":1.5}]},{"osd":2,"last update":"Wed May 8 21:19:16 2024","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":2.552,"15min":2.2440000000000002},"min":{"1min":0.22700000000000001,"5min":0.191,"15min":0.191},"max":{"1min":7.5350000000000001,"5min":18.373000000000001,"15min":70.688000000000002},"last":9.8689999999999998},{"interface":"front","average":{"1min":1.151,"5min":2.0419999999999998,"15min":1.796},"min":{"1min":0.25600000000000001,"5min":0.22800000000000001,"15min":0.219},"max":{"1min":9.0779999999999994,"5min":14.207000000000001,"15min":35.401000000000003},"last":6.8650000000000002}]},{"osd":3,"last update":"Wed May 8 21:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":2.3690000000000002,"15min":1.599},"min":{"1min":0.26600000000000001,"5min":0.224,"15min":0.224},"max":{"1min":6.4299999999999997,"5min":14.621,"15min":35.658000000000001},"last":9.7759999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":1.96,"15min":1.6200000000000001},"min":{"1min":0.316,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":2.5609999999999999,"5min":14.189,"15min":27.207999999999998},"last":1.5449999999999999}]},{"osd":4,"last update":"Wed May 8 21:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":1.8580000000000001,"15min":1.4830000000000001},"min":{"1min":0.34999999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":2.5209999999999999,"5min":16.561,"15min":43.401000000000003},"last":1.46},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.9550000000000001,"15min":1.351},"min":{"1min":0.37,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":6.702,"5min":10.372999999999999,"15min":27.239000000000001},"last":1.5700000000000001}]},{"osd":5,"last update":"Wed May 8 21:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":2.2040000000000002,"15min":1.7509999999999999},"min":{"1min":0.36199999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.1399999999999999,"5min":18.241,"15min":43.515000000000001},"last":1.5249999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":1.8620000000000001,"15min":1.633},"min":{"1min":0.40500000000000003,"5min":0.34899999999999998,"15min":0.32300000000000001},"max":{"1min":0.80300000000000005,"5min":19.843,"15min":27.352},"last":1.516}]},{"osd":6,"last update":"Wed May 8 21:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":2.6589999999999998,"15min":1.748},"min":{"1min":0.34300000000000003,"5min":0.307,"15min":0.307},"max":{"1min":1.1879999999999999,"5min":18.268999999999998,"15min":43.472999999999999},"last":1.5629999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":1.9319999999999999,"15min":1.425},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35499999999999998},"max":{"1min":2.4710000000000001,"5min":16.155000000000001,"15min":27.376999999999999},"last":1.599}]},{"osd":7,"last update":"Wed May 8 21:19:16 2024","interfaces":[{"interface":"back","average":{"1min":1.544,"5min":2.5390000000000001,"15min":1.9910000000000001},"min":{"1min":0.39000000000000001,"5min":0.315,"15min":0.315},"max":{"1min":6.7309999999999999,"5min":13.484999999999999,"15min":68.287999999999997},"last":6.9189999999999996},{"interface":"front","average":{"1min":0.95599999999999996,"5min":1.8280000000000001,"15min":1.6000000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":4.2450000000000001,"5min":13.592000000000001,"15min":27.312999999999999},"last":4.6980000000000004}]}]},{"osd":4,"up_from":15,"seq":64424509560,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1304900,"kb_used_data":371708,"kb_used_omap":1,"kb_used_meta":933182,"kb_avail":93066940,"statfs":{"total":96636764160,"available":95300546560,"internally_reserved":0,"allocated":380628992,"data_stored":626087417,"data_compressed":38469211,"data_compressed_allocated":118784000,"data_compressed_original":364449792,"omap_allocated":1593,"internal_metadata":955578823},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1,0,1,0,1,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:19:19 2024","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.5580000000000001,"15min":1.0549999999999999},"min":{"1min":0.28299999999999997,"5min":0.218,"15min":0.218},"max":{"1min":7.6849999999999996,"5min":20.606999999999999,"15min":20.606999999999999},"last":12.94},{"interface":"front","average":{"1min":1.7769999999999999,"5min":2.7770000000000001,"15min":1.758},"min":{"1min":0.316,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":18.945,"5min":45.499000000000002,"15min":45.499000000000002},"last":0.23799999999999999}]},{"osd":1,"last update":"Wed May 8 21:19:19 2024","interfaces":[{"interface":"back","average":{"1min":2.4870000000000001,"5min":5.0439999999999996,"15min":2.5},"min":{"1min":0.28100000000000003,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":18.905999999999999,"5min":273.69299999999998,"15min":273.69299999999998},"last":11.542},{"interface":"front","average":{"1min":1.0409999999999999,"5min":4.907,"15min":3.069},"min":{"1min":0.35499999999999998,"5min":0.28699999999999998,"15min":0.26200000000000001},"max":{"1min":5.2290000000000001,"5min":281.21699999999998,"15min":281.21699999999998},"last":11.993}]},{"osd":2,"last update":"Wed May 8 21:19:19 2024","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.8089999999999999,"15min":1.395},"min":{"1min":0.26200000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":7.4119999999999999,"5min":46.542000000000002,"15min":96.177999999999997},"last":3.1160000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":1.415,"15min":1.361},"min":{"1min":0.35399999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.7070000000000001,"5min":16.183,"15min":94.947000000000003},"last":0.45200000000000001}]},{"osd":3,"last update":"Wed May 8 21:19:19 2024","interfaces":[{"interface":"back","average":{"1min":1.8999999999999999,"5min":2.3540000000000001,"15min":1.429},"min":{"1min":0.33500000000000002,"5min":0.245,"15min":0.23899999999999999},"max":{"1min":18.632000000000001,"5min":18.632000000000001,"15min":30.596},"last":11.496},{"interface":"front","average":{"1min":1.111,"5min":3.4340000000000002,"15min":1.804},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":5.2089999999999996,"5min":42.969000000000001,"15min":42.969000000000001},"last":3.3410000000000002}]},{"osd":5,"last update":"Wed May 8 21:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":1.7669999999999999,"15min":1.129},"min":{"1min":0.29499999999999998,"5min":0.252,"15min":0.221},"max":{"1min":1.714,"5min":46.488999999999997,"15min":46.488999999999997},"last":4.7640000000000002},{"interface":"front","average":{"1min":0.877,"5min":1.6899999999999999,"15min":0.98599999999999999},"min":{"1min":0.37,"5min":0.28000000000000003,"15min":0.26200000000000001},"max":{"1min":4.9320000000000004,"5min":45.445999999999998,"15min":45.445999999999998},"last":1.859}]},{"osd":6,"last update":"Wed May 8 21:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":1.869,"15min":1.1439999999999999},"min":{"1min":0.29699999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.6839999999999999,"5min":35.289999999999999,"15min":35.289999999999999},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":2.145,"15min":1.5029999999999999},"min":{"1min":0.371,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.351,"5min":46.576999999999998,"15min":46.576999999999998},"last":4.0910000000000002}]},{"osd":7,"last update":"Wed May 8 21:19:19 2024","interfaces":[{"interface":"back","average":{"1min":1.5980000000000001,"5min":1.9430000000000001,"15min":1.1259999999999999},"min":{"1min":0.36099999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":19.077999999999999,"5min":19.077999999999999,"15min":19.077999999999999},"last":0.438},{"interface":"front","average":{"1min":2.4390000000000001,"5min":1.6319999999999999,"15min":1.0489999999999999},"min":{"1min":0.32300000000000001,"5min":0.30299999999999999,"15min":0.28000000000000003},"max":{"1min":31.617999999999999,"5min":31.617999999999999,"15min":31.617999999999999},"last":0.48699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32306,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32306,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1581056,"data_stored":3158475,"data_compressed":328373,"data_compressed_allocated":425984,"data_compressed_original":2015232,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":94059,"data_compressed":4766,"data_compressed_allocated":8192,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5066752,"data_stored":8483339,"data_compressed":770600,"data_compressed_allocated":995328,"data_compressed_original":4419584,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2256896,"data_stored":4194430,"data_compressed":367613,"data_compressed_allocated":532480,"data_compressed_original":2482176,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1589248,"data_stored":4194976,"data_compressed":576533,"data_compressed_allocated":724992,"data_compressed_original":3338240,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7221248,"data_stored":11548165,"data_compressed":885287,"data_compressed_allocated":1220608,"data_compressed_original":5554176,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":482086912,"data_stored":772747264,"data_compressed":46560604,"data_compressed_allocated":144330752,"data_compressed_original":434991104,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":619642880,"data_stored":1001676800,"data_compressed":60380065,"data_compressed_allocated":186576896,"data_compressed_original":568610816,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":135761920,"data_stored":233381888,"data_compressed":14322819,"data_compressed_allocated":44068864,"data_compressed_original":141688832,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":597532672,"data_stored":967655424,"data_compressed":58094013,"data_compressed_allocated":180183040,"data_compressed_original":550305792,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":341811200,"data_stored":565121024,"data_compressed":34767024,"data_compressed_allocated":108322816,"data_compressed_original":331632640,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":390811648,"data_stored":636235776,"data_compressed":38654705,"data_compressed_allocated":119525376,"data_compressed_original":364949504,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":367538176,"data_stored":617414656,"data_compressed":38390940,"data_compressed_allocated":119353344,"data_compressed_original":369229824,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":373923840,"data_stored":615157760,"data_compressed":37572296,"data_compressed_allocated":116301824,"data_compressed_original":357535744,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T21:19:52.974 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T21:19:53.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.405+0000 7f2c5cab8700 1 Processor -- start 2024-05-08T21:19:53.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.405+0000 7f2c5cab8700 1 -- start start 2024-05-08T21:19:53.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.406+0000 7f2c5cab8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2c581520b0 0x7f2c58158810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:53.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.406+0000 7f2c5cab8700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f2c580cbba0 0x7f2c580cbff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:53.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.406+0000 7f2c5cab8700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c5815b6d0 con 0x7f2c58158d50 2024-05-08T21:19:53.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.406+0000 7f2c5cab8700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c580cc530 con 0x7f2c581520b0 2024-05-08T21:19:53.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.406+0000 7f2c5cab8700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c581580e0 con 0x7f2c580cbba0 2024-05-08T21:19:53.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.406+0000 7f2c5659c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2c581520b0 0x7f2c58158810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:53.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.406+0000 7f2c5659c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2c581520b0 0x7f2c58158810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39312/0 (socket says 172.21.15.80:39312) 2024-05-08T21:19:53.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.406+0000 7f2c5659c700 1 -- 172.21.15.80:0/415107573 learned_addr learned my addr 172.21.15.80:0/415107573 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:19:53.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.406+0000 7f2c56d9d700 1 --2- 172.21.15.80:0/415107573 >> v2:172.21.15.106:3300/0 conn(0x7f2c580cbba0 0x7f2c580cbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:53.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.406+0000 7f2c5659c700 1 -- 172.21.15.80:0/415107573 >> v2:172.21.15.106:3300/0 conn(0x7f2c580cbba0 msgr2=0x7f2c580cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:19:53.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.406+0000 7f2c5659c700 1 --2- 172.21.15.80:0/415107573 >> v2:172.21.15.106:3300/0 conn(0x7f2c580cbba0 0x7f2c580cbff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:53.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.406+0000 7f2c5659c700 1 -- 172.21.15.80:0/415107573 >> v1:172.21.15.106:6789/0 conn(0x7f2c58158d50 legacy=0x7f2c58072d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:19:53.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.406+0000 7f2c5659c700 1 -- 172.21.15.80:0/415107573 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c5815c650 con 0x7f2c581520b0 2024-05-08T21:19:53.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.406+0000 7f2c5659c700 1 --2- 172.21.15.80:0/415107573 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c581520b0 0x7f2c58158810 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f2c580c63d0 tx=0x7f2c4c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1836d4940ea18945 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:53.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.406+0000 7f2c5559a700 1 -- 172.21.15.80:0/415107573 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c4c004230 con 0x7f2c581520b0 2024-05-08T21:19:53.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.407+0000 7f2c5559a700 1 -- 172.21.15.80:0/415107573 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c4c004390 con 0x7f2c581520b0 2024-05-08T21:19:53.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.407+0000 7f2c5559a700 1 -- 172.21.15.80:0/415107573 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c4c0036a0 con 0x7f2c581520b0 2024-05-08T21:19:53.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.407+0000 7f2c5cab8700 1 -- 172.21.15.80:0/415107573 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c581520b0 msgr2=0x7f2c58158810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:53.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.407+0000 7f2c5cab8700 1 --2- 172.21.15.80:0/415107573 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c581520b0 0x7f2c58158810 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f2c580c63d0 tx=0x7f2c4c009bd0 comp rx=0 tx=0).stop 2024-05-08T21:19:53.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.407+0000 7f2c5cab8700 1 -- 172.21.15.80:0/415107573 shutdown_connections 2024-05-08T21:19:53.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.407+0000 7f2c5cab8700 1 --2- 172.21.15.80:0/415107573 >> v2:172.21.15.106:3300/0 conn(0x7f2c580cbba0 0x7f2c580cbff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:53.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.407+0000 7f2c5cab8700 1 --2- 172.21.15.80:0/415107573 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c581520b0 0x7f2c58158810 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:53.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.407+0000 7f2c5cab8700 1 -- 172.21.15.80:0/415107573 >> 172.21.15.80:0/415107573 conn(0x7f2c58066780 msgr2=0x7f2c58066b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:53.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.407+0000 7f2c5cab8700 1 -- 172.21.15.80:0/415107573 shutdown_connections 2024-05-08T21:19:53.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.407+0000 7f2c5cab8700 1 -- 172.21.15.80:0/415107573 wait complete. 2024-05-08T21:19:53.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.408+0000 7f2c5cab8700 1 Processor -- start 2024-05-08T21:19:53.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.408+0000 7f2c5cab8700 1 -- start start 2024-05-08T21:19:53.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.409+0000 7f2c5cab8700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c580cbba0 0x7f2c5814cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:53.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.409+0000 7f2c5cab8700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c581520b0 0x7f2c5814a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:53.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.409+0000 7f2c5cab8700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2c58158d50 0x7f2c5814a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:53.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.409+0000 7f2c5cab8700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c580c78b0 con 0x7f2c581520b0 2024-05-08T21:19:53.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.409+0000 7f2c5cab8700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c580c7b90 con 0x7f2c580cbba0 2024-05-08T21:19:53.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.409+0000 7f2c5cab8700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c580c7e70 con 0x7f2c58158d50 2024-05-08T21:19:53.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.409+0000 7f2c55d9b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c581520b0 0x7f2c5814a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:53.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.409+0000 7f2c55d9b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c581520b0 0x7f2c5814a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39318/0 (socket says 172.21.15.80:39318) 2024-05-08T21:19:53.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.409+0000 7f2c55d9b700 1 -- 172.21.15.80:0/1903121601 learned_addr learned my addr 172.21.15.80:0/1903121601 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:19:53.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.409+0000 7f2c5659c700 1 --2- 172.21.15.80:0/1903121601 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c580cbba0 0x7f2c5814cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:53.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.409+0000 7f2c56d9d700 1 --2- 172.21.15.80:0/1903121601 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2c58158d50 0x7f2c5814a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:53.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.410+0000 7f2c55d9b700 1 -- 172.21.15.80:0/1903121601 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2c58158d50 msgr2=0x7f2c5814a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:53.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.410+0000 7f2c55d9b700 1 --2- 172.21.15.80:0/1903121601 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2c58158d50 0x7f2c5814a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:53.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.410+0000 7f2c55d9b700 1 -- 172.21.15.80:0/1903121601 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c580cbba0 msgr2=0x7f2c5814cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:53.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.410+0000 7f2c55d9b700 1 --2- 172.21.15.80:0/1903121601 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c580cbba0 0x7f2c5814cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:53.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.410+0000 7f2c55d9b700 1 -- 172.21.15.80:0/1903121601 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c4c009550 con 0x7f2c581520b0 2024-05-08T21:19:53.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.410+0000 7f2c55d9b700 1 --2- 172.21.15.80:0/1903121601 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c581520b0 0x7f2c5814a410 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f2c4800b4a0 tx=0x7f2c4800b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:53.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.410+0000 7f2c46ffd700 1 -- 172.21.15.80:0/1903121601 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c48011830 con 0x7f2c581520b0 2024-05-08T21:19:53.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.410+0000 7f2c46ffd700 1 -- 172.21.15.80:0/1903121601 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c48011990 con 0x7f2c581520b0 2024-05-08T21:19:53.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.410+0000 7f2c5cab8700 1 -- 172.21.15.80:0/1903121601 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c580c8150 con 0x7f2c581520b0 2024-05-08T21:19:53.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.410+0000 7f2c46ffd700 1 -- 172.21.15.80:0/1903121601 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c48011d40 con 0x7f2c581520b0 2024-05-08T21:19:53.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.410+0000 7f2c5cab8700 1 -- 172.21.15.80:0/1903121601 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c5814d150 con 0x7f2c581520b0 2024-05-08T21:19:53.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.411+0000 7f2c5cab8700 1 -- 172.21.15.80:0/1903121601 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c5804ec60 con 0x7f2c581520b0 2024-05-08T21:19:53.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.411+0000 7f2c46ffd700 1 -- 172.21.15.80:0/1903121601 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2c4801a400 con 0x7f2c581520b0 2024-05-08T21:19:53.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.412+0000 7f2c46ffd700 1 --2- 172.21.15.80:0/1903121601 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f2c3806acc0 0x7f2c3806d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:53.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.412+0000 7f2c5659c700 1 --2- 172.21.15.80:0/1903121601 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f2c3806acc0 0x7f2c3806d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:53.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.412+0000 7f2c46ffd700 1 -- 172.21.15.80:0/1903121601 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f2c48089750 con 0x7f2c581520b0 2024-05-08T21:19:53.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.412+0000 7f2c5659c700 1 --2- 172.21.15.80:0/1903121601 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f2c3806acc0 0x7f2c3806d180 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c009130 tx=0x7f2c4c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:53.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.416+0000 7f2c46ffd700 1 -- 172.21.15.80:0/1903121601 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f2c48054420 con 0x7f2c581520b0 2024-05-08T21:19:53.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.614+0000 7f2c5cab8700 1 -- 172.21.15.80:0/1903121601 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2c580cb980 con 0x7f2c581520b0 2024-05-08T21:19:53.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.616+0000 7f2c46ffd700 1 -- 172.21.15.80:0/1903121601 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+18793 (secure 0 0 0) 0x7f2c48057a40 con 0x7f2c581520b0 2024-05-08T21:19:53.618 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:19:53.619 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":32,"fsid":"44d31c1e-aad3-47ca-a4fa-85a63d4a60aa","created":"2024-05-08T21:09:46.467038+0000","modified":"2024-05-08T21:19:06.330550+0000","last_up_change":"2024-05-08T21:09:57.284675+0000","last_in_change":"2024-05-08T21:09:49.125444+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T21:09:58.238951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T21:10:02.177476+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T21:10:02.685535+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-08T21:10:05.753779+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c3f9d93e-ed6d-4a0c-b5c0-0e8d44c65fdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":47011},{"type":"v1","addr":"172.21.15.80:6817","nonce":47011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":47011},{"type":"v1","addr":"172.21.15.80:6819","nonce":47011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":47011},{"type":"v1","addr":"172.21.15.80:6823","nonce":47011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":47011},{"type":"v1","addr":"172.21.15.80:6821","nonce":47011}]},"public_addr":"172.21.15.80:6817/47011","cluster_addr":"172.21.15.80:6819/47011","heartbeat_back_addr":"172.21.15.80:6823/47011","heartbeat_front_addr":"172.21.15.80:6821/47011","state":["exists","up"]},{"osd":1,"uuid":"4ce2b4d6-6c40-43aa-8dd1-743fef8915df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":47010},{"type":"v1","addr":"172.21.15.80:6809","nonce":47010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":47010},{"type":"v1","addr":"172.21.15.80:6811","nonce":47010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":47010},{"type":"v1","addr":"172.21.15.80:6815","nonce":47010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":47010},{"type":"v1","addr":"172.21.15.80:6813","nonce":47010}]},"public_addr":"172.21.15.80:6809/47010","cluster_addr":"172.21.15.80:6811/47010","heartbeat_back_addr":"172.21.15.80:6815/47010","heartbeat_front_addr":"172.21.15.80:6813/47010","state":["exists","up"]},{"osd":2,"uuid":"e30cc3bc-6461-4fac-960a-de00c9488d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":47009},{"type":"v1","addr":"172.21.15.80:6801","nonce":47009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":47009},{"type":"v1","addr":"172.21.15.80:6803","nonce":47009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":47009},{"type":"v1","addr":"172.21.15.80:6807","nonce":47009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":47009},{"type":"v1","addr":"172.21.15.80:6805","nonce":47009}]},"public_addr":"172.21.15.80:6801/47009","cluster_addr":"172.21.15.80:6803/47009","heartbeat_back_addr":"172.21.15.80:6807/47009","heartbeat_front_addr":"172.21.15.80:6805/47009","state":["exists","up"]},{"osd":3,"uuid":"a415c099-9ea6-40be-98ed-f2932f98dfd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":47012},{"type":"v1","addr":"172.21.15.80:6825","nonce":47012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":47012},{"type":"v1","addr":"172.21.15.80:6827","nonce":47012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":47012},{"type":"v1","addr":"172.21.15.80:6831","nonce":47012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":47012},{"type":"v1","addr":"172.21.15.80:6829","nonce":47012}]},"public_addr":"172.21.15.80:6825/47012","cluster_addr":"172.21.15.80:6827/47012","heartbeat_back_addr":"172.21.15.80:6831/47012","heartbeat_front_addr":"172.21.15.80:6829/47012","state":["exists","up"]},{"osd":4,"uuid":"5ae1d51f-0918-4571-b79b-154308d46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6823","nonce":47114},{"type":"v1","addr":"172.21.15.106:6825","nonce":47114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":47114},{"type":"v1","addr":"172.21.15.106:6827","nonce":47114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":47114},{"type":"v1","addr":"172.21.15.106:6831","nonce":47114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":47114},{"type":"v1","addr":"172.21.15.106:6829","nonce":47114}]},"public_addr":"172.21.15.106:6825/47114","cluster_addr":"172.21.15.106:6827/47114","heartbeat_back_addr":"172.21.15.106:6831/47114","heartbeat_front_addr":"172.21.15.106:6829/47114","state":["exists","up"]},{"osd":5,"uuid":"a19ac74e-4282-4428-b167-26ba6b92f732","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6807","nonce":47111},{"type":"v1","addr":"172.21.15.106:6809","nonce":47111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":47111},{"type":"v1","addr":"172.21.15.106:6811","nonce":47111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":47111},{"type":"v1","addr":"172.21.15.106:6815","nonce":47111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":47111},{"type":"v1","addr":"172.21.15.106:6813","nonce":47111}]},"public_addr":"172.21.15.106:6809/47111","cluster_addr":"172.21.15.106:6811/47111","heartbeat_back_addr":"172.21.15.106:6815/47111","heartbeat_front_addr":"172.21.15.106:6813/47111","state":["exists","up"]},{"osd":6,"uuid":"bfe72edd-7acc-4805-807d-2000e76f2feb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":47112},{"type":"v1","addr":"172.21.15.106:6817","nonce":47112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":47112},{"type":"v1","addr":"172.21.15.106:6819","nonce":47112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":47112},{"type":"v1","addr":"172.21.15.106:6824","nonce":47112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":47112},{"type":"v1","addr":"172.21.15.106:6821","nonce":47112}]},"public_addr":"172.21.15.106:6817/47112","cluster_addr":"172.21.15.106:6819/47112","heartbeat_back_addr":"172.21.15.106:6824/47112","heartbeat_front_addr":"172.21.15.106:6821/47112","state":["exists","up"]},{"osd":7,"uuid":"99897f22-ed17-4c7c-9088-cc0c4a51f786","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":47113},{"type":"v1","addr":"172.21.15.106:6801","nonce":47113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":47113},{"type":"v1","addr":"172.21.15.106:6803","nonce":47113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":47113},{"type":"v1","addr":"172.21.15.106:6808","nonce":47113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":47113},{"type":"v1","addr":"172.21.15.106:6805","nonce":47113}]},"public_addr":"172.21.15.106:6801/47113","cluster_addr":"172.21.15.106:6803/47113","heartbeat_back_addr":"172.21.15.106:6808/47113","heartbeat_front_addr":"172.21.15.106:6805/47113","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.232670+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.277753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.050087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.349312+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.344080+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.348781+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.352539+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.275013+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.27","mappings":[{"from":3,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.106:6833/791920806":"2024-05-09T21:19:06.330456+0000","172.21.15.106:6832/791920806":"2024-05-09T21:19:06.330456+0000","172.21.15.106:6836/1949999190":"2024-05-09T21:12:06.228867+0000","172.21.15.106:6834/1949999190":"2024-05-09T21:12:06.228867+0000","172.21.15.106:6834/1499761952":"2024-05-09T21:17:21.292339+0000","172.21.15.106:6832/2289230272":"2024-05-09T21:14:41.256000+0000","172.21.15.106:6833/2289230272":"2024-05-09T21:14:41.256000+0000","172.21.15.106:6836/1499761952":"2024-05-09T21:17:21.292339+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T21:19:53.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.618+0000 7f2c5cab8700 1 -- 172.21.15.80:0/1903121601 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f2c3806acc0 msgr2=0x7f2c3806d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:53.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.618+0000 7f2c5cab8700 1 --2- 172.21.15.80:0/1903121601 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f2c3806acc0 0x7f2c3806d180 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c009130 tx=0x7f2c4c008030 comp rx=0 tx=0).stop 2024-05-08T21:19:53.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.618+0000 7f2c5cab8700 1 -- 172.21.15.80:0/1903121601 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c581520b0 msgr2=0x7f2c5814a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:53.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.618+0000 7f2c5cab8700 1 --2- 172.21.15.80:0/1903121601 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c581520b0 0x7f2c5814a410 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f2c4800b4a0 tx=0x7f2c4800b7b0 comp rx=0 tx=0).stop 2024-05-08T21:19:53.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.618+0000 7f2c5cab8700 1 -- 172.21.15.80:0/1903121601 shutdown_connections 2024-05-08T21:19:53.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.618+0000 7f2c5cab8700 1 --2- 172.21.15.80:0/1903121601 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f2c3806acc0 0x7f2c3806d180 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:53.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.618+0000 7f2c5cab8700 1 --2- 172.21.15.80:0/1903121601 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2c58158d50 0x7f2c5814a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:53.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.618+0000 7f2c5cab8700 1 --2- 172.21.15.80:0/1903121601 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c580cbba0 0x7f2c5814cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:53.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.618+0000 7f2c5cab8700 1 --2- 172.21.15.80:0/1903121601 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c581520b0 0x7f2c5814a410 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:53.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.618+0000 7f2c5cab8700 1 -- 172.21.15.80:0/1903121601 >> 172.21.15.80:0/1903121601 conn(0x7f2c58066780 msgr2=0x7f2c5806ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:53.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.618+0000 7f2c5cab8700 1 -- 172.21.15.80:0/1903121601 shutdown_connections 2024-05-08T21:19:53.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:53.618+0000 7f2c5cab8700 1 -- 172.21.15.80:0/1903121601 wait complete. 2024-05-08T21:19:54.634 INFO:tasks.ceph:Scrubbing osd.0 2024-05-08T21:19:54.634 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-05-08T21:19:54.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.759+0000 7f8e99128700 1 Processor -- start 2024-05-08T21:19:54.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.759+0000 7f8e99128700 1 -- start start 2024-05-08T21:19:54.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.759+0000 7f8e99128700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8e9406b250 0x7f8e9406b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:54.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.759+0000 7f8e99128700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8e941568f0 0x7f8e94156d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:54.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.759+0000 7f8e99128700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e940c7270 con 0x7f8e941509b0 2024-05-08T21:19:54.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.759+0000 7f8e99128700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e94072ea0 con 0x7f8e941568f0 2024-05-08T21:19:54.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.759+0000 7f8e99128700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e94150d90 con 0x7f8e9406b250 2024-05-08T21:19:54.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.760+0000 7f8e9359e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8e941568f0 0x7f8e94156d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:54.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.760+0000 7f8e92d9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f8e941509b0 0x7f8e940c7960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46472/0 (socket says 172.21.15.80:46472) 2024-05-08T21:19:54.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.760+0000 7f8e9359e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8e941568f0 0x7f8e94156d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39334/0 (socket says 172.21.15.80:39334) 2024-05-08T21:19:54.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.760+0000 7f8e92d9d700 1 -- 172.21.15.80:0/1189006673 learned_addr learned my addr 172.21.15.80:0/1189006673 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:19:54.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.760+0000 7f8e9259c700 1 --2- 172.21.15.80:0/1189006673 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8e9406b250 0x7f8e9406b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:54.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.760+0000 7f8e9359e700 1 -- 172.21.15.80:0/1189006673 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8e9406b250 msgr2=0x7f8e9406b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:19:54.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.760+0000 7f8e9359e700 1 --2- 172.21.15.80:0/1189006673 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8e9406b250 0x7f8e9406b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:54.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.760+0000 7f8e9359e700 1 -- 172.21.15.80:0/1189006673 >> v1:172.21.15.80:6789/0 conn(0x7f8e941509b0 legacy=0x7f8e940c7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:54.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.760+0000 7f8e9359e700 1 -- 172.21.15.80:0/1189006673 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e941572a0 con 0x7f8e941568f0 2024-05-08T21:19:54.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.760+0000 7f8e91d9b700 1 -- 172.21.15.80:0/1189006673 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2664679176 0 0) 0x7f8e88001110 con 0x7f8e941509b0 2024-05-08T21:19:54.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.760+0000 7f8e9359e700 1 --2- 172.21.15.80:0/1189006673 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e941568f0 0x7f8e94156d60 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c009d90 tx=0x7f8e8c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a15977b96c35f33 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:54.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.760+0000 7f8e91d9b700 1 -- 172.21.15.80:0/1189006673 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e8c00e070 con 0x7f8e941568f0 2024-05-08T21:19:54.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.760+0000 7f8e91d9b700 1 -- 172.21.15.80:0/1189006673 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e8c00bbd0 con 0x7f8e941568f0 2024-05-08T21:19:54.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.760+0000 7f8e91d9b700 1 -- 172.21.15.80:0/1189006673 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e8c012430 con 0x7f8e941568f0 2024-05-08T21:19:54.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.761+0000 7f8e99128700 1 -- 172.21.15.80:0/1189006673 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e941568f0 msgr2=0x7f8e94156d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:54.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.761+0000 7f8e99128700 1 --2- 172.21.15.80:0/1189006673 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e941568f0 0x7f8e94156d60 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c009d90 tx=0x7f8e8c00b330 comp rx=0 tx=0).stop 2024-05-08T21:19:54.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.761+0000 7f8e99128700 1 -- 172.21.15.80:0/1189006673 shutdown_connections 2024-05-08T21:19:54.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.761+0000 7f8e99128700 1 --2- 172.21.15.80:0/1189006673 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e941568f0 0x7f8e94156d60 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:54.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.761+0000 7f8e99128700 1 --2- 172.21.15.80:0/1189006673 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8e9406b250 0x7f8e9406b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:54.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.761+0000 7f8e99128700 1 -- 172.21.15.80:0/1189006673 >> 172.21.15.80:0/1189006673 conn(0x7f8e940cb620 msgr2=0x7f8e940cba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:54.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.761+0000 7f8e99128700 1 -- 172.21.15.80:0/1189006673 shutdown_connections 2024-05-08T21:19:54.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.761+0000 7f8e99128700 1 -- 172.21.15.80:0/1189006673 wait complete. 2024-05-08T21:19:54.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.762+0000 7f8e99128700 1 Processor -- start 2024-05-08T21:19:54.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.762+0000 7f8e99128700 1 -- start start 2024-05-08T21:19:54.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.763+0000 7f8e99128700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8e9406b250 0x7f8e9413e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:54.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.763+0000 7f8e99128700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8e941509b0 0x7f8e9414f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:54.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.763+0000 7f8e99128700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e941568f0 0x7f8e94137eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:54.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.763+0000 7f8e99128700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9413e660 con 0x7f8e941568f0 2024-05-08T21:19:54.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.763+0000 7f8e99128700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e941ef090 con 0x7f8e941509b0 2024-05-08T21:19:54.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.763+0000 7f8e99128700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e941f1fd0 con 0x7f8e9406b250 2024-05-08T21:19:54.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.763+0000 7f8e9359e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e941568f0 0x7f8e94137eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:54.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.763+0000 7f8e9359e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e941568f0 0x7f8e94137eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39342/0 (socket says 172.21.15.80:39342) 2024-05-08T21:19:54.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.763+0000 7f8e9359e700 1 -- 172.21.15.80:0/238740230 learned_addr learned my addr 172.21.15.80:0/238740230 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:19:54.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.763+0000 7f8e92d9d700 1 --2- 172.21.15.80:0/238740230 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8e9406b250 0x7f8e9413e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:54.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.763+0000 7f8e9259c700 1 --2- 172.21.15.80:0/238740230 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8e941509b0 0x7f8e9414f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:54.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.763+0000 7f8e9359e700 1 -- 172.21.15.80:0/238740230 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8e9406b250 msgr2=0x7f8e9413e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:54.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.763+0000 7f8e9359e700 1 --2- 172.21.15.80:0/238740230 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8e9406b250 0x7f8e9413e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:54.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.763+0000 7f8e9359e700 1 -- 172.21.15.80:0/238740230 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8e941509b0 msgr2=0x7f8e9414f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:54.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.763+0000 7f8e9359e700 1 --2- 172.21.15.80:0/238740230 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8e941509b0 0x7f8e9414f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:54.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.763+0000 7f8e9359e700 1 -- 172.21.15.80:0/238740230 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e8c009a70 con 0x7f8e941568f0 2024-05-08T21:19:54.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.763+0000 7f8e92d9d700 1 --2- 172.21.15.80:0/238740230 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8e9406b250 0x7f8e9413e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:19:54.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.763+0000 7f8e9359e700 1 --2- 172.21.15.80:0/238740230 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e941568f0 0x7f8e94137eb0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f8e9406ecf0 tx=0x7f8e8c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:54.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.764+0000 7f8e7b7fe700 1 -- 172.21.15.80:0/238740230 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e8c012430 con 0x7f8e941568f0 2024-05-08T21:19:54.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.764+0000 7f8e7b7fe700 1 -- 172.21.15.80:0/238740230 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e8c020070 con 0x7f8e941568f0 2024-05-08T21:19:54.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.764+0000 7f8e99128700 1 -- 172.21.15.80:0/238740230 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e9414e040 con 0x7f8e941568f0 2024-05-08T21:19:54.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.764+0000 7f8e7b7fe700 1 -- 172.21.15.80:0/238740230 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e8c004280 con 0x7f8e941568f0 2024-05-08T21:19:54.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.764+0000 7f8e99128700 1 -- 172.21.15.80:0/238740230 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e9414e600 con 0x7f8e941568f0 2024-05-08T21:19:54.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.764+0000 7f8e99128700 1 -- 172.21.15.80:0/238740230 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8e9414d880 con 0x7f8e941568f0 2024-05-08T21:19:54.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.765+0000 7f8e7b7fe700 1 -- 172.21.15.80:0/238740230 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8e8c0043e0 con 0x7f8e941568f0 2024-05-08T21:19:54.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.765+0000 7f8e7b7fe700 1 --2- 172.21.15.80:0/238740230 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f8e8006ac90 0x7f8e8006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:54.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.765+0000 7f8e7b7fe700 1 -- 172.21.15.80:0/238740230 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f8e8c022070 con 0x7f8e941568f0 2024-05-08T21:19:54.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.765+0000 7f8e92d9d700 1 --2- 172.21.15.80:0/238740230 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f8e8006ac90 0x7f8e8006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:54.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.766+0000 7f8e7b7fe700 1 --2- 172.21.15.80:0/238740230 >> [v2:172.21.15.80:6816/47011,v1:172.21.15.80:6817/47011] conn(0x7f8e80074880 0x7f8e80076d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:54.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.766+0000 7f8e7b7fe700 1 -- 172.21.15.80:0/238740230 --> [v2:172.21.15.80:6816/47011,v1:172.21.15.80:6817/47011] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8e800773f0 con 0x7f8e80074880 2024-05-08T21:19:54.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.766+0000 7f8e7b7fe700 1 -- 172.21.15.80:0/238740230 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8e8c0902c0 con 0x7f8e941568f0 2024-05-08T21:19:54.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.766+0000 7f8e9259c700 1 --2- 172.21.15.80:0/238740230 >> [v2:172.21.15.80:6816/47011,v1:172.21.15.80:6817/47011] conn(0x7f8e80074880 0x7f8e80076d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:54.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.766+0000 7f8e92d9d700 1 --2- 172.21.15.80:0/238740230 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f8e8006ac90 0x7f8e8006d150 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8e88000f60 tx=0x7f8e88007ae0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:54.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.766+0000 7f8e9259c700 1 --2- 172.21.15.80:0/238740230 >> [v2:172.21.15.80:6816/47011,v1:172.21.15.80:6817/47011] conn(0x7f8e80074880 0x7f8e80076d20 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:54.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.767+0000 7f8e7b7fe700 1 -- 172.21.15.80:0/238740230 <== osd.0 v2:172.21.15.80:6816/47011 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f8e800773f0 con 0x7f8e80074880 2024-05-08T21:19:54.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.781+0000 7f8e99128700 1 -- 172.21.15.80:0/238740230 --> [v2:172.21.15.80:6816/47011,v1:172.21.15.80:6817/47011] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8e94070b70 con 0x7f8e80074880 2024-05-08T21:19:54.784 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.782+0000 7f8e7b7fe700 1 -- 172.21.15.80:0/238740230 <== osd.0 v2:172.21.15.80:6816/47011 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f8e840099c0 con 0x7f8e80074880 2024-05-08T21:19:54.784 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T21:19:54.784 INFO:teuthology.orchestra.run.smithi080.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T21:19:54.784 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T21:19:54.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.782+0000 7f8e99128700 1 -- 172.21.15.80:0/238740230 >> [v2:172.21.15.80:6816/47011,v1:172.21.15.80:6817/47011] conn(0x7f8e80074880 msgr2=0x7f8e80076d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:54.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.782+0000 7f8e99128700 1 --2- 172.21.15.80:0/238740230 >> [v2:172.21.15.80:6816/47011,v1:172.21.15.80:6817/47011] conn(0x7f8e80074880 0x7f8e80076d20 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:54.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.782+0000 7f8e99128700 1 -- 172.21.15.80:0/238740230 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f8e8006ac90 msgr2=0x7f8e8006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:54.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.782+0000 7f8e99128700 1 --2- 172.21.15.80:0/238740230 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f8e8006ac90 0x7f8e8006d150 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8e88000f60 tx=0x7f8e88007ae0 comp rx=0 tx=0).stop 2024-05-08T21:19:54.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.782+0000 7f8e99128700 1 -- 172.21.15.80:0/238740230 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e941568f0 msgr2=0x7f8e94137eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:54.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.782+0000 7f8e99128700 1 --2- 172.21.15.80:0/238740230 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e941568f0 0x7f8e94137eb0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f8e9406ecf0 tx=0x7f8e8c004ad0 comp rx=0 tx=0).stop 2024-05-08T21:19:54.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.782+0000 7f8e9359e700 1 -- 172.21.15.80:0/238740230 reap_dead start 2024-05-08T21:19:54.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.782+0000 7f8e99128700 1 -- 172.21.15.80:0/238740230 shutdown_connections 2024-05-08T21:19:54.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.782+0000 7f8e99128700 1 -- 172.21.15.80:0/238740230 >> 172.21.15.80:0/238740230 conn(0x7f8e940cb620 msgr2=0x7f8e940c5000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:54.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.782+0000 7f8e99128700 1 -- 172.21.15.80:0/238740230 shutdown_connections 2024-05-08T21:19:54.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.782+0000 7f8e99128700 1 -- 172.21.15.80:0/238740230 wait complete. 2024-05-08T21:19:54.796 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-05-08T21:19:54.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.919+0000 7f7c2fa78700 1 Processor -- start 2024-05-08T21:19:54.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.920+0000 7f7c2fa78700 1 -- start start 2024-05-08T21:19:54.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.920+0000 7f7c2fa78700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7c281520b0 0x7f7c28158810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:54.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.920+0000 7f7c2fa78700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7c280cbba0 0x7f7c280cbff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:54.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.920+0000 7f7c2fa78700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c2815b6d0 con 0x7f7c28158d50 2024-05-08T21:19:54.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.920+0000 7f7c2fa78700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c280cc530 con 0x7f7c281520b0 2024-05-08T21:19:54.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.920+0000 7f7c2fa78700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c281580e0 con 0x7f7c280cbba0 2024-05-08T21:19:54.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.921+0000 7f7c2d814700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7c281520b0 0x7f7c28158810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:54.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.921+0000 7f7c2d814700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7c281520b0 0x7f7c28158810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39348/0 (socket says 172.21.15.80:39348) 2024-05-08T21:19:54.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.921+0000 7f7c2d013700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f7c28158d50 0x7f7c28072d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46476/0 (socket says 172.21.15.80:46476) 2024-05-08T21:19:54.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.921+0000 7f7c2d814700 1 -- 172.21.15.80:0/3693175030 learned_addr learned my addr 172.21.15.80:0/3693175030 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:19:54.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.921+0000 7f7c2e015700 1 --2- 172.21.15.80:0/3693175030 >> v2:172.21.15.106:3300/0 conn(0x7f7c280cbba0 0x7f7c280cbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:54.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.921+0000 7f7c2d814700 1 -- 172.21.15.80:0/3693175030 >> v2:172.21.15.106:3300/0 conn(0x7f7c280cbba0 msgr2=0x7f7c280cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:19:54.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.921+0000 7f7c2d814700 1 --2- 172.21.15.80:0/3693175030 >> v2:172.21.15.106:3300/0 conn(0x7f7c280cbba0 0x7f7c280cbff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:54.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.921+0000 7f7c2d814700 1 -- 172.21.15.80:0/3693175030 >> v1:172.21.15.80:6789/0 conn(0x7f7c28158d50 legacy=0x7f7c28072d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:54.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.921+0000 7f7c2d814700 1 -- 172.21.15.80:0/3693175030 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c2815c650 con 0x7f7c281520b0 2024-05-08T21:19:54.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.921+0000 7f7c2d814700 1 --2- 172.21.15.80:0/3693175030 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c281520b0 0x7f7c28158810 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f7c280c63d0 tx=0x7f7c24009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60dffe329fd4fdb6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:54.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.921+0000 7f7c2c812700 1 -- 172.21.15.80:0/3693175030 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c24011830 con 0x7f7c281520b0 2024-05-08T21:19:54.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.921+0000 7f7c2c812700 1 -- 172.21.15.80:0/3693175030 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c24011990 con 0x7f7c281520b0 2024-05-08T21:19:54.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.921+0000 7f7c2c812700 1 -- 172.21.15.80:0/3693175030 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c24011d20 con 0x7f7c281520b0 2024-05-08T21:19:54.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.922+0000 7f7c2fa78700 1 -- 172.21.15.80:0/3693175030 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c281520b0 msgr2=0x7f7c28158810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:54.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.922+0000 7f7c2fa78700 1 --2- 172.21.15.80:0/3693175030 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c281520b0 0x7f7c28158810 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f7c280c63d0 tx=0x7f7c24009bd0 comp rx=0 tx=0).stop 2024-05-08T21:19:54.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.922+0000 7f7c2fa78700 1 -- 172.21.15.80:0/3693175030 shutdown_connections 2024-05-08T21:19:54.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.922+0000 7f7c2fa78700 1 --2- 172.21.15.80:0/3693175030 >> v2:172.21.15.106:3300/0 conn(0x7f7c280cbba0 0x7f7c280cbff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:54.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.922+0000 7f7c2fa78700 1 --2- 172.21.15.80:0/3693175030 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c281520b0 0x7f7c28158810 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:54.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.922+0000 7f7c2fa78700 1 -- 172.21.15.80:0/3693175030 >> 172.21.15.80:0/3693175030 conn(0x7f7c28066780 msgr2=0x7f7c28066b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:54.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.922+0000 7f7c2fa78700 1 -- 172.21.15.80:0/3693175030 shutdown_connections 2024-05-08T21:19:54.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.922+0000 7f7c2fa78700 1 -- 172.21.15.80:0/3693175030 wait complete. 2024-05-08T21:19:54.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.923+0000 7f7c2fa78700 1 Processor -- start 2024-05-08T21:19:54.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.923+0000 7f7c2fa78700 1 -- start start 2024-05-08T21:19:54.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.924+0000 7f7c2fa78700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c280cbba0 0x7f7c281ee100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:54.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.924+0000 7f7c2fa78700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7c281520b0 0x7f7c2814c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:54.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.924+0000 7f7c2fa78700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c28158d50 0x7f7c28147170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:54.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.924+0000 7f7c2fa78700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c28156c20 con 0x7f7c28158d50 2024-05-08T21:19:54.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.924+0000 7f7c2fa78700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c281f16e0 con 0x7f7c280cbba0 2024-05-08T21:19:54.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.924+0000 7f7c2fa78700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c281f1c10 con 0x7f7c281520b0 2024-05-08T21:19:54.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.924+0000 7f7c2e015700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c28158d50 0x7f7c28147170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:54.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.924+0000 7f7c2e015700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c28158d50 0x7f7c28147170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39352/0 (socket says 172.21.15.80:39352) 2024-05-08T21:19:54.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.924+0000 7f7c2e015700 1 -- 172.21.15.80:0/2049968277 learned_addr learned my addr 172.21.15.80:0/2049968277 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:19:54.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.924+0000 7f7c2d013700 1 --2- 172.21.15.80:0/2049968277 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7c281520b0 0x7f7c2814c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:54.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.924+0000 7f7c2d814700 1 --2- 172.21.15.80:0/2049968277 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c280cbba0 0x7f7c281ee100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:54.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.924+0000 7f7c2e015700 1 -- 172.21.15.80:0/2049968277 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7c281520b0 msgr2=0x7f7c2814c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:54.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.924+0000 7f7c2e015700 1 --2- 172.21.15.80:0/2049968277 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7c281520b0 0x7f7c2814c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:54.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.924+0000 7f7c2e015700 1 -- 172.21.15.80:0/2049968277 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c280cbba0 msgr2=0x7f7c281ee100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:54.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.924+0000 7f7c2e015700 1 --2- 172.21.15.80:0/2049968277 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c280cbba0 0x7f7c281ee100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:54.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.924+0000 7f7c2e015700 1 -- 172.21.15.80:0/2049968277 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c24009550 con 0x7f7c28158d50 2024-05-08T21:19:54.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.924+0000 7f7c2d013700 1 --2- 172.21.15.80:0/2049968277 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7c281520b0 0x7f7c2814c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:19:54.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.924+0000 7f7c2e015700 1 --2- 172.21.15.80:0/2049968277 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c28158d50 0x7f7c28147170 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f7c20009dd0 tx=0x7f7c2000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:54.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.924+0000 7f7c1e7fc700 1 -- 172.21.15.80:0/2049968277 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c20009c40 con 0x7f7c28158d50 2024-05-08T21:19:54.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.924+0000 7f7c1e7fc700 1 -- 172.21.15.80:0/2049968277 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c2000f040 con 0x7f7c28158d50 2024-05-08T21:19:54.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.924+0000 7f7c2fa78700 1 -- 172.21.15.80:0/2049968277 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c28156e70 con 0x7f7c28158d50 2024-05-08T21:19:54.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.924+0000 7f7c1e7fc700 1 -- 172.21.15.80:0/2049968277 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c20014480 con 0x7f7c28158d50 2024-05-08T21:19:54.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.925+0000 7f7c2fa78700 1 -- 172.21.15.80:0/2049968277 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c281ed900 con 0x7f7c28158d50 2024-05-08T21:19:54.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.926+0000 7f7c2fa78700 1 -- 172.21.15.80:0/2049968277 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c281ed760 con 0x7f7c28158d50 2024-05-08T21:19:54.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.926+0000 7f7c1e7fc700 1 -- 172.21.15.80:0/2049968277 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7c200145e0 con 0x7f7c28158d50 2024-05-08T21:19:54.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.927+0000 7f7c1e7fc700 1 --2- 172.21.15.80:0/2049968277 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f7c0c06ac90 0x7f7c0c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:54.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.927+0000 7f7c2d814700 1 --2- 172.21.15.80:0/2049968277 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f7c0c06ac90 0x7f7c0c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:54.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.927+0000 7f7c1e7fc700 1 -- 172.21.15.80:0/2049968277 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f7c2008a4c0 con 0x7f7c28158d50 2024-05-08T21:19:54.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.927+0000 7f7c2d814700 1 --2- 172.21.15.80:0/2049968277 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f7c0c06ac90 0x7f7c0c06d150 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7c24009c10 tx=0x7f7c24008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:54.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:54.931+0000 7f7c1e7fc700 1 -- 172.21.15.80:0/2049968277 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f7c281ed760 con 0x7f7c28158d50 2024-05-08T21:19:55.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.137+0000 7f7c2fa78700 1 -- 172.21.15.80:0/2049968277 --> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f7c280c5430 con 0x7f7c0c06ac90 2024-05-08T21:19:55.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.137+0000 7f7c1e7fc700 1 -- 172.21.15.80:0/2049968277 <== mgr.4100 v2:172.21.15.80:6832/46731 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7c24011b80 con 0x7f7c0c06ac90 2024-05-08T21:19:55.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.140+0000 7f7c2fa78700 1 -- 172.21.15.80:0/2049968277 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f7c0c06ac90 msgr2=0x7f7c0c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:55.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.140+0000 7f7c2fa78700 1 --2- 172.21.15.80:0/2049968277 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f7c0c06ac90 0x7f7c0c06d150 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7c24009c10 tx=0x7f7c24008030 comp rx=0 tx=0).stop 2024-05-08T21:19:55.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.140+0000 7f7c2fa78700 1 -- 172.21.15.80:0/2049968277 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c28158d50 msgr2=0x7f7c28147170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:55.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.140+0000 7f7c2fa78700 1 --2- 172.21.15.80:0/2049968277 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c28158d50 0x7f7c28147170 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f7c20009dd0 tx=0x7f7c2000c3a0 comp rx=0 tx=0).stop 2024-05-08T21:19:55.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.140+0000 7f7c2fa78700 1 -- 172.21.15.80:0/2049968277 shutdown_connections 2024-05-08T21:19:55.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.140+0000 7f7c2fa78700 1 --2- 172.21.15.80:0/2049968277 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f7c0c06ac90 0x7f7c0c06d150 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:55.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.140+0000 7f7c2fa78700 1 --2- 172.21.15.80:0/2049968277 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c28158d50 0x7f7c28147170 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:55.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.140+0000 7f7c2fa78700 1 --2- 172.21.15.80:0/2049968277 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c280cbba0 0x7f7c281ee100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:55.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.140+0000 7f7c2fa78700 1 --2- 172.21.15.80:0/2049968277 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7c281520b0 0x7f7c2814c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:55.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.140+0000 7f7c2fa78700 1 -- 172.21.15.80:0/2049968277 >> 172.21.15.80:0/2049968277 conn(0x7f7c28066780 msgr2=0x7f7c280cd840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:55.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.140+0000 7f7c2fa78700 1 -- 172.21.15.80:0/2049968277 shutdown_connections 2024-05-08T21:19:55.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.140+0000 7f7c2fa78700 1 -- 172.21.15.80:0/2049968277 wait complete. 2024-05-08T21:19:55.144 INFO:teuthology.orchestra.run.smithi080.stderr:instructed osd(s) 0 to deep-scrub 2024-05-08T21:19:55.154 INFO:tasks.ceph:Scrubbing osd.1 2024-05-08T21:19:55.155 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-05-08T21:19:55.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.278+0000 7f193a140700 1 Processor -- start 2024-05-08T21:19:55.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.278+0000 7f193a140700 1 -- start start 2024-05-08T21:19:55.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.279+0000 7f193a140700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1934072fd0 0x7f193415b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:55.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.279+0000 7f193a140700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f193415bbf0 0x7f19340cffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:55.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.279+0000 7f193a140700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19340c4b50 con 0x7f1934154180 2024-05-08T21:19:55.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.279+0000 7f193a140700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19340ca940 con 0x7f193415bbf0 2024-05-08T21:19:55.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.279+0000 7f193a140700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19340c4e10 con 0x7f1934072fd0 2024-05-08T21:19:55.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.279+0000 7f1933fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f193415bbf0 0x7f19340cffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:55.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.279+0000 7f19337fe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f1934154180 0x7f193415ac40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46486/0 (socket says 172.21.15.80:46486) 2024-05-08T21:19:55.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.279+0000 7f19337fe700 1 -- 172.21.15.80:0/2693210415 learned_addr learned my addr 172.21.15.80:0/2693210415 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:19:55.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.279+0000 7f192affd700 1 --2- 172.21.15.80:0/2693210415 >> v2:172.21.15.106:3300/0 conn(0x7f1934072fd0 0x7f193415b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:55.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.279+0000 7f1933fff700 1 -- 172.21.15.80:0/2693210415 >> v2:172.21.15.106:3300/0 conn(0x7f1934072fd0 msgr2=0x7f193415b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:19:55.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.279+0000 7f1933fff700 1 --2- 172.21.15.80:0/2693210415 >> v2:172.21.15.106:3300/0 conn(0x7f1934072fd0 0x7f193415b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:55.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.279+0000 7f1933fff700 1 -- 172.21.15.80:0/2693210415 >> v1:172.21.15.80:6789/0 conn(0x7f1934154180 legacy=0x7f193415ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:55.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.279+0000 7f1932ffd700 1 -- 172.21.15.80:0/2693210415 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3549653776 0 0) 0x7f19340c4b50 con 0x7f1934154180 2024-05-08T21:19:55.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.279+0000 7f1933fff700 1 -- 172.21.15.80:0/2693210415 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19340c50f0 con 0x7f193415bbf0 2024-05-08T21:19:55.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.280+0000 7f1933fff700 1 --2- 172.21.15.80:0/2693210415 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f193415bbf0 0x7f19340cffb0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f19340b2550 tx=0x7f192c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c218e8f2da8bd9e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:55.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.280+0000 7f1932ffd700 1 -- 172.21.15.80:0/2693210415 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192c00e070 con 0x7f193415bbf0 2024-05-08T21:19:55.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.280+0000 7f1932ffd700 1 -- 172.21.15.80:0/2693210415 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f192c00bbd0 con 0x7f193415bbf0 2024-05-08T21:19:55.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.280+0000 7f1932ffd700 1 -- 172.21.15.80:0/2693210415 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192c012430 con 0x7f193415bbf0 2024-05-08T21:19:55.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.280+0000 7f193a140700 1 -- 172.21.15.80:0/2693210415 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f193415bbf0 msgr2=0x7f19340cffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:55.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.280+0000 7f193a140700 1 --2- 172.21.15.80:0/2693210415 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f193415bbf0 0x7f19340cffb0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f19340b2550 tx=0x7f192c00b330 comp rx=0 tx=0).stop 2024-05-08T21:19:55.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.280+0000 7f193a140700 1 -- 172.21.15.80:0/2693210415 shutdown_connections 2024-05-08T21:19:55.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.280+0000 7f193a140700 1 --2- 172.21.15.80:0/2693210415 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f193415bbf0 0x7f19340cffb0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:55.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.280+0000 7f193a140700 1 --2- 172.21.15.80:0/2693210415 >> v2:172.21.15.106:3300/0 conn(0x7f1934072fd0 0x7f193415b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:55.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.280+0000 7f193a140700 1 -- 172.21.15.80:0/2693210415 >> 172.21.15.80:0/2693210415 conn(0x7f193406ab90 msgr2=0x7f193406afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:55.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.280+0000 7f193a140700 1 -- 172.21.15.80:0/2693210415 shutdown_connections 2024-05-08T21:19:55.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.280+0000 7f193a140700 1 -- 172.21.15.80:0/2693210415 wait complete. 2024-05-08T21:19:55.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.281+0000 7f193a140700 1 Processor -- start 2024-05-08T21:19:55.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.282+0000 7f193a140700 1 -- start start 2024-05-08T21:19:55.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.282+0000 7f193a140700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1934072fd0 0x7f19341f0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:55.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.282+0000 7f193a140700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1934154180 0x7f19340cf3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:55.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.282+0000 7f193a140700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f193415bbf0 0x7f1934148180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:55.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.282+0000 7f193a140700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19341f08a0 con 0x7f1934072fd0 2024-05-08T21:19:55.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.282+0000 7f193a140700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19340cf8e0 con 0x7f1934154180 2024-05-08T21:19:55.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.282+0000 7f193a140700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1934147770 con 0x7f193415bbf0 2024-05-08T21:19:55.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.282+0000 7f19337fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1934072fd0 0x7f19341f0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:55.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.282+0000 7f19337fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1934072fd0 0x7f19341f0360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39368/0 (socket says 172.21.15.80:39368) 2024-05-08T21:19:55.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.282+0000 7f19337fe700 1 -- 172.21.15.80:0/3836736464 learned_addr learned my addr 172.21.15.80:0/3836736464 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:19:55.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.283+0000 7f192affd700 1 --2- 172.21.15.80:0/3836736464 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1934154180 0x7f19340cf3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:55.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.283+0000 7f1933fff700 1 --2- 172.21.15.80:0/3836736464 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f193415bbf0 0x7f1934148180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:55.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.283+0000 7f19337fe700 1 -- 172.21.15.80:0/3836736464 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f193415bbf0 msgr2=0x7f1934148180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:55.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.283+0000 7f19337fe700 1 --2- 172.21.15.80:0/3836736464 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f193415bbf0 0x7f1934148180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:55.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.283+0000 7f19337fe700 1 -- 172.21.15.80:0/3836736464 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1934154180 msgr2=0x7f19340cf3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:55.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.283+0000 7f19337fe700 1 --2- 172.21.15.80:0/3836736464 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1934154180 0x7f19340cf3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:55.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.283+0000 7f19337fe700 1 -- 172.21.15.80:0/3836736464 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f192c009a70 con 0x7f1934072fd0 2024-05-08T21:19:55.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.283+0000 7f19337fe700 1 --2- 172.21.15.80:0/3836736464 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1934072fd0 0x7f19341f0360 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f19240011e0 tx=0x7f192400cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:55.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.283+0000 7f1930ff9700 1 -- 172.21.15.80:0/3836736464 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1924004c80 con 0x7f1934072fd0 2024-05-08T21:19:55.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.283+0000 7f1930ff9700 1 -- 172.21.15.80:0/3836736464 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1924004e00 con 0x7f1934072fd0 2024-05-08T21:19:55.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.283+0000 7f193a140700 1 -- 172.21.15.80:0/3836736464 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1934146220 con 0x7f1934072fd0 2024-05-08T21:19:55.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.283+0000 7f1930ff9700 1 -- 172.21.15.80:0/3836736464 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1924007310 con 0x7f1934072fd0 2024-05-08T21:19:55.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.283+0000 7f193a140700 1 -- 172.21.15.80:0/3836736464 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1934141fa0 con 0x7f1934072fd0 2024-05-08T21:19:55.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.284+0000 7f193a140700 1 -- 172.21.15.80:0/3836736464 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f19340c5bd0 con 0x7f1934072fd0 2024-05-08T21:19:55.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.284+0000 7f1930ff9700 1 -- 172.21.15.80:0/3836736464 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1924007470 con 0x7f1934072fd0 2024-05-08T21:19:55.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.285+0000 7f1930ff9700 1 --2- 172.21.15.80:0/3836736464 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f191406ac90 0x7f191406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:55.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.285+0000 7f1930ff9700 1 -- 172.21.15.80:0/3836736464 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f1924089ed0 con 0x7f1934072fd0 2024-05-08T21:19:55.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.285+0000 7f192affd700 1 --2- 172.21.15.80:0/3836736464 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f191406ac90 0x7f191406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:55.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.285+0000 7f1930ff9700 1 --2- 172.21.15.80:0/3836736464 >> [v2:172.21.15.80:6808/47010,v1:172.21.15.80:6809/47010] conn(0x7f1914074880 0x7f1914076d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:55.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.285+0000 7f1930ff9700 1 -- 172.21.15.80:0/3836736464 --> [v2:172.21.15.80:6808/47010,v1:172.21.15.80:6809/47010] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f19140773f0 con 0x7f1914074880 2024-05-08T21:19:55.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.285+0000 7f1930ff9700 1 -- 172.21.15.80:0/3836736464 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f192408a320 con 0x7f1934072fd0 2024-05-08T21:19:55.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.285+0000 7f1933fff700 1 --2- 172.21.15.80:0/3836736464 >> [v2:172.21.15.80:6808/47010,v1:172.21.15.80:6809/47010] conn(0x7f1914074880 0x7f1914076d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:55.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.285+0000 7f192affd700 1 --2- 172.21.15.80:0/3836736464 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f191406ac90 0x7f191406d150 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f19340c60b0 tx=0x7f191c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:55.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.285+0000 7f1933fff700 1 --2- 172.21.15.80:0/3836736464 >> [v2:172.21.15.80:6808/47010,v1:172.21.15.80:6809/47010] conn(0x7f1914074880 0x7f1914076d20 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:55.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.286+0000 7f1930ff9700 1 -- 172.21.15.80:0/3836736464 <== osd.1 v2:172.21.15.80:6808/47010 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f19140773f0 con 0x7f1914074880 2024-05-08T21:19:55.303 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.301+0000 7f193a140700 1 -- 172.21.15.80:0/3836736464 --> [v2:172.21.15.80:6808/47010,v1:172.21.15.80:6809/47010] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f19340c56b0 con 0x7f1914074880 2024-05-08T21:19:55.303 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.301+0000 7f1930ff9700 1 -- 172.21.15.80:0/3836736464 <== osd.1 v2:172.21.15.80:6808/47010 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f192c003b80 con 0x7f1914074880 2024-05-08T21:19:55.304 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T21:19:55.305 INFO:teuthology.orchestra.run.smithi080.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T21:19:55.305 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T21:19:55.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.301+0000 7f193a140700 1 -- 172.21.15.80:0/3836736464 >> [v2:172.21.15.80:6808/47010,v1:172.21.15.80:6809/47010] conn(0x7f1914074880 msgr2=0x7f1914076d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:55.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.301+0000 7f193a140700 1 --2- 172.21.15.80:0/3836736464 >> [v2:172.21.15.80:6808/47010,v1:172.21.15.80:6809/47010] conn(0x7f1914074880 0x7f1914076d20 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:55.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.301+0000 7f193a140700 1 -- 172.21.15.80:0/3836736464 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f191406ac90 msgr2=0x7f191406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:55.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.301+0000 7f193a140700 1 --2- 172.21.15.80:0/3836736464 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f191406ac90 0x7f191406d150 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f19340c60b0 tx=0x7f191c008040 comp rx=0 tx=0).stop 2024-05-08T21:19:55.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.301+0000 7f193a140700 1 -- 172.21.15.80:0/3836736464 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1934072fd0 msgr2=0x7f19341f0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:55.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.301+0000 7f193a140700 1 --2- 172.21.15.80:0/3836736464 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1934072fd0 0x7f19341f0360 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f19240011e0 tx=0x7f192400cae0 comp rx=0 tx=0).stop 2024-05-08T21:19:55.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.301+0000 7f1933fff700 1 -- 172.21.15.80:0/3836736464 reap_dead start 2024-05-08T21:19:55.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.301+0000 7f193a140700 1 -- 172.21.15.80:0/3836736464 shutdown_connections 2024-05-08T21:19:55.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.301+0000 7f193a140700 1 -- 172.21.15.80:0/3836736464 >> 172.21.15.80:0/3836736464 conn(0x7f193406ab90 msgr2=0x7f19340cff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:55.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.302+0000 7f193a140700 1 -- 172.21.15.80:0/3836736464 shutdown_connections 2024-05-08T21:19:55.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.302+0000 7f193a140700 1 -- 172.21.15.80:0/3836736464 wait complete. 2024-05-08T21:19:55.316 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-05-08T21:19:55.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.436+0000 7f5b8e56e700 1 Processor -- start 2024-05-08T21:19:55.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.436+0000 7f5b8e56e700 1 -- start start 2024-05-08T21:19:55.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.437+0000 7f5b8e56e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5b8806a9c0 0x7f5b881522d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:55.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.437+0000 7f5b8e56e700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5b88157f90 0x7f5b880c7b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:55.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.437+0000 7f5b8e56e700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b88072530 con 0x7f5b88151ef0 2024-05-08T21:19:55.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.437+0000 7f5b8e56e700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b880733b0 con 0x7f5b8806a9c0 2024-05-08T21:19:55.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.437+0000 7f5b8e56e700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8806ce90 con 0x7f5b88157f90 2024-05-08T21:19:55.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.437+0000 7f5b877fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5b8806a9c0 0x7f5b881522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:55.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.437+0000 7f5b877fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5b8806a9c0 0x7f5b881522d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39372/0 (socket says 172.21.15.80:39372) 2024-05-08T21:19:55.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.437+0000 7f5b877fe700 1 -- 172.21.15.80:0/3608241420 learned_addr learned my addr 172.21.15.80:0/3608241420 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:19:55.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.437+0000 7f5b8cb0b700 1 --2- 172.21.15.80:0/3608241420 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5b88157f90 0x7f5b880c7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:55.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.437+0000 7f5b877fe700 1 -- 172.21.15.80:0/3608241420 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5b88157f90 msgr2=0x7f5b880c7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:19:55.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.437+0000 7f5b877fe700 1 --2- 172.21.15.80:0/3608241420 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5b88157f90 0x7f5b880c7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:55.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.437+0000 7f5b877fe700 1 -- 172.21.15.80:0/3608241420 >> v1:172.21.15.106:6789/0 conn(0x7f5b88151ef0 legacy=0x7f5b88072ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:55.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.437+0000 7f5b877fe700 1 -- 172.21.15.80:0/3608241420 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b880c89e0 con 0x7f5b8806a9c0 2024-05-08T21:19:55.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.437+0000 7f5b8cb0b700 1 --2- 172.21.15.80:0/3608241420 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5b88157f90 0x7f5b880c7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:19:55.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.437+0000 7f5b877fe700 1 --2- 172.21.15.80:0/3608241420 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b8806a9c0 0x7f5b881522d0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f5b78009920 tx=0x7f5b78009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7406563d47f82589 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:55.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.437+0000 7f5b86ffd700 1 -- 172.21.15.80:0/3608241420 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7800ba20 con 0x7f5b8806a9c0 2024-05-08T21:19:55.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.438+0000 7f5b86ffd700 1 -- 172.21.15.80:0/3608241420 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b7800bb80 con 0x7f5b8806a9c0 2024-05-08T21:19:55.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.438+0000 7f5b86ffd700 1 -- 172.21.15.80:0/3608241420 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b78009e70 con 0x7f5b8806a9c0 2024-05-08T21:19:55.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.438+0000 7f5b8e56e700 1 -- 172.21.15.80:0/3608241420 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b8806a9c0 msgr2=0x7f5b881522d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:55.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.438+0000 7f5b8e56e700 1 --2- 172.21.15.80:0/3608241420 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b8806a9c0 0x7f5b881522d0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f5b78009920 tx=0x7f5b78009c30 comp rx=0 tx=0).stop 2024-05-08T21:19:55.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.438+0000 7f5b8e56e700 1 -- 172.21.15.80:0/3608241420 shutdown_connections 2024-05-08T21:19:55.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.438+0000 7f5b8e56e700 1 --2- 172.21.15.80:0/3608241420 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5b88157f90 0x7f5b880c7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:55.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.438+0000 7f5b8e56e700 1 --2- 172.21.15.80:0/3608241420 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b8806a9c0 0x7f5b881522d0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:55.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.438+0000 7f5b8e56e700 1 -- 172.21.15.80:0/3608241420 >> 172.21.15.80:0/3608241420 conn(0x7f5b8806ef80 msgr2=0x7f5b8806f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:55.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.438+0000 7f5b8e56e700 1 -- 172.21.15.80:0/3608241420 shutdown_connections 2024-05-08T21:19:55.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.438+0000 7f5b8e56e700 1 -- 172.21.15.80:0/3608241420 wait complete. 2024-05-08T21:19:55.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.439+0000 7f5b8e56e700 1 Processor -- start 2024-05-08T21:19:55.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.439+0000 7f5b8e56e700 1 -- start start 2024-05-08T21:19:55.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.440+0000 7f5b8e56e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b8806a9c0 0x7f5b88155490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:55.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.440+0000 7f5b8e56e700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5b88151ef0 0x7f5b88071390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:55.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.440+0000 7f5b8e56e700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5b88157f90 0x7f5b880718d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:55.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.440+0000 7f5b8e56e700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b881473c0 con 0x7f5b8806a9c0 2024-05-08T21:19:55.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.440+0000 7f5b8e56e700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b88147180 con 0x7f5b88151ef0 2024-05-08T21:19:55.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.440+0000 7f5b8e56e700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b88147660 con 0x7f5b88157f90 2024-05-08T21:19:55.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.440+0000 7f5b87fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b8806a9c0 0x7f5b88155490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:55.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.440+0000 7f5b87fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b8806a9c0 0x7f5b88155490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39388/0 (socket says 172.21.15.80:39388) 2024-05-08T21:19:55.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.440+0000 7f5b87fff700 1 -- 172.21.15.80:0/4127227822 learned_addr learned my addr 172.21.15.80:0/4127227822 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:19:55.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.440+0000 7f5b877fe700 1 --2- 172.21.15.80:0/4127227822 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5b88151ef0 0x7f5b88071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:55.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.440+0000 7f5b8cb0b700 1 --2- 172.21.15.80:0/4127227822 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5b88157f90 0x7f5b880718d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:55.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.441+0000 7f5b87fff700 1 -- 172.21.15.80:0/4127227822 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5b88157f90 msgr2=0x7f5b880718d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:55.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.441+0000 7f5b87fff700 1 --2- 172.21.15.80:0/4127227822 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5b88157f90 0x7f5b880718d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:55.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.441+0000 7f5b87fff700 1 -- 172.21.15.80:0/4127227822 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5b88151ef0 msgr2=0x7f5b88071390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:55.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.441+0000 7f5b87fff700 1 --2- 172.21.15.80:0/4127227822 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5b88151ef0 0x7f5b88071390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:55.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.441+0000 7f5b87fff700 1 -- 172.21.15.80:0/4127227822 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b78009550 con 0x7f5b8806a9c0 2024-05-08T21:19:55.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.441+0000 7f5b8cb0b700 1 --2- 172.21.15.80:0/4127227822 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5b88157f90 0x7f5b880718d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:19:55.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.441+0000 7f5b87fff700 1 --2- 172.21.15.80:0/4127227822 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b8806a9c0 0x7f5b88155490 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c00c4e0 tx=0x7f5b7c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:55.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.441+0000 7f5b84ff9700 1 -- 172.21.15.80:0/4127227822 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c0052d0 con 0x7f5b8806a9c0 2024-05-08T21:19:55.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.441+0000 7f5b84ff9700 1 -- 172.21.15.80:0/4127227822 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b7c005430 con 0x7f5b8806a9c0 2024-05-08T21:19:55.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.441+0000 7f5b8e56e700 1 -- 172.21.15.80:0/4127227822 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b881edc60 con 0x7f5b8806a9c0 2024-05-08T21:19:55.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.441+0000 7f5b84ff9700 1 -- 172.21.15.80:0/4127227822 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c0038c0 con 0x7f5b8806a9c0 2024-05-08T21:19:55.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.441+0000 7f5b8e56e700 1 -- 172.21.15.80:0/4127227822 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b881ee220 con 0x7f5b8806a9c0 2024-05-08T21:19:55.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.442+0000 7f5b8e56e700 1 -- 172.21.15.80:0/4127227822 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b88158d20 con 0x7f5b8806a9c0 2024-05-08T21:19:55.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.442+0000 7f5b84ff9700 1 -- 172.21.15.80:0/4127227822 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5b7c003a20 con 0x7f5b8806a9c0 2024-05-08T21:19:55.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.443+0000 7f5b84ff9700 1 --2- 172.21.15.80:0/4127227822 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f5b7406ac90 0x7f5b7406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:55.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.443+0000 7f5b84ff9700 1 -- 172.21.15.80:0/4127227822 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f5b7c088d10 con 0x7f5b8806a9c0 2024-05-08T21:19:55.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.443+0000 7f5b877fe700 1 --2- 172.21.15.80:0/4127227822 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f5b7406ac90 0x7f5b7406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:55.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.443+0000 7f5b877fe700 1 --2- 172.21.15.80:0/4127227822 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f5b7406ac90 0x7f5b7406d150 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5b88069020 tx=0x7f5b78008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:55.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.447+0000 7f5b84ff9700 1 -- 172.21.15.80:0/4127227822 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f5b7c053950 con 0x7f5b8806a9c0 2024-05-08T21:19:55.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.646+0000 7f5b8e56e700 1 -- 172.21.15.80:0/4127227822 --> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f5b88072780 con 0x7f5b7406ac90 2024-05-08T21:19:55.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.646+0000 7f5b84ff9700 1 -- 172.21.15.80:0/4127227822 <== mgr.4100 v2:172.21.15.80:6832/46731 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5b7800b820 con 0x7f5b7406ac90 2024-05-08T21:19:55.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.649+0000 7f5b8e56e700 1 -- 172.21.15.80:0/4127227822 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f5b7406ac90 msgr2=0x7f5b7406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:55.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.649+0000 7f5b8e56e700 1 --2- 172.21.15.80:0/4127227822 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f5b7406ac90 0x7f5b7406d150 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5b88069020 tx=0x7f5b78008030 comp rx=0 tx=0).stop 2024-05-08T21:19:55.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.649+0000 7f5b8e56e700 1 -- 172.21.15.80:0/4127227822 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b8806a9c0 msgr2=0x7f5b88155490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:55.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.649+0000 7f5b8e56e700 1 --2- 172.21.15.80:0/4127227822 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b8806a9c0 0x7f5b88155490 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c00c4e0 tx=0x7f5b7c00c7f0 comp rx=0 tx=0).stop 2024-05-08T21:19:55.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.649+0000 7f5b8e56e700 1 -- 172.21.15.80:0/4127227822 shutdown_connections 2024-05-08T21:19:55.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.649+0000 7f5b8e56e700 1 --2- 172.21.15.80:0/4127227822 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f5b7406ac90 0x7f5b7406d150 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:55.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.649+0000 7f5b8e56e700 1 --2- 172.21.15.80:0/4127227822 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b8806a9c0 0x7f5b88155490 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:55.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.649+0000 7f5b8e56e700 1 --2- 172.21.15.80:0/4127227822 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5b88157f90 0x7f5b880718d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:55.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.649+0000 7f5b8e56e700 1 --2- 172.21.15.80:0/4127227822 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5b88151ef0 0x7f5b88071390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:55.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.649+0000 7f5b8e56e700 1 -- 172.21.15.80:0/4127227822 >> 172.21.15.80:0/4127227822 conn(0x7f5b8806ef80 msgr2=0x7f5b8814ea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:55.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.649+0000 7f5b8e56e700 1 -- 172.21.15.80:0/4127227822 shutdown_connections 2024-05-08T21:19:55.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.649+0000 7f5b8e56e700 1 -- 172.21.15.80:0/4127227822 wait complete. 2024-05-08T21:19:55.654 INFO:teuthology.orchestra.run.smithi080.stderr:instructed osd(s) 1 to deep-scrub 2024-05-08T21:19:55.664 INFO:tasks.ceph:Scrubbing osd.2 2024-05-08T21:19:55.665 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-05-08T21:19:55.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.789+0000 7f57ac0d9700 1 Processor -- start 2024-05-08T21:19:55.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.789+0000 7f57ac0d9700 1 -- start start 2024-05-08T21:19:55.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.790+0000 7f57ac0d9700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f57a406ada0 0x7f57a41674d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:55.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.790+0000 7f57ac0d9700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57a416a750 con 0x7f57a406a9c0 2024-05-08T21:19:55.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.790+0000 7f57ac0d9700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57a416b2b0 con 0x7f57a4167a10 2024-05-08T21:19:55.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.790+0000 7f57ac0d9700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57a4072630 con 0x7f57a406ada0 2024-05-08T21:19:55.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.790+0000 7f57a9e75700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f57a406a9c0 0x7f57a40c7130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46502/0 (socket says 172.21.15.80:46502) 2024-05-08T21:19:55.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.790+0000 7f57a9e75700 1 -- 172.21.15.80:0/1962948492 learned_addr learned my addr 172.21.15.80:0/1962948492 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:19:55.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.790+0000 7f57a9674700 1 --2- 172.21.15.80:0/1962948492 >> v2:172.21.15.106:3300/0 conn(0x7f57a406ada0 0x7f57a41674d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:55.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.790+0000 7f57a8e73700 1 -- 172.21.15.80:0/1962948492 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1006660005 0 0) 0x7f57a416a750 con 0x7f57a406a9c0 2024-05-08T21:19:55.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.844+0000 7f57a8e73700 1 -- 172.21.15.80:0/1962948492 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5790003590 con 0x7f57a406a9c0 2024-05-08T21:19:55.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.844+0000 7f57a8e73700 1 -- 172.21.15.80:0/1962948492 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3571684029 0 0) 0x7f57a416b2b0 con 0x7f57a4167a10 2024-05-08T21:19:55.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.844+0000 7f57a8e73700 1 -- 172.21.15.80:0/1962948492 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57a416a750 con 0x7f57a4167a10 2024-05-08T21:19:55.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.844+0000 7f57a8e73700 1 -- 172.21.15.80:0/1962948492 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 627309197 0 0) 0x7f5790003590 con 0x7f57a406a9c0 2024-05-08T21:19:55.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.844+0000 7f57a8e73700 1 -- 172.21.15.80:0/1962948492 >> v2:172.21.15.106:3300/0 conn(0x7f57a406ada0 msgr2=0x7f57a41674d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:19:55.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.844+0000 7f57a8e73700 1 --2- 172.21.15.80:0/1962948492 >> v2:172.21.15.106:3300/0 conn(0x7f57a406ada0 0x7f57a41674d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:55.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.844+0000 7f57a8e73700 1 -- 172.21.15.80:0/1962948492 >> v1:172.21.15.106:6789/0 conn(0x7f57a4167a10 legacy=0x7f57a4171740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:55.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.844+0000 7f57a8e73700 1 -- 172.21.15.80:0/1962948492 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a416aa10 con 0x7f57a406a9c0 2024-05-08T21:19:55.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.844+0000 7f57a8e73700 1 -- 172.21.15.80:0/1962948492 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3520646302 0 0) 0x7f5794001670 con 0x7f57a406a9c0 2024-05-08T21:19:55.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.844+0000 7f57a8e73700 1 -- 172.21.15.80:0/1962948492 >> v1:172.21.15.80:6789/0 conn(0x7f57a406a9c0 legacy=0x7f57a40c7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:55.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.844+0000 7f57a8e73700 1 --2- 172.21.15.80:0/1962948492 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5790003d60 0x7f5790004160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:55.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.844+0000 7f57a8e73700 1 --2- 172.21.15.80:0/1962948492 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f57900046a0 0x7f579000d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:55.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.844+0000 7f57a8e73700 1 --2- 172.21.15.80:0/1962948492 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f579000d9e0 0x7f579000fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:55.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.844+0000 7f57a8e73700 1 -- 172.21.15.80:0/1962948492 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57900104d0 con 0x7f579000d9e0 2024-05-08T21:19:55.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.844+0000 7f57a8e73700 1 -- 172.21.15.80:0/1962948492 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5790010640 con 0x7f5790003d60 2024-05-08T21:19:55.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.844+0000 7f57a8e73700 1 -- 172.21.15.80:0/1962948492 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5790010800 con 0x7f57900046a0 2024-05-08T21:19:55.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.844+0000 7f57aa676700 1 --2- 172.21.15.80:0/1962948492 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f579000d9e0 0x7f579000fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:55.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.844+0000 7f57a9e75700 1 --2- 172.21.15.80:0/1962948492 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5790003d60 0x7f5790004160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:55.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.844+0000 7f57a9674700 1 --2- 172.21.15.80:0/1962948492 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f57900046a0 0x7f579000d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:55.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.845+0000 7f57aa676700 1 -- 172.21.15.80:0/1962948492 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f57900046a0 msgr2=0x7f579000d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:19:55.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.845+0000 7f57aa676700 1 --2- 172.21.15.80:0/1962948492 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f57900046a0 0x7f579000d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:55.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.845+0000 7f57aa676700 1 -- 172.21.15.80:0/1962948492 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5790003d60 msgr2=0x7f5790004160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:19:55.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.845+0000 7f57aa676700 1 --2- 172.21.15.80:0/1962948492 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5790003d60 0x7f5790004160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:55.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.845+0000 7f57aa676700 1 -- 172.21.15.80:0/1962948492 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5790003590 con 0x7f579000d9e0 2024-05-08T21:19:55.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.845+0000 7f57aa676700 1 -- 172.21.15.80:0/1962948492 reap_dead start 2024-05-08T21:19:55.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.845+0000 7f57aa676700 1 --2- 172.21.15.80:0/1962948492 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f579000d9e0 0x7f579000fdd0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f579c00c2f0 tx=0x7f5790004de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98f464c3c637d518 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:55.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.845+0000 7f57a8e73700 1 -- 172.21.15.80:0/1962948492 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579c001f30 con 0x7f579000d9e0 2024-05-08T21:19:55.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.845+0000 7f57a8e73700 1 -- 172.21.15.80:0/1962948492 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f579c003a00 con 0x7f579000d9e0 2024-05-08T21:19:55.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.845+0000 7f57a8e73700 1 -- 172.21.15.80:0/1962948492 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579c003db0 con 0x7f579000d9e0 2024-05-08T21:19:55.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.845+0000 7f57ac0d9700 1 -- 172.21.15.80:0/1962948492 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f579000d9e0 msgr2=0x7f579000fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:55.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.845+0000 7f57ac0d9700 1 --2- 172.21.15.80:0/1962948492 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f579000d9e0 0x7f579000fdd0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f579c00c2f0 tx=0x7f5790004de0 comp rx=0 tx=0).stop 2024-05-08T21:19:55.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.846+0000 7f57ac0d9700 1 -- 172.21.15.80:0/1962948492 shutdown_connections 2024-05-08T21:19:55.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.846+0000 7f57ac0d9700 1 --2- 172.21.15.80:0/1962948492 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f579000d9e0 0x7f579000fdd0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:55.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.846+0000 7f57ac0d9700 1 -- 172.21.15.80:0/1962948492 >> 172.21.15.80:0/1962948492 conn(0x7f57a40cb620 msgr2=0x7f57a40cba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:55.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.846+0000 7f57ac0d9700 1 -- 172.21.15.80:0/1962948492 shutdown_connections 2024-05-08T21:19:55.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.846+0000 7f57ac0d9700 1 -- 172.21.15.80:0/1962948492 wait complete. 2024-05-08T21:19:55.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.847+0000 7f57ac0d9700 1 Processor -- start 2024-05-08T21:19:55.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.847+0000 7f57ac0d9700 1 -- start start 2024-05-08T21:19:55.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.848+0000 7f57ac0d9700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f579000d9e0 0x7f57a415d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:55.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.848+0000 7f57ac0d9700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f57a4160ec0 0x7f57a4161340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:55.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.848+0000 7f57ac0d9700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f57a415fc50 0x7f57a41600d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:55.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.848+0000 7f57ac0d9700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a415ec80 con 0x7f579000d9e0 2024-05-08T21:19:55.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.848+0000 7f57ac0d9700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a40c2e20 con 0x7f57a415fc50 2024-05-08T21:19:55.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.848+0000 7f57ac0d9700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57a415f7c0 con 0x7f57a4160ec0 2024-05-08T21:19:55.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.848+0000 7f57a9e75700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f579000d9e0 0x7f57a415d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:55.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.848+0000 7f57a9e75700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f579000d9e0 0x7f57a415d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39404/0 (socket says 172.21.15.80:39404) 2024-05-08T21:19:55.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.848+0000 7f57a9e75700 1 -- 172.21.15.80:0/3579687402 learned_addr learned my addr 172.21.15.80:0/3579687402 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:19:55.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.848+0000 7f57aa676700 1 --2- 172.21.15.80:0/3579687402 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f57a415fc50 0x7f57a41600d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:55.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.848+0000 7f57a9674700 1 --2- 172.21.15.80:0/3579687402 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f57a4160ec0 0x7f57a4161340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:55.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.849+0000 7f57a9e75700 1 -- 172.21.15.80:0/3579687402 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f57a4160ec0 msgr2=0x7f57a4161340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:55.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.849+0000 7f57a9e75700 1 --2- 172.21.15.80:0/3579687402 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f57a4160ec0 0x7f57a4161340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:55.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.849+0000 7f57a9e75700 1 -- 172.21.15.80:0/3579687402 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f57a415fc50 msgr2=0x7f57a41600d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:55.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.849+0000 7f57a9e75700 1 --2- 172.21.15.80:0/3579687402 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f57a415fc50 0x7f57a41600d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:55.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.849+0000 7f57a9e75700 1 -- 172.21.15.80:0/3579687402 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a41ff8b0 con 0x7f579000d9e0 2024-05-08T21:19:55.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.849+0000 7f57a9e75700 1 --2- 172.21.15.80:0/3579687402 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f579000d9e0 0x7f57a415d770 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f57940072c0 tx=0x7f57940075d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:55.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.849+0000 7f579a7fc700 1 -- 172.21.15.80:0/3579687402 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5794011580 con 0x7f579000d9e0 2024-05-08T21:19:55.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.849+0000 7f579a7fc700 1 -- 172.21.15.80:0/3579687402 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57940116e0 con 0x7f579000d9e0 2024-05-08T21:19:55.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.849+0000 7f57ac0d9700 1 -- 172.21.15.80:0/3579687402 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57a40c6be0 con 0x7f579000d9e0 2024-05-08T21:19:55.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.849+0000 7f579a7fc700 1 -- 172.21.15.80:0/3579687402 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5794011a90 con 0x7f579000d9e0 2024-05-08T21:19:55.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.849+0000 7f57ac0d9700 1 -- 172.21.15.80:0/3579687402 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57a415f170 con 0x7f579000d9e0 2024-05-08T21:19:55.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.850+0000 7f57ac0d9700 1 -- 172.21.15.80:0/3579687402 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f57a416afd0 con 0x7f579000d9e0 2024-05-08T21:19:55.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.850+0000 7f579a7fc700 1 -- 172.21.15.80:0/3579687402 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5794011bf0 con 0x7f579000d9e0 2024-05-08T21:19:55.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.851+0000 7f579a7fc700 1 --2- 172.21.15.80:0/3579687402 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f578806ac90 0x7f578806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:55.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.851+0000 7f579a7fc700 1 -- 172.21.15.80:0/3579687402 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f57940896f0 con 0x7f579000d9e0 2024-05-08T21:19:55.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.851+0000 7f57a9674700 1 --2- 172.21.15.80:0/3579687402 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f578806ac90 0x7f578806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:55.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.851+0000 7f579a7fc700 1 --2- 172.21.15.80:0/3579687402 >> [v2:172.21.15.80:6800/47009,v1:172.21.15.80:6801/47009] conn(0x7f5788074880 0x7f5788076d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:55.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.851+0000 7f579a7fc700 1 -- 172.21.15.80:0/3579687402 --> [v2:172.21.15.80:6800/47009,v1:172.21.15.80:6801/47009] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f57880773f0 con 0x7f5788074880 2024-05-08T21:19:55.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.851+0000 7f579a7fc700 1 -- 172.21.15.80:0/3579687402 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f579408bdb0 con 0x7f579000d9e0 2024-05-08T21:19:55.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.851+0000 7f57aa676700 1 --2- 172.21.15.80:0/3579687402 >> [v2:172.21.15.80:6800/47009,v1:172.21.15.80:6801/47009] conn(0x7f5788074880 0x7f5788076d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:55.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.851+0000 7f57a9674700 1 --2- 172.21.15.80:0/3579687402 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f578806ac90 0x7f578806d150 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f57a415eb50 tx=0x7f57a000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:55.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.851+0000 7f57aa676700 1 --2- 172.21.15.80:0/3579687402 >> [v2:172.21.15.80:6800/47009,v1:172.21.15.80:6801/47009] conn(0x7f5788074880 0x7f5788076d20 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:55.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.852+0000 7f579a7fc700 1 -- 172.21.15.80:0/3579687402 <== osd.2 v2:172.21.15.80:6800/47009 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f57880773f0 con 0x7f5788074880 2024-05-08T21:19:55.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.867+0000 7f57ac0d9700 1 -- 172.21.15.80:0/3579687402 --> [v2:172.21.15.80:6800/47009,v1:172.21.15.80:6801/47009] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f57a4167e80 con 0x7f5788074880 2024-05-08T21:19:55.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.867+0000 7f579a7fc700 1 -- 172.21.15.80:0/3579687402 <== osd.2 v2:172.21.15.80:6800/47009 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f579c00cd10 con 0x7f5788074880 2024-05-08T21:19:55.873 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T21:19:55.873 INFO:teuthology.orchestra.run.smithi080.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T21:19:55.873 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T21:19:55.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.867+0000 7f57ac0d9700 1 -- 172.21.15.80:0/3579687402 >> [v2:172.21.15.80:6800/47009,v1:172.21.15.80:6801/47009] conn(0x7f5788074880 msgr2=0x7f5788076d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:55.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.867+0000 7f57ac0d9700 1 --2- 172.21.15.80:0/3579687402 >> [v2:172.21.15.80:6800/47009,v1:172.21.15.80:6801/47009] conn(0x7f5788074880 0x7f5788076d20 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:55.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.867+0000 7f57ac0d9700 1 -- 172.21.15.80:0/3579687402 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f578806ac90 msgr2=0x7f578806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:55.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.867+0000 7f57ac0d9700 1 --2- 172.21.15.80:0/3579687402 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f578806ac90 0x7f578806d150 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f57a415eb50 tx=0x7f57a000b040 comp rx=0 tx=0).stop 2024-05-08T21:19:55.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.867+0000 7f57ac0d9700 1 -- 172.21.15.80:0/3579687402 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f579000d9e0 msgr2=0x7f57a415d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:55.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.867+0000 7f57ac0d9700 1 --2- 172.21.15.80:0/3579687402 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f579000d9e0 0x7f57a415d770 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f57940072c0 tx=0x7f57940075d0 comp rx=0 tx=0).stop 2024-05-08T21:19:55.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.867+0000 7f57aa676700 1 -- 172.21.15.80:0/3579687402 reap_dead start 2024-05-08T21:19:55.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.868+0000 7f57ac0d9700 1 -- 172.21.15.80:0/3579687402 shutdown_connections 2024-05-08T21:19:55.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.868+0000 7f57ac0d9700 1 -- 172.21.15.80:0/3579687402 >> 172.21.15.80:0/3579687402 conn(0x7f57a40cb620 msgr2=0x7f57a4165d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:55.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.868+0000 7f57ac0d9700 1 -- 172.21.15.80:0/3579687402 shutdown_connections 2024-05-08T21:19:55.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:55.868+0000 7f57ac0d9700 1 -- 172.21.15.80:0/3579687402 wait complete. 2024-05-08T21:19:55.882 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-05-08T21:19:56.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.006+0000 7f66cfcd8700 1 Processor -- start 2024-05-08T21:19:56.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.006+0000 7f66cfcd8700 1 -- start start 2024-05-08T21:19:56.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.007+0000 7f66cfcd8700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f66c8154580 0x7f66c815abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:56.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.007+0000 7f66cfcd8700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66c80cad60 con 0x7f66c80cbe40 2024-05-08T21:19:56.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.007+0000 7f66cfcd8700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66c815d930 con 0x7f66c80cc3d0 2024-05-08T21:19:56.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.007+0000 7f66cfcd8700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66c80b2c60 con 0x7f66c8154580 2024-05-08T21:19:56.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.007+0000 7f66cd273700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f66c80cbe40 0x7f66c80c48c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46516/0 (socket says 172.21.15.80:46516) 2024-05-08T21:19:56.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.007+0000 7f66cd273700 1 -- 172.21.15.80:0/1533447775 learned_addr learned my addr 172.21.15.80:0/1533447775 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:19:56.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.007+0000 7f66cca72700 1 -- 172.21.15.80:0/1533447775 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2341994993 0 0) 0x7f66c80cad60 con 0x7f66c80cbe40 2024-05-08T21:19:56.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.007+0000 7f66cca72700 1 -- 172.21.15.80:0/1533447775 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66b40035b0 con 0x7f66c80cbe40 2024-05-08T21:19:56.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.007+0000 7f66cda74700 1 --2- 172.21.15.80:0/1533447775 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f66c8154580 0x7f66c815abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:56.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.007+0000 7f66cca72700 1 -- 172.21.15.80:0/1533447775 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4285733939 0 0) 0x7f66b40035b0 con 0x7f66c80cbe40 2024-05-08T21:19:56.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.007+0000 7f66cca72700 1 -- 172.21.15.80:0/1533447775 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f66c8154580 msgr2=0x7f66c815abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:19:56.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.007+0000 7f66cca72700 1 --2- 172.21.15.80:0/1533447775 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f66c8154580 0x7f66c815abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:56.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.007+0000 7f66cca72700 1 -- 172.21.15.80:0/1533447775 >> v1:172.21.15.106:6789/0 conn(0x7f66c80cc3d0 legacy=0x7f66c8164ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:56.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.007+0000 7f66cca72700 1 -- 172.21.15.80:0/1533447775 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66c815dc10 con 0x7f66c80cbe40 2024-05-08T21:19:56.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.007+0000 7f66cca72700 1 -- 172.21.15.80:0/1533447775 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3520646302 0 0) 0x7f66b8001670 con 0x7f66c80cbe40 2024-05-08T21:19:56.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.007+0000 7f66cca72700 1 -- 172.21.15.80:0/1533447775 >> v1:172.21.15.80:6789/0 conn(0x7f66c80cbe40 legacy=0x7f66c80c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:56.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.007+0000 7f66cca72700 1 --2- 172.21.15.80:0/1533447775 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f66c8154580 0x7f66b4003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:56.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.008+0000 7f66cca72700 1 --2- 172.21.15.80:0/1533447775 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66b4004060 0x7f66b4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:56.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.008+0000 7f66cca72700 1 --2- 172.21.15.80:0/1533447775 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f66b4004d90 0x7f66b4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:56.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.008+0000 7f66cca72700 1 -- 172.21.15.80:0/1533447775 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c80b2c60 con 0x7f66b4004060 2024-05-08T21:19:56.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.008+0000 7f66cca72700 1 -- 172.21.15.80:0/1533447775 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66b400bc50 con 0x7f66b4004d90 2024-05-08T21:19:56.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.008+0000 7f66cca72700 1 -- 172.21.15.80:0/1533447775 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66b400be10 con 0x7f66c8154580 2024-05-08T21:19:56.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.008+0000 7f66cd273700 1 --2- 172.21.15.80:0/1533447775 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66b4004060 0x7f66b4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:56.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.008+0000 7f66cda74700 1 --2- 172.21.15.80:0/1533447775 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f66c8154580 0x7f66b4003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:56.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.008+0000 7f66ce275700 1 --2- 172.21.15.80:0/1533447775 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f66b4004d90 0x7f66b4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:56.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.008+0000 7f66cd273700 1 -- 172.21.15.80:0/1533447775 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f66c8154580 msgr2=0x7f66b4003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:19:56.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.008+0000 7f66cd273700 1 --2- 172.21.15.80:0/1533447775 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f66c8154580 0x7f66b4003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:56.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.008+0000 7f66cd273700 1 -- 172.21.15.80:0/1533447775 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f66b4004d90 msgr2=0x7f66b4005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:19:56.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.008+0000 7f66cd273700 1 --2- 172.21.15.80:0/1533447775 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f66b4004d90 0x7f66b4005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:56.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.008+0000 7f66cd273700 1 -- 172.21.15.80:0/1533447775 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66b40035b0 con 0x7f66b4004060 2024-05-08T21:19:56.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.008+0000 7f66cd273700 1 --2- 172.21.15.80:0/1533447775 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66b4004060 0x7f66b4004850 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f66b800c240 tx=0x7f66b4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=548109e7755fb0b2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:56.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.008+0000 7f66cca72700 1 -- 172.21.15.80:0/1533447775 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b8007c10 con 0x7f66b4004060 2024-05-08T21:19:56.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.008+0000 7f66cca72700 1 -- 172.21.15.80:0/1533447775 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66b800cde0 con 0x7f66b4004060 2024-05-08T21:19:56.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.008+0000 7f66cca72700 1 -- 172.21.15.80:0/1533447775 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b8005ba0 con 0x7f66b4004060 2024-05-08T21:19:56.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.009+0000 7f66cfcd8700 1 -- 172.21.15.80:0/1533447775 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66b4004060 msgr2=0x7f66b4004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:56.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.009+0000 7f66cfcd8700 1 --2- 172.21.15.80:0/1533447775 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66b4004060 0x7f66b4004850 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f66b800c240 tx=0x7f66b4005880 comp rx=0 tx=0).stop 2024-05-08T21:19:56.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.009+0000 7f66ce275700 1 -- 172.21.15.80:0/1533447775 reap_dead start 2024-05-08T21:19:56.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.009+0000 7f66cfcd8700 1 -- 172.21.15.80:0/1533447775 shutdown_connections 2024-05-08T21:19:56.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.009+0000 7f66cfcd8700 1 -- 172.21.15.80:0/1533447775 >> 172.21.15.80:0/1533447775 conn(0x7f66c806c6a0 msgr2=0x7f66c806cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:56.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.009+0000 7f66cfcd8700 1 -- 172.21.15.80:0/1533447775 shutdown_connections 2024-05-08T21:19:56.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.009+0000 7f66cfcd8700 1 -- 172.21.15.80:0/1533447775 wait complete. 2024-05-08T21:19:56.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.010+0000 7f66cfcd8700 1 Processor -- start 2024-05-08T21:19:56.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.010+0000 7f66cfcd8700 1 -- start start 2024-05-08T21:19:56.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.011+0000 7f66cfcd8700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66b4004060 0x7f66c8146820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:56.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.011+0000 7f66cfcd8700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f66c8149a90 0x7f66c81ef950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:56.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.011+0000 7f66cfcd8700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f66c81efe90 0x7f66c80b4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:56.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.011+0000 7f66cfcd8700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c815d750 con 0x7f66b4004060 2024-05-08T21:19:56.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.011+0000 7f66cfcd8700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c81f3b40 con 0x7f66c8149a90 2024-05-08T21:19:56.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.011+0000 7f66cfcd8700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66c8145b50 con 0x7f66c81efe90 2024-05-08T21:19:56.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.011+0000 7f66cda74700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66b4004060 0x7f66c8146820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:56.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.011+0000 7f66cda74700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66b4004060 0x7f66c8146820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39426/0 (socket says 172.21.15.80:39426) 2024-05-08T21:19:56.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.011+0000 7f66cda74700 1 -- 172.21.15.80:0/1688938502 learned_addr learned my addr 172.21.15.80:0/1688938502 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:19:56.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.011+0000 7f66cd273700 1 --2- 172.21.15.80:0/1688938502 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f66c8149a90 0x7f66c81ef950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:56.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.011+0000 7f66ce275700 1 --2- 172.21.15.80:0/1688938502 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f66c81efe90 0x7f66c80b4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:56.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.011+0000 7f66cda74700 1 -- 172.21.15.80:0/1688938502 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f66c81efe90 msgr2=0x7f66c80b4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:56.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.011+0000 7f66cda74700 1 --2- 172.21.15.80:0/1688938502 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f66c81efe90 0x7f66c80b4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:56.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.011+0000 7f66cda74700 1 -- 172.21.15.80:0/1688938502 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f66c8149a90 msgr2=0x7f66c81ef950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:56.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.011+0000 7f66cda74700 1 --2- 172.21.15.80:0/1688938502 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f66c8149a90 0x7f66c81ef950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:56.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.011+0000 7f66cda74700 1 -- 172.21.15.80:0/1688938502 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66c814d1e0 con 0x7f66b4004060 2024-05-08T21:19:56.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.011+0000 7f66cda74700 1 --2- 172.21.15.80:0/1688938502 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66b4004060 0x7f66c8146820 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f66c40116c0 tx=0x7f66c4011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:56.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.012+0000 7f66be7fc700 1 -- 172.21.15.80:0/1688938502 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c400c070 con 0x7f66b4004060 2024-05-08T21:19:56.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.012+0000 7f66be7fc700 1 -- 172.21.15.80:0/1688938502 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66c4015870 con 0x7f66b4004060 2024-05-08T21:19:56.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.012+0000 7f66cfcd8700 1 -- 172.21.15.80:0/1688938502 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66c814b3c0 con 0x7f66b4004060 2024-05-08T21:19:56.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.012+0000 7f66be7fc700 1 -- 172.21.15.80:0/1688938502 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c4015c20 con 0x7f66b4004060 2024-05-08T21:19:56.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.012+0000 7f66cfcd8700 1 -- 172.21.15.80:0/1688938502 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66c81f2ec0 con 0x7f66b4004060 2024-05-08T21:19:56.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.013+0000 7f66cfcd8700 1 -- 172.21.15.80:0/1688938502 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66c81f3c80 con 0x7f66b4004060 2024-05-08T21:19:56.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.013+0000 7f66be7fc700 1 -- 172.21.15.80:0/1688938502 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f66c4013400 con 0x7f66b4004060 2024-05-08T21:19:56.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.013+0000 7f66be7fc700 1 --2- 172.21.15.80:0/1688938502 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f66ac06ac90 0x7f66ac06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:56.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.014+0000 7f66be7fc700 1 -- 172.21.15.80:0/1688938502 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f66c4089ab0 con 0x7f66b4004060 2024-05-08T21:19:56.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.014+0000 7f66cd273700 1 --2- 172.21.15.80:0/1688938502 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f66ac06ac90 0x7f66ac06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:56.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.014+0000 7f66cd273700 1 --2- 172.21.15.80:0/1688938502 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f66ac06ac90 0x7f66ac06d150 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f66b8000c00 tx=0x7f66b8007000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:56.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.018+0000 7f66be7fc700 1 -- 172.21.15.80:0/1688938502 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f66c81f3c80 con 0x7f66b4004060 2024-05-08T21:19:56.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.224+0000 7f66cfcd8700 1 -- 172.21.15.80:0/1688938502 --> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f66c815e1d0 con 0x7f66ac06ac90 2024-05-08T21:19:56.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.224+0000 7f66be7fc700 1 -- 172.21.15.80:0/1688938502 <== mgr.4100 v2:172.21.15.80:6832/46731 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f66b8022070 con 0x7f66ac06ac90 2024-05-08T21:19:56.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.226+0000 7f66cfcd8700 1 -- 172.21.15.80:0/1688938502 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f66ac06ac90 msgr2=0x7f66ac06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:56.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.226+0000 7f66cfcd8700 1 --2- 172.21.15.80:0/1688938502 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f66ac06ac90 0x7f66ac06d150 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f66b8000c00 tx=0x7f66b8007000 comp rx=0 tx=0).stop 2024-05-08T21:19:56.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.226+0000 7f66cfcd8700 1 -- 172.21.15.80:0/1688938502 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66b4004060 msgr2=0x7f66c8146820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:56.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.226+0000 7f66cfcd8700 1 --2- 172.21.15.80:0/1688938502 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66b4004060 0x7f66c8146820 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f66c40116c0 tx=0x7f66c4011a80 comp rx=0 tx=0).stop 2024-05-08T21:19:56.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.226+0000 7f66cfcd8700 1 -- 172.21.15.80:0/1688938502 shutdown_connections 2024-05-08T21:19:56.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.226+0000 7f66cfcd8700 1 --2- 172.21.15.80:0/1688938502 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f66ac06ac90 0x7f66ac06d150 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:56.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.226+0000 7f66cfcd8700 1 --2- 172.21.15.80:0/1688938502 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66b4004060 0x7f66c8146820 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:56.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.226+0000 7f66cfcd8700 1 --2- 172.21.15.80:0/1688938502 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f66c81efe90 0x7f66c80b4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:56.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.226+0000 7f66cfcd8700 1 --2- 172.21.15.80:0/1688938502 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f66c8149a90 0x7f66c81ef950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:56.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.226+0000 7f66cfcd8700 1 -- 172.21.15.80:0/1688938502 >> 172.21.15.80:0/1688938502 conn(0x7f66c806c6a0 msgr2=0x7f66c80c48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:56.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.227+0000 7f66cfcd8700 1 -- 172.21.15.80:0/1688938502 shutdown_connections 2024-05-08T21:19:56.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.227+0000 7f66cfcd8700 1 -- 172.21.15.80:0/1688938502 wait complete. 2024-05-08T21:19:56.231 INFO:teuthology.orchestra.run.smithi080.stderr:instructed osd(s) 2 to deep-scrub 2024-05-08T21:19:56.241 INFO:tasks.ceph:Scrubbing osd.3 2024-05-08T21:19:56.242 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-05-08T21:19:56.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.368+0000 7f772f92d700 1 Processor -- start 2024-05-08T21:19:56.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.368+0000 7f772f92d700 1 -- start start 2024-05-08T21:19:56.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.369+0000 7f772f92d700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7728143400 0x7f7728071e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:56.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.369+0000 7f772f92d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f772806f530 0x7f772806a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:56.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.369+0000 7f772f92d700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f772806f990 0x7f772806af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:56.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.369+0000 7f772f92d700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77280c7580 con 0x7f772806f530 2024-05-08T21:19:56.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.369+0000 7f772f92d700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f772815b070 con 0x7f7728143400 2024-05-08T21:19:56.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.369+0000 7f772f92d700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77281437e0 con 0x7f772806f990 2024-05-08T21:19:56.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.369+0000 7f772cec8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f772806f530 0x7f772806a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:56.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.369+0000 7f772cec8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f772806f530 0x7f772806a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39430/0 (socket says 172.21.15.80:39430) 2024-05-08T21:19:56.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.369+0000 7f772cec8700 1 -- 172.21.15.80:0/1923205001 learned_addr learned my addr 172.21.15.80:0/1923205001 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:19:56.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.369+0000 7f772deca700 1 --2- 172.21.15.80:0/1923205001 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f772806f990 0x7f772806af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:56.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.369+0000 7f772d6c9700 1 --2- 172.21.15.80:0/1923205001 >> v2:172.21.15.106:3300/0 conn(0x7f7728143400 0x7f7728071e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:56.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.369+0000 7f772cec8700 1 -- 172.21.15.80:0/1923205001 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f772806f990 msgr2=0x7f772806af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:19:56.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.369+0000 7f772cec8700 1 --2- 172.21.15.80:0/1923205001 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f772806f990 0x7f772806af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:56.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.369+0000 7f772cec8700 1 -- 172.21.15.80:0/1923205001 >> v2:172.21.15.106:3300/0 conn(0x7f7728143400 msgr2=0x7f7728071e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:19:56.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.369+0000 7f772cec8700 1 --2- 172.21.15.80:0/1923205001 >> v2:172.21.15.106:3300/0 conn(0x7f7728143400 0x7f7728071e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:56.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.369+0000 7f772cec8700 1 -- 172.21.15.80:0/1923205001 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f772815a1a0 con 0x7f772806f530 2024-05-08T21:19:56.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.369+0000 7f772d6c9700 1 --2- 172.21.15.80:0/1923205001 >> v2:172.21.15.106:3300/0 conn(0x7f7728143400 0x7f7728071e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:19:56.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.369+0000 7f772cec8700 1 --2- 172.21.15.80:0/1923205001 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f772806f530 0x7f772806a9c0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f772806b4c0 tx=0x7f7718009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a37f46d9640fc49 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:56.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.370+0000 7f771ffff700 1 -- 172.21.15.80:0/1923205001 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7718011830 con 0x7f772806f530 2024-05-08T21:19:56.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.370+0000 7f771ffff700 1 -- 172.21.15.80:0/1923205001 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7718011990 con 0x7f772806f530 2024-05-08T21:19:56.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.370+0000 7f771ffff700 1 -- 172.21.15.80:0/1923205001 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7718011d20 con 0x7f772806f530 2024-05-08T21:19:56.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.370+0000 7f772f92d700 1 -- 172.21.15.80:0/1923205001 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f772806f530 msgr2=0x7f772806a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:56.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.370+0000 7f772f92d700 1 --2- 172.21.15.80:0/1923205001 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f772806f530 0x7f772806a9c0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f772806b4c0 tx=0x7f7718009bd0 comp rx=0 tx=0).stop 2024-05-08T21:19:56.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.370+0000 7f772f92d700 1 -- 172.21.15.80:0/1923205001 shutdown_connections 2024-05-08T21:19:56.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.370+0000 7f772f92d700 1 --2- 172.21.15.80:0/1923205001 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f772806f990 0x7f772806af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:56.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.370+0000 7f772f92d700 1 --2- 172.21.15.80:0/1923205001 >> v2:172.21.15.106:3300/0 conn(0x7f7728143400 0x7f7728071e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:56.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.370+0000 7f772f92d700 1 --2- 172.21.15.80:0/1923205001 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f772806f530 0x7f772806a9c0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:56.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.370+0000 7f772f92d700 1 -- 172.21.15.80:0/1923205001 >> 172.21.15.80:0/1923205001 conn(0x7f772806bad0 msgr2=0x7f772806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:56.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.370+0000 7f772f92d700 1 -- 172.21.15.80:0/1923205001 shutdown_connections 2024-05-08T21:19:56.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.370+0000 7f772f92d700 1 -- 172.21.15.80:0/1923205001 wait complete. 2024-05-08T21:19:56.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.372+0000 7f772f92d700 1 Processor -- start 2024-05-08T21:19:56.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.372+0000 7f772f92d700 1 -- start start 2024-05-08T21:19:56.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.372+0000 7f772f92d700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f772806f530 0x7f7728155730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:56.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.372+0000 7f772f92d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f772806f990 0x7f77280c9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:56.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.372+0000 7f772f92d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7728143400 0x7f77280c8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:56.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.372+0000 7f772f92d700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77280c9fe0 con 0x7f772806f990 2024-05-08T21:19:56.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.372+0000 7f772f92d700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f772813b340 con 0x7f7728143400 2024-05-08T21:19:56.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.372+0000 7f772f92d700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77280c8690 con 0x7f772806f530 2024-05-08T21:19:56.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.372+0000 7f772cec8700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f772806f990 0x7f77280c9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:56.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.372+0000 7f772cec8700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f772806f990 0x7f77280c9390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39436/0 (socket says 172.21.15.80:39436) 2024-05-08T21:19:56.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.372+0000 7f772cec8700 1 -- 172.21.15.80:0/2444839153 learned_addr learned my addr 172.21.15.80:0/2444839153 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:19:56.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.372+0000 7f772d6c9700 1 --2- 172.21.15.80:0/2444839153 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f772806f530 0x7f7728155730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:56.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.372+0000 7f772deca700 1 --2- 172.21.15.80:0/2444839153 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7728143400 0x7f77280c8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:56.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.373+0000 7f772cec8700 1 -- 172.21.15.80:0/2444839153 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f772806f530 msgr2=0x7f7728155730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:56.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.373+0000 7f772cec8700 1 --2- 172.21.15.80:0/2444839153 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f772806f530 0x7f7728155730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:56.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.373+0000 7f772cec8700 1 -- 172.21.15.80:0/2444839153 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7728143400 msgr2=0x7f77280c8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:56.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.373+0000 7f772cec8700 1 --2- 172.21.15.80:0/2444839153 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7728143400 0x7f77280c8b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:56.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.373+0000 7f772cec8700 1 -- 172.21.15.80:0/2444839153 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7718009550 con 0x7f772806f990 2024-05-08T21:19:56.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.373+0000 7f772cec8700 1 --2- 172.21.15.80:0/2444839153 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f772806f990 0x7f77280c9390 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f7718014040 tx=0x7f7718004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:56.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.373+0000 7f771dffb700 1 -- 172.21.15.80:0/2444839153 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7718004450 con 0x7f772806f990 2024-05-08T21:19:56.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.373+0000 7f771dffb700 1 -- 172.21.15.80:0/2444839153 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f771801e070 con 0x7f772806f990 2024-05-08T21:19:56.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.373+0000 7f772f92d700 1 -- 172.21.15.80:0/2444839153 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77280c9a20 con 0x7f772806f990 2024-05-08T21:19:56.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.373+0000 7f771dffb700 1 -- 172.21.15.80:0/2444839153 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77180038e0 con 0x7f772806f990 2024-05-08T21:19:56.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.373+0000 7f772f92d700 1 -- 172.21.15.80:0/2444839153 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77280c8040 con 0x7f772806f990 2024-05-08T21:19:56.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.374+0000 7f772f92d700 1 -- 172.21.15.80:0/2444839153 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f772815aa20 con 0x7f772806f990 2024-05-08T21:19:56.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.374+0000 7f771dffb700 1 -- 172.21.15.80:0/2444839153 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7718003a40 con 0x7f772806f990 2024-05-08T21:19:56.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.375+0000 7f771dffb700 1 --2- 172.21.15.80:0/2444839153 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f770c06acc0 0x7f770c06d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:56.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.375+0000 7f771dffb700 1 -- 172.21.15.80:0/2444839153 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f771808a600 con 0x7f772806f990 2024-05-08T21:19:56.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.375+0000 7f772d6c9700 1 --2- 172.21.15.80:0/2444839153 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f770c06acc0 0x7f770c06d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:56.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.375+0000 7f771dffb700 1 --2- 172.21.15.80:0/2444839153 >> [v2:172.21.15.80:6824/47012,v1:172.21.15.80:6825/47012] conn(0x7f770c0748b0 0x7f770c076d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:56.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.375+0000 7f771dffb700 1 -- 172.21.15.80:0/2444839153 --> [v2:172.21.15.80:6824/47012,v1:172.21.15.80:6825/47012] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f770c077420 con 0x7f770c0748b0 2024-05-08T21:19:56.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.375+0000 7f771dffb700 1 -- 172.21.15.80:0/2444839153 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f771808ccc0 con 0x7f772806f990 2024-05-08T21:19:56.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.375+0000 7f772deca700 1 --2- 172.21.15.80:0/2444839153 >> [v2:172.21.15.80:6824/47012,v1:172.21.15.80:6825/47012] conn(0x7f770c0748b0 0x7f770c076d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:56.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.375+0000 7f772d6c9700 1 --2- 172.21.15.80:0/2444839153 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f770c06acc0 0x7f770c06d180 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7724006f10 tx=0x7f7724008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:56.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.376+0000 7f772deca700 1 --2- 172.21.15.80:0/2444839153 >> [v2:172.21.15.80:6824/47012,v1:172.21.15.80:6825/47012] conn(0x7f770c0748b0 0x7f770c076d50 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:56.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.376+0000 7f771dffb700 1 -- 172.21.15.80:0/2444839153 <== osd.3 v2:172.21.15.80:6824/47012 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f770c077420 con 0x7f770c0748b0 2024-05-08T21:19:56.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.391+0000 7f772f92d700 1 -- 172.21.15.80:0/2444839153 --> [v2:172.21.15.80:6824/47012,v1:172.21.15.80:6825/47012] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f772815a740 con 0x7f770c0748b0 2024-05-08T21:19:56.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.391+0000 7f771dffb700 1 -- 172.21.15.80:0/2444839153 <== osd.3 v2:172.21.15.80:6824/47012 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f772000f040 con 0x7f770c0748b0 2024-05-08T21:19:56.394 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T21:19:56.394 INFO:teuthology.orchestra.run.smithi080.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T21:19:56.394 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T21:19:56.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.391+0000 7f772f92d700 1 -- 172.21.15.80:0/2444839153 >> [v2:172.21.15.80:6824/47012,v1:172.21.15.80:6825/47012] conn(0x7f770c0748b0 msgr2=0x7f770c076d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:56.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.391+0000 7f772f92d700 1 --2- 172.21.15.80:0/2444839153 >> [v2:172.21.15.80:6824/47012,v1:172.21.15.80:6825/47012] conn(0x7f770c0748b0 0x7f770c076d50 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:56.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.391+0000 7f772f92d700 1 -- 172.21.15.80:0/2444839153 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f770c06acc0 msgr2=0x7f770c06d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:56.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.391+0000 7f772f92d700 1 --2- 172.21.15.80:0/2444839153 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f770c06acc0 0x7f770c06d180 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7724006f10 tx=0x7f7724008040 comp rx=0 tx=0).stop 2024-05-08T21:19:56.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.391+0000 7f772f92d700 1 -- 172.21.15.80:0/2444839153 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f772806f990 msgr2=0x7f77280c9390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:56.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.391+0000 7f772f92d700 1 --2- 172.21.15.80:0/2444839153 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f772806f990 0x7f77280c9390 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f7718014040 tx=0x7f7718004750 comp rx=0 tx=0).stop 2024-05-08T21:19:56.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.391+0000 7f772deca700 1 -- 172.21.15.80:0/2444839153 reap_dead start 2024-05-08T21:19:56.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.391+0000 7f772f92d700 1 -- 172.21.15.80:0/2444839153 shutdown_connections 2024-05-08T21:19:56.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.391+0000 7f772f92d700 1 -- 172.21.15.80:0/2444839153 >> 172.21.15.80:0/2444839153 conn(0x7f772806bad0 msgr2=0x7f77280c76d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:56.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.392+0000 7f772f92d700 1 -- 172.21.15.80:0/2444839153 shutdown_connections 2024-05-08T21:19:56.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.392+0000 7f772f92d700 1 -- 172.21.15.80:0/2444839153 wait complete. 2024-05-08T21:19:56.406 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-05-08T21:19:56.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.527+0000 7f85a5c95700 1 Processor -- start 2024-05-08T21:19:56.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.527+0000 7f85a5c95700 1 -- start start 2024-05-08T21:19:56.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.528+0000 7f85a5c95700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f85a00c9860 0x7f85a015a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:56.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.528+0000 7f85a5c95700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f85a0072600 0x7f85a0072a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:56.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.528+0000 7f85a5c95700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85a00c8cc0 con 0x7f85a01541a0 2024-05-08T21:19:56.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.528+0000 7f85a5c95700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85a006c5a0 con 0x7f85a00c9860 2024-05-08T21:19:56.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.528+0000 7f85a5c95700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85a006ce60 con 0x7f85a0072600 2024-05-08T21:19:56.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.528+0000 7f859effd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f85a00c9860 0x7f85a015a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:56.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.528+0000 7f859effd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f85a00c9860 0x7f85a015a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39438/0 (socket says 172.21.15.80:39438) 2024-05-08T21:19:56.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.528+0000 7f859effd700 1 -- 172.21.15.80:0/3759349786 learned_addr learned my addr 172.21.15.80:0/3759349786 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:19:56.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.529+0000 7f859ffff700 1 --2- 172.21.15.80:0/3759349786 >> v2:172.21.15.106:3300/0 conn(0x7f85a0072600 0x7f85a0072a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:56.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.529+0000 7f859effd700 1 -- 172.21.15.80:0/3759349786 >> v2:172.21.15.106:3300/0 conn(0x7f85a0072600 msgr2=0x7f85a0072a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:19:56.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.529+0000 7f859effd700 1 --2- 172.21.15.80:0/3759349786 >> v2:172.21.15.106:3300/0 conn(0x7f85a0072600 0x7f85a0072a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:56.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.529+0000 7f859effd700 1 -- 172.21.15.80:0/3759349786 >> v1:172.21.15.106:6789/0 conn(0x7f85a01541a0 legacy=0x7f85a00c9150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:19:56.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.529+0000 7f859effd700 1 -- 172.21.15.80:0/3759349786 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a015e710 con 0x7f85a00c9860 2024-05-08T21:19:56.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.529+0000 7f859effd700 1 --2- 172.21.15.80:0/3759349786 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f85a00c9860 0x7f85a015a1a0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f85a00c8b20 tx=0x7f8590009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42fb4342f00dc406 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:56.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.529+0000 7f859e7fc700 1 -- 172.21.15.80:0/3759349786 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8590004230 con 0x7f85a00c9860 2024-05-08T21:19:56.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.529+0000 7f859e7fc700 1 -- 172.21.15.80:0/3759349786 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8590004390 con 0x7f85a00c9860 2024-05-08T21:19:56.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.529+0000 7f859e7fc700 1 -- 172.21.15.80:0/3759349786 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85900036a0 con 0x7f85a00c9860 2024-05-08T21:19:56.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.529+0000 7f85a5c95700 1 -- 172.21.15.80:0/3759349786 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f85a00c9860 msgr2=0x7f85a015a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:56.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.529+0000 7f85a5c95700 1 --2- 172.21.15.80:0/3759349786 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f85a00c9860 0x7f85a015a1a0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f85a00c8b20 tx=0x7f8590009bd0 comp rx=0 tx=0).stop 2024-05-08T21:19:56.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.529+0000 7f85a5c95700 1 -- 172.21.15.80:0/3759349786 shutdown_connections 2024-05-08T21:19:56.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.529+0000 7f85a5c95700 1 --2- 172.21.15.80:0/3759349786 >> v2:172.21.15.106:3300/0 conn(0x7f85a0072600 0x7f85a0072a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:56.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.529+0000 7f85a5c95700 1 --2- 172.21.15.80:0/3759349786 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f85a00c9860 0x7f85a015a1a0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:56.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.529+0000 7f85a5c95700 1 -- 172.21.15.80:0/3759349786 >> 172.21.15.80:0/3759349786 conn(0x7f85a006ef80 msgr2=0x7f85a006f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:56.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.530+0000 7f85a5c95700 1 -- 172.21.15.80:0/3759349786 shutdown_connections 2024-05-08T21:19:56.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.530+0000 7f85a5c95700 1 -- 172.21.15.80:0/3759349786 wait complete. 2024-05-08T21:19:56.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.531+0000 7f85a5c95700 1 Processor -- start 2024-05-08T21:19:56.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.531+0000 7f85a5c95700 1 -- start start 2024-05-08T21:19:56.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.531+0000 7f85a5c95700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85a0072600 0x7f85a0144410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:56.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.532+0000 7f85a5c95700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f85a00c9860 0x7f85a00c6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:56.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.532+0000 7f85a5c95700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f85a01541a0 0x7f85a00c6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:56.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.532+0000 7f85a5c95700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a01552f0 con 0x7f85a01541a0 2024-05-08T21:19:56.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.532+0000 7f85a5c95700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a014e460 con 0x7f85a0072600 2024-05-08T21:19:56.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.532+0000 7f85a5c95700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85a00c5a90 con 0x7f85a00c9860 2024-05-08T21:19:56.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.532+0000 7f859ffff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f85a01541a0 0x7f85a00c6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:56.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.532+0000 7f859ffff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f85a01541a0 0x7f85a00c6740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39452/0 (socket says 172.21.15.80:39452) 2024-05-08T21:19:56.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.532+0000 7f859ffff700 1 -- 172.21.15.80:0/59148676 learned_addr learned my addr 172.21.15.80:0/59148676 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:19:56.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.532+0000 7f859f7fe700 1 --2- 172.21.15.80:0/59148676 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85a0072600 0x7f85a0144410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:56.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.532+0000 7f859effd700 1 --2- 172.21.15.80:0/59148676 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f85a00c9860 0x7f85a00c6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:56.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.532+0000 7f859ffff700 1 -- 172.21.15.80:0/59148676 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f85a00c9860 msgr2=0x7f85a00c6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:56.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.532+0000 7f859ffff700 1 --2- 172.21.15.80:0/59148676 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f85a00c9860 0x7f85a00c6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:56.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.532+0000 7f859ffff700 1 -- 172.21.15.80:0/59148676 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85a0072600 msgr2=0x7f85a0144410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:56.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.532+0000 7f859ffff700 1 --2- 172.21.15.80:0/59148676 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85a0072600 0x7f85a0144410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:56.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.532+0000 7f859ffff700 1 -- 172.21.15.80:0/59148676 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8590009550 con 0x7f85a01541a0 2024-05-08T21:19:56.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.532+0000 7f859ffff700 1 --2- 172.21.15.80:0/59148676 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f85a01541a0 0x7f85a00c6740 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f8598007ea0 tx=0x7f859800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:56.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.532+0000 7f8587fff700 1 -- 172.21.15.80:0/59148676 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f859800ee80 con 0x7f85a01541a0 2024-05-08T21:19:56.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.532+0000 7f8587fff700 1 -- 172.21.15.80:0/59148676 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8598014420 con 0x7f85a01541a0 2024-05-08T21:19:56.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.532+0000 7f8587fff700 1 -- 172.21.15.80:0/59148676 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85980147d0 con 0x7f85a01541a0 2024-05-08T21:19:56.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.532+0000 7f85a5c95700 1 -- 172.21.15.80:0/59148676 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85a0144950 con 0x7f85a01541a0 2024-05-08T21:19:56.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.532+0000 7f85a5c95700 1 -- 172.21.15.80:0/59148676 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85a00c50e0 con 0x7f85a01541a0 2024-05-08T21:19:56.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.533+0000 7f85a5c95700 1 -- 172.21.15.80:0/59148676 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85a006cc20 con 0x7f85a01541a0 2024-05-08T21:19:56.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.534+0000 7f8587fff700 1 -- 172.21.15.80:0/59148676 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8598014930 con 0x7f85a01541a0 2024-05-08T21:19:56.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.534+0000 7f8587fff700 1 --2- 172.21.15.80:0/59148676 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f858c06ac90 0x7f858c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:56.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.534+0000 7f8587fff700 1 -- 172.21.15.80:0/59148676 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f859808a050 con 0x7f85a01541a0 2024-05-08T21:19:56.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.534+0000 7f859f7fe700 1 --2- 172.21.15.80:0/59148676 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f858c06ac90 0x7f858c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:56.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.535+0000 7f859f7fe700 1 --2- 172.21.15.80:0/59148676 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f858c06ac90 0x7f858c06d150 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8594009870 tx=0x7f8594008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:56.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.539+0000 7f8587fff700 1 -- 172.21.15.80:0/59148676 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f8598054d20 con 0x7f85a01541a0 2024-05-08T21:19:56.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.740+0000 7f85a5c95700 1 -- 172.21.15.80:0/59148676 --> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f85a0072310 con 0x7f858c06ac90 2024-05-08T21:19:56.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.741+0000 7f8587fff700 1 -- 172.21.15.80:0/59148676 <== mgr.4100 v2:172.21.15.80:6832/46731 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f85a0072310 con 0x7f858c06ac90 2024-05-08T21:19:56.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.743+0000 7f85a5c95700 1 -- 172.21.15.80:0/59148676 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f858c06ac90 msgr2=0x7f858c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:56.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.743+0000 7f85a5c95700 1 --2- 172.21.15.80:0/59148676 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f858c06ac90 0x7f858c06d150 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8594009870 tx=0x7f8594008040 comp rx=0 tx=0).stop 2024-05-08T21:19:56.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.743+0000 7f85a5c95700 1 -- 172.21.15.80:0/59148676 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f85a01541a0 msgr2=0x7f85a00c6740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:56.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.743+0000 7f85a5c95700 1 --2- 172.21.15.80:0/59148676 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f85a01541a0 0x7f85a00c6740 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f8598007ea0 tx=0x7f859800e3c0 comp rx=0 tx=0).stop 2024-05-08T21:19:56.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.743+0000 7f85a5c95700 1 -- 172.21.15.80:0/59148676 shutdown_connections 2024-05-08T21:19:56.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.743+0000 7f85a5c95700 1 --2- 172.21.15.80:0/59148676 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f858c06ac90 0x7f858c06d150 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:56.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.743+0000 7f85a5c95700 1 --2- 172.21.15.80:0/59148676 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f85a01541a0 0x7f85a00c6740 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:56.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.743+0000 7f85a5c95700 1 --2- 172.21.15.80:0/59148676 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85a0072600 0x7f85a0144410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:56.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.743+0000 7f85a5c95700 1 --2- 172.21.15.80:0/59148676 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f85a00c9860 0x7f85a00c6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:56.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.743+0000 7f85a5c95700 1 -- 172.21.15.80:0/59148676 >> 172.21.15.80:0/59148676 conn(0x7f85a006ef80 msgr2=0x7f85a0152b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:56.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.743+0000 7f85a5c95700 1 -- 172.21.15.80:0/59148676 shutdown_connections 2024-05-08T21:19:56.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.743+0000 7f85a5c95700 1 -- 172.21.15.80:0/59148676 wait complete. 2024-05-08T21:19:56.747 INFO:teuthology.orchestra.run.smithi080.stderr:instructed osd(s) 3 to deep-scrub 2024-05-08T21:19:56.758 INFO:tasks.ceph:Scrubbing osd.4 2024-05-08T21:19:56.758 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-05-08T21:19:56.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.884+0000 7fd77e72b700 1 Processor -- start 2024-05-08T21:19:56.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.884+0000 7fd77e72b700 1 -- start start 2024-05-08T21:19:56.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.885+0000 7fd77e72b700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd778066b80 0x7fd7780c1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:56.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.885+0000 7fd77e72b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd7780c1740 0x7fd778164b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:56.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.885+0000 7fd77e72b700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7780aede0 con 0x7fd778150dd0 2024-05-08T21:19:56.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.885+0000 7fd77e72b700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7780c6fb0 con 0x7fd7780c1740 2024-05-08T21:19:56.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.885+0000 7fd77e72b700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd77815a210 con 0x7fd778066b80 2024-05-08T21:19:56.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.885+0000 7fd77ccc8700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd7780c1740 0x7fd778164b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:56.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.885+0000 7fd777fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd778150dd0 0x7fd77815a940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46526/0 (socket says 172.21.15.80:46526) 2024-05-08T21:19:56.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.885+0000 7fd777fff700 1 -- 172.21.15.80:0/2067616005 learned_addr learned my addr 172.21.15.80:0/2067616005 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:19:56.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.885+0000 7fd7777fe700 1 --2- 172.21.15.80:0/2067616005 >> v2:172.21.15.106:3300/0 conn(0x7fd778066b80 0x7fd7780c1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:56.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.885+0000 7fd77ccc8700 1 -- 172.21.15.80:0/2067616005 >> v2:172.21.15.106:3300/0 conn(0x7fd778066b80 msgr2=0x7fd7780c1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:19:56.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.885+0000 7fd77ccc8700 1 --2- 172.21.15.80:0/2067616005 >> v2:172.21.15.106:3300/0 conn(0x7fd778066b80 0x7fd7780c1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:56.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.885+0000 7fd77ccc8700 1 -- 172.21.15.80:0/2067616005 >> v1:172.21.15.80:6789/0 conn(0x7fd778150dd0 legacy=0x7fd77815a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:56.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.885+0000 7fd77ccc8700 1 -- 172.21.15.80:0/2067616005 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7780ae8b0 con 0x7fd7780c1740 2024-05-08T21:19:56.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.885+0000 7fd776ffd700 1 -- 172.21.15.80:0/2067616005 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 650783913 0 0) 0x7fd7780aede0 con 0x7fd778150dd0 2024-05-08T21:19:56.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.885+0000 7fd77ccc8700 1 --2- 172.21.15.80:0/2067616005 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7780c1740 0x7fd778164b90 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fd77806c8a0 tx=0x7fd77000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d6665baa5a8db56 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:56.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.885+0000 7fd776ffd700 1 -- 172.21.15.80:0/2067616005 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77000e070 con 0x7fd7780c1740 2024-05-08T21:19:56.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.885+0000 7fd776ffd700 1 -- 172.21.15.80:0/2067616005 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd77000bbd0 con 0x7fd7780c1740 2024-05-08T21:19:56.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.885+0000 7fd776ffd700 1 -- 172.21.15.80:0/2067616005 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd770012430 con 0x7fd7780c1740 2024-05-08T21:19:56.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.886+0000 7fd77e72b700 1 -- 172.21.15.80:0/2067616005 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7780c1740 msgr2=0x7fd778164b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:56.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.886+0000 7fd77e72b700 1 --2- 172.21.15.80:0/2067616005 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7780c1740 0x7fd778164b90 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fd77806c8a0 tx=0x7fd77000b330 comp rx=0 tx=0).stop 2024-05-08T21:19:56.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.886+0000 7fd77e72b700 1 -- 172.21.15.80:0/2067616005 shutdown_connections 2024-05-08T21:19:56.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.886+0000 7fd77e72b700 1 --2- 172.21.15.80:0/2067616005 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7780c1740 0x7fd778164b90 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:56.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.886+0000 7fd77e72b700 1 --2- 172.21.15.80:0/2067616005 >> v2:172.21.15.106:3300/0 conn(0x7fd778066b80 0x7fd7780c1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:56.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.886+0000 7fd77e72b700 1 -- 172.21.15.80:0/2067616005 >> 172.21.15.80:0/2067616005 conn(0x7fd7780cc1e0 msgr2=0x7fd7780cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:56.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.886+0000 7fd77e72b700 1 -- 172.21.15.80:0/2067616005 shutdown_connections 2024-05-08T21:19:56.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.886+0000 7fd77e72b700 1 -- 172.21.15.80:0/2067616005 wait complete. 2024-05-08T21:19:56.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.887+0000 7fd77e72b700 1 Processor -- start 2024-05-08T21:19:56.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.887+0000 7fd77e72b700 1 -- start start 2024-05-08T21:19:56.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.888+0000 7fd77e72b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd778066b80 0x7fd7781f0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:56.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.888+0000 7fd77e72b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7780c1740 0x7fd7780c4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:56.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.888+0000 7fd77e72b700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd778150dd0 0x7fd7780c53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:56.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.888+0000 7fd77e72b700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7780c14b0 con 0x7fd7780c1740 2024-05-08T21:19:56.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.888+0000 7fd77e72b700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7781f0c40 con 0x7fd778066b80 2024-05-08T21:19:56.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.888+0000 7fd77e72b700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7780c3250 con 0x7fd778150dd0 2024-05-08T21:19:56.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.888+0000 7fd7777fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7780c1740 0x7fd7780c4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:56.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.888+0000 7fd7777fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7780c1740 0x7fd7780c4590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39480/0 (socket says 172.21.15.80:39480) 2024-05-08T21:19:56.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.888+0000 7fd7777fe700 1 -- 172.21.15.80:0/1968519342 learned_addr learned my addr 172.21.15.80:0/1968519342 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:19:56.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.888+0000 7fd77ccc8700 1 --2- 172.21.15.80:0/1968519342 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd778150dd0 0x7fd7780c53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:56.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.888+0000 7fd7777fe700 1 -- 172.21.15.80:0/1968519342 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd778150dd0 msgr2=0x7fd7780c53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:56.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.888+0000 7fd777fff700 1 --2- 172.21.15.80:0/1968519342 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd778066b80 0x7fd7781f0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:56.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.888+0000 7fd7777fe700 1 --2- 172.21.15.80:0/1968519342 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd778150dd0 0x7fd7780c53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:56.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.888+0000 7fd7777fe700 1 -- 172.21.15.80:0/1968519342 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd778066b80 msgr2=0x7fd7781f0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:56.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.888+0000 7fd7777fe700 1 --2- 172.21.15.80:0/1968519342 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd778066b80 0x7fd7781f0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:56.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.888+0000 7fd7777fe700 1 -- 172.21.15.80:0/1968519342 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd770009a70 con 0x7fd7780c1740 2024-05-08T21:19:56.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.888+0000 7fd77ccc8700 1 --2- 172.21.15.80:0/1968519342 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd778150dd0 0x7fd7780c53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:19:56.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.888+0000 7fd777fff700 1 --2- 172.21.15.80:0/1968519342 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd778066b80 0x7fd7781f0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:19:56.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.889+0000 7fd7777fe700 1 --2- 172.21.15.80:0/1968519342 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7780c1740 0x7fd7780c4590 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fd76c00c820 tx=0x7fd76c00cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:56.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.889+0000 7fd774ff9700 1 -- 172.21.15.80:0/1968519342 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76c011800 con 0x7fd7780c1740 2024-05-08T21:19:56.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.889+0000 7fd774ff9700 1 -- 172.21.15.80:0/1968519342 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd76c011960 con 0x7fd7780c1740 2024-05-08T21:19:56.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.889+0000 7fd77e72b700 1 -- 172.21.15.80:0/1968519342 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7780c34f0 con 0x7fd7780c1740 2024-05-08T21:19:56.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.889+0000 7fd774ff9700 1 -- 172.21.15.80:0/1968519342 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76c011cf0 con 0x7fd7780c1740 2024-05-08T21:19:56.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.889+0000 7fd77e72b700 1 -- 172.21.15.80:0/1968519342 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7780c3ab0 con 0x7fd7780c1740 2024-05-08T21:19:56.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.889+0000 7fd77e72b700 1 -- 172.21.15.80:0/1968519342 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd7780aeb00 con 0x7fd7780c1740 2024-05-08T21:19:56.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.890+0000 7fd774ff9700 1 -- 172.21.15.80:0/1968519342 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd76c018360 con 0x7fd7780c1740 2024-05-08T21:19:56.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.890+0000 7fd774ff9700 1 --2- 172.21.15.80:0/1968519342 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fd76406acc0 0x7fd76406d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:56.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.890+0000 7fd774ff9700 1 -- 172.21.15.80:0/1968519342 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7007+0+0 (secure 0 0 0) 0x7fd76c089690 con 0x7fd7780c1740 2024-05-08T21:19:56.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.890+0000 7fd777fff700 1 --2- 172.21.15.80:0/1968519342 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fd76406acc0 0x7fd76406d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:56.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.891+0000 7fd774ff9700 1 --2- 172.21.15.80:0/1968519342 >> [v2:172.21.15.106:6823/47114,v1:172.21.15.106:6825/47114] conn(0x7fd7640748b0 0x7fd764076d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:56.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.891+0000 7fd774ff9700 1 -- 172.21.15.80:0/1968519342 --> [v2:172.21.15.106:6823/47114,v1:172.21.15.106:6825/47114] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd764077420 con 0x7fd7640748b0 2024-05-08T21:19:56.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.891+0000 7fd774ff9700 1 -- 172.21.15.80:0/1968519342 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd76c08bd50 con 0x7fd7780c1740 2024-05-08T21:19:56.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.891+0000 7fd777fff700 1 --2- 172.21.15.80:0/1968519342 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fd76406acc0 0x7fd76406d180 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd768000f60 tx=0x7fd768009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:56.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.891+0000 7fd77ccc8700 1 --2- 172.21.15.80:0/1968519342 >> [v2:172.21.15.106:6823/47114,v1:172.21.15.106:6825/47114] conn(0x7fd7640748b0 0x7fd764076d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:56.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.891+0000 7fd77ccc8700 1 --2- 172.21.15.80:0/1968519342 >> [v2:172.21.15.106:6823/47114,v1:172.21.15.106:6825/47114] conn(0x7fd7640748b0 0x7fd764076d50 crc :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:56.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.892+0000 7fd774ff9700 1 -- 172.21.15.80:0/1968519342 <== osd.4 v2:172.21.15.106:6823/47114 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fd764077420 con 0x7fd7640748b0 2024-05-08T21:19:56.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.907+0000 7fd77e72b700 1 -- 172.21.15.80:0/1968519342 --> [v2:172.21.15.106:6823/47114,v1:172.21.15.106:6825/47114] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd7780c8940 con 0x7fd7640748b0 2024-05-08T21:19:56.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.907+0000 7fd774ff9700 1 -- 172.21.15.80:0/1968519342 <== osd.4 v2:172.21.15.106:6823/47114 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fd7700098f0 con 0x7fd7640748b0 2024-05-08T21:19:56.910 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T21:19:56.910 INFO:teuthology.orchestra.run.smithi080.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T21:19:56.910 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T21:19:56.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.908+0000 7fd77e72b700 1 -- 172.21.15.80:0/1968519342 >> [v2:172.21.15.106:6823/47114,v1:172.21.15.106:6825/47114] conn(0x7fd7640748b0 msgr2=0x7fd764076d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:56.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.908+0000 7fd77e72b700 1 --2- 172.21.15.80:0/1968519342 >> [v2:172.21.15.106:6823/47114,v1:172.21.15.106:6825/47114] conn(0x7fd7640748b0 0x7fd764076d50 crc :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:56.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.908+0000 7fd77e72b700 1 -- 172.21.15.80:0/1968519342 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fd76406acc0 msgr2=0x7fd76406d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:56.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.908+0000 7fd77e72b700 1 --2- 172.21.15.80:0/1968519342 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fd76406acc0 0x7fd76406d180 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd768000f60 tx=0x7fd768009040 comp rx=0 tx=0).stop 2024-05-08T21:19:56.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.908+0000 7fd77e72b700 1 -- 172.21.15.80:0/1968519342 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7780c1740 msgr2=0x7fd7780c4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:56.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.908+0000 7fd77e72b700 1 --2- 172.21.15.80:0/1968519342 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd7780c1740 0x7fd7780c4590 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fd76c00c820 tx=0x7fd76c00cbe0 comp rx=0 tx=0).stop 2024-05-08T21:19:56.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.908+0000 7fd77ccc8700 1 -- 172.21.15.80:0/1968519342 reap_dead start 2024-05-08T21:19:56.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.908+0000 7fd77e72b700 1 -- 172.21.15.80:0/1968519342 shutdown_connections 2024-05-08T21:19:56.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.908+0000 7fd77e72b700 1 -- 172.21.15.80:0/1968519342 >> 172.21.15.80:0/1968519342 conn(0x7fd7780cc1e0 msgr2=0x7fd778158c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:56.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.908+0000 7fd77e72b700 1 -- 172.21.15.80:0/1968519342 shutdown_connections 2024-05-08T21:19:56.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:56.908+0000 7fd77e72b700 1 -- 172.21.15.80:0/1968519342 wait complete. 2024-05-08T21:19:56.922 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-05-08T21:19:57.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.044+0000 7f881d254700 1 Processor -- start 2024-05-08T21:19:57.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.044+0000 7f881d254700 1 -- start start 2024-05-08T21:19:57.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.045+0000 7f881d254700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8818066910 0x7f88180ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:57.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.045+0000 7f881d254700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8818154810 0x7f881815a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:57.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.045+0000 7f881d254700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88180aef80 con 0x7f88180c2ad0 2024-05-08T21:19:57.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.045+0000 7f881d254700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f881815e540 con 0x7f8818154810 2024-05-08T21:19:57.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.045+0000 7f881d254700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f881815d8c0 con 0x7f8818066910 2024-05-08T21:19:57.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.045+0000 7f8816d9d700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f88180c2ad0 0x7f8818154100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46534/0 (socket says 172.21.15.80:46534) 2024-05-08T21:19:57.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.045+0000 7f8816d9d700 1 -- 172.21.15.80:0/1122221531 learned_addr learned my addr 172.21.15.80:0/1122221531 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:19:57.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.045+0000 7f881759e700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8818154810 0x7f881815a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:57.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.045+0000 7f881659c700 1 --2- 172.21.15.80:0/1122221531 >> v2:172.21.15.106:3300/0 conn(0x7f8818066910 0x7f88180ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:57.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.045+0000 7f881759e700 1 -- 172.21.15.80:0/1122221531 >> v2:172.21.15.106:3300/0 conn(0x7f8818066910 msgr2=0x7f88180ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:19:57.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.045+0000 7f881759e700 1 --2- 172.21.15.80:0/1122221531 >> v2:172.21.15.106:3300/0 conn(0x7f8818066910 0x7f88180ae8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:57.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.045+0000 7f881759e700 1 -- 172.21.15.80:0/1122221531 >> v1:172.21.15.80:6789/0 conn(0x7f88180c2ad0 legacy=0x7f8818154100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:57.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.045+0000 7f881759e700 1 -- 172.21.15.80:0/1122221531 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f881815dba0 con 0x7f8818154810 2024-05-08T21:19:57.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.045+0000 7f881659c700 1 --2- 172.21.15.80:0/1122221531 >> v2:172.21.15.106:3300/0 conn(0x7f8818066910 0x7f88180ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:19:57.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.045+0000 7f8815d9b700 1 -- 172.21.15.80:0/1122221531 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3416660483 0 0) 0x7f88180aef80 con 0x7f88180c2ad0 2024-05-08T21:19:57.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.046+0000 7f881759e700 1 --2- 172.21.15.80:0/1122221531 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8818154810 0x7f881815a3b0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f8818067380 tx=0x7f881000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1bd43c09a64d0d5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:57.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.046+0000 7f8815d9b700 1 -- 172.21.15.80:0/1122221531 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881000e070 con 0x7f8818154810 2024-05-08T21:19:57.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.046+0000 7f8815d9b700 1 -- 172.21.15.80:0/1122221531 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f881000bbd0 con 0x7f8818154810 2024-05-08T21:19:57.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.046+0000 7f8815d9b700 1 -- 172.21.15.80:0/1122221531 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8810012430 con 0x7f8818154810 2024-05-08T21:19:57.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.046+0000 7f881d254700 1 -- 172.21.15.80:0/1122221531 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8818154810 msgr2=0x7f881815a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:57.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.046+0000 7f881d254700 1 --2- 172.21.15.80:0/1122221531 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8818154810 0x7f881815a3b0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f8818067380 tx=0x7f881000b330 comp rx=0 tx=0).stop 2024-05-08T21:19:57.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.046+0000 7f881d254700 1 -- 172.21.15.80:0/1122221531 shutdown_connections 2024-05-08T21:19:57.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.046+0000 7f881d254700 1 --2- 172.21.15.80:0/1122221531 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8818154810 0x7f881815a3b0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:57.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.046+0000 7f881d254700 1 --2- 172.21.15.80:0/1122221531 >> v2:172.21.15.106:3300/0 conn(0x7f8818066910 0x7f88180ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:57.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.046+0000 7f881d254700 1 -- 172.21.15.80:0/1122221531 >> 172.21.15.80:0/1122221531 conn(0x7f88180c8bd0 msgr2=0x7f88180c8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:57.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.046+0000 7f881d254700 1 -- 172.21.15.80:0/1122221531 shutdown_connections 2024-05-08T21:19:57.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.046+0000 7f881d254700 1 -- 172.21.15.80:0/1122221531 wait complete. 2024-05-08T21:19:57.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.048+0000 7f881d254700 1 Processor -- start 2024-05-08T21:19:57.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.048+0000 7f881d254700 1 -- start start 2024-05-08T21:19:57.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.048+0000 7f881d254700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8818066910 0x7f8818156c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:57.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.048+0000 7f881d254700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88180c2ad0 0x7f88181ef130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:57.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.048+0000 7f881d254700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8818154810 0x7f88181591f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:57.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.048+0000 7f881d254700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f881815cd60 con 0x7f8818066910 2024-05-08T21:19:57.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.048+0000 7f881d254700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8818157c00 con 0x7f8818154810 2024-05-08T21:19:57.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.048+0000 7f881d254700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f881815c420 con 0x7f88180c2ad0 2024-05-08T21:19:57.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.049+0000 7f8816d9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8818066910 0x7f8818156c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:57.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.049+0000 7f8816d9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8818066910 0x7f8818156c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39496/0 (socket says 172.21.15.80:39496) 2024-05-08T21:19:57.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.049+0000 7f8816d9d700 1 -- 172.21.15.80:0/1610297373 learned_addr learned my addr 172.21.15.80:0/1610297373 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:19:57.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.049+0000 7f881759e700 1 --2- 172.21.15.80:0/1610297373 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8818154810 0x7f88181591f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:57.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.049+0000 7f881659c700 1 --2- 172.21.15.80:0/1610297373 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88180c2ad0 0x7f88181ef130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:57.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.049+0000 7f8816d9d700 1 -- 172.21.15.80:0/1610297373 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88180c2ad0 msgr2=0x7f88181ef130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:57.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.049+0000 7f8816d9d700 1 --2- 172.21.15.80:0/1610297373 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88180c2ad0 0x7f88181ef130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:57.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.049+0000 7f8816d9d700 1 -- 172.21.15.80:0/1610297373 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8818154810 msgr2=0x7f88181591f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:57.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.049+0000 7f8816d9d700 1 --2- 172.21.15.80:0/1610297373 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8818154810 0x7f88181591f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:57.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.049+0000 7f8816d9d700 1 -- 172.21.15.80:0/1610297373 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8810009a70 con 0x7f8818066910 2024-05-08T21:19:57.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.049+0000 7f8816d9d700 1 --2- 172.21.15.80:0/1610297373 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8818066910 0x7f8818156c50 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f880c00c750 tx=0x7f880c00ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:57.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.049+0000 7f87ff7fe700 1 -- 172.21.15.80:0/1610297373 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880c004c80 con 0x7f8818066910 2024-05-08T21:19:57.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.049+0000 7f87ff7fe700 1 -- 172.21.15.80:0/1610297373 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f880c004e00 con 0x7f8818066910 2024-05-08T21:19:57.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.049+0000 7f881d254700 1 -- 172.21.15.80:0/1610297373 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8818157190 con 0x7f8818066910 2024-05-08T21:19:57.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.049+0000 7f87ff7fe700 1 -- 172.21.15.80:0/1610297373 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880c007310 con 0x7f8818066910 2024-05-08T21:19:57.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.049+0000 7f881d254700 1 -- 172.21.15.80:0/1610297373 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88181f31e0 con 0x7f8818066910 2024-05-08T21:19:57.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.050+0000 7f881d254700 1 -- 172.21.15.80:0/1610297373 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88180c8010 con 0x7f8818066910 2024-05-08T21:19:57.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.051+0000 7f87ff7fe700 1 -- 172.21.15.80:0/1610297373 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f880c007470 con 0x7f8818066910 2024-05-08T21:19:57.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.051+0000 7f87ff7fe700 1 --2- 172.21.15.80:0/1610297373 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f880406ac90 0x7f880406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:57.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.051+0000 7f87ff7fe700 1 -- 172.21.15.80:0/1610297373 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f880c089510 con 0x7f8818066910 2024-05-08T21:19:57.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.051+0000 7f881659c700 1 --2- 172.21.15.80:0/1610297373 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f880406ac90 0x7f880406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:57.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.052+0000 7f881659c700 1 --2- 172.21.15.80:0/1610297373 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f880406ac90 0x7f880406d150 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f88180c1a50 tx=0x7f8808008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:57.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.056+0000 7f87ff7fe700 1 -- 172.21.15.80:0/1610297373 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f880c054270 con 0x7f8818066910 2024-05-08T21:19:57.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.257+0000 7f881d254700 1 -- 172.21.15.80:0/1610297373 --> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f881815e160 con 0x7f880406ac90 2024-05-08T21:19:57.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.257+0000 7f87ff7fe700 1 -- 172.21.15.80:0/1610297373 <== mgr.4100 v2:172.21.15.80:6832/46731 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f880800c050 con 0x7f880406ac90 2024-05-08T21:19:57.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.260+0000 7f881d254700 1 -- 172.21.15.80:0/1610297373 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f880406ac90 msgr2=0x7f880406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:57.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.260+0000 7f881d254700 1 --2- 172.21.15.80:0/1610297373 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f880406ac90 0x7f880406d150 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f88180c1a50 tx=0x7f8808008040 comp rx=0 tx=0).stop 2024-05-08T21:19:57.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.260+0000 7f881d254700 1 -- 172.21.15.80:0/1610297373 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8818066910 msgr2=0x7f8818156c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:57.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.260+0000 7f881d254700 1 --2- 172.21.15.80:0/1610297373 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8818066910 0x7f8818156c50 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f880c00c750 tx=0x7f880c00ca60 comp rx=0 tx=0).stop 2024-05-08T21:19:57.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.260+0000 7f881d254700 1 -- 172.21.15.80:0/1610297373 shutdown_connections 2024-05-08T21:19:57.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.260+0000 7f881d254700 1 --2- 172.21.15.80:0/1610297373 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f880406ac90 0x7f880406d150 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:57.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.260+0000 7f881d254700 1 --2- 172.21.15.80:0/1610297373 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8818066910 0x7f8818156c50 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:57.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.260+0000 7f881d254700 1 --2- 172.21.15.80:0/1610297373 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8818154810 0x7f88181591f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:57.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.260+0000 7f881d254700 1 --2- 172.21.15.80:0/1610297373 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88180c2ad0 0x7f88181ef130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:57.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.260+0000 7f881d254700 1 -- 172.21.15.80:0/1610297373 >> 172.21.15.80:0/1610297373 conn(0x7f88180c8bd0 msgr2=0x7f8818158880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:57.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.260+0000 7f881d254700 1 -- 172.21.15.80:0/1610297373 shutdown_connections 2024-05-08T21:19:57.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.260+0000 7f881d254700 1 -- 172.21.15.80:0/1610297373 wait complete. 2024-05-08T21:19:57.263 INFO:teuthology.orchestra.run.smithi080.stderr:instructed osd(s) 4 to deep-scrub 2024-05-08T21:19:57.274 INFO:tasks.ceph:Scrubbing osd.5 2024-05-08T21:19:57.274 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-05-08T21:19:57.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.399+0000 7fd909d0d700 1 Processor -- start 2024-05-08T21:19:57.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.399+0000 7fd909d0d700 1 -- start start 2024-05-08T21:19:57.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.400+0000 7fd909d0d700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd904143400 0x7fd904071e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:57.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.400+0000 7fd909d0d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd90406f990 0x7fd90415b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:57.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.400+0000 7fd909d0d700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd90415b070 con 0x7fd90406f530 2024-05-08T21:19:57.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.400+0000 7fd909d0d700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9040c7580 con 0x7fd90406f990 2024-05-08T21:19:57.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.400+0000 7fd909d0d700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9041437e0 con 0x7fd904143400 2024-05-08T21:19:57.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.400+0000 7fd903fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd90406f990 0x7fd90415b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:57.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.400+0000 7fd903fff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd90406f990 0x7fd90415b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39504/0 (socket says 172.21.15.80:39504) 2024-05-08T21:19:57.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.400+0000 7fd903fff700 1 -- 172.21.15.80:0/2440911090 learned_addr learned my addr 172.21.15.80:0/2440911090 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:19:57.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.400+0000 7fd9037fe700 1 --2- 172.21.15.80:0/2440911090 >> v2:172.21.15.106:3300/0 conn(0x7fd904143400 0x7fd904071e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:57.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.400+0000 7fd903fff700 1 -- 172.21.15.80:0/2440911090 >> v2:172.21.15.106:3300/0 conn(0x7fd904143400 msgr2=0x7fd904071e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:19:57.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.400+0000 7fd903fff700 1 --2- 172.21.15.80:0/2440911090 >> v2:172.21.15.106:3300/0 conn(0x7fd904143400 0x7fd904071e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:57.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.400+0000 7fd903fff700 1 -- 172.21.15.80:0/2440911090 >> v1:172.21.15.106:6789/0 conn(0x7fd90406f530 legacy=0x7fd90406a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:19:57.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.400+0000 7fd903fff700 1 -- 172.21.15.80:0/2440911090 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd90415a1a0 con 0x7fd90406f990 2024-05-08T21:19:57.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.400+0000 7fd9037fe700 1 --2- 172.21.15.80:0/2440911090 >> v2:172.21.15.106:3300/0 conn(0x7fd904143400 0x7fd904071e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:19:57.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.401+0000 7fd903fff700 1 --2- 172.21.15.80:0/2440911090 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd90406f990 0x7fd90415b810 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fd90406b4c0 tx=0x7fd8fc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb8d3c377ca7a2b5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:57.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.401+0000 7fd9027fc700 1 -- 172.21.15.80:0/2440911090 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8fc00e070 con 0x7fd90406f990 2024-05-08T21:19:57.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.401+0000 7fd9027fc700 1 -- 172.21.15.80:0/2440911090 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8fc003a20 con 0x7fd90406f990 2024-05-08T21:19:57.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.401+0000 7fd9027fc700 1 -- 172.21.15.80:0/2440911090 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8fc003dd0 con 0x7fd90406f990 2024-05-08T21:19:57.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.401+0000 7fd909d0d700 1 -- 172.21.15.80:0/2440911090 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd90406f990 msgr2=0x7fd90415b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:57.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.401+0000 7fd909d0d700 1 --2- 172.21.15.80:0/2440911090 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd90406f990 0x7fd90415b810 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fd90406b4c0 tx=0x7fd8fc00b330 comp rx=0 tx=0).stop 2024-05-08T21:19:57.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.401+0000 7fd909d0d700 1 -- 172.21.15.80:0/2440911090 shutdown_connections 2024-05-08T21:19:57.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.401+0000 7fd909d0d700 1 --2- 172.21.15.80:0/2440911090 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd90406f990 0x7fd90415b810 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:57.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.401+0000 7fd909d0d700 1 --2- 172.21.15.80:0/2440911090 >> v2:172.21.15.106:3300/0 conn(0x7fd904143400 0x7fd904071e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:57.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.401+0000 7fd909d0d700 1 -- 172.21.15.80:0/2440911090 >> 172.21.15.80:0/2440911090 conn(0x7fd90406bad0 msgr2=0x7fd90406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:57.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.401+0000 7fd909d0d700 1 -- 172.21.15.80:0/2440911090 shutdown_connections 2024-05-08T21:19:57.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.401+0000 7fd909d0d700 1 -- 172.21.15.80:0/2440911090 wait complete. 2024-05-08T21:19:57.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.402+0000 7fd909d0d700 1 Processor -- start 2024-05-08T21:19:57.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.403+0000 7fd909d0d700 1 -- start start 2024-05-08T21:19:57.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.403+0000 7fd909d0d700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd90406f530 0x7fd90413f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:57.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.403+0000 7fd909d0d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd90406f990 0x7fd9040caeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:57.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.403+0000 7fd909d0d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd904143400 0x7fd90413b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:57.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.403+0000 7fd909d0d700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9041f0250 con 0x7fd90406f990 2024-05-08T21:19:57.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.403+0000 7fd909d0d700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd90413ff70 con 0x7fd904143400 2024-05-08T21:19:57.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.403+0000 7fd909d0d700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9041ef640 con 0x7fd90406f530 2024-05-08T21:19:57.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.403+0000 7fd902ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd90406f990 0x7fd9040caeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:57.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.403+0000 7fd902ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd90406f990 0x7fd9040caeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39516/0 (socket says 172.21.15.80:39516) 2024-05-08T21:19:57.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.403+0000 7fd902ffd700 1 -- 172.21.15.80:0/113444108 learned_addr learned my addr 172.21.15.80:0/113444108 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:19:57.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.403+0000 7fd903fff700 1 --2- 172.21.15.80:0/113444108 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd904143400 0x7fd90413b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:57.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.404+0000 7fd9037fe700 1 --2- 172.21.15.80:0/113444108 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd90406f530 0x7fd90413f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:57.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.404+0000 7fd902ffd700 1 -- 172.21.15.80:0/113444108 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd90406f530 msgr2=0x7fd90413f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:57.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.404+0000 7fd902ffd700 1 --2- 172.21.15.80:0/113444108 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd90406f530 0x7fd90413f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:57.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.404+0000 7fd902ffd700 1 -- 172.21.15.80:0/113444108 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd904143400 msgr2=0x7fd90413b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:57.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.404+0000 7fd902ffd700 1 --2- 172.21.15.80:0/113444108 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd904143400 0x7fd90413b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:57.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.404+0000 7fd902ffd700 1 -- 172.21.15.80:0/113444108 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8fc009b30 con 0x7fd90406f990 2024-05-08T21:19:57.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.404+0000 7fd902ffd700 1 --2- 172.21.15.80:0/113444108 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd90406f990 0x7fd9040caeb0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec00b4a0 tx=0x7fd8ec00b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:57.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.404+0000 7fd8fbfff700 1 -- 172.21.15.80:0/113444108 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec011830 con 0x7fd90406f990 2024-05-08T21:19:57.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.404+0000 7fd8fbfff700 1 -- 172.21.15.80:0/113444108 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8ec011990 con 0x7fd90406f990 2024-05-08T21:19:57.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.404+0000 7fd8fbfff700 1 -- 172.21.15.80:0/113444108 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec011d40 con 0x7fd90406f990 2024-05-08T21:19:57.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.404+0000 7fd909d0d700 1 -- 172.21.15.80:0/113444108 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9041ef920 con 0x7fd90406f990 2024-05-08T21:19:57.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.404+0000 7fd909d0d700 1 -- 172.21.15.80:0/113444108 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9041efee0 con 0x7fd90406f990 2024-05-08T21:19:57.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.405+0000 7fd909d0d700 1 -- 172.21.15.80:0/113444108 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd90415aa20 con 0x7fd90406f990 2024-05-08T21:19:57.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.405+0000 7fd8fbfff700 1 -- 172.21.15.80:0/113444108 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd8ec01a400 con 0x7fd90406f990 2024-05-08T21:19:57.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.406+0000 7fd8fbfff700 1 --2- 172.21.15.80:0/113444108 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fd8e406acc0 0x7fd8e406d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:57.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.406+0000 7fd8fbfff700 1 -- 172.21.15.80:0/113444108 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7007+0+0 (secure 0 0 0) 0x7fd8ec089410 con 0x7fd90406f990 2024-05-08T21:19:57.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.406+0000 7fd9037fe700 1 --2- 172.21.15.80:0/113444108 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fd8e406acc0 0x7fd8e406d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:57.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.406+0000 7fd8fbfff700 1 --2- 172.21.15.80:0/113444108 >> [v2:172.21.15.106:6807/47111,v1:172.21.15.106:6809/47111] conn(0x7fd8e40748b0 0x7fd8e4076d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:57.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.406+0000 7fd8fbfff700 1 -- 172.21.15.80:0/113444108 --> [v2:172.21.15.106:6807/47111,v1:172.21.15.106:6809/47111] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd8e4077420 con 0x7fd8e40748b0 2024-05-08T21:19:57.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.406+0000 7fd8fbfff700 1 -- 172.21.15.80:0/113444108 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd8ec08bad0 con 0x7fd90406f990 2024-05-08T21:19:57.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.406+0000 7fd903fff700 1 --2- 172.21.15.80:0/113444108 >> [v2:172.21.15.106:6807/47111,v1:172.21.15.106:6809/47111] conn(0x7fd8e40748b0 0x7fd8e4076d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:57.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.406+0000 7fd9037fe700 1 --2- 172.21.15.80:0/113444108 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fd8e406acc0 0x7fd8e406d180 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd8f4006fd0 tx=0x7fd8f4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:57.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.407+0000 7fd903fff700 1 --2- 172.21.15.80:0/113444108 >> [v2:172.21.15.106:6807/47111,v1:172.21.15.106:6809/47111] conn(0x7fd8e40748b0 0x7fd8e4076d50 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:57.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.407+0000 7fd8fbfff700 1 -- 172.21.15.80:0/113444108 <== osd.5 v2:172.21.15.106:6807/47111 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fd8e4077420 con 0x7fd8e40748b0 2024-05-08T21:19:57.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.422+0000 7fd909d0d700 1 -- 172.21.15.80:0/113444108 --> [v2:172.21.15.106:6807/47111,v1:172.21.15.106:6809/47111] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd90415ad00 con 0x7fd8e40748b0 2024-05-08T21:19:57.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.422+0000 7fd8fbfff700 1 -- 172.21.15.80:0/113444108 <== osd.5 v2:172.21.15.106:6807/47111 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fd8fc003b90 con 0x7fd8e40748b0 2024-05-08T21:19:57.425 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T21:19:57.425 INFO:teuthology.orchestra.run.smithi080.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T21:19:57.425 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T21:19:57.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.423+0000 7fd909d0d700 1 -- 172.21.15.80:0/113444108 >> [v2:172.21.15.106:6807/47111,v1:172.21.15.106:6809/47111] conn(0x7fd8e40748b0 msgr2=0x7fd8e4076d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:57.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.423+0000 7fd909d0d700 1 --2- 172.21.15.80:0/113444108 >> [v2:172.21.15.106:6807/47111,v1:172.21.15.106:6809/47111] conn(0x7fd8e40748b0 0x7fd8e4076d50 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:57.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.423+0000 7fd909d0d700 1 -- 172.21.15.80:0/113444108 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fd8e406acc0 msgr2=0x7fd8e406d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:57.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.423+0000 7fd909d0d700 1 --2- 172.21.15.80:0/113444108 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fd8e406acc0 0x7fd8e406d180 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd8f4006fd0 tx=0x7fd8f4008040 comp rx=0 tx=0).stop 2024-05-08T21:19:57.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.423+0000 7fd909d0d700 1 -- 172.21.15.80:0/113444108 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd90406f990 msgr2=0x7fd9040caeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:57.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.423+0000 7fd909d0d700 1 --2- 172.21.15.80:0/113444108 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd90406f990 0x7fd9040caeb0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec00b4a0 tx=0x7fd8ec00b7b0 comp rx=0 tx=0).stop 2024-05-08T21:19:57.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.423+0000 7fd903fff700 1 -- 172.21.15.80:0/113444108 reap_dead start 2024-05-08T21:19:57.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.423+0000 7fd909d0d700 1 -- 172.21.15.80:0/113444108 shutdown_connections 2024-05-08T21:19:57.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.423+0000 7fd909d0d700 1 -- 172.21.15.80:0/113444108 >> 172.21.15.80:0/113444108 conn(0x7fd90406bad0 msgr2=0x7fd904071300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:57.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.423+0000 7fd909d0d700 1 -- 172.21.15.80:0/113444108 shutdown_connections 2024-05-08T21:19:57.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.423+0000 7fd909d0d700 1 -- 172.21.15.80:0/113444108 wait complete. 2024-05-08T21:19:57.437 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-05-08T21:19:57.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.570+0000 7fbfb409a700 1 Processor -- start 2024-05-08T21:19:57.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.570+0000 7fbfb409a700 1 -- start start 2024-05-08T21:19:57.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.571+0000 7fbfb409a700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fbfac1433e0 0x7fbfac071e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:57.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.571+0000 7fbfb409a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbfac06f4b0 0x7fbfac15b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:57.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.571+0000 7fbfb409a700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfac06edd0 con 0x7fbfac0c7050 2024-05-08T21:19:57.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.571+0000 7fbfb409a700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfac15a090 con 0x7fbfac06f4b0 2024-05-08T21:19:57.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.571+0000 7fbfb409a700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfac06fa10 con 0x7fbfac1433e0 2024-05-08T21:19:57.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.571+0000 7fbfb2637700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbfac06f4b0 0x7fbfac15b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:57.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.571+0000 7fbfb2637700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbfac06f4b0 0x7fbfac15b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39522/0 (socket says 172.21.15.80:39522) 2024-05-08T21:19:57.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.571+0000 7fbfb2637700 1 -- 172.21.15.80:0/3967070418 learned_addr learned my addr 172.21.15.80:0/3967070418 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:19:57.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.571+0000 7fbfb1e36700 1 --2- 172.21.15.80:0/3967070418 >> v2:172.21.15.106:3300/0 conn(0x7fbfac1433e0 0x7fbfac071e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:57.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.571+0000 7fbfb2637700 1 -- 172.21.15.80:0/3967070418 >> v2:172.21.15.106:3300/0 conn(0x7fbfac1433e0 msgr2=0x7fbfac071e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:19:57.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.571+0000 7fbfb2637700 1 --2- 172.21.15.80:0/3967070418 >> v2:172.21.15.106:3300/0 conn(0x7fbfac1433e0 0x7fbfac071e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:57.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.571+0000 7fbfb2637700 1 -- 172.21.15.80:0/3967070418 >> v1:172.21.15.106:6789/0 conn(0x7fbfac0c7050 legacy=0x7fbfac06a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:57.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.571+0000 7fbfb2637700 1 -- 172.21.15.80:0/3967070418 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfac15a310 con 0x7fbfac06f4b0 2024-05-08T21:19:57.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.571+0000 7fbfb2637700 1 --2- 172.21.15.80:0/3967070418 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbfac06f4b0 0x7fbfac15b580 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fbfac0ca1e0 tx=0x7fbfa400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad0635fab16d8894 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:57.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.572+0000 7fbfb0e34700 1 -- 172.21.15.80:0/3967070418 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa400e070 con 0x7fbfac06f4b0 2024-05-08T21:19:57.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.572+0000 7fbfb0e34700 1 -- 172.21.15.80:0/3967070418 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfa400b910 con 0x7fbfac06f4b0 2024-05-08T21:19:57.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.572+0000 7fbfb0e34700 1 -- 172.21.15.80:0/3967070418 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa400bcc0 con 0x7fbfac06f4b0 2024-05-08T21:19:57.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.572+0000 7fbfb409a700 1 -- 172.21.15.80:0/3967070418 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbfac06f4b0 msgr2=0x7fbfac15b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:57.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.572+0000 7fbfb409a700 1 --2- 172.21.15.80:0/3967070418 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbfac06f4b0 0x7fbfac15b580 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fbfac0ca1e0 tx=0x7fbfa400b330 comp rx=0 tx=0).stop 2024-05-08T21:19:57.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.572+0000 7fbfb409a700 1 -- 172.21.15.80:0/3967070418 shutdown_connections 2024-05-08T21:19:57.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.572+0000 7fbfb409a700 1 --2- 172.21.15.80:0/3967070418 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbfac06f4b0 0x7fbfac15b580 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:57.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.572+0000 7fbfb409a700 1 --2- 172.21.15.80:0/3967070418 >> v2:172.21.15.106:3300/0 conn(0x7fbfac1433e0 0x7fbfac071e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:57.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.572+0000 7fbfb409a700 1 -- 172.21.15.80:0/3967070418 >> 172.21.15.80:0/3967070418 conn(0x7fbfac06bad0 msgr2=0x7fbfac06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:57.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.572+0000 7fbfb409a700 1 -- 172.21.15.80:0/3967070418 shutdown_connections 2024-05-08T21:19:57.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.572+0000 7fbfb409a700 1 -- 172.21.15.80:0/3967070418 wait complete. 2024-05-08T21:19:57.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.573+0000 7fbfb409a700 1 Processor -- start 2024-05-08T21:19:57.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.574+0000 7fbfb409a700 1 -- start start 2024-05-08T21:19:57.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.574+0000 7fbfb409a700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbfac06f4b0 0x7fbfac1f3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:57.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.574+0000 7fbfb409a700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbfac0c7050 0x7fbfac1f3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:57.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.574+0000 7fbfb409a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbfac1433e0 0x7fbfac154b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:57.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.574+0000 7fbfb409a700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac0c96f0 con 0x7fbfac1433e0 2024-05-08T21:19:57.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.574+0000 7fbfb409a700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac0c8820 con 0x7fbfac06f4b0 2024-05-08T21:19:57.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.574+0000 7fbfb409a700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac0c8a70 con 0x7fbfac0c7050 2024-05-08T21:19:57.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.574+0000 7fbfb2637700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbfac1433e0 0x7fbfac154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:57.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.574+0000 7fbfb2637700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbfac1433e0 0x7fbfac154b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39532/0 (socket says 172.21.15.80:39532) 2024-05-08T21:19:57.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.574+0000 7fbfb2637700 1 -- 172.21.15.80:0/2354628163 learned_addr learned my addr 172.21.15.80:0/2354628163 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:19:57.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.574+0000 7fbfb1e36700 1 --2- 172.21.15.80:0/2354628163 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbfac06f4b0 0x7fbfac1f3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:57.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.574+0000 7fbfb1635700 1 --2- 172.21.15.80:0/2354628163 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbfac0c7050 0x7fbfac1f3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:57.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.575+0000 7fbfb2637700 1 -- 172.21.15.80:0/2354628163 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbfac0c7050 msgr2=0x7fbfac1f3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:57.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.575+0000 7fbfb2637700 1 --2- 172.21.15.80:0/2354628163 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbfac0c7050 0x7fbfac1f3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:57.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.575+0000 7fbfb2637700 1 -- 172.21.15.80:0/2354628163 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbfac06f4b0 msgr2=0x7fbfac1f3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:57.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.575+0000 7fbfb2637700 1 --2- 172.21.15.80:0/2354628163 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbfac06f4b0 0x7fbfac1f3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:57.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.575+0000 7fbfb2637700 1 -- 172.21.15.80:0/2354628163 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfa4009b30 con 0x7fbfac1433e0 2024-05-08T21:19:57.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.575+0000 7fbfb2637700 1 --2- 172.21.15.80:0/2354628163 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbfac1433e0 0x7fbfac154b10 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fbfac06ef60 tx=0x7fbfa4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:57.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.575+0000 7fbfa27fc700 1 -- 172.21.15.80:0/2354628163 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa4004880 con 0x7fbfac1433e0 2024-05-08T21:19:57.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.575+0000 7fbfa27fc700 1 -- 172.21.15.80:0/2354628163 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfa40092e0 con 0x7fbfac1433e0 2024-05-08T21:19:57.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.575+0000 7fbfb409a700 1 -- 172.21.15.80:0/2354628163 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfac0c8d50 con 0x7fbfac1433e0 2024-05-08T21:19:57.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.575+0000 7fbfa27fc700 1 -- 172.21.15.80:0/2354628163 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa401b650 con 0x7fbfac1433e0 2024-05-08T21:19:57.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.575+0000 7fbfb409a700 1 -- 172.21.15.80:0/2354628163 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfac0c9310 con 0x7fbfac1433e0 2024-05-08T21:19:57.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.576+0000 7fbfb409a700 1 -- 172.21.15.80:0/2354628163 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfac04ec60 con 0x7fbfac1433e0 2024-05-08T21:19:57.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.577+0000 7fbfa27fc700 1 -- 172.21.15.80:0/2354628163 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbfa401b7b0 con 0x7fbfac1433e0 2024-05-08T21:19:57.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.577+0000 7fbfa27fc700 1 --2- 172.21.15.80:0/2354628163 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fbf9006ac90 0x7fbf9006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:57.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.577+0000 7fbfa27fc700 1 -- 172.21.15.80:0/2354628163 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7007+0+0 (secure 0 0 0) 0x7fbfa408af70 con 0x7fbfac1433e0 2024-05-08T21:19:57.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.577+0000 7fbfb1e36700 1 --2- 172.21.15.80:0/2354628163 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fbf9006ac90 0x7fbf9006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:57.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.578+0000 7fbfb1e36700 1 --2- 172.21.15.80:0/2354628163 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fbf9006ac90 0x7fbf9006d150 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fbfa8009be0 tx=0x7fbfa8009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:57.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.582+0000 7fbfa27fc700 1 -- 172.21.15.80:0/2354628163 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fbfa4055cd0 con 0x7fbfac1433e0 2024-05-08T21:19:57.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.785+0000 7fbfb409a700 1 -- 172.21.15.80:0/2354628163 --> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fbfac15abb0 con 0x7fbf9006ac90 2024-05-08T21:19:57.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.785+0000 7fbfa27fc700 1 -- 172.21.15.80:0/2354628163 <== mgr.4100 v2:172.21.15.80:6832/46731 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fbfa8004020 con 0x7fbf9006ac90 2024-05-08T21:19:57.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.787+0000 7fbfb409a700 1 -- 172.21.15.80:0/2354628163 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fbf9006ac90 msgr2=0x7fbf9006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:57.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.787+0000 7fbfb409a700 1 --2- 172.21.15.80:0/2354628163 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fbf9006ac90 0x7fbf9006d150 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fbfa8009be0 tx=0x7fbfa8009210 comp rx=0 tx=0).stop 2024-05-08T21:19:57.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.787+0000 7fbfb409a700 1 -- 172.21.15.80:0/2354628163 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbfac1433e0 msgr2=0x7fbfac154b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:57.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.787+0000 7fbfb409a700 1 --2- 172.21.15.80:0/2354628163 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbfac1433e0 0x7fbfac154b10 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fbfac06ef60 tx=0x7fbfa4004ad0 comp rx=0 tx=0).stop 2024-05-08T21:19:57.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.788+0000 7fbfb409a700 1 -- 172.21.15.80:0/2354628163 shutdown_connections 2024-05-08T21:19:57.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.788+0000 7fbfb409a700 1 --2- 172.21.15.80:0/2354628163 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fbf9006ac90 0x7fbf9006d150 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:57.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.788+0000 7fbfb409a700 1 --2- 172.21.15.80:0/2354628163 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbfac1433e0 0x7fbfac154b10 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:57.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.788+0000 7fbfb409a700 1 --2- 172.21.15.80:0/2354628163 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbfac06f4b0 0x7fbfac1f3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:57.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.788+0000 7fbfb409a700 1 --2- 172.21.15.80:0/2354628163 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbfac0c7050 0x7fbfac1f3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:57.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.788+0000 7fbfb409a700 1 -- 172.21.15.80:0/2354628163 >> 172.21.15.80:0/2354628163 conn(0x7fbfac06bad0 msgr2=0x7fbfac15d5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:57.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.788+0000 7fbfb409a700 1 -- 172.21.15.80:0/2354628163 shutdown_connections 2024-05-08T21:19:57.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.788+0000 7fbfb409a700 1 -- 172.21.15.80:0/2354628163 wait complete. 2024-05-08T21:19:57.791 INFO:teuthology.orchestra.run.smithi080.stderr:instructed osd(s) 5 to deep-scrub 2024-05-08T21:19:57.802 INFO:tasks.ceph:Scrubbing osd.6 2024-05-08T21:19:57.802 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-05-08T21:19:57.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.928+0000 7f1a98986700 1 Processor -- start 2024-05-08T21:19:57.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.928+0000 7f1a98986700 1 -- start start 2024-05-08T21:19:57.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.929+0000 7f1a98986700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1a94154180 0x7f1a9415ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:57.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.929+0000 7f1a98986700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1a940ca420 0x7f1a940cffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:57.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.929+0000 7f1a98986700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a9415b180 con 0x7f1a94072fd0 2024-05-08T21:19:57.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.929+0000 7f1a98986700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a940c4b50 con 0x7f1a940ca420 2024-05-08T21:19:57.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.929+0000 7f1a98986700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a940ca940 con 0x7f1a94154180 2024-05-08T21:19:57.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.929+0000 7f1a92d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1a940ca420 0x7f1a940cffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:57.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.929+0000 7f1a92d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1a940ca420 0x7f1a940cffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39548/0 (socket says 172.21.15.80:39548) 2024-05-08T21:19:57.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.929+0000 7f1a92d9d700 1 -- 172.21.15.80:0/3890279889 learned_addr learned my addr 172.21.15.80:0/3890279889 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:19:57.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.929+0000 7f1a9259c700 1 --2- 172.21.15.80:0/3890279889 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1a94154180 0x7f1a9415ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:57.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.929+0000 7f1a92d9d700 1 -- 172.21.15.80:0/3890279889 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1a94154180 msgr2=0x7f1a9415ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:19:57.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.929+0000 7f1a92d9d700 1 --2- 172.21.15.80:0/3890279889 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1a94154180 0x7f1a9415ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:57.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.929+0000 7f1a92d9d700 1 -- 172.21.15.80:0/3890279889 >> v1:172.21.15.106:6789/0 conn(0x7f1a94072fd0 legacy=0x7f1a9415b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:57.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.929+0000 7f1a92d9d700 1 -- 172.21.15.80:0/3890279889 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a940c4e10 con 0x7f1a940ca420 2024-05-08T21:19:57.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.929+0000 7f1a92d9d700 1 --2- 172.21.15.80:0/3890279889 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1a940ca420 0x7f1a940cffb0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c009e50 tx=0x7f1a8c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e14ae9927531352 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:57.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.929+0000 7f1a9159a700 1 -- 172.21.15.80:0/3890279889 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c00e070 con 0x7f1a940ca420 2024-05-08T21:19:57.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.929+0000 7f1a9159a700 1 -- 172.21.15.80:0/3890279889 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a8c00b9c0 con 0x7f1a940ca420 2024-05-08T21:19:57.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.929+0000 7f1a9159a700 1 -- 172.21.15.80:0/3890279889 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c00bd70 con 0x7f1a940ca420 2024-05-08T21:19:57.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.930+0000 7f1a98986700 1 -- 172.21.15.80:0/3890279889 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1a940ca420 msgr2=0x7f1a940cffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:57.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.930+0000 7f1a98986700 1 --2- 172.21.15.80:0/3890279889 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1a940ca420 0x7f1a940cffb0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c009e50 tx=0x7f1a8c00b330 comp rx=0 tx=0).stop 2024-05-08T21:19:57.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.930+0000 7f1a98986700 1 -- 172.21.15.80:0/3890279889 shutdown_connections 2024-05-08T21:19:57.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.930+0000 7f1a98986700 1 --2- 172.21.15.80:0/3890279889 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1a940ca420 0x7f1a940cffb0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:57.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.930+0000 7f1a98986700 1 --2- 172.21.15.80:0/3890279889 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1a94154180 0x7f1a9415ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:57.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.930+0000 7f1a98986700 1 -- 172.21.15.80:0/3890279889 >> 172.21.15.80:0/3890279889 conn(0x7f1a9406ab90 msgr2=0x7f1a9406afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:57.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.930+0000 7f1a98986700 1 -- 172.21.15.80:0/3890279889 shutdown_connections 2024-05-08T21:19:57.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.930+0000 7f1a98986700 1 -- 172.21.15.80:0/3890279889 wait complete. 2024-05-08T21:19:57.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.931+0000 7f1a98986700 1 Processor -- start 2024-05-08T21:19:57.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.931+0000 7f1a98986700 1 -- start start 2024-05-08T21:19:57.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.932+0000 7f1a98986700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1a94072fd0 0x7f1a940ccae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:57.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.932+0000 7f1a98986700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1a940ca420 0x7f1a940ce450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:57.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.932+0000 7f1a98986700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1a94154180 0x7f1a940ce990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:57.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.932+0000 7f1a98986700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a94159720 con 0x7f1a94072fd0 2024-05-08T21:19:57.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.932+0000 7f1a98986700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a94158a40 con 0x7f1a940ca420 2024-05-08T21:19:57.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.932+0000 7f1a98986700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a940cd9b0 con 0x7f1a94154180 2024-05-08T21:19:57.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.932+0000 7f1a9259c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1a94072fd0 0x7f1a940ccae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:57.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.932+0000 7f1a9259c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1a94072fd0 0x7f1a940ccae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39554/0 (socket says 172.21.15.80:39554) 2024-05-08T21:19:57.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.932+0000 7f1a9259c700 1 -- 172.21.15.80:0/3629004999 learned_addr learned my addr 172.21.15.80:0/3629004999 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:19:57.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.932+0000 7f1a92d9d700 1 --2- 172.21.15.80:0/3629004999 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1a94154180 0x7f1a940ce990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:57.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.932+0000 7f1a91d9b700 1 --2- 172.21.15.80:0/3629004999 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1a940ca420 0x7f1a940ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:57.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.932+0000 7f1a9259c700 1 -- 172.21.15.80:0/3629004999 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1a94154180 msgr2=0x7f1a940ce990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:57.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.932+0000 7f1a9259c700 1 --2- 172.21.15.80:0/3629004999 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1a94154180 0x7f1a940ce990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:57.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.932+0000 7f1a9259c700 1 -- 172.21.15.80:0/3629004999 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1a940ca420 msgr2=0x7f1a940ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:57.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.932+0000 7f1a9259c700 1 --2- 172.21.15.80:0/3629004999 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1a940ca420 0x7f1a940ce450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:57.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.932+0000 7f1a9259c700 1 -- 172.21.15.80:0/3629004999 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a8c009b30 con 0x7f1a94072fd0 2024-05-08T21:19:57.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.933+0000 7f1a9259c700 1 --2- 172.21.15.80:0/3629004999 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1a94072fd0 0x7f1a940ccae0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f1a8400e810 tx=0x7f1a8400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:57.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.933+0000 7f1a82ffd700 1 -- 172.21.15.80:0/3629004999 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8400c070 con 0x7f1a94072fd0 2024-05-08T21:19:57.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.933+0000 7f1a82ffd700 1 -- 172.21.15.80:0/3629004999 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a84013610 con 0x7f1a94072fd0 2024-05-08T21:19:57.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.933+0000 7f1a98986700 1 -- 172.21.15.80:0/3629004999 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a94158ce0 con 0x7f1a94072fd0 2024-05-08T21:19:57.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.933+0000 7f1a82ffd700 1 -- 172.21.15.80:0/3629004999 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a840139c0 con 0x7f1a94072fd0 2024-05-08T21:19:57.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.933+0000 7f1a98986700 1 -- 172.21.15.80:0/3629004999 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a940cdc50 con 0x7f1a94072fd0 2024-05-08T21:19:57.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.934+0000 7f1a98986700 1 -- 172.21.15.80:0/3629004999 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1a940c56b0 con 0x7f1a94072fd0 2024-05-08T21:19:57.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.934+0000 7f1a82ffd700 1 -- 172.21.15.80:0/3629004999 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1a84013b20 con 0x7f1a94072fd0 2024-05-08T21:19:57.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.935+0000 7f1a82ffd700 1 --2- 172.21.15.80:0/3629004999 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f1a7406acc0 0x7f1a7406d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:57.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.935+0000 7f1a82ffd700 1 -- 172.21.15.80:0/3629004999 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f1a84089c70 con 0x7f1a94072fd0 2024-05-08T21:19:57.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.935+0000 7f1a91d9b700 1 --2- 172.21.15.80:0/3629004999 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f1a7406acc0 0x7f1a7406d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:57.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.935+0000 7f1a82ffd700 1 --2- 172.21.15.80:0/3629004999 >> [v2:172.21.15.106:6816/47112,v1:172.21.15.106:6817/47112] conn(0x7f1a740748b0 0x7f1a74076d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:57.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.935+0000 7f1a82ffd700 1 -- 172.21.15.80:0/3629004999 --> [v2:172.21.15.106:6816/47112,v1:172.21.15.106:6817/47112] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1a74077420 con 0x7f1a740748b0 2024-05-08T21:19:57.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.935+0000 7f1a82ffd700 1 -- 172.21.15.80:0/3629004999 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1a8408a0c0 con 0x7f1a94072fd0 2024-05-08T21:19:57.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.935+0000 7f1a91d9b700 1 --2- 172.21.15.80:0/3629004999 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f1a7406acc0 0x7f1a7406d180 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1a94157a20 tx=0x7f1a88009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:57.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.935+0000 7f1a92d9d700 1 --2- 172.21.15.80:0/3629004999 >> [v2:172.21.15.106:6816/47112,v1:172.21.15.106:6817/47112] conn(0x7f1a740748b0 0x7f1a74076d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:57.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.935+0000 7f1a92d9d700 1 -- 172.21.15.80:0/3629004999 >> [v2:172.21.15.106:6816/47112,v1:172.21.15.106:6817/47112] conn(0x7f1a740748b0 msgr2=0x7f1a74076d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-05-08T21:19:57.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.935+0000 7f1a92d9d700 1 -- 172.21.15.80:0/3629004999 >> [v2:172.21.15.106:6816/47112,v1:172.21.15.106:6817/47112] conn(0x7f1a740748b0 msgr2=0x7f1a74076d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T21:19:57.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.935+0000 7f1a92d9d700 1 --2- 172.21.15.80:0/3629004999 >> [v2:172.21.15.106:6816/47112,v1:172.21.15.106:6817/47112] conn(0x7f1a740748b0 0x7f1a74076d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T21:19:57.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:57.935+0000 7f1a92d9d700 1 --2- 172.21.15.80:0/3629004999 >> [v2:172.21.15.106:6816/47112,v1:172.21.15.106:6817/47112] conn(0x7f1a740748b0 0x7f1a74076d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T21:19:58.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.136+0000 7f1a92d9d700 1 --2- 172.21.15.80:0/3629004999 >> [v2:172.21.15.106:6816/47112,v1:172.21.15.106:6817/47112] conn(0x7f1a740748b0 0x7f1a74076d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:58.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.136+0000 7f1a92d9d700 1 --2- 172.21.15.80:0/3629004999 >> [v2:172.21.15.106:6816/47112,v1:172.21.15.106:6817/47112] conn(0x7f1a740748b0 0x7f1a74076d50 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:58.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.137+0000 7f1a82ffd700 1 -- 172.21.15.80:0/3629004999 <== osd.6 v2:172.21.15.106:6816/47112 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f1a74077420 con 0x7f1a740748b0 2024-05-08T21:19:58.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.151+0000 7f1a98986700 1 -- 172.21.15.80:0/3629004999 --> [v2:172.21.15.106:6816/47112,v1:172.21.15.106:6817/47112] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1a940c53d0 con 0x7f1a740748b0 2024-05-08T21:19:58.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.152+0000 7f1a82ffd700 1 -- 172.21.15.80:0/3629004999 <== osd.6 v2:172.21.15.106:6816/47112 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f1a8c0099b0 con 0x7f1a740748b0 2024-05-08T21:19:58.154 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T21:19:58.154 INFO:teuthology.orchestra.run.smithi080.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T21:19:58.155 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T21:19:58.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.152+0000 7f1a98986700 1 -- 172.21.15.80:0/3629004999 >> [v2:172.21.15.106:6816/47112,v1:172.21.15.106:6817/47112] conn(0x7f1a740748b0 msgr2=0x7f1a74076d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:58.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.152+0000 7f1a98986700 1 --2- 172.21.15.80:0/3629004999 >> [v2:172.21.15.106:6816/47112,v1:172.21.15.106:6817/47112] conn(0x7f1a740748b0 0x7f1a74076d50 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:58.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.152+0000 7f1a98986700 1 -- 172.21.15.80:0/3629004999 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f1a7406acc0 msgr2=0x7f1a7406d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:58.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.152+0000 7f1a98986700 1 --2- 172.21.15.80:0/3629004999 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f1a7406acc0 0x7f1a7406d180 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1a94157a20 tx=0x7f1a88009040 comp rx=0 tx=0).stop 2024-05-08T21:19:58.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.152+0000 7f1a98986700 1 -- 172.21.15.80:0/3629004999 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1a94072fd0 msgr2=0x7f1a940ccae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:58.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.152+0000 7f1a98986700 1 --2- 172.21.15.80:0/3629004999 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1a94072fd0 0x7f1a940ccae0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f1a8400e810 tx=0x7f1a8400eb20 comp rx=0 tx=0).stop 2024-05-08T21:19:58.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.152+0000 7f1a92d9d700 1 -- 172.21.15.80:0/3629004999 reap_dead start 2024-05-08T21:19:58.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.152+0000 7f1a98986700 1 -- 172.21.15.80:0/3629004999 shutdown_connections 2024-05-08T21:19:58.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.152+0000 7f1a98986700 1 -- 172.21.15.80:0/3629004999 >> 172.21.15.80:0/3629004999 conn(0x7f1a9406ab90 msgr2=0x7f1a940cff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:58.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.152+0000 7f1a98986700 1 -- 172.21.15.80:0/3629004999 shutdown_connections 2024-05-08T21:19:58.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.152+0000 7f1a98986700 1 -- 172.21.15.80:0/3629004999 wait complete. 2024-05-08T21:19:58.167 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-05-08T21:19:58.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.318+0000 7fe2a9ce7700 1 Processor -- start 2024-05-08T21:19:58.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.318+0000 7fe2a9ce7700 1 -- start start 2024-05-08T21:19:58.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.319+0000 7fe2a9ce7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe2a4072d80 0x7fe2a4073210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:58.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.319+0000 7fe2a9ce7700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe2a40cbba0 0x7fe2a40cbff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:58.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.319+0000 7fe2a9ce7700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2a415b6d0 con 0x7fe2a41520b0 2024-05-08T21:19:58.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.319+0000 7fe2a9ce7700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2a40cc530 con 0x7fe2a4072d80 2024-05-08T21:19:58.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.319+0000 7fe2a9ce7700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2a41580e0 con 0x7fe2a40cbba0 2024-05-08T21:19:58.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.319+0000 7fe29affd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe2a4072d80 0x7fe2a4073210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:58.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.319+0000 7fe2a37fe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe2a41520b0 0x7fe2a4158810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:46544/0 (socket says 172.21.15.80:46544) 2024-05-08T21:19:58.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.319+0000 7fe2a37fe700 1 -- 172.21.15.80:0/3693546652 learned_addr learned my addr 172.21.15.80:0/3693546652 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:19:58.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.319+0000 7fe2a3fff700 1 --2- 172.21.15.80:0/3693546652 >> v2:172.21.15.106:3300/0 conn(0x7fe2a40cbba0 0x7fe2a40cbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:58.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.319+0000 7fe29affd700 1 -- 172.21.15.80:0/3693546652 >> v2:172.21.15.106:3300/0 conn(0x7fe2a40cbba0 msgr2=0x7fe2a40cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:19:58.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.319+0000 7fe29affd700 1 --2- 172.21.15.80:0/3693546652 >> v2:172.21.15.106:3300/0 conn(0x7fe2a40cbba0 0x7fe2a40cbff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:58.323 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.319+0000 7fe29affd700 1 -- 172.21.15.80:0/3693546652 >> v1:172.21.15.80:6789/0 conn(0x7fe2a41520b0 legacy=0x7fe2a4158810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:58.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.319+0000 7fe29affd700 1 -- 172.21.15.80:0/3693546652 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2a415c650 con 0x7fe2a4072d80 2024-05-08T21:19:58.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.320+0000 7fe29affd700 1 --2- 172.21.15.80:0/3693546652 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2a4072d80 0x7fe2a4073210 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fe2a40c63d0 tx=0x7fe28c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5603ddd2d7e085c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:58.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.320+0000 7fe2a2ffd700 1 -- 172.21.15.80:0/3693546652 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28c011830 con 0x7fe2a4072d80 2024-05-08T21:19:58.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.320+0000 7fe2a2ffd700 1 -- 172.21.15.80:0/3693546652 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe28c011990 con 0x7fe2a4072d80 2024-05-08T21:19:58.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.320+0000 7fe2a2ffd700 1 -- 172.21.15.80:0/3693546652 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28c011d20 con 0x7fe2a4072d80 2024-05-08T21:19:58.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.320+0000 7fe2a9ce7700 1 -- 172.21.15.80:0/3693546652 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2a4072d80 msgr2=0x7fe2a4073210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:58.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.320+0000 7fe2a9ce7700 1 --2- 172.21.15.80:0/3693546652 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2a4072d80 0x7fe2a4073210 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fe2a40c63d0 tx=0x7fe28c009b20 comp rx=0 tx=0).stop 2024-05-08T21:19:58.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.320+0000 7fe2a9ce7700 1 -- 172.21.15.80:0/3693546652 shutdown_connections 2024-05-08T21:19:58.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.320+0000 7fe2a9ce7700 1 --2- 172.21.15.80:0/3693546652 >> v2:172.21.15.106:3300/0 conn(0x7fe2a40cbba0 0x7fe2a40cbff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:58.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.320+0000 7fe2a9ce7700 1 --2- 172.21.15.80:0/3693546652 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2a4072d80 0x7fe2a4073210 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:58.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.320+0000 7fe2a9ce7700 1 -- 172.21.15.80:0/3693546652 >> 172.21.15.80:0/3693546652 conn(0x7fe2a4066780 msgr2=0x7fe2a4066b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:58.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.320+0000 7fe2a9ce7700 1 -- 172.21.15.80:0/3693546652 shutdown_connections 2024-05-08T21:19:58.324 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.320+0000 7fe2a9ce7700 1 -- 172.21.15.80:0/3693546652 wait complete. 2024-05-08T21:19:58.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.322+0000 7fe2a9ce7700 1 Processor -- start 2024-05-08T21:19:58.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.322+0000 7fe2a9ce7700 1 -- start start 2024-05-08T21:19:58.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.322+0000 7fe2a9ce7700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe2a4072d80 0x7fe2a40c7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:58.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.322+0000 7fe2a9ce7700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2a40cbba0 0x7fe2a41ede80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:58.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.322+0000 7fe2a9ce7700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe2a41520b0 0x7fe2a41f1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:58.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.322+0000 7fe2a9ce7700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a4147ea0 con 0x7fe2a40cbba0 2024-05-08T21:19:58.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.322+0000 7fe2a9ce7700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a41ee3c0 con 0x7fe2a4072d80 2024-05-08T21:19:58.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.322+0000 7fe2a9ce7700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a41480f0 con 0x7fe2a41520b0 2024-05-08T21:19:58.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.323+0000 7fe29affd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2a40cbba0 0x7fe2a41ede80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:58.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.323+0000 7fe29affd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2a40cbba0 0x7fe2a41ede80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39568/0 (socket says 172.21.15.80:39568) 2024-05-08T21:19:58.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.323+0000 7fe29affd700 1 -- 172.21.15.80:0/3635188251 learned_addr learned my addr 172.21.15.80:0/3635188251 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:19:58.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.323+0000 7fe2a37fe700 1 --2- 172.21.15.80:0/3635188251 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe2a4072d80 0x7fe2a40c7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:58.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.323+0000 7fe2a3fff700 1 --2- 172.21.15.80:0/3635188251 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe2a41520b0 0x7fe2a41f1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:58.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.323+0000 7fe29affd700 1 -- 172.21.15.80:0/3635188251 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe2a41520b0 msgr2=0x7fe2a41f1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:58.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.323+0000 7fe29affd700 1 --2- 172.21.15.80:0/3635188251 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe2a41520b0 0x7fe2a41f1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:58.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.323+0000 7fe29affd700 1 -- 172.21.15.80:0/3635188251 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe2a4072d80 msgr2=0x7fe2a40c7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:58.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.323+0000 7fe29affd700 1 --2- 172.21.15.80:0/3635188251 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe2a4072d80 0x7fe2a40c7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:58.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.323+0000 7fe29affd700 1 -- 172.21.15.80:0/3635188251 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe28c0094a0 con 0x7fe2a40cbba0 2024-05-08T21:19:58.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.323+0000 7fe29affd700 1 --2- 172.21.15.80:0/3635188251 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2a40cbba0 0x7fe2a41ede80 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fe28c000c00 tx=0x7fe28c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:58.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.323+0000 7fe2a0ff9700 1 -- 172.21.15.80:0/3635188251 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28c004550 con 0x7fe2a40cbba0 2024-05-08T21:19:58.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.323+0000 7fe2a0ff9700 1 -- 172.21.15.80:0/3635188251 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe28c01f070 con 0x7fe2a40cbba0 2024-05-08T21:19:58.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.323+0000 7fe2a9ce7700 1 -- 172.21.15.80:0/3635188251 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2a41483d0 con 0x7fe2a40cbba0 2024-05-08T21:19:58.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.323+0000 7fe2a0ff9700 1 -- 172.21.15.80:0/3635188251 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28c0038e0 con 0x7fe2a40cbba0 2024-05-08T21:19:58.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.323+0000 7fe2a9ce7700 1 -- 172.21.15.80:0/3635188251 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2a41f0b40 con 0x7fe2a40cbba0 2024-05-08T21:19:58.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.324+0000 7fe2a9ce7700 1 -- 172.21.15.80:0/3635188251 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2a41488f0 con 0x7fe2a40cbba0 2024-05-08T21:19:58.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.325+0000 7fe2a0ff9700 1 -- 172.21.15.80:0/3635188251 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe28c003a40 con 0x7fe2a40cbba0 2024-05-08T21:19:58.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.325+0000 7fe2a0ff9700 1 --2- 172.21.15.80:0/3635188251 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe28406ac90 0x7fe28406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:58.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.325+0000 7fe2a0ff9700 1 -- 172.21.15.80:0/3635188251 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7007+0+0 (secure 0 0 0) 0x7fe28c021070 con 0x7fe2a40cbba0 2024-05-08T21:19:58.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.325+0000 7fe2a37fe700 1 --2- 172.21.15.80:0/3635188251 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe28406ac90 0x7fe28406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:58.329 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.325+0000 7fe2a37fe700 1 --2- 172.21.15.80:0/3635188251 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe28406ac90 0x7fe28406d150 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe294000f60 tx=0x7fe294007f10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:58.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.329+0000 7fe2a0ff9700 1 -- 172.21.15.80:0/3635188251 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fe28c055d60 con 0x7fe2a40cbba0 2024-05-08T21:19:58.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.530+0000 7fe2a9ce7700 1 -- 172.21.15.80:0/3635188251 --> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fe2a41f09c0 con 0x7fe28406ac90 2024-05-08T21:19:58.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.530+0000 7fe2a0ff9700 1 -- 172.21.15.80:0/3635188251 <== mgr.4100 v2:172.21.15.80:6832/46731 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe294004b70 con 0x7fe28406ac90 2024-05-08T21:19:58.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.533+0000 7fe2a9ce7700 1 -- 172.21.15.80:0/3635188251 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe28406ac90 msgr2=0x7fe28406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:58.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.533+0000 7fe2a9ce7700 1 --2- 172.21.15.80:0/3635188251 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe28406ac90 0x7fe28406d150 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe294000f60 tx=0x7fe294007f10 comp rx=0 tx=0).stop 2024-05-08T21:19:58.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.533+0000 7fe2a9ce7700 1 -- 172.21.15.80:0/3635188251 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2a40cbba0 msgr2=0x7fe2a41ede80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:58.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.533+0000 7fe2a9ce7700 1 --2- 172.21.15.80:0/3635188251 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2a40cbba0 0x7fe2a41ede80 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fe28c000c00 tx=0x7fe28c004750 comp rx=0 tx=0).stop 2024-05-08T21:19:58.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.533+0000 7fe2a9ce7700 1 -- 172.21.15.80:0/3635188251 shutdown_connections 2024-05-08T21:19:58.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.533+0000 7fe2a9ce7700 1 --2- 172.21.15.80:0/3635188251 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fe28406ac90 0x7fe28406d150 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:58.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.533+0000 7fe2a9ce7700 1 --2- 172.21.15.80:0/3635188251 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe2a41520b0 0x7fe2a41f1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:58.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.533+0000 7fe2a9ce7700 1 --2- 172.21.15.80:0/3635188251 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe2a4072d80 0x7fe2a40c7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:58.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.533+0000 7fe2a9ce7700 1 --2- 172.21.15.80:0/3635188251 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe2a40cbba0 0x7fe2a41ede80 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:58.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.533+0000 7fe2a9ce7700 1 -- 172.21.15.80:0/3635188251 >> 172.21.15.80:0/3635188251 conn(0x7fe2a4066780 msgr2=0x7fe2a4066b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:58.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.533+0000 7fe2a9ce7700 1 -- 172.21.15.80:0/3635188251 shutdown_connections 2024-05-08T21:19:58.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.533+0000 7fe2a9ce7700 1 -- 172.21.15.80:0/3635188251 wait complete. 2024-05-08T21:19:58.537 INFO:teuthology.orchestra.run.smithi080.stderr:instructed osd(s) 6 to deep-scrub 2024-05-08T21:19:58.547 INFO:tasks.ceph:Scrubbing osd.7 2024-05-08T21:19:58.548 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-05-08T21:19:58.676 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.674+0000 7f0464368700 1 Processor -- start 2024-05-08T21:19:58.676 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.674+0000 7f0464368700 1 -- start start 2024-05-08T21:19:58.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.675+0000 7f0464368700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f045c152290 0x7f045c0732d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:58.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.675+0000 7f0464368700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f045c0c6b40 0x7f045c0ae6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:58.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.675+0000 7f0464368700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f045c0aec30 0x7f045c070e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:58.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.675+0000 7f0464368700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f045c158340 con 0x7f045c0aec30 2024-05-08T21:19:58.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.675+0000 7f0464368700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f045c158620 con 0x7f045c0c6b40 2024-05-08T21:19:58.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.675+0000 7f0464368700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f045c158900 con 0x7f045c152290 2024-05-08T21:19:58.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.675+0000 7f0462905700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f045c0aec30 0x7f045c070e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:58.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.675+0000 7f0462905700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f045c0aec30 0x7f045c070e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39584/0 (socket says 172.21.15.80:39584) 2024-05-08T21:19:58.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.675+0000 7f0462905700 1 -- 172.21.15.80:0/3682197959 learned_addr learned my addr 172.21.15.80:0/3682197959 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:19:58.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.675+0000 7f0462104700 1 --2- 172.21.15.80:0/3682197959 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f045c152290 0x7f045c0732d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:58.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.675+0000 7f0461903700 1 --2- 172.21.15.80:0/3682197959 >> v2:172.21.15.106:3300/0 conn(0x7f045c0c6b40 0x7f045c0ae6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:58.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.675+0000 7f0462905700 1 -- 172.21.15.80:0/3682197959 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f045c152290 msgr2=0x7f045c0732d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:19:58.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.675+0000 7f0462905700 1 --2- 172.21.15.80:0/3682197959 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f045c152290 0x7f045c0732d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:58.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.675+0000 7f0462905700 1 -- 172.21.15.80:0/3682197959 >> v2:172.21.15.106:3300/0 conn(0x7f045c0c6b40 msgr2=0x7f045c0ae6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:19:58.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.675+0000 7f0462905700 1 --2- 172.21.15.80:0/3682197959 >> v2:172.21.15.106:3300/0 conn(0x7f045c0c6b40 0x7f045c0ae6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:58.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.675+0000 7f0462905700 1 -- 172.21.15.80:0/3682197959 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f045c158be0 con 0x7f045c0aec30 2024-05-08T21:19:58.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.675+0000 7f0462905700 1 --2- 172.21.15.80:0/3682197959 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f045c0aec30 0x7f045c070e50 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f045c06c920 tx=0x7f045400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=275dfbacf8f4f2b0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:58.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.675+0000 7f0461102700 1 -- 172.21.15.80:0/3682197959 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f045400e070 con 0x7f045c0aec30 2024-05-08T21:19:58.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.676+0000 7f0461102700 1 -- 172.21.15.80:0/3682197959 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f045400b9c0 con 0x7f045c0aec30 2024-05-08T21:19:58.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.676+0000 7f0461102700 1 -- 172.21.15.80:0/3682197959 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f045400bd70 con 0x7f045c0aec30 2024-05-08T21:19:58.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.676+0000 7f0464368700 1 -- 172.21.15.80:0/3682197959 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f045c0aec30 msgr2=0x7f045c070e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:58.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.676+0000 7f0464368700 1 --2- 172.21.15.80:0/3682197959 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f045c0aec30 0x7f045c070e50 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f045c06c920 tx=0x7f045400b330 comp rx=0 tx=0).stop 2024-05-08T21:19:58.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.676+0000 7f0464368700 1 -- 172.21.15.80:0/3682197959 shutdown_connections 2024-05-08T21:19:58.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.676+0000 7f0464368700 1 --2- 172.21.15.80:0/3682197959 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f045c0aec30 0x7f045c070e50 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:58.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.676+0000 7f0464368700 1 --2- 172.21.15.80:0/3682197959 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f045c152290 0x7f045c0732d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:58.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.676+0000 7f0464368700 1 --2- 172.21.15.80:0/3682197959 >> v2:172.21.15.106:3300/0 conn(0x7f045c0c6b40 0x7f045c0ae6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:58.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.676+0000 7f0464368700 1 -- 172.21.15.80:0/3682197959 >> 172.21.15.80:0/3682197959 conn(0x7f045c0cc140 msgr2=0x7f045c0cc550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:58.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.676+0000 7f0464368700 1 -- 172.21.15.80:0/3682197959 shutdown_connections 2024-05-08T21:19:58.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.676+0000 7f0464368700 1 -- 172.21.15.80:0/3682197959 wait complete. 2024-05-08T21:19:58.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.677+0000 7f0464368700 1 Processor -- start 2024-05-08T21:19:58.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.678+0000 7f0464368700 1 -- start start 2024-05-08T21:19:58.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.678+0000 7f0464368700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f045c0aec30 0x7f045c1ee230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:58.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.678+0000 7f0464368700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f045c0c6b40 0x7f045c0b05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:58.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.678+0000 7f0464368700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f045c152290 0x7f045c150c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:58.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.678+0000 7f0464368700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f045c1ed840 con 0x7f045c152290 2024-05-08T21:19:58.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.678+0000 7f0464368700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f045c151a60 con 0x7f045c0aec30 2024-05-08T21:19:58.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.678+0000 7f0464368700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f045c1ee770 con 0x7f045c0c6b40 2024-05-08T21:19:58.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.678+0000 7f0462905700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f045c152290 0x7f045c150c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:58.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.678+0000 7f0462905700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f045c152290 0x7f045c150c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39596/0 (socket says 172.21.15.80:39596) 2024-05-08T21:19:58.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.678+0000 7f0462905700 1 -- 172.21.15.80:0/3173136468 learned_addr learned my addr 172.21.15.80:0/3173136468 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:19:58.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.678+0000 7f0462104700 1 --2- 172.21.15.80:0/3173136468 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f045c0aec30 0x7f045c1ee230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:58.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.678+0000 7f0461903700 1 --2- 172.21.15.80:0/3173136468 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f045c0c6b40 0x7f045c0b05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:58.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.679+0000 7f0462905700 1 -- 172.21.15.80:0/3173136468 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f045c0c6b40 msgr2=0x7f045c0b05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:58.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.679+0000 7f0462905700 1 --2- 172.21.15.80:0/3173136468 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f045c0c6b40 0x7f045c0b05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:58.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.679+0000 7f0462905700 1 -- 172.21.15.80:0/3173136468 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f045c0aec30 msgr2=0x7f045c1ee230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:58.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.679+0000 7f0462905700 1 --2- 172.21.15.80:0/3173136468 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f045c0aec30 0x7f045c1ee230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:58.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.679+0000 7f0462905700 1 -- 172.21.15.80:0/3173136468 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0454009b30 con 0x7f045c152290 2024-05-08T21:19:58.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.679+0000 7f0462905700 1 --2- 172.21.15.80:0/3173136468 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f045c152290 0x7f045c150c20 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f045c0707e0 tx=0x7f0454004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:58.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.679+0000 7f0452ffd700 1 -- 172.21.15.80:0/3173136468 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0454004880 con 0x7f045c152290 2024-05-08T21:19:58.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.679+0000 7f0452ffd700 1 -- 172.21.15.80:0/3173136468 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04540092e0 con 0x7f045c152290 2024-05-08T21:19:58.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.679+0000 7f0464368700 1 -- 172.21.15.80:0/3173136468 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f045c1f1860 con 0x7f045c152290 2024-05-08T21:19:58.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.679+0000 7f0452ffd700 1 -- 172.21.15.80:0/3173136468 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f045401c660 con 0x7f045c152290 2024-05-08T21:19:58.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.679+0000 7f0464368700 1 -- 172.21.15.80:0/3173136468 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f045c1eda30 con 0x7f045c152290 2024-05-08T21:19:58.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.680+0000 7f0464368700 1 -- 172.21.15.80:0/3173136468 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f045c152670 con 0x7f045c152290 2024-05-08T21:19:58.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.680+0000 7f0452ffd700 1 -- 172.21.15.80:0/3173136468 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f045401c7c0 con 0x7f045c152290 2024-05-08T21:19:58.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.681+0000 7f0452ffd700 1 --2- 172.21.15.80:0/3173136468 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f044006ac90 0x7f044006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:58.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.681+0000 7f0452ffd700 1 -- 172.21.15.80:0/3173136468 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f045408a930 con 0x7f045c152290 2024-05-08T21:19:58.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.681+0000 7f0462104700 1 --2- 172.21.15.80:0/3173136468 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f044006ac90 0x7f044006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:58.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.681+0000 7f0452ffd700 1 --2- 172.21.15.80:0/3173136468 >> [v2:172.21.15.106:6800/47113,v1:172.21.15.106:6801/47113] conn(0x7f0440074880 0x7f0440076d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:58.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.681+0000 7f0452ffd700 1 -- 172.21.15.80:0/3173136468 --> [v2:172.21.15.106:6800/47113,v1:172.21.15.106:6801/47113] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f04400773f0 con 0x7f0440074880 2024-05-08T21:19:58.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.681+0000 7f0452ffd700 1 -- 172.21.15.80:0/3173136468 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f045408f2c0 con 0x7f045c152290 2024-05-08T21:19:58.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.681+0000 7f0462104700 1 --2- 172.21.15.80:0/3173136468 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f044006ac90 0x7f044006d150 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0458006b20 tx=0x7f0458008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:58.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.681+0000 7f0461903700 1 --2- 172.21.15.80:0/3173136468 >> [v2:172.21.15.106:6800/47113,v1:172.21.15.106:6801/47113] conn(0x7f0440074880 0x7f0440076d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:58.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.682+0000 7f0461903700 1 --2- 172.21.15.80:0/3173136468 >> [v2:172.21.15.106:6800/47113,v1:172.21.15.106:6801/47113] conn(0x7f0440074880 0x7f0440076d20 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:58.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.683+0000 7f0452ffd700 1 -- 172.21.15.80:0/3173136468 <== osd.7 v2:172.21.15.106:6800/47113 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f04400773f0 con 0x7f0440074880 2024-05-08T21:19:58.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.697+0000 7f0464368700 1 -- 172.21.15.80:0/3173136468 --> [v2:172.21.15.106:6800/47113,v1:172.21.15.106:6801/47113] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f045c157ff0 con 0x7f0440074880 2024-05-08T21:19:58.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.698+0000 7f0452ffd700 1 -- 172.21.15.80:0/3173136468 <== osd.7 v2:172.21.15.106:6800/47113 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f044c0099e0 con 0x7f0440074880 2024-05-08T21:19:58.700 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-08T21:19:58.700 INFO:teuthology.orchestra.run.smithi080.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T21:19:58.701 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-08T21:19:58.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.698+0000 7f0464368700 1 -- 172.21.15.80:0/3173136468 >> [v2:172.21.15.106:6800/47113,v1:172.21.15.106:6801/47113] conn(0x7f0440074880 msgr2=0x7f0440076d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:58.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.698+0000 7f0464368700 1 --2- 172.21.15.80:0/3173136468 >> [v2:172.21.15.106:6800/47113,v1:172.21.15.106:6801/47113] conn(0x7f0440074880 0x7f0440076d20 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:58.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.698+0000 7f0464368700 1 -- 172.21.15.80:0/3173136468 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f044006ac90 msgr2=0x7f044006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:58.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.698+0000 7f0464368700 1 --2- 172.21.15.80:0/3173136468 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f044006ac90 0x7f044006d150 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0458006b20 tx=0x7f0458008040 comp rx=0 tx=0).stop 2024-05-08T21:19:58.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.698+0000 7f0464368700 1 -- 172.21.15.80:0/3173136468 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f045c152290 msgr2=0x7f045c150c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:58.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.698+0000 7f0464368700 1 --2- 172.21.15.80:0/3173136468 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f045c152290 0x7f045c150c20 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f045c0707e0 tx=0x7f0454004ad0 comp rx=0 tx=0).stop 2024-05-08T21:19:58.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.698+0000 7f0462905700 1 -- 172.21.15.80:0/3173136468 reap_dead start 2024-05-08T21:19:58.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.698+0000 7f0464368700 1 -- 172.21.15.80:0/3173136468 shutdown_connections 2024-05-08T21:19:58.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.698+0000 7f0464368700 1 -- 172.21.15.80:0/3173136468 >> 172.21.15.80:0/3173136468 conn(0x7f045c0cc140 msgr2=0x7f045c1562b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:58.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.698+0000 7f0464368700 1 -- 172.21.15.80:0/3173136468 shutdown_connections 2024-05-08T21:19:58.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.698+0000 7f0464368700 1 -- 172.21.15.80:0/3173136468 wait complete. 2024-05-08T21:19:58.712 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-05-08T21:19:58.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.834+0000 7f0478b73700 1 Processor -- start 2024-05-08T21:19:58.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.834+0000 7f0478b73700 1 -- start start 2024-05-08T21:19:58.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.835+0000 7f0478b73700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0474154580 0x7f047415abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:58.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.835+0000 7f0478b73700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f04740cbe40 0x7f04740c48c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:58.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.835+0000 7f0478b73700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f04740c4e00 0x7f04740cc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:58.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.835+0000 7f0478b73700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04740b2c60 con 0x7f04740cbe40 2024-05-08T21:19:58.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.835+0000 7f0478b73700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f047415d750 con 0x7f0474154580 2024-05-08T21:19:58.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.835+0000 7f0478b73700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04740b34f0 con 0x7f04740c4e00 2024-05-08T21:19:58.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.835+0000 7f0471d9b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f04740cbe40 0x7f04740c48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:58.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.835+0000 7f0471d9b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f04740cbe40 0x7f04740c48c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39604/0 (socket says 172.21.15.80:39604) 2024-05-08T21:19:58.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.835+0000 7f0471d9b700 1 -- 172.21.15.80:0/3664821296 learned_addr learned my addr 172.21.15.80:0/3664821296 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:19:58.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.835+0000 7f047259c700 1 --2- 172.21.15.80:0/3664821296 >> v2:172.21.15.106:3300/0 conn(0x7f0474154580 0x7f047415abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:58.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.835+0000 7f0472d9d700 1 --2- 172.21.15.80:0/3664821296 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f04740c4e00 0x7f04740cc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:58.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.835+0000 7f0471d9b700 1 -- 172.21.15.80:0/3664821296 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f04740c4e00 msgr2=0x7f04740cc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:19:58.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.835+0000 7f0471d9b700 1 --2- 172.21.15.80:0/3664821296 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f04740c4e00 0x7f04740cc3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:58.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.835+0000 7f0471d9b700 1 -- 172.21.15.80:0/3664821296 >> v2:172.21.15.106:3300/0 conn(0x7f0474154580 msgr2=0x7f047415abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:19:58.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.835+0000 7f0471d9b700 1 --2- 172.21.15.80:0/3664821296 >> v2:172.21.15.106:3300/0 conn(0x7f0474154580 0x7f047415abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:58.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.835+0000 7f0471d9b700 1 -- 172.21.15.80:0/3664821296 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04740cad60 con 0x7f04740cbe40 2024-05-08T21:19:58.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.835+0000 7f0471d9b700 1 --2- 172.21.15.80:0/3664821296 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f04740cbe40 0x7f04740c48c0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f04740cd360 tx=0x7f0468009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d523fe8107bd908 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:58.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.835+0000 7f047159a700 1 -- 172.21.15.80:0/3664821296 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046800b870 con 0x7f04740cbe40 2024-05-08T21:19:58.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.835+0000 7f047159a700 1 -- 172.21.15.80:0/3664821296 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f046800b9d0 con 0x7f04740cbe40 2024-05-08T21:19:58.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.835+0000 7f047159a700 1 -- 172.21.15.80:0/3664821296 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046800bd60 con 0x7f04740cbe40 2024-05-08T21:19:58.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.836+0000 7f0478b73700 1 -- 172.21.15.80:0/3664821296 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f04740cbe40 msgr2=0x7f04740c48c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:58.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.836+0000 7f0478b73700 1 --2- 172.21.15.80:0/3664821296 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f04740cbe40 0x7f04740c48c0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f04740cd360 tx=0x7f0468009bd0 comp rx=0 tx=0).stop 2024-05-08T21:19:58.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.836+0000 7f0478b73700 1 -- 172.21.15.80:0/3664821296 shutdown_connections 2024-05-08T21:19:58.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.836+0000 7f0478b73700 1 --2- 172.21.15.80:0/3664821296 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f04740c4e00 0x7f04740cc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:58.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.836+0000 7f0478b73700 1 --2- 172.21.15.80:0/3664821296 >> v2:172.21.15.106:3300/0 conn(0x7f0474154580 0x7f047415abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:58.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.836+0000 7f0478b73700 1 --2- 172.21.15.80:0/3664821296 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f04740cbe40 0x7f04740c48c0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:58.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.836+0000 7f0478b73700 1 -- 172.21.15.80:0/3664821296 >> 172.21.15.80:0/3664821296 conn(0x7f047406c6a0 msgr2=0x7f047406cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:58.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.836+0000 7f0478b73700 1 -- 172.21.15.80:0/3664821296 shutdown_connections 2024-05-08T21:19:58.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.836+0000 7f0478b73700 1 -- 172.21.15.80:0/3664821296 wait complete. 2024-05-08T21:19:58.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.837+0000 7f0478b73700 1 Processor -- start 2024-05-08T21:19:58.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.837+0000 7f0478b73700 1 -- start start 2024-05-08T21:19:58.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.838+0000 7f0478b73700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f04740c4e00 0x7f04741f3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:58.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.838+0000 7f0478b73700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f04740cbe40 0x7f0474150ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:58.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.838+0000 7f0478b73700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0474154580 0x7f04740ce790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:58.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.838+0000 7f0478b73700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04741ef7b0 con 0x7f04740c4e00 2024-05-08T21:19:58.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.838+0000 7f0478b73700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04741efa70 con 0x7f0474154580 2024-05-08T21:19:58.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.838+0000 7f0478b73700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04741efd50 con 0x7f04740cbe40 2024-05-08T21:19:58.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.838+0000 7f047259c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f04740c4e00 0x7f04741f3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:58.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.838+0000 7f047259c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f04740c4e00 0x7f04741f3730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39618/0 (socket says 172.21.15.80:39618) 2024-05-08T21:19:58.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.838+0000 7f047259c700 1 -- 172.21.15.80:0/4046897017 learned_addr learned my addr 172.21.15.80:0/4046897017 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:19:58.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.838+0000 7f0472d9d700 1 --2- 172.21.15.80:0/4046897017 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0474154580 0x7f04740ce790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:58.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.838+0000 7f0471d9b700 1 --2- 172.21.15.80:0/4046897017 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f04740cbe40 0x7f0474150ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:58.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.839+0000 7f047259c700 1 -- 172.21.15.80:0/4046897017 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f04740cbe40 msgr2=0x7f0474150ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:58.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.839+0000 7f047259c700 1 --2- 172.21.15.80:0/4046897017 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f04740cbe40 0x7f0474150ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:58.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.839+0000 7f047259c700 1 -- 172.21.15.80:0/4046897017 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0474154580 msgr2=0x7f04740ce790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:58.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.839+0000 7f047259c700 1 --2- 172.21.15.80:0/4046897017 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0474154580 0x7f04740ce790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:58.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.839+0000 7f047259c700 1 -- 172.21.15.80:0/4046897017 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0468009550 con 0x7f04740c4e00 2024-05-08T21:19:58.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.839+0000 7f047259c700 1 --2- 172.21.15.80:0/4046897017 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f04740c4e00 0x7f04741f3730 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f046400d800 tx=0x7f046400db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:58.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.839+0000 7f0462ffd700 1 -- 172.21.15.80:0/4046897017 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04640125f0 con 0x7f04740c4e00 2024-05-08T21:19:58.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.839+0000 7f0462ffd700 1 -- 172.21.15.80:0/4046897017 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0464012750 con 0x7f04740c4e00 2024-05-08T21:19:58.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.839+0000 7f0462ffd700 1 -- 172.21.15.80:0/4046897017 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0464012b00 con 0x7f04740c4e00 2024-05-08T21:19:58.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.839+0000 7f0478b73700 1 -- 172.21.15.80:0/4046897017 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04741f0030 con 0x7f04740c4e00 2024-05-08T21:19:58.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.839+0000 7f0478b73700 1 -- 172.21.15.80:0/4046897017 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04741f05f0 con 0x7f04740c4e00 2024-05-08T21:19:58.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.840+0000 7f0478b73700 1 -- 172.21.15.80:0/4046897017 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04740ce590 con 0x7f04740c4e00 2024-05-08T21:19:58.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.840+0000 7f0462ffd700 1 -- 172.21.15.80:0/4046897017 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0464012c60 con 0x7f04740c4e00 2024-05-08T21:19:58.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.841+0000 7f0462ffd700 1 --2- 172.21.15.80:0/4046897017 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f045406ac90 0x7f045406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:58.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.841+0000 7f0462ffd700 1 -- 172.21.15.80:0/4046897017 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f0464089960 con 0x7f04740c4e00 2024-05-08T21:19:58.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.841+0000 7f0471d9b700 1 --2- 172.21.15.80:0/4046897017 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f045406ac90 0x7f045406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:58.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.841+0000 7f0471d9b700 1 --2- 172.21.15.80:0/4046897017 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f045406ac90 0x7f045406d150 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0468000c00 tx=0x7f0468008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:58.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:58.849+0000 7f0462ffd700 1 -- 172.21.15.80:0/4046897017 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f04640545a0 con 0x7f04740c4e00 2024-05-08T21:19:59.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.062+0000 7f0478b73700 1 -- 172.21.15.80:0/4046897017 --> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f047406c490 con 0x7f045406ac90 2024-05-08T21:19:59.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.063+0000 7f0462ffd700 1 -- 172.21.15.80:0/4046897017 <== mgr.4100 v2:172.21.15.80:6832/46731 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f047406c490 con 0x7f045406ac90 2024-05-08T21:19:59.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.065+0000 7f0478b73700 1 -- 172.21.15.80:0/4046897017 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f045406ac90 msgr2=0x7f045406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:59.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.065+0000 7f0478b73700 1 --2- 172.21.15.80:0/4046897017 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f045406ac90 0x7f045406d150 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0468000c00 tx=0x7f0468008030 comp rx=0 tx=0).stop 2024-05-08T21:19:59.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.065+0000 7f0478b73700 1 -- 172.21.15.80:0/4046897017 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f04740c4e00 msgr2=0x7f04741f3730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:59.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.065+0000 7f0478b73700 1 --2- 172.21.15.80:0/4046897017 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f04740c4e00 0x7f04741f3730 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f046400d800 tx=0x7f046400db10 comp rx=0 tx=0).stop 2024-05-08T21:19:59.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.065+0000 7f0478b73700 1 -- 172.21.15.80:0/4046897017 shutdown_connections 2024-05-08T21:19:59.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.065+0000 7f0478b73700 1 --2- 172.21.15.80:0/4046897017 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f045406ac90 0x7f045406d150 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:59.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.065+0000 7f0478b73700 1 --2- 172.21.15.80:0/4046897017 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f04740c4e00 0x7f04741f3730 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:59.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.065+0000 7f0478b73700 1 --2- 172.21.15.80:0/4046897017 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0474154580 0x7f04740ce790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:59.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.065+0000 7f0478b73700 1 --2- 172.21.15.80:0/4046897017 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f04740cbe40 0x7f0474150ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:59.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.065+0000 7f0478b73700 1 -- 172.21.15.80:0/4046897017 >> 172.21.15.80:0/4046897017 conn(0x7f047406c6a0 msgr2=0x7f04740c5c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:59.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.065+0000 7f0478b73700 1 -- 172.21.15.80:0/4046897017 shutdown_connections 2024-05-08T21:19:59.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.065+0000 7f0478b73700 1 -- 172.21.15.80:0/4046897017 wait complete. 2024-05-08T21:19:59.069 INFO:teuthology.orchestra.run.smithi080.stderr:instructed osd(s) 7 to deep-scrub 2024-05-08T21:19:59.080 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T21:19:59.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.199+0000 7fa6106d7700 1 Processor -- start 2024-05-08T21:19:59.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.199+0000 7fa6106d7700 1 -- start start 2024-05-08T21:19:59.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.200+0000 7fa6106d7700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa6080c2230 0x7fa6080c6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:59.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.200+0000 7fa6106d7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa6080cb570 0x7fa6080cb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:59.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.200+0000 7fa6106d7700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa60816a850 0x7fa60816ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:59.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.200+0000 7fa6106d7700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa608167f40 con 0x7fa6080cb570 2024-05-08T21:19:59.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.200+0000 7fa6106d7700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa60816b220 con 0x7fa6080c2230 2024-05-08T21:19:59.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.200+0000 7fa6106d7700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6080c6bc0 con 0x7fa60816a850 2024-05-08T21:19:59.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.200+0000 7fa60dc72700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa6080cb570 0x7fa6080cb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:59.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.200+0000 7fa60dc72700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa6080cb570 0x7fa6080cb9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39624/0 (socket says 172.21.15.80:39624) 2024-05-08T21:19:59.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.200+0000 7fa60ec74700 1 --2- 172.21.15.80:0/1656155696 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa60816a850 0x7fa60816ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:59.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.200+0000 7fa60dc72700 1 -- 172.21.15.80:0/1656155696 learned_addr learned my addr 172.21.15.80:0/1656155696 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:19:59.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.200+0000 7fa60e473700 1 --2- 172.21.15.80:0/1656155696 >> v2:172.21.15.106:3300/0 conn(0x7fa6080c2230 0x7fa6080c6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:59.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.230+0000 7fa60dc72700 1 -- 172.21.15.80:0/1656155696 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa60816a850 msgr2=0x7fa60816ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:19:59.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.230+0000 7fa60dc72700 1 --2- 172.21.15.80:0/1656155696 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa60816a850 0x7fa60816ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:59.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.230+0000 7fa60dc72700 1 -- 172.21.15.80:0/1656155696 >> v2:172.21.15.106:3300/0 conn(0x7fa6080c2230 msgr2=0x7fa6080c6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:19:59.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.230+0000 7fa60dc72700 1 --2- 172.21.15.80:0/1656155696 >> v2:172.21.15.106:3300/0 conn(0x7fa6080c2230 0x7fa6080c6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:59.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.230+0000 7fa60dc72700 1 -- 172.21.15.80:0/1656155696 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa608167330 con 0x7fa6080cb570 2024-05-08T21:19:59.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.230+0000 7fa60dc72700 1 --2- 172.21.15.80:0/1656155696 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa6080cb570 0x7fa6080cb9b0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fa6080c8020 tx=0x7fa60400bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=979709751b8201db server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:59.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.230+0000 7fa60d471700 1 -- 172.21.15.80:0/1656155696 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60400ca70 con 0x7fa6080cb570 2024-05-08T21:19:59.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.230+0000 7fa60d471700 1 -- 172.21.15.80:0/1656155696 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa60400cbd0 con 0x7fa6080cb570 2024-05-08T21:19:59.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.230+0000 7fa60d471700 1 -- 172.21.15.80:0/1656155696 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60400f460 con 0x7fa6080cb570 2024-05-08T21:19:59.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.231+0000 7fa6106d7700 1 -- 172.21.15.80:0/1656155696 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa6080cb570 msgr2=0x7fa6080cb9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:59.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.231+0000 7fa6106d7700 1 --2- 172.21.15.80:0/1656155696 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa6080cb570 0x7fa6080cb9b0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fa6080c8020 tx=0x7fa60400bc80 comp rx=0 tx=0).stop 2024-05-08T21:19:59.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.231+0000 7fa6106d7700 1 -- 172.21.15.80:0/1656155696 shutdown_connections 2024-05-08T21:19:59.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.231+0000 7fa6106d7700 1 --2- 172.21.15.80:0/1656155696 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa60816a850 0x7fa60816ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:59.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.231+0000 7fa6106d7700 1 --2- 172.21.15.80:0/1656155696 >> v2:172.21.15.106:3300/0 conn(0x7fa6080c2230 0x7fa6080c6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:59.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.231+0000 7fa6106d7700 1 --2- 172.21.15.80:0/1656155696 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa6080cb570 0x7fa6080cb9b0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:59.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.231+0000 7fa6106d7700 1 -- 172.21.15.80:0/1656155696 >> 172.21.15.80:0/1656155696 conn(0x7fa60806a9c0 msgr2=0x7fa60806ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:59.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.231+0000 7fa6106d7700 1 -- 172.21.15.80:0/1656155696 shutdown_connections 2024-05-08T21:19:59.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.231+0000 7fa6106d7700 1 -- 172.21.15.80:0/1656155696 wait complete. 2024-05-08T21:19:59.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.232+0000 7fa6106d7700 1 Processor -- start 2024-05-08T21:19:59.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.232+0000 7fa6106d7700 1 -- start start 2024-05-08T21:19:59.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.233+0000 7fa6106d7700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa6080c2230 0x7fa6081656f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:59.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.233+0000 7fa6106d7700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa6080cb570 0x7fa60815c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:59.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.233+0000 7fa6106d7700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa60816a850 0x7fa608168140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:59.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.233+0000 7fa6106d7700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6081fd370 con 0x7fa60816a850 2024-05-08T21:19:59.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.233+0000 7fa6106d7700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6081fc780 con 0x7fa6080c2230 2024-05-08T21:19:59.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.233+0000 7fa6106d7700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa60816a290 con 0x7fa6080cb570 2024-05-08T21:19:59.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.233+0000 7fa60ec74700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa60816a850 0x7fa608168140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:59.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.233+0000 7fa60ec74700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa60816a850 0x7fa608168140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:39626/0 (socket says 172.21.15.80:39626) 2024-05-08T21:19:59.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.233+0000 7fa60ec74700 1 -- 172.21.15.80:0/1557282734 learned_addr learned my addr 172.21.15.80:0/1557282734 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:19:59.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.233+0000 7fa60e473700 1 --2- 172.21.15.80:0/1557282734 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa6080c2230 0x7fa6081656f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:59.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.233+0000 7fa60dc72700 1 --2- 172.21.15.80:0/1557282734 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa6080cb570 0x7fa60815c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:59.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.233+0000 7fa60ec74700 1 -- 172.21.15.80:0/1557282734 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa6080cb570 msgr2=0x7fa60815c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:59.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.233+0000 7fa60ec74700 1 --2- 172.21.15.80:0/1557282734 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa6080cb570 0x7fa60815c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:59.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.233+0000 7fa60ec74700 1 -- 172.21.15.80:0/1557282734 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa6080c2230 msgr2=0x7fa6081656f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:59.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.233+0000 7fa60ec74700 1 --2- 172.21.15.80:0/1557282734 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa6080c2230 0x7fa6081656f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:59.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.233+0000 7fa60ec74700 1 -- 172.21.15.80:0/1557282734 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa60400b600 con 0x7fa60816a850 2024-05-08T21:19:59.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.233+0000 7fa60ec74700 1 --2- 172.21.15.80:0/1557282734 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa60816a850 0x7fa608168140 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fa6000133f0 tx=0x7fa600013700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:59.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.234+0000 7fa5faffd700 1 -- 172.21.15.80:0/1557282734 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60000e0d0 con 0x7fa60816a850 2024-05-08T21:19:59.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.234+0000 7fa5faffd700 1 -- 172.21.15.80:0/1557282734 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa600014040 con 0x7fa60816a850 2024-05-08T21:19:59.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.234+0000 7fa6106d7700 1 -- 172.21.15.80:0/1557282734 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6081fca40 con 0x7fa60816a850 2024-05-08T21:19:59.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.234+0000 7fa5faffd700 1 -- 172.21.15.80:0/1557282734 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60000e450 con 0x7fa60816a850 2024-05-08T21:19:59.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.234+0000 7fa6106d7700 1 -- 172.21.15.80:0/1557282734 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6081fd000 con 0x7fa60816a850 2024-05-08T21:19:59.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.235+0000 7fa6106d7700 1 -- 172.21.15.80:0/1557282734 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6081fd190 con 0x7fa60816a850 2024-05-08T21:19:59.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.235+0000 7fa5faffd700 1 -- 172.21.15.80:0/1557282734 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa600008040 con 0x7fa60816a850 2024-05-08T21:19:59.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.236+0000 7fa5faffd700 1 --2- 172.21.15.80:0/1557282734 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fa5ec06ac90 0x7fa5ec06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:19:59.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.236+0000 7fa5faffd700 1 -- 172.21.15.80:0/1557282734 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7007+0+0 (secure 0 0 0) 0x7fa60008dda0 con 0x7fa60816a850 2024-05-08T21:19:59.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.236+0000 7fa60e473700 1 --2- 172.21.15.80:0/1557282734 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fa5ec06ac90 0x7fa5ec06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:19:59.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.236+0000 7fa60e473700 1 --2- 172.21.15.80:0/1557282734 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fa5ec06ac90 0x7fa5ec06d150 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc004150 tx=0x7fa5fc009180 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:19:59.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.240+0000 7fa5faffd700 1 -- 172.21.15.80:0/1557282734 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fa600058a70 con 0x7fa60816a850 2024-05-08T21:19:59.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.455+0000 7fa6106d7700 1 -- 172.21.15.80:0/1557282734 --> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa608167bd0 con 0x7fa5ec06ac90 2024-05-08T21:19:59.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.465+0000 7fa5faffd700 1 -- 172.21.15.80:0/1557282734 <== mgr.4100 v2:172.21.15.80:6832/46731 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367662 (secure 0 0 0) 0x7fa5fc00d040 con 0x7fa5ec06ac90 2024-05-08T21:19:59.473 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:19:59.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.469+0000 7fa6106d7700 1 -- 172.21.15.80:0/1557282734 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fa5ec06ac90 msgr2=0x7fa5ec06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:59.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.469+0000 7fa6106d7700 1 --2- 172.21.15.80:0/1557282734 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fa5ec06ac90 0x7fa5ec06d150 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc004150 tx=0x7fa5fc009180 comp rx=0 tx=0).stop 2024-05-08T21:19:59.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.469+0000 7fa6106d7700 1 -- 172.21.15.80:0/1557282734 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa60816a850 msgr2=0x7fa608168140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:19:59.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.469+0000 7fa6106d7700 1 --2- 172.21.15.80:0/1557282734 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa60816a850 0x7fa608168140 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fa6000133f0 tx=0x7fa600013700 comp rx=0 tx=0).stop 2024-05-08T21:19:59.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.469+0000 7fa6106d7700 1 -- 172.21.15.80:0/1557282734 shutdown_connections 2024-05-08T21:19:59.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.469+0000 7fa6106d7700 1 --2- 172.21.15.80:0/1557282734 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7fa5ec06ac90 0x7fa5ec06d150 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:59.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.469+0000 7fa6106d7700 1 --2- 172.21.15.80:0/1557282734 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa60816a850 0x7fa608168140 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:59.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.469+0000 7fa6106d7700 1 --2- 172.21.15.80:0/1557282734 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa6080c2230 0x7fa6081656f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:59.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.469+0000 7fa6106d7700 1 --2- 172.21.15.80:0/1557282734 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa6080cb570 0x7fa60815c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:19:59.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.469+0000 7fa6106d7700 1 -- 172.21.15.80:0/1557282734 >> 172.21.15.80:0/1557282734 conn(0x7fa60806a9c0 msgr2=0x7fa60806ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:19:59.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.469+0000 7fa6106d7700 1 -- 172.21.15.80:0/1557282734 shutdown_connections 2024-05-08T21:19:59.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:19:59.469+0000 7fa6106d7700 1 -- 172.21.15.80:0/1557282734 wait complete. 2024-05-08T21:19:59.476 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-05-08T21:19:59.483 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":327,"stamp":"2024-05-08T21:19:58.502920+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":16427784,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":2254,"num_read_kb":39820,"num_write":1717439,"num_write_kb":22166553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":136207,"ondisk_log_size":136207,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":7430828,"kb_used_data":77220,"kb_used_omap":12,"kb_used_meta":7346419,"kb_avail":747543892,"statfs":{"total":773094113280,"available":765484945408,"internally_reserved":0,"allocated":79073280,"data_stored":120898024,"data_compressed":7599893,"data_compressed_allocated":17952768,"data_compressed_original":61407232,"omap_allocated":12743,"internal_metadata":7522733625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,3,0,4,3,4],"upper_bound":512},"perf_stat":{"commit_latency_ms":77,"apply_latency_ms":77,"commit_latency_ns":77000000,"apply_latency_ns":77000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6084211312,"num_objects":-1649,"num_object_clones":0,"num_object_copies":-6578,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1649,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1658,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006562"},"pg_stats":[{"pgid":"3.3f","version":"32'8","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.228524+0000","last_change":"2024-05-08T21:10:03.747477+0000","last_active":"2024-05-08T21:19:53.228524+0000","last_peered":"2024-05-08T21:19:53.228524+0000","last_clean":"2024-05-08T21:19:53.228524+0000","last_became_active":"2024-05-08T21:10:03.747059+0000","last_became_peered":"2024-05-08T21:10:03.747059+0000","last_unstale":"2024-05-08T21:19:53.228524+0000","last_undegraded":"2024-05-08T21:19:53.228524+0000","last_fullsized":"2024-05-08T21:19:53.228524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:15:24.340135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"32'6","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.322172+0000","last_change":"2024-05-08T21:10:03.738974+0000","last_active":"2024-05-08T21:19:53.322172+0000","last_peered":"2024-05-08T21:19:53.322172+0000","last_clean":"2024-05-08T21:19:53.322172+0000","last_became_active":"2024-05-08T21:10:03.738466+0000","last_became_peered":"2024-05-08T21:10:03.738466+0000","last_unstale":"2024-05-08T21:19:53.322172+0000","last_undegraded":"2024-05-08T21:19:53.322172+0000","last_fullsized":"2024-05-08T21:19:53.322172+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"32'13","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.224296+0000","last_change":"2024-05-08T21:10:03.740146+0000","last_active":"2024-05-08T21:19:53.224296+0000","last_peered":"2024-05-08T21:19:53.224296+0000","last_clean":"2024-05-08T21:19:53.224296+0000","last_became_active":"2024-05-08T21:10:03.739884+0000","last_became_peered":"2024-05-08T21:10:03.739884+0000","last_unstale":"2024-05-08T21:19:53.224296+0000","last_undegraded":"2024-05-08T21:19:53.224296+0000","last_fullsized":"2024-05-08T21:19:53.224296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"32'6","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.277411+0000","last_change":"2024-05-08T21:10:03.754159+0000","last_active":"2024-05-08T21:19:53.277411+0000","last_peered":"2024-05-08T21:19:53.277411+0000","last_clean":"2024-05-08T21:19:53.277411+0000","last_became_active":"2024-05-08T21:10:03.753800+0000","last_became_peered":"2024-05-08T21:10:03.753800+0000","last_unstale":"2024-05-08T21:19:53.277411+0000","last_undegraded":"2024-05-08T21:19:53.277411+0000","last_fullsized":"2024-05-08T21:19:53.277411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"32'11","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.259999+0000","last_change":"2024-05-08T21:10:03.750051+0000","last_active":"2024-05-08T21:19:53.259999+0000","last_peered":"2024-05-08T21:19:53.259999+0000","last_clean":"2024-05-08T21:19:53.259999+0000","last_became_active":"2024-05-08T21:10:03.749730+0000","last_became_peered":"2024-05-08T21:10:03.749730+0000","last_unstale":"2024-05-08T21:19:53.259999+0000","last_undegraded":"2024-05-08T21:19:53.259999+0000","last_fullsized":"2024-05-08T21:19:53.259999+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:49.402253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"32'11","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.300011+0000","last_change":"2024-05-08T21:10:53.473952+0000","last_active":"2024-05-08T21:19:53.300011+0000","last_peered":"2024-05-08T21:19:53.300011+0000","last_clean":"2024-05-08T21:19:53.300011+0000","last_became_active":"2024-05-08T21:10:53.473632+0000","last_became_peered":"2024-05-08T21:10:53.473632+0000","last_unstale":"2024-05-08T21:19:53.300011+0000","last_undegraded":"2024-05-08T21:19:53.300011+0000","last_fullsized":"2024-05-08T21:19:53.300011+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"32'8","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.053504+0000","last_change":"2024-05-08T21:10:03.743802+0000","last_active":"2024-05-08T21:19:53.053504+0000","last_peered":"2024-05-08T21:19:53.053504+0000","last_clean":"2024-05-08T21:19:53.053504+0000","last_became_active":"2024-05-08T21:10:03.743349+0000","last_became_peered":"2024-05-08T21:10:03.743349+0000","last_unstale":"2024-05-08T21:19:53.053504+0000","last_undegraded":"2024-05-08T21:19:53.053504+0000","last_fullsized":"2024-05-08T21:19:53.053504+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:08:06.408724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"32'6","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.201047+0000","last_change":"2024-05-08T21:10:03.747558+0000","last_active":"2024-05-08T21:19:53.201047+0000","last_peered":"2024-05-08T21:19:53.201047+0000","last_clean":"2024-05-08T21:19:53.201047+0000","last_became_active":"2024-05-08T21:10:03.747300+0000","last_became_peered":"2024-05-08T21:10:03.747300+0000","last_unstale":"2024-05-08T21:19:53.201047+0000","last_undegraded":"2024-05-08T21:19:53.201047+0000","last_fullsized":"2024-05-08T21:19:53.201047+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:07:50.266894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"32'16","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:51.373365+0000","last_change":"2024-05-08T21:10:03.748221+0000","last_active":"2024-05-08T21:19:51.373365+0000","last_peered":"2024-05-08T21:19:51.373365+0000","last_clean":"2024-05-08T21:19:51.373365+0000","last_became_active":"2024-05-08T21:10:03.747956+0000","last_became_peered":"2024-05-08T21:10:03.747956+0000","last_unstale":"2024-05-08T21:19:51.373365+0000","last_undegraded":"2024-05-08T21:19:51.373365+0000","last_fullsized":"2024-05-08T21:19:51.373365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:27:35.947884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"32'11","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.155748+0000","last_change":"2024-05-08T21:10:03.745291+0000","last_active":"2024-05-08T21:19:53.155748+0000","last_peered":"2024-05-08T21:19:53.155748+0000","last_clean":"2024-05-08T21:19:53.155748+0000","last_became_active":"2024-05-08T21:10:03.744976+0000","last_became_peered":"2024-05-08T21:10:03.744976+0000","last_unstale":"2024-05-08T21:19:53.155748+0000","last_undegraded":"2024-05-08T21:19:53.155748+0000","last_fullsized":"2024-05-08T21:19:53.155748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:36:54.983642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"32'12","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:43.501157+0000","last_change":"2024-05-08T21:10:03.748518+0000","last_active":"2024-05-08T21:19:43.501157+0000","last_peered":"2024-05-08T21:19:43.501157+0000","last_clean":"2024-05-08T21:19:43.501157+0000","last_became_active":"2024-05-08T21:10:03.748253+0000","last_became_peered":"2024-05-08T21:10:03.748253+0000","last_unstale":"2024-05-08T21:19:43.501157+0000","last_undegraded":"2024-05-08T21:19:43.501157+0000","last_fullsized":"2024-05-08T21:19:43.501157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:03:26.013122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"32'11","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.055969+0000","last_change":"2024-05-08T21:10:03.745985+0000","last_active":"2024-05-08T21:19:53.055969+0000","last_peered":"2024-05-08T21:19:53.055969+0000","last_clean":"2024-05-08T21:19:53.055969+0000","last_became_active":"2024-05-08T21:10:03.745247+0000","last_became_peered":"2024-05-08T21:10:03.745247+0000","last_unstale":"2024-05-08T21:19:53.055969+0000","last_undegraded":"2024-05-08T21:19:53.055969+0000","last_fullsized":"2024-05-08T21:19:53.055969+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:59:42.506304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"32'15","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.162569+0000","last_change":"2024-05-08T21:10:03.747016+0000","last_active":"2024-05-08T21:19:53.162569+0000","last_peered":"2024-05-08T21:19:53.162569+0000","last_clean":"2024-05-08T21:19:53.162569+0000","last_became_active":"2024-05-08T21:10:03.746848+0000","last_became_peered":"2024-05-08T21:10:03.746848+0000","last_unstale":"2024-05-08T21:19:53.162569+0000","last_undegraded":"2024-05-08T21:19:53.162569+0000","last_fullsized":"2024-05-08T21:19:53.162569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:41:21.081035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"32'17","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.185744+0000","last_change":"2024-05-08T21:10:03.737984+0000","last_active":"2024-05-08T21:19:53.185744+0000","last_peered":"2024-05-08T21:19:53.185744+0000","last_clean":"2024-05-08T21:19:53.185744+0000","last_became_active":"2024-05-08T21:10:03.737716+0000","last_became_peered":"2024-05-08T21:10:03.737716+0000","last_unstale":"2024-05-08T21:19:53.185744+0000","last_undegraded":"2024-05-08T21:19:53.185744+0000","last_fullsized":"2024-05-08T21:19:53.185744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"32'13","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.266055+0000","last_change":"2024-05-08T21:10:03.744543+0000","last_active":"2024-05-08T21:19:53.266055+0000","last_peered":"2024-05-08T21:19:53.266055+0000","last_clean":"2024-05-08T21:19:53.266055+0000","last_became_active":"2024-05-08T21:10:03.744276+0000","last_became_peered":"2024-05-08T21:10:03.744276+0000","last_unstale":"2024-05-08T21:19:53.266055+0000","last_undegraded":"2024-05-08T21:19:53.266055+0000","last_fullsized":"2024-05-08T21:19:53.266055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"32'13","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.180928+0000","last_change":"2024-05-08T21:10:03.746547+0000","last_active":"2024-05-08T21:19:53.180928+0000","last_peered":"2024-05-08T21:19:53.180928+0000","last_clean":"2024-05-08T21:19:53.180928+0000","last_became_active":"2024-05-08T21:10:03.745862+0000","last_became_peered":"2024-05-08T21:10:03.745862+0000","last_unstale":"2024-05-08T21:19:53.180928+0000","last_undegraded":"2024-05-08T21:19:53.180928+0000","last_fullsized":"2024-05-08T21:19:53.180928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"32'13","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.229774+0000","last_change":"2024-05-08T21:10:54.028844+0000","last_active":"2024-05-08T21:19:53.229774+0000","last_peered":"2024-05-08T21:19:53.229774+0000","last_clean":"2024-05-08T21:19:53.229774+0000","last_became_active":"2024-05-08T21:10:54.028630+0000","last_became_peered":"2024-05-08T21:10:54.028630+0000","last_unstale":"2024-05-08T21:19:53.229774+0000","last_undegraded":"2024-05-08T21:19:53.229774+0000","last_fullsized":"2024-05-08T21:19:53.229774+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"32'17","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.298398+0000","last_change":"2024-05-08T21:10:03.743889+0000","last_active":"2024-05-08T21:19:53.298398+0000","last_peered":"2024-05-08T21:19:53.298398+0000","last_clean":"2024-05-08T21:19:53.298398+0000","last_became_active":"2024-05-08T21:10:03.743596+0000","last_became_peered":"2024-05-08T21:10:03.743596+0000","last_unstale":"2024-05-08T21:19:53.298398+0000","last_undegraded":"2024-05-08T21:19:53.298398+0000","last_fullsized":"2024-05-08T21:19:53.298398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"32'15","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.034501+0000","last_change":"2024-05-08T21:10:03.743893+0000","last_active":"2024-05-08T21:19:53.034501+0000","last_peered":"2024-05-08T21:19:53.034501+0000","last_clean":"2024-05-08T21:19:53.034501+0000","last_became_active":"2024-05-08T21:10:03.743580+0000","last_became_peered":"2024-05-08T21:10:03.743580+0000","last_unstale":"2024-05-08T21:19:53.034501+0000","last_undegraded":"2024-05-08T21:19:53.034501+0000","last_fullsized":"2024-05-08T21:19:53.034501+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:44:21.747625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"32'4303","reported_seq":4392,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.262697+0000","last_change":"2024-05-08T21:10:08.052394+0000","last_active":"2024-05-08T21:19:53.262697+0000","last_peered":"2024-05-08T21:19:53.262697+0000","last_clean":"2024-05-08T21:19:53.262697+0000","last_became_active":"2024-05-08T21:10:08.052009+0000","last_became_peered":"2024-05-08T21:10:08.052009+0000","last_unstale":"2024-05-08T21:19:53.262697+0000","last_undegraded":"2024-05-08T21:19:53.262697+0000","last_fullsized":"2024-05-08T21:19:53.262697+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4303,"log_dups_size":0,"ondisk_log_size":4303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:47:20.148683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":0,"num_write":56160,"num_write_kb":728959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"32'472","reported_seq":510,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.220454+0000","last_change":"2024-05-08T21:10:03.340118+0000","last_active":"2024-05-08T21:19:53.220454+0000","last_peered":"2024-05-08T21:19:53.220454+0000","last_clean":"2024-05-08T21:19:53.220454+0000","last_became_active":"2024-05-08T21:10:03.339847+0000","last_became_peered":"2024-05-08T21:10:03.339847+0000","last_unstale":"2024-05-08T21:19:53.220454+0000","last_undegraded":"2024-05-08T21:19:53.220454+0000","last_fullsized":"2024-05-08T21:19:53.220454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3159557,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":1370,"num_write":465,"num_write_kb":3345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"32'7","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.162795+0000","last_change":"2024-05-08T21:10:03.746516+0000","last_active":"2024-05-08T21:19:53.162795+0000","last_peered":"2024-05-08T21:19:53.162795+0000","last_clean":"2024-05-08T21:19:53.162795+0000","last_became_active":"2024-05-08T21:10:03.746383+0000","last_became_peered":"2024-05-08T21:10:03.746383+0000","last_unstale":"2024-05-08T21:19:53.162795+0000","last_undegraded":"2024-05-08T21:19:53.162795+0000","last_fullsized":"2024-05-08T21:19:53.162795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:29:05.305134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'4174","reported_seq":4263,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.304810+0000","last_change":"2024-05-08T21:10:53.484902+0000","last_active":"2024-05-08T21:19:53.304810+0000","last_peered":"2024-05-08T21:19:53.304810+0000","last_clean":"2024-05-08T21:19:53.304810+0000","last_became_active":"2024-05-08T21:10:53.484437+0000","last_became_peered":"2024-05-08T21:10:53.484437+0000","last_unstale":"2024-05-08T21:19:53.304810+0000","last_undegraded":"2024-05-08T21:19:53.304810+0000","last_fullsized":"2024-05-08T21:19:53.304810+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4174,"log_dups_size":0,"ondisk_log_size":4174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:51:42.307075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":0,"num_write":53711,"num_write_kb":702965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2,3],"acting":[4,6,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"32'7","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.137976+0000","last_change":"2024-05-08T21:10:03.329414+0000","last_active":"2024-05-08T21:19:53.137976+0000","last_peered":"2024-05-08T21:19:53.137976+0000","last_clean":"2024-05-08T21:19:53.137976+0000","last_became_active":"2024-05-08T21:10:03.328970+0000","last_became_peered":"2024-05-08T21:10:03.328970+0000","last_unstale":"2024-05-08T21:19:53.137976+0000","last_undegraded":"2024-05-08T21:19:53.137976+0000","last_fullsized":"2024-05-08T21:19:53.137976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:34:32.820755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"32'13","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.308072+0000","last_change":"2024-05-08T21:10:03.748566+0000","last_active":"2024-05-08T21:19:53.308072+0000","last_peered":"2024-05-08T21:19:53.308072+0000","last_clean":"2024-05-08T21:19:53.308072+0000","last_became_active":"2024-05-08T21:10:03.747989+0000","last_became_peered":"2024-05-08T21:10:03.747989+0000","last_unstale":"2024-05-08T21:19:53.308072+0000","last_undegraded":"2024-05-08T21:19:53.308072+0000","last_fullsized":"2024-05-08T21:19:53.308072+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"32'4151","reported_seq":4234,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.277881+0000","last_change":"2024-05-08T21:10:07.770390+0000","last_active":"2024-05-08T21:19:53.277881+0000","last_peered":"2024-05-08T21:19:53.277881+0000","last_clean":"2024-05-08T21:19:53.277881+0000","last_became_active":"2024-05-08T21:10:07.770017+0000","last_became_peered":"2024-05-08T21:10:07.770017+0000","last_unstale":"2024-05-08T21:19:53.277881+0000","last_undegraded":"2024-05-08T21:19:53.277881+0000","last_fullsized":"2024-05-08T21:19:53.277881+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4151,"log_dups_size":0,"ondisk_log_size":4151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:12:00.200848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":0,"num_write":52838,"num_write_kb":674205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"32'17","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.158591+0000","last_change":"2024-05-08T21:10:03.339207+0000","last_active":"2024-05-08T21:19:53.158591+0000","last_peered":"2024-05-08T21:19:53.158591+0000","last_clean":"2024-05-08T21:19:53.158591+0000","last_became_active":"2024-05-08T21:10:03.338917+0000","last_became_peered":"2024-05-08T21:10:03.338917+0000","last_unstale":"2024-05-08T21:19:53.158591+0000","last_undegraded":"2024-05-08T21:19:53.158591+0000","last_fullsized":"2024-05-08T21:19:53.158591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:20.676853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":8,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"32'8","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.032545+0000","last_change":"2024-05-08T21:10:53.477056+0000","last_active":"2024-05-08T21:19:53.032545+0000","last_peered":"2024-05-08T21:19:53.032545+0000","last_clean":"2024-05-08T21:19:53.032545+0000","last_became_active":"2024-05-08T21:10:53.476785+0000","last_became_peered":"2024-05-08T21:10:53.476785+0000","last_unstale":"2024-05-08T21:19:53.032545+0000","last_undegraded":"2024-05-08T21:19:53.032545+0000","last_fullsized":"2024-05-08T21:19:53.032545+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"32'3545","reported_seq":3610,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.180315+0000","last_change":"2024-05-08T21:10:07.776367+0000","last_active":"2024-05-08T21:19:53.180315+0000","last_peered":"2024-05-08T21:19:53.180315+0000","last_clean":"2024-05-08T21:19:53.180315+0000","last_became_active":"2024-05-08T21:10:07.775998+0000","last_became_peered":"2024-05-08T21:10:07.775998+0000","last_unstale":"2024-05-08T21:19:53.180315+0000","last_undegraded":"2024-05-08T21:19:53.180315+0000","last_fullsized":"2024-05-08T21:19:53.180315+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":3545,"log_dups_size":0,"ondisk_log_size":3545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:24:18.845560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":0,"num_write":46338,"num_write_kb":599175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"32'6","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:52.938774+0000","last_change":"2024-05-08T21:10:03.339182+0000","last_active":"2024-05-08T21:19:52.938774+0000","last_peered":"2024-05-08T21:19:52.938774+0000","last_clean":"2024-05-08T21:19:52.938774+0000","last_became_active":"2024-05-08T21:10:03.338899+0000","last_became_peered":"2024-05-08T21:10:03.338899+0000","last_unstale":"2024-05-08T21:19:52.938774+0000","last_undegraded":"2024-05-08T21:19:52.938774+0000","last_fullsized":"2024-05-08T21:19:52.938774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:55:53.368546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"32'14","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.230966+0000","last_change":"2024-05-08T21:10:03.750724+0000","last_active":"2024-05-08T21:19:53.230966+0000","last_peered":"2024-05-08T21:19:53.230966+0000","last_clean":"2024-05-08T21:19:53.230966+0000","last_became_active":"2024-05-08T21:10:03.750371+0000","last_became_peered":"2024-05-08T21:10:03.750371+0000","last_unstale":"2024-05-08T21:19:53.230966+0000","last_undegraded":"2024-05-08T21:19:53.230966+0000","last_fullsized":"2024-05-08T21:19:53.230966+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"32'4480","reported_seq":4567,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.252501+0000","last_change":"2024-05-08T21:10:07.767604+0000","last_active":"2024-05-08T21:19:53.252501+0000","last_peered":"2024-05-08T21:19:53.252501+0000","last_clean":"2024-05-08T21:19:53.252501+0000","last_became_active":"2024-05-08T21:10:07.767234+0000","last_became_peered":"2024-05-08T21:10:07.767234+0000","last_unstale":"2024-05-08T21:19:53.252501+0000","last_undegraded":"2024-05-08T21:19:53.252501+0000","last_fullsized":"2024-05-08T21:19:53.252501+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4480,"log_dups_size":0,"ondisk_log_size":4480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:30:21.411491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":0,"num_write":57901,"num_write_kb":753617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"32'1295","reported_seq":1323,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.144223+0000","last_change":"2024-05-08T21:10:03.338149+0000","last_active":"2024-05-08T21:19:53.144223+0000","last_peered":"2024-05-08T21:19:53.144223+0000","last_clean":"2024-05-08T21:19:53.144223+0000","last_became_active":"2024-05-08T21:10:03.337860+0000","last_became_peered":"2024-05-08T21:10:03.337860+0000","last_unstale":"2024-05-08T21:19:53.144223+0000","last_undegraded":"2024-05-08T21:19:53.144223+0000","last_fullsized":"2024-05-08T21:19:53.144223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":1295,"log_dups_size":0,"ondisk_log_size":1295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:07:39.052625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":1290,"num_write_kb":5292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"32'12","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:51.871987+0000","last_change":"2024-05-08T21:10:03.743506+0000","last_active":"2024-05-08T21:19:51.871987+0000","last_peered":"2024-05-08T21:19:51.871987+0000","last_clean":"2024-05-08T21:19:51.871987+0000","last_became_active":"2024-05-08T21:10:03.743227+0000","last_became_peered":"2024-05-08T21:10:03.743227+0000","last_unstale":"2024-05-08T21:19:51.871987+0000","last_undegraded":"2024-05-08T21:19:51.871987+0000","last_fullsized":"2024-05-08T21:19:51.871987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:45:47.977619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"32'3361","reported_seq":3425,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.277796+0000","last_change":"2024-05-08T21:10:07.768424+0000","last_active":"2024-05-08T21:19:53.277796+0000","last_peered":"2024-05-08T21:19:53.277796+0000","last_clean":"2024-05-08T21:19:53.277796+0000","last_became_active":"2024-05-08T21:10:07.768160+0000","last_became_peered":"2024-05-08T21:10:07.768160+0000","last_unstale":"2024-05-08T21:19:53.277796+0000","last_undegraded":"2024-05-08T21:19:53.277796+0000","last_fullsized":"2024-05-08T21:19:53.277796+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":3361,"log_dups_size":0,"ondisk_log_size":3361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":0,"num_write":43355,"num_write_kb":562121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"32'9","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.251406+0000","last_change":"2024-05-08T21:10:03.333647+0000","last_active":"2024-05-08T21:19:53.251406+0000","last_peered":"2024-05-08T21:19:53.251406+0000","last_clean":"2024-05-08T21:19:53.251406+0000","last_became_active":"2024-05-08T21:10:03.332844+0000","last_became_peered":"2024-05-08T21:10:03.332844+0000","last_unstale":"2024-05-08T21:19:53.251406+0000","last_undegraded":"2024-05-08T21:19:53.251406+0000","last_fullsized":"2024-05-08T21:19:53.251406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:47:40.344808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"32'12","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.274723+0000","last_change":"2024-05-08T21:10:03.743003+0000","last_active":"2024-05-08T21:19:53.274723+0000","last_peered":"2024-05-08T21:19:53.274723+0000","last_clean":"2024-05-08T21:19:53.274723+0000","last_became_active":"2024-05-08T21:10:03.742753+0000","last_became_peered":"2024-05-08T21:10:03.742753+0000","last_unstale":"2024-05-08T21:19:53.274723+0000","last_undegraded":"2024-05-08T21:19:53.274723+0000","last_fullsized":"2024-05-08T21:19:53.274723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4240","reported_seq":4333,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.314466+0000","last_change":"2024-05-08T21:10:07.770105+0000","last_active":"2024-05-08T21:19:53.314466+0000","last_peered":"2024-05-08T21:19:53.314466+0000","last_clean":"2024-05-08T21:19:53.314466+0000","last_became_active":"2024-05-08T21:10:07.769668+0000","last_became_peered":"2024-05-08T21:10:07.769668+0000","last_unstale":"2024-05-08T21:19:53.314466+0000","last_undegraded":"2024-05-08T21:19:53.314466+0000","last_fullsized":"2024-05-08T21:19:53.314466+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4240,"log_dups_size":0,"ondisk_log_size":4240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:07:21.560031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":0,"num_write":54954,"num_write_kb":711961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"32'4","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.227516+0000","last_change":"2024-05-08T21:10:03.333025+0000","last_active":"2024-05-08T21:19:53.227516+0000","last_peered":"2024-05-08T21:19:53.227516+0000","last_clean":"2024-05-08T21:19:53.227516+0000","last_became_active":"2024-05-08T21:10:03.332750+0000","last_became_peered":"2024-05-08T21:10:03.332750+0000","last_unstale":"2024-05-08T21:19:53.227516+0000","last_undegraded":"2024-05-08T21:19:53.227516+0000","last_fullsized":"2024-05-08T21:19:53.227516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:20:50.134647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'19","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.317272+0000","last_change":"2024-05-08T21:10:03.744023+0000","last_active":"2024-05-08T21:19:53.317272+0000","last_peered":"2024-05-08T21:19:53.317272+0000","last_clean":"2024-05-08T21:19:53.317272+0000","last_became_active":"2024-05-08T21:10:03.743724+0000","last_became_peered":"2024-05-08T21:10:03.743724+0000","last_unstale":"2024-05-08T21:19:53.317272+0000","last_undegraded":"2024-05-08T21:19:53.317272+0000","last_fullsized":"2024-05-08T21:19:53.317272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:50:36.857245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"32'4835","reported_seq":4930,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.320320+0000","last_change":"2024-05-08T21:10:08.052307+0000","last_active":"2024-05-08T21:19:53.320320+0000","last_peered":"2024-05-08T21:19:53.320320+0000","last_clean":"2024-05-08T21:19:53.320320+0000","last_became_active":"2024-05-08T21:10:08.051924+0000","last_became_peered":"2024-05-08T21:10:08.051924+0000","last_unstale":"2024-05-08T21:19:53.320320+0000","last_undegraded":"2024-05-08T21:19:53.320320+0000","last_fullsized":"2024-05-08T21:19:53.320320+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4835,"log_dups_size":0,"ondisk_log_size":4835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":0,"num_write":62640,"num_write_kb":808641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:47.898646+0000","last_change":"2024-05-08T21:10:03.330304+0000","last_active":"2024-05-08T21:19:47.898646+0000","last_peered":"2024-05-08T21:19:47.898646+0000","last_clean":"2024-05-08T21:19:47.898646+0000","last_became_active":"2024-05-08T21:10:03.330054+0000","last_became_peered":"2024-05-08T21:10:03.330054+0000","last_unstale":"2024-05-08T21:19:47.898646+0000","last_undegraded":"2024-05-08T21:19:47.898646+0000","last_fullsized":"2024-05-08T21:19:47.898646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"32'9","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:55.648224+0000","last_change":"2024-05-08T21:10:03.739687+0000","last_active":"2024-05-08T21:19:55.648224+0000","last_peered":"2024-05-08T21:19:55.648224+0000","last_clean":"2024-05-08T21:19:55.648224+0000","last_became_active":"2024-05-08T21:10:03.739425+0000","last_became_peered":"2024-05-08T21:10:03.739425+0000","last_unstale":"2024-05-08T21:19:55.648224+0000","last_undegraded":"2024-05-08T21:19:55.648224+0000","last_fullsized":"2024-05-08T21:19:55.648224+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"32'4216","reported_seq":4296,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.194323+0000","last_change":"2024-05-08T21:10:08.050980+0000","last_active":"2024-05-08T21:19:53.194323+0000","last_peered":"2024-05-08T21:19:53.194323+0000","last_clean":"2024-05-08T21:19:53.194323+0000","last_became_active":"2024-05-08T21:10:08.050625+0000","last_became_peered":"2024-05-08T21:10:08.050625+0000","last_unstale":"2024-05-08T21:19:53.194323+0000","last_undegraded":"2024-05-08T21:19:53.194323+0000","last_fullsized":"2024-05-08T21:19:53.194323+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4216,"log_dups_size":0,"ondisk_log_size":4216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:39:43.917363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":0,"num_write":54049,"num_write_kb":693342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"32'4","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.090142+0000","last_change":"2024-05-08T21:10:03.331297+0000","last_active":"2024-05-08T21:19:53.090142+0000","last_peered":"2024-05-08T21:19:53.090142+0000","last_clean":"2024-05-08T21:19:53.090142+0000","last_became_active":"2024-05-08T21:10:03.330973+0000","last_became_peered":"2024-05-08T21:10:03.330973+0000","last_unstale":"2024-05-08T21:19:53.090142+0000","last_undegraded":"2024-05-08T21:19:53.090142+0000","last_fullsized":"2024-05-08T21:19:53.090142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:57:26.190186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"32'15","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.288908+0000","last_change":"2024-05-08T21:10:03.751746+0000","last_active":"2024-05-08T21:19:53.288908+0000","last_peered":"2024-05-08T21:19:53.288908+0000","last_clean":"2024-05-08T21:19:53.288908+0000","last_became_active":"2024-05-08T21:10:03.751426+0000","last_became_peered":"2024-05-08T21:10:03.751426+0000","last_unstale":"2024-05-08T21:19:53.288908+0000","last_undegraded":"2024-05-08T21:19:53.288908+0000","last_fullsized":"2024-05-08T21:19:53.288908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"32'4067","reported_seq":4160,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.193081+0000","last_change":"2024-05-08T21:10:53.484721+0000","last_active":"2024-05-08T21:19:53.193081+0000","last_peered":"2024-05-08T21:19:53.193081+0000","last_clean":"2024-05-08T21:19:53.193081+0000","last_became_active":"2024-05-08T21:10:53.484313+0000","last_became_peered":"2024-05-08T21:10:53.484313+0000","last_unstale":"2024-05-08T21:19:53.193081+0000","last_undegraded":"2024-05-08T21:19:53.193081+0000","last_fullsized":"2024-05-08T21:19:53.193081+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4067,"log_dups_size":0,"ondisk_log_size":4067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:20:10.055442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":0,"num_write":52779,"num_write_kb":673924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"32'3","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.186192+0000","last_change":"2024-05-08T21:10:03.332049+0000","last_active":"2024-05-08T21:19:53.186192+0000","last_peered":"2024-05-08T21:19:53.186192+0000","last_clean":"2024-05-08T21:19:53.186192+0000","last_became_active":"2024-05-08T21:10:03.331712+0000","last_became_peered":"2024-05-08T21:10:03.331712+0000","last_unstale":"2024-05-08T21:19:53.186192+0000","last_undegraded":"2024-05-08T21:19:53.186192+0000","last_fullsized":"2024-05-08T21:19:53.186192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"32'15","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.299906+0000","last_change":"2024-05-08T21:10:03.748728+0000","last_active":"2024-05-08T21:19:53.299906+0000","last_peered":"2024-05-08T21:19:53.299906+0000","last_clean":"2024-05-08T21:19:53.299906+0000","last_became_active":"2024-05-08T21:10:03.748315+0000","last_became_peered":"2024-05-08T21:10:03.748315+0000","last_unstale":"2024-05-08T21:19:53.299906+0000","last_undegraded":"2024-05-08T21:19:53.299906+0000","last_fullsized":"2024-05-08T21:19:53.299906+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"32'4209","reported_seq":4288,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.239173+0000","last_change":"2024-05-08T21:10:07.761559+0000","last_active":"2024-05-08T21:19:53.239173+0000","last_peered":"2024-05-08T21:19:53.239173+0000","last_clean":"2024-05-08T21:19:53.239173+0000","last_became_active":"2024-05-08T21:10:07.761129+0000","last_became_peered":"2024-05-08T21:10:07.761129+0000","last_unstale":"2024-05-08T21:19:53.239173+0000","last_undegraded":"2024-05-08T21:19:53.239173+0000","last_fullsized":"2024-05-08T21:19:53.239173+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4209,"log_dups_size":0,"ondisk_log_size":4209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:29:03.444853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":0,"num_write":55217,"num_write_kb":706687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"32'18","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.890229+0000","last_change":"2024-05-08T21:10:03.333077+0000","last_active":"2024-05-08T21:19:53.890229+0000","last_peered":"2024-05-08T21:19:53.890229+0000","last_clean":"2024-05-08T21:19:53.890229+0000","last_became_active":"2024-05-08T21:10:03.332796+0000","last_became_peered":"2024-05-08T21:10:03.332796+0000","last_unstale":"2024-05-08T21:19:53.890229+0000","last_undegraded":"2024-05-08T21:19:53.890229+0000","last_fullsized":"2024-05-08T21:19:53.890229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":19,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"32'12","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.269045+0000","last_change":"2024-05-08T21:10:03.751370+0000","last_active":"2024-05-08T21:19:53.269045+0000","last_peered":"2024-05-08T21:19:53.269045+0000","last_clean":"2024-05-08T21:19:53.269045+0000","last_became_active":"2024-05-08T21:10:03.750394+0000","last_became_peered":"2024-05-08T21:10:03.750394+0000","last_unstale":"2024-05-08T21:19:53.269045+0000","last_undegraded":"2024-05-08T21:19:53.269045+0000","last_fullsized":"2024-05-08T21:19:53.269045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:31:06.682543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"32'3898","reported_seq":3963,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.185154+0000","last_change":"2024-05-08T21:10:07.764815+0000","last_active":"2024-05-08T21:19:53.185154+0000","last_peered":"2024-05-08T21:19:53.185154+0000","last_clean":"2024-05-08T21:19:53.185154+0000","last_became_active":"2024-05-08T21:10:07.763591+0000","last_became_peered":"2024-05-08T21:10:07.763591+0000","last_unstale":"2024-05-08T21:19:53.185154+0000","last_undegraded":"2024-05-08T21:19:53.185154+0000","last_fullsized":"2024-05-08T21:19:53.185154+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":3898,"log_dups_size":0,"ondisk_log_size":3898,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":0,"num_write":50159,"num_write_kb":657283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"32'220","reported_seq":265,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:52.980082+0000","last_change":"2024-05-08T21:10:03.342400+0000","last_active":"2024-05-08T21:19:52.980082+0000","last_peered":"2024-05-08T21:19:52.980082+0000","last_clean":"2024-05-08T21:19:52.980082+0000","last_became_active":"2024-05-08T21:10:03.342202+0000","last_became_peered":"2024-05-08T21:10:03.342202+0000","last_unstale":"2024-05-08T21:19:52.980082+0000","last_undegraded":"2024-05-08T21:19:52.980082+0000","last_fullsized":"2024-05-08T21:19:52.980082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:10:04.668029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":37,"num_read_kb":12328,"num_write":219,"num_write_kb":4276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"32'12","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:48.953073+0000","last_change":"2024-05-08T21:10:03.752144+0000","last_active":"2024-05-08T21:19:48.953073+0000","last_peered":"2024-05-08T21:19:48.953073+0000","last_clean":"2024-05-08T21:19:48.953073+0000","last_became_active":"2024-05-08T21:10:03.751868+0000","last_became_peered":"2024-05-08T21:10:03.751868+0000","last_unstale":"2024-05-08T21:19:48.953073+0000","last_undegraded":"2024-05-08T21:19:48.953073+0000","last_fullsized":"2024-05-08T21:19:48.953073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:40:43.168591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"32'3951","reported_seq":4026,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:52.932499+0000","last_change":"2024-05-08T21:10:08.052390+0000","last_active":"2024-05-08T21:19:52.932499+0000","last_peered":"2024-05-08T21:19:52.932499+0000","last_clean":"2024-05-08T21:19:52.932499+0000","last_became_active":"2024-05-08T21:10:08.051967+0000","last_became_peered":"2024-05-08T21:10:08.051967+0000","last_unstale":"2024-05-08T21:19:52.932499+0000","last_undegraded":"2024-05-08T21:19:52.932499+0000","last_fullsized":"2024-05-08T21:19:52.932499+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":3951,"log_dups_size":0,"ondisk_log_size":3951,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":0,"num_write":50192,"num_write_kb":654171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"32'7","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.214041+0000","last_change":"2024-05-08T21:10:03.330102+0000","last_active":"2024-05-08T21:19:53.214041+0000","last_peered":"2024-05-08T21:19:53.214041+0000","last_clean":"2024-05-08T21:19:53.214041+0000","last_became_active":"2024-05-08T21:10:03.329761+0000","last_became_peered":"2024-05-08T21:10:03.329761+0000","last_unstale":"2024-05-08T21:19:53.214041+0000","last_undegraded":"2024-05-08T21:19:53.214041+0000","last_fullsized":"2024-05-08T21:19:53.214041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":32,"num_write":6,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"32'15","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.080942+0000","last_change":"2024-05-08T21:10:03.749332+0000","last_active":"2024-05-08T21:19:53.080942+0000","last_peered":"2024-05-08T21:19:53.080942+0000","last_clean":"2024-05-08T21:19:53.080942+0000","last_became_active":"2024-05-08T21:10:03.749094+0000","last_became_peered":"2024-05-08T21:10:03.749094+0000","last_unstale":"2024-05-08T21:19:53.080942+0000","last_undegraded":"2024-05-08T21:19:53.080942+0000","last_fullsized":"2024-05-08T21:19:53.080942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"32'4387","reported_seq":4464,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.310953+0000","last_change":"2024-05-08T21:10:08.048331+0000","last_active":"2024-05-08T21:19:53.310953+0000","last_peered":"2024-05-08T21:19:53.310953+0000","last_clean":"2024-05-08T21:19:53.310953+0000","last_became_active":"2024-05-08T21:10:08.047505+0000","last_became_peered":"2024-05-08T21:10:08.047505+0000","last_unstale":"2024-05-08T21:19:53.310953+0000","last_undegraded":"2024-05-08T21:19:53.310953+0000","last_fullsized":"2024-05-08T21:19:53.310953+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4387,"log_dups_size":0,"ondisk_log_size":4387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:18:39.268730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":0,"num_write":56798,"num_write_kb":743616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"32'3","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.303802+0000","last_change":"2024-05-08T21:10:03.328021+0000","last_active":"2024-05-08T21:19:53.303802+0000","last_peered":"2024-05-08T21:19:53.303802+0000","last_clean":"2024-05-08T21:19:53.303802+0000","last_became_active":"2024-05-08T21:10:03.327648+0000","last_became_peered":"2024-05-08T21:10:03.327648+0000","last_unstale":"2024-05-08T21:19:53.303802+0000","last_undegraded":"2024-05-08T21:19:53.303802+0000","last_fullsized":"2024-05-08T21:19:53.303802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"32'15","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.194309+0000","last_change":"2024-05-08T21:10:03.750560+0000","last_active":"2024-05-08T21:19:53.194309+0000","last_peered":"2024-05-08T21:19:53.194309+0000","last_clean":"2024-05-08T21:19:53.194309+0000","last_became_active":"2024-05-08T21:10:03.750294+0000","last_became_peered":"2024-05-08T21:10:03.750294+0000","last_unstale":"2024-05-08T21:19:53.194309+0000","last_undegraded":"2024-05-08T21:19:53.194309+0000","last_fullsized":"2024-05-08T21:19:53.194309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:30:47.937326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"32'4344","reported_seq":4416,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.277366+0000","last_change":"2024-05-08T21:10:08.052318+0000","last_active":"2024-05-08T21:19:53.277366+0000","last_peered":"2024-05-08T21:19:53.277366+0000","last_clean":"2024-05-08T21:19:53.277366+0000","last_became_active":"2024-05-08T21:10:08.051920+0000","last_became_peered":"2024-05-08T21:10:08.051920+0000","last_unstale":"2024-05-08T21:19:53.277366+0000","last_undegraded":"2024-05-08T21:19:53.277366+0000","last_fullsized":"2024-05-08T21:19:53.277366+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4344,"log_dups_size":0,"ondisk_log_size":4344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:25:27.669768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":0,"num_write":56474,"num_write_kb":728506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"32'7","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.148310+0000","last_change":"2024-05-08T21:10:03.332390+0000","last_active":"2024-05-08T21:19:53.148310+0000","last_peered":"2024-05-08T21:19:53.148310+0000","last_clean":"2024-05-08T21:19:53.148310+0000","last_became_active":"2024-05-08T21:10:03.332105+0000","last_became_peered":"2024-05-08T21:10:03.332105+0000","last_unstale":"2024-05-08T21:19:53.148310+0000","last_undegraded":"2024-05-08T21:19:53.148310+0000","last_fullsized":"2024-05-08T21:19:53.148310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:32:44.705682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"32'9","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:43.859053+0000","last_change":"2024-05-08T21:10:03.742100+0000","last_active":"2024-05-08T21:19:43.859053+0000","last_peered":"2024-05-08T21:19:43.859053+0000","last_clean":"2024-05-08T21:19:43.859053+0000","last_became_active":"2024-05-08T21:10:03.741742+0000","last_became_peered":"2024-05-08T21:10:03.741742+0000","last_unstale":"2024-05-08T21:19:43.859053+0000","last_undegraded":"2024-05-08T21:19:43.859053+0000","last_fullsized":"2024-05-08T21:19:43.859053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:53:19.394126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"32'4473","reported_seq":4564,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.317634+0000","last_change":"2024-05-08T21:10:07.769850+0000","last_active":"2024-05-08T21:19:53.317634+0000","last_peered":"2024-05-08T21:19:53.317634+0000","last_clean":"2024-05-08T21:19:53.317634+0000","last_became_active":"2024-05-08T21:10:07.769016+0000","last_became_peered":"2024-05-08T21:10:07.769016+0000","last_unstale":"2024-05-08T21:19:53.317634+0000","last_undegraded":"2024-05-08T21:19:53.317634+0000","last_fullsized":"2024-05-08T21:19:53.317634+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4473,"log_dups_size":0,"ondisk_log_size":4473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":0,"num_write":57758,"num_write_kb":734684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"32'16","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.310231+0000","last_change":"2024-05-08T21:10:03.331783+0000","last_active":"2024-05-08T21:19:53.310231+0000","last_peered":"2024-05-08T21:19:53.310231+0000","last_clean":"2024-05-08T21:19:53.310231+0000","last_became_active":"2024-05-08T21:10:03.331501+0000","last_became_peered":"2024-05-08T21:10:03.331501+0000","last_unstale":"2024-05-08T21:19:53.310231+0000","last_undegraded":"2024-05-08T21:19:53.310231+0000","last_fullsized":"2024-05-08T21:19:53.310231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":69,"num_read_kb":69,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"32'12","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.016108+0000","last_change":"2024-05-08T21:10:03.744007+0000","last_active":"2024-05-08T21:19:53.016108+0000","last_peered":"2024-05-08T21:19:53.016108+0000","last_clean":"2024-05-08T21:19:53.016108+0000","last_became_active":"2024-05-08T21:10:03.743557+0000","last_became_peered":"2024-05-08T21:10:03.743557+0000","last_unstale":"2024-05-08T21:19:53.016108+0000","last_undegraded":"2024-05-08T21:19:53.016108+0000","last_fullsized":"2024-05-08T21:19:53.016108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:45:26.458377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"32'3690","reported_seq":3766,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.196563+0000","last_change":"2024-05-08T21:10:07.777283+0000","last_active":"2024-05-08T21:19:53.196563+0000","last_peered":"2024-05-08T21:19:53.196563+0000","last_clean":"2024-05-08T21:19:53.196563+0000","last_became_active":"2024-05-08T21:10:07.776858+0000","last_became_peered":"2024-05-08T21:10:07.776858+0000","last_unstale":"2024-05-08T21:19:53.196563+0000","last_undegraded":"2024-05-08T21:19:53.196563+0000","last_fullsized":"2024-05-08T21:19:53.196563+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":3690,"log_dups_size":0,"ondisk_log_size":3690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:51.725885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":0,"num_write":47426,"num_write_kb":636696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"32'4","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.177820+0000","last_change":"2024-05-08T21:10:03.326892+0000","last_active":"2024-05-08T21:19:53.177820+0000","last_peered":"2024-05-08T21:19:53.177820+0000","last_clean":"2024-05-08T21:19:53.177820+0000","last_became_active":"2024-05-08T21:10:03.326608+0000","last_became_peered":"2024-05-08T21:10:03.326608+0000","last_unstale":"2024-05-08T21:19:53.177820+0000","last_undegraded":"2024-05-08T21:19:53.177820+0000","last_fullsized":"2024-05-08T21:19:53.177820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:01:33.441985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"32'8","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.195427+0000","last_change":"2024-05-08T21:10:03.749221+0000","last_active":"2024-05-08T21:19:53.195427+0000","last_peered":"2024-05-08T21:19:53.195427+0000","last_clean":"2024-05-08T21:19:53.195427+0000","last_became_active":"2024-05-08T21:10:03.748915+0000","last_became_peered":"2024-05-08T21:10:03.748915+0000","last_unstale":"2024-05-08T21:19:53.195427+0000","last_undegraded":"2024-05-08T21:19:53.195427+0000","last_fullsized":"2024-05-08T21:19:53.195427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:03:10.791535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"32'4727","reported_seq":4821,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.296347+0000","last_change":"2024-05-08T21:10:07.759492+0000","last_active":"2024-05-08T21:19:53.296347+0000","last_peered":"2024-05-08T21:19:53.296347+0000","last_clean":"2024-05-08T21:19:53.296347+0000","last_became_active":"2024-05-08T21:10:07.759139+0000","last_became_peered":"2024-05-08T21:10:07.759139+0000","last_unstale":"2024-05-08T21:19:53.296347+0000","last_undegraded":"2024-05-08T21:19:53.296347+0000","last_fullsized":"2024-05-08T21:19:53.296347+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4727,"log_dups_size":0,"ondisk_log_size":4727,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":0,"num_write":61813,"num_write_kb":787262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"32'3","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.230047+0000","last_change":"2024-05-08T21:10:03.329020+0000","last_active":"2024-05-08T21:19:53.230047+0000","last_peered":"2024-05-08T21:19:53.230047+0000","last_clean":"2024-05-08T21:19:53.230047+0000","last_became_active":"2024-05-08T21:10:03.328739+0000","last_became_peered":"2024-05-08T21:10:03.328739+0000","last_unstale":"2024-05-08T21:19:53.230047+0000","last_undegraded":"2024-05-08T21:19:53.230047+0000","last_fullsized":"2024-05-08T21:19:53.230047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"32'13","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.259451+0000","last_change":"2024-05-08T21:10:03.744662+0000","last_active":"2024-05-08T21:19:53.259451+0000","last_peered":"2024-05-08T21:19:53.259451+0000","last_clean":"2024-05-08T21:19:53.259451+0000","last_became_active":"2024-05-08T21:10:03.744398+0000","last_became_peered":"2024-05-08T21:10:03.744398+0000","last_unstale":"2024-05-08T21:19:53.259451+0000","last_undegraded":"2024-05-08T21:19:53.259451+0000","last_fullsized":"2024-05-08T21:19:53.259451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"32'4127","reported_seq":4198,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.216672+0000","last_change":"2024-05-08T21:10:07.776566+0000","last_active":"2024-05-08T21:19:53.216672+0000","last_peered":"2024-05-08T21:19:53.216672+0000","last_clean":"2024-05-08T21:19:53.216672+0000","last_became_active":"2024-05-08T21:10:07.776080+0000","last_became_peered":"2024-05-08T21:10:07.776080+0000","last_unstale":"2024-05-08T21:19:53.216672+0000","last_undegraded":"2024-05-08T21:19:53.216672+0000","last_fullsized":"2024-05-08T21:19:53.216672+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4127,"log_dups_size":0,"ondisk_log_size":4127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":0,"num_write":53759,"num_write_kb":696170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.335395+0000","last_change":"2024-05-08T21:10:03.332953+0000","last_active":"2024-05-08T21:19:06.335395+0000","last_peered":"2024-05-08T21:19:06.335395+0000","last_clean":"2024-05-08T21:19:06.335395+0000","last_became_active":"2024-05-08T21:10:03.332689+0000","last_became_peered":"2024-05-08T21:10:03.332689+0000","last_unstale":"2024-05-08T21:19:06.335395+0000","last_undegraded":"2024-05-08T21:19:06.335395+0000","last_fullsized":"2024-05-08T21:19:06.335395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"32'9","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:50.777192+0000","last_change":"2024-05-08T21:10:03.745651+0000","last_active":"2024-05-08T21:19:50.777192+0000","last_peered":"2024-05-08T21:19:50.777192+0000","last_clean":"2024-05-08T21:19:50.777192+0000","last_became_active":"2024-05-08T21:10:03.742744+0000","last_became_peered":"2024-05-08T21:10:03.742744+0000","last_unstale":"2024-05-08T21:19:50.777192+0000","last_undegraded":"2024-05-08T21:19:50.777192+0000","last_fullsized":"2024-05-08T21:19:50.777192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:32:31.689490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"32'4649","reported_seq":4740,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.286527+0000","last_change":"2024-05-08T21:10:07.776527+0000","last_active":"2024-05-08T21:19:53.286527+0000","last_peered":"2024-05-08T21:19:53.286527+0000","last_clean":"2024-05-08T21:19:53.286527+0000","last_became_active":"2024-05-08T21:10:07.776053+0000","last_became_peered":"2024-05-08T21:10:07.776053+0000","last_unstale":"2024-05-08T21:19:53.286527+0000","last_undegraded":"2024-05-08T21:19:53.286527+0000","last_fullsized":"2024-05-08T21:19:53.286527+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4649,"log_dups_size":0,"ondisk_log_size":4649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":0,"num_write":59828,"num_write_kb":758247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"32'13","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.263619+0000","last_change":"2024-05-08T21:10:03.738421+0000","last_active":"2024-05-08T21:19:53.263619+0000","last_peered":"2024-05-08T21:19:53.263619+0000","last_clean":"2024-05-08T21:19:53.263619+0000","last_became_active":"2024-05-08T21:10:03.738000+0000","last_became_peered":"2024-05-08T21:10:03.738000+0000","last_unstale":"2024-05-08T21:19:53.263619+0000","last_undegraded":"2024-05-08T21:19:53.263619+0000","last_fullsized":"2024-05-08T21:19:53.263619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"32'27","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.197969+0000","last_change":"2024-05-08T21:10:03.331141+0000","last_active":"2024-05-08T21:19:53.197969+0000","last_peered":"2024-05-08T21:19:53.197969+0000","last_clean":"2024-05-08T21:19:53.197969+0000","last_became_active":"2024-05-08T21:10:03.330842+0000","last_became_peered":"2024-05-08T21:10:03.330842+0000","last_unstale":"2024-05-08T21:19:53.197969+0000","last_undegraded":"2024-05-08T21:19:53.197969+0000","last_fullsized":"2024-05-08T21:19:53.197969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94059,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":26,"num_read_kb":107,"num_write":23,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"32'4123","reported_seq":4201,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.288008+0000","last_change":"2024-05-08T21:10:08.049274+0000","last_active":"2024-05-08T21:19:53.288008+0000","last_peered":"2024-05-08T21:19:53.288008+0000","last_clean":"2024-05-08T21:19:53.288008+0000","last_became_active":"2024-05-08T21:10:08.048763+0000","last_became_peered":"2024-05-08T21:10:08.048763+0000","last_unstale":"2024-05-08T21:19:53.288008+0000","last_undegraded":"2024-05-08T21:19:53.288008+0000","last_fullsized":"2024-05-08T21:19:53.288008+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4123,"log_dups_size":0,"ondisk_log_size":4123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:00:41.257040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":0,"num_write":53637,"num_write_kb":684025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"32'8","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:46.700801+0000","last_change":"2024-05-08T21:10:03.747594+0000","last_active":"2024-05-08T21:19:46.700801+0000","last_peered":"2024-05-08T21:19:46.700801+0000","last_clean":"2024-05-08T21:19:46.700801+0000","last_became_active":"2024-05-08T21:10:03.747360+0000","last_became_peered":"2024-05-08T21:10:03.747360+0000","last_unstale":"2024-05-08T21:19:46.700801+0000","last_undegraded":"2024-05-08T21:19:46.700801+0000","last_fullsized":"2024-05-08T21:19:46.700801+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:31:12.357348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"32'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.118979+0000","last_change":"2024-05-08T21:10:03.327847+0000","last_active":"2024-05-08T21:19:53.118979+0000","last_peered":"2024-05-08T21:19:53.118979+0000","last_clean":"2024-05-08T21:19:53.118979+0000","last_became_active":"2024-05-08T21:10:03.327530+0000","last_became_peered":"2024-05-08T21:10:03.327530+0000","last_unstale":"2024-05-08T21:19:53.118979+0000","last_undegraded":"2024-05-08T21:19:53.118979+0000","last_fullsized":"2024-05-08T21:19:53.118979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T21:18:03.705532+0000","last_change":"2024-05-08T21:09:59.333990+0000","last_active":"2024-05-08T21:18:03.705532+0000","last_peered":"2024-05-08T21:18:03.705532+0000","last_clean":"2024-05-08T21:18:03.705532+0000","last_became_active":"2024-05-08T21:09:59.332929+0000","last_became_peered":"2024-05-08T21:09:59.332929+0000","last_unstale":"2024-05-08T21:18:03.705532+0000","last_undegraded":"2024-05-08T21:18:03.705532+0000","last_fullsized":"2024-05-08T21:18:03.705532+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:09:58.287675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:09:58.287675+0000","last_clean_scrub_stamp":"2024-05-08T21:09:58.287675+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:47.595380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"32'3586","reported_seq":3655,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.225218+0000","last_change":"2024-05-08T21:10:08.049848+0000","last_active":"2024-05-08T21:19:53.225218+0000","last_peered":"2024-05-08T21:19:53.225218+0000","last_clean":"2024-05-08T21:19:53.225218+0000","last_became_active":"2024-05-08T21:10:08.049153+0000","last_became_peered":"2024-05-08T21:10:08.049153+0000","last_unstale":"2024-05-08T21:19:53.225218+0000","last_undegraded":"2024-05-08T21:19:53.225218+0000","last_fullsized":"2024-05-08T21:19:53.225218+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":3586,"log_dups_size":0,"ondisk_log_size":3586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":0,"num_write":45747,"num_write_kb":586385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"32'6","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.081282+0000","last_change":"2024-05-08T21:10:03.743094+0000","last_active":"2024-05-08T21:19:53.081282+0000","last_peered":"2024-05-08T21:19:53.081282+0000","last_clean":"2024-05-08T21:19:53.081282+0000","last_became_active":"2024-05-08T21:10:03.742819+0000","last_became_peered":"2024-05-08T21:10:03.742819+0000","last_unstale":"2024-05-08T21:19:53.081282+0000","last_undegraded":"2024-05-08T21:19:53.081282+0000","last_fullsized":"2024-05-08T21:19:53.081282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"32'8","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.199352+0000","last_change":"2024-05-08T21:10:03.340259+0000","last_active":"2024-05-08T21:19:53.199352+0000","last_peered":"2024-05-08T21:19:53.199352+0000","last_clean":"2024-05-08T21:19:53.199352+0000","last_became_active":"2024-05-08T21:10:03.339957+0000","last_became_peered":"2024-05-08T21:10:03.339957+0000","last_unstale":"2024-05-08T21:19:53.199352+0000","last_undegraded":"2024-05-08T21:19:53.199352+0000","last_fullsized":"2024-05-08T21:19:53.199352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:38:36.535689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"32'3621","reported_seq":3686,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.171132+0000","last_change":"2024-05-08T21:10:08.050370+0000","last_active":"2024-05-08T21:19:53.171132+0000","last_peered":"2024-05-08T21:19:53.171132+0000","last_clean":"2024-05-08T21:19:53.171132+0000","last_became_active":"2024-05-08T21:10:08.049962+0000","last_became_peered":"2024-05-08T21:10:08.049962+0000","last_unstale":"2024-05-08T21:19:53.171132+0000","last_undegraded":"2024-05-08T21:19:53.171132+0000","last_fullsized":"2024-05-08T21:19:53.171132+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":3621,"log_dups_size":0,"ondisk_log_size":3621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":0,"num_write":47664,"num_write_kb":629817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"32'2","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.752247+0000","last_change":"2024-05-08T21:10:03.337949+0000","last_active":"2024-05-08T21:19:06.752247+0000","last_peered":"2024-05-08T21:19:06.752247+0000","last_clean":"2024-05-08T21:19:06.752247+0000","last_became_active":"2024-05-08T21:10:03.337627+0000","last_became_peered":"2024-05-08T21:10:03.337627+0000","last_unstale":"2024-05-08T21:19:06.752247+0000","last_undegraded":"2024-05-08T21:19:06.752247+0000","last_fullsized":"2024-05-08T21:19:06.752247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:17:36.792731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"32'10","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.204740+0000","last_change":"2024-05-08T21:10:03.738212+0000","last_active":"2024-05-08T21:19:53.204740+0000","last_peered":"2024-05-08T21:19:53.204740+0000","last_clean":"2024-05-08T21:19:53.204740+0000","last_became_active":"2024-05-08T21:10:03.737927+0000","last_became_peered":"2024-05-08T21:10:03.737927+0000","last_unstale":"2024-05-08T21:19:53.204740+0000","last_undegraded":"2024-05-08T21:19:53.204740+0000","last_fullsized":"2024-05-08T21:19:53.204740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"32'4719","reported_seq":4815,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.214915+0000","last_change":"2024-05-08T21:10:08.052270+0000","last_active":"2024-05-08T21:19:53.214915+0000","last_peered":"2024-05-08T21:19:53.214915+0000","last_clean":"2024-05-08T21:19:53.214915+0000","last_became_active":"2024-05-08T21:10:08.051881+0000","last_became_peered":"2024-05-08T21:10:08.051881+0000","last_unstale":"2024-05-08T21:19:53.214915+0000","last_undegraded":"2024-05-08T21:19:53.214915+0000","last_fullsized":"2024-05-08T21:19:53.214915+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4719,"log_dups_size":0,"ondisk_log_size":4719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:39:07.929942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":0,"num_write":60705,"num_write_kb":757240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"32'69","reported_seq":99,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.166450+0000","last_change":"2024-05-08T21:10:03.333696+0000","last_active":"2024-05-08T21:19:53.166450+0000","last_peered":"2024-05-08T21:19:53.166450+0000","last_clean":"2024-05-08T21:19:53.166450+0000","last_became_active":"2024-05-08T21:10:03.333368+0000","last_became_peered":"2024-05-08T21:10:03.333368+0000","last_unstale":"2024-05-08T21:19:53.166450+0000","last_undegraded":"2024-05-08T21:19:53.166450+0000","last_fullsized":"2024-05-08T21:19:53.166450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":34,"num_write":151,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"32'12","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.051848+0000","last_change":"2024-05-08T21:10:03.752578+0000","last_active":"2024-05-08T21:19:53.051848+0000","last_peered":"2024-05-08T21:19:53.051848+0000","last_clean":"2024-05-08T21:19:53.051848+0000","last_became_active":"2024-05-08T21:10:03.752389+0000","last_became_peered":"2024-05-08T21:10:03.752389+0000","last_unstale":"2024-05-08T21:19:53.051848+0000","last_undegraded":"2024-05-08T21:19:53.051848+0000","last_fullsized":"2024-05-08T21:19:53.051848+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:54:02.318162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"32'3951","reported_seq":4018,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.046094+0000","last_change":"2024-05-08T21:10:08.048081+0000","last_active":"2024-05-08T21:19:53.046094+0000","last_peered":"2024-05-08T21:19:53.046094+0000","last_clean":"2024-05-08T21:19:53.046094+0000","last_became_active":"2024-05-08T21:10:08.047632+0000","last_became_peered":"2024-05-08T21:10:08.047632+0000","last_unstale":"2024-05-08T21:19:53.046094+0000","last_undegraded":"2024-05-08T21:19:53.046094+0000","last_fullsized":"2024-05-08T21:19:53.046094+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":3951,"log_dups_size":0,"ondisk_log_size":3951,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:26:05.857718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":0,"num_write":51572,"num_write_kb":672103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"32'8","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.238294+0000","last_change":"2024-05-08T21:10:03.340553+0000","last_active":"2024-05-08T21:19:53.238294+0000","last_peered":"2024-05-08T21:19:53.238294+0000","last_clean":"2024-05-08T21:19:53.238294+0000","last_became_active":"2024-05-08T21:10:03.340280+0000","last_became_peered":"2024-05-08T21:10:03.340280+0000","last_unstale":"2024-05-08T21:19:53.238294+0000","last_undegraded":"2024-05-08T21:19:53.238294+0000","last_fullsized":"2024-05-08T21:19:53.238294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:36:24.866220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"32'18","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.095227+0000","last_change":"2024-05-08T21:10:03.736316+0000","last_active":"2024-05-08T21:19:53.095227+0000","last_peered":"2024-05-08T21:19:53.095227+0000","last_clean":"2024-05-08T21:19:53.095227+0000","last_became_active":"2024-05-08T21:10:03.736049+0000","last_became_peered":"2024-05-08T21:10:03.736049+0000","last_unstale":"2024-05-08T21:19:53.095227+0000","last_undegraded":"2024-05-08T21:19:53.095227+0000","last_fullsized":"2024-05-08T21:19:53.095227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'3546","reported_seq":3633,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.288399+0000","last_change":"2024-05-08T21:10:53.484914+0000","last_active":"2024-05-08T21:19:53.288399+0000","last_peered":"2024-05-08T21:19:53.288399+0000","last_clean":"2024-05-08T21:19:53.288399+0000","last_became_active":"2024-05-08T21:10:53.484443+0000","last_became_peered":"2024-05-08T21:10:53.484443+0000","last_unstale":"2024-05-08T21:19:53.288399+0000","last_undegraded":"2024-05-08T21:19:53.288399+0000","last_fullsized":"2024-05-08T21:19:53.288399+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":3546,"log_dups_size":0,"ondisk_log_size":3546,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:09:00.867177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":0,"num_write":45468,"num_write_kb":601547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"32'2","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:52.994526+0000","last_change":"2024-05-08T21:10:03.340078+0000","last_active":"2024-05-08T21:19:52.994526+0000","last_peered":"2024-05-08T21:19:52.994526+0000","last_clean":"2024-05-08T21:19:52.994526+0000","last_became_active":"2024-05-08T21:10:03.339690+0000","last_became_peered":"2024-05-08T21:10:03.339690+0000","last_unstale":"2024-05-08T21:19:52.994526+0000","last_undegraded":"2024-05-08T21:19:52.994526+0000","last_fullsized":"2024-05-08T21:19:52.994526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:01:33.991878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"32'9","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.043264+0000","last_change":"2024-05-08T21:10:03.744606+0000","last_active":"2024-05-08T21:19:53.043264+0000","last_peered":"2024-05-08T21:19:53.043264+0000","last_clean":"2024-05-08T21:19:53.043264+0000","last_became_active":"2024-05-08T21:10:03.744160+0000","last_became_peered":"2024-05-08T21:10:03.744160+0000","last_unstale":"2024-05-08T21:19:53.043264+0000","last_undegraded":"2024-05-08T21:19:53.043264+0000","last_fullsized":"2024-05-08T21:19:53.043264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:10:25.144058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'5130","reported_seq":5225,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.247899+0000","last_change":"2024-05-08T21:10:08.049224+0000","last_active":"2024-05-08T21:19:53.247899+0000","last_peered":"2024-05-08T21:19:53.247899+0000","last_clean":"2024-05-08T21:19:53.247899+0000","last_became_active":"2024-05-08T21:10:08.048866+0000","last_became_peered":"2024-05-08T21:10:08.048866+0000","last_unstale":"2024-05-08T21:19:53.247899+0000","last_undegraded":"2024-05-08T21:19:53.247899+0000","last_fullsized":"2024-05-08T21:19:53.247899+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":5130,"log_dups_size":0,"ondisk_log_size":5130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":0,"num_write":66101,"num_write_kb":843075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"32'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.187871+0000","last_change":"2024-05-08T21:10:03.339344+0000","last_active":"2024-05-08T21:19:53.187871+0000","last_peered":"2024-05-08T21:19:53.187871+0000","last_clean":"2024-05-08T21:19:53.187871+0000","last_became_active":"2024-05-08T21:10:03.339136+0000","last_became_peered":"2024-05-08T21:10:03.339136+0000","last_unstale":"2024-05-08T21:19:53.187871+0000","last_undegraded":"2024-05-08T21:19:53.187871+0000","last_fullsized":"2024-05-08T21:19:53.187871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"32'9","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:06.753228+0000","last_change":"2024-05-08T21:10:03.737684+0000","last_active":"2024-05-08T21:19:06.753228+0000","last_peered":"2024-05-08T21:19:06.753228+0000","last_clean":"2024-05-08T21:19:06.753228+0000","last_became_active":"2024-05-08T21:10:03.737459+0000","last_became_peered":"2024-05-08T21:10:03.737459+0000","last_unstale":"2024-05-08T21:19:06.753228+0000","last_undegraded":"2024-05-08T21:19:06.753228+0000","last_fullsized":"2024-05-08T21:19:06.753228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:39.662018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"32'4248","reported_seq":4323,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.278075+0000","last_change":"2024-05-08T21:10:07.776483+0000","last_active":"2024-05-08T21:19:53.278075+0000","last_peered":"2024-05-08T21:19:53.278075+0000","last_clean":"2024-05-08T21:19:53.278075+0000","last_became_active":"2024-05-08T21:10:07.775956+0000","last_became_peered":"2024-05-08T21:10:07.775956+0000","last_unstale":"2024-05-08T21:19:53.278075+0000","last_undegraded":"2024-05-08T21:19:53.278075+0000","last_fullsized":"2024-05-08T21:19:53.278075+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4248,"log_dups_size":0,"ondisk_log_size":4248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:28:17.332488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":0,"num_write":55084,"num_write_kb":703369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"32'3","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.254231+0000","last_change":"2024-05-08T21:10:03.331695+0000","last_active":"2024-05-08T21:19:53.254231+0000","last_peered":"2024-05-08T21:19:53.254231+0000","last_clean":"2024-05-08T21:19:53.254231+0000","last_became_active":"2024-05-08T21:10:03.331198+0000","last_became_peered":"2024-05-08T21:10:03.331198+0000","last_unstale":"2024-05-08T21:19:53.254231+0000","last_undegraded":"2024-05-08T21:19:53.254231+0000","last_fullsized":"2024-05-08T21:19:53.254231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"32'11","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.054487+0000","last_change":"2024-05-08T21:10:03.744562+0000","last_active":"2024-05-08T21:19:53.054487+0000","last_peered":"2024-05-08T21:19:53.054487+0000","last_clean":"2024-05-08T21:19:53.054487+0000","last_became_active":"2024-05-08T21:10:03.744326+0000","last_became_peered":"2024-05-08T21:10:03.744326+0000","last_unstale":"2024-05-08T21:19:53.054487+0000","last_undegraded":"2024-05-08T21:19:53.054487+0000","last_fullsized":"2024-05-08T21:19:53.054487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:21:52.947209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'4119","reported_seq":4195,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.308053+0000","last_change":"2024-05-08T21:10:07.763204+0000","last_active":"2024-05-08T21:19:53.308053+0000","last_peered":"2024-05-08T21:19:53.308053+0000","last_clean":"2024-05-08T21:19:53.308053+0000","last_became_active":"2024-05-08T21:10:07.762886+0000","last_became_peered":"2024-05-08T21:10:07.762886+0000","last_unstale":"2024-05-08T21:19:53.308053+0000","last_undegraded":"2024-05-08T21:19:53.308053+0000","last_fullsized":"2024-05-08T21:19:53.308053+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4119,"log_dups_size":0,"ondisk_log_size":4119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:01.599700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":0,"num_write":53672,"num_write_kb":692300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"32'675","reported_seq":709,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.194386+0000","last_change":"2024-05-08T21:10:03.337993+0000","last_active":"2024-05-08T21:19:53.194386+0000","last_peered":"2024-05-08T21:19:53.194386+0000","last_clean":"2024-05-08T21:19:53.194386+0000","last_became_active":"2024-05-08T21:10:03.337654+0000","last_became_peered":"2024-05-08T21:10:03.337654+0000","last_unstale":"2024-05-08T21:19:53.194386+0000","last_undegraded":"2024-05-08T21:19:53.194386+0000","last_fullsized":"2024-05-08T21:19:53.194386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":675,"log_dups_size":0,"ondisk_log_size":675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:23:20.536178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":9261,"num_write":668,"num_write_kb":4529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"32'11","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.216679+0000","last_change":"2024-05-08T21:10:03.744871+0000","last_active":"2024-05-08T21:19:53.216679+0000","last_peered":"2024-05-08T21:19:53.216679+0000","last_clean":"2024-05-08T21:19:53.216679+0000","last_became_active":"2024-05-08T21:10:03.744589+0000","last_became_peered":"2024-05-08T21:10:03.744589+0000","last_unstale":"2024-05-08T21:19:53.216679+0000","last_undegraded":"2024-05-08T21:19:53.216679+0000","last_fullsized":"2024-05-08T21:19:53.216679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:41.090204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"32'4008","reported_seq":4078,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.222129+0000","last_change":"2024-05-08T21:10:08.047735+0000","last_active":"2024-05-08T21:19:53.222129+0000","last_peered":"2024-05-08T21:19:53.222129+0000","last_clean":"2024-05-08T21:19:53.222129+0000","last_became_active":"2024-05-08T21:10:08.047331+0000","last_became_peered":"2024-05-08T21:10:08.047331+0000","last_unstale":"2024-05-08T21:19:53.222129+0000","last_undegraded":"2024-05-08T21:19:53.222129+0000","last_fullsized":"2024-05-08T21:19:53.222129+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4008,"log_dups_size":0,"ondisk_log_size":4008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:44:22.797154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":0,"num_write":52621,"num_write_kb":688417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"32'5","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.246721+0000","last_change":"2024-05-08T21:10:03.333117+0000","last_active":"2024-05-08T21:19:53.246721+0000","last_peered":"2024-05-08T21:19:53.246721+0000","last_clean":"2024-05-08T21:19:53.246721+0000","last_became_active":"2024-05-08T21:10:03.332790+0000","last_became_peered":"2024-05-08T21:10:03.332790+0000","last_unstale":"2024-05-08T21:19:53.246721+0000","last_undegraded":"2024-05-08T21:19:53.246721+0000","last_fullsized":"2024-05-08T21:19:53.246721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'15","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.286888+0000","last_change":"2024-05-08T21:10:03.748047+0000","last_active":"2024-05-08T21:19:53.286888+0000","last_peered":"2024-05-08T21:19:53.286888+0000","last_clean":"2024-05-08T21:19:53.286888+0000","last_became_active":"2024-05-08T21:10:03.747759+0000","last_became_peered":"2024-05-08T21:10:03.747759+0000","last_unstale":"2024-05-08T21:19:53.286888+0000","last_undegraded":"2024-05-08T21:19:53.286888+0000","last_fullsized":"2024-05-08T21:19:53.286888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:11:05.309278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"32'3793","reported_seq":3873,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.314599+0000","last_change":"2024-05-08T21:10:07.761000+0000","last_active":"2024-05-08T21:19:53.314599+0000","last_peered":"2024-05-08T21:19:53.314599+0000","last_clean":"2024-05-08T21:19:53.314599+0000","last_became_active":"2024-05-08T21:10:07.760566+0000","last_became_peered":"2024-05-08T21:10:07.760566+0000","last_unstale":"2024-05-08T21:19:53.314599+0000","last_undegraded":"2024-05-08T21:19:53.314599+0000","last_fullsized":"2024-05-08T21:19:53.314599+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":3793,"log_dups_size":0,"ondisk_log_size":3793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":0,"num_write":48645,"num_write_kb":636437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"32'2","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.242140+0000","last_change":"2024-05-08T21:10:03.331358+0000","last_active":"2024-05-08T21:19:53.242140+0000","last_peered":"2024-05-08T21:19:53.242140+0000","last_clean":"2024-05-08T21:19:53.242140+0000","last_became_active":"2024-05-08T21:10:03.331028+0000","last_became_peered":"2024-05-08T21:10:03.331028+0000","last_unstale":"2024-05-08T21:19:53.242140+0000","last_undegraded":"2024-05-08T21:19:53.242140+0000","last_fullsized":"2024-05-08T21:19:53.242140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"32'12","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.297305+0000","last_change":"2024-05-08T21:10:03.751285+0000","last_active":"2024-05-08T21:19:53.297305+0000","last_peered":"2024-05-08T21:19:53.297305+0000","last_clean":"2024-05-08T21:19:53.297305+0000","last_became_active":"2024-05-08T21:10:03.746557+0000","last_became_peered":"2024-05-08T21:10:03.746557+0000","last_unstale":"2024-05-08T21:19:53.297305+0000","last_undegraded":"2024-05-08T21:19:53.297305+0000","last_fullsized":"2024-05-08T21:19:53.297305+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"32'3739","reported_seq":3805,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.231729+0000","last_change":"2024-05-08T21:10:08.048830+0000","last_active":"2024-05-08T21:19:53.231729+0000","last_peered":"2024-05-08T21:19:53.231729+0000","last_clean":"2024-05-08T21:19:53.231729+0000","last_became_active":"2024-05-08T21:10:08.048453+0000","last_became_peered":"2024-05-08T21:10:08.048453+0000","last_unstale":"2024-05-08T21:19:53.231729+0000","last_undegraded":"2024-05-08T21:19:53.231729+0000","last_fullsized":"2024-05-08T21:19:53.231729+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":3739,"log_dups_size":0,"ondisk_log_size":3739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":0,"num_write":49340,"num_write_kb":639424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"32'7","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.176141+0000","last_change":"2024-05-08T21:10:03.330419+0000","last_active":"2024-05-08T21:19:53.176141+0000","last_peered":"2024-05-08T21:19:53.176141+0000","last_clean":"2024-05-08T21:19:53.176141+0000","last_became_active":"2024-05-08T21:10:03.330082+0000","last_became_peered":"2024-05-08T21:10:03.330082+0000","last_unstale":"2024-05-08T21:19:53.176141+0000","last_undegraded":"2024-05-08T21:19:53.176141+0000","last_fullsized":"2024-05-08T21:19:53.176141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"32'11","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:48.445509+0000","last_change":"2024-05-08T21:10:03.747306+0000","last_active":"2024-05-08T21:19:48.445509+0000","last_peered":"2024-05-08T21:19:48.445509+0000","last_clean":"2024-05-08T21:19:48.445509+0000","last_became_active":"2024-05-08T21:10:03.746755+0000","last_became_peered":"2024-05-08T21:10:03.746755+0000","last_unstale":"2024-05-08T21:19:48.445509+0000","last_undegraded":"2024-05-08T21:19:48.445509+0000","last_fullsized":"2024-05-08T21:19:48.445509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:17:51.344821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"32'16","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.121860+0000","last_change":"2024-05-08T21:10:03.738627+0000","last_active":"2024-05-08T21:19:53.121860+0000","last_peered":"2024-05-08T21:19:53.121860+0000","last_clean":"2024-05-08T21:19:53.121860+0000","last_became_active":"2024-05-08T21:10:03.738338+0000","last_became_peered":"2024-05-08T21:10:03.738338+0000","last_unstale":"2024-05-08T21:19:53.121860+0000","last_undegraded":"2024-05-08T21:19:53.121860+0000","last_fullsized":"2024-05-08T21:19:53.121860+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:28:34.088831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"32'14","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.244767+0000","last_change":"2024-05-08T21:10:03.745607+0000","last_active":"2024-05-08T21:19:53.244767+0000","last_peered":"2024-05-08T21:19:53.244767+0000","last_clean":"2024-05-08T21:19:53.244767+0000","last_became_active":"2024-05-08T21:10:03.745362+0000","last_became_peered":"2024-05-08T21:10:03.745362+0000","last_unstale":"2024-05-08T21:19:53.244767+0000","last_undegraded":"2024-05-08T21:19:53.244767+0000","last_fullsized":"2024-05-08T21:19:53.244767+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"32'20","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.286157+0000","last_change":"2024-05-08T21:10:03.745137+0000","last_active":"2024-05-08T21:19:53.286157+0000","last_peered":"2024-05-08T21:19:53.286157+0000","last_clean":"2024-05-08T21:19:53.286157+0000","last_became_active":"2024-05-08T21:10:03.744844+0000","last_became_peered":"2024-05-08T21:10:03.744844+0000","last_unstale":"2024-05-08T21:19:53.286157+0000","last_undegraded":"2024-05-08T21:19:53.286157+0000","last_fullsized":"2024-05-08T21:19:53.286157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"32'11","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.190046+0000","last_change":"2024-05-08T21:10:03.745163+0000","last_active":"2024-05-08T21:19:53.190046+0000","last_peered":"2024-05-08T21:19:53.190046+0000","last_clean":"2024-05-08T21:19:53.190046+0000","last_became_active":"2024-05-08T21:10:03.744908+0000","last_became_peered":"2024-05-08T21:10:03.744908+0000","last_unstale":"2024-05-08T21:19:53.190046+0000","last_undegraded":"2024-05-08T21:19:53.190046+0000","last_fullsized":"2024-05-08T21:19:53.190046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'9","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.028238+0000","last_change":"2024-05-08T21:10:03.748542+0000","last_active":"2024-05-08T21:19:53.028238+0000","last_peered":"2024-05-08T21:19:53.028238+0000","last_clean":"2024-05-08T21:19:53.028238+0000","last_became_active":"2024-05-08T21:10:03.748284+0000","last_became_peered":"2024-05-08T21:10:03.748284+0000","last_unstale":"2024-05-08T21:19:53.028238+0000","last_undegraded":"2024-05-08T21:19:53.028238+0000","last_fullsized":"2024-05-08T21:19:53.028238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:49:10.430406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"32'12","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.304358+0000","last_change":"2024-05-08T21:10:03.739778+0000","last_active":"2024-05-08T21:19:53.304358+0000","last_peered":"2024-05-08T21:19:53.304358+0000","last_clean":"2024-05-08T21:19:53.304358+0000","last_became_active":"2024-05-08T21:10:03.739522+0000","last_became_peered":"2024-05-08T21:10:03.739522+0000","last_unstale":"2024-05-08T21:19:53.304358+0000","last_undegraded":"2024-05-08T21:19:53.304358+0000","last_fullsized":"2024-05-08T21:19:53.304358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"32'11","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.186033+0000","last_change":"2024-05-08T21:10:03.746126+0000","last_active":"2024-05-08T21:19:53.186033+0000","last_peered":"2024-05-08T21:19:53.186033+0000","last_clean":"2024-05-08T21:19:53.186033+0000","last_became_active":"2024-05-08T21:10:03.745842+0000","last_became_peered":"2024-05-08T21:10:03.745842+0000","last_unstale":"2024-05-08T21:19:53.186033+0000","last_undegraded":"2024-05-08T21:19:53.186033+0000","last_fullsized":"2024-05-08T21:19:53.186033+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:51:06.176371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"32'13","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.250885+0000","last_change":"2024-05-08T21:10:53.473916+0000","last_active":"2024-05-08T21:19:53.250885+0000","last_peered":"2024-05-08T21:19:53.250885+0000","last_clean":"2024-05-08T21:19:53.250885+0000","last_became_active":"2024-05-08T21:10:53.473615+0000","last_became_peered":"2024-05-08T21:10:53.473615+0000","last_unstale":"2024-05-08T21:19:53.250885+0000","last_undegraded":"2024-05-08T21:19:53.250885+0000","last_fullsized":"2024-05-08T21:19:53.250885+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"32'13","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.240860+0000","last_change":"2024-05-08T21:10:03.751111+0000","last_active":"2024-05-08T21:19:53.240860+0000","last_peered":"2024-05-08T21:19:53.240860+0000","last_clean":"2024-05-08T21:19:53.240860+0000","last_became_active":"2024-05-08T21:10:03.747059+0000","last_became_peered":"2024-05-08T21:10:03.747059+0000","last_unstale":"2024-05-08T21:19:53.240860+0000","last_undegraded":"2024-05-08T21:19:53.240860+0000","last_fullsized":"2024-05-08T21:19:53.240860+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"32'17","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.145869+0000","last_change":"2024-05-08T21:10:03.747207+0000","last_active":"2024-05-08T21:19:53.145869+0000","last_peered":"2024-05-08T21:19:53.145869+0000","last_clean":"2024-05-08T21:19:53.145869+0000","last_became_active":"2024-05-08T21:10:03.746942+0000","last_became_peered":"2024-05-08T21:10:03.746942+0000","last_unstale":"2024-05-08T21:19:53.145869+0000","last_undegraded":"2024-05-08T21:19:53.145869+0000","last_fullsized":"2024-05-08T21:19:53.145869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:33:52.317273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"32'12","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.090653+0000","last_change":"2024-05-08T21:10:03.753663+0000","last_active":"2024-05-08T21:19:53.090653+0000","last_peered":"2024-05-08T21:19:53.090653+0000","last_clean":"2024-05-08T21:19:53.090653+0000","last_became_active":"2024-05-08T21:10:03.752486+0000","last_became_peered":"2024-05-08T21:10:03.752486+0000","last_unstale":"2024-05-08T21:19:53.090653+0000","last_undegraded":"2024-05-08T21:19:53.090653+0000","last_fullsized":"2024-05-08T21:19:53.090653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"32'19","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.299643+0000","last_change":"2024-05-08T21:10:03.753849+0000","last_active":"2024-05-08T21:19:53.299643+0000","last_peered":"2024-05-08T21:19:53.299643+0000","last_clean":"2024-05-08T21:19:53.299643+0000","last_became_active":"2024-05-08T21:10:03.753616+0000","last_became_peered":"2024-05-08T21:10:03.753616+0000","last_unstale":"2024-05-08T21:19:53.299643+0000","last_undegraded":"2024-05-08T21:19:53.299643+0000","last_fullsized":"2024-05-08T21:19:53.299643+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"32'10","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.096566+0000","last_change":"2024-05-08T21:10:03.744906+0000","last_active":"2024-05-08T21:19:53.096566+0000","last_peered":"2024-05-08T21:19:53.096566+0000","last_clean":"2024-05-08T21:19:53.096566+0000","last_became_active":"2024-05-08T21:10:03.744562+0000","last_became_peered":"2024-05-08T21:10:03.744562+0000","last_unstale":"2024-05-08T21:19:53.096566+0000","last_undegraded":"2024-05-08T21:19:53.096566+0000","last_fullsized":"2024-05-08T21:19:53.096566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:21:30.416392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1810,"num_read_kb":0,"num_write":1714405,"num_write_kb":22146371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132410,"ondisk_log_size":132410,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":773,"ondisk_log_size":773,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64612,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":15837416,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":328,"num_read_kb":39720,"num_write":2875,"num_write_kb":17766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17809408,"data_stored":31674832,"data_compressed":2933172,"data_compressed_allocated":3907584,"data_compressed_original":17833984,"omap_allocated":0,"internal_metadata":0},"log_size":2907,"ondisk_log_size":2907,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509561,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":913320,"kb_used_data":1888,"kb_used_omap":1,"kb_used_meta":911422,"kb_avail":93458520,"statfs":{"total":96636764160,"available":95701524480,"internally_reserved":0,"allocated":1933312,"data_stored":4343835,"data_compressed":576533,"data_compressed_allocated":724992,"data_compressed_original":3338240,"omap_allocated":1593,"internal_metadata":933296583},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:19:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.9790000000000001,"15min":1.603},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":5.5289999999999999,"5min":13.432,"15min":17.978999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.91700000000000004,"5min":1.4750000000000001,"15min":1.0800000000000001},"min":{"1min":0.24299999999999999,"5min":0.219,"15min":0.219},"max":{"1min":5.2889999999999997,"5min":10.097,"15min":11.362},"last":0.41799999999999998}]},{"osd":1,"last update":"Wed May 8 21:19:07 2024","interfaces":[{"interface":"back","average":{"1min":2.2170000000000001,"5min":2.831,"15min":1.863},"min":{"1min":0.247,"5min":0.219,"15min":0.219},"max":{"1min":9.7360000000000007,"5min":49.942999999999998,"15min":49.942999999999998},"last":0.47299999999999998},{"interface":"front","average":{"1min":1.726,"5min":2.5259999999999998,"15min":1.516},"min":{"1min":0.45100000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":5.2789999999999999,"5min":27.733000000000001,"15min":27.733000000000001},"last":0.441}]},{"osd":2,"last update":"Wed May 8 21:19:07 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":1.583,"15min":1.6970000000000001},"min":{"1min":0.27100000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":2.7189999999999999,"5min":17.858000000000001,"15min":58.450000000000003},"last":0.49399999999999999},{"interface":"front","average":{"1min":1.165,"5min":1.639,"15min":1.1319999999999999},"min":{"1min":0.32000000000000001,"5min":0.30199999999999999,"15min":0.27400000000000002},"max":{"1min":4.6559999999999997,"5min":13.568,"15min":14.746},"last":0.505}]},{"osd":3,"last update":"Wed May 8 21:19:07 2024","interfaces":[{"interface":"back","average":{"1min":1.6379999999999999,"5min":4.3520000000000003,"15min":2.617},"min":{"1min":0.35499999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":6.1879999999999997,"5min":68.728999999999999,"15min":74.570999999999998},"last":0.42999999999999999},{"interface":"front","average":{"1min":1.173,"5min":2.3490000000000002,"15min":1.6279999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":11.816000000000001,"5min":27.358000000000001,"15min":28.099},"last":0.53900000000000003}]},{"osd":4,"last update":"Wed May 8 21:19:07 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":1.5580000000000001,"15min":1.1319999999999999},"min":{"1min":0.23300000000000001,"5min":0.223,"15min":0.223},"max":{"1min":8.0869999999999997,"5min":27.963000000000001,"15min":29.731000000000002},"last":0.39500000000000002},{"interface":"front","average":{"1min":1.258,"5min":1.5660000000000001,"15min":1.1519999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":10.657999999999999,"5min":17.835999999999999,"15min":26.454999999999998},"last":0.57599999999999996}]},{"osd":5,"last update":"Wed May 8 21:19:07 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":1.1000000000000001,"15min":1.177},"min":{"1min":0.30099999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":2.4510000000000001,"5min":17.780999999999999,"15min":65.373000000000005},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":1.2809999999999999,"15min":1.046},"min":{"1min":0.28399999999999997,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.357,"5min":13.509,"15min":26.498999999999999},"last":0.55000000000000004}]},{"osd":7,"last update":"Wed May 8 21:19:07 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":1.7889999999999999,"15min":1.0589999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.9450000000000001,"5min":16.808,"15min":16.808},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":1.4770000000000001,"15min":0.96499999999999997},"min":{"1min":0.33600000000000002,"5min":0.314,"15min":0.314},"max":{"1min":1.821,"5min":18.100999999999999,"15min":18.100999999999999},"last":0.45200000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509563,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":696156,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":695806,"kb_avail":93675684,"statfs":{"total":96636764160,"available":95923900416,"internally_reserved":0,"allocated":348160,"data_stored":148949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":712505798},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":1.8360000000000001,"15min":1.4450000000000001},"min":{"1min":0.24199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":7.8029999999999999,"5min":17.295999999999999,"15min":48.481999999999999},"last":0.44800000000000001},{"interface":"front","average":{"1min":1.619,"5min":2.0600000000000001,"15min":1.522},"min":{"1min":0.36299999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":13.234999999999999,"5min":17.164000000000001,"15min":30.004999999999999},"last":0.624}]},{"osd":1,"last update":"Wed May 8 21:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":2.7120000000000002,"15min":1.7310000000000001},"min":{"1min":0.26800000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":3.0550000000000002,"5min":21.702999999999999,"15min":25.228000000000002},"last":4.149},{"interface":"front","average":{"1min":0.86299999999999999,"5min":2.4710000000000001,"15min":1.403},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":4.0670000000000002,"5min":21.869,"15min":21.869},"last":4.1859999999999999}]},{"osd":2,"last update":"Wed May 8 21:19:19 2024","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":3.0019999999999998,"15min":1.6699999999999999},"min":{"1min":0.29399999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":10.689,"5min":34.850000000000001,"15min":34.850000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.54900000000000004,"5min":2.4430000000000001,"15min":1.4690000000000001},"min":{"1min":0.28899999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.617,"5min":29.623000000000001,"15min":29.623000000000001},"last":0.752}]},{"osd":3,"last update":"Wed May 8 21:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":1.8029999999999999,"15min":1.377},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":4.1070000000000002,"5min":19.395,"15min":23.234999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":1.55,"5min":3.6520000000000001,"15min":2.0489999999999999},"min":{"1min":0.34399999999999997,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":20.013000000000002,"5min":40.954999999999998,"15min":40.954999999999998},"last":0.78400000000000003}]},{"osd":4,"last update":"Wed May 8 21:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":1.0369999999999999,"15min":0.89800000000000002},"min":{"1min":0.27500000000000002,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.95599999999999996,"5min":12.390000000000001,"15min":23.254000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.60499999999999998,"5min":1.0820000000000001,"15min":0.93999999999999995},"min":{"1min":0.32300000000000001,"5min":0.27600000000000002,"15min":0.26600000000000001},"max":{"1min":3.0859999999999999,"5min":7.7370000000000001,"15min":17.550999999999998},"last":0.69499999999999995}]},{"osd":6,"last update":"Wed May 8 21:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.95299999999999996,"15min":0.89100000000000001},"min":{"1min":0.26900000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.747,"5min":8.7249999999999996,"15min":17.856000000000002},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":1.1619999999999999,"15min":1.0029999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.26900000000000002},"max":{"1min":0.77700000000000002,"5min":8.9269999999999996,"15min":17.827999999999999},"last":0.73099999999999998}]},{"osd":7,"last update":"Wed May 8 21:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":1.1739999999999999,"15min":0.92900000000000005},"min":{"1min":0.311,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.98499999999999999,"5min":11.183999999999999,"15min":18.079000000000001},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.73499999999999999,"5min":1.464,"15min":1.1659999999999999},"min":{"1min":0.30599999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":4.8819999999999997,"5min":13.496,"15min":30.050000000000001},"last":0.71499999999999997}]}]},{"osd":0,"up_from":14,"seq":60129542267,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":800100,"kb_used_data":1948,"kb_used_omap":1,"kb_used_meta":798142,"kb_avail":93571740,"statfs":{"total":96636764160,"available":95817461760,"internally_reserved":0,"allocated":1994752,"data_stored":3898840,"data_compressed":360679,"data_compressed_allocated":471040,"data_compressed_original":2588672,"omap_allocated":1594,"internal_metadata":817297862},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 8 21:19:14 2024","interfaces":[{"interface":"back","average":{"1min":3.8900000000000001,"5min":2.9590000000000001,"15min":1.925},"min":{"1min":0.193,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":24.199999999999999,"5min":24.199999999999999,"15min":98.899000000000001},"last":0.223},{"interface":"front","average":{"1min":2.4420000000000002,"5min":2.8100000000000001,"15min":1.6519999999999999},"min":{"1min":0.24199999999999999,"5min":0.185,"15min":0.185},"max":{"1min":13.778,"5min":25.295999999999999,"15min":39.594000000000001},"last":0.40899999999999997}]},{"osd":2,"last update":"Wed May 8 21:19:14 2024","interfaces":[{"interface":"back","average":{"1min":3.2759999999999998,"5min":2.4390000000000001,"15min":1.6479999999999999},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.224},"max":{"1min":21.695,"5min":27.657,"15min":33.238999999999997},"last":0.27700000000000002},{"interface":"front","average":{"1min":1.7949999999999999,"5min":1.8240000000000001,"15min":1.0800000000000001},"min":{"1min":0.26500000000000001,"5min":0.22500000000000001,"15min":0.223},"max":{"1min":17.302,"5min":27.027000000000001,"15min":27.027000000000001},"last":0.35599999999999998}]},{"osd":3,"last update":"Wed May 8 21:19:14 2024","interfaces":[{"interface":"back","average":{"1min":1.7090000000000001,"5min":2.9100000000000001,"15min":2.1909999999999998},"min":{"1min":0.28499999999999998,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":17.355,"5min":30.341999999999999,"15min":77.010999999999996},"last":0.29699999999999999},{"interface":"front","average":{"1min":1.879,"5min":2.069,"15min":1.653},"min":{"1min":0.33400000000000002,"5min":0.29199999999999998,"15min":0.28899999999999998},"max":{"1min":17.271000000000001,"5min":29.155999999999999,"15min":93.995999999999995},"last":0.32500000000000001}]},{"osd":4,"last update":"Wed May 8 21:19:14 2024","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":2.0990000000000002,"15min":1.7330000000000001},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":6.8259999999999996,"5min":27.513999999999999,"15min":33.121000000000002},"last":0.47899999999999998},{"interface":"front","average":{"1min":1.196,"5min":2.149,"15min":1.474},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":9.1869999999999994,"5min":27.48,"15min":27.48},"last":0.41999999999999998}]},{"osd":5,"last update":"Wed May 8 21:19:14 2024","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":2.1440000000000001,"15min":1.5009999999999999},"min":{"1min":0.32100000000000001,"5min":0.311,"15min":0.311},"max":{"1min":7.3339999999999996,"5min":13.412000000000001,"15min":29.919},"last":0.44700000000000001},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.923,"15min":1.714},"min":{"1min":0.34100000000000003,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":9.3979999999999997,"5min":20.626999999999999,"15min":33.209000000000003},"last":0.497}]},{"osd":6,"last update":"Wed May 8 21:19:14 2024","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":1.738,"15min":1.4159999999999999},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":7.702,"5min":11.276999999999999,"15min":19.527999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":1.599,"5min":2.2690000000000001,"15min":1.4390000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":9.2219999999999995,"5min":15.829000000000001,"15min":29.800000000000001},"last":0.38500000000000001}]},{"osd":7,"last update":"Wed May 8 21:19:14 2024","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":2.0179999999999998,"15min":1.639},"min":{"1min":0.35699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":8.952,"5min":11.372999999999999,"15min":33.174999999999997},"last":0.39500000000000002},{"interface":"front","average":{"1min":1.0089999999999999,"5min":2.351,"15min":1.4690000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":4.7450000000000001,"5min":21.097999999999999,"15min":21.097999999999999},"last":0.45800000000000002}]}]},{"osd":7,"up_from":14,"seq":60129542266,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":867812,"kb_used_data":7452,"kb_used_omap":1,"kb_used_meta":860350,"kb_avail":93504028,"statfs":{"total":96636764160,"available":95748124672,"internally_reserved":0,"allocated":7630848,"data_stored":12287392,"data_compressed":917593,"data_compressed_allocated":1265664,"data_compressed_original":6127616,"omap_allocated":1589,"internal_metadata":880998859},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:19:08 2024","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":2.21,"15min":1.1799999999999999},"min":{"1min":0.217,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":10.747999999999999,"5min":20.876999999999999,"15min":20.876999999999999},"last":3.698},{"interface":"front","average":{"1min":1.343,"5min":2.1579999999999999,"15min":1.4730000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":4.0570000000000004,"5min":23.748999999999999,"15min":62.033000000000001},"last":3.839}]},{"osd":1,"last update":"Wed May 8 21:19:17 2024","interfaces":[{"interface":"back","average":{"1min":1.9350000000000001,"5min":2.8330000000000002,"15min":2.04},"min":{"1min":0.251,"5min":0.251,"15min":0.246},"max":{"1min":23.103999999999999,"5min":44.164000000000001,"15min":44.645000000000003},"last":1.9430000000000001},{"interface":"front","average":{"1min":1.7050000000000001,"5min":2.395,"15min":1.3720000000000001},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":8.3339999999999996,"5min":44.091000000000001,"15min":44.091000000000001},"last":1.9890000000000001}]},{"osd":2,"last update":"Wed May 8 21:19:08 2024","interfaces":[{"interface":"back","average":{"1min":2.3740000000000001,"5min":2.0870000000000002,"15min":1.131},"min":{"1min":0.34599999999999997,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":11.388999999999999,"5min":15.986000000000001,"15min":15.986000000000001},"last":1.7529999999999999},{"interface":"front","average":{"1min":2.121,"5min":1.833,"15min":1.028},"min":{"1min":0.45000000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":9.3949999999999996,"5min":11.112,"15min":11.112},"last":1.841}]},{"osd":3,"last update":"Wed May 8 21:19:08 2024","interfaces":[{"interface":"back","average":{"1min":2.3969999999999998,"5min":3.1320000000000001,"15min":1.5880000000000001},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":9.8789999999999996,"5min":44.064999999999998,"15min":44.064999999999998},"last":13.513999999999999},{"interface":"front","average":{"1min":1.7649999999999999,"5min":2.661,"15min":1.7050000000000001},"min":{"1min":0.379,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":15.789,"5min":44.607999999999997,"15min":44.607999999999997},"last":13.789}]},{"osd":4,"last update":"Wed May 8 21:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":1.0549999999999999,"15min":0.82699999999999996},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":3.1850000000000001,"5min":10.51,"15min":21.338000000000001},"last":1.2609999999999999},{"interface":"front","average":{"1min":0.80200000000000005,"5min":1.302,"15min":0.94799999999999995},"min":{"1min":0.27900000000000003,"5min":0.216,"15min":0.216},"max":{"1min":3.242,"5min":16.082999999999998,"15min":22.827000000000002},"last":1.7849999999999999}]},{"osd":5,"last update":"Wed May 8 21:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.079,"15min":0.85299999999999998},"min":{"1min":0.28899999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":10.785,"5min":10.785,"15min":10.880000000000001},"last":1.601},{"interface":"front","average":{"1min":0.60899999999999999,"5min":1.026,"15min":0.84699999999999998},"min":{"1min":0.32700000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.613,"5min":7.4939999999999998,"15min":8.157},"last":1.6279999999999999}]},{"osd":6,"last update":"Wed May 8 21:19:17 2024","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.2909999999999999,"15min":0.86099999999999999},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":12.433,"5min":12.433,"15min":12.433},"last":1.4750000000000001},{"interface":"front","average":{"1min":1.252,"5min":1.546,"15min":1.052},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":12.182,"5min":19.864999999999998,"15min":19.864999999999998},"last":1.4399999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574970,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":729956,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":729534,"kb_avail":93641884,"statfs":{"total":96636764160,"available":95889289216,"internally_reserved":0,"allocated":421888,"data_stored":242918,"data_compressed":4766,"data_compressed_allocated":8192,"data_compressed_original":24576,"omap_allocated":1594,"internal_metadata":747043270},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:19:12 2024","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":2.6640000000000001,"15min":1.5049999999999999},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.20399999999999999},"max":{"1min":7.3049999999999997,"5min":17.789000000000001,"15min":24.859999999999999},"last":0.27100000000000002},{"interface":"front","average":{"1min":1.486,"5min":2.1960000000000002,"15min":1.3759999999999999},"min":{"1min":0.27200000000000002,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":7.4560000000000004,"5min":17.835999999999999,"15min":49.606000000000002},"last":0.30199999999999999}]},{"osd":1,"last update":"Wed May 8 21:19:12 2024","interfaces":[{"interface":"back","average":{"1min":3.0430000000000001,"5min":2.6960000000000002,"15min":1.7470000000000001},"min":{"1min":0.26500000000000001,"5min":0.218,"15min":0.19800000000000001},"max":{"1min":24.321999999999999,"5min":25.135999999999999,"15min":55.296999999999997},"last":0.28599999999999998},{"interface":"front","average":{"1min":2.706,"5min":2.4990000000000001,"15min":1.7090000000000001},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":24.149999999999999,"5min":24.149999999999999,"15min":79.221000000000004},"last":0.32100000000000001}]},{"osd":3,"last update":"Wed May 8 21:19:12 2024","interfaces":[{"interface":"back","average":{"1min":2.1440000000000001,"5min":4.8819999999999997,"15min":2.1600000000000001},"min":{"1min":0.32000000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":7.7510000000000003,"5min":69.888000000000005,"15min":69.888000000000005},"last":0.39900000000000002},{"interface":"front","average":{"1min":2.1829999999999998,"5min":4.931,"15min":2.198},"min":{"1min":0.33900000000000002,"5min":0.30199999999999999,"15min":0.23699999999999999},"max":{"1min":7.7850000000000001,"5min":69.959000000000003,"15min":69.959000000000003},"last":0.42699999999999999}]},{"osd":4,"last update":"Wed May 8 21:19:12 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":1.8979999999999999,"15min":1.4319999999999999},"min":{"1min":0.34999999999999998,"5min":0.253,"15min":0.253},"max":{"1min":2.2170000000000001,"5min":17.716999999999999,"15min":32.457999999999998},"last":0.54100000000000004},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.823,"15min":1.171},"min":{"1min":0.25700000000000001,"5min":0.255,"15min":0.255},"max":{"1min":7.3940000000000001,"5min":13.827,"15min":18.315000000000001},"last":0.627}]},{"osd":5,"last update":"Wed May 8 21:19:12 2024","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.655,"15min":1.079},"min":{"1min":0.38500000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":4.4219999999999997,"5min":17.507999999999999,"15min":17.507999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.72399999999999998,"5min":2.6200000000000001,"15min":1.6200000000000001},"min":{"1min":0.30299999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.744,"5min":48.560000000000002,"15min":48.560000000000002},"last":0.66200000000000003}]},{"osd":6,"last update":"Wed May 8 21:19:12 2024","interfaces":[{"interface":"back","average":{"1min":1.4770000000000001,"5min":1.911,"15min":1.246},"min":{"1min":0.39300000000000002,"5min":0.308,"15min":0.308},"max":{"1min":7.4290000000000003,"5min":13.933999999999999,"15min":16.399999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":1.196,"5min":1.9970000000000001,"15min":1.2909999999999999},"min":{"1min":0.46800000000000003,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":4.4649999999999999,"5min":17.536000000000001,"15min":23.216000000000001},"last":0.51900000000000002}]},{"osd":7,"last update":"Wed May 8 21:19:12 2024","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.9750000000000001,"15min":1.2929999999999999},"min":{"1min":0.42499999999999999,"5min":0.33200000000000002,"15min":0.33000000000000002},"max":{"1min":4.492,"5min":11.041,"15min":16.366},"last":0.60799999999999998},{"interface":"front","average":{"1min":1.6499999999999999,"5min":1.7509999999999999,"15min":1.1439999999999999},"min":{"1min":0.46200000000000002,"5min":0.313,"15min":0.313},"max":{"1min":7.4820000000000002,"5min":13.903,"15min":13.903},"last":0.65200000000000002}]}]},{"osd":3,"up_from":14,"seq":60129542262,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1328872,"kb_used_data":62296,"kb_used_omap":1,"kb_used_meta":1259454,"kb_avail":93042968,"statfs":{"total":96636764160,"available":95275999232,"internally_reserved":0,"allocated":63791104,"data_stored":95483782,"data_compressed":5372709,"data_compressed_allocated":14950400,"data_compressed_original":46845952,"omap_allocated":1592,"internal_metadata":1289681352},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,3,0,4,3,4],"upper_bound":512},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:19:20 2024","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":2.9950000000000001,"15min":1.3879999999999999},"min":{"1min":0.24299999999999999,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":7.2930000000000001,"5min":39.801000000000002,"15min":39.801000000000002},"last":1.6299999999999999},{"interface":"front","average":{"1min":1.3049999999999999,"5min":2.0680000000000001,"15min":1.7569999999999999},"min":{"1min":0.26000000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":10.782,"5min":14.497,"15min":60.847999999999999},"last":2.1190000000000002}]},{"osd":1,"last update":"Wed May 8 21:19:20 2024","interfaces":[{"interface":"back","average":{"1min":2.5249999999999999,"5min":3.3759999999999999,"15min":1.851},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":15.603,"5min":47.418999999999997,"15min":57.020000000000003},"last":1.6719999999999999},{"interface":"front","average":{"1min":4.6790000000000003,"5min":4.5030000000000001,"15min":2.0070000000000001},"min":{"1min":0.26300000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":29.669,"5min":43.317,"15min":43.317},"last":2.2349999999999999}]},{"osd":2,"last update":"Wed May 8 21:19:20 2024","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.714,"15min":1.105},"min":{"1min":0.32000000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":10.712999999999999,"5min":10.938000000000001,"15min":32.247999999999998},"last":2.1920000000000002},{"interface":"front","average":{"1min":1.5029999999999999,"5min":3.1099999999999999,"15min":1.5780000000000001},"min":{"1min":0.33300000000000002,"5min":0.31,"15min":0.26200000000000001},"max":{"1min":7.2030000000000003,"5min":39.386000000000003,"15min":39.386000000000003},"last":0.33600000000000002}]},{"osd":4,"last update":"Wed May 8 21:19:20 2024","interfaces":[{"interface":"back","average":{"1min":1.446,"5min":1.6639999999999999,"15min":1.639},"min":{"1min":0.39300000000000002,"5min":0.309,"15min":0.309},"max":{"1min":10.755000000000001,"5min":10.755000000000001,"15min":58.072000000000003},"last":13.068},{"interface":"front","average":{"1min":1.387,"5min":2.3650000000000002,"15min":1.367},"min":{"1min":0.46700000000000003,"5min":0.314,"15min":0.314},"max":{"1min":7.2430000000000003,"5min":15.712,"15min":26.311},"last":10.382999999999999}]},{"osd":5,"last update":"Wed May 8 21:19:20 2024","interfaces":[{"interface":"back","average":{"1min":1.5760000000000001,"5min":1.786,"15min":1.6200000000000001},"min":{"1min":0.438,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":10.842000000000001,"5min":14.584,"15min":60.375999999999998},"last":2.165},{"interface":"front","average":{"1min":1.4139999999999999,"5min":2.9359999999999999,"15min":1.6080000000000001},"min":{"1min":0.45500000000000002,"5min":0.31,"15min":0.31},"max":{"1min":7.2679999999999998,"5min":39.274000000000001,"15min":39.274000000000001},"last":0.374}]},{"osd":6,"last update":"Wed May 8 21:19:20 2024","interfaces":[{"interface":"back","average":{"1min":2.9710000000000001,"5min":3.452,"15min":1.8580000000000001},"min":{"1min":0.34499999999999997,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":30.25,"5min":30.25,"15min":30.25},"last":1.605},{"interface":"front","average":{"1min":1.6499999999999999,"5min":3.4319999999999999,"15min":1.861},"min":{"1min":0.48099999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":11.914,"5min":41.323999999999998,"15min":41.323999999999998},"last":0.40000000000000002}]},{"osd":7,"last update":"Wed May 8 21:19:20 2024","interfaces":[{"interface":"back","average":{"1min":2.907,"5min":3.5510000000000002,"15min":1.829},"min":{"1min":0.40100000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":30.295000000000002,"5min":30.295000000000002,"15min":30.295000000000002},"last":1.659},{"interface":"front","average":{"1min":3.0310000000000001,"5min":3.9180000000000001,"15min":2.0110000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":30.201000000000001,"5min":30.201000000000001,"15min":30.201000000000001},"last":2.2040000000000002}]}]},{"osd":1,"up_from":15,"seq":64424509560,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1171168,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":1170814,"kb_avail":93200672,"statfs":{"total":96636764160,"available":95437488128,"internally_reserved":0,"allocated":352256,"data_stored":149019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1198913990},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":2.2400000000000002,"15min":1.653},"min":{"1min":0.22800000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.77300000000000002,"5min":16.692,"15min":68.346999999999994},"last":0.373},{"interface":"front","average":{"1min":0.97399999999999998,"5min":2.5630000000000002,"15min":1.486},"min":{"1min":0.22,"5min":0.21199999999999999,"15min":0.19800000000000001},"max":{"1min":6.6589999999999998,"5min":16.875,"15min":25.786000000000001},"last":0.28499999999999998}]},{"osd":2,"last update":"Wed May 8 21:19:16 2024","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":2.552,"15min":2.2440000000000002},"min":{"1min":0.22700000000000001,"5min":0.191,"15min":0.191},"max":{"1min":7.5350000000000001,"5min":18.373000000000001,"15min":70.688000000000002},"last":0.38700000000000001},{"interface":"front","average":{"1min":1.151,"5min":2.0419999999999998,"15min":1.796},"min":{"1min":0.25600000000000001,"5min":0.22800000000000001,"15min":0.219},"max":{"1min":9.0779999999999994,"5min":14.207000000000001,"15min":35.401000000000003},"last":0.34100000000000003}]},{"osd":3,"last update":"Wed May 8 21:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":2.3690000000000002,"15min":1.599},"min":{"1min":0.26600000000000001,"5min":0.224,"15min":0.224},"max":{"1min":6.4299999999999997,"5min":14.621,"15min":35.658000000000001},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":1.96,"15min":1.6200000000000001},"min":{"1min":0.316,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":2.5609999999999999,"5min":14.189,"15min":27.207999999999998},"last":0.40500000000000003}]},{"osd":4,"last update":"Wed May 8 21:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":1.8580000000000001,"15min":1.4830000000000001},"min":{"1min":0.34999999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":2.5209999999999999,"5min":16.561,"15min":43.401000000000003},"last":0.69199999999999995},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.9550000000000001,"15min":1.351},"min":{"1min":0.37,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":6.702,"5min":10.372999999999999,"15min":27.239000000000001},"last":0.52000000000000002}]},{"osd":5,"last update":"Wed May 8 21:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":2.2040000000000002,"15min":1.7509999999999999},"min":{"1min":0.36199999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.1399999999999999,"5min":18.241,"15min":43.515000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":1.8620000000000001,"15min":1.633},"min":{"1min":0.40500000000000003,"5min":0.34899999999999998,"15min":0.32300000000000001},"max":{"1min":0.80300000000000005,"5min":19.843,"15min":27.352},"last":0.626}]},{"osd":6,"last update":"Wed May 8 21:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":2.6589999999999998,"15min":1.748},"min":{"1min":0.34300000000000003,"5min":0.307,"15min":0.307},"max":{"1min":1.1879999999999999,"5min":18.268999999999998,"15min":43.472999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.68600000000000005,"5min":1.9319999999999999,"15min":1.425},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35499999999999998},"max":{"1min":2.4710000000000001,"5min":16.155000000000001,"15min":27.376999999999999},"last":0.54800000000000004}]},{"osd":7,"last update":"Wed May 8 21:19:16 2024","interfaces":[{"interface":"back","average":{"1min":1.544,"5min":2.5390000000000001,"15min":1.9910000000000001},"min":{"1min":0.39000000000000001,"5min":0.315,"15min":0.315},"max":{"1min":6.7309999999999999,"5min":13.484999999999999,"15min":68.287999999999997},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.95599999999999996,"5min":1.8280000000000001,"15min":1.6000000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":4.2450000000000001,"5min":13.592000000000001,"15min":27.312999999999999},"last":0.57899999999999996}]}]},{"osd":4,"up_from":15,"seq":64424509561,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":923444,"kb_used_data":2540,"kb_used_omap":1,"kb_used_meta":920894,"kb_avail":93448396,"statfs":{"total":96636764160,"available":95691157504,"internally_reserved":0,"allocated":2600960,"data_stored":4343289,"data_compressed":367613,"data_compressed_allocated":532480,"data_compressed_original":2482176,"omap_allocated":1593,"internal_metadata":942995911},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:19:19 2024","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.5580000000000001,"15min":1.0549999999999999},"min":{"1min":0.28299999999999997,"5min":0.218,"15min":0.218},"max":{"1min":7.6849999999999996,"5min":20.606999999999999,"15min":20.606999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":1.7769999999999999,"5min":2.7770000000000001,"15min":1.758},"min":{"1min":0.316,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":18.945,"5min":45.499000000000002,"15min":45.499000000000002},"last":0.58499999999999996}]},{"osd":1,"last update":"Wed May 8 21:19:19 2024","interfaces":[{"interface":"back","average":{"1min":2.4870000000000001,"5min":5.0439999999999996,"15min":2.5},"min":{"1min":0.28100000000000003,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":18.905999999999999,"5min":273.69299999999998,"15min":273.69299999999998},"last":0.436},{"interface":"front","average":{"1min":1.0409999999999999,"5min":4.907,"15min":3.069},"min":{"1min":0.35499999999999998,"5min":0.28699999999999998,"15min":0.26200000000000001},"max":{"1min":5.2290000000000001,"5min":281.21699999999998,"15min":281.21699999999998},"last":0.56899999999999995}]},{"osd":2,"last update":"Wed May 8 21:19:19 2024","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.8089999999999999,"15min":1.395},"min":{"1min":0.26200000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":7.4119999999999999,"5min":46.542000000000002,"15min":96.177999999999997},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":1.415,"15min":1.361},"min":{"1min":0.35399999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.7070000000000001,"5min":16.183,"15min":94.947000000000003},"last":0.47399999999999998}]},{"osd":3,"last update":"Wed May 8 21:19:19 2024","interfaces":[{"interface":"back","average":{"1min":1.8999999999999999,"5min":2.3540000000000001,"15min":1.429},"min":{"1min":0.33500000000000002,"5min":0.245,"15min":0.23899999999999999},"max":{"1min":18.632000000000001,"5min":18.632000000000001,"15min":30.596},"last":0.52500000000000002},{"interface":"front","average":{"1min":1.111,"5min":3.4340000000000002,"15min":1.804},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":5.2089999999999996,"5min":42.969000000000001,"15min":42.969000000000001},"last":0.61299999999999999}]},{"osd":5,"last update":"Wed May 8 21:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":1.7669999999999999,"15min":1.129},"min":{"1min":0.29499999999999998,"5min":0.252,"15min":0.221},"max":{"1min":1.714,"5min":46.488999999999997,"15min":46.488999999999997},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.877,"5min":1.6899999999999999,"15min":0.98599999999999999},"min":{"1min":0.37,"5min":0.28000000000000003,"15min":0.26200000000000001},"max":{"1min":4.9320000000000004,"5min":45.445999999999998,"15min":45.445999999999998},"last":0.63800000000000001}]},{"osd":6,"last update":"Wed May 8 21:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":1.869,"15min":1.1439999999999999},"min":{"1min":0.29699999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.6839999999999999,"5min":35.289999999999999,"15min":35.289999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":2.145,"15min":1.5029999999999999},"min":{"1min":0.371,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.351,"5min":46.576999999999998,"15min":46.576999999999998},"last":0.67000000000000004}]},{"osd":7,"last update":"Wed May 8 21:19:19 2024","interfaces":[{"interface":"back","average":{"1min":1.5980000000000001,"5min":1.9430000000000001,"15min":1.1259999999999999},"min":{"1min":0.36099999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":19.077999999999999,"5min":19.077999999999999,"15min":19.077999999999999},"last":0.627},{"interface":"front","average":{"1min":2.4390000000000001,"5min":1.6319999999999999,"15min":1.0489999999999999},"min":{"1min":0.32300000000000001,"5min":0.30299999999999999,"15min":0.28000000000000003},"max":{"1min":31.617999999999999,"5min":31.617999999999999,"15min":31.617999999999999},"last":0.68200000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32306,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32306,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1585152,"data_stored":3159613,"data_compressed":328373,"data_compressed_allocated":425984,"data_compressed_original":2015232,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":94059,"data_compressed":4766,"data_compressed_allocated":8192,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5066752,"data_stored":8483339,"data_compressed":770600,"data_compressed_allocated":995328,"data_compressed_original":4419584,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2256896,"data_stored":4194430,"data_compressed":367613,"data_compressed_allocated":532480,"data_compressed_original":2482176,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1589248,"data_stored":4194976,"data_compressed":576533,"data_compressed_allocated":724992,"data_compressed_original":3338240,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7221248,"data_stored":11548165,"data_compressed":885287,"data_compressed_allocated":1220608,"data_compressed_original":5554176,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T21:19:59.492 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.492 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.493 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.493 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.493 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.493 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.493 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.493 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.493 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.493 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.493 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.494 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.494 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.494 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.494 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.494 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.494 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.494 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.494 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.495 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.495 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-05-08T21:10:02.301995+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=2, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.495 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.495 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.495 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-05-08T21:10:02.301995+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=2, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.495 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.495 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.495 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-05-08T21:10:02.301995+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=2, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.495 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.495 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.496 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-05-08T21:10:02.301995+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=2, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.496 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.496 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.496 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-05-08T21:10:02.301995+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=2, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.496 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.496 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.496 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-05-08T21:10:02.301995+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=2, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.496 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.496 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.496 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-05-08T21:10:02.301995+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=2, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.497 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.497 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.497 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-05-08T21:10:02.301995+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=2, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.497 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.497 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.497 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-05-08T21:10:02.301995+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=2, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.498 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.498 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.498 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-05-08T21:10:02.301995+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=2, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.498 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.498 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.498 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-05-08T21:10:02.301995+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=2, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.498 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.498 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.498 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-05-08T21:10:02.301995+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=2, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.498 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.499 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.499 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-05-08T21:10:02.301995+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=2, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.499 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.499 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.499 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-05-08T21:10:02.301995+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=2, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.499 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.499 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.500 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-05-08T21:10:02.301995+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=2, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.500 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.500 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.500 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-05-08T21:10:02.301995+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=2, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.500 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.500 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.500 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-05-08T21:10:02.301995+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=2, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.500 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.500 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.501 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-05-08T21:10:02.301995+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=2, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.501 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.501 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.501 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-05-08T21:10:02.301995+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=2, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.501 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.501 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.501 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.501 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-05-08T21:10:02.301995+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=2, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.502 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.502 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.502 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-05-08T21:10:02.301995+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=2, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.502 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-08T21:09:58.287675+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=9, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.502 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.502 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.502 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-05-08T21:10:02.301995+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=2, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.502 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.502 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-05-08T21:10:02.301995+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=2, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.503 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.503 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.503 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-05-08T21:10:02.301995+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=2, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.503 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.504 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.504 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-05-08T21:10:02.301995+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=2, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.504 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.504 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.504 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-05-08T21:10:02.301995+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=2, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.504 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.504 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.505 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-05-08T21:10:02.301995+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=2, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.505 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.505 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.505 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-05-08T21:10:02.301995+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=2, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.505 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.505 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.505 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-05-08T21:10:02.301995+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=2, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.505 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.506 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.506 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-05-08T21:10:02.301995+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=2, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.506 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.506 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.506 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-05-08T21:10:02.301995+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=2, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.506 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.506 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.507 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-05-08T21:10:02.301995+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=2, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.507 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.507 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.507 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.507 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.507 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.507 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.508 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.508 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.508 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.508 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.508 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.508 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.508 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.508 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:19:59.508 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-08T21:20:19.509 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T21:20:19.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.633+0000 7f0e79f6b700 1 Processor -- start 2024-05-08T21:20:19.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.634+0000 7f0e79f6b700 1 -- start start 2024-05-08T21:20:19.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.634+0000 7f0e79f6b700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0e74150d30 0x7f0e740c20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:20:19.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.634+0000 7f0e79f6b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0e740c3cd0 0x7f0e740c8050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:20:19.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.634+0000 7f0e79f6b700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e74156c70 con 0x7f0e740c8590 2024-05-08T21:20:19.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.634+0000 7f0e79f6b700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e741577f0 con 0x7f0e740c3cd0 2024-05-08T21:20:19.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.634+0000 7f0e79f6b700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e74156f50 con 0x7f0e74150d30 2024-05-08T21:20:19.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.634+0000 7f0e72ffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0e740c3cd0 0x7f0e740c8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:20:19.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.634+0000 7f0e72ffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0e740c3cd0 0x7f0e740c8050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50966/0 (socket says 172.21.15.80:50966) 2024-05-08T21:20:19.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.634+0000 7f0e72ffd700 1 -- 172.21.15.80:0/1197831504 learned_addr learned my addr 172.21.15.80:0/1197831504 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:20:19.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.635+0000 7f0e737fe700 1 --2- 172.21.15.80:0/1197831504 >> v2:172.21.15.106:3300/0 conn(0x7f0e74150d30 0x7f0e740c20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:20:19.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.635+0000 7f0e72ffd700 1 -- 172.21.15.80:0/1197831504 >> v2:172.21.15.106:3300/0 conn(0x7f0e74150d30 msgr2=0x7f0e740c20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:20:19.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.635+0000 7f0e72ffd700 1 --2- 172.21.15.80:0/1197831504 >> v2:172.21.15.106:3300/0 conn(0x7f0e74150d30 0x7f0e740c20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:20:19.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.635+0000 7f0e72ffd700 1 -- 172.21.15.80:0/1197831504 >> v1:172.21.15.106:6789/0 conn(0x7f0e740c8590 legacy=0x7f0e740c4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:20:19.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.635+0000 7f0e72ffd700 1 -- 172.21.15.80:0/1197831504 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e74157230 con 0x7f0e740c3cd0 2024-05-08T21:20:19.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.635+0000 7f0e737fe700 1 --2- 172.21.15.80:0/1197831504 >> v2:172.21.15.106:3300/0 conn(0x7f0e74150d30 0x7f0e740c20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:20:19.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.635+0000 7f0e72ffd700 1 --2- 172.21.15.80:0/1197831504 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e740c3cd0 0x7f0e740c8050 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f0e740c5c40 tx=0x7f0e68009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c33c4d144ae880d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:20:19.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.635+0000 7f0e727fc700 1 -- 172.21.15.80:0/1197831504 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e6800b870 con 0x7f0e740c3cd0 2024-05-08T21:20:19.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.635+0000 7f0e727fc700 1 -- 172.21.15.80:0/1197831504 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e6800b9d0 con 0x7f0e740c3cd0 2024-05-08T21:20:19.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.635+0000 7f0e727fc700 1 -- 172.21.15.80:0/1197831504 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e6800bd60 con 0x7f0e740c3cd0 2024-05-08T21:20:19.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.636+0000 7f0e79f6b700 1 -- 172.21.15.80:0/1197831504 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e740c3cd0 msgr2=0x7f0e740c8050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:20:19.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.636+0000 7f0e79f6b700 1 --2- 172.21.15.80:0/1197831504 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e740c3cd0 0x7f0e740c8050 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f0e740c5c40 tx=0x7f0e68009bd0 comp rx=0 tx=0).stop 2024-05-08T21:20:19.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.636+0000 7f0e79f6b700 1 -- 172.21.15.80:0/1197831504 shutdown_connections 2024-05-08T21:20:19.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.636+0000 7f0e79f6b700 1 --2- 172.21.15.80:0/1197831504 >> v2:172.21.15.106:3300/0 conn(0x7f0e74150d30 0x7f0e740c20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:20:19.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.636+0000 7f0e79f6b700 1 --2- 172.21.15.80:0/1197831504 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e740c3cd0 0x7f0e740c8050 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:20:19.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.636+0000 7f0e79f6b700 1 -- 172.21.15.80:0/1197831504 >> 172.21.15.80:0/1197831504 conn(0x7f0e7406a9c0 msgr2=0x7f0e7406ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:20:19.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.636+0000 7f0e79f6b700 1 -- 172.21.15.80:0/1197831504 shutdown_connections 2024-05-08T21:20:19.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.636+0000 7f0e79f6b700 1 -- 172.21.15.80:0/1197831504 wait complete. 2024-05-08T21:20:19.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.637+0000 7f0e79f6b700 1 Processor -- start 2024-05-08T21:20:19.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.638+0000 7f0e79f6b700 1 -- start start 2024-05-08T21:20:19.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.638+0000 7f0e79f6b700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0e740c3cd0 0x7f0e740caf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:20:19.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.638+0000 7f0e79f6b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e740c8590 0x7f0e740c0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:20:19.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.638+0000 7f0e79f6b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0e74150d30 0x7f0e741f1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:20:19.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.638+0000 7f0e79f6b700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7414ea20 con 0x7f0e740c8590 2024-05-08T21:20:19.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.638+0000 7f0e79f6b700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7414e170 con 0x7f0e74150d30 2024-05-08T21:20:19.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.638+0000 7f0e79f6b700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7414d560 con 0x7f0e740c3cd0 2024-05-08T21:20:19.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.638+0000 7f0e72ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e740c8590 0x7f0e740c0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:20:19.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.639+0000 7f0e72ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e740c8590 0x7f0e740c0ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50970/0 (socket says 172.21.15.80:50970) 2024-05-08T21:20:19.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.639+0000 7f0e72ffd700 1 -- 172.21.15.80:0/3892534019 learned_addr learned my addr 172.21.15.80:0/3892534019 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:20:19.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.639+0000 7f0e737fe700 1 --2- 172.21.15.80:0/3892534019 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0e740c3cd0 0x7f0e740caf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:20:19.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.639+0000 7f0e73fff700 1 --2- 172.21.15.80:0/3892534019 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0e74150d30 0x7f0e741f1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:20:19.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.639+0000 7f0e72ffd700 1 -- 172.21.15.80:0/3892534019 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0e740c3cd0 msgr2=0x7f0e740caf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:20:19.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.639+0000 7f0e72ffd700 1 --2- 172.21.15.80:0/3892534019 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0e740c3cd0 0x7f0e740caf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:20:19.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.639+0000 7f0e72ffd700 1 -- 172.21.15.80:0/3892534019 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0e74150d30 msgr2=0x7f0e741f1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:20:19.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.639+0000 7f0e72ffd700 1 --2- 172.21.15.80:0/3892534019 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0e74150d30 0x7f0e741f1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:20:19.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.639+0000 7f0e72ffd700 1 -- 172.21.15.80:0/3892534019 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e68009550 con 0x7f0e740c8590 2024-05-08T21:20:19.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.639+0000 7f0e72ffd700 1 --2- 172.21.15.80:0/3892534019 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e740c8590 0x7f0e740c0ee0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f0e68000c00 tx=0x7f0e68004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:20:19.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.639+0000 7f0e5bfff700 1 -- 172.21.15.80:0/3892534019 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e68011830 con 0x7f0e740c8590 2024-05-08T21:20:19.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.639+0000 7f0e5bfff700 1 -- 172.21.15.80:0/3892534019 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e6801e070 con 0x7f0e740c8590 2024-05-08T21:20:19.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.639+0000 7f0e79f6b700 1 -- 172.21.15.80:0/3892534019 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e7414d840 con 0x7f0e740c8590 2024-05-08T21:20:19.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.639+0000 7f0e5bfff700 1 -- 172.21.15.80:0/3892534019 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e68011b90 con 0x7f0e740c8590 2024-05-08T21:20:19.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.639+0000 7f0e79f6b700 1 -- 172.21.15.80:0/3892534019 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e7414de00 con 0x7f0e740c8590 2024-05-08T21:20:19.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.640+0000 7f0e79f6b700 1 -- 172.21.15.80:0/3892534019 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e7404ec60 con 0x7f0e740c8590 2024-05-08T21:20:19.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.641+0000 7f0e5bfff700 1 -- 172.21.15.80:0/3892534019 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0e68011cf0 con 0x7f0e740c8590 2024-05-08T21:20:19.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.641+0000 7f0e5bfff700 1 --2- 172.21.15.80:0/3892534019 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f0e6006ac90 0x7f0e6006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:20:19.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.641+0000 7f0e5bfff700 1 -- 172.21.15.80:0/3892534019 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f0e68020070 con 0x7f0e740c8590 2024-05-08T21:20:19.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.641+0000 7f0e737fe700 1 --2- 172.21.15.80:0/3892534019 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f0e6006ac90 0x7f0e6006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:20:19.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.642+0000 7f0e737fe700 1 --2- 172.21.15.80:0/3892534019 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f0e6006ac90 0x7f0e6006d150 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0e6400c940 tx=0x7f0e64008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:20:19.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.645+0000 7f0e5bfff700 1 -- 172.21.15.80:0/3892534019 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f0e68055ea0 con 0x7f0e740c8590 2024-05-08T21:20:19.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.844+0000 7f0e79f6b700 1 -- 172.21.15.80:0/3892534019 --> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0e7406d760 con 0x7f0e6006ac90 2024-05-08T21:20:19.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.854+0000 7f0e5bfff700 1 -- 172.21.15.80:0/3892534019 <== mgr.4100 v2:172.21.15.80:6832/46731 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367654 (secure 0 0 0) 0x7f0e7406d760 con 0x7f0e6006ac90 2024-05-08T21:20:19.861 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:20:19.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.859+0000 7f0e79f6b700 1 -- 172.21.15.80:0/3892534019 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f0e6006ac90 msgr2=0x7f0e6006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:20:19.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.859+0000 7f0e79f6b700 1 --2- 172.21.15.80:0/3892534019 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f0e6006ac90 0x7f0e6006d150 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0e6400c940 tx=0x7f0e64008040 comp rx=0 tx=0).stop 2024-05-08T21:20:19.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.859+0000 7f0e79f6b700 1 -- 172.21.15.80:0/3892534019 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e740c8590 msgr2=0x7f0e740c0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:20:19.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.859+0000 7f0e79f6b700 1 --2- 172.21.15.80:0/3892534019 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e740c8590 0x7f0e740c0ee0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f0e68000c00 tx=0x7f0e68004750 comp rx=0 tx=0).stop 2024-05-08T21:20:19.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.859+0000 7f0e79f6b700 1 -- 172.21.15.80:0/3892534019 shutdown_connections 2024-05-08T21:20:19.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.859+0000 7f0e79f6b700 1 --2- 172.21.15.80:0/3892534019 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f0e6006ac90 0x7f0e6006d150 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:20:19.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.859+0000 7f0e79f6b700 1 --2- 172.21.15.80:0/3892534019 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0e74150d30 0x7f0e741f1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:20:19.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.859+0000 7f0e79f6b700 1 --2- 172.21.15.80:0/3892534019 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0e740c3cd0 0x7f0e740caf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:20:19.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.859+0000 7f0e79f6b700 1 --2- 172.21.15.80:0/3892534019 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0e740c8590 0x7f0e740c0ee0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:20:19.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.859+0000 7f0e79f6b700 1 -- 172.21.15.80:0/3892534019 >> 172.21.15.80:0/3892534019 conn(0x7f0e7406a9c0 msgr2=0x7f0e740cb930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:20:19.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.859+0000 7f0e79f6b700 1 -- 172.21.15.80:0/3892534019 shutdown_connections 2024-05-08T21:20:19.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:19.859+0000 7f0e79f6b700 1 -- 172.21.15.80:0/3892534019 wait complete. 2024-05-08T21:20:19.865 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-05-08T21:20:19.874 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":337,"stamp":"2024-05-08T21:20:18.508158+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":16427784,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":2254,"num_read_kb":39820,"num_write":1717439,"num_write_kb":22166553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":136227,"ondisk_log_size":136227,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":7386224,"kb_used_data":20208,"kb_used_omap":12,"kb_used_meta":7365939,"kb_avail":747588496,"statfs":{"total":773094113280,"available":765530619904,"internally_reserved":0,"allocated":20692992,"data_stored":34046440,"data_compressed":2997784,"data_compressed_allocated":3997696,"data_compressed_original":18980864,"omap_allocated":12743,"internal_metadata":7542722105},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003364"},"pg_stats":[{"pgid":"3.3f","version":"32'8","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.275355+0000","last_change":"2024-05-08T21:10:03.747477+0000","last_active":"2024-05-08T21:19:53.275355+0000","last_peered":"2024-05-08T21:19:53.275355+0000","last_clean":"2024-05-08T21:19:53.275355+0000","last_became_active":"2024-05-08T21:10:03.747059+0000","last_became_peered":"2024-05-08T21:10:03.747059+0000","last_unstale":"2024-05-08T21:19:53.275355+0000","last_undegraded":"2024-05-08T21:19:53.275355+0000","last_fullsized":"2024-05-08T21:19:53.275355+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"32'6","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:01.277399+0000","last_change":"2024-05-08T21:20:01.277494+0000","last_active":"2024-05-08T21:20:01.277399+0000","last_peered":"2024-05-08T21:20:01.277399+0000","last_clean":"2024-05-08T21:20:01.277399+0000","last_became_active":"2024-05-08T21:10:03.738466+0000","last_became_peered":"2024-05-08T21:10:03.738466+0000","last_unstale":"2024-05-08T21:20:01.277399+0000","last_undegraded":"2024-05-08T21:20:01.277399+0000","last_fullsized":"2024-05-08T21:20:01.277399+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-08T21:20:01.277377+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-08T21:20:01.277377+0000","last_clean_scrub_stamp":"2024-05-08T21:20:01.277377+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:32:05.453713+0000","scrub_duration":0.0039052399999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"32'13","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:06.583983+0000","last_change":"2024-05-08T21:20:06.584071+0000","last_active":"2024-05-08T21:20:06.583983+0000","last_peered":"2024-05-08T21:20:06.583983+0000","last_clean":"2024-05-08T21:20:06.583983+0000","last_became_active":"2024-05-08T21:10:03.739884+0000","last_became_peered":"2024-05-08T21:10:03.739884+0000","last_unstale":"2024-05-08T21:20:06.583983+0000","last_undegraded":"2024-05-08T21:20:06.583983+0000","last_fullsized":"2024-05-08T21:20:06.583983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'13","last_scrub_stamp":"2024-05-08T21:20:06.583961+0000","last_deep_scrub":"32'13","last_deep_scrub_stamp":"2024-05-08T21:20:06.583961+0000","last_clean_scrub_stamp":"2024-05-08T21:20:06.583961+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:24:50.098329+0000","scrub_duration":0.0046022240000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"32'6","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:57.787680+0000","last_change":"2024-05-08T21:10:03.754159+0000","last_active":"2024-05-08T21:19:57.787680+0000","last_peered":"2024-05-08T21:19:57.787680+0000","last_clean":"2024-05-08T21:19:57.787680+0000","last_became_active":"2024-05-08T21:10:03.753800+0000","last_became_peered":"2024-05-08T21:10:03.753800+0000","last_unstale":"2024-05-08T21:19:57.787680+0000","last_undegraded":"2024-05-08T21:19:57.787680+0000","last_fullsized":"2024-05-08T21:19:57.787680+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"32'11","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:59.065095+0000","last_change":"2024-05-08T21:10:03.750051+0000","last_active":"2024-05-08T21:19:59.065095+0000","last_peered":"2024-05-08T21:19:59.065095+0000","last_clean":"2024-05-08T21:19:59.065095+0000","last_became_active":"2024-05-08T21:10:03.749730+0000","last_became_peered":"2024-05-08T21:10:03.749730+0000","last_unstale":"2024-05-08T21:19:59.065095+0000","last_undegraded":"2024-05-08T21:19:59.065095+0000","last_fullsized":"2024-05-08T21:19:59.065095+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"32'11","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.300011+0000","last_change":"2024-05-08T21:10:53.473952+0000","last_active":"2024-05-08T21:19:53.300011+0000","last_peered":"2024-05-08T21:19:53.300011+0000","last_clean":"2024-05-08T21:19:53.300011+0000","last_became_active":"2024-05-08T21:10:53.473632+0000","last_became_peered":"2024-05-08T21:10:53.473632+0000","last_unstale":"2024-05-08T21:19:53.300011+0000","last_undegraded":"2024-05-08T21:19:53.300011+0000","last_fullsized":"2024-05-08T21:19:53.300011+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"32'8","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:59.065022+0000","last_change":"2024-05-08T21:10:03.743802+0000","last_active":"2024-05-08T21:19:59.065022+0000","last_peered":"2024-05-08T21:19:59.065022+0000","last_clean":"2024-05-08T21:19:59.065022+0000","last_became_active":"2024-05-08T21:10:03.743349+0000","last_became_peered":"2024-05-08T21:10:03.743349+0000","last_unstale":"2024-05-08T21:19:59.065022+0000","last_undegraded":"2024-05-08T21:19:59.065022+0000","last_fullsized":"2024-05-08T21:19:59.065022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"32'6","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:56.742713+0000","last_change":"2024-05-08T21:10:03.747558+0000","last_active":"2024-05-08T21:19:56.742713+0000","last_peered":"2024-05-08T21:19:56.742713+0000","last_clean":"2024-05-08T21:19:56.742713+0000","last_became_active":"2024-05-08T21:10:03.747300+0000","last_became_peered":"2024-05-08T21:10:03.747300+0000","last_unstale":"2024-05-08T21:19:56.742713+0000","last_undegraded":"2024-05-08T21:19:56.742713+0000","last_fullsized":"2024-05-08T21:19:56.742713+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"32'16","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.263123+0000","last_change":"2024-05-08T21:10:03.748221+0000","last_active":"2024-05-08T21:19:53.263123+0000","last_peered":"2024-05-08T21:19:53.263123+0000","last_clean":"2024-05-08T21:19:53.263123+0000","last_became_active":"2024-05-08T21:10:03.747956+0000","last_became_peered":"2024-05-08T21:10:03.747956+0000","last_unstale":"2024-05-08T21:19:53.263123+0000","last_undegraded":"2024-05-08T21:19:53.263123+0000","last_fullsized":"2024-05-08T21:19:53.263123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"32'11","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:54.853684+0000","last_change":"2024-05-08T21:10:03.745291+0000","last_active":"2024-05-08T21:19:54.853684+0000","last_peered":"2024-05-08T21:19:54.853684+0000","last_clean":"2024-05-08T21:19:54.853684+0000","last_became_active":"2024-05-08T21:10:03.744976+0000","last_became_peered":"2024-05-08T21:10:03.744976+0000","last_unstale":"2024-05-08T21:19:54.853684+0000","last_undegraded":"2024-05-08T21:19:54.853684+0000","last_fullsized":"2024-05-08T21:19:54.853684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"32'12","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:54.853670+0000","last_change":"2024-05-08T21:10:03.748518+0000","last_active":"2024-05-08T21:19:54.853670+0000","last_peered":"2024-05-08T21:19:54.853670+0000","last_clean":"2024-05-08T21:19:54.853670+0000","last_became_active":"2024-05-08T21:10:03.748253+0000","last_became_peered":"2024-05-08T21:10:03.748253+0000","last_unstale":"2024-05-08T21:19:54.853670+0000","last_undegraded":"2024-05-08T21:19:54.853670+0000","last_fullsized":"2024-05-08T21:19:54.853670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"32'11","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.274918+0000","last_change":"2024-05-08T21:10:03.745985+0000","last_active":"2024-05-08T21:19:53.274918+0000","last_peered":"2024-05-08T21:19:53.274918+0000","last_clean":"2024-05-08T21:19:53.274918+0000","last_became_active":"2024-05-08T21:10:03.745247+0000","last_became_peered":"2024-05-08T21:10:03.745247+0000","last_unstale":"2024-05-08T21:19:53.274918+0000","last_undegraded":"2024-05-08T21:19:53.274918+0000","last_fullsized":"2024-05-08T21:19:53.274918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"32'15","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:58.769193+0000","last_change":"2024-05-08T21:19:58.769310+0000","last_active":"2024-05-08T21:19:58.769193+0000","last_peered":"2024-05-08T21:19:58.769193+0000","last_clean":"2024-05-08T21:19:58.769193+0000","last_became_active":"2024-05-08T21:10:03.746848+0000","last_became_peered":"2024-05-08T21:10:03.746848+0000","last_unstale":"2024-05-08T21:19:58.769193+0000","last_undegraded":"2024-05-08T21:19:58.769193+0000","last_fullsized":"2024-05-08T21:19:58.769193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-05-08T21:19:58.769170+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-05-08T21:19:58.769170+0000","last_clean_scrub_stamp":"2024-05-08T21:19:58.769170+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:44:20.357961+0000","scrub_duration":0.027292114999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"32'17","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.185744+0000","last_change":"2024-05-08T21:10:03.737984+0000","last_active":"2024-05-08T21:19:53.185744+0000","last_peered":"2024-05-08T21:19:53.185744+0000","last_clean":"2024-05-08T21:19:53.185744+0000","last_became_active":"2024-05-08T21:10:03.737716+0000","last_became_peered":"2024-05-08T21:10:03.737716+0000","last_unstale":"2024-05-08T21:19:53.185744+0000","last_undegraded":"2024-05-08T21:19:53.185744+0000","last_fullsized":"2024-05-08T21:19:53.185744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"32'13","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.266055+0000","last_change":"2024-05-08T21:10:03.744543+0000","last_active":"2024-05-08T21:19:53.266055+0000","last_peered":"2024-05-08T21:19:53.266055+0000","last_clean":"2024-05-08T21:19:53.266055+0000","last_became_active":"2024-05-08T21:10:03.744276+0000","last_became_peered":"2024-05-08T21:10:03.744276+0000","last_unstale":"2024-05-08T21:19:53.266055+0000","last_undegraded":"2024-05-08T21:19:53.266055+0000","last_fullsized":"2024-05-08T21:19:53.266055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"32'13","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.180928+0000","last_change":"2024-05-08T21:10:03.746547+0000","last_active":"2024-05-08T21:19:53.180928+0000","last_peered":"2024-05-08T21:19:53.180928+0000","last_clean":"2024-05-08T21:19:53.180928+0000","last_became_active":"2024-05-08T21:10:03.745862+0000","last_became_peered":"2024-05-08T21:10:03.745862+0000","last_unstale":"2024-05-08T21:19:53.180928+0000","last_undegraded":"2024-05-08T21:19:53.180928+0000","last_fullsized":"2024-05-08T21:19:53.180928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"32'13","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:56.226107+0000","last_change":"2024-05-08T21:10:54.028844+0000","last_active":"2024-05-08T21:19:56.226107+0000","last_peered":"2024-05-08T21:19:56.226107+0000","last_clean":"2024-05-08T21:19:56.226107+0000","last_became_active":"2024-05-08T21:10:54.028630+0000","last_became_peered":"2024-05-08T21:10:54.028630+0000","last_unstale":"2024-05-08T21:19:56.226107+0000","last_undegraded":"2024-05-08T21:19:56.226107+0000","last_fullsized":"2024-05-08T21:19:56.226107+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"32'17","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:09.346737+0000","last_change":"2024-05-08T21:20:09.346874+0000","last_active":"2024-05-08T21:20:09.346737+0000","last_peered":"2024-05-08T21:20:09.346737+0000","last_clean":"2024-05-08T21:20:09.346737+0000","last_became_active":"2024-05-08T21:10:03.743596+0000","last_became_peered":"2024-05-08T21:10:03.743596+0000","last_unstale":"2024-05-08T21:20:09.346737+0000","last_undegraded":"2024-05-08T21:20:09.346737+0000","last_fullsized":"2024-05-08T21:20:09.346737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'17","last_scrub_stamp":"2024-05-08T21:20:09.346697+0000","last_deep_scrub":"32'17","last_deep_scrub_stamp":"2024-05-08T21:20:09.346697+0000","last_clean_scrub_stamp":"2024-05-08T21:20:09.346697+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:36:15.220278+0000","scrub_duration":0.0019157390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"32'15","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.066176+0000","last_change":"2024-05-08T21:10:03.743893+0000","last_active":"2024-05-08T21:19:53.066176+0000","last_peered":"2024-05-08T21:19:53.066176+0000","last_clean":"2024-05-08T21:19:53.066176+0000","last_became_active":"2024-05-08T21:10:03.743580+0000","last_became_peered":"2024-05-08T21:10:03.743580+0000","last_unstale":"2024-05-08T21:19:53.066176+0000","last_undegraded":"2024-05-08T21:19:53.066176+0000","last_fullsized":"2024-05-08T21:19:53.066176+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"32'4303","reported_seq":4393,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.616922+0000","last_change":"2024-05-08T21:10:08.052394+0000","last_active":"2024-05-08T21:19:53.616922+0000","last_peered":"2024-05-08T21:19:53.616922+0000","last_clean":"2024-05-08T21:19:53.616922+0000","last_became_active":"2024-05-08T21:10:08.052009+0000","last_became_peered":"2024-05-08T21:10:08.052009+0000","last_unstale":"2024-05-08T21:19:53.616922+0000","last_undegraded":"2024-05-08T21:19:53.616922+0000","last_fullsized":"2024-05-08T21:19:53.616922+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4303,"log_dups_size":0,"ondisk_log_size":4303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":0,"num_write":56160,"num_write_kb":728959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"32'474","reported_seq":523,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:03.577331+0000","last_change":"2024-05-08T21:20:03.577407+0000","last_active":"2024-05-08T21:20:03.577331+0000","last_peered":"2024-05-08T21:20:03.577331+0000","last_clean":"2024-05-08T21:20:03.577331+0000","last_became_active":"2024-05-08T21:10:03.339847+0000","last_became_peered":"2024-05-08T21:10:03.339847+0000","last_unstale":"2024-05-08T21:20:03.577331+0000","last_undegraded":"2024-05-08T21:20:03.577331+0000","last_fullsized":"2024-05-08T21:20:03.577331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'474","last_scrub_stamp":"2024-05-08T21:20:03.577308+0000","last_deep_scrub":"32'474","last_deep_scrub_stamp":"2024-05-08T21:20:03.577308+0000","last_clean_scrub_stamp":"2024-05-08T21:20:03.577308+0000","objects_scrubbed":3,"log_size":474,"log_dups_size":0,"ondisk_log_size":474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:33:31.180492+0000","scrub_duration":0.013062450999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3159557,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":1370,"num_write":465,"num_write_kb":3345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"32'7","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.175608+0000","last_change":"2024-05-08T21:10:03.746516+0000","last_active":"2024-05-08T21:19:53.175608+0000","last_peered":"2024-05-08T21:19:53.175608+0000","last_clean":"2024-05-08T21:19:53.175608+0000","last_became_active":"2024-05-08T21:10:03.746383+0000","last_became_peered":"2024-05-08T21:10:03.746383+0000","last_unstale":"2024-05-08T21:19:53.175608+0000","last_undegraded":"2024-05-08T21:19:53.175608+0000","last_fullsized":"2024-05-08T21:19:53.175608+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'4174","reported_seq":4264,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:54.850299+0000","last_change":"2024-05-08T21:10:53.484902+0000","last_active":"2024-05-08T21:19:54.850299+0000","last_peered":"2024-05-08T21:19:54.850299+0000","last_clean":"2024-05-08T21:19:54.850299+0000","last_became_active":"2024-05-08T21:10:53.484437+0000","last_became_peered":"2024-05-08T21:10:53.484437+0000","last_unstale":"2024-05-08T21:19:54.850299+0000","last_undegraded":"2024-05-08T21:19:54.850299+0000","last_fullsized":"2024-05-08T21:19:54.850299+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4174,"log_dups_size":0,"ondisk_log_size":4174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":0,"num_write":53711,"num_write_kb":702965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2,3],"acting":[4,6,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"32'7","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:12.814124+0000","last_change":"2024-05-08T21:20:12.814201+0000","last_active":"2024-05-08T21:20:12.814124+0000","last_peered":"2024-05-08T21:20:12.814124+0000","last_clean":"2024-05-08T21:20:12.814124+0000","last_became_active":"2024-05-08T21:10:03.328970+0000","last_became_peered":"2024-05-08T21:10:03.328970+0000","last_unstale":"2024-05-08T21:20:12.814124+0000","last_undegraded":"2024-05-08T21:20:12.814124+0000","last_fullsized":"2024-05-08T21:20:12.814124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-05-08T21:20:12.814101+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-05-08T21:20:12.814101+0000","last_clean_scrub_stamp":"2024-05-08T21:20:12.814101+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:43:38.340101+0000","scrub_duration":0.0011883289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"32'13","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.308072+0000","last_change":"2024-05-08T21:10:03.748566+0000","last_active":"2024-05-08T21:19:53.308072+0000","last_peered":"2024-05-08T21:19:53.308072+0000","last_clean":"2024-05-08T21:19:53.308072+0000","last_became_active":"2024-05-08T21:10:03.747989+0000","last_became_peered":"2024-05-08T21:10:03.747989+0000","last_unstale":"2024-05-08T21:19:53.308072+0000","last_undegraded":"2024-05-08T21:19:53.308072+0000","last_fullsized":"2024-05-08T21:19:53.308072+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"32'4151","reported_seq":4236,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:57.259663+0000","last_change":"2024-05-08T21:10:07.770390+0000","last_active":"2024-05-08T21:19:57.259663+0000","last_peered":"2024-05-08T21:19:57.259663+0000","last_clean":"2024-05-08T21:19:57.259663+0000","last_became_active":"2024-05-08T21:10:07.770017+0000","last_became_peered":"2024-05-08T21:10:07.770017+0000","last_unstale":"2024-05-08T21:19:57.259663+0000","last_undegraded":"2024-05-08T21:19:57.259663+0000","last_fullsized":"2024-05-08T21:19:57.259663+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4151,"log_dups_size":0,"ondisk_log_size":4151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":0,"num_write":52838,"num_write_kb":674205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"32'17","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:59.064956+0000","last_change":"2024-05-08T21:10:03.339207+0000","last_active":"2024-05-08T21:19:59.064956+0000","last_peered":"2024-05-08T21:19:59.064956+0000","last_clean":"2024-05-08T21:19:59.064956+0000","last_became_active":"2024-05-08T21:10:03.338917+0000","last_became_peered":"2024-05-08T21:10:03.338917+0000","last_unstale":"2024-05-08T21:19:59.064956+0000","last_undegraded":"2024-05-08T21:19:59.064956+0000","last_fullsized":"2024-05-08T21:19:59.064956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":8,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"32'8","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.032545+0000","last_change":"2024-05-08T21:10:53.477056+0000","last_active":"2024-05-08T21:19:53.032545+0000","last_peered":"2024-05-08T21:19:53.032545+0000","last_clean":"2024-05-08T21:19:53.032545+0000","last_became_active":"2024-05-08T21:10:53.476785+0000","last_became_peered":"2024-05-08T21:10:53.476785+0000","last_unstale":"2024-05-08T21:19:53.032545+0000","last_undegraded":"2024-05-08T21:19:53.032545+0000","last_fullsized":"2024-05-08T21:19:53.032545+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"32'3545","reported_seq":3612,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:57.259669+0000","last_change":"2024-05-08T21:10:07.776367+0000","last_active":"2024-05-08T21:19:57.259669+0000","last_peered":"2024-05-08T21:19:57.259669+0000","last_clean":"2024-05-08T21:19:57.259669+0000","last_became_active":"2024-05-08T21:10:07.775998+0000","last_became_peered":"2024-05-08T21:10:07.775998+0000","last_unstale":"2024-05-08T21:19:57.259669+0000","last_undegraded":"2024-05-08T21:19:57.259669+0000","last_fullsized":"2024-05-08T21:19:57.259669+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":3545,"log_dups_size":0,"ondisk_log_size":3545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":0,"num_write":46338,"num_write_kb":599175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"32'6","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:59.064867+0000","last_change":"2024-05-08T21:10:03.339182+0000","last_active":"2024-05-08T21:19:59.064867+0000","last_peered":"2024-05-08T21:19:59.064867+0000","last_clean":"2024-05-08T21:19:59.064867+0000","last_became_active":"2024-05-08T21:10:03.338899+0000","last_became_peered":"2024-05-08T21:10:03.338899+0000","last_unstale":"2024-05-08T21:19:59.064867+0000","last_undegraded":"2024-05-08T21:19:59.064867+0000","last_fullsized":"2024-05-08T21:19:59.064867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"32'14","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:57.787551+0000","last_change":"2024-05-08T21:10:03.750724+0000","last_active":"2024-05-08T21:19:57.787551+0000","last_peered":"2024-05-08T21:19:57.787551+0000","last_clean":"2024-05-08T21:19:57.787551+0000","last_became_active":"2024-05-08T21:10:03.750371+0000","last_became_peered":"2024-05-08T21:10:03.750371+0000","last_unstale":"2024-05-08T21:19:57.787551+0000","last_undegraded":"2024-05-08T21:19:57.787551+0000","last_fullsized":"2024-05-08T21:19:57.787551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"32'4480","reported_seq":4569,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:56.742653+0000","last_change":"2024-05-08T21:10:07.767604+0000","last_active":"2024-05-08T21:19:56.742653+0000","last_peered":"2024-05-08T21:19:56.742653+0000","last_clean":"2024-05-08T21:19:56.742653+0000","last_became_active":"2024-05-08T21:10:07.767234+0000","last_became_peered":"2024-05-08T21:10:07.767234+0000","last_unstale":"2024-05-08T21:19:56.742653+0000","last_undegraded":"2024-05-08T21:19:56.742653+0000","last_fullsized":"2024-05-08T21:19:56.742653+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4480,"log_dups_size":0,"ondisk_log_size":4480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":0,"num_write":57901,"num_write_kb":753617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"32'1296","reported_seq":1337,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:09.764169+0000","last_change":"2024-05-08T21:20:09.764290+0000","last_active":"2024-05-08T21:20:09.764169+0000","last_peered":"2024-05-08T21:20:09.764169+0000","last_clean":"2024-05-08T21:20:09.764169+0000","last_became_active":"2024-05-08T21:10:03.337860+0000","last_became_peered":"2024-05-08T21:10:03.337860+0000","last_unstale":"2024-05-08T21:20:09.764169+0000","last_undegraded":"2024-05-08T21:20:09.764169+0000","last_fullsized":"2024-05-08T21:20:09.764169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'1296","last_scrub_stamp":"2024-05-08T21:20:09.764127+0000","last_deep_scrub":"32'1296","last_deep_scrub_stamp":"2024-05-08T21:20:09.764127+0000","last_clean_scrub_stamp":"2024-05-08T21:20:09.764127+0000","objects_scrubbed":1,"log_size":1296,"log_dups_size":0,"ondisk_log_size":1296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:11:05.072292+0000","scrub_duration":0.015328803,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":1290,"num_write_kb":5292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"32'12","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:58.476141+0000","last_change":"2024-05-08T21:19:58.476141+0000","last_active":"2024-05-08T21:19:58.476141+0000","last_peered":"2024-05-08T21:19:58.476141+0000","last_clean":"2024-05-08T21:19:58.476141+0000","last_became_active":"2024-05-08T21:10:03.743227+0000","last_became_peered":"2024-05-08T21:10:03.743227+0000","last_unstale":"2024-05-08T21:19:58.476141+0000","last_undegraded":"2024-05-08T21:19:58.476141+0000","last_fullsized":"2024-05-08T21:19:58.476141+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-08T21:19:58.475998+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-08T21:19:58.475998+0000","last_clean_scrub_stamp":"2024-05-08T21:19:58.475998+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:35:21.268713+0000","scrub_duration":0.001760143,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"32'3361","reported_seq":3426,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:56.226114+0000","last_change":"2024-05-08T21:10:07.768424+0000","last_active":"2024-05-08T21:19:56.226114+0000","last_peered":"2024-05-08T21:19:56.226114+0000","last_clean":"2024-05-08T21:19:56.226114+0000","last_became_active":"2024-05-08T21:10:07.768160+0000","last_became_peered":"2024-05-08T21:10:07.768160+0000","last_unstale":"2024-05-08T21:19:56.226114+0000","last_undegraded":"2024-05-08T21:19:56.226114+0000","last_fullsized":"2024-05-08T21:19:56.226114+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":3361,"log_dups_size":0,"ondisk_log_size":3361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":0,"num_write":43355,"num_write_kb":562121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"32'9","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:02.828459+0000","last_change":"2024-05-08T21:20:02.828565+0000","last_active":"2024-05-08T21:20:02.828459+0000","last_peered":"2024-05-08T21:20:02.828459+0000","last_clean":"2024-05-08T21:20:02.828459+0000","last_became_active":"2024-05-08T21:10:03.332844+0000","last_became_peered":"2024-05-08T21:10:03.332844+0000","last_unstale":"2024-05-08T21:20:02.828459+0000","last_undegraded":"2024-05-08T21:20:02.828459+0000","last_fullsized":"2024-05-08T21:20:02.828459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-05-08T21:20:02.828433+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-05-08T21:20:02.828433+0000","last_clean_scrub_stamp":"2024-05-08T21:20:02.828433+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:53:55.069397+0000","scrub_duration":0.001788127,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"32'12","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:11.631350+0000","last_change":"2024-05-08T21:20:11.631446+0000","last_active":"2024-05-08T21:20:11.631350+0000","last_peered":"2024-05-08T21:20:11.631350+0000","last_clean":"2024-05-08T21:20:11.631350+0000","last_became_active":"2024-05-08T21:10:03.742753+0000","last_became_peered":"2024-05-08T21:10:03.742753+0000","last_unstale":"2024-05-08T21:20:11.631350+0000","last_undegraded":"2024-05-08T21:20:11.631350+0000","last_fullsized":"2024-05-08T21:20:11.631350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-08T21:20:11.631327+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-08T21:20:11.631327+0000","last_clean_scrub_stamp":"2024-05-08T21:20:11.631327+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:50:05.535730+0000","scrub_duration":0.01930291,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4240","reported_seq":4334,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.318629+0000","last_change":"2024-05-08T21:10:07.770105+0000","last_active":"2024-05-08T21:19:53.318629+0000","last_peered":"2024-05-08T21:19:53.318629+0000","last_clean":"2024-05-08T21:19:53.318629+0000","last_became_active":"2024-05-08T21:10:07.769668+0000","last_became_peered":"2024-05-08T21:10:07.769668+0000","last_unstale":"2024-05-08T21:19:53.318629+0000","last_undegraded":"2024-05-08T21:19:53.318629+0000","last_fullsized":"2024-05-08T21:19:53.318629+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4240,"log_dups_size":0,"ondisk_log_size":4240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":0,"num_write":54954,"num_write_kb":711961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"32'4","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:03.662340+0000","last_change":"2024-05-08T21:20:03.662462+0000","last_active":"2024-05-08T21:20:03.662340+0000","last_peered":"2024-05-08T21:20:03.662340+0000","last_clean":"2024-05-08T21:20:03.662340+0000","last_became_active":"2024-05-08T21:10:03.332750+0000","last_became_peered":"2024-05-08T21:10:03.332750+0000","last_unstale":"2024-05-08T21:20:03.662340+0000","last_undegraded":"2024-05-08T21:20:03.662340+0000","last_fullsized":"2024-05-08T21:20:03.662340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T21:20:03.662300+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T21:20:03.662300+0000","last_clean_scrub_stamp":"2024-05-08T21:20:03.662300+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:38:24.800703+0000","scrub_duration":0.001741189,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'19","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:01.739268+0000","last_change":"2024-05-08T21:20:01.739343+0000","last_active":"2024-05-08T21:20:01.739268+0000","last_peered":"2024-05-08T21:20:01.739268+0000","last_clean":"2024-05-08T21:20:01.739268+0000","last_became_active":"2024-05-08T21:10:03.743724+0000","last_became_peered":"2024-05-08T21:10:03.743724+0000","last_unstale":"2024-05-08T21:20:01.739268+0000","last_undegraded":"2024-05-08T21:20:01.739268+0000","last_fullsized":"2024-05-08T21:20:01.739268+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'19","last_scrub_stamp":"2024-05-08T21:20:01.739244+0000","last_deep_scrub":"32'19","last_deep_scrub_stamp":"2024-05-08T21:20:01.739244+0000","last_clean_scrub_stamp":"2024-05-08T21:20:01.739244+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:24:59.758236+0000","scrub_duration":0.0011762560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"32'4835","reported_seq":4931,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:55.139269+0000","last_change":"2024-05-08T21:10:08.052307+0000","last_active":"2024-05-08T21:19:55.139269+0000","last_peered":"2024-05-08T21:19:55.139269+0000","last_clean":"2024-05-08T21:19:55.139269+0000","last_became_active":"2024-05-08T21:10:08.051924+0000","last_became_peered":"2024-05-08T21:10:08.051924+0000","last_unstale":"2024-05-08T21:19:55.139269+0000","last_undegraded":"2024-05-08T21:19:55.139269+0000","last_fullsized":"2024-05-08T21:19:55.139269+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4835,"log_dups_size":0,"ondisk_log_size":4835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":0,"num_write":62640,"num_write_kb":808641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:13.384814+0000","last_change":"2024-05-08T21:20:13.384926+0000","last_active":"2024-05-08T21:20:13.384814+0000","last_peered":"2024-05-08T21:20:13.384814+0000","last_clean":"2024-05-08T21:20:13.384814+0000","last_became_active":"2024-05-08T21:10:03.330054+0000","last_became_peered":"2024-05-08T21:10:03.330054+0000","last_unstale":"2024-05-08T21:20:13.384814+0000","last_undegraded":"2024-05-08T21:20:13.384814+0000","last_fullsized":"2024-05-08T21:20:13.384814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:20:13.384790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:20:13.384790+0000","last_clean_scrub_stamp":"2024-05-08T21:20:13.384790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:47:44.021224+0000","scrub_duration":0.0013472479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"32'9","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:00.300968+0000","last_change":"2024-05-08T21:20:00.301081+0000","last_active":"2024-05-08T21:20:00.300968+0000","last_peered":"2024-05-08T21:20:00.300968+0000","last_clean":"2024-05-08T21:20:00.300968+0000","last_became_active":"2024-05-08T21:10:03.739425+0000","last_became_peered":"2024-05-08T21:10:03.739425+0000","last_unstale":"2024-05-08T21:20:00.300968+0000","last_undegraded":"2024-05-08T21:20:00.300968+0000","last_fullsized":"2024-05-08T21:20:00.300968+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-05-08T21:20:00.300945+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-05-08T21:20:00.300945+0000","last_clean_scrub_stamp":"2024-05-08T21:20:00.300945+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:19:46.530428+0000","scrub_duration":0.0052140820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"32'4216","reported_seq":4297,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.277483+0000","last_change":"2024-05-08T21:10:08.050980+0000","last_active":"2024-05-08T21:19:53.277483+0000","last_peered":"2024-05-08T21:19:53.277483+0000","last_clean":"2024-05-08T21:19:53.277483+0000","last_became_active":"2024-05-08T21:10:08.050625+0000","last_became_peered":"2024-05-08T21:10:08.050625+0000","last_unstale":"2024-05-08T21:19:53.277483+0000","last_undegraded":"2024-05-08T21:19:53.277483+0000","last_fullsized":"2024-05-08T21:19:53.277483+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4216,"log_dups_size":0,"ondisk_log_size":4216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":0,"num_write":54049,"num_write_kb":693342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"32'4","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:12.887724+0000","last_change":"2024-05-08T21:20:12.887825+0000","last_active":"2024-05-08T21:20:12.887724+0000","last_peered":"2024-05-08T21:20:12.887724+0000","last_clean":"2024-05-08T21:20:12.887724+0000","last_became_active":"2024-05-08T21:10:03.330973+0000","last_became_peered":"2024-05-08T21:10:03.330973+0000","last_unstale":"2024-05-08T21:20:12.887724+0000","last_undegraded":"2024-05-08T21:20:12.887724+0000","last_fullsized":"2024-05-08T21:20:12.887724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T21:20:12.887700+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T21:20:12.887700+0000","last_clean_scrub_stamp":"2024-05-08T21:20:12.887700+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:59:10.235660+0000","scrub_duration":0.0015778560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"32'15","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.288908+0000","last_change":"2024-05-08T21:10:03.751746+0000","last_active":"2024-05-08T21:19:53.288908+0000","last_peered":"2024-05-08T21:19:53.288908+0000","last_clean":"2024-05-08T21:19:53.288908+0000","last_became_active":"2024-05-08T21:10:03.751426+0000","last_became_peered":"2024-05-08T21:10:03.751426+0000","last_unstale":"2024-05-08T21:19:53.288908+0000","last_undegraded":"2024-05-08T21:19:53.288908+0000","last_fullsized":"2024-05-08T21:19:53.288908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"32'4067","reported_seq":4161,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.235906+0000","last_change":"2024-05-08T21:10:53.484721+0000","last_active":"2024-05-08T21:19:53.235906+0000","last_peered":"2024-05-08T21:19:53.235906+0000","last_clean":"2024-05-08T21:19:53.235906+0000","last_became_active":"2024-05-08T21:10:53.484313+0000","last_became_peered":"2024-05-08T21:10:53.484313+0000","last_unstale":"2024-05-08T21:19:53.235906+0000","last_undegraded":"2024-05-08T21:19:53.235906+0000","last_fullsized":"2024-05-08T21:19:53.235906+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4067,"log_dups_size":0,"ondisk_log_size":4067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":0,"num_write":52779,"num_write_kb":673924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"32'3","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:01.367256+0000","last_change":"2024-05-08T21:20:01.367399+0000","last_active":"2024-05-08T21:20:01.367256+0000","last_peered":"2024-05-08T21:20:01.367256+0000","last_clean":"2024-05-08T21:20:01.367256+0000","last_became_active":"2024-05-08T21:10:03.331712+0000","last_became_peered":"2024-05-08T21:10:03.331712+0000","last_unstale":"2024-05-08T21:20:01.367256+0000","last_undegraded":"2024-05-08T21:20:01.367256+0000","last_fullsized":"2024-05-08T21:20:01.367256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-05-08T21:20:01.367207+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-05-08T21:20:01.367207+0000","last_clean_scrub_stamp":"2024-05-08T21:20:01.367207+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:44:21.231895+0000","scrub_duration":0.001703927,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"32'15","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.299906+0000","last_change":"2024-05-08T21:10:03.748728+0000","last_active":"2024-05-08T21:19:53.299906+0000","last_peered":"2024-05-08T21:19:53.299906+0000","last_clean":"2024-05-08T21:19:53.299906+0000","last_became_active":"2024-05-08T21:10:03.748315+0000","last_became_peered":"2024-05-08T21:10:03.748315+0000","last_unstale":"2024-05-08T21:19:53.299906+0000","last_undegraded":"2024-05-08T21:19:53.299906+0000","last_fullsized":"2024-05-08T21:19:53.299906+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"32'4209","reported_seq":4289,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.308925+0000","last_change":"2024-05-08T21:10:07.761559+0000","last_active":"2024-05-08T21:19:53.308925+0000","last_peered":"2024-05-08T21:19:53.308925+0000","last_clean":"2024-05-08T21:19:53.308925+0000","last_became_active":"2024-05-08T21:10:07.761129+0000","last_became_peered":"2024-05-08T21:10:07.761129+0000","last_unstale":"2024-05-08T21:19:53.308925+0000","last_undegraded":"2024-05-08T21:19:53.308925+0000","last_fullsized":"2024-05-08T21:19:53.308925+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4209,"log_dups_size":0,"ondisk_log_size":4209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":0,"num_write":55217,"num_write_kb":706687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"32'19","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:13.143038+0000","last_change":"2024-05-08T21:20:13.143152+0000","last_active":"2024-05-08T21:20:13.143038+0000","last_peered":"2024-05-08T21:20:13.143038+0000","last_clean":"2024-05-08T21:20:13.143038+0000","last_became_active":"2024-05-08T21:10:03.332796+0000","last_became_peered":"2024-05-08T21:10:03.332796+0000","last_unstale":"2024-05-08T21:20:13.143038+0000","last_undegraded":"2024-05-08T21:20:13.143038+0000","last_fullsized":"2024-05-08T21:20:13.143038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'19","last_scrub_stamp":"2024-05-08T21:20:13.143014+0000","last_deep_scrub":"32'19","last_deep_scrub_stamp":"2024-05-08T21:20:13.143014+0000","last_clean_scrub_stamp":"2024-05-08T21:20:13.143014+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:05:21.634577+0000","scrub_duration":0.0039298390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":19,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"32'12","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:00.530549+0000","last_change":"2024-05-08T21:20:00.530656+0000","last_active":"2024-05-08T21:20:00.530549+0000","last_peered":"2024-05-08T21:20:00.530549+0000","last_clean":"2024-05-08T21:20:00.530549+0000","last_became_active":"2024-05-08T21:10:03.750394+0000","last_became_peered":"2024-05-08T21:10:03.750394+0000","last_unstale":"2024-05-08T21:20:00.530549+0000","last_undegraded":"2024-05-08T21:20:00.530549+0000","last_fullsized":"2024-05-08T21:20:00.530549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-08T21:20:00.530522+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-08T21:20:00.530522+0000","last_clean_scrub_stamp":"2024-05-08T21:20:00.530522+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:15:24.920108+0000","scrub_duration":0.0015651160000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"32'3898","reported_seq":3963,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.185154+0000","last_change":"2024-05-08T21:10:07.764815+0000","last_active":"2024-05-08T21:19:53.185154+0000","last_peered":"2024-05-08T21:19:53.185154+0000","last_clean":"2024-05-08T21:19:53.185154+0000","last_became_active":"2024-05-08T21:10:07.763591+0000","last_became_peered":"2024-05-08T21:10:07.763591+0000","last_unstale":"2024-05-08T21:19:53.185154+0000","last_undegraded":"2024-05-08T21:19:53.185154+0000","last_fullsized":"2024-05-08T21:19:53.185154+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":3898,"log_dups_size":0,"ondisk_log_size":3898,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":0,"num_write":50159,"num_write_kb":657283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"32'224","reported_seq":281,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:11.871388+0000","last_change":"2024-05-08T21:20:11.871495+0000","last_active":"2024-05-08T21:20:11.871388+0000","last_peered":"2024-05-08T21:20:11.871388+0000","last_clean":"2024-05-08T21:20:11.871388+0000","last_became_active":"2024-05-08T21:10:03.342202+0000","last_became_peered":"2024-05-08T21:10:03.342202+0000","last_unstale":"2024-05-08T21:20:11.871388+0000","last_undegraded":"2024-05-08T21:20:11.871388+0000","last_fullsized":"2024-05-08T21:20:11.871388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'224","last_scrub_stamp":"2024-05-08T21:20:11.871363+0000","last_deep_scrub":"32'224","last_deep_scrub_stamp":"2024-05-08T21:20:11.871363+0000","last_clean_scrub_stamp":"2024-05-08T21:20:11.871363+0000","objects_scrubbed":4,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:39:13.408501+0000","scrub_duration":0.016953936999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":37,"num_read_kb":12328,"num_write":219,"num_write_kb":4276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"32'12","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:51.206088+0000","last_change":"2024-05-08T21:10:03.752144+0000","last_active":"2024-05-08T21:19:51.206088+0000","last_peered":"2024-05-08T21:19:51.206088+0000","last_clean":"2024-05-08T21:19:51.206088+0000","last_became_active":"2024-05-08T21:10:03.751868+0000","last_became_peered":"2024-05-08T21:10:03.751868+0000","last_unstale":"2024-05-08T21:19:51.206088+0000","last_undegraded":"2024-05-08T21:19:51.206088+0000","last_fullsized":"2024-05-08T21:19:51.206088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"32'3951","reported_seq":4026,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:52.932499+0000","last_change":"2024-05-08T21:10:08.052390+0000","last_active":"2024-05-08T21:19:52.932499+0000","last_peered":"2024-05-08T21:19:52.932499+0000","last_clean":"2024-05-08T21:19:52.932499+0000","last_became_active":"2024-05-08T21:10:08.051967+0000","last_became_peered":"2024-05-08T21:10:08.051967+0000","last_unstale":"2024-05-08T21:19:52.932499+0000","last_undegraded":"2024-05-08T21:19:52.932499+0000","last_fullsized":"2024-05-08T21:19:52.932499+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":3951,"log_dups_size":0,"ondisk_log_size":3951,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":0,"num_write":50192,"num_write_kb":654171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"32'9","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:01.515901+0000","last_change":"2024-05-08T21:20:01.515989+0000","last_active":"2024-05-08T21:20:01.515901+0000","last_peered":"2024-05-08T21:20:01.515901+0000","last_clean":"2024-05-08T21:20:01.515901+0000","last_became_active":"2024-05-08T21:10:03.329761+0000","last_became_peered":"2024-05-08T21:10:03.329761+0000","last_unstale":"2024-05-08T21:20:01.515901+0000","last_undegraded":"2024-05-08T21:20:01.515901+0000","last_fullsized":"2024-05-08T21:20:01.515901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-05-08T21:20:01.515879+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-05-08T21:20:01.515879+0000","last_clean_scrub_stamp":"2024-05-08T21:20:01.515879+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:10:12.952423+0000","scrub_duration":0.0051169010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":32,"num_write":6,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"32'15","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:04.584821+0000","last_change":"2024-05-08T21:20:04.584918+0000","last_active":"2024-05-08T21:20:04.584821+0000","last_peered":"2024-05-08T21:20:04.584821+0000","last_clean":"2024-05-08T21:20:04.584821+0000","last_became_active":"2024-05-08T21:10:03.749094+0000","last_became_peered":"2024-05-08T21:10:03.749094+0000","last_unstale":"2024-05-08T21:20:04.584821+0000","last_undegraded":"2024-05-08T21:20:04.584821+0000","last_fullsized":"2024-05-08T21:20:04.584821+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-05-08T21:20:04.584798+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-05-08T21:20:04.584798+0000","last_clean_scrub_stamp":"2024-05-08T21:20:04.584798+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:15:08.630447+0000","scrub_duration":0.001938178,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"32'4387","reported_seq":4465,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.311123+0000","last_change":"2024-05-08T21:10:08.048331+0000","last_active":"2024-05-08T21:19:53.311123+0000","last_peered":"2024-05-08T21:19:53.311123+0000","last_clean":"2024-05-08T21:19:53.311123+0000","last_became_active":"2024-05-08T21:10:08.047505+0000","last_became_peered":"2024-05-08T21:10:08.047505+0000","last_unstale":"2024-05-08T21:19:53.311123+0000","last_undegraded":"2024-05-08T21:19:53.311123+0000","last_fullsized":"2024-05-08T21:19:53.311123+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4387,"log_dups_size":0,"ondisk_log_size":4387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":0,"num_write":56798,"num_write_kb":743616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"32'3","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.303802+0000","last_change":"2024-05-08T21:10:03.328021+0000","last_active":"2024-05-08T21:19:53.303802+0000","last_peered":"2024-05-08T21:19:53.303802+0000","last_clean":"2024-05-08T21:19:53.303802+0000","last_became_active":"2024-05-08T21:10:03.327648+0000","last_became_peered":"2024-05-08T21:10:03.327648+0000","last_unstale":"2024-05-08T21:19:53.303802+0000","last_undegraded":"2024-05-08T21:19:53.303802+0000","last_fullsized":"2024-05-08T21:19:53.303802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"32'15","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.224706+0000","last_change":"2024-05-08T21:10:03.750560+0000","last_active":"2024-05-08T21:19:53.224706+0000","last_peered":"2024-05-08T21:19:53.224706+0000","last_clean":"2024-05-08T21:19:53.224706+0000","last_became_active":"2024-05-08T21:10:03.750294+0000","last_became_peered":"2024-05-08T21:10:03.750294+0000","last_unstale":"2024-05-08T21:19:53.224706+0000","last_undegraded":"2024-05-08T21:19:53.224706+0000","last_fullsized":"2024-05-08T21:19:53.224706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"32'4344","reported_seq":4417,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.313448+0000","last_change":"2024-05-08T21:10:08.052318+0000","last_active":"2024-05-08T21:19:53.313448+0000","last_peered":"2024-05-08T21:19:53.313448+0000","last_clean":"2024-05-08T21:19:53.313448+0000","last_became_active":"2024-05-08T21:10:08.051920+0000","last_became_peered":"2024-05-08T21:10:08.051920+0000","last_unstale":"2024-05-08T21:19:53.313448+0000","last_undegraded":"2024-05-08T21:19:53.313448+0000","last_fullsized":"2024-05-08T21:19:53.313448+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4344,"log_dups_size":0,"ondisk_log_size":4344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":0,"num_write":56474,"num_write_kb":728506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"32'7","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:58.846319+0000","last_change":"2024-05-08T21:19:58.846430+0000","last_active":"2024-05-08T21:19:58.846319+0000","last_peered":"2024-05-08T21:19:58.846319+0000","last_clean":"2024-05-08T21:19:58.846319+0000","last_became_active":"2024-05-08T21:10:03.332105+0000","last_became_peered":"2024-05-08T21:10:03.332105+0000","last_unstale":"2024-05-08T21:19:58.846319+0000","last_undegraded":"2024-05-08T21:19:58.846319+0000","last_fullsized":"2024-05-08T21:19:58.846319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-05-08T21:19:58.846289+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-05-08T21:19:58.846289+0000","last_clean_scrub_stamp":"2024-05-08T21:19:58.846289+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:14:20.957954+0000","scrub_duration":0.0015942689999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"32'9","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.229853+0000","last_change":"2024-05-08T21:10:03.742100+0000","last_active":"2024-05-08T21:19:53.229853+0000","last_peered":"2024-05-08T21:19:53.229853+0000","last_clean":"2024-05-08T21:19:53.229853+0000","last_became_active":"2024-05-08T21:10:03.741742+0000","last_became_peered":"2024-05-08T21:10:03.741742+0000","last_unstale":"2024-05-08T21:19:53.229853+0000","last_undegraded":"2024-05-08T21:19:53.229853+0000","last_fullsized":"2024-05-08T21:19:53.229853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"32'4473","reported_seq":4564,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.317634+0000","last_change":"2024-05-08T21:10:07.769850+0000","last_active":"2024-05-08T21:19:53.317634+0000","last_peered":"2024-05-08T21:19:53.317634+0000","last_clean":"2024-05-08T21:19:53.317634+0000","last_became_active":"2024-05-08T21:10:07.769016+0000","last_became_peered":"2024-05-08T21:10:07.769016+0000","last_unstale":"2024-05-08T21:19:53.317634+0000","last_undegraded":"2024-05-08T21:19:53.317634+0000","last_fullsized":"2024-05-08T21:19:53.317634+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4473,"log_dups_size":0,"ondisk_log_size":4473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":0,"num_write":57758,"num_write_kb":734684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"32'20","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:58.371047+0000","last_change":"2024-05-08T21:19:58.371123+0000","last_active":"2024-05-08T21:19:58.371047+0000","last_peered":"2024-05-08T21:19:58.371047+0000","last_clean":"2024-05-08T21:19:58.371047+0000","last_became_active":"2024-05-08T21:10:03.331501+0000","last_became_peered":"2024-05-08T21:10:03.331501+0000","last_unstale":"2024-05-08T21:19:58.371047+0000","last_undegraded":"2024-05-08T21:19:58.371047+0000","last_fullsized":"2024-05-08T21:19:58.371047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-05-08T21:19:58.371025+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-05-08T21:19:58.371025+0000","last_clean_scrub_stamp":"2024-05-08T21:19:58.371025+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:14:53.459921+0000","scrub_duration":0.0044400510000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":69,"num_read_kb":69,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"32'12","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:00.652186+0000","last_change":"2024-05-08T21:20:00.652278+0000","last_active":"2024-05-08T21:20:00.652186+0000","last_peered":"2024-05-08T21:20:00.652186+0000","last_clean":"2024-05-08T21:20:00.652186+0000","last_became_active":"2024-05-08T21:10:03.743557+0000","last_became_peered":"2024-05-08T21:10:03.743557+0000","last_unstale":"2024-05-08T21:20:00.652186+0000","last_undegraded":"2024-05-08T21:20:00.652186+0000","last_fullsized":"2024-05-08T21:20:00.652186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-08T21:20:00.652163+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-08T21:20:00.652163+0000","last_clean_scrub_stamp":"2024-05-08T21:20:00.652163+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:38:06.051126+0000","scrub_duration":0.0014301730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"32'3690","reported_seq":3767,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.238491+0000","last_change":"2024-05-08T21:10:07.777283+0000","last_active":"2024-05-08T21:19:53.238491+0000","last_peered":"2024-05-08T21:19:53.238491+0000","last_clean":"2024-05-08T21:19:53.238491+0000","last_became_active":"2024-05-08T21:10:07.776858+0000","last_became_peered":"2024-05-08T21:10:07.776858+0000","last_unstale":"2024-05-08T21:19:53.238491+0000","last_undegraded":"2024-05-08T21:19:53.238491+0000","last_fullsized":"2024-05-08T21:19:53.238491+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":3690,"log_dups_size":0,"ondisk_log_size":3690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":0,"num_write":47426,"num_write_kb":636696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"32'5","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:57.493492+0000","last_change":"2024-05-08T21:19:57.493623+0000","last_active":"2024-05-08T21:19:57.493492+0000","last_peered":"2024-05-08T21:19:57.493492+0000","last_clean":"2024-05-08T21:19:57.493492+0000","last_became_active":"2024-05-08T21:10:03.326608+0000","last_became_peered":"2024-05-08T21:10:03.326608+0000","last_unstale":"2024-05-08T21:19:57.493492+0000","last_undegraded":"2024-05-08T21:19:57.493492+0000","last_fullsized":"2024-05-08T21:19:57.493492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-05-08T21:19:57.493449+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-05-08T21:19:57.493449+0000","last_clean_scrub_stamp":"2024-05-08T21:19:57.493449+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:45:21.237664+0000","scrub_duration":0.0035203579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"32'8","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.220059+0000","last_change":"2024-05-08T21:10:03.749221+0000","last_active":"2024-05-08T21:19:53.220059+0000","last_peered":"2024-05-08T21:19:53.220059+0000","last_clean":"2024-05-08T21:19:53.220059+0000","last_became_active":"2024-05-08T21:10:03.748915+0000","last_became_peered":"2024-05-08T21:10:03.748915+0000","last_unstale":"2024-05-08T21:19:53.220059+0000","last_undegraded":"2024-05-08T21:19:53.220059+0000","last_fullsized":"2024-05-08T21:19:53.220059+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"32'4727","reported_seq":4821,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.296347+0000","last_change":"2024-05-08T21:10:07.759492+0000","last_active":"2024-05-08T21:19:53.296347+0000","last_peered":"2024-05-08T21:19:53.296347+0000","last_clean":"2024-05-08T21:19:53.296347+0000","last_became_active":"2024-05-08T21:10:07.759139+0000","last_became_peered":"2024-05-08T21:10:07.759139+0000","last_unstale":"2024-05-08T21:19:53.296347+0000","last_undegraded":"2024-05-08T21:19:53.296347+0000","last_fullsized":"2024-05-08T21:19:53.296347+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4727,"log_dups_size":0,"ondisk_log_size":4727,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":0,"num_write":61813,"num_write_kb":787262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"32'3","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:02.232651+0000","last_change":"2024-05-08T21:20:02.232728+0000","last_active":"2024-05-08T21:20:02.232651+0000","last_peered":"2024-05-08T21:20:02.232651+0000","last_clean":"2024-05-08T21:20:02.232651+0000","last_became_active":"2024-05-08T21:10:03.328739+0000","last_became_peered":"2024-05-08T21:10:03.328739+0000","last_unstale":"2024-05-08T21:20:02.232651+0000","last_undegraded":"2024-05-08T21:20:02.232651+0000","last_fullsized":"2024-05-08T21:20:02.232651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-05-08T21:20:02.232628+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-05-08T21:20:02.232628+0000","last_clean_scrub_stamp":"2024-05-08T21:20:02.232628+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:38:36.143029+0000","scrub_duration":0.0012656970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"32'13","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.259451+0000","last_change":"2024-05-08T21:10:03.744662+0000","last_active":"2024-05-08T21:19:53.259451+0000","last_peered":"2024-05-08T21:19:53.259451+0000","last_clean":"2024-05-08T21:19:53.259451+0000","last_became_active":"2024-05-08T21:10:03.744398+0000","last_became_peered":"2024-05-08T21:10:03.744398+0000","last_unstale":"2024-05-08T21:19:53.259451+0000","last_undegraded":"2024-05-08T21:19:53.259451+0000","last_fullsized":"2024-05-08T21:19:53.259451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"32'4127","reported_seq":4198,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.216672+0000","last_change":"2024-05-08T21:10:07.776566+0000","last_active":"2024-05-08T21:19:53.216672+0000","last_peered":"2024-05-08T21:19:53.216672+0000","last_clean":"2024-05-08T21:19:53.216672+0000","last_became_active":"2024-05-08T21:10:07.776080+0000","last_became_peered":"2024-05-08T21:10:07.776080+0000","last_unstale":"2024-05-08T21:19:53.216672+0000","last_undegraded":"2024-05-08T21:19:53.216672+0000","last_fullsized":"2024-05-08T21:19:53.216672+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4127,"log_dups_size":0,"ondisk_log_size":4127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":0,"num_write":53759,"num_write_kb":696170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:07.460295+0000","last_change":"2024-05-08T21:20:07.460399+0000","last_active":"2024-05-08T21:20:07.460295+0000","last_peered":"2024-05-08T21:20:07.460295+0000","last_clean":"2024-05-08T21:20:07.460295+0000","last_became_active":"2024-05-08T21:10:03.332689+0000","last_became_peered":"2024-05-08T21:10:03.332689+0000","last_unstale":"2024-05-08T21:20:07.460295+0000","last_undegraded":"2024-05-08T21:20:07.460295+0000","last_fullsized":"2024-05-08T21:20:07.460295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:20:07.460272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:20:07.460272+0000","last_clean_scrub_stamp":"2024-05-08T21:20:07.460272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:12:13.310545+0000","scrub_duration":0.0015644680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"32'9","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:08.553749+0000","last_change":"2024-05-08T21:20:08.553854+0000","last_active":"2024-05-08T21:20:08.553749+0000","last_peered":"2024-05-08T21:20:08.553749+0000","last_clean":"2024-05-08T21:20:08.553749+0000","last_became_active":"2024-05-08T21:10:03.742744+0000","last_became_peered":"2024-05-08T21:10:03.742744+0000","last_unstale":"2024-05-08T21:20:08.553749+0000","last_undegraded":"2024-05-08T21:20:08.553749+0000","last_fullsized":"2024-05-08T21:20:08.553749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-05-08T21:20:08.553723+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-05-08T21:20:08.553723+0000","last_clean_scrub_stamp":"2024-05-08T21:20:08.553723+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:45:32.459903+0000","scrub_duration":0.0072960309999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"32'4649","reported_seq":4740,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.286527+0000","last_change":"2024-05-08T21:10:07.776527+0000","last_active":"2024-05-08T21:19:53.286527+0000","last_peered":"2024-05-08T21:19:53.286527+0000","last_clean":"2024-05-08T21:19:53.286527+0000","last_became_active":"2024-05-08T21:10:07.776053+0000","last_became_peered":"2024-05-08T21:10:07.776053+0000","last_unstale":"2024-05-08T21:19:53.286527+0000","last_undegraded":"2024-05-08T21:19:53.286527+0000","last_fullsized":"2024-05-08T21:19:53.286527+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4649,"log_dups_size":0,"ondisk_log_size":4649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":0,"num_write":59828,"num_write_kb":758247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"32'13","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:55.648171+0000","last_change":"2024-05-08T21:10:03.738421+0000","last_active":"2024-05-08T21:19:55.648171+0000","last_peered":"2024-05-08T21:19:55.648171+0000","last_clean":"2024-05-08T21:19:55.648171+0000","last_became_active":"2024-05-08T21:10:03.738000+0000","last_became_peered":"2024-05-08T21:10:03.738000+0000","last_unstale":"2024-05-08T21:19:55.648171+0000","last_undegraded":"2024-05-08T21:19:55.648171+0000","last_fullsized":"2024-05-08T21:19:55.648171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"32'27","reported_seq":90,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:00.324986+0000","last_change":"2024-05-08T21:20:00.325080+0000","last_active":"2024-05-08T21:20:00.324986+0000","last_peered":"2024-05-08T21:20:00.324986+0000","last_clean":"2024-05-08T21:20:00.324986+0000","last_became_active":"2024-05-08T21:10:03.330842+0000","last_became_peered":"2024-05-08T21:10:03.330842+0000","last_unstale":"2024-05-08T21:20:00.324986+0000","last_undegraded":"2024-05-08T21:20:00.324986+0000","last_fullsized":"2024-05-08T21:20:00.324986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'27","last_scrub_stamp":"2024-05-08T21:20:00.324962+0000","last_deep_scrub":"32'27","last_deep_scrub_stamp":"2024-05-08T21:20:00.324962+0000","last_clean_scrub_stamp":"2024-05-08T21:20:00.324962+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:09:32.831083+0000","scrub_duration":0.021989438,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94059,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":26,"num_read_kb":107,"num_write":23,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"32'4123","reported_seq":4202,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.300786+0000","last_change":"2024-05-08T21:10:08.049274+0000","last_active":"2024-05-08T21:19:53.300786+0000","last_peered":"2024-05-08T21:19:53.300786+0000","last_clean":"2024-05-08T21:19:53.300786+0000","last_became_active":"2024-05-08T21:10:08.048763+0000","last_became_peered":"2024-05-08T21:10:08.048763+0000","last_unstale":"2024-05-08T21:19:53.300786+0000","last_undegraded":"2024-05-08T21:19:53.300786+0000","last_fullsized":"2024-05-08T21:19:53.300786+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4123,"log_dups_size":0,"ondisk_log_size":4123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":0,"num_write":53637,"num_write_kb":684025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"32'8","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.253400+0000","last_change":"2024-05-08T21:10:03.747594+0000","last_active":"2024-05-08T21:19:53.253400+0000","last_peered":"2024-05-08T21:19:53.253400+0000","last_clean":"2024-05-08T21:19:53.253400+0000","last_became_active":"2024-05-08T21:10:03.747360+0000","last_became_peered":"2024-05-08T21:10:03.747360+0000","last_unstale":"2024-05-08T21:19:53.253400+0000","last_undegraded":"2024-05-08T21:19:53.253400+0000","last_fullsized":"2024-05-08T21:19:53.253400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:12.407078+0000","last_change":"2024-05-08T21:20:12.407195+0000","last_active":"2024-05-08T21:20:12.407078+0000","last_peered":"2024-05-08T21:20:12.407078+0000","last_clean":"2024-05-08T21:20:12.407078+0000","last_became_active":"2024-05-08T21:10:03.327530+0000","last_became_peered":"2024-05-08T21:10:03.327530+0000","last_unstale":"2024-05-08T21:20:12.407078+0000","last_undegraded":"2024-05-08T21:20:12.407078+0000","last_fullsized":"2024-05-08T21:20:12.407078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T21:20:12.407050+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T21:20:12.407050+0000","last_clean_scrub_stamp":"2024-05-08T21:20:12.407050+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:42:48.318549+0000","scrub_duration":0.0015389780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"32'119","reported_seq":193,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:09.519397+0000","last_change":"2024-05-08T21:20:09.519491+0000","last_active":"2024-05-08T21:20:09.519397+0000","last_peered":"2024-05-08T21:20:09.519397+0000","last_clean":"2024-05-08T21:20:09.519397+0000","last_became_active":"2024-05-08T21:09:59.332929+0000","last_became_peered":"2024-05-08T21:09:59.332929+0000","last_unstale":"2024-05-08T21:20:09.519397+0000","last_undegraded":"2024-05-08T21:20:09.519397+0000","last_fullsized":"2024-05-08T21:20:09.519397+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'119","last_scrub_stamp":"2024-05-08T21:20:09.519371+0000","last_deep_scrub":"32'119","last_deep_scrub_stamp":"2024-05-08T21:20:09.519371+0000","last_clean_scrub_stamp":"2024-05-08T21:20:09.519371+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:38:31.505096+0000","scrub_duration":0.0053401769999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"32'3586","reported_seq":3655,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.225218+0000","last_change":"2024-05-08T21:10:08.049848+0000","last_active":"2024-05-08T21:19:53.225218+0000","last_peered":"2024-05-08T21:19:53.225218+0000","last_clean":"2024-05-08T21:19:53.225218+0000","last_became_active":"2024-05-08T21:10:08.049153+0000","last_became_peered":"2024-05-08T21:10:08.049153+0000","last_unstale":"2024-05-08T21:19:53.225218+0000","last_undegraded":"2024-05-08T21:19:53.225218+0000","last_fullsized":"2024-05-08T21:19:53.225218+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":3586,"log_dups_size":0,"ondisk_log_size":3586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":0,"num_write":45747,"num_write_kb":586385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"32'6","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:13.619721+0000","last_change":"2024-05-08T21:20:13.619795+0000","last_active":"2024-05-08T21:20:13.619721+0000","last_peered":"2024-05-08T21:20:13.619721+0000","last_clean":"2024-05-08T21:20:13.619721+0000","last_became_active":"2024-05-08T21:10:03.742819+0000","last_became_peered":"2024-05-08T21:10:03.742819+0000","last_unstale":"2024-05-08T21:20:13.619721+0000","last_undegraded":"2024-05-08T21:20:13.619721+0000","last_fullsized":"2024-05-08T21:20:13.619721+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-08T21:20:13.619702+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-08T21:20:13.619702+0000","last_clean_scrub_stamp":"2024-05-08T21:20:13.619702+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:44:45.908469+0000","scrub_duration":0.001576299,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"32'8","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:59.064875+0000","last_change":"2024-05-08T21:10:03.340259+0000","last_active":"2024-05-08T21:19:59.064875+0000","last_peered":"2024-05-08T21:19:59.064875+0000","last_clean":"2024-05-08T21:19:59.064875+0000","last_became_active":"2024-05-08T21:10:03.339957+0000","last_became_peered":"2024-05-08T21:10:03.339957+0000","last_unstale":"2024-05-08T21:19:59.064875+0000","last_undegraded":"2024-05-08T21:19:59.064875+0000","last_fullsized":"2024-05-08T21:19:59.064875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"32'3621","reported_seq":3686,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.171132+0000","last_change":"2024-05-08T21:10:08.050370+0000","last_active":"2024-05-08T21:19:53.171132+0000","last_peered":"2024-05-08T21:19:53.171132+0000","last_clean":"2024-05-08T21:19:53.171132+0000","last_became_active":"2024-05-08T21:10:08.049962+0000","last_became_peered":"2024-05-08T21:10:08.049962+0000","last_unstale":"2024-05-08T21:19:53.171132+0000","last_undegraded":"2024-05-08T21:19:53.171132+0000","last_fullsized":"2024-05-08T21:19:53.171132+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":3621,"log_dups_size":0,"ondisk_log_size":3621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":0,"num_write":47664,"num_write_kb":629817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"32'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.247692+0000","last_change":"2024-05-08T21:10:03.337949+0000","last_active":"2024-05-08T21:19:53.247692+0000","last_peered":"2024-05-08T21:19:53.247692+0000","last_clean":"2024-05-08T21:19:53.247692+0000","last_became_active":"2024-05-08T21:10:03.337627+0000","last_became_peered":"2024-05-08T21:10:03.337627+0000","last_unstale":"2024-05-08T21:19:53.247692+0000","last_undegraded":"2024-05-08T21:19:53.247692+0000","last_fullsized":"2024-05-08T21:19:53.247692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"32'10","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.204740+0000","last_change":"2024-05-08T21:10:03.738212+0000","last_active":"2024-05-08T21:19:53.204740+0000","last_peered":"2024-05-08T21:19:53.204740+0000","last_clean":"2024-05-08T21:19:53.204740+0000","last_became_active":"2024-05-08T21:10:03.737927+0000","last_became_peered":"2024-05-08T21:10:03.737927+0000","last_unstale":"2024-05-08T21:19:53.204740+0000","last_undegraded":"2024-05-08T21:19:53.204740+0000","last_fullsized":"2024-05-08T21:19:53.204740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"32'4719","reported_seq":4816,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.287656+0000","last_change":"2024-05-08T21:10:08.052270+0000","last_active":"2024-05-08T21:19:53.287656+0000","last_peered":"2024-05-08T21:19:53.287656+0000","last_clean":"2024-05-08T21:19:53.287656+0000","last_became_active":"2024-05-08T21:10:08.051881+0000","last_became_peered":"2024-05-08T21:10:08.051881+0000","last_unstale":"2024-05-08T21:19:53.287656+0000","last_undegraded":"2024-05-08T21:19:53.287656+0000","last_fullsized":"2024-05-08T21:19:53.287656+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4719,"log_dups_size":0,"ondisk_log_size":4719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":0,"num_write":60705,"num_write_kb":757240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"32'69","reported_seq":110,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:09.149522+0000","last_change":"2024-05-08T21:20:09.149631+0000","last_active":"2024-05-08T21:20:09.149522+0000","last_peered":"2024-05-08T21:20:09.149522+0000","last_clean":"2024-05-08T21:20:09.149522+0000","last_became_active":"2024-05-08T21:10:03.333368+0000","last_became_peered":"2024-05-08T21:10:03.333368+0000","last_unstale":"2024-05-08T21:20:09.149522+0000","last_undegraded":"2024-05-08T21:20:09.149522+0000","last_fullsized":"2024-05-08T21:20:09.149522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'69","last_scrub_stamp":"2024-05-08T21:20:09.149480+0000","last_deep_scrub":"32'69","last_deep_scrub_stamp":"2024-05-08T21:20:09.149480+0000","last_clean_scrub_stamp":"2024-05-08T21:20:09.149480+0000","objects_scrubbed":1,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:53:53.593469+0000","scrub_duration":0.0026429190000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":34,"num_write":151,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"32'12","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.187560+0000","last_change":"2024-05-08T21:10:03.752578+0000","last_active":"2024-05-08T21:19:53.187560+0000","last_peered":"2024-05-08T21:19:53.187560+0000","last_clean":"2024-05-08T21:19:53.187560+0000","last_became_active":"2024-05-08T21:10:03.752389+0000","last_became_peered":"2024-05-08T21:10:03.752389+0000","last_unstale":"2024-05-08T21:19:53.187560+0000","last_undegraded":"2024-05-08T21:19:53.187560+0000","last_fullsized":"2024-05-08T21:19:53.187560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"32'3951","reported_seq":4019,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.249090+0000","last_change":"2024-05-08T21:10:08.048081+0000","last_active":"2024-05-08T21:19:53.249090+0000","last_peered":"2024-05-08T21:19:53.249090+0000","last_clean":"2024-05-08T21:19:53.249090+0000","last_became_active":"2024-05-08T21:10:08.047632+0000","last_became_peered":"2024-05-08T21:10:08.047632+0000","last_unstale":"2024-05-08T21:19:53.249090+0000","last_undegraded":"2024-05-08T21:19:53.249090+0000","last_fullsized":"2024-05-08T21:19:53.249090+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":3951,"log_dups_size":0,"ondisk_log_size":3951,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":0,"num_write":51572,"num_write_kb":672103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"32'9","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:06.832214+0000","last_change":"2024-05-08T21:20:06.832307+0000","last_active":"2024-05-08T21:20:06.832214+0000","last_peered":"2024-05-08T21:20:06.832214+0000","last_clean":"2024-05-08T21:20:06.832214+0000","last_became_active":"2024-05-08T21:10:03.340280+0000","last_became_peered":"2024-05-08T21:10:03.340280+0000","last_unstale":"2024-05-08T21:20:06.832214+0000","last_undegraded":"2024-05-08T21:20:06.832214+0000","last_fullsized":"2024-05-08T21:20:06.832214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-05-08T21:20:06.832183+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-05-08T21:20:06.832183+0000","last_clean_scrub_stamp":"2024-05-08T21:20:06.832183+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:08:37.037032+0000","scrub_duration":0.0030290820000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"32'18","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:59.504474+0000","last_change":"2024-05-08T21:19:59.504564+0000","last_active":"2024-05-08T21:19:59.504474+0000","last_peered":"2024-05-08T21:19:59.504474+0000","last_clean":"2024-05-08T21:19:59.504474+0000","last_became_active":"2024-05-08T21:10:03.736049+0000","last_became_peered":"2024-05-08T21:10:03.736049+0000","last_unstale":"2024-05-08T21:19:59.504474+0000","last_undegraded":"2024-05-08T21:19:59.504474+0000","last_fullsized":"2024-05-08T21:19:59.504474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-05-08T21:19:59.504451+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-05-08T21:19:59.504451+0000","last_clean_scrub_stamp":"2024-05-08T21:19:59.504451+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:13:18.147944+0000","scrub_duration":0.0056426109999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'3546","reported_seq":3634,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.305028+0000","last_change":"2024-05-08T21:10:53.484914+0000","last_active":"2024-05-08T21:19:53.305028+0000","last_peered":"2024-05-08T21:19:53.305028+0000","last_clean":"2024-05-08T21:19:53.305028+0000","last_became_active":"2024-05-08T21:10:53.484443+0000","last_became_peered":"2024-05-08T21:10:53.484443+0000","last_unstale":"2024-05-08T21:19:53.305028+0000","last_undegraded":"2024-05-08T21:19:53.305028+0000","last_fullsized":"2024-05-08T21:19:53.305028+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":3546,"log_dups_size":0,"ondisk_log_size":3546,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":0,"num_write":45468,"num_write_kb":601547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"32'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.203972+0000","last_change":"2024-05-08T21:10:03.340078+0000","last_active":"2024-05-08T21:19:53.203972+0000","last_peered":"2024-05-08T21:19:53.203972+0000","last_clean":"2024-05-08T21:19:53.203972+0000","last_became_active":"2024-05-08T21:10:03.339690+0000","last_became_peered":"2024-05-08T21:10:03.339690+0000","last_unstale":"2024-05-08T21:19:53.203972+0000","last_undegraded":"2024-05-08T21:19:53.203972+0000","last_fullsized":"2024-05-08T21:19:53.203972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"32'9","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:05.630976+0000","last_change":"2024-05-08T21:20:05.631085+0000","last_active":"2024-05-08T21:20:05.630976+0000","last_peered":"2024-05-08T21:20:05.630976+0000","last_clean":"2024-05-08T21:20:05.630976+0000","last_became_active":"2024-05-08T21:10:03.744160+0000","last_became_peered":"2024-05-08T21:10:03.744160+0000","last_unstale":"2024-05-08T21:20:05.630976+0000","last_undegraded":"2024-05-08T21:20:05.630976+0000","last_fullsized":"2024-05-08T21:20:05.630976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-05-08T21:20:05.630950+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-05-08T21:20:05.630950+0000","last_clean_scrub_stamp":"2024-05-08T21:20:05.630950+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:28:39.640053+0000","scrub_duration":0.0016783080000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'5130","reported_seq":5225,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.247899+0000","last_change":"2024-05-08T21:10:08.049224+0000","last_active":"2024-05-08T21:19:53.247899+0000","last_peered":"2024-05-08T21:19:53.247899+0000","last_clean":"2024-05-08T21:19:53.247899+0000","last_became_active":"2024-05-08T21:10:08.048866+0000","last_became_peered":"2024-05-08T21:10:08.048866+0000","last_unstale":"2024-05-08T21:19:53.247899+0000","last_undegraded":"2024-05-08T21:19:53.247899+0000","last_fullsized":"2024-05-08T21:19:53.247899+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":5130,"log_dups_size":0,"ondisk_log_size":5130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":0,"num_write":66101,"num_write_kb":843075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:10.134000+0000","last_change":"2024-05-08T21:20:10.134089+0000","last_active":"2024-05-08T21:20:10.134000+0000","last_peered":"2024-05-08T21:20:10.134000+0000","last_clean":"2024-05-08T21:20:10.134000+0000","last_became_active":"2024-05-08T21:10:03.339136+0000","last_became_peered":"2024-05-08T21:10:03.339136+0000","last_unstale":"2024-05-08T21:20:10.134000+0000","last_undegraded":"2024-05-08T21:20:10.134000+0000","last_fullsized":"2024-05-08T21:20:10.134000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T21:20:10.133976+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T21:20:10.133976+0000","last_clean_scrub_stamp":"2024-05-08T21:20:10.133976+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:19:43.392154+0000","scrub_duration":0.0021174700000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"32'9","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:02.697484+0000","last_change":"2024-05-08T21:20:02.697565+0000","last_active":"2024-05-08T21:20:02.697484+0000","last_peered":"2024-05-08T21:20:02.697484+0000","last_clean":"2024-05-08T21:20:02.697484+0000","last_became_active":"2024-05-08T21:10:03.737459+0000","last_became_peered":"2024-05-08T21:10:03.737459+0000","last_unstale":"2024-05-08T21:20:02.697484+0000","last_undegraded":"2024-05-08T21:20:02.697484+0000","last_fullsized":"2024-05-08T21:20:02.697484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-05-08T21:20:02.697461+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-05-08T21:20:02.697461+0000","last_clean_scrub_stamp":"2024-05-08T21:20:02.697461+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:00:37.934494+0000","scrub_duration":0.001184753,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"32'4248","reported_seq":4324,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.304091+0000","last_change":"2024-05-08T21:10:07.776483+0000","last_active":"2024-05-08T21:19:53.304091+0000","last_peered":"2024-05-08T21:19:53.304091+0000","last_clean":"2024-05-08T21:19:53.304091+0000","last_became_active":"2024-05-08T21:10:07.775956+0000","last_became_peered":"2024-05-08T21:10:07.775956+0000","last_unstale":"2024-05-08T21:19:53.304091+0000","last_undegraded":"2024-05-08T21:19:53.304091+0000","last_fullsized":"2024-05-08T21:19:53.304091+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4248,"log_dups_size":0,"ondisk_log_size":4248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":0,"num_write":55084,"num_write_kb":703369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"32'3","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:12.103697+0000","last_change":"2024-05-08T21:20:12.103775+0000","last_active":"2024-05-08T21:20:12.103697+0000","last_peered":"2024-05-08T21:20:12.103697+0000","last_clean":"2024-05-08T21:20:12.103697+0000","last_became_active":"2024-05-08T21:10:03.331198+0000","last_became_peered":"2024-05-08T21:10:03.331198+0000","last_unstale":"2024-05-08T21:20:12.103697+0000","last_undegraded":"2024-05-08T21:20:12.103697+0000","last_fullsized":"2024-05-08T21:20:12.103697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-05-08T21:20:12.103673+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-05-08T21:20:12.103673+0000","last_clean_scrub_stamp":"2024-05-08T21:20:12.103673+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:29:46.249901+0000","scrub_duration":0.001456349,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"32'11","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.136284+0000","last_change":"2024-05-08T21:10:03.744562+0000","last_active":"2024-05-08T21:19:53.136284+0000","last_peered":"2024-05-08T21:19:53.136284+0000","last_clean":"2024-05-08T21:19:53.136284+0000","last_became_active":"2024-05-08T21:10:03.744326+0000","last_became_peered":"2024-05-08T21:10:03.744326+0000","last_unstale":"2024-05-08T21:19:53.136284+0000","last_undegraded":"2024-05-08T21:19:53.136284+0000","last_fullsized":"2024-05-08T21:19:53.136284+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'4119","reported_seq":4196,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.314481+0000","last_change":"2024-05-08T21:10:07.763204+0000","last_active":"2024-05-08T21:19:53.314481+0000","last_peered":"2024-05-08T21:19:53.314481+0000","last_clean":"2024-05-08T21:19:53.314481+0000","last_became_active":"2024-05-08T21:10:07.762886+0000","last_became_peered":"2024-05-08T21:10:07.762886+0000","last_unstale":"2024-05-08T21:19:53.314481+0000","last_undegraded":"2024-05-08T21:19:53.314481+0000","last_fullsized":"2024-05-08T21:19:53.314481+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4119,"log_dups_size":0,"ondisk_log_size":4119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":0,"num_write":53672,"num_write_kb":692300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"32'675","reported_seq":710,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.236519+0000","last_change":"2024-05-08T21:10:03.337993+0000","last_active":"2024-05-08T21:19:53.236519+0000","last_peered":"2024-05-08T21:19:53.236519+0000","last_clean":"2024-05-08T21:19:53.236519+0000","last_became_active":"2024-05-08T21:10:03.337654+0000","last_became_peered":"2024-05-08T21:10:03.337654+0000","last_unstale":"2024-05-08T21:19:53.236519+0000","last_undegraded":"2024-05-08T21:19:53.236519+0000","last_fullsized":"2024-05-08T21:19:53.236519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:02.301995+0000","last_clean_scrub_stamp":"2024-05-08T21:10:02.301995+0000","objects_scrubbed":0,"log_size":675,"log_dups_size":0,"ondisk_log_size":675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":9261,"num_write":668,"num_write_kb":4529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"32'11","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.242398+0000","last_change":"2024-05-08T21:10:03.744871+0000","last_active":"2024-05-08T21:19:53.242398+0000","last_peered":"2024-05-08T21:19:53.242398+0000","last_clean":"2024-05-08T21:19:53.242398+0000","last_became_active":"2024-05-08T21:10:03.744589+0000","last_became_peered":"2024-05-08T21:10:03.744589+0000","last_unstale":"2024-05-08T21:19:53.242398+0000","last_undegraded":"2024-05-08T21:19:53.242398+0000","last_fullsized":"2024-05-08T21:19:53.242398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"32'4008","reported_seq":4079,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.266120+0000","last_change":"2024-05-08T21:10:08.047735+0000","last_active":"2024-05-08T21:19:53.266120+0000","last_peered":"2024-05-08T21:19:53.266120+0000","last_clean":"2024-05-08T21:19:53.266120+0000","last_became_active":"2024-05-08T21:10:08.047331+0000","last_became_peered":"2024-05-08T21:10:08.047331+0000","last_unstale":"2024-05-08T21:19:53.266120+0000","last_undegraded":"2024-05-08T21:19:53.266120+0000","last_fullsized":"2024-05-08T21:19:53.266120+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4008,"log_dups_size":0,"ondisk_log_size":4008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":0,"num_write":52621,"num_write_kb":688417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"32'5","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:03.323940+0000","last_change":"2024-05-08T21:20:03.324041+0000","last_active":"2024-05-08T21:20:03.323940+0000","last_peered":"2024-05-08T21:20:03.323940+0000","last_clean":"2024-05-08T21:20:03.323940+0000","last_became_active":"2024-05-08T21:10:03.332790+0000","last_became_peered":"2024-05-08T21:10:03.332790+0000","last_unstale":"2024-05-08T21:20:03.323940+0000","last_undegraded":"2024-05-08T21:20:03.323940+0000","last_fullsized":"2024-05-08T21:20:03.323940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-05-08T21:20:03.323907+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-05-08T21:20:03.323907+0000","last_clean_scrub_stamp":"2024-05-08T21:20:03.323907+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:44:20.215991+0000","scrub_duration":0.001874807,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'15","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.290882+0000","last_change":"2024-05-08T21:10:03.748047+0000","last_active":"2024-05-08T21:19:53.290882+0000","last_peered":"2024-05-08T21:19:53.290882+0000","last_clean":"2024-05-08T21:19:53.290882+0000","last_became_active":"2024-05-08T21:10:03.747759+0000","last_became_peered":"2024-05-08T21:10:03.747759+0000","last_unstale":"2024-05-08T21:19:53.290882+0000","last_undegraded":"2024-05-08T21:19:53.290882+0000","last_fullsized":"2024-05-08T21:19:53.290882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"32'3793","reported_seq":3873,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.314599+0000","last_change":"2024-05-08T21:10:07.761000+0000","last_active":"2024-05-08T21:19:53.314599+0000","last_peered":"2024-05-08T21:19:53.314599+0000","last_clean":"2024-05-08T21:19:53.314599+0000","last_became_active":"2024-05-08T21:10:07.760566+0000","last_became_peered":"2024-05-08T21:10:07.760566+0000","last_unstale":"2024-05-08T21:19:53.314599+0000","last_undegraded":"2024-05-08T21:19:53.314599+0000","last_fullsized":"2024-05-08T21:19:53.314599+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":3793,"log_dups_size":0,"ondisk_log_size":3793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":0,"num_write":48645,"num_write_kb":636437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"32'3","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:03.185252+0000","last_change":"2024-05-08T21:20:03.185331+0000","last_active":"2024-05-08T21:20:03.185252+0000","last_peered":"2024-05-08T21:20:03.185252+0000","last_clean":"2024-05-08T21:20:03.185252+0000","last_became_active":"2024-05-08T21:10:03.331028+0000","last_became_peered":"2024-05-08T21:10:03.331028+0000","last_unstale":"2024-05-08T21:20:03.185252+0000","last_undegraded":"2024-05-08T21:20:03.185252+0000","last_fullsized":"2024-05-08T21:20:03.185252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-05-08T21:20:03.185228+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-05-08T21:20:03.185228+0000","last_clean_scrub_stamp":"2024-05-08T21:20:03.185228+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:53:13.030027+0000","scrub_duration":0.0031620390000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"32'12","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.297305+0000","last_change":"2024-05-08T21:10:03.751285+0000","last_active":"2024-05-08T21:19:53.297305+0000","last_peered":"2024-05-08T21:19:53.297305+0000","last_clean":"2024-05-08T21:19:53.297305+0000","last_became_active":"2024-05-08T21:10:03.746557+0000","last_became_peered":"2024-05-08T21:10:03.746557+0000","last_unstale":"2024-05-08T21:19:53.297305+0000","last_undegraded":"2024-05-08T21:19:53.297305+0000","last_fullsized":"2024-05-08T21:19:53.297305+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"32'3739","reported_seq":3805,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.231729+0000","last_change":"2024-05-08T21:10:08.048830+0000","last_active":"2024-05-08T21:19:53.231729+0000","last_peered":"2024-05-08T21:19:53.231729+0000","last_clean":"2024-05-08T21:19:53.231729+0000","last_became_active":"2024-05-08T21:10:08.048453+0000","last_became_peered":"2024-05-08T21:10:08.048453+0000","last_unstale":"2024-05-08T21:19:53.231729+0000","last_undegraded":"2024-05-08T21:19:53.231729+0000","last_fullsized":"2024-05-08T21:19:53.231729+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":3739,"log_dups_size":0,"ondisk_log_size":3739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":0,"num_write":49340,"num_write_kb":639424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"32'8","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:01.265385+0000","last_change":"2024-05-08T21:20:01.265470+0000","last_active":"2024-05-08T21:20:01.265385+0000","last_peered":"2024-05-08T21:20:01.265385+0000","last_clean":"2024-05-08T21:20:01.265385+0000","last_became_active":"2024-05-08T21:10:03.330082+0000","last_became_peered":"2024-05-08T21:10:03.330082+0000","last_unstale":"2024-05-08T21:20:01.265385+0000","last_undegraded":"2024-05-08T21:20:01.265385+0000","last_fullsized":"2024-05-08T21:20:01.265385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-08T21:20:01.265361+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-08T21:20:01.265361+0000","last_clean_scrub_stamp":"2024-05-08T21:20:01.265361+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:02.229852+0000","scrub_duration":0.0021232669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"32'11","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:59.772591+0000","last_change":"2024-05-08T21:19:59.772720+0000","last_active":"2024-05-08T21:19:59.772591+0000","last_peered":"2024-05-08T21:19:59.772591+0000","last_clean":"2024-05-08T21:19:59.772591+0000","last_became_active":"2024-05-08T21:10:03.746755+0000","last_became_peered":"2024-05-08T21:10:03.746755+0000","last_unstale":"2024-05-08T21:19:59.772591+0000","last_undegraded":"2024-05-08T21:19:59.772591+0000","last_fullsized":"2024-05-08T21:19:59.772591+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'11","last_scrub_stamp":"2024-05-08T21:19:59.772568+0000","last_deep_scrub":"32'11","last_deep_scrub_stamp":"2024-05-08T21:19:59.772568+0000","last_clean_scrub_stamp":"2024-05-08T21:19:59.772568+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:41:47.304779+0000","scrub_duration":0.081020191000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"32'16","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.202185+0000","last_change":"2024-05-08T21:10:03.738627+0000","last_active":"2024-05-08T21:19:53.202185+0000","last_peered":"2024-05-08T21:19:53.202185+0000","last_clean":"2024-05-08T21:19:53.202185+0000","last_became_active":"2024-05-08T21:10:03.738338+0000","last_became_peered":"2024-05-08T21:10:03.738338+0000","last_unstale":"2024-05-08T21:19:53.202185+0000","last_undegraded":"2024-05-08T21:19:53.202185+0000","last_fullsized":"2024-05-08T21:19:53.202185+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"32'14","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:10.325253+0000","last_change":"2024-05-08T21:20:10.325371+0000","last_active":"2024-05-08T21:20:10.325253+0000","last_peered":"2024-05-08T21:20:10.325253+0000","last_clean":"2024-05-08T21:20:10.325253+0000","last_became_active":"2024-05-08T21:10:03.745362+0000","last_became_peered":"2024-05-08T21:10:03.745362+0000","last_unstale":"2024-05-08T21:20:10.325253+0000","last_undegraded":"2024-05-08T21:20:10.325253+0000","last_fullsized":"2024-05-08T21:20:10.325253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-05-08T21:20:10.325202+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-05-08T21:20:10.325202+0000","last_clean_scrub_stamp":"2024-05-08T21:20:10.325202+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:03:52.158974+0000","scrub_duration":0.007440164,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"32'20","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.286157+0000","last_change":"2024-05-08T21:10:03.745137+0000","last_active":"2024-05-08T21:19:53.286157+0000","last_peered":"2024-05-08T21:19:53.286157+0000","last_clean":"2024-05-08T21:19:53.286157+0000","last_became_active":"2024-05-08T21:10:03.744844+0000","last_became_peered":"2024-05-08T21:10:03.744844+0000","last_unstale":"2024-05-08T21:19:53.286157+0000","last_undegraded":"2024-05-08T21:19:53.286157+0000","last_fullsized":"2024-05-08T21:19:53.286157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"32'11","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:14.593808+0000","last_change":"2024-05-08T21:20:14.593913+0000","last_active":"2024-05-08T21:20:14.593808+0000","last_peered":"2024-05-08T21:20:14.593808+0000","last_clean":"2024-05-08T21:20:14.593808+0000","last_became_active":"2024-05-08T21:10:03.744908+0000","last_became_peered":"2024-05-08T21:10:03.744908+0000","last_unstale":"2024-05-08T21:20:14.593808+0000","last_undegraded":"2024-05-08T21:20:14.593808+0000","last_fullsized":"2024-05-08T21:20:14.593808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'11","last_scrub_stamp":"2024-05-08T21:20:14.593768+0000","last_deep_scrub":"32'11","last_deep_scrub_stamp":"2024-05-08T21:20:14.593768+0000","last_clean_scrub_stamp":"2024-05-08T21:20:14.593768+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:57:46.848018+0000","scrub_duration":0.0021814820000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'9","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.138934+0000","last_change":"2024-05-08T21:10:03.748542+0000","last_active":"2024-05-08T21:19:53.138934+0000","last_peered":"2024-05-08T21:19:53.138934+0000","last_clean":"2024-05-08T21:19:53.138934+0000","last_became_active":"2024-05-08T21:10:03.748284+0000","last_became_peered":"2024-05-08T21:10:03.748284+0000","last_unstale":"2024-05-08T21:19:53.138934+0000","last_undegraded":"2024-05-08T21:19:53.138934+0000","last_fullsized":"2024-05-08T21:19:53.138934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"32'12","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.304358+0000","last_change":"2024-05-08T21:10:03.739778+0000","last_active":"2024-05-08T21:19:53.304358+0000","last_peered":"2024-05-08T21:19:53.304358+0000","last_clean":"2024-05-08T21:19:53.304358+0000","last_became_active":"2024-05-08T21:10:03.739522+0000","last_became_peered":"2024-05-08T21:10:03.739522+0000","last_unstale":"2024-05-08T21:19:53.304358+0000","last_undegraded":"2024-05-08T21:19:53.304358+0000","last_fullsized":"2024-05-08T21:19:53.304358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"32'11","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.221385+0000","last_change":"2024-05-08T21:10:03.746126+0000","last_active":"2024-05-08T21:19:53.221385+0000","last_peered":"2024-05-08T21:19:53.221385+0000","last_clean":"2024-05-08T21:19:53.221385+0000","last_became_active":"2024-05-08T21:10:03.745842+0000","last_became_peered":"2024-05-08T21:10:03.745842+0000","last_unstale":"2024-05-08T21:19:53.221385+0000","last_undegraded":"2024-05-08T21:19:53.221385+0000","last_fullsized":"2024-05-08T21:19:53.221385+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"32'13","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.250885+0000","last_change":"2024-05-08T21:10:53.473916+0000","last_active":"2024-05-08T21:19:53.250885+0000","last_peered":"2024-05-08T21:19:53.250885+0000","last_clean":"2024-05-08T21:19:53.250885+0000","last_became_active":"2024-05-08T21:10:53.473615+0000","last_became_peered":"2024-05-08T21:10:53.473615+0000","last_unstale":"2024-05-08T21:19:53.250885+0000","last_undegraded":"2024-05-08T21:19:53.250885+0000","last_fullsized":"2024-05-08T21:19:53.250885+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"32'13","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.240860+0000","last_change":"2024-05-08T21:10:03.751111+0000","last_active":"2024-05-08T21:19:53.240860+0000","last_peered":"2024-05-08T21:19:53.240860+0000","last_clean":"2024-05-08T21:19:53.240860+0000","last_became_active":"2024-05-08T21:10:03.747059+0000","last_became_peered":"2024-05-08T21:10:03.747059+0000","last_unstale":"2024-05-08T21:19:53.240860+0000","last_undegraded":"2024-05-08T21:19:53.240860+0000","last_fullsized":"2024-05-08T21:19:53.240860+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"32'17","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:57.701516+0000","last_change":"2024-05-08T21:19:57.701600+0000","last_active":"2024-05-08T21:19:57.701516+0000","last_peered":"2024-05-08T21:19:57.701516+0000","last_clean":"2024-05-08T21:19:57.701516+0000","last_became_active":"2024-05-08T21:10:03.746942+0000","last_became_peered":"2024-05-08T21:10:03.746942+0000","last_unstale":"2024-05-08T21:19:57.701516+0000","last_undegraded":"2024-05-08T21:19:57.701516+0000","last_fullsized":"2024-05-08T21:19:57.701516+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'17","last_scrub_stamp":"2024-05-08T21:19:57.701494+0000","last_deep_scrub":"32'17","last_deep_scrub_stamp":"2024-05-08T21:19:57.701494+0000","last_clean_scrub_stamp":"2024-05-08T21:19:57.701494+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:15:31.324653+0000","scrub_duration":0.0065830869999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"32'12","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.090653+0000","last_change":"2024-05-08T21:10:03.753663+0000","last_active":"2024-05-08T21:19:53.090653+0000","last_peered":"2024-05-08T21:19:53.090653+0000","last_clean":"2024-05-08T21:19:53.090653+0000","last_became_active":"2024-05-08T21:10:03.752486+0000","last_became_peered":"2024-05-08T21:10:03.752486+0000","last_unstale":"2024-05-08T21:19:53.090653+0000","last_undegraded":"2024-05-08T21:19:53.090653+0000","last_fullsized":"2024-05-08T21:19:53.090653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"32'19","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:17.586352+0000","last_change":"2024-05-08T21:20:17.586434+0000","last_active":"2024-05-08T21:20:17.586352+0000","last_peered":"2024-05-08T21:20:17.586352+0000","last_clean":"2024-05-08T21:20:17.586352+0000","last_became_active":"2024-05-08T21:10:03.753616+0000","last_became_peered":"2024-05-08T21:10:03.753616+0000","last_unstale":"2024-05-08T21:20:17.586352+0000","last_undegraded":"2024-05-08T21:20:17.586352+0000","last_fullsized":"2024-05-08T21:20:17.586352+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'19","last_scrub_stamp":"2024-05-08T21:20:17.586326+0000","last_deep_scrub":"32'19","last_deep_scrub_stamp":"2024-05-08T21:20:17.586326+0000","last_clean_scrub_stamp":"2024-05-08T21:20:17.586326+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:05:31.480211+0000","scrub_duration":0.0093599229999999992,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"32'10","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.260628+0000","last_change":"2024-05-08T21:10:03.744906+0000","last_active":"2024-05-08T21:19:53.260628+0000","last_peered":"2024-05-08T21:19:53.260628+0000","last_clean":"2024-05-08T21:19:53.260628+0000","last_became_active":"2024-05-08T21:10:03.744562+0000","last_became_peered":"2024-05-08T21:10:03.744562+0000","last_unstale":"2024-05-08T21:19:53.260628+0000","last_undegraded":"2024-05-08T21:19:53.260628+0000","last_fullsized":"2024-05-08T21:19:53.260628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1810,"num_read_kb":0,"num_write":1714405,"num_write_kb":22146371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132410,"ondisk_log_size":132410,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":773,"ondisk_log_size":773,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64612,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":15837416,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":328,"num_read_kb":39720,"num_write":2875,"num_write_kb":17766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17809408,"data_stored":31674832,"data_compressed":2933172,"data_compressed_allocated":3907584,"data_compressed_original":17833984,"omap_allocated":0,"internal_metadata":0},"log_size":2925,"ondisk_log_size":2925,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509565,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":913320,"kb_used_data":1888,"kb_used_omap":1,"kb_used_meta":911422,"kb_avail":93458520,"statfs":{"total":96636764160,"available":95701524480,"internally_reserved":0,"allocated":1933312,"data_stored":4343835,"data_compressed":576533,"data_compressed_allocated":724992,"data_compressed_original":3338240,"omap_allocated":1593,"internal_metadata":933296583},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:20:08 2024","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":1.831,"15min":1.587},"min":{"1min":0.32200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":5.5890000000000004,"5min":13.432,"15min":17.978999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.427,"15min":1.117},"min":{"1min":0.29699999999999999,"5min":0.24299999999999999,"15min":0.219},"max":{"1min":6.1020000000000003,"5min":10.097,"15min":11.362},"last":0.54100000000000004}]},{"osd":1,"last update":"Wed May 8 21:20:08 2024","interfaces":[{"interface":"back","average":{"1min":2.2080000000000002,"5min":2.9169999999999998,"15min":1.968},"min":{"1min":0.35499999999999998,"5min":0.219,"15min":0.219},"max":{"1min":17.797000000000001,"5min":49.942999999999998,"15min":49.942999999999998},"last":0.47799999999999998},{"interface":"front","average":{"1min":2.7869999999999999,"5min":2.7970000000000002,"15min":1.667},"min":{"1min":0.41699999999999998,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":16.221,"5min":27.733000000000001,"15min":27.733000000000001},"last":0.40899999999999997}]},{"osd":2,"last update":"Wed May 8 21:20:08 2024","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.6859999999999999,"15min":1.7190000000000001},"min":{"1min":0.39300000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":5.7640000000000002,"5min":17.858000000000001,"15min":58.450000000000003},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.611,"15min":1.159},"min":{"1min":0.35599999999999998,"5min":0.30199999999999999,"15min":0.27400000000000002},"max":{"1min":5.2110000000000003,"5min":13.568,"15min":14.746},"last":0.39400000000000002}]},{"osd":3,"last update":"Wed May 8 21:20:08 2024","interfaces":[{"interface":"back","average":{"1min":3.0169999999999999,"5min":4.1769999999999996,"15min":2.754},"min":{"1min":0.41199999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":23.302,"5min":68.728999999999999,"15min":74.570999999999998},"last":0.52700000000000002},{"interface":"front","average":{"1min":1.863,"5min":1.982,"15min":1.7090000000000001},"min":{"1min":0.35699999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":16.302,"5min":16.302,"15min":28.099},"last":0.46300000000000002}]},{"osd":4,"last update":"Wed May 8 21:20:08 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":1.468,"15min":1.1319999999999999},"min":{"1min":0.25,"5min":0.223,"15min":0.223},"max":{"1min":1.2010000000000001,"5min":27.963000000000001,"15min":29.731000000000002},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.81799999999999995,"5min":1.548,"15min":1.169},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":5.234,"5min":17.835999999999999,"15min":26.454999999999998},"last":0.441}]},{"osd":5,"last update":"Wed May 8 21:20:08 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":1.1619999999999999,"15min":1.1879999999999999},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.25900000000000001},"max":{"1min":5.5190000000000001,"5min":17.780999999999999,"15min":65.373000000000005},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.874,"5min":1.28,"15min":1.0629999999999999},"min":{"1min":0.29099999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":5.1779999999999999,"5min":13.509,"15min":26.498999999999999},"last":0.56799999999999995}]},{"osd":7,"last update":"Wed May 8 21:20:08 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":1.631,"15min":1.0600000000000001},"min":{"1min":0.318,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.1459999999999999,"5min":16.808,"15min":16.808},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.89800000000000002,"5min":1.4399999999999999,"15min":0.98399999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":7.9930000000000003,"5min":18.100999999999999,"15min":18.100999999999999},"last":0.59199999999999997}]}]},{"osd":5,"up_from":15,"seq":64424509567,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":696156,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":695806,"kb_avail":93675684,"statfs":{"total":96636764160,"available":95923900416,"internally_reserved":0,"allocated":348160,"data_stored":148949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":712505798},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":1.8360000000000001,"15min":1.4450000000000001},"min":{"1min":0.24199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":7.8029999999999999,"5min":17.295999999999999,"15min":48.481999999999999},"last":0.58099999999999996},{"interface":"front","average":{"1min":1.619,"5min":2.0600000000000001,"15min":1.522},"min":{"1min":0.36299999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":13.234999999999999,"5min":17.164000000000001,"15min":30.004999999999999},"last":0.42099999999999999}]},{"osd":1,"last update":"Wed May 8 21:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":2.7120000000000002,"15min":1.7310000000000001},"min":{"1min":0.26800000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":3.0550000000000002,"5min":21.702999999999999,"15min":25.228000000000002},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.86299999999999999,"5min":2.4710000000000001,"15min":1.403},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":4.0670000000000002,"5min":21.869,"15min":21.869},"last":0.66800000000000004}]},{"osd":2,"last update":"Wed May 8 21:19:19 2024","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":3.0019999999999998,"15min":1.6699999999999999},"min":{"1min":0.29399999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":10.689,"5min":34.850000000000001,"15min":34.850000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":2.4430000000000001,"15min":1.4690000000000001},"min":{"1min":0.28899999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.617,"5min":29.623000000000001,"15min":29.623000000000001},"last":0.54700000000000004}]},{"osd":3,"last update":"Wed May 8 21:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":1.8029999999999999,"15min":1.377},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":4.1070000000000002,"5min":19.395,"15min":23.234999999999999},"last":0.63},{"interface":"front","average":{"1min":1.55,"5min":3.6520000000000001,"15min":2.0489999999999999},"min":{"1min":0.34399999999999997,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":20.013000000000002,"5min":40.954999999999998,"15min":40.954999999999998},"last":0.60099999999999998}]},{"osd":4,"last update":"Wed May 8 21:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":1.0369999999999999,"15min":0.89800000000000002},"min":{"1min":0.27500000000000002,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.95599999999999996,"5min":12.390000000000001,"15min":23.254000000000001},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.60499999999999998,"5min":1.0820000000000001,"15min":0.93999999999999995},"min":{"1min":0.32300000000000001,"5min":0.27600000000000002,"15min":0.26600000000000001},"max":{"1min":3.0859999999999999,"5min":7.7370000000000001,"15min":17.550999999999998},"last":0.47699999999999998}]},{"osd":6,"last update":"Wed May 8 21:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.95299999999999996,"15min":0.89100000000000001},"min":{"1min":0.26900000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.747,"5min":8.7249999999999996,"15min":17.856000000000002},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":1.1619999999999999,"15min":1.0029999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.26900000000000002},"max":{"1min":0.77700000000000002,"5min":8.9269999999999996,"15min":17.827999999999999},"last":0.56499999999999995}]},{"osd":7,"last update":"Wed May 8 21:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":1.1739999999999999,"15min":0.92900000000000005},"min":{"1min":0.311,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.98499999999999999,"5min":11.183999999999999,"15min":18.079000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":1.464,"15min":1.1659999999999999},"min":{"1min":0.30599999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":4.8819999999999997,"5min":13.496,"15min":30.050000000000001},"last":0.68999999999999995}]}]},{"osd":0,"up_from":14,"seq":60129542271,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":800100,"kb_used_data":1948,"kb_used_omap":1,"kb_used_meta":798142,"kb_avail":93571740,"statfs":{"total":96636764160,"available":95817461760,"internally_reserved":0,"allocated":1994752,"data_stored":3898840,"data_compressed":360679,"data_compressed_allocated":471040,"data_compressed_original":2588672,"omap_allocated":1594,"internal_metadata":817297862},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 8 21:20:14 2024","interfaces":[{"interface":"back","average":{"1min":5.1619999999999999,"5min":3.508,"15min":2.2450000000000001},"min":{"1min":0.19800000000000001,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":60.868000000000002,"5min":60.868000000000002,"15min":98.899000000000001},"last":0.221},{"interface":"front","average":{"1min":4.266,"5min":3.2170000000000001,"15min":1.9119999999999999},"min":{"1min":0.224,"5min":0.185,"15min":0.185},"max":{"1min":61.276000000000003,"5min":61.276000000000003,"15min":61.276000000000003},"last":0.24099999999999999}]},{"osd":2,"last update":"Wed May 8 21:20:14 2024","interfaces":[{"interface":"back","average":{"1min":3.8119999999999998,"5min":2.98,"15min":1.877},"min":{"1min":0.25600000000000001,"5min":0.23499999999999999,"15min":0.224},"max":{"1min":61.043999999999997,"5min":61.043999999999997,"15min":61.043999999999997},"last":0.27800000000000002},{"interface":"front","average":{"1min":3.762,"5min":2.3900000000000001,"15min":1.3069999999999999},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":60.700000000000003,"5min":60.700000000000003,"15min":60.700000000000003},"last":0.26000000000000001}]},{"osd":3,"last update":"Wed May 8 21:20:14 2024","interfaces":[{"interface":"back","average":{"1min":6.7050000000000001,"5min":3.8119999999999998,"15min":2.6110000000000002},"min":{"1min":0.25700000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":92.697000000000003,"5min":92.697000000000003,"15min":92.697000000000003},"last":0.23499999999999999},{"interface":"front","average":{"1min":5.7480000000000002,"5min":2.9590000000000001,"15min":2.0070000000000001},"min":{"1min":0.311,"5min":0.29199999999999998,"15min":0.28899999999999998},"max":{"1min":92.721000000000004,"5min":92.721000000000004,"15min":93.995999999999995},"last":0.38200000000000001}]},{"osd":4,"last update":"Wed May 8 21:20:14 2024","interfaces":[{"interface":"back","average":{"1min":4.1639999999999997,"5min":2.645,"15min":1.9690000000000001},"min":{"1min":0.40300000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":60.953000000000003,"5min":60.953000000000003,"15min":60.953000000000003},"last":0.59399999999999997},{"interface":"front","average":{"1min":4.4779999999999998,"5min":2.7410000000000001,"15min":1.73},"min":{"1min":0.39200000000000002,"5min":0.252,"15min":0.252},"max":{"1min":61.073,"5min":61.073,"15min":61.073},"last":0.54100000000000004}]},{"osd":5,"last update":"Wed May 8 21:20:14 2024","interfaces":[{"interface":"back","average":{"1min":4.5469999999999997,"5min":2.778,"15min":1.7609999999999999},"min":{"1min":0.42799999999999999,"5min":0.311,"15min":0.311},"max":{"1min":60.796999999999997,"5min":60.796999999999997,"15min":60.796999999999997},"last":0.624},{"interface":"front","average":{"1min":4.5229999999999997,"5min":2.569,"15min":1.972},"min":{"1min":0.36799999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":61.005000000000003,"5min":61.005000000000003,"15min":61.005000000000003},"last":0.61399999999999999}]},{"osd":6,"last update":"Wed May 8 21:20:14 2024","interfaces":[{"interface":"back","average":{"1min":4.6319999999999997,"5min":2.448,"15min":1.679},"min":{"1min":0.41099999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":60.838000000000001,"5min":60.838000000000001,"15min":60.838000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":4.3200000000000003,"5min":2.819,"15min":1.6830000000000001},"min":{"1min":0.38500000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":61.100000000000001,"5min":61.100000000000001,"15min":61.100000000000001},"last":0.65800000000000003}]},{"osd":7,"last update":"Wed May 8 21:20:14 2024","interfaces":[{"interface":"back","average":{"1min":3.7330000000000001,"5min":2.4569999999999999,"15min":1.843},"min":{"1min":0.35599999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":53.844999999999999,"5min":53.844999999999999,"15min":53.844999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":4.0149999999999997,"5min":2.8159999999999998,"15min":1.6899999999999999},"min":{"1min":0.438,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":61.124000000000002,"5min":61.124000000000002,"15min":61.124000000000002},"last":0.55500000000000005}]}]},{"osd":7,"up_from":14,"seq":60129542270,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":867812,"kb_used_data":7452,"kb_used_omap":1,"kb_used_meta":860350,"kb_avail":93504028,"statfs":{"total":96636764160,"available":95748124672,"internally_reserved":0,"allocated":7630848,"data_stored":12287392,"data_compressed":917593,"data_compressed_allocated":1265664,"data_compressed_original":6127616,"omap_allocated":1589,"internal_metadata":880998859},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:20:11 2024","interfaces":[{"interface":"back","average":{"1min":1.6100000000000001,"5min":2.2599999999999998,"15min":1.2529999999999999},"min":{"1min":0.26800000000000002,"5min":0.217,"15min":0.20999999999999999},"max":{"1min":6.5570000000000004,"5min":20.876999999999999,"15min":20.876999999999999},"last":0.40000000000000002},{"interface":"front","average":{"1min":1.337,"5min":2.2280000000000002,"15min":1.5249999999999999},"min":{"1min":0.315,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":7.8840000000000003,"5min":23.748999999999999,"15min":62.033000000000001},"last":0.315}]},{"osd":1,"last update":"Wed May 8 21:19:17 2024","interfaces":[{"interface":"back","average":{"1min":1.9350000000000001,"5min":2.8330000000000002,"15min":2.04},"min":{"1min":0.251,"5min":0.251,"15min":0.246},"max":{"1min":23.103999999999999,"5min":44.164000000000001,"15min":44.645000000000003},"last":0.434},{"interface":"front","average":{"1min":1.7050000000000001,"5min":2.395,"15min":1.3720000000000001},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":8.3339999999999996,"5min":44.091000000000001,"15min":44.091000000000001},"last":0.371}]},{"osd":2,"last update":"Wed May 8 21:20:11 2024","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":2.097,"15min":1.1699999999999999},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":6.1989999999999998,"5min":15.986000000000001,"15min":15.986000000000001},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.92400000000000004,"5min":1.782,"15min":1.0509999999999999},"min":{"1min":0.30399999999999999,"5min":0.29099999999999998,"15min":0.26100000000000001},"max":{"1min":5.4370000000000003,"5min":11.112,"15min":11.112},"last":0.46899999999999997}]},{"osd":3,"last update":"Wed May 8 21:20:11 2024","interfaces":[{"interface":"back","average":{"1min":2.0819999999999999,"5min":3.0950000000000002,"15min":1.6850000000000001},"min":{"1min":0.307,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":13.513999999999999,"5min":44.064999999999998,"15min":44.064999999999998},"last":0.53800000000000003},{"interface":"front","average":{"1min":1.857,"5min":2.512,"15min":1.788},"min":{"1min":0.38,"5min":0.28399999999999997,"15min":0.27500000000000002},"max":{"1min":13.789,"5min":44.607999999999997,"15min":44.607999999999997},"last":0.52900000000000003}]},{"osd":4,"last update":"Wed May 8 21:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":1.0549999999999999,"15min":0.82699999999999996},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":3.1850000000000001,"5min":10.51,"15min":21.338000000000001},"last":0.505},{"interface":"front","average":{"1min":0.80200000000000005,"5min":1.302,"15min":0.94799999999999995},"min":{"1min":0.27900000000000003,"5min":0.216,"15min":0.216},"max":{"1min":3.242,"5min":16.082999999999998,"15min":22.827000000000002},"last":0.42299999999999999}]},{"osd":5,"last update":"Wed May 8 21:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.079,"15min":0.85299999999999998},"min":{"1min":0.28899999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":10.785,"5min":10.785,"15min":10.880000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.60899999999999999,"5min":1.026,"15min":0.84699999999999998},"min":{"1min":0.32700000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.613,"5min":7.4939999999999998,"15min":8.157},"last":0.60799999999999998}]},{"osd":6,"last update":"Wed May 8 21:19:17 2024","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.2909999999999999,"15min":0.86099999999999999},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":12.433,"5min":12.433,"15min":12.433},"last":0.45500000000000002},{"interface":"front","average":{"1min":1.252,"5min":1.546,"15min":1.052},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":12.182,"5min":19.864999999999998,"15min":19.864999999999998},"last":0.58599999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574974,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":729956,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":729534,"kb_avail":93641884,"statfs":{"total":96636764160,"available":95889289216,"internally_reserved":0,"allocated":421888,"data_stored":242918,"data_compressed":4766,"data_compressed_allocated":8192,"data_compressed_original":24576,"omap_allocated":1594,"internal_metadata":747043270},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:20:13 2024","interfaces":[{"interface":"back","average":{"1min":2.1459999999999999,"5min":2.5619999999999998,"15min":1.627},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":17.690000000000001,"5min":17.789000000000001,"15min":24.859999999999999},"last":0.22600000000000001},{"interface":"front","average":{"1min":1.429,"5min":2.1419999999999999,"15min":1.4490000000000001},"min":{"1min":0.22500000000000001,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":11.759,"5min":17.835999999999999,"15min":49.606000000000002},"last":0.24199999999999999}]},{"osd":1,"last update":"Wed May 8 21:20:13 2024","interfaces":[{"interface":"back","average":{"1min":3.6709999999999998,"5min":2.6139999999999999,"15min":1.9690000000000001},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.19800000000000001},"max":{"1min":19.904,"5min":24.321999999999999,"15min":55.296999999999997},"last":0.26900000000000002},{"interface":"front","average":{"1min":1.4670000000000001,"5min":2.4399999999999999,"15min":1.782},"min":{"1min":0.254,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":6.3890000000000002,"5min":24.149999999999999,"15min":79.221000000000004},"last":0.28399999999999997}]},{"osd":3,"last update":"Wed May 8 21:20:13 2024","interfaces":[{"interface":"back","average":{"1min":1.9950000000000001,"5min":4.7050000000000001,"15min":2.2690000000000001},"min":{"1min":0.26100000000000001,"5min":0.249,"15min":0.23699999999999999},"max":{"1min":10.680999999999999,"5min":69.888000000000005,"15min":69.888000000000005},"last":0.32800000000000001},{"interface":"front","average":{"1min":2.0720000000000001,"5min":4.7599999999999998,"15min":2.3100000000000001},"min":{"1min":0.30599999999999999,"5min":0.30199999999999999,"15min":0.23699999999999999},"max":{"1min":10.705,"5min":69.959000000000003,"15min":69.959000000000003},"last":0.34599999999999997}]},{"osd":4,"last update":"Wed May 8 21:20:13 2024","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.786,"15min":1.466},"min":{"1min":0.33700000000000002,"5min":0.29299999999999998,"15min":0.253},"max":{"1min":5.8810000000000002,"5min":17.716999999999999,"15min":32.457999999999998},"last":0.504},{"interface":"front","average":{"1min":1.194,"5min":1.7689999999999999,"15min":1.2110000000000001},"min":{"1min":0.28299999999999997,"5min":0.25700000000000001,"15min":0.255},"max":{"1min":5.9640000000000004,"5min":13.827,"15min":18.315000000000001},"last":0.52400000000000002}]},{"osd":5,"last update":"Wed May 8 21:20:13 2024","interfaces":[{"interface":"back","average":{"1min":1.6679999999999999,"5min":1.7649999999999999,"15min":1.153},"min":{"1min":0.434,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":10.627000000000001,"5min":17.507999999999999,"15min":17.507999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":1.0669999999999999,"5min":2.4849999999999999,"15min":1.6519999999999999},"min":{"1min":0.318,"5min":0.30299999999999999,"15min":0.28299999999999997},"max":{"1min":5.9909999999999997,"5min":48.560000000000002,"15min":48.560000000000002},"last":0.55300000000000005}]},{"osd":6,"last update":"Wed May 8 21:20:13 2024","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.752,"15min":1.278},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":5.9160000000000004,"5min":13.933999999999999,"15min":16.399999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":1.837,"5min":2.1230000000000002,"15min":1.3740000000000001},"min":{"1min":0.33600000000000002,"5min":0.33100000000000002,"15min":0.27600000000000002},"max":{"1min":10.538,"5min":17.536000000000001,"15min":23.216000000000001},"last":0.46600000000000003}]},{"osd":7,"last update":"Wed May 8 21:20:13 2024","interfaces":[{"interface":"back","average":{"1min":1.952,"5min":1.992,"15min":1.3839999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.33000000000000002},"max":{"1min":10.599,"5min":11.041,"15min":16.366},"last":0.45000000000000001},{"interface":"front","average":{"1min":1.946,"5min":1.9379999999999999,"15min":1.232},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.313},"max":{"1min":10.654999999999999,"5min":13.903,"15min":13.903},"last":0.53600000000000003}]}]},{"osd":3,"up_from":14,"seq":60129542266,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1284268,"kb_used_data":5284,"kb_used_omap":1,"kb_used_meta":1278974,"kb_avail":93087572,"statfs":{"total":96636764160,"available":95321673728,"internally_reserved":0,"allocated":5410816,"data_stored":8632198,"data_compressed":770600,"data_compressed_allocated":995328,"data_compressed_original":4419584,"omap_allocated":1592,"internal_metadata":1309669832},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:19:20 2024","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":2.9950000000000001,"15min":1.3879999999999999},"min":{"1min":0.24299999999999999,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":7.2930000000000001,"5min":39.801000000000002,"15min":39.801000000000002},"last":0.311},{"interface":"front","average":{"1min":1.3049999999999999,"5min":2.0680000000000001,"15min":1.7569999999999999},"min":{"1min":0.26000000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":10.782,"5min":14.497,"15min":60.847999999999999},"last":0.29399999999999998}]},{"osd":1,"last update":"Wed May 8 21:19:20 2024","interfaces":[{"interface":"back","average":{"1min":2.5249999999999999,"5min":3.3759999999999999,"15min":1.851},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":15.603,"5min":47.418999999999997,"15min":57.020000000000003},"last":0.34499999999999997},{"interface":"front","average":{"1min":4.6790000000000003,"5min":4.5030000000000001,"15min":2.0070000000000001},"min":{"1min":0.26300000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":29.669,"5min":43.317,"15min":43.317},"last":0.27600000000000002}]},{"osd":2,"last update":"Wed May 8 21:19:20 2024","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.714,"15min":1.105},"min":{"1min":0.32000000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":10.712999999999999,"5min":10.938000000000001,"15min":32.247999999999998},"last":0.35499999999999998},{"interface":"front","average":{"1min":1.5029999999999999,"5min":3.1099999999999999,"15min":1.5780000000000001},"min":{"1min":0.33300000000000002,"5min":0.31,"15min":0.26200000000000001},"max":{"1min":7.2030000000000003,"5min":39.386000000000003,"15min":39.386000000000003},"last":0.372}]},{"osd":4,"last update":"Wed May 8 21:19:20 2024","interfaces":[{"interface":"back","average":{"1min":1.446,"5min":1.6639999999999999,"15min":1.639},"min":{"1min":0.39300000000000002,"5min":0.309,"15min":0.309},"max":{"1min":10.755000000000001,"5min":10.755000000000001,"15min":58.072000000000003},"last":0.56499999999999995},{"interface":"front","average":{"1min":1.387,"5min":2.3650000000000002,"15min":1.367},"min":{"1min":0.46700000000000003,"5min":0.314,"15min":0.314},"max":{"1min":7.2430000000000003,"5min":15.712,"15min":26.311},"last":0.74399999999999999}]},{"osd":5,"last update":"Wed May 8 21:19:20 2024","interfaces":[{"interface":"back","average":{"1min":1.5760000000000001,"5min":1.786,"15min":1.6200000000000001},"min":{"1min":0.438,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":10.842000000000001,"5min":14.584,"15min":60.375999999999998},"last":0.66400000000000003},{"interface":"front","average":{"1min":1.4139999999999999,"5min":2.9359999999999999,"15min":1.6080000000000001},"min":{"1min":0.45500000000000002,"5min":0.31,"15min":0.31},"max":{"1min":7.2679999999999998,"5min":39.274000000000001,"15min":39.274000000000001},"last":0.79900000000000004}]},{"osd":6,"last update":"Wed May 8 21:19:20 2024","interfaces":[{"interface":"back","average":{"1min":2.9710000000000001,"5min":3.452,"15min":1.8580000000000001},"min":{"1min":0.34499999999999997,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":30.25,"5min":30.25,"15min":30.25},"last":0.58199999999999996},{"interface":"front","average":{"1min":1.6499999999999999,"5min":3.4319999999999999,"15min":1.861},"min":{"1min":0.48099999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":11.914,"5min":41.323999999999998,"15min":41.323999999999998},"last":0.77600000000000002}]},{"osd":7,"last update":"Wed May 8 21:19:20 2024","interfaces":[{"interface":"back","average":{"1min":2.907,"5min":3.5510000000000002,"15min":1.829},"min":{"1min":0.40100000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":30.295000000000002,"5min":30.295000000000002,"15min":30.295000000000002},"last":0.76200000000000001},{"interface":"front","average":{"1min":3.0310000000000001,"5min":3.9180000000000001,"15min":2.0110000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":30.201000000000001,"5min":30.201000000000001,"15min":30.201000000000001},"last":0.65500000000000003}]}]},{"osd":1,"up_from":15,"seq":64424509564,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1171168,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":1170814,"kb_avail":93200672,"statfs":{"total":96636764160,"available":95437488128,"internally_reserved":0,"allocated":352256,"data_stored":149019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1198913990},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:20:17 2024","interfaces":[{"interface":"back","average":{"1min":4.1159999999999997,"5min":2.488,"15min":1.8879999999999999},"min":{"1min":0.20200000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":35.555999999999997,"5min":35.555999999999997,"15min":68.346999999999994},"last":0.26400000000000001},{"interface":"front","average":{"1min":2.496,"5min":2.5249999999999999,"15min":1.6120000000000001},"min":{"1min":0.22700000000000001,"5min":0.21199999999999999,"15min":0.19800000000000001},"max":{"1min":21.079000000000001,"5min":21.079000000000001,"15min":25.786000000000001},"last":0.313}]},{"osd":2,"last update":"Wed May 8 21:20:17 2024","interfaces":[{"interface":"back","average":{"1min":4.5700000000000003,"5min":3.0409999999999999,"15min":2.468},"min":{"1min":0.217,"5min":0.191,"15min":0.191},"max":{"1min":59.341999999999999,"5min":59.341999999999999,"15min":70.688000000000002},"last":0.34799999999999998},{"interface":"front","average":{"1min":3.7210000000000001,"5min":2.488,"15min":1.9790000000000001},"min":{"1min":0.27900000000000003,"5min":0.22800000000000001,"15min":0.219},"max":{"1min":35.648000000000003,"5min":35.648000000000003,"15min":35.648000000000003},"last":0.27900000000000003}]},{"osd":3,"last update":"Wed May 8 21:20:17 2024","interfaces":[{"interface":"back","average":{"1min":4.2640000000000002,"5min":2.758,"15min":1.8580000000000001},"min":{"1min":0.25,"5min":0.224,"15min":0.224},"max":{"1min":35.601999999999997,"5min":35.601999999999997,"15min":35.658000000000001},"last":0.36499999999999999},{"interface":"front","average":{"1min":3.4460000000000002,"5min":2.1760000000000002,"15min":1.782},"min":{"1min":0.29799999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":35.628,"5min":35.628,"15min":35.628},"last":0.44900000000000001}]},{"osd":4,"last update":"Wed May 8 21:20:17 2024","interfaces":[{"interface":"back","average":{"1min":3.6429999999999998,"5min":2.2730000000000001,"15min":1.6899999999999999},"min":{"1min":0.40699999999999997,"5min":0.34999999999999998,"15min":0.26900000000000002},"max":{"1min":24.457999999999998,"5min":24.457999999999998,"15min":43.401000000000003},"last":0.432},{"interface":"front","average":{"1min":3.1720000000000002,"5min":2.3199999999999998,"15min":1.5049999999999999},"min":{"1min":0.32800000000000001,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":24.553999999999998,"5min":24.553999999999998,"15min":27.239000000000001},"last":0.53500000000000003}]},{"osd":5,"last update":"Wed May 8 21:20:17 2024","interfaces":[{"interface":"back","average":{"1min":4.0490000000000004,"5min":2.6970000000000001,"15min":1.964},"min":{"1min":0.39800000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":59.378999999999998,"5min":59.378999999999998,"15min":59.378999999999998},"last":0.52600000000000002},{"interface":"front","average":{"1min":3.077,"5min":2.169,"15min":1.7430000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.32300000000000001},"max":{"1min":24.524000000000001,"5min":24.524000000000001,"15min":27.352},"last":0.46700000000000003}]},{"osd":6,"last update":"Wed May 8 21:20:17 2024","interfaces":[{"interface":"back","average":{"1min":4.7549999999999999,"5min":3.0579999999999998,"15min":2.028},"min":{"1min":0.44500000000000001,"5min":0.307,"15min":0.307},"max":{"1min":70.786000000000001,"5min":70.786000000000001,"15min":70.786000000000001},"last":0.503},{"interface":"front","average":{"1min":3.1099999999999999,"5min":2.1739999999999999,"15min":1.5740000000000001},"min":{"1min":0.46000000000000002,"5min":0.35999999999999999,"15min":0.35499999999999998},"max":{"1min":24.588999999999999,"5min":24.588999999999999,"15min":27.376999999999999},"last":0.51300000000000001}]},{"osd":7,"last update":"Wed May 8 21:20:17 2024","interfaces":[{"interface":"back","average":{"1min":3.5419999999999998,"5min":2.8239999999999998,"15min":2.1680000000000001},"min":{"1min":0.46300000000000002,"5min":0.315,"15min":0.315},"max":{"1min":35.683999999999997,"5min":35.683999999999997,"15min":68.287999999999997},"last":0.49199999999999999},{"interface":"front","average":{"1min":3.1389999999999998,"5min":2.1789999999999998,"15min":1.714},"min":{"1min":0.42599999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":24.613,"5min":24.613,"15min":27.312999999999999},"last":0.55500000000000005}]}]},{"osd":4,"up_from":15,"seq":64424509565,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":923444,"kb_used_data":2540,"kb_used_omap":1,"kb_used_meta":920894,"kb_avail":93448396,"statfs":{"total":96636764160,"available":95691157504,"internally_reserved":0,"allocated":2600960,"data_stored":4343289,"data_compressed":367613,"data_compressed_allocated":532480,"data_compressed_original":2482176,"omap_allocated":1593,"internal_metadata":942995911},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:19:19 2024","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.5580000000000001,"15min":1.0549999999999999},"min":{"1min":0.28299999999999997,"5min":0.218,"15min":0.218},"max":{"1min":7.6849999999999996,"5min":20.606999999999999,"15min":20.606999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":1.7769999999999999,"5min":2.7770000000000001,"15min":1.758},"min":{"1min":0.316,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":18.945,"5min":45.499000000000002,"15min":45.499000000000002},"last":0.44900000000000001}]},{"osd":1,"last update":"Wed May 8 21:19:19 2024","interfaces":[{"interface":"back","average":{"1min":2.4870000000000001,"5min":5.0439999999999996,"15min":2.5},"min":{"1min":0.28100000000000003,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":18.905999999999999,"5min":273.69299999999998,"15min":273.69299999999998},"last":0.40899999999999997},{"interface":"front","average":{"1min":1.0409999999999999,"5min":4.907,"15min":3.069},"min":{"1min":0.35499999999999998,"5min":0.28699999999999998,"15min":0.26200000000000001},"max":{"1min":5.2290000000000001,"5min":281.21699999999998,"15min":281.21699999999998},"last":0.55500000000000005}]},{"osd":2,"last update":"Wed May 8 21:19:19 2024","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.8089999999999999,"15min":1.395},"min":{"1min":0.26200000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":7.4119999999999999,"5min":46.542000000000002,"15min":96.177999999999997},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.64100000000000001,"5min":1.415,"15min":1.361},"min":{"1min":0.35399999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.7070000000000001,"5min":16.183,"15min":94.947000000000003},"last":0.39500000000000002}]},{"osd":3,"last update":"Wed May 8 21:19:19 2024","interfaces":[{"interface":"back","average":{"1min":1.8999999999999999,"5min":2.3540000000000001,"15min":1.429},"min":{"1min":0.33500000000000002,"5min":0.245,"15min":0.23899999999999999},"max":{"1min":18.632000000000001,"5min":18.632000000000001,"15min":30.596},"last":0.48699999999999999},{"interface":"front","average":{"1min":1.111,"5min":3.4340000000000002,"15min":1.804},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":5.2089999999999996,"5min":42.969000000000001,"15min":42.969000000000001},"last":0.42499999999999999}]},{"osd":5,"last update":"Wed May 8 21:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":1.7669999999999999,"15min":1.129},"min":{"1min":0.29499999999999998,"5min":0.252,"15min":0.221},"max":{"1min":1.714,"5min":46.488999999999997,"15min":46.488999999999997},"last":0.31},{"interface":"front","average":{"1min":0.877,"5min":1.6899999999999999,"15min":0.98599999999999999},"min":{"1min":0.37,"5min":0.28000000000000003,"15min":0.26200000000000001},"max":{"1min":4.9320000000000004,"5min":45.445999999999998,"15min":45.445999999999998},"last":0.378}]},{"osd":6,"last update":"Wed May 8 21:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":1.869,"15min":1.1439999999999999},"min":{"1min":0.29699999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.6839999999999999,"5min":35.289999999999999,"15min":35.289999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":2.145,"15min":1.5029999999999999},"min":{"1min":0.371,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.351,"5min":46.576999999999998,"15min":46.576999999999998},"last":0.435}]},{"osd":7,"last update":"Wed May 8 21:19:19 2024","interfaces":[{"interface":"back","average":{"1min":1.5980000000000001,"5min":1.9430000000000001,"15min":1.1259999999999999},"min":{"1min":0.36099999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":19.077999999999999,"5min":19.077999999999999,"15min":19.077999999999999},"last":0.35999999999999999},{"interface":"front","average":{"1min":2.4390000000000001,"5min":1.6319999999999999,"15min":1.0489999999999999},"min":{"1min":0.32300000000000001,"5min":0.30299999999999999,"15min":0.28000000000000003},"max":{"1min":31.617999999999999,"5min":31.617999999999999,"15min":31.617999999999999},"last":0.503}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32306,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32306,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1585152,"data_stored":3159613,"data_compressed":328373,"data_compressed_allocated":425984,"data_compressed_original":2015232,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":94059,"data_compressed":4766,"data_compressed_allocated":8192,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5066752,"data_stored":8483339,"data_compressed":770600,"data_compressed_allocated":995328,"data_compressed_original":4419584,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2256896,"data_stored":4194430,"data_compressed":367613,"data_compressed_allocated":532480,"data_compressed_original":2482176,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1589248,"data_stored":4194976,"data_compressed":576533,"data_compressed_allocated":724992,"data_compressed_original":3338240,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7221248,"data_stored":11548165,"data_compressed":885287,"data_compressed_allocated":1220608,"data_compressed_original":5554176,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T21:20:19.880 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.880 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.880 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.880 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.880 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.880 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.881 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.881 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.881 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.881 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.881 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.881 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.881 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.881 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.881 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.882 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.882 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.882 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.882 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.882 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.882 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-05-08T21:10:02.301995+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=2, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.882 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.882 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.883 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-05-08T21:10:02.301995+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=2, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.883 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.883 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.883 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.883 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.883 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.883 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.883 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.884 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.884 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.884 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.884 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.884 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.884 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.884 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.884 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-05-08T21:10:02.301995+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=2, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.884 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.885 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.885 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.885 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.885 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.885 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.885 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.885 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.885 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.886 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.886 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.886 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.886 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.886 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.886 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-05-08T21:10:02.301995+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=2, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.886 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.886 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-05-08T21:10:02.301995+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=2, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.886 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.887 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.887 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.887 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.887 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.887 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-05-08T21:10:02.301995+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=2, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.887 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.887 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.887 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.888 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.888 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-05-08T21:10:02.301995+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=2, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.888 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.888 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.888 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.888 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.888 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.888 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.889 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.889 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.889 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.889 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.889 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.889 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.889 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.889 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.889 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:19.890 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-08T21:20:39.891 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T21:20:40.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.021+0000 7f5e09ddc700 1 Processor -- start 2024-05-08T21:20:40.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.021+0000 7f5e09ddc700 1 -- start start 2024-05-08T21:20:40.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.021+0000 7f5e09ddc700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f5e0406ef50 0x7f5e04072cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:20:40.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.021+0000 7f5e09ddc700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5e0406f330 0x7f5e0415ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:20:40.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.021+0000 7f5e09ddc700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e04071390 con 0x7f5e04153f60 2024-05-08T21:20:40.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.021+0000 7f5e09ddc700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e040c7030 con 0x7f5e0406ef50 2024-05-08T21:20:40.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.021+0000 7f5e09ddc700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0415b0b0 con 0x7f5e0406f330 2024-05-08T21:20:40.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.022+0000 7f5e03fff700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f5e04153f60 0x7f5e040c74c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44282/0 (socket says 172.21.15.80:44282) 2024-05-08T21:20:40.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.022+0000 7f5e03fff700 1 -- 172.21.15.80:0/1152921972 learned_addr learned my addr 172.21.15.80:0/1152921972 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:20:40.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.022+0000 7f5e027fc700 1 -- 172.21.15.80:0/1152921972 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3010017370 0 0) 0x7f5e04071390 con 0x7f5e04153f60 2024-05-08T21:20:40.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.022+0000 7f5e02ffd700 1 --2- 172.21.15.80:0/1152921972 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5e0406f330 0x7f5e0415ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:20:40.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.022+0000 7f5e037fe700 1 --2- 172.21.15.80:0/1152921972 >> v2:172.21.15.106:3300/0 conn(0x7f5e0406ef50 0x7f5e04072cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:20:40.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.022+0000 7f5e027fc700 1 -- 172.21.15.80:0/1152921972 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5df00035b0 con 0x7f5e04153f60 2024-05-08T21:20:40.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.022+0000 7f5e027fc700 1 -- 172.21.15.80:0/1152921972 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3533722580 0 0) 0x7f5df00035b0 con 0x7f5e04153f60 2024-05-08T21:20:40.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.022+0000 7f5e027fc700 1 -- 172.21.15.80:0/1152921972 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5e0406f330 msgr2=0x7f5e0415ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:20:40.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.022+0000 7f5e027fc700 1 --2- 172.21.15.80:0/1152921972 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5e0406f330 0x7f5e0415ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:20:40.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.022+0000 7f5e027fc700 1 -- 172.21.15.80:0/1152921972 >> v2:172.21.15.106:3300/0 conn(0x7f5e0406ef50 msgr2=0x7f5e04072cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:20:40.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.022+0000 7f5e027fc700 1 --2- 172.21.15.80:0/1152921972 >> v2:172.21.15.106:3300/0 conn(0x7f5e0406ef50 0x7f5e04072cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:20:40.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.022+0000 7f5e027fc700 1 -- 172.21.15.80:0/1152921972 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e040c8aa0 con 0x7f5e04153f60 2024-05-08T21:20:40.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.022+0000 7f5e027fc700 1 -- 172.21.15.80:0/1152921972 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3520646302 0 0) 0x7f5dfc001670 con 0x7f5e04153f60 2024-05-08T21:20:40.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.022+0000 7f5e027fc700 1 -- 172.21.15.80:0/1152921972 >> v1:172.21.15.80:6789/0 conn(0x7f5e04153f60 legacy=0x7f5e040c74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:20:40.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.022+0000 7f5e027fc700 1 --2- 172.21.15.80:0/1152921972 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5df0003a00 0x7f5df0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:20:40.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.022+0000 7f5e027fc700 1 --2- 172.21.15.80:0/1152921972 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5df0004850 0x7f5df0004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:20:40.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.022+0000 7f5e027fc700 1 --2- 172.21.15.80:0/1152921972 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5e0406f330 0x7f5df0005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:20:40.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.022+0000 7f5e027fc700 1 -- 172.21.15.80:0/1152921972 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e040c7030 con 0x7f5df0004850 2024-05-08T21:20:40.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.022+0000 7f5e027fc700 1 -- 172.21.15.80:0/1152921972 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0415b0b0 con 0x7f5df0003a00 2024-05-08T21:20:40.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.022+0000 7f5e027fc700 1 -- 172.21.15.80:0/1152921972 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5df000ba10 con 0x7f5e0406f330 2024-05-08T21:20:40.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.022+0000 7f5e02ffd700 1 --2- 172.21.15.80:0/1152921972 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5df0004850 0x7f5df0004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:20:40.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.022+0000 7f5e03fff700 1 --2- 172.21.15.80:0/1152921972 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5e0406f330 0x7f5df0005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:20:40.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.022+0000 7f5e037fe700 1 --2- 172.21.15.80:0/1152921972 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5df0003a00 0x7f5df0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:20:40.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.023+0000 7f5e02ffd700 1 -- 172.21.15.80:0/1152921972 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5e0406f330 msgr2=0x7f5df0005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:20:40.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.023+0000 7f5e02ffd700 1 --2- 172.21.15.80:0/1152921972 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5e0406f330 0x7f5df0005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:20:40.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.023+0000 7f5e02ffd700 1 -- 172.21.15.80:0/1152921972 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5df0003a00 msgr2=0x7f5df0003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:20:40.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.023+0000 7f5e02ffd700 1 --2- 172.21.15.80:0/1152921972 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5df0003a00 0x7f5df0003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:20:40.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.023+0000 7f5e02ffd700 1 -- 172.21.15.80:0/1152921972 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df00035b0 con 0x7f5df0004850 2024-05-08T21:20:40.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.023+0000 7f5e03fff700 1 --2- 172.21.15.80:0/1152921972 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5e0406f330 0x7f5df0005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:20:40.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.023+0000 7f5e02ffd700 1 --2- 172.21.15.80:0/1152921972 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5df0004850 0x7f5df0004cd0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f5dec009b60 tx=0x7f5df0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=540b87d731d9e79a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:20:40.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.023+0000 7f5e027fc700 1 -- 172.21.15.80:0/1152921972 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dec00e6c0 con 0x7f5df0004850 2024-05-08T21:20:40.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.023+0000 7f5e027fc700 1 -- 172.21.15.80:0/1152921972 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dec00e820 con 0x7f5df0004850 2024-05-08T21:20:40.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.023+0000 7f5e027fc700 1 -- 172.21.15.80:0/1152921972 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dec00eb90 con 0x7f5df0004850 2024-05-08T21:20:40.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.023+0000 7f5e09ddc700 1 -- 172.21.15.80:0/1152921972 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5df0004850 msgr2=0x7f5df0004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:20:40.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.023+0000 7f5e09ddc700 1 --2- 172.21.15.80:0/1152921972 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5df0004850 0x7f5df0004cd0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f5dec009b60 tx=0x7f5df0005880 comp rx=0 tx=0).stop 2024-05-08T21:20:40.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.023+0000 7f5e03fff700 1 -- 172.21.15.80:0/1152921972 reap_dead start 2024-05-08T21:20:40.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.023+0000 7f5e09ddc700 1 -- 172.21.15.80:0/1152921972 shutdown_connections 2024-05-08T21:20:40.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.023+0000 7f5e09ddc700 1 -- 172.21.15.80:0/1152921972 >> 172.21.15.80:0/1152921972 conn(0x7f5e040c9310 msgr2=0x7f5e040c9720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:20:40.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.023+0000 7f5e09ddc700 1 -- 172.21.15.80:0/1152921972 shutdown_connections 2024-05-08T21:20:40.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.023+0000 7f5e09ddc700 1 -- 172.21.15.80:0/1152921972 wait complete. 2024-05-08T21:20:40.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.025+0000 7f5e09ddc700 1 Processor -- start 2024-05-08T21:20:40.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.025+0000 7f5e09ddc700 1 -- start start 2024-05-08T21:20:40.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.025+0000 7f5e09ddc700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5df0004850 0x7f5e0414a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:20:40.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.025+0000 7f5e09ddc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e0414b8f0 0x7f5e0414cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:20:40.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.026+0000 7f5e09ddc700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5e041e6b40 0x7f5e0414d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:20:40.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.026+0000 7f5e09ddc700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0414da20 con 0x7f5e0414b8f0 2024-05-08T21:20:40.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.026+0000 7f5e09ddc700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e041f32e0 con 0x7f5df0004850 2024-05-08T21:20:40.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.026+0000 7f5e09ddc700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e041f35a0 con 0x7f5e041e6b40 2024-05-08T21:20:40.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.026+0000 7f5e02ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e0414b8f0 0x7f5e0414cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:20:40.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.026+0000 7f5e02ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e0414b8f0 0x7f5e0414cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37398/0 (socket says 172.21.15.80:37398) 2024-05-08T21:20:40.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.026+0000 7f5e02ffd700 1 -- 172.21.15.80:0/3452257000 learned_addr learned my addr 172.21.15.80:0/3452257000 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:20:40.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.026+0000 7f5e037fe700 1 --2- 172.21.15.80:0/3452257000 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5df0004850 0x7f5e0414a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:20:40.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.026+0000 7f5e03fff700 1 --2- 172.21.15.80:0/3452257000 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5e041e6b40 0x7f5e0414d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:20:40.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.026+0000 7f5e02ffd700 1 -- 172.21.15.80:0/3452257000 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5e041e6b40 msgr2=0x7f5e0414d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:20:40.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.026+0000 7f5e02ffd700 1 --2- 172.21.15.80:0/3452257000 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5e041e6b40 0x7f5e0414d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:20:40.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.026+0000 7f5e02ffd700 1 -- 172.21.15.80:0/3452257000 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5df0004850 msgr2=0x7f5e0414a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:20:40.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.026+0000 7f5e02ffd700 1 --2- 172.21.15.80:0/3452257000 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5df0004850 0x7f5e0414a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:20:40.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.026+0000 7f5e02ffd700 1 -- 172.21.15.80:0/3452257000 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e041f3880 con 0x7f5e0414b8f0 2024-05-08T21:20:40.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.026+0000 7f5e037fe700 1 --2- 172.21.15.80:0/3452257000 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5df0004850 0x7f5e0414a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:20:40.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.026+0000 7f5e02ffd700 1 --2- 172.21.15.80:0/3452257000 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e0414b8f0 0x7f5e0414cb70 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f5df00046a0 tx=0x7f5dec0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:20:40.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.026+0000 7f5dfbfff700 1 -- 172.21.15.80:0/3452257000 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dec00e6c0 con 0x7f5e0414b8f0 2024-05-08T21:20:40.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.026+0000 7f5dfbfff700 1 -- 172.21.15.80:0/3452257000 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dec003ab0 con 0x7f5e0414b8f0 2024-05-08T21:20:40.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.026+0000 7f5e09ddc700 1 -- 172.21.15.80:0/3452257000 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e041f3b60 con 0x7f5e0414b8f0 2024-05-08T21:20:40.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.026+0000 7f5dfbfff700 1 -- 172.21.15.80:0/3452257000 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dec003e60 con 0x7f5e0414b8f0 2024-05-08T21:20:40.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.026+0000 7f5e09ddc700 1 -- 172.21.15.80:0/3452257000 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e0414a8c0 con 0x7f5e0414b8f0 2024-05-08T21:20:40.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.027+0000 7f5e09ddc700 1 -- 172.21.15.80:0/3452257000 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e04072370 con 0x7f5e0414b8f0 2024-05-08T21:20:40.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.027+0000 7f5dfbfff700 1 -- 172.21.15.80:0/3452257000 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5dec013470 con 0x7f5e0414b8f0 2024-05-08T21:20:40.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.028+0000 7f5dfbfff700 1 --2- 172.21.15.80:0/3452257000 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f5de406acc0 0x7f5de406d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:20:40.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.028+0000 7f5dfbfff700 1 -- 172.21.15.80:0/3452257000 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f5dec08b210 con 0x7f5e0414b8f0 2024-05-08T21:20:40.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.028+0000 7f5e037fe700 1 --2- 172.21.15.80:0/3452257000 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f5de406acc0 0x7f5de406d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:20:40.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.028+0000 7f5e037fe700 1 --2- 172.21.15.80:0/3452257000 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f5de406acc0 0x7f5de406d180 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5df40074d0 tx=0x7f5df400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:20:40.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.032+0000 7f5dfbfff700 1 -- 172.21.15.80:0/3452257000 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f5dec056090 con 0x7f5e0414b8f0 2024-05-08T21:20:40.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.225+0000 7f5e09ddc700 1 -- 172.21.15.80:0/3452257000 --> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5e040718c0 con 0x7f5de406acc0 2024-05-08T21:20:40.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.234+0000 7f5dfbfff700 1 -- 172.21.15.80:0/3452257000 <== mgr.4100 v2:172.21.15.80:6832/46731 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+370645 (secure 0 0 0) 0x7f5df400f040 con 0x7f5de406acc0 2024-05-08T21:20:40.241 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:20:40.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.238+0000 7f5e09ddc700 1 -- 172.21.15.80:0/3452257000 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f5de406acc0 msgr2=0x7f5de406d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:20:40.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.238+0000 7f5e09ddc700 1 --2- 172.21.15.80:0/3452257000 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f5de406acc0 0x7f5de406d180 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5df40074d0 tx=0x7f5df400b040 comp rx=0 tx=0).stop 2024-05-08T21:20:40.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.238+0000 7f5e09ddc700 1 -- 172.21.15.80:0/3452257000 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e0414b8f0 msgr2=0x7f5e0414cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:20:40.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.238+0000 7f5e09ddc700 1 --2- 172.21.15.80:0/3452257000 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e0414b8f0 0x7f5e0414cb70 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f5df00046a0 tx=0x7f5dec0047c0 comp rx=0 tx=0).stop 2024-05-08T21:20:40.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.238+0000 7f5e09ddc700 1 -- 172.21.15.80:0/3452257000 shutdown_connections 2024-05-08T21:20:40.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.238+0000 7f5e09ddc700 1 --2- 172.21.15.80:0/3452257000 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f5de406acc0 0x7f5de406d180 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:20:40.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.238+0000 7f5e09ddc700 1 --2- 172.21.15.80:0/3452257000 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5e041e6b40 0x7f5e0414d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:20:40.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.238+0000 7f5e09ddc700 1 --2- 172.21.15.80:0/3452257000 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5df0004850 0x7f5e0414a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:20:40.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.238+0000 7f5e09ddc700 1 --2- 172.21.15.80:0/3452257000 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e0414b8f0 0x7f5e0414cb70 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:20:40.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.238+0000 7f5e09ddc700 1 -- 172.21.15.80:0/3452257000 >> 172.21.15.80:0/3452257000 conn(0x7f5e040c9310 msgr2=0x7f5e04153220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:20:40.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.238+0000 7f5e09ddc700 1 -- 172.21.15.80:0/3452257000 shutdown_connections 2024-05-08T21:20:40.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:20:40.238+0000 7f5e09ddc700 1 -- 172.21.15.80:0/3452257000 wait complete. 2024-05-08T21:20:40.245 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-05-08T21:20:40.253 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":347,"stamp":"2024-05-08T21:20:38.512828+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":16427784,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":2254,"num_read_kb":39820,"num_write":1717439,"num_write_kb":22166553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":136231,"ondisk_log_size":136231,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":7386224,"kb_used_data":20208,"kb_used_omap":12,"kb_used_meta":7365939,"kb_avail":747588496,"statfs":{"total":773094113280,"available":765530619904,"internally_reserved":0,"allocated":20692992,"data_stored":34046440,"data_compressed":2997784,"data_compressed_allocated":3997696,"data_compressed_original":18980864,"omap_allocated":12743,"internal_metadata":7542722105},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002732"},"pg_stats":[{"pgid":"3.3f","version":"32'8","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:59.065070+0000","last_change":"2024-05-08T21:10:03.747477+0000","last_active":"2024-05-08T21:19:59.065070+0000","last_peered":"2024-05-08T21:19:59.065070+0000","last_clean":"2024-05-08T21:19:59.065070+0000","last_became_active":"2024-05-08T21:10:03.747059+0000","last_became_peered":"2024-05-08T21:10:03.747059+0000","last_unstale":"2024-05-08T21:19:59.065070+0000","last_undegraded":"2024-05-08T21:19:59.065070+0000","last_fullsized":"2024-05-08T21:19:59.065070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"32'6","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:01.277494+0000","last_change":"2024-05-08T21:20:01.277494+0000","last_active":"2024-05-08T21:20:01.277494+0000","last_peered":"2024-05-08T21:20:01.277494+0000","last_clean":"2024-05-08T21:20:01.277494+0000","last_became_active":"2024-05-08T21:10:03.738466+0000","last_became_peered":"2024-05-08T21:10:03.738466+0000","last_unstale":"2024-05-08T21:20:01.277494+0000","last_undegraded":"2024-05-08T21:20:01.277494+0000","last_fullsized":"2024-05-08T21:20:01.277494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-08T21:20:01.277377+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-08T21:20:01.277377+0000","last_clean_scrub_stamp":"2024-05-08T21:20:01.277377+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:32:05.453713+0000","scrub_duration":0.0039052399999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"32'13","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:06.584071+0000","last_change":"2024-05-08T21:20:06.584071+0000","last_active":"2024-05-08T21:20:06.584071+0000","last_peered":"2024-05-08T21:20:06.584071+0000","last_clean":"2024-05-08T21:20:06.584071+0000","last_became_active":"2024-05-08T21:10:03.739884+0000","last_became_peered":"2024-05-08T21:10:03.739884+0000","last_unstale":"2024-05-08T21:20:06.584071+0000","last_undegraded":"2024-05-08T21:20:06.584071+0000","last_fullsized":"2024-05-08T21:20:06.584071+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'13","last_scrub_stamp":"2024-05-08T21:20:06.583961+0000","last_deep_scrub":"32'13","last_deep_scrub_stamp":"2024-05-08T21:20:06.583961+0000","last_clean_scrub_stamp":"2024-05-08T21:20:06.583961+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:24:50.098329+0000","scrub_duration":0.0046022240000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"32'6","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:57.787680+0000","last_change":"2024-05-08T21:10:03.754159+0000","last_active":"2024-05-08T21:19:57.787680+0000","last_peered":"2024-05-08T21:19:57.787680+0000","last_clean":"2024-05-08T21:19:57.787680+0000","last_became_active":"2024-05-08T21:10:03.753800+0000","last_became_peered":"2024-05-08T21:10:03.753800+0000","last_unstale":"2024-05-08T21:19:57.787680+0000","last_undegraded":"2024-05-08T21:19:57.787680+0000","last_fullsized":"2024-05-08T21:19:57.787680+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"32'11","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:59.065095+0000","last_change":"2024-05-08T21:10:03.750051+0000","last_active":"2024-05-08T21:19:59.065095+0000","last_peered":"2024-05-08T21:19:59.065095+0000","last_clean":"2024-05-08T21:19:59.065095+0000","last_became_active":"2024-05-08T21:10:03.749730+0000","last_became_peered":"2024-05-08T21:10:03.749730+0000","last_unstale":"2024-05-08T21:19:59.065095+0000","last_undegraded":"2024-05-08T21:19:59.065095+0000","last_fullsized":"2024-05-08T21:19:59.065095+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"32'11","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:24.269275+0000","last_change":"2024-05-08T21:20:24.269351+0000","last_active":"2024-05-08T21:20:24.269275+0000","last_peered":"2024-05-08T21:20:24.269275+0000","last_clean":"2024-05-08T21:20:24.269275+0000","last_became_active":"2024-05-08T21:10:53.473632+0000","last_became_peered":"2024-05-08T21:10:53.473632+0000","last_unstale":"2024-05-08T21:20:24.269275+0000","last_undegraded":"2024-05-08T21:20:24.269275+0000","last_fullsized":"2024-05-08T21:20:24.269275+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'11","last_scrub_stamp":"2024-05-08T21:20:24.269250+0000","last_deep_scrub":"32'11","last_deep_scrub_stamp":"2024-05-08T21:20:24.269250+0000","last_clean_scrub_stamp":"2024-05-08T21:20:24.269250+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:51:14.956490+0000","scrub_duration":0.0012160070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"32'8","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:59.065022+0000","last_change":"2024-05-08T21:10:03.743802+0000","last_active":"2024-05-08T21:19:59.065022+0000","last_peered":"2024-05-08T21:19:59.065022+0000","last_clean":"2024-05-08T21:19:59.065022+0000","last_became_active":"2024-05-08T21:10:03.743349+0000","last_became_peered":"2024-05-08T21:10:03.743349+0000","last_unstale":"2024-05-08T21:19:59.065022+0000","last_undegraded":"2024-05-08T21:19:59.065022+0000","last_fullsized":"2024-05-08T21:19:59.065022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"32'6","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:29.956625+0000","last_change":"2024-05-08T21:20:29.956700+0000","last_active":"2024-05-08T21:20:29.956625+0000","last_peered":"2024-05-08T21:20:29.956625+0000","last_clean":"2024-05-08T21:20:29.956625+0000","last_became_active":"2024-05-08T21:10:03.747300+0000","last_became_peered":"2024-05-08T21:10:03.747300+0000","last_unstale":"2024-05-08T21:20:29.956625+0000","last_undegraded":"2024-05-08T21:20:29.956625+0000","last_fullsized":"2024-05-08T21:20:29.956625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-08T21:20:29.956603+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-08T21:20:29.956603+0000","last_clean_scrub_stamp":"2024-05-08T21:20:29.956603+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:54:30.695489+0000","scrub_duration":0.0019023519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"32'16","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.263123+0000","last_change":"2024-05-08T21:10:03.748221+0000","last_active":"2024-05-08T21:19:53.263123+0000","last_peered":"2024-05-08T21:19:53.263123+0000","last_clean":"2024-05-08T21:19:53.263123+0000","last_became_active":"2024-05-08T21:10:03.747956+0000","last_became_peered":"2024-05-08T21:10:03.747956+0000","last_unstale":"2024-05-08T21:19:53.263123+0000","last_undegraded":"2024-05-08T21:19:53.263123+0000","last_fullsized":"2024-05-08T21:19:53.263123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"32'11","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:31.121780+0000","last_change":"2024-05-08T21:20:31.121902+0000","last_active":"2024-05-08T21:20:31.121780+0000","last_peered":"2024-05-08T21:20:31.121780+0000","last_clean":"2024-05-08T21:20:31.121780+0000","last_became_active":"2024-05-08T21:10:03.744976+0000","last_became_peered":"2024-05-08T21:10:03.744976+0000","last_unstale":"2024-05-08T21:20:31.121780+0000","last_undegraded":"2024-05-08T21:20:31.121780+0000","last_fullsized":"2024-05-08T21:20:31.121780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'11","last_scrub_stamp":"2024-05-08T21:20:31.121735+0000","last_deep_scrub":"32'11","last_deep_scrub_stamp":"2024-05-08T21:20:31.121735+0000","last_clean_scrub_stamp":"2024-05-08T21:20:31.121735+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:21:11.685387+0000","scrub_duration":0.0039182499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"32'12","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:30.096196+0000","last_change":"2024-05-08T21:20:30.096328+0000","last_active":"2024-05-08T21:20:30.096196+0000","last_peered":"2024-05-08T21:20:30.096196+0000","last_clean":"2024-05-08T21:20:30.096196+0000","last_became_active":"2024-05-08T21:10:03.748253+0000","last_became_peered":"2024-05-08T21:10:03.748253+0000","last_unstale":"2024-05-08T21:20:30.096196+0000","last_undegraded":"2024-05-08T21:20:30.096196+0000","last_fullsized":"2024-05-08T21:20:30.096196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-08T21:20:30.096170+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-08T21:20:30.096170+0000","last_clean_scrub_stamp":"2024-05-08T21:20:30.096170+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:18.919748+0000","scrub_duration":0.023160623000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"32'11","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:15.607176+0000","last_change":"2024-05-08T21:20:15.607331+0000","last_active":"2024-05-08T21:20:15.607176+0000","last_peered":"2024-05-08T21:20:15.607176+0000","last_clean":"2024-05-08T21:20:15.607176+0000","last_became_active":"2024-05-08T21:10:03.745247+0000","last_became_peered":"2024-05-08T21:10:03.745247+0000","last_unstale":"2024-05-08T21:20:15.607176+0000","last_undegraded":"2024-05-08T21:20:15.607176+0000","last_fullsized":"2024-05-08T21:20:15.607176+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'11","last_scrub_stamp":"2024-05-08T21:20:15.607148+0000","last_deep_scrub":"32'11","last_deep_scrub_stamp":"2024-05-08T21:20:15.607148+0000","last_clean_scrub_stamp":"2024-05-08T21:20:15.607148+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:09:50.658665+0000","scrub_duration":0.0016985839999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"32'15","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:58.769193+0000","last_change":"2024-05-08T21:19:58.769310+0000","last_active":"2024-05-08T21:19:58.769193+0000","last_peered":"2024-05-08T21:19:58.769193+0000","last_clean":"2024-05-08T21:19:58.769193+0000","last_became_active":"2024-05-08T21:10:03.746848+0000","last_became_peered":"2024-05-08T21:10:03.746848+0000","last_unstale":"2024-05-08T21:19:58.769193+0000","last_undegraded":"2024-05-08T21:19:58.769193+0000","last_fullsized":"2024-05-08T21:19:58.769193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-05-08T21:19:58.769170+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-05-08T21:19:58.769170+0000","last_clean_scrub_stamp":"2024-05-08T21:19:58.769170+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:44:20.357961+0000","scrub_duration":0.027292114999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"32'17","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:30.472402+0000","last_change":"2024-05-08T21:20:30.472476+0000","last_active":"2024-05-08T21:20:30.472402+0000","last_peered":"2024-05-08T21:20:30.472402+0000","last_clean":"2024-05-08T21:20:30.472402+0000","last_became_active":"2024-05-08T21:10:03.737716+0000","last_became_peered":"2024-05-08T21:10:03.737716+0000","last_unstale":"2024-05-08T21:20:30.472402+0000","last_undegraded":"2024-05-08T21:20:30.472402+0000","last_fullsized":"2024-05-08T21:20:30.472402+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'17","last_scrub_stamp":"2024-05-08T21:20:30.472380+0000","last_deep_scrub":"32'17","last_deep_scrub_stamp":"2024-05-08T21:20:30.472380+0000","last_clean_scrub_stamp":"2024-05-08T21:20:30.472380+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:02:29.542314+0000","scrub_duration":0.0012646129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"32'13","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:35.353925+0000","last_change":"2024-05-08T21:20:35.354026+0000","last_active":"2024-05-08T21:20:35.353925+0000","last_peered":"2024-05-08T21:20:35.353925+0000","last_clean":"2024-05-08T21:20:35.353925+0000","last_became_active":"2024-05-08T21:10:03.744276+0000","last_became_peered":"2024-05-08T21:10:03.744276+0000","last_unstale":"2024-05-08T21:20:35.353925+0000","last_undegraded":"2024-05-08T21:20:35.353925+0000","last_fullsized":"2024-05-08T21:20:35.353925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'13","last_scrub_stamp":"2024-05-08T21:20:35.353899+0000","last_deep_scrub":"32'13","last_deep_scrub_stamp":"2024-05-08T21:20:35.353899+0000","last_clean_scrub_stamp":"2024-05-08T21:20:35.353899+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:31:08.149770+0000","scrub_duration":0.004560644,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"32'13","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.180928+0000","last_change":"2024-05-08T21:10:03.746547+0000","last_active":"2024-05-08T21:19:53.180928+0000","last_peered":"2024-05-08T21:19:53.180928+0000","last_clean":"2024-05-08T21:19:53.180928+0000","last_became_active":"2024-05-08T21:10:03.745862+0000","last_became_peered":"2024-05-08T21:10:03.745862+0000","last_unstale":"2024-05-08T21:19:53.180928+0000","last_undegraded":"2024-05-08T21:19:53.180928+0000","last_fullsized":"2024-05-08T21:19:53.180928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"32'13","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:21.351874+0000","last_change":"2024-05-08T21:20:21.352085+0000","last_active":"2024-05-08T21:20:21.351874+0000","last_peered":"2024-05-08T21:20:21.351874+0000","last_clean":"2024-05-08T21:20:21.351874+0000","last_became_active":"2024-05-08T21:10:54.028630+0000","last_became_peered":"2024-05-08T21:10:54.028630+0000","last_unstale":"2024-05-08T21:20:21.351874+0000","last_undegraded":"2024-05-08T21:20:21.351874+0000","last_fullsized":"2024-05-08T21:20:21.351874+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'13","last_scrub_stamp":"2024-05-08T21:20:21.351819+0000","last_deep_scrub":"32'13","last_deep_scrub_stamp":"2024-05-08T21:20:21.351819+0000","last_clean_scrub_stamp":"2024-05-08T21:20:21.351819+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:26.614142+0000","scrub_duration":0.028289547000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"32'17","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:09.346737+0000","last_change":"2024-05-08T21:20:09.346874+0000","last_active":"2024-05-08T21:20:09.346737+0000","last_peered":"2024-05-08T21:20:09.346737+0000","last_clean":"2024-05-08T21:20:09.346737+0000","last_became_active":"2024-05-08T21:10:03.743596+0000","last_became_peered":"2024-05-08T21:10:03.743596+0000","last_unstale":"2024-05-08T21:20:09.346737+0000","last_undegraded":"2024-05-08T21:20:09.346737+0000","last_fullsized":"2024-05-08T21:20:09.346737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'17","last_scrub_stamp":"2024-05-08T21:20:09.346697+0000","last_deep_scrub":"32'17","last_deep_scrub_stamp":"2024-05-08T21:20:09.346697+0000","last_clean_scrub_stamp":"2024-05-08T21:20:09.346697+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:36:15.220278+0000","scrub_duration":0.0019157390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"32'15","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.066176+0000","last_change":"2024-05-08T21:10:03.743893+0000","last_active":"2024-05-08T21:19:53.066176+0000","last_peered":"2024-05-08T21:19:53.066176+0000","last_clean":"2024-05-08T21:19:53.066176+0000","last_became_active":"2024-05-08T21:10:03.743580+0000","last_became_peered":"2024-05-08T21:10:03.743580+0000","last_unstale":"2024-05-08T21:19:53.066176+0000","last_undegraded":"2024-05-08T21:19:53.066176+0000","last_fullsized":"2024-05-08T21:19:53.066176+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"32'4303","reported_seq":4393,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.616922+0000","last_change":"2024-05-08T21:10:08.052394+0000","last_active":"2024-05-08T21:19:53.616922+0000","last_peered":"2024-05-08T21:19:53.616922+0000","last_clean":"2024-05-08T21:19:53.616922+0000","last_became_active":"2024-05-08T21:10:08.052009+0000","last_became_peered":"2024-05-08T21:10:08.052009+0000","last_unstale":"2024-05-08T21:19:53.616922+0000","last_undegraded":"2024-05-08T21:19:53.616922+0000","last_fullsized":"2024-05-08T21:19:53.616922+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4303,"log_dups_size":0,"ondisk_log_size":4303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":0,"num_write":56160,"num_write_kb":728959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"32'474","reported_seq":524,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:03.577407+0000","last_change":"2024-05-08T21:20:03.577407+0000","last_active":"2024-05-08T21:20:03.577407+0000","last_peered":"2024-05-08T21:20:03.577407+0000","last_clean":"2024-05-08T21:20:03.577407+0000","last_became_active":"2024-05-08T21:10:03.339847+0000","last_became_peered":"2024-05-08T21:10:03.339847+0000","last_unstale":"2024-05-08T21:20:03.577407+0000","last_undegraded":"2024-05-08T21:20:03.577407+0000","last_fullsized":"2024-05-08T21:20:03.577407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'474","last_scrub_stamp":"2024-05-08T21:20:03.577308+0000","last_deep_scrub":"32'474","last_deep_scrub_stamp":"2024-05-08T21:20:03.577308+0000","last_clean_scrub_stamp":"2024-05-08T21:20:03.577308+0000","objects_scrubbed":3,"log_size":474,"log_dups_size":0,"ondisk_log_size":474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:33:31.180492+0000","scrub_duration":0.013062450999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3159557,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":1370,"num_write":465,"num_write_kb":3345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"32'7","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:18.886705+0000","last_change":"2024-05-08T21:20:18.886796+0000","last_active":"2024-05-08T21:20:18.886705+0000","last_peered":"2024-05-08T21:20:18.886705+0000","last_clean":"2024-05-08T21:20:18.886705+0000","last_became_active":"2024-05-08T21:10:03.746383+0000","last_became_peered":"2024-05-08T21:10:03.746383+0000","last_unstale":"2024-05-08T21:20:18.886705+0000","last_undegraded":"2024-05-08T21:20:18.886705+0000","last_fullsized":"2024-05-08T21:20:18.886705+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-05-08T21:20:18.886683+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-05-08T21:20:18.886683+0000","last_clean_scrub_stamp":"2024-05-08T21:20:18.886683+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:26:32.191068+0000","scrub_duration":0.013506995000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'4174","reported_seq":4264,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:54.850299+0000","last_change":"2024-05-08T21:10:53.484902+0000","last_active":"2024-05-08T21:19:54.850299+0000","last_peered":"2024-05-08T21:19:54.850299+0000","last_clean":"2024-05-08T21:19:54.850299+0000","last_became_active":"2024-05-08T21:10:53.484437+0000","last_became_peered":"2024-05-08T21:10:53.484437+0000","last_unstale":"2024-05-08T21:19:54.850299+0000","last_undegraded":"2024-05-08T21:19:54.850299+0000","last_fullsized":"2024-05-08T21:19:54.850299+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4174,"log_dups_size":0,"ondisk_log_size":4174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":0,"num_write":53711,"num_write_kb":702965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2,3],"acting":[4,6,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"32'7","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:12.814201+0000","last_change":"2024-05-08T21:20:12.814201+0000","last_active":"2024-05-08T21:20:12.814201+0000","last_peered":"2024-05-08T21:20:12.814201+0000","last_clean":"2024-05-08T21:20:12.814201+0000","last_became_active":"2024-05-08T21:10:03.328970+0000","last_became_peered":"2024-05-08T21:10:03.328970+0000","last_unstale":"2024-05-08T21:20:12.814201+0000","last_undegraded":"2024-05-08T21:20:12.814201+0000","last_fullsized":"2024-05-08T21:20:12.814201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-05-08T21:20:12.814101+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-05-08T21:20:12.814101+0000","last_clean_scrub_stamp":"2024-05-08T21:20:12.814101+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:43:38.340101+0000","scrub_duration":0.0011883289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"32'13","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:27.544019+0000","last_change":"2024-05-08T21:20:27.544140+0000","last_active":"2024-05-08T21:20:27.544019+0000","last_peered":"2024-05-08T21:20:27.544019+0000","last_clean":"2024-05-08T21:20:27.544019+0000","last_became_active":"2024-05-08T21:10:03.747989+0000","last_became_peered":"2024-05-08T21:10:03.747989+0000","last_unstale":"2024-05-08T21:20:27.544019+0000","last_undegraded":"2024-05-08T21:20:27.544019+0000","last_fullsized":"2024-05-08T21:20:27.544019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'13","last_scrub_stamp":"2024-05-08T21:20:27.543996+0000","last_deep_scrub":"32'13","last_deep_scrub_stamp":"2024-05-08T21:20:27.543996+0000","last_clean_scrub_stamp":"2024-05-08T21:20:27.543996+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:12:19.610255+0000","scrub_duration":0.024098972,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"32'4151","reported_seq":4236,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:57.259663+0000","last_change":"2024-05-08T21:10:07.770390+0000","last_active":"2024-05-08T21:19:57.259663+0000","last_peered":"2024-05-08T21:19:57.259663+0000","last_clean":"2024-05-08T21:19:57.259663+0000","last_became_active":"2024-05-08T21:10:07.770017+0000","last_became_peered":"2024-05-08T21:10:07.770017+0000","last_unstale":"2024-05-08T21:19:57.259663+0000","last_undegraded":"2024-05-08T21:19:57.259663+0000","last_fullsized":"2024-05-08T21:19:57.259663+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4151,"log_dups_size":0,"ondisk_log_size":4151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":0,"num_write":52838,"num_write_kb":674205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"32'18","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:28.459122+0000","last_change":"2024-05-08T21:20:28.459218+0000","last_active":"2024-05-08T21:20:28.459122+0000","last_peered":"2024-05-08T21:20:28.459122+0000","last_clean":"2024-05-08T21:20:28.459122+0000","last_became_active":"2024-05-08T21:10:03.338917+0000","last_became_peered":"2024-05-08T21:10:03.338917+0000","last_unstale":"2024-05-08T21:20:28.459122+0000","last_undegraded":"2024-05-08T21:20:28.459122+0000","last_fullsized":"2024-05-08T21:20:28.459122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-05-08T21:20:28.459097+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-05-08T21:20:28.459097+0000","last_clean_scrub_stamp":"2024-05-08T21:20:28.459097+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:49:40.671717+0000","scrub_duration":0.0027695089999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":8,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"32'8","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:23.306716+0000","last_change":"2024-05-08T21:20:23.306798+0000","last_active":"2024-05-08T21:20:23.306716+0000","last_peered":"2024-05-08T21:20:23.306716+0000","last_clean":"2024-05-08T21:20:23.306716+0000","last_became_active":"2024-05-08T21:10:53.476785+0000","last_became_peered":"2024-05-08T21:10:53.476785+0000","last_unstale":"2024-05-08T21:20:23.306716+0000","last_undegraded":"2024-05-08T21:20:23.306716+0000","last_fullsized":"2024-05-08T21:20:23.306716+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-08T21:20:23.306692+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-08T21:20:23.306692+0000","last_clean_scrub_stamp":"2024-05-08T21:20:23.306692+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:49:09.865482+0000","scrub_duration":0.0019960160000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"32'3545","reported_seq":3623,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:29.806106+0000","last_change":"2024-05-08T21:20:29.806325+0000","last_active":"2024-05-08T21:20:29.806106+0000","last_peered":"2024-05-08T21:20:29.806106+0000","last_clean":"2024-05-08T21:20:29.806106+0000","last_became_active":"2024-05-08T21:10:07.775998+0000","last_became_peered":"2024-05-08T21:10:07.775998+0000","last_unstale":"2024-05-08T21:20:29.806106+0000","last_undegraded":"2024-05-08T21:20:29.806106+0000","last_fullsized":"2024-05-08T21:20:29.806106+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3545","last_scrub_stamp":"2024-05-08T21:20:29.806063+0000","last_deep_scrub":"32'3545","last_deep_scrub_stamp":"2024-05-08T21:20:29.806063+0000","last_clean_scrub_stamp":"2024-05-08T21:20:29.806063+0000","objects_scrubbed":0,"log_size":3545,"log_dups_size":0,"ondisk_log_size":3545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:59:45.176945+0000","scrub_duration":0.066639699999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":0,"num_write":46338,"num_write_kb":599175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"32'7","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:19.435435+0000","last_change":"2024-05-08T21:20:19.435545+0000","last_active":"2024-05-08T21:20:19.435435+0000","last_peered":"2024-05-08T21:20:19.435435+0000","last_clean":"2024-05-08T21:20:19.435435+0000","last_became_active":"2024-05-08T21:10:03.338899+0000","last_became_peered":"2024-05-08T21:10:03.338899+0000","last_unstale":"2024-05-08T21:20:19.435435+0000","last_undegraded":"2024-05-08T21:20:19.435435+0000","last_fullsized":"2024-05-08T21:20:19.435435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-05-08T21:20:19.435410+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-05-08T21:20:19.435410+0000","last_clean_scrub_stamp":"2024-05-08T21:20:19.435410+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:57:17.240045+0000","scrub_duration":0.0026800080000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"32'14","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:29.310868+0000","last_change":"2024-05-08T21:20:29.310991+0000","last_active":"2024-05-08T21:20:29.310868+0000","last_peered":"2024-05-08T21:20:29.310868+0000","last_clean":"2024-05-08T21:20:29.310868+0000","last_became_active":"2024-05-08T21:10:03.750371+0000","last_became_peered":"2024-05-08T21:10:03.750371+0000","last_unstale":"2024-05-08T21:20:29.310868+0000","last_undegraded":"2024-05-08T21:20:29.310868+0000","last_fullsized":"2024-05-08T21:20:29.310868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-05-08T21:20:29.310842+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-05-08T21:20:29.310842+0000","last_clean_scrub_stamp":"2024-05-08T21:20:29.310842+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:32:04.261463+0000","scrub_duration":0.0055974880000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"32'4480","reported_seq":4580,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:30.968240+0000","last_change":"2024-05-08T21:20:30.968368+0000","last_active":"2024-05-08T21:20:30.968240+0000","last_peered":"2024-05-08T21:20:30.968240+0000","last_clean":"2024-05-08T21:20:30.968240+0000","last_became_active":"2024-05-08T21:10:07.767234+0000","last_became_peered":"2024-05-08T21:10:07.767234+0000","last_unstale":"2024-05-08T21:20:30.968240+0000","last_undegraded":"2024-05-08T21:20:30.968240+0000","last_fullsized":"2024-05-08T21:20:30.968240+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4480","last_scrub_stamp":"2024-05-08T21:20:30.968208+0000","last_deep_scrub":"32'4480","last_deep_scrub_stamp":"2024-05-08T21:20:30.968208+0000","last_clean_scrub_stamp":"2024-05-08T21:20:30.968208+0000","objects_scrubbed":0,"log_size":4480,"log_dups_size":0,"ondisk_log_size":4480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:44:44.789711+0000","scrub_duration":0.040809031000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":0,"num_write":57901,"num_write_kb":753617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"32'1296","reported_seq":1337,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:09.764169+0000","last_change":"2024-05-08T21:20:09.764290+0000","last_active":"2024-05-08T21:20:09.764169+0000","last_peered":"2024-05-08T21:20:09.764169+0000","last_clean":"2024-05-08T21:20:09.764169+0000","last_became_active":"2024-05-08T21:10:03.337860+0000","last_became_peered":"2024-05-08T21:10:03.337860+0000","last_unstale":"2024-05-08T21:20:09.764169+0000","last_undegraded":"2024-05-08T21:20:09.764169+0000","last_fullsized":"2024-05-08T21:20:09.764169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'1296","last_scrub_stamp":"2024-05-08T21:20:09.764127+0000","last_deep_scrub":"32'1296","last_deep_scrub_stamp":"2024-05-08T21:20:09.764127+0000","last_clean_scrub_stamp":"2024-05-08T21:20:09.764127+0000","objects_scrubbed":1,"log_size":1296,"log_dups_size":0,"ondisk_log_size":1296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:11:05.072292+0000","scrub_duration":0.015328803,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":1290,"num_write_kb":5292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"32'12","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:58.476141+0000","last_change":"2024-05-08T21:19:58.476141+0000","last_active":"2024-05-08T21:19:58.476141+0000","last_peered":"2024-05-08T21:19:58.476141+0000","last_clean":"2024-05-08T21:19:58.476141+0000","last_became_active":"2024-05-08T21:10:03.743227+0000","last_became_peered":"2024-05-08T21:10:03.743227+0000","last_unstale":"2024-05-08T21:19:58.476141+0000","last_undegraded":"2024-05-08T21:19:58.476141+0000","last_fullsized":"2024-05-08T21:19:58.476141+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-08T21:19:58.475998+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-08T21:19:58.475998+0000","last_clean_scrub_stamp":"2024-05-08T21:19:58.475998+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:35:21.268713+0000","scrub_duration":0.001760143,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"32'3361","reported_seq":3437,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:18.422658+0000","last_change":"2024-05-08T21:20:18.422829+0000","last_active":"2024-05-08T21:20:18.422658+0000","last_peered":"2024-05-08T21:20:18.422658+0000","last_clean":"2024-05-08T21:20:18.422658+0000","last_became_active":"2024-05-08T21:10:07.768160+0000","last_became_peered":"2024-05-08T21:10:07.768160+0000","last_unstale":"2024-05-08T21:20:18.422658+0000","last_undegraded":"2024-05-08T21:20:18.422658+0000","last_fullsized":"2024-05-08T21:20:18.422658+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3361","last_scrub_stamp":"2024-05-08T21:20:18.422615+0000","last_deep_scrub":"32'3361","last_deep_scrub_stamp":"2024-05-08T21:20:18.422615+0000","last_clean_scrub_stamp":"2024-05-08T21:20:18.422615+0000","objects_scrubbed":0,"log_size":3361,"log_dups_size":0,"ondisk_log_size":3361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:49:37.582528+0000","scrub_duration":0.058164241999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":0,"num_write":43355,"num_write_kb":562121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"32'9","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:02.828459+0000","last_change":"2024-05-08T21:20:02.828565+0000","last_active":"2024-05-08T21:20:02.828459+0000","last_peered":"2024-05-08T21:20:02.828459+0000","last_clean":"2024-05-08T21:20:02.828459+0000","last_became_active":"2024-05-08T21:10:03.332844+0000","last_became_peered":"2024-05-08T21:10:03.332844+0000","last_unstale":"2024-05-08T21:20:02.828459+0000","last_undegraded":"2024-05-08T21:20:02.828459+0000","last_fullsized":"2024-05-08T21:20:02.828459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-05-08T21:20:02.828433+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-05-08T21:20:02.828433+0000","last_clean_scrub_stamp":"2024-05-08T21:20:02.828433+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:53:55.069397+0000","scrub_duration":0.001788127,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"32'12","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:11.631350+0000","last_change":"2024-05-08T21:20:11.631446+0000","last_active":"2024-05-08T21:20:11.631350+0000","last_peered":"2024-05-08T21:20:11.631350+0000","last_clean":"2024-05-08T21:20:11.631350+0000","last_became_active":"2024-05-08T21:10:03.742753+0000","last_became_peered":"2024-05-08T21:10:03.742753+0000","last_unstale":"2024-05-08T21:20:11.631350+0000","last_undegraded":"2024-05-08T21:20:11.631350+0000","last_fullsized":"2024-05-08T21:20:11.631350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-08T21:20:11.631327+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-08T21:20:11.631327+0000","last_clean_scrub_stamp":"2024-05-08T21:20:11.631327+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:50:05.535730+0000","scrub_duration":0.01930291,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4240","reported_seq":4335,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:58.532791+0000","last_change":"2024-05-08T21:10:07.770105+0000","last_active":"2024-05-08T21:19:58.532791+0000","last_peered":"2024-05-08T21:19:58.532791+0000","last_clean":"2024-05-08T21:19:58.532791+0000","last_became_active":"2024-05-08T21:10:07.769668+0000","last_became_peered":"2024-05-08T21:10:07.769668+0000","last_unstale":"2024-05-08T21:19:58.532791+0000","last_undegraded":"2024-05-08T21:19:58.532791+0000","last_fullsized":"2024-05-08T21:19:58.532791+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4240,"log_dups_size":0,"ondisk_log_size":4240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":0,"num_write":54954,"num_write_kb":711961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"32'4","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:03.662340+0000","last_change":"2024-05-08T21:20:03.662462+0000","last_active":"2024-05-08T21:20:03.662340+0000","last_peered":"2024-05-08T21:20:03.662340+0000","last_clean":"2024-05-08T21:20:03.662340+0000","last_became_active":"2024-05-08T21:10:03.332750+0000","last_became_peered":"2024-05-08T21:10:03.332750+0000","last_unstale":"2024-05-08T21:20:03.662340+0000","last_undegraded":"2024-05-08T21:20:03.662340+0000","last_fullsized":"2024-05-08T21:20:03.662340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T21:20:03.662300+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T21:20:03.662300+0000","last_clean_scrub_stamp":"2024-05-08T21:20:03.662300+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:38:24.800703+0000","scrub_duration":0.001741189,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'19","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:01.739268+0000","last_change":"2024-05-08T21:20:01.739343+0000","last_active":"2024-05-08T21:20:01.739268+0000","last_peered":"2024-05-08T21:20:01.739268+0000","last_clean":"2024-05-08T21:20:01.739268+0000","last_became_active":"2024-05-08T21:10:03.743724+0000","last_became_peered":"2024-05-08T21:10:03.743724+0000","last_unstale":"2024-05-08T21:20:01.739268+0000","last_undegraded":"2024-05-08T21:20:01.739268+0000","last_fullsized":"2024-05-08T21:20:01.739268+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'19","last_scrub_stamp":"2024-05-08T21:20:01.739244+0000","last_deep_scrub":"32'19","last_deep_scrub_stamp":"2024-05-08T21:20:01.739244+0000","last_clean_scrub_stamp":"2024-05-08T21:20:01.739244+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:24:59.758236+0000","scrub_duration":0.0011762560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"32'4835","reported_seq":4931,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:55.139269+0000","last_change":"2024-05-08T21:10:08.052307+0000","last_active":"2024-05-08T21:19:55.139269+0000","last_peered":"2024-05-08T21:19:55.139269+0000","last_clean":"2024-05-08T21:19:55.139269+0000","last_became_active":"2024-05-08T21:10:08.051924+0000","last_became_peered":"2024-05-08T21:10:08.051924+0000","last_unstale":"2024-05-08T21:19:55.139269+0000","last_undegraded":"2024-05-08T21:19:55.139269+0000","last_fullsized":"2024-05-08T21:19:55.139269+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4835,"log_dups_size":0,"ondisk_log_size":4835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":0,"num_write":62640,"num_write_kb":808641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:13.384814+0000","last_change":"2024-05-08T21:20:13.384926+0000","last_active":"2024-05-08T21:20:13.384814+0000","last_peered":"2024-05-08T21:20:13.384814+0000","last_clean":"2024-05-08T21:20:13.384814+0000","last_became_active":"2024-05-08T21:10:03.330054+0000","last_became_peered":"2024-05-08T21:10:03.330054+0000","last_unstale":"2024-05-08T21:20:13.384814+0000","last_undegraded":"2024-05-08T21:20:13.384814+0000","last_fullsized":"2024-05-08T21:20:13.384814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:20:13.384790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:20:13.384790+0000","last_clean_scrub_stamp":"2024-05-08T21:20:13.384790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:47:44.021224+0000","scrub_duration":0.0013472479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"32'9","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:00.300968+0000","last_change":"2024-05-08T21:20:00.301081+0000","last_active":"2024-05-08T21:20:00.300968+0000","last_peered":"2024-05-08T21:20:00.300968+0000","last_clean":"2024-05-08T21:20:00.300968+0000","last_became_active":"2024-05-08T21:10:03.739425+0000","last_became_peered":"2024-05-08T21:10:03.739425+0000","last_unstale":"2024-05-08T21:20:00.300968+0000","last_undegraded":"2024-05-08T21:20:00.300968+0000","last_fullsized":"2024-05-08T21:20:00.300968+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-05-08T21:20:00.300945+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-05-08T21:20:00.300945+0000","last_clean_scrub_stamp":"2024-05-08T21:20:00.300945+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:19:46.530428+0000","scrub_duration":0.0052140820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"32'4216","reported_seq":4297,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.277483+0000","last_change":"2024-05-08T21:10:08.050980+0000","last_active":"2024-05-08T21:19:53.277483+0000","last_peered":"2024-05-08T21:19:53.277483+0000","last_clean":"2024-05-08T21:19:53.277483+0000","last_became_active":"2024-05-08T21:10:08.050625+0000","last_became_peered":"2024-05-08T21:10:08.050625+0000","last_unstale":"2024-05-08T21:19:53.277483+0000","last_undegraded":"2024-05-08T21:19:53.277483+0000","last_fullsized":"2024-05-08T21:19:53.277483+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4216,"log_dups_size":0,"ondisk_log_size":4216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":0,"num_write":54049,"num_write_kb":693342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"32'4","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:12.887724+0000","last_change":"2024-05-08T21:20:12.887825+0000","last_active":"2024-05-08T21:20:12.887724+0000","last_peered":"2024-05-08T21:20:12.887724+0000","last_clean":"2024-05-08T21:20:12.887724+0000","last_became_active":"2024-05-08T21:10:03.330973+0000","last_became_peered":"2024-05-08T21:10:03.330973+0000","last_unstale":"2024-05-08T21:20:12.887724+0000","last_undegraded":"2024-05-08T21:20:12.887724+0000","last_fullsized":"2024-05-08T21:20:12.887724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T21:20:12.887700+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T21:20:12.887700+0000","last_clean_scrub_stamp":"2024-05-08T21:20:12.887700+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:59:10.235660+0000","scrub_duration":0.0015778560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"32'15","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:26.347454+0000","last_change":"2024-05-08T21:20:26.347563+0000","last_active":"2024-05-08T21:20:26.347454+0000","last_peered":"2024-05-08T21:20:26.347454+0000","last_clean":"2024-05-08T21:20:26.347454+0000","last_became_active":"2024-05-08T21:10:03.751426+0000","last_became_peered":"2024-05-08T21:10:03.751426+0000","last_unstale":"2024-05-08T21:20:26.347454+0000","last_undegraded":"2024-05-08T21:20:26.347454+0000","last_fullsized":"2024-05-08T21:20:26.347454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-05-08T21:20:26.347426+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-05-08T21:20:26.347426+0000","last_clean_scrub_stamp":"2024-05-08T21:20:26.347426+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:56:03.545269+0000","scrub_duration":0.0057080960000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"32'4067","reported_seq":4161,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.235906+0000","last_change":"2024-05-08T21:10:53.484721+0000","last_active":"2024-05-08T21:19:53.235906+0000","last_peered":"2024-05-08T21:19:53.235906+0000","last_clean":"2024-05-08T21:19:53.235906+0000","last_became_active":"2024-05-08T21:10:53.484313+0000","last_became_peered":"2024-05-08T21:10:53.484313+0000","last_unstale":"2024-05-08T21:19:53.235906+0000","last_undegraded":"2024-05-08T21:19:53.235906+0000","last_fullsized":"2024-05-08T21:19:53.235906+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4067,"log_dups_size":0,"ondisk_log_size":4067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":0,"num_write":52779,"num_write_kb":673924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"32'3","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:01.367256+0000","last_change":"2024-05-08T21:20:01.367399+0000","last_active":"2024-05-08T21:20:01.367256+0000","last_peered":"2024-05-08T21:20:01.367256+0000","last_clean":"2024-05-08T21:20:01.367256+0000","last_became_active":"2024-05-08T21:10:03.331712+0000","last_became_peered":"2024-05-08T21:10:03.331712+0000","last_unstale":"2024-05-08T21:20:01.367256+0000","last_undegraded":"2024-05-08T21:20:01.367256+0000","last_fullsized":"2024-05-08T21:20:01.367256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-05-08T21:20:01.367207+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-05-08T21:20:01.367207+0000","last_clean_scrub_stamp":"2024-05-08T21:20:01.367207+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:44:21.231895+0000","scrub_duration":0.001703927,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"32'15","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:18.637130+0000","last_change":"2024-05-08T21:20:18.637253+0000","last_active":"2024-05-08T21:20:18.637130+0000","last_peered":"2024-05-08T21:20:18.637130+0000","last_clean":"2024-05-08T21:20:18.637130+0000","last_became_active":"2024-05-08T21:10:03.748315+0000","last_became_peered":"2024-05-08T21:10:03.748315+0000","last_unstale":"2024-05-08T21:20:18.637130+0000","last_undegraded":"2024-05-08T21:20:18.637130+0000","last_fullsized":"2024-05-08T21:20:18.637130+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-05-08T21:20:18.637109+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-05-08T21:20:18.637109+0000","last_clean_scrub_stamp":"2024-05-08T21:20:18.637109+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:32:12.691075+0000","scrub_duration":0.016542603999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"32'4209","reported_seq":4300,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:32.797200+0000","last_change":"2024-05-08T21:20:32.797364+0000","last_active":"2024-05-08T21:20:32.797200+0000","last_peered":"2024-05-08T21:20:32.797200+0000","last_clean":"2024-05-08T21:20:32.797200+0000","last_became_active":"2024-05-08T21:10:07.761129+0000","last_became_peered":"2024-05-08T21:10:07.761129+0000","last_unstale":"2024-05-08T21:20:32.797200+0000","last_undegraded":"2024-05-08T21:20:32.797200+0000","last_fullsized":"2024-05-08T21:20:32.797200+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4209","last_scrub_stamp":"2024-05-08T21:20:32.797173+0000","last_deep_scrub":"32'4209","last_deep_scrub_stamp":"2024-05-08T21:20:32.797173+0000","last_clean_scrub_stamp":"2024-05-08T21:20:32.797173+0000","objects_scrubbed":0,"log_size":4209,"log_dups_size":0,"ondisk_log_size":4209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:00:45.112532+0000","scrub_duration":0.054341675999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":0,"num_write":55217,"num_write_kb":706687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"32'19","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:13.143038+0000","last_change":"2024-05-08T21:20:13.143152+0000","last_active":"2024-05-08T21:20:13.143038+0000","last_peered":"2024-05-08T21:20:13.143038+0000","last_clean":"2024-05-08T21:20:13.143038+0000","last_became_active":"2024-05-08T21:10:03.332796+0000","last_became_peered":"2024-05-08T21:10:03.332796+0000","last_unstale":"2024-05-08T21:20:13.143038+0000","last_undegraded":"2024-05-08T21:20:13.143038+0000","last_fullsized":"2024-05-08T21:20:13.143038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'19","last_scrub_stamp":"2024-05-08T21:20:13.143014+0000","last_deep_scrub":"32'19","last_deep_scrub_stamp":"2024-05-08T21:20:13.143014+0000","last_clean_scrub_stamp":"2024-05-08T21:20:13.143014+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:05:21.634577+0000","scrub_duration":0.0039298390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":19,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"32'12","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:00.530549+0000","last_change":"2024-05-08T21:20:00.530656+0000","last_active":"2024-05-08T21:20:00.530549+0000","last_peered":"2024-05-08T21:20:00.530549+0000","last_clean":"2024-05-08T21:20:00.530549+0000","last_became_active":"2024-05-08T21:10:03.750394+0000","last_became_peered":"2024-05-08T21:10:03.750394+0000","last_unstale":"2024-05-08T21:20:00.530549+0000","last_undegraded":"2024-05-08T21:20:00.530549+0000","last_fullsized":"2024-05-08T21:20:00.530549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-08T21:20:00.530522+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-08T21:20:00.530522+0000","last_clean_scrub_stamp":"2024-05-08T21:20:00.530522+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:15:24.920108+0000","scrub_duration":0.0015651160000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"32'3898","reported_seq":3963,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.185154+0000","last_change":"2024-05-08T21:10:07.764815+0000","last_active":"2024-05-08T21:19:53.185154+0000","last_peered":"2024-05-08T21:19:53.185154+0000","last_clean":"2024-05-08T21:19:53.185154+0000","last_became_active":"2024-05-08T21:10:07.763591+0000","last_became_peered":"2024-05-08T21:10:07.763591+0000","last_unstale":"2024-05-08T21:19:53.185154+0000","last_undegraded":"2024-05-08T21:19:53.185154+0000","last_fullsized":"2024-05-08T21:19:53.185154+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":3898,"log_dups_size":0,"ondisk_log_size":3898,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":0,"num_write":50159,"num_write_kb":657283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"32'224","reported_seq":281,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:11.871388+0000","last_change":"2024-05-08T21:20:11.871495+0000","last_active":"2024-05-08T21:20:11.871388+0000","last_peered":"2024-05-08T21:20:11.871388+0000","last_clean":"2024-05-08T21:20:11.871388+0000","last_became_active":"2024-05-08T21:10:03.342202+0000","last_became_peered":"2024-05-08T21:10:03.342202+0000","last_unstale":"2024-05-08T21:20:11.871388+0000","last_undegraded":"2024-05-08T21:20:11.871388+0000","last_fullsized":"2024-05-08T21:20:11.871388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'224","last_scrub_stamp":"2024-05-08T21:20:11.871363+0000","last_deep_scrub":"32'224","last_deep_scrub_stamp":"2024-05-08T21:20:11.871363+0000","last_clean_scrub_stamp":"2024-05-08T21:20:11.871363+0000","objects_scrubbed":4,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:39:13.408501+0000","scrub_duration":0.016953936999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":37,"num_read_kb":12328,"num_write":219,"num_write_kb":4276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"32'12","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:51.206088+0000","last_change":"2024-05-08T21:10:03.752144+0000","last_active":"2024-05-08T21:19:51.206088+0000","last_peered":"2024-05-08T21:19:51.206088+0000","last_clean":"2024-05-08T21:19:51.206088+0000","last_became_active":"2024-05-08T21:10:03.751868+0000","last_became_peered":"2024-05-08T21:10:03.751868+0000","last_unstale":"2024-05-08T21:19:51.206088+0000","last_undegraded":"2024-05-08T21:19:51.206088+0000","last_fullsized":"2024-05-08T21:19:51.206088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"32'3951","reported_seq":4026,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:52.932499+0000","last_change":"2024-05-08T21:10:08.052390+0000","last_active":"2024-05-08T21:19:52.932499+0000","last_peered":"2024-05-08T21:19:52.932499+0000","last_clean":"2024-05-08T21:19:52.932499+0000","last_became_active":"2024-05-08T21:10:08.051967+0000","last_became_peered":"2024-05-08T21:10:08.051967+0000","last_unstale":"2024-05-08T21:19:52.932499+0000","last_undegraded":"2024-05-08T21:19:52.932499+0000","last_fullsized":"2024-05-08T21:19:52.932499+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":3951,"log_dups_size":0,"ondisk_log_size":3951,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":0,"num_write":50192,"num_write_kb":654171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"32'9","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:01.515901+0000","last_change":"2024-05-08T21:20:01.515989+0000","last_active":"2024-05-08T21:20:01.515901+0000","last_peered":"2024-05-08T21:20:01.515901+0000","last_clean":"2024-05-08T21:20:01.515901+0000","last_became_active":"2024-05-08T21:10:03.329761+0000","last_became_peered":"2024-05-08T21:10:03.329761+0000","last_unstale":"2024-05-08T21:20:01.515901+0000","last_undegraded":"2024-05-08T21:20:01.515901+0000","last_fullsized":"2024-05-08T21:20:01.515901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-05-08T21:20:01.515879+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-05-08T21:20:01.515879+0000","last_clean_scrub_stamp":"2024-05-08T21:20:01.515879+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:10:12.952423+0000","scrub_duration":0.0051169010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":32,"num_write":6,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"32'15","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:04.584821+0000","last_change":"2024-05-08T21:20:04.584918+0000","last_active":"2024-05-08T21:20:04.584821+0000","last_peered":"2024-05-08T21:20:04.584821+0000","last_clean":"2024-05-08T21:20:04.584821+0000","last_became_active":"2024-05-08T21:10:03.749094+0000","last_became_peered":"2024-05-08T21:10:03.749094+0000","last_unstale":"2024-05-08T21:20:04.584821+0000","last_undegraded":"2024-05-08T21:20:04.584821+0000","last_fullsized":"2024-05-08T21:20:04.584821+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-05-08T21:20:04.584798+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-05-08T21:20:04.584798+0000","last_clean_scrub_stamp":"2024-05-08T21:20:04.584798+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:15:08.630447+0000","scrub_duration":0.001938178,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"32'4387","reported_seq":4465,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.311123+0000","last_change":"2024-05-08T21:10:08.048331+0000","last_active":"2024-05-08T21:19:53.311123+0000","last_peered":"2024-05-08T21:19:53.311123+0000","last_clean":"2024-05-08T21:19:53.311123+0000","last_became_active":"2024-05-08T21:10:08.047505+0000","last_became_peered":"2024-05-08T21:10:08.047505+0000","last_unstale":"2024-05-08T21:19:53.311123+0000","last_undegraded":"2024-05-08T21:19:53.311123+0000","last_fullsized":"2024-05-08T21:19:53.311123+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4387,"log_dups_size":0,"ondisk_log_size":4387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":0,"num_write":56798,"num_write_kb":743616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"32'3","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:20.381474+0000","last_change":"2024-05-08T21:20:20.381603+0000","last_active":"2024-05-08T21:20:20.381474+0000","last_peered":"2024-05-08T21:20:20.381474+0000","last_clean":"2024-05-08T21:20:20.381474+0000","last_became_active":"2024-05-08T21:10:03.327648+0000","last_became_peered":"2024-05-08T21:10:03.327648+0000","last_unstale":"2024-05-08T21:20:20.381474+0000","last_undegraded":"2024-05-08T21:20:20.381474+0000","last_fullsized":"2024-05-08T21:20:20.381474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-05-08T21:20:20.381447+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-05-08T21:20:20.381447+0000","last_clean_scrub_stamp":"2024-05-08T21:20:20.381447+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:55.203011+0000","scrub_duration":0.0016764729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"32'15","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.224706+0000","last_change":"2024-05-08T21:10:03.750560+0000","last_active":"2024-05-08T21:19:53.224706+0000","last_peered":"2024-05-08T21:19:53.224706+0000","last_clean":"2024-05-08T21:19:53.224706+0000","last_became_active":"2024-05-08T21:10:03.750294+0000","last_became_peered":"2024-05-08T21:10:03.750294+0000","last_unstale":"2024-05-08T21:19:53.224706+0000","last_undegraded":"2024-05-08T21:19:53.224706+0000","last_fullsized":"2024-05-08T21:19:53.224706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"32'4344","reported_seq":4417,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.313448+0000","last_change":"2024-05-08T21:10:08.052318+0000","last_active":"2024-05-08T21:19:53.313448+0000","last_peered":"2024-05-08T21:19:53.313448+0000","last_clean":"2024-05-08T21:19:53.313448+0000","last_became_active":"2024-05-08T21:10:08.051920+0000","last_became_peered":"2024-05-08T21:10:08.051920+0000","last_unstale":"2024-05-08T21:19:53.313448+0000","last_undegraded":"2024-05-08T21:19:53.313448+0000","last_fullsized":"2024-05-08T21:19:53.313448+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4344,"log_dups_size":0,"ondisk_log_size":4344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":0,"num_write":56474,"num_write_kb":728506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"32'7","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:58.846319+0000","last_change":"2024-05-08T21:19:58.846430+0000","last_active":"2024-05-08T21:19:58.846319+0000","last_peered":"2024-05-08T21:19:58.846319+0000","last_clean":"2024-05-08T21:19:58.846319+0000","last_became_active":"2024-05-08T21:10:03.332105+0000","last_became_peered":"2024-05-08T21:10:03.332105+0000","last_unstale":"2024-05-08T21:19:58.846319+0000","last_undegraded":"2024-05-08T21:19:58.846319+0000","last_fullsized":"2024-05-08T21:19:58.846319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-05-08T21:19:58.846289+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-05-08T21:19:58.846289+0000","last_clean_scrub_stamp":"2024-05-08T21:19:58.846289+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:14:20.957954+0000","scrub_duration":0.0015942689999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"32'9","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:14.932737+0000","last_change":"2024-05-08T21:20:14.932841+0000","last_active":"2024-05-08T21:20:14.932737+0000","last_peered":"2024-05-08T21:20:14.932737+0000","last_clean":"2024-05-08T21:20:14.932737+0000","last_became_active":"2024-05-08T21:10:03.741742+0000","last_became_peered":"2024-05-08T21:10:03.741742+0000","last_unstale":"2024-05-08T21:20:14.932737+0000","last_undegraded":"2024-05-08T21:20:14.932737+0000","last_fullsized":"2024-05-08T21:20:14.932737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-05-08T21:20:14.932711+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-05-08T21:20:14.932711+0000","last_clean_scrub_stamp":"2024-05-08T21:20:14.932711+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:33.264529+0000","scrub_duration":0.00178802,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"32'4473","reported_seq":4564,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.317634+0000","last_change":"2024-05-08T21:10:07.769850+0000","last_active":"2024-05-08T21:19:53.317634+0000","last_peered":"2024-05-08T21:19:53.317634+0000","last_clean":"2024-05-08T21:19:53.317634+0000","last_became_active":"2024-05-08T21:10:07.769016+0000","last_became_peered":"2024-05-08T21:10:07.769016+0000","last_unstale":"2024-05-08T21:19:53.317634+0000","last_undegraded":"2024-05-08T21:19:53.317634+0000","last_fullsized":"2024-05-08T21:19:53.317634+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4473,"log_dups_size":0,"ondisk_log_size":4473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":0,"num_write":57758,"num_write_kb":734684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"32'20","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:58.371047+0000","last_change":"2024-05-08T21:19:58.371123+0000","last_active":"2024-05-08T21:19:58.371047+0000","last_peered":"2024-05-08T21:19:58.371047+0000","last_clean":"2024-05-08T21:19:58.371047+0000","last_became_active":"2024-05-08T21:10:03.331501+0000","last_became_peered":"2024-05-08T21:10:03.331501+0000","last_unstale":"2024-05-08T21:19:58.371047+0000","last_undegraded":"2024-05-08T21:19:58.371047+0000","last_fullsized":"2024-05-08T21:19:58.371047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-05-08T21:19:58.371025+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-05-08T21:19:58.371025+0000","last_clean_scrub_stamp":"2024-05-08T21:19:58.371025+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:14:53.459921+0000","scrub_duration":0.0044400510000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":69,"num_read_kb":69,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"32'12","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:00.652186+0000","last_change":"2024-05-08T21:20:00.652278+0000","last_active":"2024-05-08T21:20:00.652186+0000","last_peered":"2024-05-08T21:20:00.652186+0000","last_clean":"2024-05-08T21:20:00.652186+0000","last_became_active":"2024-05-08T21:10:03.743557+0000","last_became_peered":"2024-05-08T21:10:03.743557+0000","last_unstale":"2024-05-08T21:20:00.652186+0000","last_undegraded":"2024-05-08T21:20:00.652186+0000","last_fullsized":"2024-05-08T21:20:00.652186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-08T21:20:00.652163+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-08T21:20:00.652163+0000","last_clean_scrub_stamp":"2024-05-08T21:20:00.652163+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:38:06.051126+0000","scrub_duration":0.0014301730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"32'3690","reported_seq":3778,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:30.801002+0000","last_change":"2024-05-08T21:20:30.801159+0000","last_active":"2024-05-08T21:20:30.801002+0000","last_peered":"2024-05-08T21:20:30.801002+0000","last_clean":"2024-05-08T21:20:30.801002+0000","last_became_active":"2024-05-08T21:10:07.776858+0000","last_became_peered":"2024-05-08T21:10:07.776858+0000","last_unstale":"2024-05-08T21:20:30.801002+0000","last_undegraded":"2024-05-08T21:20:30.801002+0000","last_fullsized":"2024-05-08T21:20:30.801002+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3690","last_scrub_stamp":"2024-05-08T21:20:30.800976+0000","last_deep_scrub":"32'3690","last_deep_scrub_stamp":"2024-05-08T21:20:30.800976+0000","last_clean_scrub_stamp":"2024-05-08T21:20:30.800976+0000","objects_scrubbed":0,"log_size":3690,"log_dups_size":0,"ondisk_log_size":3690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:42:39.120505+0000","scrub_duration":0.049470954999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":0,"num_write":47426,"num_write_kb":636696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"32'5","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:57.493492+0000","last_change":"2024-05-08T21:19:57.493623+0000","last_active":"2024-05-08T21:19:57.493492+0000","last_peered":"2024-05-08T21:19:57.493492+0000","last_clean":"2024-05-08T21:19:57.493492+0000","last_became_active":"2024-05-08T21:10:03.326608+0000","last_became_peered":"2024-05-08T21:10:03.326608+0000","last_unstale":"2024-05-08T21:19:57.493492+0000","last_undegraded":"2024-05-08T21:19:57.493492+0000","last_fullsized":"2024-05-08T21:19:57.493492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-05-08T21:19:57.493449+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-05-08T21:19:57.493449+0000","last_clean_scrub_stamp":"2024-05-08T21:19:57.493449+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:45:21.237664+0000","scrub_duration":0.0035203579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"32'8","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:31.483523+0000","last_change":"2024-05-08T21:20:31.483639+0000","last_active":"2024-05-08T21:20:31.483523+0000","last_peered":"2024-05-08T21:20:31.483523+0000","last_clean":"2024-05-08T21:20:31.483523+0000","last_became_active":"2024-05-08T21:10:03.748915+0000","last_became_peered":"2024-05-08T21:10:03.748915+0000","last_unstale":"2024-05-08T21:20:31.483523+0000","last_undegraded":"2024-05-08T21:20:31.483523+0000","last_fullsized":"2024-05-08T21:20:31.483523+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-08T21:20:31.483498+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-08T21:20:31.483498+0000","last_clean_scrub_stamp":"2024-05-08T21:20:31.483498+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:51:04.907637+0000","scrub_duration":0.0019431190000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"32'4727","reported_seq":4833,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:36.479577+0000","last_change":"2024-05-08T21:20:36.479735+0000","last_active":"2024-05-08T21:20:36.479577+0000","last_peered":"2024-05-08T21:20:36.479577+0000","last_clean":"2024-05-08T21:20:36.479577+0000","last_became_active":"2024-05-08T21:10:07.759139+0000","last_became_peered":"2024-05-08T21:10:07.759139+0000","last_unstale":"2024-05-08T21:20:36.479577+0000","last_undegraded":"2024-05-08T21:20:36.479577+0000","last_fullsized":"2024-05-08T21:20:36.479577+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4727","last_scrub_stamp":"2024-05-08T21:20:36.479552+0000","last_deep_scrub":"32'4727","last_deep_scrub_stamp":"2024-05-08T21:20:36.479552+0000","last_clean_scrub_stamp":"2024-05-08T21:20:36.479552+0000","objects_scrubbed":0,"log_size":4727,"log_dups_size":0,"ondisk_log_size":4727,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:29:08.903262+0000","scrub_duration":0.080740626999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":0,"num_write":61813,"num_write_kb":787262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"32'3","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:02.232728+0000","last_change":"2024-05-08T21:20:02.232728+0000","last_active":"2024-05-08T21:20:02.232728+0000","last_peered":"2024-05-08T21:20:02.232728+0000","last_clean":"2024-05-08T21:20:02.232728+0000","last_became_active":"2024-05-08T21:10:03.328739+0000","last_became_peered":"2024-05-08T21:10:03.328739+0000","last_unstale":"2024-05-08T21:20:02.232728+0000","last_undegraded":"2024-05-08T21:20:02.232728+0000","last_fullsized":"2024-05-08T21:20:02.232728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-05-08T21:20:02.232628+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-05-08T21:20:02.232628+0000","last_clean_scrub_stamp":"2024-05-08T21:20:02.232628+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:38:36.143029+0000","scrub_duration":0.0012656970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"32'13","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:24.391884+0000","last_change":"2024-05-08T21:20:24.391884+0000","last_active":"2024-05-08T21:20:24.391884+0000","last_peered":"2024-05-08T21:20:24.391884+0000","last_clean":"2024-05-08T21:20:24.391884+0000","last_became_active":"2024-05-08T21:10:03.744398+0000","last_became_peered":"2024-05-08T21:10:03.744398+0000","last_unstale":"2024-05-08T21:20:24.391884+0000","last_undegraded":"2024-05-08T21:20:24.391884+0000","last_fullsized":"2024-05-08T21:20:24.391884+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'13","last_scrub_stamp":"2024-05-08T21:20:24.391718+0000","last_deep_scrub":"32'13","last_deep_scrub_stamp":"2024-05-08T21:20:24.391718+0000","last_clean_scrub_stamp":"2024-05-08T21:20:24.391718+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:25:45.031448+0000","scrub_duration":0.006309093,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"32'4127","reported_seq":4199,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:55.648375+0000","last_change":"2024-05-08T21:10:07.776566+0000","last_active":"2024-05-08T21:19:55.648375+0000","last_peered":"2024-05-08T21:19:55.648375+0000","last_clean":"2024-05-08T21:19:55.648375+0000","last_became_active":"2024-05-08T21:10:07.776080+0000","last_became_peered":"2024-05-08T21:10:07.776080+0000","last_unstale":"2024-05-08T21:19:55.648375+0000","last_undegraded":"2024-05-08T21:19:55.648375+0000","last_fullsized":"2024-05-08T21:19:55.648375+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4127,"log_dups_size":0,"ondisk_log_size":4127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":0,"num_write":53759,"num_write_kb":696170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:07.460399+0000","last_change":"2024-05-08T21:20:07.460399+0000","last_active":"2024-05-08T21:20:07.460399+0000","last_peered":"2024-05-08T21:20:07.460399+0000","last_clean":"2024-05-08T21:20:07.460399+0000","last_became_active":"2024-05-08T21:10:03.332689+0000","last_became_peered":"2024-05-08T21:10:03.332689+0000","last_unstale":"2024-05-08T21:20:07.460399+0000","last_undegraded":"2024-05-08T21:20:07.460399+0000","last_fullsized":"2024-05-08T21:20:07.460399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:20:07.460272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:20:07.460272+0000","last_clean_scrub_stamp":"2024-05-08T21:20:07.460272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:12:13.310545+0000","scrub_duration":0.0015644680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"32'9","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:08.553749+0000","last_change":"2024-05-08T21:20:08.553854+0000","last_active":"2024-05-08T21:20:08.553749+0000","last_peered":"2024-05-08T21:20:08.553749+0000","last_clean":"2024-05-08T21:20:08.553749+0000","last_became_active":"2024-05-08T21:10:03.742744+0000","last_became_peered":"2024-05-08T21:10:03.742744+0000","last_unstale":"2024-05-08T21:20:08.553749+0000","last_undegraded":"2024-05-08T21:20:08.553749+0000","last_fullsized":"2024-05-08T21:20:08.553749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-05-08T21:20:08.553723+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-05-08T21:20:08.553723+0000","last_clean_scrub_stamp":"2024-05-08T21:20:08.553723+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:45:32.459903+0000","scrub_duration":0.0072960309999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"32'4649","reported_seq":4740,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.286527+0000","last_change":"2024-05-08T21:10:07.776527+0000","last_active":"2024-05-08T21:19:53.286527+0000","last_peered":"2024-05-08T21:19:53.286527+0000","last_clean":"2024-05-08T21:19:53.286527+0000","last_became_active":"2024-05-08T21:10:07.776053+0000","last_became_peered":"2024-05-08T21:10:07.776053+0000","last_unstale":"2024-05-08T21:19:53.286527+0000","last_undegraded":"2024-05-08T21:19:53.286527+0000","last_fullsized":"2024-05-08T21:19:53.286527+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4649,"log_dups_size":0,"ondisk_log_size":4649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":0,"num_write":59828,"num_write_kb":758247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"32'13","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:19.223993+0000","last_change":"2024-05-08T21:20:19.224100+0000","last_active":"2024-05-08T21:20:19.223993+0000","last_peered":"2024-05-08T21:20:19.223993+0000","last_clean":"2024-05-08T21:20:19.223993+0000","last_became_active":"2024-05-08T21:10:03.738000+0000","last_became_peered":"2024-05-08T21:10:03.738000+0000","last_unstale":"2024-05-08T21:20:19.223993+0000","last_undegraded":"2024-05-08T21:20:19.223993+0000","last_fullsized":"2024-05-08T21:20:19.223993+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'13","last_scrub_stamp":"2024-05-08T21:20:19.223951+0000","last_deep_scrub":"32'13","last_deep_scrub_stamp":"2024-05-08T21:20:19.223951+0000","last_clean_scrub_stamp":"2024-05-08T21:20:19.223951+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:02:44.875032+0000","scrub_duration":0.001459419,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"32'27","reported_seq":91,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:00.325080+0000","last_change":"2024-05-08T21:20:00.325080+0000","last_active":"2024-05-08T21:20:00.325080+0000","last_peered":"2024-05-08T21:20:00.325080+0000","last_clean":"2024-05-08T21:20:00.325080+0000","last_became_active":"2024-05-08T21:10:03.330842+0000","last_became_peered":"2024-05-08T21:10:03.330842+0000","last_unstale":"2024-05-08T21:20:00.325080+0000","last_undegraded":"2024-05-08T21:20:00.325080+0000","last_fullsized":"2024-05-08T21:20:00.325080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'27","last_scrub_stamp":"2024-05-08T21:20:00.324962+0000","last_deep_scrub":"32'27","last_deep_scrub_stamp":"2024-05-08T21:20:00.324962+0000","last_clean_scrub_stamp":"2024-05-08T21:20:00.324962+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:09:32.831083+0000","scrub_duration":0.021989438,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94059,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":26,"num_read_kb":107,"num_write":23,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"32'4123","reported_seq":4202,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.300786+0000","last_change":"2024-05-08T21:10:08.049274+0000","last_active":"2024-05-08T21:19:53.300786+0000","last_peered":"2024-05-08T21:19:53.300786+0000","last_clean":"2024-05-08T21:19:53.300786+0000","last_became_active":"2024-05-08T21:10:08.048763+0000","last_became_peered":"2024-05-08T21:10:08.048763+0000","last_unstale":"2024-05-08T21:19:53.300786+0000","last_undegraded":"2024-05-08T21:19:53.300786+0000","last_fullsized":"2024-05-08T21:19:53.300786+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4123,"log_dups_size":0,"ondisk_log_size":4123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":0,"num_write":53637,"num_write_kb":684025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"32'8","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:24.895344+0000","last_change":"2024-05-08T21:20:24.895344+0000","last_active":"2024-05-08T21:20:24.895344+0000","last_peered":"2024-05-08T21:20:24.895344+0000","last_clean":"2024-05-08T21:20:24.895344+0000","last_became_active":"2024-05-08T21:10:03.747360+0000","last_became_peered":"2024-05-08T21:10:03.747360+0000","last_unstale":"2024-05-08T21:20:24.895344+0000","last_undegraded":"2024-05-08T21:20:24.895344+0000","last_fullsized":"2024-05-08T21:20:24.895344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-08T21:20:24.895243+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-08T21:20:24.895243+0000","last_clean_scrub_stamp":"2024-05-08T21:20:24.895243+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:38:39.010495+0000","scrub_duration":0.00166314,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:12.407195+0000","last_change":"2024-05-08T21:20:12.407195+0000","last_active":"2024-05-08T21:20:12.407195+0000","last_peered":"2024-05-08T21:20:12.407195+0000","last_clean":"2024-05-08T21:20:12.407195+0000","last_became_active":"2024-05-08T21:10:03.327530+0000","last_became_peered":"2024-05-08T21:10:03.327530+0000","last_unstale":"2024-05-08T21:20:12.407195+0000","last_undegraded":"2024-05-08T21:20:12.407195+0000","last_fullsized":"2024-05-08T21:20:12.407195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T21:20:12.407050+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T21:20:12.407050+0000","last_clean_scrub_stamp":"2024-05-08T21:20:12.407050+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:42:48.318549+0000","scrub_duration":0.0015389780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"32'119","reported_seq":193,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:09.519397+0000","last_change":"2024-05-08T21:20:09.519491+0000","last_active":"2024-05-08T21:20:09.519397+0000","last_peered":"2024-05-08T21:20:09.519397+0000","last_clean":"2024-05-08T21:20:09.519397+0000","last_became_active":"2024-05-08T21:09:59.332929+0000","last_became_peered":"2024-05-08T21:09:59.332929+0000","last_unstale":"2024-05-08T21:20:09.519397+0000","last_undegraded":"2024-05-08T21:20:09.519397+0000","last_fullsized":"2024-05-08T21:20:09.519397+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'119","last_scrub_stamp":"2024-05-08T21:20:09.519371+0000","last_deep_scrub":"32'119","last_deep_scrub_stamp":"2024-05-08T21:20:09.519371+0000","last_clean_scrub_stamp":"2024-05-08T21:20:09.519371+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:38:31.505096+0000","scrub_duration":0.0053401769999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"32'3586","reported_seq":3655,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.225218+0000","last_change":"2024-05-08T21:10:08.049848+0000","last_active":"2024-05-08T21:19:53.225218+0000","last_peered":"2024-05-08T21:19:53.225218+0000","last_clean":"2024-05-08T21:19:53.225218+0000","last_became_active":"2024-05-08T21:10:08.049153+0000","last_became_peered":"2024-05-08T21:10:08.049153+0000","last_unstale":"2024-05-08T21:19:53.225218+0000","last_undegraded":"2024-05-08T21:19:53.225218+0000","last_fullsized":"2024-05-08T21:19:53.225218+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":3586,"log_dups_size":0,"ondisk_log_size":3586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":0,"num_write":45747,"num_write_kb":586385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"32'6","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:13.619795+0000","last_change":"2024-05-08T21:20:13.619795+0000","last_active":"2024-05-08T21:20:13.619795+0000","last_peered":"2024-05-08T21:20:13.619795+0000","last_clean":"2024-05-08T21:20:13.619795+0000","last_became_active":"2024-05-08T21:10:03.742819+0000","last_became_peered":"2024-05-08T21:10:03.742819+0000","last_unstale":"2024-05-08T21:20:13.619795+0000","last_undegraded":"2024-05-08T21:20:13.619795+0000","last_fullsized":"2024-05-08T21:20:13.619795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-08T21:20:13.619702+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-08T21:20:13.619702+0000","last_clean_scrub_stamp":"2024-05-08T21:20:13.619702+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:44:45.908469+0000","scrub_duration":0.001576299,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"32'8","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:14.537678+0000","last_change":"2024-05-08T21:20:14.537781+0000","last_active":"2024-05-08T21:20:14.537678+0000","last_peered":"2024-05-08T21:20:14.537678+0000","last_clean":"2024-05-08T21:20:14.537678+0000","last_became_active":"2024-05-08T21:10:03.339957+0000","last_became_peered":"2024-05-08T21:10:03.339957+0000","last_unstale":"2024-05-08T21:20:14.537678+0000","last_undegraded":"2024-05-08T21:20:14.537678+0000","last_fullsized":"2024-05-08T21:20:14.537678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-08T21:20:14.537649+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-08T21:20:14.537649+0000","last_clean_scrub_stamp":"2024-05-08T21:20:14.537649+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:39:15.878210+0000","scrub_duration":0.0017147130000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"32'3621","reported_seq":3698,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:31.501367+0000","last_change":"2024-05-08T21:20:31.501367+0000","last_active":"2024-05-08T21:20:31.501367+0000","last_peered":"2024-05-08T21:20:31.501367+0000","last_clean":"2024-05-08T21:20:31.501367+0000","last_became_active":"2024-05-08T21:10:08.049962+0000","last_became_peered":"2024-05-08T21:10:08.049962+0000","last_unstale":"2024-05-08T21:20:31.501367+0000","last_undegraded":"2024-05-08T21:20:31.501367+0000","last_fullsized":"2024-05-08T21:20:31.501367+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3621","last_scrub_stamp":"2024-05-08T21:20:31.501232+0000","last_deep_scrub":"32'3621","last_deep_scrub_stamp":"2024-05-08T21:20:31.501232+0000","last_clean_scrub_stamp":"2024-05-08T21:20:31.501232+0000","objects_scrubbed":0,"log_size":3621,"log_dups_size":0,"ondisk_log_size":3621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:39:46.653234+0000","scrub_duration":0.061799664999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":0,"num_write":47664,"num_write_kb":629817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:15.504014+0000","last_change":"2024-05-08T21:20:15.504014+0000","last_active":"2024-05-08T21:20:15.504014+0000","last_peered":"2024-05-08T21:20:15.504014+0000","last_clean":"2024-05-08T21:20:15.504014+0000","last_became_active":"2024-05-08T21:10:03.337627+0000","last_became_peered":"2024-05-08T21:10:03.337627+0000","last_unstale":"2024-05-08T21:20:15.504014+0000","last_undegraded":"2024-05-08T21:20:15.504014+0000","last_fullsized":"2024-05-08T21:20:15.504014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T21:20:15.503850+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T21:20:15.503850+0000","last_clean_scrub_stamp":"2024-05-08T21:20:15.503850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:05.669614+0000","scrub_duration":0.0017121040000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"32'10","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:20.243517+0000","last_change":"2024-05-08T21:20:20.243517+0000","last_active":"2024-05-08T21:20:20.243517+0000","last_peered":"2024-05-08T21:20:20.243517+0000","last_clean":"2024-05-08T21:20:20.243517+0000","last_became_active":"2024-05-08T21:10:03.737927+0000","last_became_peered":"2024-05-08T21:10:03.737927+0000","last_unstale":"2024-05-08T21:20:20.243517+0000","last_undegraded":"2024-05-08T21:20:20.243517+0000","last_fullsized":"2024-05-08T21:20:20.243517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-05-08T21:20:20.243417+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-05-08T21:20:20.243417+0000","last_clean_scrub_stamp":"2024-05-08T21:20:20.243417+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:18:10.763623+0000","scrub_duration":0.0012253139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"32'4719","reported_seq":4817,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:56.742745+0000","last_change":"2024-05-08T21:10:08.052270+0000","last_active":"2024-05-08T21:19:56.742745+0000","last_peered":"2024-05-08T21:19:56.742745+0000","last_clean":"2024-05-08T21:19:56.742745+0000","last_became_active":"2024-05-08T21:10:08.051881+0000","last_became_peered":"2024-05-08T21:10:08.051881+0000","last_unstale":"2024-05-08T21:19:56.742745+0000","last_undegraded":"2024-05-08T21:19:56.742745+0000","last_fullsized":"2024-05-08T21:19:56.742745+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":4719,"log_dups_size":0,"ondisk_log_size":4719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":0,"num_write":60705,"num_write_kb":757240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"32'69","reported_seq":110,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:09.149522+0000","last_change":"2024-05-08T21:20:09.149631+0000","last_active":"2024-05-08T21:20:09.149522+0000","last_peered":"2024-05-08T21:20:09.149522+0000","last_clean":"2024-05-08T21:20:09.149522+0000","last_became_active":"2024-05-08T21:10:03.333368+0000","last_became_peered":"2024-05-08T21:10:03.333368+0000","last_unstale":"2024-05-08T21:20:09.149522+0000","last_undegraded":"2024-05-08T21:20:09.149522+0000","last_fullsized":"2024-05-08T21:20:09.149522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'69","last_scrub_stamp":"2024-05-08T21:20:09.149480+0000","last_deep_scrub":"32'69","last_deep_scrub_stamp":"2024-05-08T21:20:09.149480+0000","last_clean_scrub_stamp":"2024-05-08T21:20:09.149480+0000","objects_scrubbed":1,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:53:53.593469+0000","scrub_duration":0.0026429190000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":34,"num_write":151,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"32'12","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:15.912477+0000","last_change":"2024-05-08T21:20:15.912569+0000","last_active":"2024-05-08T21:20:15.912477+0000","last_peered":"2024-05-08T21:20:15.912477+0000","last_clean":"2024-05-08T21:20:15.912477+0000","last_became_active":"2024-05-08T21:10:03.752389+0000","last_became_peered":"2024-05-08T21:10:03.752389+0000","last_unstale":"2024-05-08T21:20:15.912477+0000","last_undegraded":"2024-05-08T21:20:15.912477+0000","last_fullsized":"2024-05-08T21:20:15.912477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-08T21:20:15.912455+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-08T21:20:15.912455+0000","last_clean_scrub_stamp":"2024-05-08T21:20:15.912455+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:35:09.331511+0000","scrub_duration":0.016057937000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"32'3951","reported_seq":4031,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:25.792497+0000","last_change":"2024-05-08T21:20:25.792643+0000","last_active":"2024-05-08T21:20:25.792497+0000","last_peered":"2024-05-08T21:20:25.792497+0000","last_clean":"2024-05-08T21:20:25.792497+0000","last_became_active":"2024-05-08T21:10:08.047632+0000","last_became_peered":"2024-05-08T21:10:08.047632+0000","last_unstale":"2024-05-08T21:20:25.792497+0000","last_undegraded":"2024-05-08T21:20:25.792497+0000","last_fullsized":"2024-05-08T21:20:25.792497+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3951","last_scrub_stamp":"2024-05-08T21:20:25.792472+0000","last_deep_scrub":"32'3951","last_deep_scrub_stamp":"2024-05-08T21:20:25.792472+0000","last_clean_scrub_stamp":"2024-05-08T21:20:25.792472+0000","objects_scrubbed":0,"log_size":3951,"log_dups_size":0,"ondisk_log_size":3951,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:10:11.437930+0000","scrub_duration":0.090278345999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":0,"num_write":51572,"num_write_kb":672103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"32'9","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:06.832214+0000","last_change":"2024-05-08T21:20:06.832307+0000","last_active":"2024-05-08T21:20:06.832214+0000","last_peered":"2024-05-08T21:20:06.832214+0000","last_clean":"2024-05-08T21:20:06.832214+0000","last_became_active":"2024-05-08T21:10:03.340280+0000","last_became_peered":"2024-05-08T21:10:03.340280+0000","last_unstale":"2024-05-08T21:20:06.832214+0000","last_undegraded":"2024-05-08T21:20:06.832214+0000","last_fullsized":"2024-05-08T21:20:06.832214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-05-08T21:20:06.832183+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-05-08T21:20:06.832183+0000","last_clean_scrub_stamp":"2024-05-08T21:20:06.832183+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:08:37.037032+0000","scrub_duration":0.0030290820000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"32'18","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:59.504474+0000","last_change":"2024-05-08T21:19:59.504564+0000","last_active":"2024-05-08T21:19:59.504474+0000","last_peered":"2024-05-08T21:19:59.504474+0000","last_clean":"2024-05-08T21:19:59.504474+0000","last_became_active":"2024-05-08T21:10:03.736049+0000","last_became_peered":"2024-05-08T21:10:03.736049+0000","last_unstale":"2024-05-08T21:19:59.504474+0000","last_undegraded":"2024-05-08T21:19:59.504474+0000","last_fullsized":"2024-05-08T21:19:59.504474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-05-08T21:19:59.504451+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-05-08T21:19:59.504451+0000","last_clean_scrub_stamp":"2024-05-08T21:19:59.504451+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:13:18.147944+0000","scrub_duration":0.0056426109999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'3546","reported_seq":3645,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:31.794089+0000","last_change":"2024-05-08T21:20:31.794227+0000","last_active":"2024-05-08T21:20:31.794089+0000","last_peered":"2024-05-08T21:20:31.794089+0000","last_clean":"2024-05-08T21:20:31.794089+0000","last_became_active":"2024-05-08T21:10:53.484443+0000","last_became_peered":"2024-05-08T21:10:53.484443+0000","last_unstale":"2024-05-08T21:20:31.794089+0000","last_undegraded":"2024-05-08T21:20:31.794089+0000","last_fullsized":"2024-05-08T21:20:31.794089+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3546","last_scrub_stamp":"2024-05-08T21:20:31.794061+0000","last_deep_scrub":"32'3546","last_deep_scrub_stamp":"2024-05-08T21:20:31.794061+0000","last_clean_scrub_stamp":"2024-05-08T21:20:31.794061+0000","objects_scrubbed":0,"log_size":3546,"log_dups_size":0,"ondisk_log_size":3546,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:55:34.192665+0000","scrub_duration":0.060278528999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":0,"num_write":45468,"num_write_kb":601547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:29.439804+0000","last_change":"2024-05-08T21:20:29.439945+0000","last_active":"2024-05-08T21:20:29.439804+0000","last_peered":"2024-05-08T21:20:29.439804+0000","last_clean":"2024-05-08T21:20:29.439804+0000","last_became_active":"2024-05-08T21:10:03.339690+0000","last_became_peered":"2024-05-08T21:10:03.339690+0000","last_unstale":"2024-05-08T21:20:29.439804+0000","last_undegraded":"2024-05-08T21:20:29.439804+0000","last_fullsized":"2024-05-08T21:20:29.439804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T21:20:29.439765+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T21:20:29.439765+0000","last_clean_scrub_stamp":"2024-05-08T21:20:29.439765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:26:53.204085+0000","scrub_duration":0.0017555680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"32'9","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:05.630976+0000","last_change":"2024-05-08T21:20:05.631085+0000","last_active":"2024-05-08T21:20:05.630976+0000","last_peered":"2024-05-08T21:20:05.630976+0000","last_clean":"2024-05-08T21:20:05.630976+0000","last_became_active":"2024-05-08T21:10:03.744160+0000","last_became_peered":"2024-05-08T21:10:03.744160+0000","last_unstale":"2024-05-08T21:20:05.630976+0000","last_undegraded":"2024-05-08T21:20:05.630976+0000","last_fullsized":"2024-05-08T21:20:05.630976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-05-08T21:20:05.630950+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-05-08T21:20:05.630950+0000","last_clean_scrub_stamp":"2024-05-08T21:20:05.630950+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:28:39.640053+0000","scrub_duration":0.0016783080000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'5130","reported_seq":5225,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.247899+0000","last_change":"2024-05-08T21:10:08.049224+0000","last_active":"2024-05-08T21:19:53.247899+0000","last_peered":"2024-05-08T21:19:53.247899+0000","last_clean":"2024-05-08T21:19:53.247899+0000","last_became_active":"2024-05-08T21:10:08.048866+0000","last_became_peered":"2024-05-08T21:10:08.048866+0000","last_unstale":"2024-05-08T21:19:53.247899+0000","last_undegraded":"2024-05-08T21:19:53.247899+0000","last_fullsized":"2024-05-08T21:19:53.247899+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":5130,"log_dups_size":0,"ondisk_log_size":5130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":0,"num_write":66101,"num_write_kb":843075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:10.134000+0000","last_change":"2024-05-08T21:20:10.134089+0000","last_active":"2024-05-08T21:20:10.134000+0000","last_peered":"2024-05-08T21:20:10.134000+0000","last_clean":"2024-05-08T21:20:10.134000+0000","last_became_active":"2024-05-08T21:10:03.339136+0000","last_became_peered":"2024-05-08T21:10:03.339136+0000","last_unstale":"2024-05-08T21:20:10.134000+0000","last_undegraded":"2024-05-08T21:20:10.134000+0000","last_fullsized":"2024-05-08T21:20:10.134000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T21:20:10.133976+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T21:20:10.133976+0000","last_clean_scrub_stamp":"2024-05-08T21:20:10.133976+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:19:43.392154+0000","scrub_duration":0.0021174700000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"32'9","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:02.697484+0000","last_change":"2024-05-08T21:20:02.697565+0000","last_active":"2024-05-08T21:20:02.697484+0000","last_peered":"2024-05-08T21:20:02.697484+0000","last_clean":"2024-05-08T21:20:02.697484+0000","last_became_active":"2024-05-08T21:10:03.737459+0000","last_became_peered":"2024-05-08T21:10:03.737459+0000","last_unstale":"2024-05-08T21:20:02.697484+0000","last_undegraded":"2024-05-08T21:20:02.697484+0000","last_fullsized":"2024-05-08T21:20:02.697484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-05-08T21:20:02.697461+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-05-08T21:20:02.697461+0000","last_clean_scrub_stamp":"2024-05-08T21:20:02.697461+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:00:37.934494+0000","scrub_duration":0.001184753,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"32'4248","reported_seq":4335,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:26.813608+0000","last_change":"2024-05-08T21:20:26.813750+0000","last_active":"2024-05-08T21:20:26.813608+0000","last_peered":"2024-05-08T21:20:26.813608+0000","last_clean":"2024-05-08T21:20:26.813608+0000","last_became_active":"2024-05-08T21:10:07.775956+0000","last_became_peered":"2024-05-08T21:10:07.775956+0000","last_unstale":"2024-05-08T21:20:26.813608+0000","last_undegraded":"2024-05-08T21:20:26.813608+0000","last_fullsized":"2024-05-08T21:20:26.813608+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4248","last_scrub_stamp":"2024-05-08T21:20:26.813583+0000","last_deep_scrub":"32'4248","last_deep_scrub_stamp":"2024-05-08T21:20:26.813583+0000","last_clean_scrub_stamp":"2024-05-08T21:20:26.813583+0000","objects_scrubbed":0,"log_size":4248,"log_dups_size":0,"ondisk_log_size":4248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:05:17.256637+0000","scrub_duration":0.075347738999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":0,"num_write":55084,"num_write_kb":703369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"32'3","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:12.103697+0000","last_change":"2024-05-08T21:20:12.103775+0000","last_active":"2024-05-08T21:20:12.103697+0000","last_peered":"2024-05-08T21:20:12.103697+0000","last_clean":"2024-05-08T21:20:12.103697+0000","last_became_active":"2024-05-08T21:10:03.331198+0000","last_became_peered":"2024-05-08T21:10:03.331198+0000","last_unstale":"2024-05-08T21:20:12.103697+0000","last_undegraded":"2024-05-08T21:20:12.103697+0000","last_fullsized":"2024-05-08T21:20:12.103697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-05-08T21:20:12.103673+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-05-08T21:20:12.103673+0000","last_clean_scrub_stamp":"2024-05-08T21:20:12.103673+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:29:46.249901+0000","scrub_duration":0.001456349,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"32'11","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:26.870601+0000","last_change":"2024-05-08T21:20:26.870768+0000","last_active":"2024-05-08T21:20:26.870601+0000","last_peered":"2024-05-08T21:20:26.870601+0000","last_clean":"2024-05-08T21:20:26.870601+0000","last_became_active":"2024-05-08T21:10:03.744326+0000","last_became_peered":"2024-05-08T21:10:03.744326+0000","last_unstale":"2024-05-08T21:20:26.870601+0000","last_undegraded":"2024-05-08T21:20:26.870601+0000","last_fullsized":"2024-05-08T21:20:26.870601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'11","last_scrub_stamp":"2024-05-08T21:20:26.870555+0000","last_deep_scrub":"32'11","last_deep_scrub_stamp":"2024-05-08T21:20:26.870555+0000","last_clean_scrub_stamp":"2024-05-08T21:20:26.870555+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:18:06.317902+0000","scrub_duration":0.0071934199999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'4119","reported_seq":4207,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:23.810810+0000","last_change":"2024-05-08T21:20:23.810966+0000","last_active":"2024-05-08T21:20:23.810810+0000","last_peered":"2024-05-08T21:20:23.810810+0000","last_clean":"2024-05-08T21:20:23.810810+0000","last_became_active":"2024-05-08T21:10:07.762886+0000","last_became_peered":"2024-05-08T21:10:07.762886+0000","last_unstale":"2024-05-08T21:20:23.810810+0000","last_undegraded":"2024-05-08T21:20:23.810810+0000","last_fullsized":"2024-05-08T21:20:23.810810+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4119","last_scrub_stamp":"2024-05-08T21:20:23.810787+0000","last_deep_scrub":"32'4119","last_deep_scrub_stamp":"2024-05-08T21:20:23.810787+0000","last_clean_scrub_stamp":"2024-05-08T21:20:23.810787+0000","objects_scrubbed":0,"log_size":4119,"log_dups_size":0,"ondisk_log_size":4119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:41:39.131376+0000","scrub_duration":0.093247574999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":0,"num_write":53672,"num_write_kb":692300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"32'677","reported_seq":723,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:27.461688+0000","last_change":"2024-05-08T21:20:27.461858+0000","last_active":"2024-05-08T21:20:27.461688+0000","last_peered":"2024-05-08T21:20:27.461688+0000","last_clean":"2024-05-08T21:20:27.461688+0000","last_became_active":"2024-05-08T21:10:03.337654+0000","last_became_peered":"2024-05-08T21:10:03.337654+0000","last_unstale":"2024-05-08T21:20:27.461688+0000","last_undegraded":"2024-05-08T21:20:27.461688+0000","last_fullsized":"2024-05-08T21:20:27.461688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'677","last_scrub_stamp":"2024-05-08T21:20:27.461661+0000","last_deep_scrub":"32'677","last_deep_scrub_stamp":"2024-05-08T21:20:27.461661+0000","last_clean_scrub_stamp":"2024-05-08T21:20:27.461661+0000","objects_scrubbed":2,"log_size":677,"log_dups_size":0,"ondisk_log_size":677,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:10.983427+0000","scrub_duration":0.016441509,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":9261,"num_write":668,"num_write_kb":4529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"32'11","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:28.021435+0000","last_change":"2024-05-08T21:20:28.021542+0000","last_active":"2024-05-08T21:20:28.021435+0000","last_peered":"2024-05-08T21:20:28.021435+0000","last_clean":"2024-05-08T21:20:28.021435+0000","last_became_active":"2024-05-08T21:10:03.744589+0000","last_became_peered":"2024-05-08T21:10:03.744589+0000","last_unstale":"2024-05-08T21:20:28.021435+0000","last_undegraded":"2024-05-08T21:20:28.021435+0000","last_fullsized":"2024-05-08T21:20:28.021435+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'11","last_scrub_stamp":"2024-05-08T21:20:28.021403+0000","last_deep_scrub":"32'11","last_deep_scrub_stamp":"2024-05-08T21:20:28.021403+0000","last_clean_scrub_stamp":"2024-05-08T21:20:28.021403+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:59.590278+0000","scrub_duration":0.001592163,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"32'4008","reported_seq":4090,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:34.205705+0000","last_change":"2024-05-08T21:20:34.205863+0000","last_active":"2024-05-08T21:20:34.205705+0000","last_peered":"2024-05-08T21:20:34.205705+0000","last_clean":"2024-05-08T21:20:34.205705+0000","last_became_active":"2024-05-08T21:10:08.047331+0000","last_became_peered":"2024-05-08T21:10:08.047331+0000","last_unstale":"2024-05-08T21:20:34.205705+0000","last_undegraded":"2024-05-08T21:20:34.205705+0000","last_fullsized":"2024-05-08T21:20:34.205705+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4008","last_scrub_stamp":"2024-05-08T21:20:34.205680+0000","last_deep_scrub":"32'4008","last_deep_scrub_stamp":"2024-05-08T21:20:34.205680+0000","last_clean_scrub_stamp":"2024-05-08T21:20:34.205680+0000","objects_scrubbed":0,"log_size":4008,"log_dups_size":0,"ondisk_log_size":4008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:33:01.521146+0000","scrub_duration":0.062941794999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":0,"num_write":52621,"num_write_kb":688417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"32'5","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:03.323940+0000","last_change":"2024-05-08T21:20:03.324041+0000","last_active":"2024-05-08T21:20:03.323940+0000","last_peered":"2024-05-08T21:20:03.323940+0000","last_clean":"2024-05-08T21:20:03.323940+0000","last_became_active":"2024-05-08T21:10:03.332790+0000","last_became_peered":"2024-05-08T21:10:03.332790+0000","last_unstale":"2024-05-08T21:20:03.323940+0000","last_undegraded":"2024-05-08T21:20:03.323940+0000","last_fullsized":"2024-05-08T21:20:03.323940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-05-08T21:20:03.323907+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-05-08T21:20:03.323907+0000","last_clean_scrub_stamp":"2024-05-08T21:20:03.323907+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:44:20.215991+0000","scrub_duration":0.001874807,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'15","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:30.477080+0000","last_change":"2024-05-08T21:20:30.477181+0000","last_active":"2024-05-08T21:20:30.477080+0000","last_peered":"2024-05-08T21:20:30.477080+0000","last_clean":"2024-05-08T21:20:30.477080+0000","last_became_active":"2024-05-08T21:10:03.747759+0000","last_became_peered":"2024-05-08T21:10:03.747759+0000","last_unstale":"2024-05-08T21:20:30.477080+0000","last_undegraded":"2024-05-08T21:20:30.477080+0000","last_fullsized":"2024-05-08T21:20:30.477080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-05-08T21:20:30.477054+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-05-08T21:20:30.477054+0000","last_clean_scrub_stamp":"2024-05-08T21:20:30.477054+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:12:04.864383+0000","scrub_duration":0.004148311,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"32'3793","reported_seq":3884,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:36.515712+0000","last_change":"2024-05-08T21:20:36.515834+0000","last_active":"2024-05-08T21:20:36.515712+0000","last_peered":"2024-05-08T21:20:36.515712+0000","last_clean":"2024-05-08T21:20:36.515712+0000","last_became_active":"2024-05-08T21:10:07.760566+0000","last_became_peered":"2024-05-08T21:10:07.760566+0000","last_unstale":"2024-05-08T21:20:36.515712+0000","last_undegraded":"2024-05-08T21:20:36.515712+0000","last_fullsized":"2024-05-08T21:20:36.515712+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3793","last_scrub_stamp":"2024-05-08T21:20:36.515687+0000","last_deep_scrub":"32'3793","last_deep_scrub_stamp":"2024-05-08T21:20:36.515687+0000","last_clean_scrub_stamp":"2024-05-08T21:20:36.515687+0000","objects_scrubbed":0,"log_size":3793,"log_dups_size":0,"ondisk_log_size":3793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:20.419667+0000","scrub_duration":0.048624845999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":0,"num_write":48645,"num_write_kb":636437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"32'3","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:03.185252+0000","last_change":"2024-05-08T21:20:03.185331+0000","last_active":"2024-05-08T21:20:03.185252+0000","last_peered":"2024-05-08T21:20:03.185252+0000","last_clean":"2024-05-08T21:20:03.185252+0000","last_became_active":"2024-05-08T21:10:03.331028+0000","last_became_peered":"2024-05-08T21:10:03.331028+0000","last_unstale":"2024-05-08T21:20:03.185252+0000","last_undegraded":"2024-05-08T21:20:03.185252+0000","last_fullsized":"2024-05-08T21:20:03.185252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-05-08T21:20:03.185228+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-05-08T21:20:03.185228+0000","last_clean_scrub_stamp":"2024-05-08T21:20:03.185228+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:53:13.030027+0000","scrub_duration":0.0031620390000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"32'12","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:25.390249+0000","last_change":"2024-05-08T21:20:25.390338+0000","last_active":"2024-05-08T21:20:25.390249+0000","last_peered":"2024-05-08T21:20:25.390249+0000","last_clean":"2024-05-08T21:20:25.390249+0000","last_became_active":"2024-05-08T21:10:03.746557+0000","last_became_peered":"2024-05-08T21:10:03.746557+0000","last_unstale":"2024-05-08T21:20:25.390249+0000","last_undegraded":"2024-05-08T21:20:25.390249+0000","last_fullsized":"2024-05-08T21:20:25.390249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-08T21:20:25.390223+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-08T21:20:25.390223+0000","last_clean_scrub_stamp":"2024-05-08T21:20:25.390223+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:51:54.540934+0000","scrub_duration":0.001723699,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"32'3739","reported_seq":3805,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.231729+0000","last_change":"2024-05-08T21:10:08.048830+0000","last_active":"2024-05-08T21:19:53.231729+0000","last_peered":"2024-05-08T21:19:53.231729+0000","last_clean":"2024-05-08T21:19:53.231729+0000","last_became_active":"2024-05-08T21:10:08.048453+0000","last_became_peered":"2024-05-08T21:10:08.048453+0000","last_unstale":"2024-05-08T21:19:53.231729+0000","last_undegraded":"2024-05-08T21:19:53.231729+0000","last_fullsized":"2024-05-08T21:19:53.231729+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:06.735124+0000","last_clean_scrub_stamp":"2024-05-08T21:10:06.735124+0000","objects_scrubbed":0,"log_size":3739,"log_dups_size":0,"ondisk_log_size":3739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":0,"num_write":49340,"num_write_kb":639424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"32'8","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:01.265385+0000","last_change":"2024-05-08T21:20:01.265470+0000","last_active":"2024-05-08T21:20:01.265385+0000","last_peered":"2024-05-08T21:20:01.265385+0000","last_clean":"2024-05-08T21:20:01.265385+0000","last_became_active":"2024-05-08T21:10:03.330082+0000","last_became_peered":"2024-05-08T21:10:03.330082+0000","last_unstale":"2024-05-08T21:20:01.265385+0000","last_undegraded":"2024-05-08T21:20:01.265385+0000","last_fullsized":"2024-05-08T21:20:01.265385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-08T21:20:01.265361+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-08T21:20:01.265361+0000","last_clean_scrub_stamp":"2024-05-08T21:20:01.265361+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:02.229852+0000","scrub_duration":0.0021232669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"32'11","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:59.772591+0000","last_change":"2024-05-08T21:19:59.772720+0000","last_active":"2024-05-08T21:19:59.772591+0000","last_peered":"2024-05-08T21:19:59.772591+0000","last_clean":"2024-05-08T21:19:59.772591+0000","last_became_active":"2024-05-08T21:10:03.746755+0000","last_became_peered":"2024-05-08T21:10:03.746755+0000","last_unstale":"2024-05-08T21:19:59.772591+0000","last_undegraded":"2024-05-08T21:19:59.772591+0000","last_fullsized":"2024-05-08T21:19:59.772591+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'11","last_scrub_stamp":"2024-05-08T21:19:59.772568+0000","last_deep_scrub":"32'11","last_deep_scrub_stamp":"2024-05-08T21:19:59.772568+0000","last_clean_scrub_stamp":"2024-05-08T21:19:59.772568+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:41:47.304779+0000","scrub_duration":0.081020191000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"32'16","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:16.966368+0000","last_change":"2024-05-08T21:20:16.966368+0000","last_active":"2024-05-08T21:20:16.966368+0000","last_peered":"2024-05-08T21:20:16.966368+0000","last_clean":"2024-05-08T21:20:16.966368+0000","last_became_active":"2024-05-08T21:10:03.738338+0000","last_became_peered":"2024-05-08T21:10:03.738338+0000","last_unstale":"2024-05-08T21:20:16.966368+0000","last_undegraded":"2024-05-08T21:20:16.966368+0000","last_fullsized":"2024-05-08T21:20:16.966368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-05-08T21:20:16.966163+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-05-08T21:20:16.966163+0000","last_clean_scrub_stamp":"2024-05-08T21:20:16.966163+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:31:19.839424+0000","scrub_duration":0.0021440869999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"32'14","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:10.325371+0000","last_change":"2024-05-08T21:20:10.325371+0000","last_active":"2024-05-08T21:20:10.325371+0000","last_peered":"2024-05-08T21:20:10.325371+0000","last_clean":"2024-05-08T21:20:10.325371+0000","last_became_active":"2024-05-08T21:10:03.745362+0000","last_became_peered":"2024-05-08T21:10:03.745362+0000","last_unstale":"2024-05-08T21:20:10.325371+0000","last_undegraded":"2024-05-08T21:20:10.325371+0000","last_fullsized":"2024-05-08T21:20:10.325371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-05-08T21:20:10.325202+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-05-08T21:20:10.325202+0000","last_clean_scrub_stamp":"2024-05-08T21:20:10.325202+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:03:52.158974+0000","scrub_duration":0.007440164,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"32'20","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:28.336760+0000","last_change":"2024-05-08T21:20:28.336760+0000","last_active":"2024-05-08T21:20:28.336760+0000","last_peered":"2024-05-08T21:20:28.336760+0000","last_clean":"2024-05-08T21:20:28.336760+0000","last_became_active":"2024-05-08T21:10:03.744844+0000","last_became_peered":"2024-05-08T21:10:03.744844+0000","last_unstale":"2024-05-08T21:20:28.336760+0000","last_undegraded":"2024-05-08T21:20:28.336760+0000","last_fullsized":"2024-05-08T21:20:28.336760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-05-08T21:20:28.336626+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-05-08T21:20:28.336626+0000","last_clean_scrub_stamp":"2024-05-08T21:20:28.336626+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:48:19.087494+0000","scrub_duration":0.0016633170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"32'11","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:14.593913+0000","last_change":"2024-05-08T21:20:14.593913+0000","last_active":"2024-05-08T21:20:14.593913+0000","last_peered":"2024-05-08T21:20:14.593913+0000","last_clean":"2024-05-08T21:20:14.593913+0000","last_became_active":"2024-05-08T21:10:03.744908+0000","last_became_peered":"2024-05-08T21:10:03.744908+0000","last_unstale":"2024-05-08T21:20:14.593913+0000","last_undegraded":"2024-05-08T21:20:14.593913+0000","last_fullsized":"2024-05-08T21:20:14.593913+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'11","last_scrub_stamp":"2024-05-08T21:20:14.593768+0000","last_deep_scrub":"32'11","last_deep_scrub_stamp":"2024-05-08T21:20:14.593768+0000","last_clean_scrub_stamp":"2024-05-08T21:20:14.593768+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:57:46.848018+0000","scrub_duration":0.0021814820000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'9","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:23.936128+0000","last_change":"2024-05-08T21:20:23.936252+0000","last_active":"2024-05-08T21:20:23.936128+0000","last_peered":"2024-05-08T21:20:23.936128+0000","last_clean":"2024-05-08T21:20:23.936128+0000","last_became_active":"2024-05-08T21:10:03.748284+0000","last_became_peered":"2024-05-08T21:10:03.748284+0000","last_unstale":"2024-05-08T21:20:23.936128+0000","last_undegraded":"2024-05-08T21:20:23.936128+0000","last_fullsized":"2024-05-08T21:20:23.936128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-05-08T21:20:23.936106+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-05-08T21:20:23.936106+0000","last_clean_scrub_stamp":"2024-05-08T21:20:23.936106+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:37:53.315045+0000","scrub_duration":0.0023145779999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"32'12","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:27.350551+0000","last_change":"2024-05-08T21:20:27.350706+0000","last_active":"2024-05-08T21:20:27.350551+0000","last_peered":"2024-05-08T21:20:27.350551+0000","last_clean":"2024-05-08T21:20:27.350551+0000","last_became_active":"2024-05-08T21:10:03.739522+0000","last_became_peered":"2024-05-08T21:10:03.739522+0000","last_unstale":"2024-05-08T21:20:27.350551+0000","last_undegraded":"2024-05-08T21:20:27.350551+0000","last_fullsized":"2024-05-08T21:20:27.350551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-08T21:20:27.350510+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-08T21:20:27.350510+0000","last_clean_scrub_stamp":"2024-05-08T21:20:27.350510+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:49:16.570425+0000","scrub_duration":0.047255268000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"32'11","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:33.106631+0000","last_change":"2024-05-08T21:20:33.106730+0000","last_active":"2024-05-08T21:20:33.106631+0000","last_peered":"2024-05-08T21:20:33.106631+0000","last_clean":"2024-05-08T21:20:33.106631+0000","last_became_active":"2024-05-08T21:10:03.745842+0000","last_became_peered":"2024-05-08T21:10:03.745842+0000","last_unstale":"2024-05-08T21:20:33.106631+0000","last_undegraded":"2024-05-08T21:20:33.106631+0000","last_fullsized":"2024-05-08T21:20:33.106631+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'11","last_scrub_stamp":"2024-05-08T21:20:33.106606+0000","last_deep_scrub":"32'11","last_deep_scrub_stamp":"2024-05-08T21:20:33.106606+0000","last_clean_scrub_stamp":"2024-05-08T21:20:33.106606+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:56:18.498259+0000","scrub_duration":0.0015256549999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"32'13","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:53.250885+0000","last_change":"2024-05-08T21:10:53.473916+0000","last_active":"2024-05-08T21:19:53.250885+0000","last_peered":"2024-05-08T21:19:53.250885+0000","last_clean":"2024-05-08T21:19:53.250885+0000","last_became_active":"2024-05-08T21:10:53.473615+0000","last_became_peered":"2024-05-08T21:10:53.473615+0000","last_unstale":"2024-05-08T21:19:53.250885+0000","last_undegraded":"2024-05-08T21:19:53.250885+0000","last_fullsized":"2024-05-08T21:19:53.250885+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:10:03.308625+0000","last_clean_scrub_stamp":"2024-05-08T21:10:03.308625+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"32'13","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:37.284245+0000","last_change":"2024-05-08T21:20:37.284352+0000","last_active":"2024-05-08T21:20:37.284245+0000","last_peered":"2024-05-08T21:20:37.284245+0000","last_clean":"2024-05-08T21:20:37.284245+0000","last_became_active":"2024-05-08T21:10:03.747059+0000","last_became_peered":"2024-05-08T21:10:03.747059+0000","last_unstale":"2024-05-08T21:20:37.284245+0000","last_undegraded":"2024-05-08T21:20:37.284245+0000","last_fullsized":"2024-05-08T21:20:37.284245+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'13","last_scrub_stamp":"2024-05-08T21:20:37.284218+0000","last_deep_scrub":"32'13","last_deep_scrub_stamp":"2024-05-08T21:20:37.284218+0000","last_clean_scrub_stamp":"2024-05-08T21:20:37.284218+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:04:07.083953+0000","scrub_duration":0.0021271319999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"32'17","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:57.701516+0000","last_change":"2024-05-08T21:19:57.701600+0000","last_active":"2024-05-08T21:19:57.701516+0000","last_peered":"2024-05-08T21:19:57.701516+0000","last_clean":"2024-05-08T21:19:57.701516+0000","last_became_active":"2024-05-08T21:10:03.746942+0000","last_became_peered":"2024-05-08T21:10:03.746942+0000","last_unstale":"2024-05-08T21:19:57.701516+0000","last_undegraded":"2024-05-08T21:19:57.701516+0000","last_fullsized":"2024-05-08T21:19:57.701516+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'17","last_scrub_stamp":"2024-05-08T21:19:57.701494+0000","last_deep_scrub":"32'17","last_deep_scrub_stamp":"2024-05-08T21:19:57.701494+0000","last_clean_scrub_stamp":"2024-05-08T21:19:57.701494+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:15:31.324653+0000","scrub_duration":0.0065830869999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"32'12","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:31.312658+0000","last_change":"2024-05-08T21:20:31.312791+0000","last_active":"2024-05-08T21:20:31.312658+0000","last_peered":"2024-05-08T21:20:31.312658+0000","last_clean":"2024-05-08T21:20:31.312658+0000","last_became_active":"2024-05-08T21:10:03.752486+0000","last_became_peered":"2024-05-08T21:10:03.752486+0000","last_unstale":"2024-05-08T21:20:31.312658+0000","last_undegraded":"2024-05-08T21:20:31.312658+0000","last_fullsized":"2024-05-08T21:20:31.312658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-08T21:20:31.312632+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-08T21:20:31.312632+0000","last_clean_scrub_stamp":"2024-05-08T21:20:31.312632+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:10:04.211847+0000","scrub_duration":0.001584551,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"32'19","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:17.586352+0000","last_change":"2024-05-08T21:20:17.586434+0000","last_active":"2024-05-08T21:20:17.586352+0000","last_peered":"2024-05-08T21:20:17.586352+0000","last_clean":"2024-05-08T21:20:17.586352+0000","last_became_active":"2024-05-08T21:10:03.753616+0000","last_became_peered":"2024-05-08T21:10:03.753616+0000","last_unstale":"2024-05-08T21:20:17.586352+0000","last_undegraded":"2024-05-08T21:20:17.586352+0000","last_fullsized":"2024-05-08T21:20:17.586352+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'19","last_scrub_stamp":"2024-05-08T21:20:17.586326+0000","last_deep_scrub":"32'19","last_deep_scrub_stamp":"2024-05-08T21:20:17.586326+0000","last_clean_scrub_stamp":"2024-05-08T21:20:17.586326+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:05:31.480211+0000","scrub_duration":0.0093599229999999992,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"32'10","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:15.967129+0000","last_change":"2024-05-08T21:20:15.967233+0000","last_active":"2024-05-08T21:20:15.967129+0000","last_peered":"2024-05-08T21:20:15.967129+0000","last_clean":"2024-05-08T21:20:15.967129+0000","last_became_active":"2024-05-08T21:10:03.744562+0000","last_became_peered":"2024-05-08T21:10:03.744562+0000","last_unstale":"2024-05-08T21:20:15.967129+0000","last_undegraded":"2024-05-08T21:20:15.967129+0000","last_fullsized":"2024-05-08T21:20:15.967129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-05-08T21:20:15.967103+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-05-08T21:20:15.967103+0000","last_clean_scrub_stamp":"2024-05-08T21:20:15.967103+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:41:31.805841+0000","scrub_duration":0.00156011,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1810,"num_read_kb":0,"num_write":1714405,"num_write_kb":22146371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132410,"ondisk_log_size":132410,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":773,"ondisk_log_size":773,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64612,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":15837416,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":328,"num_read_kb":39720,"num_write":2875,"num_write_kb":17766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17809408,"data_stored":31674832,"data_compressed":2933172,"data_compressed_allocated":3907584,"data_compressed_original":17833984,"omap_allocated":0,"internal_metadata":0},"log_size":2929,"ondisk_log_size":2929,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509569,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":913320,"kb_used_data":1888,"kb_used_omap":1,"kb_used_meta":911422,"kb_avail":93458520,"statfs":{"total":96636764160,"available":95701524480,"internally_reserved":0,"allocated":1933312,"data_stored":4343835,"data_compressed":576533,"data_compressed_allocated":724992,"data_compressed_original":3338240,"omap_allocated":1593,"internal_metadata":933296583},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:20:08 2024","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":1.831,"15min":1.587},"min":{"1min":0.32200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":5.5890000000000004,"5min":13.432,"15min":17.978999999999999},"last":0.442},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.427,"15min":1.117},"min":{"1min":0.29699999999999999,"5min":0.24299999999999999,"15min":0.219},"max":{"1min":6.1020000000000003,"5min":10.097,"15min":11.362},"last":0.67300000000000004}]},{"osd":1,"last update":"Wed May 8 21:20:08 2024","interfaces":[{"interface":"back","average":{"1min":2.2080000000000002,"5min":2.9169999999999998,"15min":1.968},"min":{"1min":0.35499999999999998,"5min":0.219,"15min":0.219},"max":{"1min":17.797000000000001,"5min":49.942999999999998,"15min":49.942999999999998},"last":0.48499999999999999},{"interface":"front","average":{"1min":2.7869999999999999,"5min":2.7970000000000002,"15min":1.667},"min":{"1min":0.41699999999999998,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":16.221,"5min":27.733000000000001,"15min":27.733000000000001},"last":0.46700000000000003}]},{"osd":2,"last update":"Wed May 8 21:20:08 2024","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.6859999999999999,"15min":1.7190000000000001},"min":{"1min":0.39300000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":5.7640000000000002,"5min":17.858000000000001,"15min":58.450000000000003},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.611,"15min":1.159},"min":{"1min":0.35599999999999998,"5min":0.30199999999999999,"15min":0.27400000000000002},"max":{"1min":5.2110000000000003,"5min":13.568,"15min":14.746},"last":0.57699999999999996}]},{"osd":3,"last update":"Wed May 8 21:20:08 2024","interfaces":[{"interface":"back","average":{"1min":3.0169999999999999,"5min":4.1769999999999996,"15min":2.754},"min":{"1min":0.41199999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":23.302,"5min":68.728999999999999,"15min":74.570999999999998},"last":0.59499999999999997},{"interface":"front","average":{"1min":1.863,"5min":1.982,"15min":1.7090000000000001},"min":{"1min":0.35699999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":16.302,"5min":16.302,"15min":28.099},"last":0.51300000000000001}]},{"osd":4,"last update":"Wed May 8 21:20:08 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":1.468,"15min":1.1319999999999999},"min":{"1min":0.25,"5min":0.223,"15min":0.223},"max":{"1min":1.2010000000000001,"5min":27.963000000000001,"15min":29.731000000000002},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.81799999999999995,"5min":1.548,"15min":1.169},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":5.234,"5min":17.835999999999999,"15min":26.454999999999998},"last":0.53600000000000003}]},{"osd":5,"last update":"Wed May 8 21:20:08 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":1.1619999999999999,"15min":1.1879999999999999},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.25900000000000001},"max":{"1min":5.5190000000000001,"5min":17.780999999999999,"15min":65.373000000000005},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.874,"5min":1.28,"15min":1.0629999999999999},"min":{"1min":0.29099999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":5.1779999999999999,"5min":13.509,"15min":26.498999999999999},"last":0.621}]},{"osd":7,"last update":"Wed May 8 21:20:08 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":1.631,"15min":1.0600000000000001},"min":{"1min":0.318,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.1459999999999999,"5min":16.808,"15min":16.808},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.89800000000000002,"5min":1.4399999999999999,"15min":0.98399999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":7.9930000000000003,"5min":18.100999999999999,"15min":18.100999999999999},"last":0.65000000000000002}]}]},{"osd":5,"up_from":15,"seq":64424509571,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":696156,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":695806,"kb_avail":93675684,"statfs":{"total":96636764160,"available":95923900416,"internally_reserved":0,"allocated":348160,"data_stored":148949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":712505798},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:20:20 2024","interfaces":[{"interface":"back","average":{"1min":2.4630000000000001,"5min":2.0369999999999999,"15min":1.5600000000000001},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":20.721,"5min":20.721,"15min":48.481999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":1.778,"5min":2.1440000000000001,"15min":1.5820000000000001},"min":{"1min":0.40999999999999998,"5min":0.28399999999999997,"15min":0.23999999999999999},"max":{"1min":10.145,"5min":17.164000000000001,"15min":30.004999999999999},"last":0.40699999999999997}]},{"osd":1,"last update":"Wed May 8 21:20:20 2024","interfaces":[{"interface":"back","average":{"1min":2.3650000000000002,"5min":2.6699999999999999,"15min":1.8420000000000001},"min":{"1min":0.30499999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":13.038,"5min":21.702999999999999,"15min":25.228000000000002},"last":0.41999999999999998},{"interface":"front","average":{"1min":2.3919999999999999,"5min":2.3980000000000001,"15min":1.5269999999999999},"min":{"1min":0.33300000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":13.071,"5min":17.396000000000001,"15min":21.869},"last":0.55200000000000005}]},{"osd":2,"last update":"Wed May 8 21:20:20 2024","interfaces":[{"interface":"back","average":{"1min":2.3940000000000001,"5min":2.8780000000000001,"15min":1.7929999999999999},"min":{"1min":0.33500000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":20.917000000000002,"5min":30.552,"15min":34.850000000000001},"last":0.50800000000000001},{"interface":"front","average":{"1min":1.0740000000000001,"5min":2.2069999999999999,"15min":1.504},"min":{"1min":0.313,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":5.0270000000000001,"5min":29.623000000000001,"15min":29.623000000000001},"last":0.53700000000000003}]},{"osd":3,"last update":"Wed May 8 21:20:20 2024","interfaces":[{"interface":"back","average":{"1min":2.2469999999999999,"5min":1.911,"15min":1.49},"min":{"1min":0.375,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":8.8480000000000008,"5min":19.395,"15min":23.234999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":2.2650000000000001,"5min":3.5459999999999998,"15min":2.161},"min":{"1min":0.378,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":10.65,"5min":40.954999999999998,"15min":40.954999999999998},"last":0.47299999999999998}]},{"osd":4,"last update":"Wed May 8 21:20:20 2024","interfaces":[{"interface":"back","average":{"1min":1.6819999999999999,"5min":1.2310000000000001,"15min":0.97699999999999998},"min":{"1min":0.25800000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":11.388999999999999,"5min":12.390000000000001,"15min":23.254000000000001},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.95499999999999996,"5min":1.095,"15min":0.96799999999999997},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.26600000000000001},"max":{"1min":9.2989999999999995,"5min":9.2989999999999995,"15min":17.550999999999998},"last":0.435}]},{"osd":6,"last update":"Wed May 8 21:20:20 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.84999999999999998,"15min":0.89900000000000002},"min":{"1min":0.33200000000000002,"5min":0.26900000000000002,"15min":0.25800000000000001},"max":{"1min":2.4990000000000001,"5min":8.7249999999999996,"15min":17.856000000000002},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.81299999999999994,"5min":1.085,"15min":1.02},"min":{"1min":0.378,"5min":0.29299999999999998,"15min":0.26900000000000002},"max":{"1min":3.5,"5min":8.9269999999999996,"15min":17.827999999999999},"last":0.45500000000000002}]},{"osd":7,"last update":"Wed May 8 21:20:20 2024","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.226,"15min":0.96199999999999997},"min":{"1min":0.34799999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":7.7430000000000003,"5min":11.183999999999999,"15min":18.079000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.89900000000000002,"5min":1.4099999999999999,"15min":1.1859999999999999},"min":{"1min":0.35599999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":5.1520000000000001,"5min":13.496,"15min":30.050000000000001},"last":0.35399999999999998}]}]},{"osd":0,"up_from":14,"seq":60129542275,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":800100,"kb_used_data":1948,"kb_used_omap":1,"kb_used_meta":798142,"kb_avail":93571740,"statfs":{"total":96636764160,"available":95817461760,"internally_reserved":0,"allocated":1994752,"data_stored":3898840,"data_compressed":360679,"data_compressed_allocated":471040,"data_compressed_original":2588672,"omap_allocated":1594,"internal_metadata":817297862},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 8 21:20:14 2024","interfaces":[{"interface":"back","average":{"1min":5.1619999999999999,"5min":3.508,"15min":2.2450000000000001},"min":{"1min":0.19800000000000001,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":60.868000000000002,"5min":60.868000000000002,"15min":98.899000000000001},"last":0.307},{"interface":"front","average":{"1min":4.266,"5min":3.2170000000000001,"15min":1.9119999999999999},"min":{"1min":0.224,"5min":0.185,"15min":0.185},"max":{"1min":61.276000000000003,"5min":61.276000000000003,"15min":61.276000000000003},"last":0.27500000000000002}]},{"osd":2,"last update":"Wed May 8 21:20:14 2024","interfaces":[{"interface":"back","average":{"1min":3.8119999999999998,"5min":2.98,"15min":1.877},"min":{"1min":0.25600000000000001,"5min":0.23499999999999999,"15min":0.224},"max":{"1min":61.043999999999997,"5min":61.043999999999997,"15min":61.043999999999997},"last":0.36499999999999999},{"interface":"front","average":{"1min":3.762,"5min":2.3900000000000001,"15min":1.3069999999999999},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":60.700000000000003,"5min":60.700000000000003,"15min":60.700000000000003},"last":0.254}]},{"osd":3,"last update":"Wed May 8 21:20:14 2024","interfaces":[{"interface":"back","average":{"1min":6.7050000000000001,"5min":3.8119999999999998,"15min":2.6110000000000002},"min":{"1min":0.25700000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":92.697000000000003,"5min":92.697000000000003,"15min":92.697000000000003},"last":0.32500000000000001},{"interface":"front","average":{"1min":5.7480000000000002,"5min":2.9590000000000001,"15min":2.0070000000000001},"min":{"1min":0.311,"5min":0.29199999999999998,"15min":0.28899999999999998},"max":{"1min":92.721000000000004,"5min":92.721000000000004,"15min":93.995999999999995},"last":0.34999999999999998}]},{"osd":4,"last update":"Wed May 8 21:20:14 2024","interfaces":[{"interface":"back","average":{"1min":4.1639999999999997,"5min":2.645,"15min":1.9690000000000001},"min":{"1min":0.40300000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":60.953000000000003,"5min":60.953000000000003,"15min":60.953000000000003},"last":0.61499999999999999},{"interface":"front","average":{"1min":4.4779999999999998,"5min":2.7410000000000001,"15min":1.73},"min":{"1min":0.39200000000000002,"5min":0.252,"15min":0.252},"max":{"1min":61.073,"5min":61.073,"15min":61.073},"last":0.56299999999999994}]},{"osd":5,"last update":"Wed May 8 21:20:14 2024","interfaces":[{"interface":"back","average":{"1min":4.5469999999999997,"5min":2.778,"15min":1.7609999999999999},"min":{"1min":0.42799999999999999,"5min":0.311,"15min":0.311},"max":{"1min":60.796999999999997,"5min":60.796999999999997,"15min":60.796999999999997},"last":0.65000000000000002},{"interface":"front","average":{"1min":4.5229999999999997,"5min":2.569,"15min":1.972},"min":{"1min":0.36799999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":61.005000000000003,"5min":61.005000000000003,"15min":61.005000000000003},"last":0.60299999999999998}]},{"osd":6,"last update":"Wed May 8 21:20:14 2024","interfaces":[{"interface":"back","average":{"1min":4.6319999999999997,"5min":2.448,"15min":1.679},"min":{"1min":0.41099999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":60.838000000000001,"5min":60.838000000000001,"15min":60.838000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":4.3200000000000003,"5min":2.819,"15min":1.6830000000000001},"min":{"1min":0.38500000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":61.100000000000001,"5min":61.100000000000001,"15min":61.100000000000001},"last":0.67100000000000004}]},{"osd":7,"last update":"Wed May 8 21:20:14 2024","interfaces":[{"interface":"back","average":{"1min":3.7330000000000001,"5min":2.4569999999999999,"15min":1.843},"min":{"1min":0.35599999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":53.844999999999999,"5min":53.844999999999999,"15min":53.844999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":4.0149999999999997,"5min":2.8159999999999998,"15min":1.6899999999999999},"min":{"1min":0.438,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":61.124000000000002,"5min":61.124000000000002,"15min":61.124000000000002},"last":0.54800000000000004}]}]},{"osd":7,"up_from":14,"seq":60129542274,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":867812,"kb_used_data":7452,"kb_used_omap":1,"kb_used_meta":860350,"kb_avail":93504028,"statfs":{"total":96636764160,"available":95748124672,"internally_reserved":0,"allocated":7630848,"data_stored":12287392,"data_compressed":917593,"data_compressed_allocated":1265664,"data_compressed_original":6127616,"omap_allocated":1589,"internal_metadata":880998859},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:20:11 2024","interfaces":[{"interface":"back","average":{"1min":1.6100000000000001,"5min":2.2599999999999998,"15min":1.2529999999999999},"min":{"1min":0.26800000000000002,"5min":0.217,"15min":0.20999999999999999},"max":{"1min":6.5570000000000004,"5min":20.876999999999999,"15min":20.876999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":1.337,"5min":2.2280000000000002,"15min":1.5249999999999999},"min":{"1min":0.315,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":7.8840000000000003,"5min":23.748999999999999,"15min":62.033000000000001},"last":0.39500000000000002}]},{"osd":1,"last update":"Wed May 8 21:20:19 2024","interfaces":[{"interface":"back","average":{"1min":1.6619999999999999,"5min":2.8029999999999999,"15min":2.081},"min":{"1min":0.39600000000000002,"5min":0.251,"15min":0.246},"max":{"1min":14.566000000000001,"5min":44.164000000000001,"15min":44.645000000000003},"last":0.52000000000000002},{"interface":"front","average":{"1min":2.6560000000000001,"5min":2.7229999999999999,"15min":1.508},"min":{"1min":0.371,"5min":0.245,"15min":0.245},"max":{"1min":20.672999999999998,"5min":44.091000000000001,"15min":44.091000000000001},"last":0.34300000000000003}]},{"osd":2,"last update":"Wed May 8 21:20:11 2024","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":2.097,"15min":1.1699999999999999},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":6.1989999999999998,"5min":15.986000000000001,"15min":15.986000000000001},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.92400000000000004,"5min":1.782,"15min":1.0509999999999999},"min":{"1min":0.30399999999999999,"5min":0.29099999999999998,"15min":0.26100000000000001},"max":{"1min":5.4370000000000003,"5min":11.112,"15min":11.112},"last":0.47399999999999998}]},{"osd":3,"last update":"Wed May 8 21:20:11 2024","interfaces":[{"interface":"back","average":{"1min":2.0819999999999999,"5min":3.0950000000000002,"15min":1.6850000000000001},"min":{"1min":0.307,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":13.513999999999999,"5min":44.064999999999998,"15min":44.064999999999998},"last":0.433},{"interface":"front","average":{"1min":1.857,"5min":2.512,"15min":1.788},"min":{"1min":0.38,"5min":0.28399999999999997,"15min":0.27500000000000002},"max":{"1min":13.789,"5min":44.607999999999997,"15min":44.607999999999997},"last":0.41999999999999998}]},{"osd":4,"last update":"Wed May 8 21:20:19 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":1.135,"15min":0.85199999999999998},"min":{"1min":0.28899999999999998,"5min":0.224,"15min":0.224},"max":{"1min":7.6420000000000003,"5min":10.51,"15min":21.338000000000001},"last":0.309},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.474,"15min":1.002},"min":{"1min":0.26100000000000001,"5min":0.216,"15min":0.216},"max":{"1min":13.146000000000001,"5min":16.082999999999998,"15min":22.827000000000002},"last":0.44700000000000001}]},{"osd":5,"last update":"Wed May 8 21:20:19 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":1.121,"15min":0.86599999999999999},"min":{"1min":0.27500000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":2.5750000000000002,"5min":10.785,"15min":10.880000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":1.097,"5min":1.137,"15min":0.88},"min":{"1min":0.35299999999999998,"5min":0.318,"15min":0.29699999999999999},"max":{"1min":7.8620000000000001,"5min":7.8620000000000001,"15min":8.157},"last":0.54800000000000004}]},{"osd":6,"last update":"Wed May 8 21:20:19 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":1.264,"15min":0.88},"min":{"1min":0.28399999999999997,"5min":0.254,"15min":0.254},"max":{"1min":6.2270000000000003,"5min":12.433,"15min":12.433},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.5780000000000001,"15min":1.075},"min":{"1min":0.38,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":3.8210000000000002,"5min":19.864999999999998,"15min":19.864999999999998},"last":0.57299999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574978,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":729956,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":729534,"kb_avail":93641884,"statfs":{"total":96636764160,"available":95889289216,"internally_reserved":0,"allocated":421888,"data_stored":242918,"data_compressed":4766,"data_compressed_allocated":8192,"data_compressed_original":24576,"omap_allocated":1594,"internal_metadata":747043270},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:20:13 2024","interfaces":[{"interface":"back","average":{"1min":2.1459999999999999,"5min":2.5619999999999998,"15min":1.627},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":17.690000000000001,"5min":17.789000000000001,"15min":24.859999999999999},"last":0.20200000000000001},{"interface":"front","average":{"1min":1.429,"5min":2.1419999999999999,"15min":1.4490000000000001},"min":{"1min":0.22500000000000001,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":11.759,"5min":17.835999999999999,"15min":49.606000000000002},"last":0.28599999999999998}]},{"osd":1,"last update":"Wed May 8 21:20:13 2024","interfaces":[{"interface":"back","average":{"1min":3.6709999999999998,"5min":2.6139999999999999,"15min":1.9690000000000001},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.19800000000000001},"max":{"1min":19.904,"5min":24.321999999999999,"15min":55.296999999999997},"last":0.249},{"interface":"front","average":{"1min":1.4670000000000001,"5min":2.4399999999999999,"15min":1.782},"min":{"1min":0.254,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":6.3890000000000002,"5min":24.149999999999999,"15min":79.221000000000004},"last":0.26600000000000001}]},{"osd":3,"last update":"Wed May 8 21:20:13 2024","interfaces":[{"interface":"back","average":{"1min":1.9950000000000001,"5min":4.7050000000000001,"15min":2.2690000000000001},"min":{"1min":0.26100000000000001,"5min":0.249,"15min":0.23699999999999999},"max":{"1min":10.680999999999999,"5min":69.888000000000005,"15min":69.888000000000005},"last":0.31900000000000001},{"interface":"front","average":{"1min":2.0720000000000001,"5min":4.7599999999999998,"15min":2.3100000000000001},"min":{"1min":0.30599999999999999,"5min":0.30199999999999999,"15min":0.23699999999999999},"max":{"1min":10.705,"5min":69.959000000000003,"15min":69.959000000000003},"last":0.36099999999999999}]},{"osd":4,"last update":"Wed May 8 21:20:13 2024","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.786,"15min":1.466},"min":{"1min":0.33700000000000002,"5min":0.29299999999999998,"15min":0.253},"max":{"1min":5.8810000000000002,"5min":17.716999999999999,"15min":32.457999999999998},"last":0.39400000000000002},{"interface":"front","average":{"1min":1.194,"5min":1.7689999999999999,"15min":1.2110000000000001},"min":{"1min":0.28299999999999997,"5min":0.25700000000000001,"15min":0.255},"max":{"1min":5.9640000000000004,"5min":13.827,"15min":18.315000000000001},"last":0.40500000000000003}]},{"osd":5,"last update":"Wed May 8 21:20:13 2024","interfaces":[{"interface":"back","average":{"1min":1.6679999999999999,"5min":1.7649999999999999,"15min":1.153},"min":{"1min":0.434,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":10.627000000000001,"5min":17.507999999999999,"15min":17.507999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":1.0669999999999999,"5min":2.4849999999999999,"15min":1.6519999999999999},"min":{"1min":0.318,"5min":0.30299999999999999,"15min":0.28299999999999997},"max":{"1min":5.9909999999999997,"5min":48.560000000000002,"15min":48.560000000000002},"last":0.35099999999999998}]},{"osd":6,"last update":"Wed May 8 21:20:13 2024","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.752,"15min":1.278},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":5.9160000000000004,"5min":13.933999999999999,"15min":16.399999999999999},"last":0.42699999999999999},{"interface":"front","average":{"1min":1.837,"5min":2.1230000000000002,"15min":1.3740000000000001},"min":{"1min":0.33600000000000002,"5min":0.33100000000000002,"15min":0.27600000000000002},"max":{"1min":10.538,"5min":17.536000000000001,"15min":23.216000000000001},"last":0.34399999999999997}]},{"osd":7,"last update":"Wed May 8 21:20:13 2024","interfaces":[{"interface":"back","average":{"1min":1.952,"5min":1.992,"15min":1.3839999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.33000000000000002},"max":{"1min":10.599,"5min":11.041,"15min":16.366},"last":0.38600000000000001},{"interface":"front","average":{"1min":1.946,"5min":1.9379999999999999,"15min":1.232},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.313},"max":{"1min":10.654999999999999,"5min":13.903,"15min":13.903},"last":0.438}]}]},{"osd":3,"up_from":14,"seq":60129542270,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1284268,"kb_used_data":5284,"kb_used_omap":1,"kb_used_meta":1278974,"kb_avail":93087572,"statfs":{"total":96636764160,"available":95321673728,"internally_reserved":0,"allocated":5410816,"data_stored":8632198,"data_compressed":770600,"data_compressed_allocated":995328,"data_compressed_original":4419584,"omap_allocated":1592,"internal_metadata":1309669832},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:20:24 2024","interfaces":[{"interface":"back","average":{"1min":1.675,"5min":2.7679999999999998,"15min":1.4790000000000001},"min":{"1min":0.22,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":9.7050000000000001,"5min":39.801000000000002,"15min":39.801000000000002},"last":0.247},{"interface":"front","average":{"1min":1.6930000000000001,"5min":1.825,"15min":1.847},"min":{"1min":0.22700000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":8.2379999999999995,"5min":12.999000000000001,"15min":60.847999999999999},"last":0.28299999999999997}]},{"osd":1,"last update":"Wed May 8 21:20:24 2024","interfaces":[{"interface":"back","average":{"1min":3.5579999999999998,"5min":3.7869999999999999,"15min":2.0659999999999998},"min":{"1min":0.28100000000000003,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":43.097000000000001,"5min":47.418999999999997,"15min":57.020000000000003},"last":0.34999999999999998},{"interface":"front","average":{"1min":2.714,"5min":4.6520000000000001,"15min":2.165},"min":{"1min":0.23799999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":20.542000000000002,"5min":43.317,"15min":43.317},"last":0.36499999999999999}]},{"osd":2,"last update":"Wed May 8 21:20:24 2024","interfaces":[{"interface":"back","average":{"1min":2.7080000000000002,"5min":1.9139999999999999,"15min":1.262},"min":{"1min":0.25800000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":20.440000000000001,"5min":20.440000000000001,"15min":32.247999999999998},"last":0.33800000000000002},{"interface":"front","average":{"1min":1.4330000000000001,"5min":2.8969999999999998,"15min":1.649},"min":{"1min":0.33600000000000002,"5min":0.312,"15min":0.26200000000000001},"max":{"1min":9.9209999999999994,"5min":39.386000000000003,"15min":39.386000000000003},"last":0.39400000000000002}]},{"osd":4,"last update":"Wed May 8 21:20:24 2024","interfaces":[{"interface":"back","average":{"1min":2.6779999999999999,"5min":1.7989999999999999,"15min":1.7809999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.309},"max":{"1min":13.068,"5min":13.068,"15min":58.072000000000003},"last":0.49099999999999999},{"interface":"front","average":{"1min":2.3319999999999999,"5min":2.4870000000000001,"15min":1.4850000000000001},"min":{"1min":0.38400000000000001,"5min":0.314,"15min":0.314},"max":{"1min":10.382999999999999,"5min":15.712,"15min":26.311},"last":0.52400000000000002}]},{"osd":5,"last update":"Wed May 8 21:20:24 2024","interfaces":[{"interface":"back","average":{"1min":2.113,"5min":1.792,"15min":1.724},"min":{"1min":0.41299999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":9.6630000000000003,"5min":13.962,"15min":60.375999999999998},"last":0.46100000000000002},{"interface":"front","average":{"1min":1.629,"5min":2.7160000000000002,"15min":1.6779999999999999},"min":{"1min":0.374,"5min":0.31,"15min":0.31},"max":{"1min":9.9510000000000005,"5min":39.274000000000001,"15min":39.274000000000001},"last":0.59099999999999997}]},{"osd":6,"last update":"Wed May 8 21:20:24 2024","interfaces":[{"interface":"back","average":{"1min":2.0249999999999999,"5min":3.5230000000000001,"15min":1.956},"min":{"1min":0.40699999999999997,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":11.105,"5min":30.25,"15min":30.25},"last":0.53500000000000003},{"interface":"front","average":{"1min":2.0059999999999998,"5min":3.254,"15min":1.9530000000000001},"min":{"1min":0.40000000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":11.394,"5min":41.323999999999998,"15min":41.323999999999998},"last":0.621}]},{"osd":7,"last update":"Wed May 8 21:20:24 2024","interfaces":[{"interface":"back","average":{"1min":2.0680000000000001,"5min":3.536,"15min":1.929},"min":{"1min":0.42699999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":11.029999999999999,"5min":30.295000000000002,"15min":30.295000000000002},"last":0.51600000000000001},{"interface":"front","average":{"1min":2.2770000000000001,"5min":3.895,"15min":2.1219999999999999},"min":{"1min":0.45200000000000001,"5min":0.379,"15min":0.379},"max":{"1min":11.076000000000001,"5min":30.201000000000001,"15min":30.201000000000001},"last":0.60299999999999998}]}]},{"osd":1,"up_from":15,"seq":64424509568,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1171168,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":1170814,"kb_avail":93200672,"statfs":{"total":96636764160,"available":95437488128,"internally_reserved":0,"allocated":352256,"data_stored":149019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1198913990},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:20:17 2024","interfaces":[{"interface":"back","average":{"1min":4.1159999999999997,"5min":2.488,"15min":1.8879999999999999},"min":{"1min":0.20200000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":35.555999999999997,"5min":35.555999999999997,"15min":68.346999999999994},"last":0.28699999999999998},{"interface":"front","average":{"1min":2.496,"5min":2.5249999999999999,"15min":1.6120000000000001},"min":{"1min":0.22700000000000001,"5min":0.21199999999999999,"15min":0.19800000000000001},"max":{"1min":21.079000000000001,"5min":21.079000000000001,"15min":25.786000000000001},"last":0.32300000000000001}]},{"osd":2,"last update":"Wed May 8 21:20:17 2024","interfaces":[{"interface":"back","average":{"1min":4.5700000000000003,"5min":3.0409999999999999,"15min":2.468},"min":{"1min":0.217,"5min":0.191,"15min":0.191},"max":{"1min":59.341999999999999,"5min":59.341999999999999,"15min":70.688000000000002},"last":0.36399999999999999},{"interface":"front","average":{"1min":3.7210000000000001,"5min":2.488,"15min":1.9790000000000001},"min":{"1min":0.27900000000000003,"5min":0.22800000000000001,"15min":0.219},"max":{"1min":35.648000000000003,"5min":35.648000000000003,"15min":35.648000000000003},"last":0.39400000000000002}]},{"osd":3,"last update":"Wed May 8 21:20:17 2024","interfaces":[{"interface":"back","average":{"1min":4.2640000000000002,"5min":2.758,"15min":1.8580000000000001},"min":{"1min":0.25,"5min":0.224,"15min":0.224},"max":{"1min":35.601999999999997,"5min":35.601999999999997,"15min":35.658000000000001},"last":0.38},{"interface":"front","average":{"1min":3.4460000000000002,"5min":2.1760000000000002,"15min":1.782},"min":{"1min":0.29799999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":35.628,"5min":35.628,"15min":35.628},"last":0.41999999999999998}]},{"osd":4,"last update":"Wed May 8 21:20:17 2024","interfaces":[{"interface":"back","average":{"1min":3.6429999999999998,"5min":2.2730000000000001,"15min":1.6899999999999999},"min":{"1min":0.40699999999999997,"5min":0.34999999999999998,"15min":0.26900000000000002},"max":{"1min":24.457999999999998,"5min":24.457999999999998,"15min":43.401000000000003},"last":0.76100000000000001},{"interface":"front","average":{"1min":3.1720000000000002,"5min":2.3199999999999998,"15min":1.5049999999999999},"min":{"1min":0.32800000000000001,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":24.553999999999998,"5min":24.553999999999998,"15min":27.239000000000001},"last":0.80100000000000005}]},{"osd":5,"last update":"Wed May 8 21:20:17 2024","interfaces":[{"interface":"back","average":{"1min":4.0490000000000004,"5min":2.6970000000000001,"15min":1.964},"min":{"1min":0.39800000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":59.378999999999998,"5min":59.378999999999998,"15min":59.378999999999998},"last":0.67600000000000005},{"interface":"front","average":{"1min":3.077,"5min":2.169,"15min":1.7430000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.32300000000000001},"max":{"1min":24.524000000000001,"5min":24.524000000000001,"15min":27.352},"last":0.61399999999999999}]},{"osd":6,"last update":"Wed May 8 21:20:17 2024","interfaces":[{"interface":"back","average":{"1min":4.7549999999999999,"5min":3.0579999999999998,"15min":2.028},"min":{"1min":0.44500000000000001,"5min":0.307,"15min":0.307},"max":{"1min":70.786000000000001,"5min":70.786000000000001,"15min":70.786000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":3.1099999999999999,"5min":2.1739999999999999,"15min":1.5740000000000001},"min":{"1min":0.46000000000000002,"5min":0.35999999999999999,"15min":0.35499999999999998},"max":{"1min":24.588999999999999,"5min":24.588999999999999,"15min":27.376999999999999},"last":0.72099999999999997}]},{"osd":7,"last update":"Wed May 8 21:20:17 2024","interfaces":[{"interface":"back","average":{"1min":3.5419999999999998,"5min":2.8239999999999998,"15min":2.1680000000000001},"min":{"1min":0.46300000000000002,"5min":0.315,"15min":0.315},"max":{"1min":35.683999999999997,"5min":35.683999999999997,"15min":68.287999999999997},"last":0.69099999999999995},{"interface":"front","average":{"1min":3.1389999999999998,"5min":2.1789999999999998,"15min":1.714},"min":{"1min":0.42599999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":24.613,"5min":24.613,"15min":27.312999999999999},"last":0.66600000000000004}]}]},{"osd":4,"up_from":15,"seq":64424509569,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":923444,"kb_used_data":2540,"kb_used_omap":1,"kb_used_meta":920894,"kb_avail":93448396,"statfs":{"total":96636764160,"available":95691157504,"internally_reserved":0,"allocated":2600960,"data_stored":4343289,"data_compressed":367613,"data_compressed_allocated":532480,"data_compressed_original":2482176,"omap_allocated":1593,"internal_metadata":942995911},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:20:23 2024","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.6599999999999999,"15min":1.105},"min":{"1min":0.26700000000000002,"5min":0.218,"15min":0.218},"max":{"1min":12.94,"5min":20.606999999999999,"15min":20.606999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":1.1499999999999999,"5min":2.3660000000000001,"15min":1.798},"min":{"1min":0.23799999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":11.648999999999999,"5min":20.541,"15min":45.499000000000002},"last":0.48899999999999999}]},{"osd":1,"last update":"Wed May 8 21:20:23 2024","interfaces":[{"interface":"back","average":{"1min":2.3500000000000001,"5min":5.2169999999999996,"15min":2.6179999999999999},"min":{"1min":0.28599999999999998,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":11.686,"5min":273.69299999999998,"15min":273.69299999999998},"last":0.35199999999999998},{"interface":"front","average":{"1min":2.2309999999999999,"5min":5.1539999999999999,"15min":3.1669999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.26200000000000001},"max":{"1min":11.993,"5min":281.21699999999998,"15min":281.21699999999998},"last":0.50800000000000001}]},{"osd":2,"last update":"Wed May 8 21:20:23 2024","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.4319999999999999,"15min":1.446},"min":{"1min":0.377,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":11.568,"5min":11.568,"15min":96.177999999999997},"last":0.375},{"interface":"front","average":{"1min":0.628,"5min":1.29,"15min":1.3640000000000001},"min":{"1min":0.34699999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":2.8140000000000001,"5min":16.183,"15min":94.947000000000003},"last":0.44900000000000001}]},{"osd":3,"last update":"Wed May 8 21:20:23 2024","interfaces":[{"interface":"back","average":{"1min":2,"5min":2.286,"15min":1.5249999999999999},"min":{"1min":0.37,"5min":0.30399999999999999,"15min":0.23899999999999999},"max":{"1min":11.721,"5min":18.632000000000001,"15min":30.596},"last":0.41199999999999998},{"interface":"front","average":{"1min":1.3500000000000001,"5min":3.2509999999999999,"15min":1.857},"min":{"1min":0.33400000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":10.567,"5min":42.969000000000001,"15min":42.969000000000001},"last":0.39100000000000001}]},{"osd":5,"last update":"Wed May 8 21:20:23 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":1.3240000000000001,"15min":1.141},"min":{"1min":0.31,"5min":0.26700000000000002,"15min":0.221},"max":{"1min":4.7640000000000002,"5min":16.381,"15min":46.488999999999997},"last":0.51900000000000002},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.3260000000000001,"15min":1.018},"min":{"1min":0.378,"5min":0.307,"15min":0.26200000000000001},"max":{"1min":8.1210000000000004,"5min":16.681000000000001,"15min":45.445999999999998},"last":0.58099999999999996}]},{"osd":6,"last update":"Wed May 8 21:20:23 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":1.8879999999999999,"15min":1.167},"min":{"1min":0.34599999999999997,"5min":0.27500000000000002,"15min":0.26700000000000002},"max":{"1min":8.0980000000000008,"5min":35.289999999999999,"15min":35.289999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.8180000000000001,"15min":1.5389999999999999},"min":{"1min":0.36799999999999999,"5min":0.33600000000000002,"15min":0.28699999999999998},"max":{"1min":8.0660000000000007,"5min":35.311,"15min":46.576999999999998},"last":0.55200000000000005}]},{"osd":7,"last update":"Wed May 8 21:20:23 2024","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.927,"15min":1.1699999999999999},"min":{"1min":0.33400000000000002,"5min":0.29299999999999998,"15min":0.26200000000000001},"max":{"1min":11.592000000000001,"5min":19.077999999999999,"15min":19.077999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.7070000000000001,"15min":1.0820000000000001},"min":{"1min":0.39400000000000002,"5min":0.30299999999999999,"15min":0.28000000000000003},"max":{"1min":8.1449999999999996,"5min":31.617999999999999,"15min":31.617999999999999},"last":0.56499999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32306,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32306,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1585152,"data_stored":3159613,"data_compressed":328373,"data_compressed_allocated":425984,"data_compressed_original":2015232,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":94059,"data_compressed":4766,"data_compressed_allocated":8192,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5066752,"data_stored":8483339,"data_compressed":770600,"data_compressed_allocated":995328,"data_compressed_original":4419584,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2256896,"data_stored":4194430,"data_compressed":367613,"data_compressed_allocated":532480,"data_compressed_original":2482176,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1589248,"data_stored":4194976,"data_compressed":576533,"data_compressed_allocated":724992,"data_compressed_original":3338240,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7221248,"data_stored":11548165,"data_compressed":885287,"data_compressed_allocated":1220608,"data_compressed_original":5554176,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T21:20:40.259 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:40.260 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:40.260 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:40.260 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:40.260 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:40.260 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:40.260 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:40.260 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:40.261 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:40.261 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:40.261 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:40.261 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:40.261 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:40.261 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:40.262 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:40.262 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:40.262 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:40.262 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:40.262 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:40.262 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:40.263 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:40.263 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:40.263 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:40.263 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:40.263 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:40.264 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:40.264 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:40.264 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-05-08T21:10:06.735124+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:40.264 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-05-08T21:10:03.308625+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=10, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=19, tm_sec=53, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:20:40.264 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-08T21:21:00.266 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T21:21:00.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.405+0000 7f0d886b6700 1 Processor -- start 2024-05-08T21:21:00.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.405+0000 7f0d886b6700 1 -- start start 2024-05-08T21:21:00.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.406+0000 7f0d886b6700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0d80071f90 0x7f0d8006a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:00.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.406+0000 7f0d886b6700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0d8006af00 0x7f0d8015a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:00.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.406+0000 7f0d886b6700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d8015e570 con 0x7f0d80154320 2024-05-08T21:21:00.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.406+0000 7f0d886b6700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d80072400 con 0x7f0d80071f90 2024-05-08T21:21:00.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.406+0000 7f0d886b6700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8015d710 con 0x7f0d8006af00 2024-05-08T21:21:00.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.406+0000 7f0d86c53700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0d8006af00 0x7f0d8015a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:00.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.406+0000 7f0d85c51700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0d80071f90 0x7f0d8006a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:00.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.406+0000 7f0d86c53700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0d8006af00 0x7f0d8015a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:42082/0 (socket says 172.21.15.80:42082) 2024-05-08T21:21:00.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.406+0000 7f0d86452700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f0d80154320 0x7f0d800c99d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.80:53428/0 (socket says 172.21.15.80:53428) 2024-05-08T21:21:00.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.406+0000 7f0d86c53700 1 -- 172.21.15.80:0/1893061041 learned_addr learned my addr 172.21.15.80:0/1893061041 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:21:00.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.406+0000 7f0d85c51700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0d80071f90 0x7f0d8006a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.80:41872/0 (socket says 172.21.15.80:41872) 2024-05-08T21:21:00.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.406+0000 7f0d86c53700 1 -- 172.21.15.80:0/1893061041 >> v2:172.21.15.106:3300/0 conn(0x7f0d80071f90 msgr2=0x7f0d8006a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:21:00.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.406+0000 7f0d86c53700 1 --2- 172.21.15.80:0/1893061041 >> v2:172.21.15.106:3300/0 conn(0x7f0d80071f90 0x7f0d8006a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:00.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.406+0000 7f0d86c53700 1 -- 172.21.15.80:0/1893061041 >> v1:172.21.15.106:6789/0 conn(0x7f0d80154320 legacy=0x7f0d800c99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:00.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.406+0000 7f0d86c53700 1 -- 172.21.15.80:0/1893061041 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d8015d960 con 0x7f0d8006af00 2024-05-08T21:21:00.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.406+0000 7f0d85c51700 1 --2- 172.21.15.80:0/1893061041 >> v2:172.21.15.106:3300/0 conn(0x7f0d80071f90 0x7f0d8006a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:21:00.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.407+0000 7f0d86c53700 1 --2- 172.21.15.80:0/1893061041 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0d8006af00 0x7f0d8015a340 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0d78009e50 tx=0x7f0d7800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb9801d902e667ef server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:00.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.407+0000 7f0d85450700 1 -- 172.21.15.80:0/1893061041 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7800e070 con 0x7f0d8006af00 2024-05-08T21:21:00.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.407+0000 7f0d85450700 1 -- 172.21.15.80:0/1893061041 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d7800b910 con 0x7f0d8006af00 2024-05-08T21:21:00.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.407+0000 7f0d85450700 1 -- 172.21.15.80:0/1893061041 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7800bcc0 con 0x7f0d8006af00 2024-05-08T21:21:00.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.407+0000 7f0d886b6700 1 -- 172.21.15.80:0/1893061041 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0d8006af00 msgr2=0x7f0d8015a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:00.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.407+0000 7f0d886b6700 1 --2- 172.21.15.80:0/1893061041 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0d8006af00 0x7f0d8015a340 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0d78009e50 tx=0x7f0d7800b330 comp rx=0 tx=0).stop 2024-05-08T21:21:00.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.407+0000 7f0d886b6700 1 -- 172.21.15.80:0/1893061041 shutdown_connections 2024-05-08T21:21:00.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.407+0000 7f0d886b6700 1 --2- 172.21.15.80:0/1893061041 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0d8006af00 0x7f0d8015a340 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:00.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.407+0000 7f0d886b6700 1 --2- 172.21.15.80:0/1893061041 >> v2:172.21.15.106:3300/0 conn(0x7f0d80071f90 0x7f0d8006a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:00.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.407+0000 7f0d886b6700 1 -- 172.21.15.80:0/1893061041 >> 172.21.15.80:0/1893061041 conn(0x7f0d8006f140 msgr2=0x7f0d8006f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:00.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.407+0000 7f0d886b6700 1 -- 172.21.15.80:0/1893061041 shutdown_connections 2024-05-08T21:21:00.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.407+0000 7f0d886b6700 1 -- 172.21.15.80:0/1893061041 wait complete. 2024-05-08T21:21:00.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.409+0000 7f0d886b6700 1 Processor -- start 2024-05-08T21:21:00.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.409+0000 7f0d886b6700 1 -- start start 2024-05-08T21:21:00.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.409+0000 7f0d886b6700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0d8006af00 0x7f0d80151440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:00.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.409+0000 7f0d886b6700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d80071f90 0x7f0d8014c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:00.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.409+0000 7f0d886b6700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d80154320 0x7f0d8014c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:00.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.409+0000 7f0d886b6700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d800c3fd0 con 0x7f0d80071f90 2024-05-08T21:21:00.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.409+0000 7f0d886b6700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8015d220 con 0x7f0d80154320 2024-05-08T21:21:00.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.409+0000 7f0d886b6700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8015d4c0 con 0x7f0d8006af00 2024-05-08T21:21:00.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.410+0000 7f0d85c51700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d80071f90 0x7f0d8014c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:00.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.410+0000 7f0d85c51700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d80071f90 0x7f0d8014c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51288/0 (socket says 172.21.15.80:51288) 2024-05-08T21:21:00.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.410+0000 7f0d85c51700 1 -- 172.21.15.80:0/3286579308 learned_addr learned my addr 172.21.15.80:0/3286579308 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:21:00.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.410+0000 7f0d86452700 1 --2- 172.21.15.80:0/3286579308 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0d8006af00 0x7f0d80151440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:00.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.410+0000 7f0d86c53700 1 --2- 172.21.15.80:0/3286579308 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d80154320 0x7f0d8014c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:00.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.410+0000 7f0d85c51700 1 -- 172.21.15.80:0/3286579308 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0d8006af00 msgr2=0x7f0d80151440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:00.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.410+0000 7f0d85c51700 1 --2- 172.21.15.80:0/3286579308 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0d8006af00 0x7f0d80151440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:00.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.410+0000 7f0d85c51700 1 -- 172.21.15.80:0/3286579308 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d80154320 msgr2=0x7f0d8014c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:00.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.410+0000 7f0d85c51700 1 --2- 172.21.15.80:0/3286579308 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d80154320 0x7f0d8014c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:00.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.410+0000 7f0d85c51700 1 -- 172.21.15.80:0/3286579308 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d700094a0 con 0x7f0d80071f90 2024-05-08T21:21:00.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.410+0000 7f0d85c51700 1 --2- 172.21.15.80:0/3286579308 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d80071f90 0x7f0d8014c3f0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f0d7000ebe0 tx=0x7f0d7000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:00.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.410+0000 7f0d76ffd700 1 -- 172.21.15.80:0/3286579308 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d70009760 con 0x7f0d80071f90 2024-05-08T21:21:00.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.410+0000 7f0d76ffd700 1 -- 172.21.15.80:0/3286579308 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d7000c850 con 0x7f0d80071f90 2024-05-08T21:21:00.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.410+0000 7f0d886b6700 1 -- 172.21.15.80:0/3286579308 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d78009b30 con 0x7f0d80071f90 2024-05-08T21:21:00.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.410+0000 7f0d76ffd700 1 -- 172.21.15.80:0/3286579308 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7000cbe0 con 0x7f0d80071f90 2024-05-08T21:21:00.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.410+0000 7f0d886b6700 1 -- 172.21.15.80:0/3286579308 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d800c59a0 con 0x7f0d80071f90 2024-05-08T21:21:00.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.411+0000 7f0d886b6700 1 -- 172.21.15.80:0/3286579308 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d8004ec60 con 0x7f0d80071f90 2024-05-08T21:21:00.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.412+0000 7f0d76ffd700 1 -- 172.21.15.80:0/3286579308 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0d7000cd40 con 0x7f0d80071f90 2024-05-08T21:21:00.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.412+0000 7f0d76ffd700 1 --2- 172.21.15.80:0/3286579308 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f0d6406ac90 0x7f0d6406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:00.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.412+0000 7f0d76ffd700 1 -- 172.21.15.80:0/3286579308 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f0d70089bc0 con 0x7f0d80071f90 2024-05-08T21:21:00.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.412+0000 7f0d86452700 1 --2- 172.21.15.80:0/3286579308 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f0d6406ac90 0x7f0d6406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:00.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.413+0000 7f0d86452700 1 --2- 172.21.15.80:0/3286579308 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f0d6406ac90 0x7f0d6406d150 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c000f60 tx=0x7f0d7c007ed0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:00.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.417+0000 7f0d76ffd700 1 -- 172.21.15.80:0/3286579308 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f0d70054890 con 0x7f0d80071f90 2024-05-08T21:21:00.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.609+0000 7f0d886b6700 1 -- 172.21.15.80:0/3286579308 --> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0d8006fac0 con 0x7f0d6406ac90 2024-05-08T21:21:00.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.618+0000 7f0d76ffd700 1 -- 172.21.15.80:0/3286579308 <== mgr.4100 v2:172.21.15.80:6832/46731 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+372443 (secure 0 0 0) 0x7f0d8006fac0 con 0x7f0d6406ac90 2024-05-08T21:21:00.624 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:21:00.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.622+0000 7f0d886b6700 1 -- 172.21.15.80:0/3286579308 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f0d6406ac90 msgr2=0x7f0d6406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:00.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.622+0000 7f0d886b6700 1 --2- 172.21.15.80:0/3286579308 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f0d6406ac90 0x7f0d6406d150 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c000f60 tx=0x7f0d7c007ed0 comp rx=0 tx=0).stop 2024-05-08T21:21:00.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.622+0000 7f0d886b6700 1 -- 172.21.15.80:0/3286579308 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d80071f90 msgr2=0x7f0d8014c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:00.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.622+0000 7f0d886b6700 1 --2- 172.21.15.80:0/3286579308 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d80071f90 0x7f0d8014c3f0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f0d7000ebe0 tx=0x7f0d7000eef0 comp rx=0 tx=0).stop 2024-05-08T21:21:00.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.622+0000 7f0d886b6700 1 -- 172.21.15.80:0/3286579308 shutdown_connections 2024-05-08T21:21:00.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.622+0000 7f0d886b6700 1 --2- 172.21.15.80:0/3286579308 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f0d6406ac90 0x7f0d6406d150 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:00.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.622+0000 7f0d886b6700 1 --2- 172.21.15.80:0/3286579308 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d80154320 0x7f0d8014c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:00.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.622+0000 7f0d886b6700 1 --2- 172.21.15.80:0/3286579308 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0d8006af00 0x7f0d80151440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:00.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.622+0000 7f0d886b6700 1 --2- 172.21.15.80:0/3286579308 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d80071f90 0x7f0d8014c3f0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:00.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.622+0000 7f0d886b6700 1 -- 172.21.15.80:0/3286579308 >> 172.21.15.80:0/3286579308 conn(0x7f0d8006f140 msgr2=0x7f0d8015a340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:00.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.622+0000 7f0d886b6700 1 -- 172.21.15.80:0/3286579308 shutdown_connections 2024-05-08T21:21:00.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.622+0000 7f0d886b6700 1 -- 172.21.15.80:0/3286579308 wait complete. 2024-05-08T21:21:00.628 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-05-08T21:21:00.636 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":358,"stamp":"2024-05-08T21:21:00.518378+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":16427784,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":2254,"num_read_kb":39820,"num_write":1717439,"num_write_kb":22166553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":136231,"ondisk_log_size":136231,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":7386224,"kb_used_data":20208,"kb_used_omap":12,"kb_used_meta":7365939,"kb_avail":747588496,"statfs":{"total":773094113280,"available":765530619904,"internally_reserved":0,"allocated":20692992,"data_stored":34046440,"data_compressed":2997784,"data_compressed_allocated":3997696,"data_compressed_original":18980864,"omap_allocated":12743,"internal_metadata":7542722105},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003031"},"pg_stats":[{"pgid":"3.3f","version":"32'8","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:57.563765+0000","last_change":"2024-05-08T21:20:57.563890+0000","last_active":"2024-05-08T21:20:57.563765+0000","last_peered":"2024-05-08T21:20:57.563765+0000","last_clean":"2024-05-08T21:20:57.563765+0000","last_became_active":"2024-05-08T21:10:03.747059+0000","last_became_peered":"2024-05-08T21:10:03.747059+0000","last_unstale":"2024-05-08T21:20:57.563765+0000","last_undegraded":"2024-05-08T21:20:57.563765+0000","last_fullsized":"2024-05-08T21:20:57.563765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-08T21:20:57.563741+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-08T21:20:57.563741+0000","last_clean_scrub_stamp":"2024-05-08T21:20:57.563741+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:09:19.470495+0000","scrub_duration":0.035236774999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"32'6","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:01.277494+0000","last_change":"2024-05-08T21:20:01.277494+0000","last_active":"2024-05-08T21:20:01.277494+0000","last_peered":"2024-05-08T21:20:01.277494+0000","last_clean":"2024-05-08T21:20:01.277494+0000","last_became_active":"2024-05-08T21:10:03.738466+0000","last_became_peered":"2024-05-08T21:10:03.738466+0000","last_unstale":"2024-05-08T21:20:01.277494+0000","last_undegraded":"2024-05-08T21:20:01.277494+0000","last_fullsized":"2024-05-08T21:20:01.277494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-08T21:20:01.277377+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-08T21:20:01.277377+0000","last_clean_scrub_stamp":"2024-05-08T21:20:01.277377+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:32:05.453713+0000","scrub_duration":0.0039052399999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"32'13","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:06.584071+0000","last_change":"2024-05-08T21:20:06.584071+0000","last_active":"2024-05-08T21:20:06.584071+0000","last_peered":"2024-05-08T21:20:06.584071+0000","last_clean":"2024-05-08T21:20:06.584071+0000","last_became_active":"2024-05-08T21:10:03.739884+0000","last_became_peered":"2024-05-08T21:10:03.739884+0000","last_unstale":"2024-05-08T21:20:06.584071+0000","last_undegraded":"2024-05-08T21:20:06.584071+0000","last_fullsized":"2024-05-08T21:20:06.584071+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'13","last_scrub_stamp":"2024-05-08T21:20:06.583961+0000","last_deep_scrub":"32'13","last_deep_scrub_stamp":"2024-05-08T21:20:06.583961+0000","last_clean_scrub_stamp":"2024-05-08T21:20:06.583961+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:24:50.098329+0000","scrub_duration":0.0046022240000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"32'6","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:41.317283+0000","last_change":"2024-05-08T21:20:41.317396+0000","last_active":"2024-05-08T21:20:41.317283+0000","last_peered":"2024-05-08T21:20:41.317283+0000","last_clean":"2024-05-08T21:20:41.317283+0000","last_became_active":"2024-05-08T21:10:03.753800+0000","last_became_peered":"2024-05-08T21:10:03.753800+0000","last_unstale":"2024-05-08T21:20:41.317283+0000","last_undegraded":"2024-05-08T21:20:41.317283+0000","last_fullsized":"2024-05-08T21:20:41.317283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-08T21:20:41.317255+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-08T21:20:41.317255+0000","last_clean_scrub_stamp":"2024-05-08T21:20:41.317255+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:41:52.734139+0000","scrub_duration":0.0019924529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"32'11","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:52.617417+0000","last_change":"2024-05-08T21:20:52.617554+0000","last_active":"2024-05-08T21:20:52.617417+0000","last_peered":"2024-05-08T21:20:52.617417+0000","last_clean":"2024-05-08T21:20:52.617417+0000","last_became_active":"2024-05-08T21:10:03.749730+0000","last_became_peered":"2024-05-08T21:10:03.749730+0000","last_unstale":"2024-05-08T21:20:52.617417+0000","last_undegraded":"2024-05-08T21:20:52.617417+0000","last_fullsized":"2024-05-08T21:20:52.617417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'11","last_scrub_stamp":"2024-05-08T21:20:52.617390+0000","last_deep_scrub":"32'11","last_deep_scrub_stamp":"2024-05-08T21:20:52.617390+0000","last_clean_scrub_stamp":"2024-05-08T21:20:52.617390+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:28:51.619675+0000","scrub_duration":0.023575334,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"32'11","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:24.269351+0000","last_change":"2024-05-08T21:20:24.269351+0000","last_active":"2024-05-08T21:20:24.269351+0000","last_peered":"2024-05-08T21:20:24.269351+0000","last_clean":"2024-05-08T21:20:24.269351+0000","last_became_active":"2024-05-08T21:10:53.473632+0000","last_became_peered":"2024-05-08T21:10:53.473632+0000","last_unstale":"2024-05-08T21:20:24.269351+0000","last_undegraded":"2024-05-08T21:20:24.269351+0000","last_fullsized":"2024-05-08T21:20:24.269351+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'11","last_scrub_stamp":"2024-05-08T21:20:24.269250+0000","last_deep_scrub":"32'11","last_deep_scrub_stamp":"2024-05-08T21:20:24.269250+0000","last_clean_scrub_stamp":"2024-05-08T21:20:24.269250+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:51:14.956490+0000","scrub_duration":0.0012160070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"32'8","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:47.535349+0000","last_change":"2024-05-08T21:20:47.535476+0000","last_active":"2024-05-08T21:20:47.535349+0000","last_peered":"2024-05-08T21:20:47.535349+0000","last_clean":"2024-05-08T21:20:47.535349+0000","last_became_active":"2024-05-08T21:10:03.743349+0000","last_became_peered":"2024-05-08T21:10:03.743349+0000","last_unstale":"2024-05-08T21:20:47.535349+0000","last_undegraded":"2024-05-08T21:20:47.535349+0000","last_fullsized":"2024-05-08T21:20:47.535349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-08T21:20:47.535302+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-08T21:20:47.535302+0000","last_clean_scrub_stamp":"2024-05-08T21:20:47.535302+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:10.474390+0000","scrub_duration":0.0021507869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"32'6","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:29.956625+0000","last_change":"2024-05-08T21:20:29.956700+0000","last_active":"2024-05-08T21:20:29.956625+0000","last_peered":"2024-05-08T21:20:29.956625+0000","last_clean":"2024-05-08T21:20:29.956625+0000","last_became_active":"2024-05-08T21:10:03.747300+0000","last_became_peered":"2024-05-08T21:10:03.747300+0000","last_unstale":"2024-05-08T21:20:29.956625+0000","last_undegraded":"2024-05-08T21:20:29.956625+0000","last_fullsized":"2024-05-08T21:20:29.956625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-08T21:20:29.956603+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-08T21:20:29.956603+0000","last_clean_scrub_stamp":"2024-05-08T21:20:29.956603+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:54:30.695489+0000","scrub_duration":0.0019023519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"32'16","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:42.483258+0000","last_change":"2024-05-08T21:20:42.483416+0000","last_active":"2024-05-08T21:20:42.483258+0000","last_peered":"2024-05-08T21:20:42.483258+0000","last_clean":"2024-05-08T21:20:42.483258+0000","last_became_active":"2024-05-08T21:10:03.747956+0000","last_became_peered":"2024-05-08T21:10:03.747956+0000","last_unstale":"2024-05-08T21:20:42.483258+0000","last_undegraded":"2024-05-08T21:20:42.483258+0000","last_fullsized":"2024-05-08T21:20:42.483258+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-05-08T21:20:42.483232+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-05-08T21:20:42.483232+0000","last_clean_scrub_stamp":"2024-05-08T21:20:42.483232+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:56.637052+0000","scrub_duration":0.027045820000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"32'11","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:31.121780+0000","last_change":"2024-05-08T21:20:31.121902+0000","last_active":"2024-05-08T21:20:31.121780+0000","last_peered":"2024-05-08T21:20:31.121780+0000","last_clean":"2024-05-08T21:20:31.121780+0000","last_became_active":"2024-05-08T21:10:03.744976+0000","last_became_peered":"2024-05-08T21:10:03.744976+0000","last_unstale":"2024-05-08T21:20:31.121780+0000","last_undegraded":"2024-05-08T21:20:31.121780+0000","last_fullsized":"2024-05-08T21:20:31.121780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'11","last_scrub_stamp":"2024-05-08T21:20:31.121735+0000","last_deep_scrub":"32'11","last_deep_scrub_stamp":"2024-05-08T21:20:31.121735+0000","last_clean_scrub_stamp":"2024-05-08T21:20:31.121735+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:21:11.685387+0000","scrub_duration":0.0039182499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"32'12","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:30.096196+0000","last_change":"2024-05-08T21:20:30.096328+0000","last_active":"2024-05-08T21:20:30.096196+0000","last_peered":"2024-05-08T21:20:30.096196+0000","last_clean":"2024-05-08T21:20:30.096196+0000","last_became_active":"2024-05-08T21:10:03.748253+0000","last_became_peered":"2024-05-08T21:10:03.748253+0000","last_unstale":"2024-05-08T21:20:30.096196+0000","last_undegraded":"2024-05-08T21:20:30.096196+0000","last_fullsized":"2024-05-08T21:20:30.096196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-08T21:20:30.096170+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-08T21:20:30.096170+0000","last_clean_scrub_stamp":"2024-05-08T21:20:30.096170+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:18.919748+0000","scrub_duration":0.023160623000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"32'11","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:15.607176+0000","last_change":"2024-05-08T21:20:15.607331+0000","last_active":"2024-05-08T21:20:15.607176+0000","last_peered":"2024-05-08T21:20:15.607176+0000","last_clean":"2024-05-08T21:20:15.607176+0000","last_became_active":"2024-05-08T21:10:03.745247+0000","last_became_peered":"2024-05-08T21:10:03.745247+0000","last_unstale":"2024-05-08T21:20:15.607176+0000","last_undegraded":"2024-05-08T21:20:15.607176+0000","last_fullsized":"2024-05-08T21:20:15.607176+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'11","last_scrub_stamp":"2024-05-08T21:20:15.607148+0000","last_deep_scrub":"32'11","last_deep_scrub_stamp":"2024-05-08T21:20:15.607148+0000","last_clean_scrub_stamp":"2024-05-08T21:20:15.607148+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:09:50.658665+0000","scrub_duration":0.0016985839999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"32'15","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:58.769193+0000","last_change":"2024-05-08T21:19:58.769310+0000","last_active":"2024-05-08T21:19:58.769193+0000","last_peered":"2024-05-08T21:19:58.769193+0000","last_clean":"2024-05-08T21:19:58.769193+0000","last_became_active":"2024-05-08T21:10:03.746848+0000","last_became_peered":"2024-05-08T21:10:03.746848+0000","last_unstale":"2024-05-08T21:19:58.769193+0000","last_undegraded":"2024-05-08T21:19:58.769193+0000","last_fullsized":"2024-05-08T21:19:58.769193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-05-08T21:19:58.769170+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-05-08T21:19:58.769170+0000","last_clean_scrub_stamp":"2024-05-08T21:19:58.769170+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:44:20.357961+0000","scrub_duration":0.027292114999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"32'17","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:30.472402+0000","last_change":"2024-05-08T21:20:30.472476+0000","last_active":"2024-05-08T21:20:30.472402+0000","last_peered":"2024-05-08T21:20:30.472402+0000","last_clean":"2024-05-08T21:20:30.472402+0000","last_became_active":"2024-05-08T21:10:03.737716+0000","last_became_peered":"2024-05-08T21:10:03.737716+0000","last_unstale":"2024-05-08T21:20:30.472402+0000","last_undegraded":"2024-05-08T21:20:30.472402+0000","last_fullsized":"2024-05-08T21:20:30.472402+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'17","last_scrub_stamp":"2024-05-08T21:20:30.472380+0000","last_deep_scrub":"32'17","last_deep_scrub_stamp":"2024-05-08T21:20:30.472380+0000","last_clean_scrub_stamp":"2024-05-08T21:20:30.472380+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:02:29.542314+0000","scrub_duration":0.0012646129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"32'13","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:35.353925+0000","last_change":"2024-05-08T21:20:35.354026+0000","last_active":"2024-05-08T21:20:35.353925+0000","last_peered":"2024-05-08T21:20:35.353925+0000","last_clean":"2024-05-08T21:20:35.353925+0000","last_became_active":"2024-05-08T21:10:03.744276+0000","last_became_peered":"2024-05-08T21:10:03.744276+0000","last_unstale":"2024-05-08T21:20:35.353925+0000","last_undegraded":"2024-05-08T21:20:35.353925+0000","last_fullsized":"2024-05-08T21:20:35.353925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'13","last_scrub_stamp":"2024-05-08T21:20:35.353899+0000","last_deep_scrub":"32'13","last_deep_scrub_stamp":"2024-05-08T21:20:35.353899+0000","last_clean_scrub_stamp":"2024-05-08T21:20:35.353899+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:31:08.149770+0000","scrub_duration":0.004560644,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"32'13","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:39.365436+0000","last_change":"2024-05-08T21:20:39.365535+0000","last_active":"2024-05-08T21:20:39.365436+0000","last_peered":"2024-05-08T21:20:39.365436+0000","last_clean":"2024-05-08T21:20:39.365436+0000","last_became_active":"2024-05-08T21:10:03.745862+0000","last_became_peered":"2024-05-08T21:10:03.745862+0000","last_unstale":"2024-05-08T21:20:39.365436+0000","last_undegraded":"2024-05-08T21:20:39.365436+0000","last_fullsized":"2024-05-08T21:20:39.365436+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'13","last_scrub_stamp":"2024-05-08T21:20:39.365385+0000","last_deep_scrub":"32'13","last_deep_scrub_stamp":"2024-05-08T21:20:39.365385+0000","last_clean_scrub_stamp":"2024-05-08T21:20:39.365385+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:12:49.344814+0000","scrub_duration":0.0021466319999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"32'13","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:21.351874+0000","last_change":"2024-05-08T21:20:21.352085+0000","last_active":"2024-05-08T21:20:21.351874+0000","last_peered":"2024-05-08T21:20:21.351874+0000","last_clean":"2024-05-08T21:20:21.351874+0000","last_became_active":"2024-05-08T21:10:54.028630+0000","last_became_peered":"2024-05-08T21:10:54.028630+0000","last_unstale":"2024-05-08T21:20:21.351874+0000","last_undegraded":"2024-05-08T21:20:21.351874+0000","last_fullsized":"2024-05-08T21:20:21.351874+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'13","last_scrub_stamp":"2024-05-08T21:20:21.351819+0000","last_deep_scrub":"32'13","last_deep_scrub_stamp":"2024-05-08T21:20:21.351819+0000","last_clean_scrub_stamp":"2024-05-08T21:20:21.351819+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:26.614142+0000","scrub_duration":0.028289547000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"32'17","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:09.346737+0000","last_change":"2024-05-08T21:20:09.346874+0000","last_active":"2024-05-08T21:20:09.346737+0000","last_peered":"2024-05-08T21:20:09.346737+0000","last_clean":"2024-05-08T21:20:09.346737+0000","last_became_active":"2024-05-08T21:10:03.743596+0000","last_became_peered":"2024-05-08T21:10:03.743596+0000","last_unstale":"2024-05-08T21:20:09.346737+0000","last_undegraded":"2024-05-08T21:20:09.346737+0000","last_fullsized":"2024-05-08T21:20:09.346737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'17","last_scrub_stamp":"2024-05-08T21:20:09.346697+0000","last_deep_scrub":"32'17","last_deep_scrub_stamp":"2024-05-08T21:20:09.346697+0000","last_clean_scrub_stamp":"2024-05-08T21:20:09.346697+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:36:15.220278+0000","scrub_duration":0.0019157390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"32'15","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:51.612660+0000","last_change":"2024-05-08T21:20:51.612780+0000","last_active":"2024-05-08T21:20:51.612660+0000","last_peered":"2024-05-08T21:20:51.612660+0000","last_clean":"2024-05-08T21:20:51.612660+0000","last_became_active":"2024-05-08T21:10:03.743580+0000","last_became_peered":"2024-05-08T21:10:03.743580+0000","last_unstale":"2024-05-08T21:20:51.612660+0000","last_undegraded":"2024-05-08T21:20:51.612660+0000","last_fullsized":"2024-05-08T21:20:51.612660+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-05-08T21:20:51.612633+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-05-08T21:20:51.612633+0000","last_clean_scrub_stamp":"2024-05-08T21:20:51.612633+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:53:41.020934+0000","scrub_duration":0.003211485,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"32'4303","reported_seq":4404,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:52.106252+0000","last_change":"2024-05-08T21:20:52.106406+0000","last_active":"2024-05-08T21:20:52.106252+0000","last_peered":"2024-05-08T21:20:52.106252+0000","last_clean":"2024-05-08T21:20:52.106252+0000","last_became_active":"2024-05-08T21:10:08.052009+0000","last_became_peered":"2024-05-08T21:10:08.052009+0000","last_unstale":"2024-05-08T21:20:52.106252+0000","last_undegraded":"2024-05-08T21:20:52.106252+0000","last_fullsized":"2024-05-08T21:20:52.106252+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4303","last_scrub_stamp":"2024-05-08T21:20:52.106221+0000","last_deep_scrub":"32'4303","last_deep_scrub_stamp":"2024-05-08T21:20:52.106221+0000","last_clean_scrub_stamp":"2024-05-08T21:20:52.106221+0000","objects_scrubbed":0,"log_size":4303,"log_dups_size":0,"ondisk_log_size":4303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:24:25.198900+0000","scrub_duration":0.032061385999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":0,"num_write":56160,"num_write_kb":728959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"32'474","reported_seq":524,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:03.577407+0000","last_change":"2024-05-08T21:20:03.577407+0000","last_active":"2024-05-08T21:20:03.577407+0000","last_peered":"2024-05-08T21:20:03.577407+0000","last_clean":"2024-05-08T21:20:03.577407+0000","last_became_active":"2024-05-08T21:10:03.339847+0000","last_became_peered":"2024-05-08T21:10:03.339847+0000","last_unstale":"2024-05-08T21:20:03.577407+0000","last_undegraded":"2024-05-08T21:20:03.577407+0000","last_fullsized":"2024-05-08T21:20:03.577407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'474","last_scrub_stamp":"2024-05-08T21:20:03.577308+0000","last_deep_scrub":"32'474","last_deep_scrub_stamp":"2024-05-08T21:20:03.577308+0000","last_clean_scrub_stamp":"2024-05-08T21:20:03.577308+0000","objects_scrubbed":3,"log_size":474,"log_dups_size":0,"ondisk_log_size":474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:33:31.180492+0000","scrub_duration":0.013062450999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3159557,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":1370,"num_write":465,"num_write_kb":3345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"32'7","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:18.886705+0000","last_change":"2024-05-08T21:20:18.886796+0000","last_active":"2024-05-08T21:20:18.886705+0000","last_peered":"2024-05-08T21:20:18.886705+0000","last_clean":"2024-05-08T21:20:18.886705+0000","last_became_active":"2024-05-08T21:10:03.746383+0000","last_became_peered":"2024-05-08T21:10:03.746383+0000","last_unstale":"2024-05-08T21:20:18.886705+0000","last_undegraded":"2024-05-08T21:20:18.886705+0000","last_fullsized":"2024-05-08T21:20:18.886705+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-05-08T21:20:18.886683+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-05-08T21:20:18.886683+0000","last_clean_scrub_stamp":"2024-05-08T21:20:18.886683+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:26:32.191068+0000","scrub_duration":0.013506995000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'4174","reported_seq":4275,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:39.761304+0000","last_change":"2024-05-08T21:20:39.761447+0000","last_active":"2024-05-08T21:20:39.761304+0000","last_peered":"2024-05-08T21:20:39.761304+0000","last_clean":"2024-05-08T21:20:39.761304+0000","last_became_active":"2024-05-08T21:10:53.484437+0000","last_became_peered":"2024-05-08T21:10:53.484437+0000","last_unstale":"2024-05-08T21:20:39.761304+0000","last_undegraded":"2024-05-08T21:20:39.761304+0000","last_fullsized":"2024-05-08T21:20:39.761304+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4174","last_scrub_stamp":"2024-05-08T21:20:39.761279+0000","last_deep_scrub":"32'4174","last_deep_scrub_stamp":"2024-05-08T21:20:39.761279+0000","last_clean_scrub_stamp":"2024-05-08T21:20:39.761279+0000","objects_scrubbed":0,"log_size":4174,"log_dups_size":0,"ondisk_log_size":4174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:05:23.832808+0000","scrub_duration":0.056450651999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":0,"num_write":53711,"num_write_kb":702965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2,3],"acting":[4,6,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"32'7","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:12.814201+0000","last_change":"2024-05-08T21:20:12.814201+0000","last_active":"2024-05-08T21:20:12.814201+0000","last_peered":"2024-05-08T21:20:12.814201+0000","last_clean":"2024-05-08T21:20:12.814201+0000","last_became_active":"2024-05-08T21:10:03.328970+0000","last_became_peered":"2024-05-08T21:10:03.328970+0000","last_unstale":"2024-05-08T21:20:12.814201+0000","last_undegraded":"2024-05-08T21:20:12.814201+0000","last_fullsized":"2024-05-08T21:20:12.814201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-05-08T21:20:12.814101+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-05-08T21:20:12.814101+0000","last_clean_scrub_stamp":"2024-05-08T21:20:12.814101+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:43:38.340101+0000","scrub_duration":0.0011883289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"32'13","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:27.544019+0000","last_change":"2024-05-08T21:20:27.544140+0000","last_active":"2024-05-08T21:20:27.544019+0000","last_peered":"2024-05-08T21:20:27.544019+0000","last_clean":"2024-05-08T21:20:27.544019+0000","last_became_active":"2024-05-08T21:10:03.747989+0000","last_became_peered":"2024-05-08T21:10:03.747989+0000","last_unstale":"2024-05-08T21:20:27.544019+0000","last_undegraded":"2024-05-08T21:20:27.544019+0000","last_fullsized":"2024-05-08T21:20:27.544019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'13","last_scrub_stamp":"2024-05-08T21:20:27.543996+0000","last_deep_scrub":"32'13","last_deep_scrub_stamp":"2024-05-08T21:20:27.543996+0000","last_clean_scrub_stamp":"2024-05-08T21:20:27.543996+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:12:19.610255+0000","scrub_duration":0.024098972,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"32'4151","reported_seq":4247,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:42.762861+0000","last_change":"2024-05-08T21:20:42.763000+0000","last_active":"2024-05-08T21:20:42.762861+0000","last_peered":"2024-05-08T21:20:42.762861+0000","last_clean":"2024-05-08T21:20:42.762861+0000","last_became_active":"2024-05-08T21:10:07.770017+0000","last_became_peered":"2024-05-08T21:10:07.770017+0000","last_unstale":"2024-05-08T21:20:42.762861+0000","last_undegraded":"2024-05-08T21:20:42.762861+0000","last_fullsized":"2024-05-08T21:20:42.762861+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4151","last_scrub_stamp":"2024-05-08T21:20:42.762836+0000","last_deep_scrub":"32'4151","last_deep_scrub_stamp":"2024-05-08T21:20:42.762836+0000","last_clean_scrub_stamp":"2024-05-08T21:20:42.762836+0000","objects_scrubbed":0,"log_size":4151,"log_dups_size":0,"ondisk_log_size":4151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:18:15.433901+0000","scrub_duration":0.058435639999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":0,"num_write":52838,"num_write_kb":674205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"32'18","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:28.459122+0000","last_change":"2024-05-08T21:20:28.459218+0000","last_active":"2024-05-08T21:20:28.459122+0000","last_peered":"2024-05-08T21:20:28.459122+0000","last_clean":"2024-05-08T21:20:28.459122+0000","last_became_active":"2024-05-08T21:10:03.338917+0000","last_became_peered":"2024-05-08T21:10:03.338917+0000","last_unstale":"2024-05-08T21:20:28.459122+0000","last_undegraded":"2024-05-08T21:20:28.459122+0000","last_fullsized":"2024-05-08T21:20:28.459122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-05-08T21:20:28.459097+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-05-08T21:20:28.459097+0000","last_clean_scrub_stamp":"2024-05-08T21:20:28.459097+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:49:40.671717+0000","scrub_duration":0.0027695089999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":8,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"32'8","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:23.306798+0000","last_change":"2024-05-08T21:20:23.306798+0000","last_active":"2024-05-08T21:20:23.306798+0000","last_peered":"2024-05-08T21:20:23.306798+0000","last_clean":"2024-05-08T21:20:23.306798+0000","last_became_active":"2024-05-08T21:10:53.476785+0000","last_became_peered":"2024-05-08T21:10:53.476785+0000","last_unstale":"2024-05-08T21:20:23.306798+0000","last_undegraded":"2024-05-08T21:20:23.306798+0000","last_fullsized":"2024-05-08T21:20:23.306798+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-08T21:20:23.306692+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-08T21:20:23.306692+0000","last_clean_scrub_stamp":"2024-05-08T21:20:23.306692+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:49:09.865482+0000","scrub_duration":0.0019960160000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"32'3545","reported_seq":3623,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:29.806106+0000","last_change":"2024-05-08T21:20:29.806325+0000","last_active":"2024-05-08T21:20:29.806106+0000","last_peered":"2024-05-08T21:20:29.806106+0000","last_clean":"2024-05-08T21:20:29.806106+0000","last_became_active":"2024-05-08T21:10:07.775998+0000","last_became_peered":"2024-05-08T21:10:07.775998+0000","last_unstale":"2024-05-08T21:20:29.806106+0000","last_undegraded":"2024-05-08T21:20:29.806106+0000","last_fullsized":"2024-05-08T21:20:29.806106+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3545","last_scrub_stamp":"2024-05-08T21:20:29.806063+0000","last_deep_scrub":"32'3545","last_deep_scrub_stamp":"2024-05-08T21:20:29.806063+0000","last_clean_scrub_stamp":"2024-05-08T21:20:29.806063+0000","objects_scrubbed":0,"log_size":3545,"log_dups_size":0,"ondisk_log_size":3545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:59:45.176945+0000","scrub_duration":0.066639699999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":0,"num_write":46338,"num_write_kb":599175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"32'7","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:19.435435+0000","last_change":"2024-05-08T21:20:19.435545+0000","last_active":"2024-05-08T21:20:19.435435+0000","last_peered":"2024-05-08T21:20:19.435435+0000","last_clean":"2024-05-08T21:20:19.435435+0000","last_became_active":"2024-05-08T21:10:03.338899+0000","last_became_peered":"2024-05-08T21:10:03.338899+0000","last_unstale":"2024-05-08T21:20:19.435435+0000","last_undegraded":"2024-05-08T21:20:19.435435+0000","last_fullsized":"2024-05-08T21:20:19.435435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-05-08T21:20:19.435410+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-05-08T21:20:19.435410+0000","last_clean_scrub_stamp":"2024-05-08T21:20:19.435410+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:57:17.240045+0000","scrub_duration":0.0026800080000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"32'14","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:29.310868+0000","last_change":"2024-05-08T21:20:29.310991+0000","last_active":"2024-05-08T21:20:29.310868+0000","last_peered":"2024-05-08T21:20:29.310868+0000","last_clean":"2024-05-08T21:20:29.310868+0000","last_became_active":"2024-05-08T21:10:03.750371+0000","last_became_peered":"2024-05-08T21:10:03.750371+0000","last_unstale":"2024-05-08T21:20:29.310868+0000","last_undegraded":"2024-05-08T21:20:29.310868+0000","last_fullsized":"2024-05-08T21:20:29.310868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-05-08T21:20:29.310842+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-05-08T21:20:29.310842+0000","last_clean_scrub_stamp":"2024-05-08T21:20:29.310842+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:32:04.261463+0000","scrub_duration":0.0055974880000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"32'4480","reported_seq":4580,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:30.968240+0000","last_change":"2024-05-08T21:20:30.968368+0000","last_active":"2024-05-08T21:20:30.968240+0000","last_peered":"2024-05-08T21:20:30.968240+0000","last_clean":"2024-05-08T21:20:30.968240+0000","last_became_active":"2024-05-08T21:10:07.767234+0000","last_became_peered":"2024-05-08T21:10:07.767234+0000","last_unstale":"2024-05-08T21:20:30.968240+0000","last_undegraded":"2024-05-08T21:20:30.968240+0000","last_fullsized":"2024-05-08T21:20:30.968240+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4480","last_scrub_stamp":"2024-05-08T21:20:30.968208+0000","last_deep_scrub":"32'4480","last_deep_scrub_stamp":"2024-05-08T21:20:30.968208+0000","last_clean_scrub_stamp":"2024-05-08T21:20:30.968208+0000","objects_scrubbed":0,"log_size":4480,"log_dups_size":0,"ondisk_log_size":4480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:44:44.789711+0000","scrub_duration":0.040809031000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":0,"num_write":57901,"num_write_kb":753617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"32'1296","reported_seq":1337,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:09.764169+0000","last_change":"2024-05-08T21:20:09.764290+0000","last_active":"2024-05-08T21:20:09.764169+0000","last_peered":"2024-05-08T21:20:09.764169+0000","last_clean":"2024-05-08T21:20:09.764169+0000","last_became_active":"2024-05-08T21:10:03.337860+0000","last_became_peered":"2024-05-08T21:10:03.337860+0000","last_unstale":"2024-05-08T21:20:09.764169+0000","last_undegraded":"2024-05-08T21:20:09.764169+0000","last_fullsized":"2024-05-08T21:20:09.764169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'1296","last_scrub_stamp":"2024-05-08T21:20:09.764127+0000","last_deep_scrub":"32'1296","last_deep_scrub_stamp":"2024-05-08T21:20:09.764127+0000","last_clean_scrub_stamp":"2024-05-08T21:20:09.764127+0000","objects_scrubbed":1,"log_size":1296,"log_dups_size":0,"ondisk_log_size":1296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:11:05.072292+0000","scrub_duration":0.015328803,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":1290,"num_write_kb":5292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"32'12","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:58.476141+0000","last_change":"2024-05-08T21:19:58.476141+0000","last_active":"2024-05-08T21:19:58.476141+0000","last_peered":"2024-05-08T21:19:58.476141+0000","last_clean":"2024-05-08T21:19:58.476141+0000","last_became_active":"2024-05-08T21:10:03.743227+0000","last_became_peered":"2024-05-08T21:10:03.743227+0000","last_unstale":"2024-05-08T21:19:58.476141+0000","last_undegraded":"2024-05-08T21:19:58.476141+0000","last_fullsized":"2024-05-08T21:19:58.476141+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-08T21:19:58.475998+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-08T21:19:58.475998+0000","last_clean_scrub_stamp":"2024-05-08T21:19:58.475998+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:35:21.268713+0000","scrub_duration":0.001760143,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"32'3361","reported_seq":3437,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:18.422658+0000","last_change":"2024-05-08T21:20:18.422829+0000","last_active":"2024-05-08T21:20:18.422658+0000","last_peered":"2024-05-08T21:20:18.422658+0000","last_clean":"2024-05-08T21:20:18.422658+0000","last_became_active":"2024-05-08T21:10:07.768160+0000","last_became_peered":"2024-05-08T21:10:07.768160+0000","last_unstale":"2024-05-08T21:20:18.422658+0000","last_undegraded":"2024-05-08T21:20:18.422658+0000","last_fullsized":"2024-05-08T21:20:18.422658+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3361","last_scrub_stamp":"2024-05-08T21:20:18.422615+0000","last_deep_scrub":"32'3361","last_deep_scrub_stamp":"2024-05-08T21:20:18.422615+0000","last_clean_scrub_stamp":"2024-05-08T21:20:18.422615+0000","objects_scrubbed":0,"log_size":3361,"log_dups_size":0,"ondisk_log_size":3361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:49:37.582528+0000","scrub_duration":0.058164241999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":0,"num_write":43355,"num_write_kb":562121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"32'9","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:02.828459+0000","last_change":"2024-05-08T21:20:02.828565+0000","last_active":"2024-05-08T21:20:02.828459+0000","last_peered":"2024-05-08T21:20:02.828459+0000","last_clean":"2024-05-08T21:20:02.828459+0000","last_became_active":"2024-05-08T21:10:03.332844+0000","last_became_peered":"2024-05-08T21:10:03.332844+0000","last_unstale":"2024-05-08T21:20:02.828459+0000","last_undegraded":"2024-05-08T21:20:02.828459+0000","last_fullsized":"2024-05-08T21:20:02.828459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-05-08T21:20:02.828433+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-05-08T21:20:02.828433+0000","last_clean_scrub_stamp":"2024-05-08T21:20:02.828433+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:53:55.069397+0000","scrub_duration":0.001788127,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"32'12","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:11.631350+0000","last_change":"2024-05-08T21:20:11.631446+0000","last_active":"2024-05-08T21:20:11.631350+0000","last_peered":"2024-05-08T21:20:11.631350+0000","last_clean":"2024-05-08T21:20:11.631350+0000","last_became_active":"2024-05-08T21:10:03.742753+0000","last_became_peered":"2024-05-08T21:10:03.742753+0000","last_unstale":"2024-05-08T21:20:11.631350+0000","last_undegraded":"2024-05-08T21:20:11.631350+0000","last_fullsized":"2024-05-08T21:20:11.631350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-08T21:20:11.631327+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-08T21:20:11.631327+0000","last_clean_scrub_stamp":"2024-05-08T21:20:11.631327+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:50:05.535730+0000","scrub_duration":0.01930291,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4240","reported_seq":4346,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:37.124710+0000","last_change":"2024-05-08T21:20:37.124856+0000","last_active":"2024-05-08T21:20:37.124710+0000","last_peered":"2024-05-08T21:20:37.124710+0000","last_clean":"2024-05-08T21:20:37.124710+0000","last_became_active":"2024-05-08T21:10:07.769668+0000","last_became_peered":"2024-05-08T21:10:07.769668+0000","last_unstale":"2024-05-08T21:20:37.124710+0000","last_undegraded":"2024-05-08T21:20:37.124710+0000","last_fullsized":"2024-05-08T21:20:37.124710+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4240","last_scrub_stamp":"2024-05-08T21:20:37.124685+0000","last_deep_scrub":"32'4240","last_deep_scrub_stamp":"2024-05-08T21:20:37.124685+0000","last_clean_scrub_stamp":"2024-05-08T21:20:37.124685+0000","objects_scrubbed":0,"log_size":4240,"log_dups_size":0,"ondisk_log_size":4240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:23:21.827760+0000","scrub_duration":0.054205101999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":0,"num_write":54954,"num_write_kb":711961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"32'4","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:03.662340+0000","last_change":"2024-05-08T21:20:03.662462+0000","last_active":"2024-05-08T21:20:03.662340+0000","last_peered":"2024-05-08T21:20:03.662340+0000","last_clean":"2024-05-08T21:20:03.662340+0000","last_became_active":"2024-05-08T21:10:03.332750+0000","last_became_peered":"2024-05-08T21:10:03.332750+0000","last_unstale":"2024-05-08T21:20:03.662340+0000","last_undegraded":"2024-05-08T21:20:03.662340+0000","last_fullsized":"2024-05-08T21:20:03.662340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T21:20:03.662300+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T21:20:03.662300+0000","last_clean_scrub_stamp":"2024-05-08T21:20:03.662300+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:38:24.800703+0000","scrub_duration":0.001741189,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'19","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:01.739268+0000","last_change":"2024-05-08T21:20:01.739343+0000","last_active":"2024-05-08T21:20:01.739268+0000","last_peered":"2024-05-08T21:20:01.739268+0000","last_clean":"2024-05-08T21:20:01.739268+0000","last_became_active":"2024-05-08T21:10:03.743724+0000","last_became_peered":"2024-05-08T21:10:03.743724+0000","last_unstale":"2024-05-08T21:20:01.739268+0000","last_undegraded":"2024-05-08T21:20:01.739268+0000","last_fullsized":"2024-05-08T21:20:01.739268+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'19","last_scrub_stamp":"2024-05-08T21:20:01.739244+0000","last_deep_scrub":"32'19","last_deep_scrub_stamp":"2024-05-08T21:20:01.739244+0000","last_clean_scrub_stamp":"2024-05-08T21:20:01.739244+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:24:59.758236+0000","scrub_duration":0.0011762560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"32'4835","reported_seq":4942,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:38.574352+0000","last_change":"2024-05-08T21:20:38.574503+0000","last_active":"2024-05-08T21:20:38.574352+0000","last_peered":"2024-05-08T21:20:38.574352+0000","last_clean":"2024-05-08T21:20:38.574352+0000","last_became_active":"2024-05-08T21:10:08.051924+0000","last_became_peered":"2024-05-08T21:10:08.051924+0000","last_unstale":"2024-05-08T21:20:38.574352+0000","last_undegraded":"2024-05-08T21:20:38.574352+0000","last_fullsized":"2024-05-08T21:20:38.574352+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4835","last_scrub_stamp":"2024-05-08T21:20:38.574318+0000","last_deep_scrub":"32'4835","last_deep_scrub_stamp":"2024-05-08T21:20:38.574318+0000","last_clean_scrub_stamp":"2024-05-08T21:20:38.574318+0000","objects_scrubbed":0,"log_size":4835,"log_dups_size":0,"ondisk_log_size":4835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:13:06.016072+0000","scrub_duration":0.048566524,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":0,"num_write":62640,"num_write_kb":808641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:13.384814+0000","last_change":"2024-05-08T21:20:13.384926+0000","last_active":"2024-05-08T21:20:13.384814+0000","last_peered":"2024-05-08T21:20:13.384814+0000","last_clean":"2024-05-08T21:20:13.384814+0000","last_became_active":"2024-05-08T21:10:03.330054+0000","last_became_peered":"2024-05-08T21:10:03.330054+0000","last_unstale":"2024-05-08T21:20:13.384814+0000","last_undegraded":"2024-05-08T21:20:13.384814+0000","last_fullsized":"2024-05-08T21:20:13.384814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:20:13.384790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:20:13.384790+0000","last_clean_scrub_stamp":"2024-05-08T21:20:13.384790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:47:44.021224+0000","scrub_duration":0.0013472479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"32'9","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:00.300968+0000","last_change":"2024-05-08T21:20:00.301081+0000","last_active":"2024-05-08T21:20:00.300968+0000","last_peered":"2024-05-08T21:20:00.300968+0000","last_clean":"2024-05-08T21:20:00.300968+0000","last_became_active":"2024-05-08T21:10:03.739425+0000","last_became_peered":"2024-05-08T21:10:03.739425+0000","last_unstale":"2024-05-08T21:20:00.300968+0000","last_undegraded":"2024-05-08T21:20:00.300968+0000","last_fullsized":"2024-05-08T21:20:00.300968+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-05-08T21:20:00.300945+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-05-08T21:20:00.300945+0000","last_clean_scrub_stamp":"2024-05-08T21:20:00.300945+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:19:46.530428+0000","scrub_duration":0.0052140820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"32'4216","reported_seq":4308,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:35.953759+0000","last_change":"2024-05-08T21:20:35.953900+0000","last_active":"2024-05-08T21:20:35.953759+0000","last_peered":"2024-05-08T21:20:35.953759+0000","last_clean":"2024-05-08T21:20:35.953759+0000","last_became_active":"2024-05-08T21:10:08.050625+0000","last_became_peered":"2024-05-08T21:10:08.050625+0000","last_unstale":"2024-05-08T21:20:35.953759+0000","last_undegraded":"2024-05-08T21:20:35.953759+0000","last_fullsized":"2024-05-08T21:20:35.953759+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4216","last_scrub_stamp":"2024-05-08T21:20:35.953735+0000","last_deep_scrub":"32'4216","last_deep_scrub_stamp":"2024-05-08T21:20:35.953735+0000","last_clean_scrub_stamp":"2024-05-08T21:20:35.953735+0000","objects_scrubbed":0,"log_size":4216,"log_dups_size":0,"ondisk_log_size":4216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:38:24.206464+0000","scrub_duration":0.038268776999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":0,"num_write":54049,"num_write_kb":693342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"32'4","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:12.887724+0000","last_change":"2024-05-08T21:20:12.887825+0000","last_active":"2024-05-08T21:20:12.887724+0000","last_peered":"2024-05-08T21:20:12.887724+0000","last_clean":"2024-05-08T21:20:12.887724+0000","last_became_active":"2024-05-08T21:10:03.330973+0000","last_became_peered":"2024-05-08T21:10:03.330973+0000","last_unstale":"2024-05-08T21:20:12.887724+0000","last_undegraded":"2024-05-08T21:20:12.887724+0000","last_fullsized":"2024-05-08T21:20:12.887724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T21:20:12.887700+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T21:20:12.887700+0000","last_clean_scrub_stamp":"2024-05-08T21:20:12.887700+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:59:10.235660+0000","scrub_duration":0.0015778560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"32'15","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:26.347454+0000","last_change":"2024-05-08T21:20:26.347563+0000","last_active":"2024-05-08T21:20:26.347454+0000","last_peered":"2024-05-08T21:20:26.347454+0000","last_clean":"2024-05-08T21:20:26.347454+0000","last_became_active":"2024-05-08T21:10:03.751426+0000","last_became_peered":"2024-05-08T21:10:03.751426+0000","last_unstale":"2024-05-08T21:20:26.347454+0000","last_undegraded":"2024-05-08T21:20:26.347454+0000","last_fullsized":"2024-05-08T21:20:26.347454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-05-08T21:20:26.347426+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-05-08T21:20:26.347426+0000","last_clean_scrub_stamp":"2024-05-08T21:20:26.347426+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:56:03.545269+0000","scrub_duration":0.0057080960000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"32'4067","reported_seq":4172,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:53.139189+0000","last_change":"2024-05-08T21:20:53.139350+0000","last_active":"2024-05-08T21:20:53.139189+0000","last_peered":"2024-05-08T21:20:53.139189+0000","last_clean":"2024-05-08T21:20:53.139189+0000","last_became_active":"2024-05-08T21:10:53.484313+0000","last_became_peered":"2024-05-08T21:10:53.484313+0000","last_unstale":"2024-05-08T21:20:53.139189+0000","last_undegraded":"2024-05-08T21:20:53.139189+0000","last_fullsized":"2024-05-08T21:20:53.139189+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4067","last_scrub_stamp":"2024-05-08T21:20:53.139162+0000","last_deep_scrub":"32'4067","last_deep_scrub_stamp":"2024-05-08T21:20:53.139162+0000","last_clean_scrub_stamp":"2024-05-08T21:20:53.139162+0000","objects_scrubbed":0,"log_size":4067,"log_dups_size":0,"ondisk_log_size":4067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:48:53.347881+0000","scrub_duration":0.035835101000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":0,"num_write":52779,"num_write_kb":673924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"32'3","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:01.367256+0000","last_change":"2024-05-08T21:20:01.367399+0000","last_active":"2024-05-08T21:20:01.367256+0000","last_peered":"2024-05-08T21:20:01.367256+0000","last_clean":"2024-05-08T21:20:01.367256+0000","last_became_active":"2024-05-08T21:10:03.331712+0000","last_became_peered":"2024-05-08T21:10:03.331712+0000","last_unstale":"2024-05-08T21:20:01.367256+0000","last_undegraded":"2024-05-08T21:20:01.367256+0000","last_fullsized":"2024-05-08T21:20:01.367256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-05-08T21:20:01.367207+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-05-08T21:20:01.367207+0000","last_clean_scrub_stamp":"2024-05-08T21:20:01.367207+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:44:21.231895+0000","scrub_duration":0.001703927,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"32'15","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:18.637130+0000","last_change":"2024-05-08T21:20:18.637253+0000","last_active":"2024-05-08T21:20:18.637130+0000","last_peered":"2024-05-08T21:20:18.637130+0000","last_clean":"2024-05-08T21:20:18.637130+0000","last_became_active":"2024-05-08T21:10:03.748315+0000","last_became_peered":"2024-05-08T21:10:03.748315+0000","last_unstale":"2024-05-08T21:20:18.637130+0000","last_undegraded":"2024-05-08T21:20:18.637130+0000","last_fullsized":"2024-05-08T21:20:18.637130+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-05-08T21:20:18.637109+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-05-08T21:20:18.637109+0000","last_clean_scrub_stamp":"2024-05-08T21:20:18.637109+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:32:12.691075+0000","scrub_duration":0.016542603999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"32'4209","reported_seq":4300,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:32.797200+0000","last_change":"2024-05-08T21:20:32.797364+0000","last_active":"2024-05-08T21:20:32.797200+0000","last_peered":"2024-05-08T21:20:32.797200+0000","last_clean":"2024-05-08T21:20:32.797200+0000","last_became_active":"2024-05-08T21:10:07.761129+0000","last_became_peered":"2024-05-08T21:10:07.761129+0000","last_unstale":"2024-05-08T21:20:32.797200+0000","last_undegraded":"2024-05-08T21:20:32.797200+0000","last_fullsized":"2024-05-08T21:20:32.797200+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4209","last_scrub_stamp":"2024-05-08T21:20:32.797173+0000","last_deep_scrub":"32'4209","last_deep_scrub_stamp":"2024-05-08T21:20:32.797173+0000","last_clean_scrub_stamp":"2024-05-08T21:20:32.797173+0000","objects_scrubbed":0,"log_size":4209,"log_dups_size":0,"ondisk_log_size":4209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:00:45.112532+0000","scrub_duration":0.054341675999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":0,"num_write":55217,"num_write_kb":706687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"32'19","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:13.143038+0000","last_change":"2024-05-08T21:20:13.143152+0000","last_active":"2024-05-08T21:20:13.143038+0000","last_peered":"2024-05-08T21:20:13.143038+0000","last_clean":"2024-05-08T21:20:13.143038+0000","last_became_active":"2024-05-08T21:10:03.332796+0000","last_became_peered":"2024-05-08T21:10:03.332796+0000","last_unstale":"2024-05-08T21:20:13.143038+0000","last_undegraded":"2024-05-08T21:20:13.143038+0000","last_fullsized":"2024-05-08T21:20:13.143038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'19","last_scrub_stamp":"2024-05-08T21:20:13.143014+0000","last_deep_scrub":"32'19","last_deep_scrub_stamp":"2024-05-08T21:20:13.143014+0000","last_clean_scrub_stamp":"2024-05-08T21:20:13.143014+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:05:21.634577+0000","scrub_duration":0.0039298390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":19,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"32'12","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:00.530549+0000","last_change":"2024-05-08T21:20:00.530656+0000","last_active":"2024-05-08T21:20:00.530549+0000","last_peered":"2024-05-08T21:20:00.530549+0000","last_clean":"2024-05-08T21:20:00.530549+0000","last_became_active":"2024-05-08T21:10:03.750394+0000","last_became_peered":"2024-05-08T21:10:03.750394+0000","last_unstale":"2024-05-08T21:20:00.530549+0000","last_undegraded":"2024-05-08T21:20:00.530549+0000","last_fullsized":"2024-05-08T21:20:00.530549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-08T21:20:00.530522+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-08T21:20:00.530522+0000","last_clean_scrub_stamp":"2024-05-08T21:20:00.530522+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:15:24.920108+0000","scrub_duration":0.0015651160000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"32'3898","reported_seq":3974,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:42.483117+0000","last_change":"2024-05-08T21:20:42.483255+0000","last_active":"2024-05-08T21:20:42.483117+0000","last_peered":"2024-05-08T21:20:42.483117+0000","last_clean":"2024-05-08T21:20:42.483117+0000","last_became_active":"2024-05-08T21:10:07.763591+0000","last_became_peered":"2024-05-08T21:10:07.763591+0000","last_unstale":"2024-05-08T21:20:42.483117+0000","last_undegraded":"2024-05-08T21:20:42.483117+0000","last_fullsized":"2024-05-08T21:20:42.483117+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3898","last_scrub_stamp":"2024-05-08T21:20:42.483090+0000","last_deep_scrub":"32'3898","last_deep_scrub_stamp":"2024-05-08T21:20:42.483090+0000","last_clean_scrub_stamp":"2024-05-08T21:20:42.483090+0000","objects_scrubbed":0,"log_size":3898,"log_dups_size":0,"ondisk_log_size":3898,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:07:08.477327+0000","scrub_duration":0.054025381999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":0,"num_write":50159,"num_write_kb":657283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"32'224","reported_seq":281,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:11.871388+0000","last_change":"2024-05-08T21:20:11.871495+0000","last_active":"2024-05-08T21:20:11.871388+0000","last_peered":"2024-05-08T21:20:11.871388+0000","last_clean":"2024-05-08T21:20:11.871388+0000","last_became_active":"2024-05-08T21:10:03.342202+0000","last_became_peered":"2024-05-08T21:10:03.342202+0000","last_unstale":"2024-05-08T21:20:11.871388+0000","last_undegraded":"2024-05-08T21:20:11.871388+0000","last_fullsized":"2024-05-08T21:20:11.871388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'224","last_scrub_stamp":"2024-05-08T21:20:11.871363+0000","last_deep_scrub":"32'224","last_deep_scrub_stamp":"2024-05-08T21:20:11.871363+0000","last_clean_scrub_stamp":"2024-05-08T21:20:11.871363+0000","objects_scrubbed":4,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:39:13.408501+0000","scrub_duration":0.016953936999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":37,"num_read_kb":12328,"num_write":219,"num_write_kb":4276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"32'12","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:48.547270+0000","last_change":"2024-05-08T21:20:48.547390+0000","last_active":"2024-05-08T21:20:48.547270+0000","last_peered":"2024-05-08T21:20:48.547270+0000","last_clean":"2024-05-08T21:20:48.547270+0000","last_became_active":"2024-05-08T21:10:03.751868+0000","last_became_peered":"2024-05-08T21:10:03.751868+0000","last_unstale":"2024-05-08T21:20:48.547270+0000","last_undegraded":"2024-05-08T21:20:48.547270+0000","last_fullsized":"2024-05-08T21:20:48.547270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-08T21:20:48.547245+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-08T21:20:48.547245+0000","last_clean_scrub_stamp":"2024-05-08T21:20:48.547245+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:03:10.791777+0000","scrub_duration":0.0032574399999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"32'3951","reported_seq":4037,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:50.348436+0000","last_change":"2024-05-08T21:20:50.348626+0000","last_active":"2024-05-08T21:20:50.348436+0000","last_peered":"2024-05-08T21:20:50.348436+0000","last_clean":"2024-05-08T21:20:50.348436+0000","last_became_active":"2024-05-08T21:10:08.051967+0000","last_became_peered":"2024-05-08T21:10:08.051967+0000","last_unstale":"2024-05-08T21:20:50.348436+0000","last_undegraded":"2024-05-08T21:20:50.348436+0000","last_fullsized":"2024-05-08T21:20:50.348436+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3951","last_scrub_stamp":"2024-05-08T21:20:50.348407+0000","last_deep_scrub":"32'3951","last_deep_scrub_stamp":"2024-05-08T21:20:50.348407+0000","last_clean_scrub_stamp":"2024-05-08T21:20:50.348407+0000","objects_scrubbed":0,"log_size":3951,"log_dups_size":0,"ondisk_log_size":3951,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:44:04.475116+0000","scrub_duration":0.03281444,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":0,"num_write":50192,"num_write_kb":654171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"32'9","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:01.515901+0000","last_change":"2024-05-08T21:20:01.515989+0000","last_active":"2024-05-08T21:20:01.515901+0000","last_peered":"2024-05-08T21:20:01.515901+0000","last_clean":"2024-05-08T21:20:01.515901+0000","last_became_active":"2024-05-08T21:10:03.329761+0000","last_became_peered":"2024-05-08T21:10:03.329761+0000","last_unstale":"2024-05-08T21:20:01.515901+0000","last_undegraded":"2024-05-08T21:20:01.515901+0000","last_fullsized":"2024-05-08T21:20:01.515901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-05-08T21:20:01.515879+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-05-08T21:20:01.515879+0000","last_clean_scrub_stamp":"2024-05-08T21:20:01.515879+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:10:12.952423+0000","scrub_duration":0.0051169010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":32,"num_write":6,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"32'15","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:04.584821+0000","last_change":"2024-05-08T21:20:04.584918+0000","last_active":"2024-05-08T21:20:04.584821+0000","last_peered":"2024-05-08T21:20:04.584821+0000","last_clean":"2024-05-08T21:20:04.584821+0000","last_became_active":"2024-05-08T21:10:03.749094+0000","last_became_peered":"2024-05-08T21:10:03.749094+0000","last_unstale":"2024-05-08T21:20:04.584821+0000","last_undegraded":"2024-05-08T21:20:04.584821+0000","last_fullsized":"2024-05-08T21:20:04.584821+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-05-08T21:20:04.584798+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-05-08T21:20:04.584798+0000","last_clean_scrub_stamp":"2024-05-08T21:20:04.584798+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:15:08.630447+0000","scrub_duration":0.001938178,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"32'4387","reported_seq":4476,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:49.082222+0000","last_change":"2024-05-08T21:20:49.082400+0000","last_active":"2024-05-08T21:20:49.082222+0000","last_peered":"2024-05-08T21:20:49.082222+0000","last_clean":"2024-05-08T21:20:49.082222+0000","last_became_active":"2024-05-08T21:10:08.047505+0000","last_became_peered":"2024-05-08T21:10:08.047505+0000","last_unstale":"2024-05-08T21:20:49.082222+0000","last_undegraded":"2024-05-08T21:20:49.082222+0000","last_fullsized":"2024-05-08T21:20:49.082222+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4387","last_scrub_stamp":"2024-05-08T21:20:49.082183+0000","last_deep_scrub":"32'4387","last_deep_scrub_stamp":"2024-05-08T21:20:49.082183+0000","last_clean_scrub_stamp":"2024-05-08T21:20:49.082183+0000","objects_scrubbed":0,"log_size":4387,"log_dups_size":0,"ondisk_log_size":4387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:05:20.732116+0000","scrub_duration":0.031402432000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":0,"num_write":56798,"num_write_kb":743616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"32'3","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:20.381474+0000","last_change":"2024-05-08T21:20:20.381603+0000","last_active":"2024-05-08T21:20:20.381474+0000","last_peered":"2024-05-08T21:20:20.381474+0000","last_clean":"2024-05-08T21:20:20.381474+0000","last_became_active":"2024-05-08T21:10:03.327648+0000","last_became_peered":"2024-05-08T21:10:03.327648+0000","last_unstale":"2024-05-08T21:20:20.381474+0000","last_undegraded":"2024-05-08T21:20:20.381474+0000","last_fullsized":"2024-05-08T21:20:20.381474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-05-08T21:20:20.381447+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-05-08T21:20:20.381447+0000","last_clean_scrub_stamp":"2024-05-08T21:20:20.381447+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:55.203011+0000","scrub_duration":0.0016764729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"32'15","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:36.514362+0000","last_change":"2024-05-08T21:20:36.514448+0000","last_active":"2024-05-08T21:20:36.514362+0000","last_peered":"2024-05-08T21:20:36.514362+0000","last_clean":"2024-05-08T21:20:36.514362+0000","last_became_active":"2024-05-08T21:10:03.750294+0000","last_became_peered":"2024-05-08T21:10:03.750294+0000","last_unstale":"2024-05-08T21:20:36.514362+0000","last_undegraded":"2024-05-08T21:20:36.514362+0000","last_fullsized":"2024-05-08T21:20:36.514362+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-05-08T21:20:36.514340+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-05-08T21:20:36.514340+0000","last_clean_scrub_stamp":"2024-05-08T21:20:36.514340+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:54:52.724531+0000","scrub_duration":0.001382033,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"32'4344","reported_seq":4428,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:51.080058+0000","last_change":"2024-05-08T21:20:51.080218+0000","last_active":"2024-05-08T21:20:51.080058+0000","last_peered":"2024-05-08T21:20:51.080058+0000","last_clean":"2024-05-08T21:20:51.080058+0000","last_became_active":"2024-05-08T21:10:08.051920+0000","last_became_peered":"2024-05-08T21:10:08.051920+0000","last_unstale":"2024-05-08T21:20:51.080058+0000","last_undegraded":"2024-05-08T21:20:51.080058+0000","last_fullsized":"2024-05-08T21:20:51.080058+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4344","last_scrub_stamp":"2024-05-08T21:20:51.080032+0000","last_deep_scrub":"32'4344","last_deep_scrub_stamp":"2024-05-08T21:20:51.080032+0000","last_clean_scrub_stamp":"2024-05-08T21:20:51.080032+0000","objects_scrubbed":0,"log_size":4344,"log_dups_size":0,"ondisk_log_size":4344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:33:08.718366+0000","scrub_duration":0.026782648999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":0,"num_write":56474,"num_write_kb":728506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"32'7","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:58.846319+0000","last_change":"2024-05-08T21:19:58.846430+0000","last_active":"2024-05-08T21:19:58.846319+0000","last_peered":"2024-05-08T21:19:58.846319+0000","last_clean":"2024-05-08T21:19:58.846319+0000","last_became_active":"2024-05-08T21:10:03.332105+0000","last_became_peered":"2024-05-08T21:10:03.332105+0000","last_unstale":"2024-05-08T21:19:58.846319+0000","last_undegraded":"2024-05-08T21:19:58.846319+0000","last_fullsized":"2024-05-08T21:19:58.846319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-05-08T21:19:58.846289+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-05-08T21:19:58.846289+0000","last_clean_scrub_stamp":"2024-05-08T21:19:58.846289+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:14:20.957954+0000","scrub_duration":0.0015942689999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"32'9","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:14.932737+0000","last_change":"2024-05-08T21:20:14.932841+0000","last_active":"2024-05-08T21:20:14.932737+0000","last_peered":"2024-05-08T21:20:14.932737+0000","last_clean":"2024-05-08T21:20:14.932737+0000","last_became_active":"2024-05-08T21:10:03.741742+0000","last_became_peered":"2024-05-08T21:10:03.741742+0000","last_unstale":"2024-05-08T21:20:14.932737+0000","last_undegraded":"2024-05-08T21:20:14.932737+0000","last_fullsized":"2024-05-08T21:20:14.932737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-05-08T21:20:14.932711+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-05-08T21:20:14.932711+0000","last_clean_scrub_stamp":"2024-05-08T21:20:14.932711+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:33.264529+0000","scrub_duration":0.00178802,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"32'4473","reported_seq":4575,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:48.619397+0000","last_change":"2024-05-08T21:20:48.619531+0000","last_active":"2024-05-08T21:20:48.619397+0000","last_peered":"2024-05-08T21:20:48.619397+0000","last_clean":"2024-05-08T21:20:48.619397+0000","last_became_active":"2024-05-08T21:10:07.769016+0000","last_became_peered":"2024-05-08T21:10:07.769016+0000","last_unstale":"2024-05-08T21:20:48.619397+0000","last_undegraded":"2024-05-08T21:20:48.619397+0000","last_fullsized":"2024-05-08T21:20:48.619397+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4473","last_scrub_stamp":"2024-05-08T21:20:48.619370+0000","last_deep_scrub":"32'4473","last_deep_scrub_stamp":"2024-05-08T21:20:48.619370+0000","last_clean_scrub_stamp":"2024-05-08T21:20:48.619370+0000","objects_scrubbed":0,"log_size":4473,"log_dups_size":0,"ondisk_log_size":4473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:35:02.729690+0000","scrub_duration":0.041725443000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":0,"num_write":57758,"num_write_kb":734684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"32'20","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:58.371047+0000","last_change":"2024-05-08T21:19:58.371123+0000","last_active":"2024-05-08T21:19:58.371047+0000","last_peered":"2024-05-08T21:19:58.371047+0000","last_clean":"2024-05-08T21:19:58.371047+0000","last_became_active":"2024-05-08T21:10:03.331501+0000","last_became_peered":"2024-05-08T21:10:03.331501+0000","last_unstale":"2024-05-08T21:19:58.371047+0000","last_undegraded":"2024-05-08T21:19:58.371047+0000","last_fullsized":"2024-05-08T21:19:58.371047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-05-08T21:19:58.371025+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-05-08T21:19:58.371025+0000","last_clean_scrub_stamp":"2024-05-08T21:19:58.371025+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:14:53.459921+0000","scrub_duration":0.0044400510000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":69,"num_read_kb":69,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"32'12","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:00.652186+0000","last_change":"2024-05-08T21:20:00.652278+0000","last_active":"2024-05-08T21:20:00.652186+0000","last_peered":"2024-05-08T21:20:00.652186+0000","last_clean":"2024-05-08T21:20:00.652186+0000","last_became_active":"2024-05-08T21:10:03.743557+0000","last_became_peered":"2024-05-08T21:10:03.743557+0000","last_unstale":"2024-05-08T21:20:00.652186+0000","last_undegraded":"2024-05-08T21:20:00.652186+0000","last_fullsized":"2024-05-08T21:20:00.652186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-08T21:20:00.652163+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-08T21:20:00.652163+0000","last_clean_scrub_stamp":"2024-05-08T21:20:00.652163+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:38:06.051126+0000","scrub_duration":0.0014301730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"32'3690","reported_seq":3778,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:30.801002+0000","last_change":"2024-05-08T21:20:30.801159+0000","last_active":"2024-05-08T21:20:30.801002+0000","last_peered":"2024-05-08T21:20:30.801002+0000","last_clean":"2024-05-08T21:20:30.801002+0000","last_became_active":"2024-05-08T21:10:07.776858+0000","last_became_peered":"2024-05-08T21:10:07.776858+0000","last_unstale":"2024-05-08T21:20:30.801002+0000","last_undegraded":"2024-05-08T21:20:30.801002+0000","last_fullsized":"2024-05-08T21:20:30.801002+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3690","last_scrub_stamp":"2024-05-08T21:20:30.800976+0000","last_deep_scrub":"32'3690","last_deep_scrub_stamp":"2024-05-08T21:20:30.800976+0000","last_clean_scrub_stamp":"2024-05-08T21:20:30.800976+0000","objects_scrubbed":0,"log_size":3690,"log_dups_size":0,"ondisk_log_size":3690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:42:39.120505+0000","scrub_duration":0.049470954999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":0,"num_write":47426,"num_write_kb":636696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"32'5","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:57.493492+0000","last_change":"2024-05-08T21:19:57.493623+0000","last_active":"2024-05-08T21:19:57.493492+0000","last_peered":"2024-05-08T21:19:57.493492+0000","last_clean":"2024-05-08T21:19:57.493492+0000","last_became_active":"2024-05-08T21:10:03.326608+0000","last_became_peered":"2024-05-08T21:10:03.326608+0000","last_unstale":"2024-05-08T21:19:57.493492+0000","last_undegraded":"2024-05-08T21:19:57.493492+0000","last_fullsized":"2024-05-08T21:19:57.493492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-05-08T21:19:57.493449+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-05-08T21:19:57.493449+0000","last_clean_scrub_stamp":"2024-05-08T21:19:57.493449+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:45:21.237664+0000","scrub_duration":0.0035203579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"32'8","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:31.483523+0000","last_change":"2024-05-08T21:20:31.483639+0000","last_active":"2024-05-08T21:20:31.483523+0000","last_peered":"2024-05-08T21:20:31.483523+0000","last_clean":"2024-05-08T21:20:31.483523+0000","last_became_active":"2024-05-08T21:10:03.748915+0000","last_became_peered":"2024-05-08T21:10:03.748915+0000","last_unstale":"2024-05-08T21:20:31.483523+0000","last_undegraded":"2024-05-08T21:20:31.483523+0000","last_fullsized":"2024-05-08T21:20:31.483523+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-08T21:20:31.483498+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-08T21:20:31.483498+0000","last_clean_scrub_stamp":"2024-05-08T21:20:31.483498+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:51:04.907637+0000","scrub_duration":0.0019431190000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"32'4727","reported_seq":4833,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:36.479577+0000","last_change":"2024-05-08T21:20:36.479735+0000","last_active":"2024-05-08T21:20:36.479577+0000","last_peered":"2024-05-08T21:20:36.479577+0000","last_clean":"2024-05-08T21:20:36.479577+0000","last_became_active":"2024-05-08T21:10:07.759139+0000","last_became_peered":"2024-05-08T21:10:07.759139+0000","last_unstale":"2024-05-08T21:20:36.479577+0000","last_undegraded":"2024-05-08T21:20:36.479577+0000","last_fullsized":"2024-05-08T21:20:36.479577+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4727","last_scrub_stamp":"2024-05-08T21:20:36.479552+0000","last_deep_scrub":"32'4727","last_deep_scrub_stamp":"2024-05-08T21:20:36.479552+0000","last_clean_scrub_stamp":"2024-05-08T21:20:36.479552+0000","objects_scrubbed":0,"log_size":4727,"log_dups_size":0,"ondisk_log_size":4727,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:29:08.903262+0000","scrub_duration":0.080740626999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":0,"num_write":61813,"num_write_kb":787262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"32'3","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:02.232728+0000","last_change":"2024-05-08T21:20:02.232728+0000","last_active":"2024-05-08T21:20:02.232728+0000","last_peered":"2024-05-08T21:20:02.232728+0000","last_clean":"2024-05-08T21:20:02.232728+0000","last_became_active":"2024-05-08T21:10:03.328739+0000","last_became_peered":"2024-05-08T21:10:03.328739+0000","last_unstale":"2024-05-08T21:20:02.232728+0000","last_undegraded":"2024-05-08T21:20:02.232728+0000","last_fullsized":"2024-05-08T21:20:02.232728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-05-08T21:20:02.232628+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-05-08T21:20:02.232628+0000","last_clean_scrub_stamp":"2024-05-08T21:20:02.232628+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:38:36.143029+0000","scrub_duration":0.0012656970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"32'13","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:24.391884+0000","last_change":"2024-05-08T21:20:24.391884+0000","last_active":"2024-05-08T21:20:24.391884+0000","last_peered":"2024-05-08T21:20:24.391884+0000","last_clean":"2024-05-08T21:20:24.391884+0000","last_became_active":"2024-05-08T21:10:03.744398+0000","last_became_peered":"2024-05-08T21:10:03.744398+0000","last_unstale":"2024-05-08T21:20:24.391884+0000","last_undegraded":"2024-05-08T21:20:24.391884+0000","last_fullsized":"2024-05-08T21:20:24.391884+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'13","last_scrub_stamp":"2024-05-08T21:20:24.391718+0000","last_deep_scrub":"32'13","last_deep_scrub_stamp":"2024-05-08T21:20:24.391718+0000","last_clean_scrub_stamp":"2024-05-08T21:20:24.391718+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:25:45.031448+0000","scrub_duration":0.006309093,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"32'4127","reported_seq":4210,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:45.504515+0000","last_change":"2024-05-08T21:20:45.504650+0000","last_active":"2024-05-08T21:20:45.504515+0000","last_peered":"2024-05-08T21:20:45.504515+0000","last_clean":"2024-05-08T21:20:45.504515+0000","last_became_active":"2024-05-08T21:10:07.776080+0000","last_became_peered":"2024-05-08T21:10:07.776080+0000","last_unstale":"2024-05-08T21:20:45.504515+0000","last_undegraded":"2024-05-08T21:20:45.504515+0000","last_fullsized":"2024-05-08T21:20:45.504515+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4127","last_scrub_stamp":"2024-05-08T21:20:45.504489+0000","last_deep_scrub":"32'4127","last_deep_scrub_stamp":"2024-05-08T21:20:45.504489+0000","last_clean_scrub_stamp":"2024-05-08T21:20:45.504489+0000","objects_scrubbed":0,"log_size":4127,"log_dups_size":0,"ondisk_log_size":4127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:29:31.812745+0000","scrub_duration":0.053628268999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":0,"num_write":53759,"num_write_kb":696170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:07.460399+0000","last_change":"2024-05-08T21:20:07.460399+0000","last_active":"2024-05-08T21:20:07.460399+0000","last_peered":"2024-05-08T21:20:07.460399+0000","last_clean":"2024-05-08T21:20:07.460399+0000","last_became_active":"2024-05-08T21:10:03.332689+0000","last_became_peered":"2024-05-08T21:10:03.332689+0000","last_unstale":"2024-05-08T21:20:07.460399+0000","last_undegraded":"2024-05-08T21:20:07.460399+0000","last_fullsized":"2024-05-08T21:20:07.460399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T21:20:07.460272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T21:20:07.460272+0000","last_clean_scrub_stamp":"2024-05-08T21:20:07.460272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:12:13.310545+0000","scrub_duration":0.0015644680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"32'9","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:08.553854+0000","last_change":"2024-05-08T21:20:08.553854+0000","last_active":"2024-05-08T21:20:08.553854+0000","last_peered":"2024-05-08T21:20:08.553854+0000","last_clean":"2024-05-08T21:20:08.553854+0000","last_became_active":"2024-05-08T21:10:03.742744+0000","last_became_peered":"2024-05-08T21:10:03.742744+0000","last_unstale":"2024-05-08T21:20:08.553854+0000","last_undegraded":"2024-05-08T21:20:08.553854+0000","last_fullsized":"2024-05-08T21:20:08.553854+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-05-08T21:20:08.553723+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-05-08T21:20:08.553723+0000","last_clean_scrub_stamp":"2024-05-08T21:20:08.553723+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:45:32.459903+0000","scrub_duration":0.0072960309999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"32'4649","reported_seq":4752,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:46.460094+0000","last_change":"2024-05-08T21:20:46.460094+0000","last_active":"2024-05-08T21:20:46.460094+0000","last_peered":"2024-05-08T21:20:46.460094+0000","last_clean":"2024-05-08T21:20:46.460094+0000","last_became_active":"2024-05-08T21:10:07.776053+0000","last_became_peered":"2024-05-08T21:10:07.776053+0000","last_unstale":"2024-05-08T21:20:46.460094+0000","last_undegraded":"2024-05-08T21:20:46.460094+0000","last_fullsized":"2024-05-08T21:20:46.460094+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4649","last_scrub_stamp":"2024-05-08T21:20:46.459915+0000","last_deep_scrub":"32'4649","last_deep_scrub_stamp":"2024-05-08T21:20:46.459915+0000","last_clean_scrub_stamp":"2024-05-08T21:20:46.459915+0000","objects_scrubbed":0,"log_size":4649,"log_dups_size":0,"ondisk_log_size":4649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:56:41.722413+0000","scrub_duration":0.049517230000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":0,"num_write":59828,"num_write_kb":758247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"32'13","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:19.223993+0000","last_change":"2024-05-08T21:20:19.224100+0000","last_active":"2024-05-08T21:20:19.223993+0000","last_peered":"2024-05-08T21:20:19.223993+0000","last_clean":"2024-05-08T21:20:19.223993+0000","last_became_active":"2024-05-08T21:10:03.738000+0000","last_became_peered":"2024-05-08T21:10:03.738000+0000","last_unstale":"2024-05-08T21:20:19.223993+0000","last_undegraded":"2024-05-08T21:20:19.223993+0000","last_fullsized":"2024-05-08T21:20:19.223993+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'13","last_scrub_stamp":"2024-05-08T21:20:19.223951+0000","last_deep_scrub":"32'13","last_deep_scrub_stamp":"2024-05-08T21:20:19.223951+0000","last_clean_scrub_stamp":"2024-05-08T21:20:19.223951+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:02:44.875032+0000","scrub_duration":0.001459419,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"32'27","reported_seq":91,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:00.325080+0000","last_change":"2024-05-08T21:20:00.325080+0000","last_active":"2024-05-08T21:20:00.325080+0000","last_peered":"2024-05-08T21:20:00.325080+0000","last_clean":"2024-05-08T21:20:00.325080+0000","last_became_active":"2024-05-08T21:10:03.330842+0000","last_became_peered":"2024-05-08T21:10:03.330842+0000","last_unstale":"2024-05-08T21:20:00.325080+0000","last_undegraded":"2024-05-08T21:20:00.325080+0000","last_fullsized":"2024-05-08T21:20:00.325080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'27","last_scrub_stamp":"2024-05-08T21:20:00.324962+0000","last_deep_scrub":"32'27","last_deep_scrub_stamp":"2024-05-08T21:20:00.324962+0000","last_clean_scrub_stamp":"2024-05-08T21:20:00.324962+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:09:32.831083+0000","scrub_duration":0.021989438,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94059,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":26,"num_read_kb":107,"num_write":23,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"32'4123","reported_seq":4214,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:36.166698+0000","last_change":"2024-05-08T21:20:36.166698+0000","last_active":"2024-05-08T21:20:36.166698+0000","last_peered":"2024-05-08T21:20:36.166698+0000","last_clean":"2024-05-08T21:20:36.166698+0000","last_became_active":"2024-05-08T21:10:08.048763+0000","last_became_peered":"2024-05-08T21:10:08.048763+0000","last_unstale":"2024-05-08T21:20:36.166698+0000","last_undegraded":"2024-05-08T21:20:36.166698+0000","last_fullsized":"2024-05-08T21:20:36.166698+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4123","last_scrub_stamp":"2024-05-08T21:20:36.166461+0000","last_deep_scrub":"32'4123","last_deep_scrub_stamp":"2024-05-08T21:20:36.166461+0000","last_clean_scrub_stamp":"2024-05-08T21:20:36.166461+0000","objects_scrubbed":0,"log_size":4123,"log_dups_size":0,"ondisk_log_size":4123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:16:09.232034+0000","scrub_duration":0.064017473000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":0,"num_write":53637,"num_write_kb":684025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"32'8","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:24.895344+0000","last_change":"2024-05-08T21:20:24.895344+0000","last_active":"2024-05-08T21:20:24.895344+0000","last_peered":"2024-05-08T21:20:24.895344+0000","last_clean":"2024-05-08T21:20:24.895344+0000","last_became_active":"2024-05-08T21:10:03.747360+0000","last_became_peered":"2024-05-08T21:10:03.747360+0000","last_unstale":"2024-05-08T21:20:24.895344+0000","last_undegraded":"2024-05-08T21:20:24.895344+0000","last_fullsized":"2024-05-08T21:20:24.895344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-08T21:20:24.895243+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-08T21:20:24.895243+0000","last_clean_scrub_stamp":"2024-05-08T21:20:24.895243+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:38:39.010495+0000","scrub_duration":0.00166314,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:12.407195+0000","last_change":"2024-05-08T21:20:12.407195+0000","last_active":"2024-05-08T21:20:12.407195+0000","last_peered":"2024-05-08T21:20:12.407195+0000","last_clean":"2024-05-08T21:20:12.407195+0000","last_became_active":"2024-05-08T21:10:03.327530+0000","last_became_peered":"2024-05-08T21:10:03.327530+0000","last_unstale":"2024-05-08T21:20:12.407195+0000","last_undegraded":"2024-05-08T21:20:12.407195+0000","last_fullsized":"2024-05-08T21:20:12.407195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T21:20:12.407050+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T21:20:12.407050+0000","last_clean_scrub_stamp":"2024-05-08T21:20:12.407050+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:42:48.318549+0000","scrub_duration":0.0015389780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"32'119","reported_seq":193,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:09.519397+0000","last_change":"2024-05-08T21:20:09.519491+0000","last_active":"2024-05-08T21:20:09.519397+0000","last_peered":"2024-05-08T21:20:09.519397+0000","last_clean":"2024-05-08T21:20:09.519397+0000","last_became_active":"2024-05-08T21:09:59.332929+0000","last_became_peered":"2024-05-08T21:09:59.332929+0000","last_unstale":"2024-05-08T21:20:09.519397+0000","last_undegraded":"2024-05-08T21:20:09.519397+0000","last_fullsized":"2024-05-08T21:20:09.519397+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'119","last_scrub_stamp":"2024-05-08T21:20:09.519371+0000","last_deep_scrub":"32'119","last_deep_scrub_stamp":"2024-05-08T21:20:09.519371+0000","last_clean_scrub_stamp":"2024-05-08T21:20:09.519371+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:38:31.505096+0000","scrub_duration":0.0053401769999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"32'3586","reported_seq":3667,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:39.622739+0000","last_change":"2024-05-08T21:20:39.622739+0000","last_active":"2024-05-08T21:20:39.622739+0000","last_peered":"2024-05-08T21:20:39.622739+0000","last_clean":"2024-05-08T21:20:39.622739+0000","last_became_active":"2024-05-08T21:10:08.049153+0000","last_became_peered":"2024-05-08T21:10:08.049153+0000","last_unstale":"2024-05-08T21:20:39.622739+0000","last_undegraded":"2024-05-08T21:20:39.622739+0000","last_fullsized":"2024-05-08T21:20:39.622739+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3586","last_scrub_stamp":"2024-05-08T21:20:39.622562+0000","last_deep_scrub":"32'3586","last_deep_scrub_stamp":"2024-05-08T21:20:39.622562+0000","last_clean_scrub_stamp":"2024-05-08T21:20:39.622562+0000","objects_scrubbed":0,"log_size":3586,"log_dups_size":0,"ondisk_log_size":3586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:52:57.957974+0000","scrub_duration":0.052300709000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":0,"num_write":45747,"num_write_kb":586385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"32'6","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:13.619795+0000","last_change":"2024-05-08T21:20:13.619795+0000","last_active":"2024-05-08T21:20:13.619795+0000","last_peered":"2024-05-08T21:20:13.619795+0000","last_clean":"2024-05-08T21:20:13.619795+0000","last_became_active":"2024-05-08T21:10:03.742819+0000","last_became_peered":"2024-05-08T21:10:03.742819+0000","last_unstale":"2024-05-08T21:20:13.619795+0000","last_undegraded":"2024-05-08T21:20:13.619795+0000","last_fullsized":"2024-05-08T21:20:13.619795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-08T21:20:13.619702+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-08T21:20:13.619702+0000","last_clean_scrub_stamp":"2024-05-08T21:20:13.619702+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:44:45.908469+0000","scrub_duration":0.001576299,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"32'8","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:14.537678+0000","last_change":"2024-05-08T21:20:14.537781+0000","last_active":"2024-05-08T21:20:14.537678+0000","last_peered":"2024-05-08T21:20:14.537678+0000","last_clean":"2024-05-08T21:20:14.537678+0000","last_became_active":"2024-05-08T21:10:03.339957+0000","last_became_peered":"2024-05-08T21:10:03.339957+0000","last_unstale":"2024-05-08T21:20:14.537678+0000","last_undegraded":"2024-05-08T21:20:14.537678+0000","last_fullsized":"2024-05-08T21:20:14.537678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-08T21:20:14.537649+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-08T21:20:14.537649+0000","last_clean_scrub_stamp":"2024-05-08T21:20:14.537649+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:39:15.878210+0000","scrub_duration":0.0017147130000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"32'3621","reported_seq":3698,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:31.501367+0000","last_change":"2024-05-08T21:20:31.501367+0000","last_active":"2024-05-08T21:20:31.501367+0000","last_peered":"2024-05-08T21:20:31.501367+0000","last_clean":"2024-05-08T21:20:31.501367+0000","last_became_active":"2024-05-08T21:10:08.049962+0000","last_became_peered":"2024-05-08T21:10:08.049962+0000","last_unstale":"2024-05-08T21:20:31.501367+0000","last_undegraded":"2024-05-08T21:20:31.501367+0000","last_fullsized":"2024-05-08T21:20:31.501367+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3621","last_scrub_stamp":"2024-05-08T21:20:31.501232+0000","last_deep_scrub":"32'3621","last_deep_scrub_stamp":"2024-05-08T21:20:31.501232+0000","last_clean_scrub_stamp":"2024-05-08T21:20:31.501232+0000","objects_scrubbed":0,"log_size":3621,"log_dups_size":0,"ondisk_log_size":3621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:39:46.653234+0000","scrub_duration":0.061799664999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":0,"num_write":47664,"num_write_kb":629817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:15.504014+0000","last_change":"2024-05-08T21:20:15.504014+0000","last_active":"2024-05-08T21:20:15.504014+0000","last_peered":"2024-05-08T21:20:15.504014+0000","last_clean":"2024-05-08T21:20:15.504014+0000","last_became_active":"2024-05-08T21:10:03.337627+0000","last_became_peered":"2024-05-08T21:10:03.337627+0000","last_unstale":"2024-05-08T21:20:15.504014+0000","last_undegraded":"2024-05-08T21:20:15.504014+0000","last_fullsized":"2024-05-08T21:20:15.504014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T21:20:15.503850+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T21:20:15.503850+0000","last_clean_scrub_stamp":"2024-05-08T21:20:15.503850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:05.669614+0000","scrub_duration":0.0017121040000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"32'10","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:20.243517+0000","last_change":"2024-05-08T21:20:20.243517+0000","last_active":"2024-05-08T21:20:20.243517+0000","last_peered":"2024-05-08T21:20:20.243517+0000","last_clean":"2024-05-08T21:20:20.243517+0000","last_became_active":"2024-05-08T21:10:03.737927+0000","last_became_peered":"2024-05-08T21:10:03.737927+0000","last_unstale":"2024-05-08T21:20:20.243517+0000","last_undegraded":"2024-05-08T21:20:20.243517+0000","last_fullsized":"2024-05-08T21:20:20.243517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-05-08T21:20:20.243417+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-05-08T21:20:20.243417+0000","last_clean_scrub_stamp":"2024-05-08T21:20:20.243417+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:18:10.763623+0000","scrub_duration":0.0012253139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"32'4719","reported_seq":4828,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:43.964579+0000","last_change":"2024-05-08T21:20:43.964727+0000","last_active":"2024-05-08T21:20:43.964579+0000","last_peered":"2024-05-08T21:20:43.964579+0000","last_clean":"2024-05-08T21:20:43.964579+0000","last_became_active":"2024-05-08T21:10:08.051881+0000","last_became_peered":"2024-05-08T21:10:08.051881+0000","last_unstale":"2024-05-08T21:20:43.964579+0000","last_undegraded":"2024-05-08T21:20:43.964579+0000","last_fullsized":"2024-05-08T21:20:43.964579+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4719","last_scrub_stamp":"2024-05-08T21:20:43.964553+0000","last_deep_scrub":"32'4719","last_deep_scrub_stamp":"2024-05-08T21:20:43.964553+0000","last_clean_scrub_stamp":"2024-05-08T21:20:43.964553+0000","objects_scrubbed":0,"log_size":4719,"log_dups_size":0,"ondisk_log_size":4719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:38:57.103670+0000","scrub_duration":0.060709581999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":0,"num_write":60705,"num_write_kb":757240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"32'69","reported_seq":111,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:09.149631+0000","last_change":"2024-05-08T21:20:09.149631+0000","last_active":"2024-05-08T21:20:09.149631+0000","last_peered":"2024-05-08T21:20:09.149631+0000","last_clean":"2024-05-08T21:20:09.149631+0000","last_became_active":"2024-05-08T21:10:03.333368+0000","last_became_peered":"2024-05-08T21:10:03.333368+0000","last_unstale":"2024-05-08T21:20:09.149631+0000","last_undegraded":"2024-05-08T21:20:09.149631+0000","last_fullsized":"2024-05-08T21:20:09.149631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'69","last_scrub_stamp":"2024-05-08T21:20:09.149480+0000","last_deep_scrub":"32'69","last_deep_scrub_stamp":"2024-05-08T21:20:09.149480+0000","last_clean_scrub_stamp":"2024-05-08T21:20:09.149480+0000","objects_scrubbed":1,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:53:53.593469+0000","scrub_duration":0.0026429190000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":34,"num_write":151,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"32'12","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:15.912569+0000","last_change":"2024-05-08T21:20:15.912569+0000","last_active":"2024-05-08T21:20:15.912569+0000","last_peered":"2024-05-08T21:20:15.912569+0000","last_clean":"2024-05-08T21:20:15.912569+0000","last_became_active":"2024-05-08T21:10:03.752389+0000","last_became_peered":"2024-05-08T21:10:03.752389+0000","last_unstale":"2024-05-08T21:20:15.912569+0000","last_undegraded":"2024-05-08T21:20:15.912569+0000","last_fullsized":"2024-05-08T21:20:15.912569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-08T21:20:15.912455+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-08T21:20:15.912455+0000","last_clean_scrub_stamp":"2024-05-08T21:20:15.912455+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:35:09.331511+0000","scrub_duration":0.016057937000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"32'3951","reported_seq":4031,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:25.792497+0000","last_change":"2024-05-08T21:20:25.792643+0000","last_active":"2024-05-08T21:20:25.792497+0000","last_peered":"2024-05-08T21:20:25.792497+0000","last_clean":"2024-05-08T21:20:25.792497+0000","last_became_active":"2024-05-08T21:10:08.047632+0000","last_became_peered":"2024-05-08T21:10:08.047632+0000","last_unstale":"2024-05-08T21:20:25.792497+0000","last_undegraded":"2024-05-08T21:20:25.792497+0000","last_fullsized":"2024-05-08T21:20:25.792497+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3951","last_scrub_stamp":"2024-05-08T21:20:25.792472+0000","last_deep_scrub":"32'3951","last_deep_scrub_stamp":"2024-05-08T21:20:25.792472+0000","last_clean_scrub_stamp":"2024-05-08T21:20:25.792472+0000","objects_scrubbed":0,"log_size":3951,"log_dups_size":0,"ondisk_log_size":3951,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:10:11.437930+0000","scrub_duration":0.090278345999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":0,"num_write":51572,"num_write_kb":672103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"32'9","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:06.832307+0000","last_change":"2024-05-08T21:20:06.832307+0000","last_active":"2024-05-08T21:20:06.832307+0000","last_peered":"2024-05-08T21:20:06.832307+0000","last_clean":"2024-05-08T21:20:06.832307+0000","last_became_active":"2024-05-08T21:10:03.340280+0000","last_became_peered":"2024-05-08T21:10:03.340280+0000","last_unstale":"2024-05-08T21:20:06.832307+0000","last_undegraded":"2024-05-08T21:20:06.832307+0000","last_fullsized":"2024-05-08T21:20:06.832307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-05-08T21:20:06.832183+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-05-08T21:20:06.832183+0000","last_clean_scrub_stamp":"2024-05-08T21:20:06.832183+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:08:37.037032+0000","scrub_duration":0.0030290820000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"32'18","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:59.504564+0000","last_change":"2024-05-08T21:19:59.504564+0000","last_active":"2024-05-08T21:19:59.504564+0000","last_peered":"2024-05-08T21:19:59.504564+0000","last_clean":"2024-05-08T21:19:59.504564+0000","last_became_active":"2024-05-08T21:10:03.736049+0000","last_became_peered":"2024-05-08T21:10:03.736049+0000","last_unstale":"2024-05-08T21:19:59.504564+0000","last_undegraded":"2024-05-08T21:19:59.504564+0000","last_fullsized":"2024-05-08T21:19:59.504564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-05-08T21:19:59.504451+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-05-08T21:19:59.504451+0000","last_clean_scrub_stamp":"2024-05-08T21:19:59.504451+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:13:18.147944+0000","scrub_duration":0.0056426109999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'3546","reported_seq":3645,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:31.794089+0000","last_change":"2024-05-08T21:20:31.794227+0000","last_active":"2024-05-08T21:20:31.794089+0000","last_peered":"2024-05-08T21:20:31.794089+0000","last_clean":"2024-05-08T21:20:31.794089+0000","last_became_active":"2024-05-08T21:10:53.484443+0000","last_became_peered":"2024-05-08T21:10:53.484443+0000","last_unstale":"2024-05-08T21:20:31.794089+0000","last_undegraded":"2024-05-08T21:20:31.794089+0000","last_fullsized":"2024-05-08T21:20:31.794089+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3546","last_scrub_stamp":"2024-05-08T21:20:31.794061+0000","last_deep_scrub":"32'3546","last_deep_scrub_stamp":"2024-05-08T21:20:31.794061+0000","last_clean_scrub_stamp":"2024-05-08T21:20:31.794061+0000","objects_scrubbed":0,"log_size":3546,"log_dups_size":0,"ondisk_log_size":3546,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:55:34.192665+0000","scrub_duration":0.060278528999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":0,"num_write":45468,"num_write_kb":601547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:29.439945+0000","last_change":"2024-05-08T21:20:29.439945+0000","last_active":"2024-05-08T21:20:29.439945+0000","last_peered":"2024-05-08T21:20:29.439945+0000","last_clean":"2024-05-08T21:20:29.439945+0000","last_became_active":"2024-05-08T21:10:03.339690+0000","last_became_peered":"2024-05-08T21:10:03.339690+0000","last_unstale":"2024-05-08T21:20:29.439945+0000","last_undegraded":"2024-05-08T21:20:29.439945+0000","last_fullsized":"2024-05-08T21:20:29.439945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T21:20:29.439765+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T21:20:29.439765+0000","last_clean_scrub_stamp":"2024-05-08T21:20:29.439765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:26:53.204085+0000","scrub_duration":0.0017555680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"32'9","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:05.630976+0000","last_change":"2024-05-08T21:20:05.631085+0000","last_active":"2024-05-08T21:20:05.630976+0000","last_peered":"2024-05-08T21:20:05.630976+0000","last_clean":"2024-05-08T21:20:05.630976+0000","last_became_active":"2024-05-08T21:10:03.744160+0000","last_became_peered":"2024-05-08T21:10:03.744160+0000","last_unstale":"2024-05-08T21:20:05.630976+0000","last_undegraded":"2024-05-08T21:20:05.630976+0000","last_fullsized":"2024-05-08T21:20:05.630976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-05-08T21:20:05.630950+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-05-08T21:20:05.630950+0000","last_clean_scrub_stamp":"2024-05-08T21:20:05.630950+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:28:39.640053+0000","scrub_duration":0.0016783080000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'5130","reported_seq":5236,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:50.564637+0000","last_change":"2024-05-08T21:20:50.564781+0000","last_active":"2024-05-08T21:20:50.564637+0000","last_peered":"2024-05-08T21:20:50.564637+0000","last_clean":"2024-05-08T21:20:50.564637+0000","last_became_active":"2024-05-08T21:10:08.048866+0000","last_became_peered":"2024-05-08T21:10:08.048866+0000","last_unstale":"2024-05-08T21:20:50.564637+0000","last_undegraded":"2024-05-08T21:20:50.564637+0000","last_fullsized":"2024-05-08T21:20:50.564637+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5130","last_scrub_stamp":"2024-05-08T21:20:50.564610+0000","last_deep_scrub":"32'5130","last_deep_scrub_stamp":"2024-05-08T21:20:50.564610+0000","last_clean_scrub_stamp":"2024-05-08T21:20:50.564610+0000","objects_scrubbed":0,"log_size":5130,"log_dups_size":0,"ondisk_log_size":5130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:38:01.565521+0000","scrub_duration":0.043391770000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":0,"num_write":66101,"num_write_kb":843075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:10.134089+0000","last_change":"2024-05-08T21:20:10.134089+0000","last_active":"2024-05-08T21:20:10.134089+0000","last_peered":"2024-05-08T21:20:10.134089+0000","last_clean":"2024-05-08T21:20:10.134089+0000","last_became_active":"2024-05-08T21:10:03.339136+0000","last_became_peered":"2024-05-08T21:10:03.339136+0000","last_unstale":"2024-05-08T21:20:10.134089+0000","last_undegraded":"2024-05-08T21:20:10.134089+0000","last_fullsized":"2024-05-08T21:20:10.134089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T21:20:10.133976+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T21:20:10.133976+0000","last_clean_scrub_stamp":"2024-05-08T21:20:10.133976+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:19:43.392154+0000","scrub_duration":0.0021174700000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"32'9","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:02.697565+0000","last_change":"2024-05-08T21:20:02.697565+0000","last_active":"2024-05-08T21:20:02.697565+0000","last_peered":"2024-05-08T21:20:02.697565+0000","last_clean":"2024-05-08T21:20:02.697565+0000","last_became_active":"2024-05-08T21:10:03.737459+0000","last_became_peered":"2024-05-08T21:10:03.737459+0000","last_unstale":"2024-05-08T21:20:02.697565+0000","last_undegraded":"2024-05-08T21:20:02.697565+0000","last_fullsized":"2024-05-08T21:20:02.697565+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-05-08T21:20:02.697461+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-05-08T21:20:02.697461+0000","last_clean_scrub_stamp":"2024-05-08T21:20:02.697461+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:00:37.934494+0000","scrub_duration":0.001184753,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"32'4248","reported_seq":4335,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:26.813608+0000","last_change":"2024-05-08T21:20:26.813750+0000","last_active":"2024-05-08T21:20:26.813608+0000","last_peered":"2024-05-08T21:20:26.813608+0000","last_clean":"2024-05-08T21:20:26.813608+0000","last_became_active":"2024-05-08T21:10:07.775956+0000","last_became_peered":"2024-05-08T21:10:07.775956+0000","last_unstale":"2024-05-08T21:20:26.813608+0000","last_undegraded":"2024-05-08T21:20:26.813608+0000","last_fullsized":"2024-05-08T21:20:26.813608+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4248","last_scrub_stamp":"2024-05-08T21:20:26.813583+0000","last_deep_scrub":"32'4248","last_deep_scrub_stamp":"2024-05-08T21:20:26.813583+0000","last_clean_scrub_stamp":"2024-05-08T21:20:26.813583+0000","objects_scrubbed":0,"log_size":4248,"log_dups_size":0,"ondisk_log_size":4248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:05:17.256637+0000","scrub_duration":0.075347738999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":0,"num_write":55084,"num_write_kb":703369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"32'3","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:12.103697+0000","last_change":"2024-05-08T21:20:12.103775+0000","last_active":"2024-05-08T21:20:12.103697+0000","last_peered":"2024-05-08T21:20:12.103697+0000","last_clean":"2024-05-08T21:20:12.103697+0000","last_became_active":"2024-05-08T21:10:03.331198+0000","last_became_peered":"2024-05-08T21:10:03.331198+0000","last_unstale":"2024-05-08T21:20:12.103697+0000","last_undegraded":"2024-05-08T21:20:12.103697+0000","last_fullsized":"2024-05-08T21:20:12.103697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-05-08T21:20:12.103673+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-05-08T21:20:12.103673+0000","last_clean_scrub_stamp":"2024-05-08T21:20:12.103673+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:29:46.249901+0000","scrub_duration":0.001456349,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"32'11","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:26.870601+0000","last_change":"2024-05-08T21:20:26.870768+0000","last_active":"2024-05-08T21:20:26.870601+0000","last_peered":"2024-05-08T21:20:26.870601+0000","last_clean":"2024-05-08T21:20:26.870601+0000","last_became_active":"2024-05-08T21:10:03.744326+0000","last_became_peered":"2024-05-08T21:10:03.744326+0000","last_unstale":"2024-05-08T21:20:26.870601+0000","last_undegraded":"2024-05-08T21:20:26.870601+0000","last_fullsized":"2024-05-08T21:20:26.870601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'11","last_scrub_stamp":"2024-05-08T21:20:26.870555+0000","last_deep_scrub":"32'11","last_deep_scrub_stamp":"2024-05-08T21:20:26.870555+0000","last_clean_scrub_stamp":"2024-05-08T21:20:26.870555+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:18:06.317902+0000","scrub_duration":0.0071934199999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'4119","reported_seq":4207,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:23.810810+0000","last_change":"2024-05-08T21:20:23.810966+0000","last_active":"2024-05-08T21:20:23.810810+0000","last_peered":"2024-05-08T21:20:23.810810+0000","last_clean":"2024-05-08T21:20:23.810810+0000","last_became_active":"2024-05-08T21:10:07.762886+0000","last_became_peered":"2024-05-08T21:10:07.762886+0000","last_unstale":"2024-05-08T21:20:23.810810+0000","last_undegraded":"2024-05-08T21:20:23.810810+0000","last_fullsized":"2024-05-08T21:20:23.810810+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4119","last_scrub_stamp":"2024-05-08T21:20:23.810787+0000","last_deep_scrub":"32'4119","last_deep_scrub_stamp":"2024-05-08T21:20:23.810787+0000","last_clean_scrub_stamp":"2024-05-08T21:20:23.810787+0000","objects_scrubbed":0,"log_size":4119,"log_dups_size":0,"ondisk_log_size":4119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:41:39.131376+0000","scrub_duration":0.093247574999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":0,"num_write":53672,"num_write_kb":692300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"32'677","reported_seq":723,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:27.461688+0000","last_change":"2024-05-08T21:20:27.461858+0000","last_active":"2024-05-08T21:20:27.461688+0000","last_peered":"2024-05-08T21:20:27.461688+0000","last_clean":"2024-05-08T21:20:27.461688+0000","last_became_active":"2024-05-08T21:10:03.337654+0000","last_became_peered":"2024-05-08T21:10:03.337654+0000","last_unstale":"2024-05-08T21:20:27.461688+0000","last_undegraded":"2024-05-08T21:20:27.461688+0000","last_fullsized":"2024-05-08T21:20:27.461688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'677","last_scrub_stamp":"2024-05-08T21:20:27.461661+0000","last_deep_scrub":"32'677","last_deep_scrub_stamp":"2024-05-08T21:20:27.461661+0000","last_clean_scrub_stamp":"2024-05-08T21:20:27.461661+0000","objects_scrubbed":2,"log_size":677,"log_dups_size":0,"ondisk_log_size":677,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:10.983427+0000","scrub_duration":0.016441509,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":9261,"num_write":668,"num_write_kb":4529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"32'11","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:28.021435+0000","last_change":"2024-05-08T21:20:28.021542+0000","last_active":"2024-05-08T21:20:28.021435+0000","last_peered":"2024-05-08T21:20:28.021435+0000","last_clean":"2024-05-08T21:20:28.021435+0000","last_became_active":"2024-05-08T21:10:03.744589+0000","last_became_peered":"2024-05-08T21:10:03.744589+0000","last_unstale":"2024-05-08T21:20:28.021435+0000","last_undegraded":"2024-05-08T21:20:28.021435+0000","last_fullsized":"2024-05-08T21:20:28.021435+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'11","last_scrub_stamp":"2024-05-08T21:20:28.021403+0000","last_deep_scrub":"32'11","last_deep_scrub_stamp":"2024-05-08T21:20:28.021403+0000","last_clean_scrub_stamp":"2024-05-08T21:20:28.021403+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:59.590278+0000","scrub_duration":0.001592163,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"32'4008","reported_seq":4090,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:34.205705+0000","last_change":"2024-05-08T21:20:34.205863+0000","last_active":"2024-05-08T21:20:34.205705+0000","last_peered":"2024-05-08T21:20:34.205705+0000","last_clean":"2024-05-08T21:20:34.205705+0000","last_became_active":"2024-05-08T21:10:08.047331+0000","last_became_peered":"2024-05-08T21:10:08.047331+0000","last_unstale":"2024-05-08T21:20:34.205705+0000","last_undegraded":"2024-05-08T21:20:34.205705+0000","last_fullsized":"2024-05-08T21:20:34.205705+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4008","last_scrub_stamp":"2024-05-08T21:20:34.205680+0000","last_deep_scrub":"32'4008","last_deep_scrub_stamp":"2024-05-08T21:20:34.205680+0000","last_clean_scrub_stamp":"2024-05-08T21:20:34.205680+0000","objects_scrubbed":0,"log_size":4008,"log_dups_size":0,"ondisk_log_size":4008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:33:01.521146+0000","scrub_duration":0.062941794999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":0,"num_write":52621,"num_write_kb":688417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"32'5","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:03.323940+0000","last_change":"2024-05-08T21:20:03.324041+0000","last_active":"2024-05-08T21:20:03.323940+0000","last_peered":"2024-05-08T21:20:03.323940+0000","last_clean":"2024-05-08T21:20:03.323940+0000","last_became_active":"2024-05-08T21:10:03.332790+0000","last_became_peered":"2024-05-08T21:10:03.332790+0000","last_unstale":"2024-05-08T21:20:03.323940+0000","last_undegraded":"2024-05-08T21:20:03.323940+0000","last_fullsized":"2024-05-08T21:20:03.323940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-05-08T21:20:03.323907+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-05-08T21:20:03.323907+0000","last_clean_scrub_stamp":"2024-05-08T21:20:03.323907+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:44:20.215991+0000","scrub_duration":0.001874807,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'15","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:30.477080+0000","last_change":"2024-05-08T21:20:30.477181+0000","last_active":"2024-05-08T21:20:30.477080+0000","last_peered":"2024-05-08T21:20:30.477080+0000","last_clean":"2024-05-08T21:20:30.477080+0000","last_became_active":"2024-05-08T21:10:03.747759+0000","last_became_peered":"2024-05-08T21:10:03.747759+0000","last_unstale":"2024-05-08T21:20:30.477080+0000","last_undegraded":"2024-05-08T21:20:30.477080+0000","last_fullsized":"2024-05-08T21:20:30.477080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-05-08T21:20:30.477054+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-05-08T21:20:30.477054+0000","last_clean_scrub_stamp":"2024-05-08T21:20:30.477054+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:12:04.864383+0000","scrub_duration":0.004148311,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"32'3793","reported_seq":3884,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:36.515712+0000","last_change":"2024-05-08T21:20:36.515834+0000","last_active":"2024-05-08T21:20:36.515712+0000","last_peered":"2024-05-08T21:20:36.515712+0000","last_clean":"2024-05-08T21:20:36.515712+0000","last_became_active":"2024-05-08T21:10:07.760566+0000","last_became_peered":"2024-05-08T21:10:07.760566+0000","last_unstale":"2024-05-08T21:20:36.515712+0000","last_undegraded":"2024-05-08T21:20:36.515712+0000","last_fullsized":"2024-05-08T21:20:36.515712+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3793","last_scrub_stamp":"2024-05-08T21:20:36.515687+0000","last_deep_scrub":"32'3793","last_deep_scrub_stamp":"2024-05-08T21:20:36.515687+0000","last_clean_scrub_stamp":"2024-05-08T21:20:36.515687+0000","objects_scrubbed":0,"log_size":3793,"log_dups_size":0,"ondisk_log_size":3793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:20.419667+0000","scrub_duration":0.048624845999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":0,"num_write":48645,"num_write_kb":636437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"32'3","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:03.185252+0000","last_change":"2024-05-08T21:20:03.185331+0000","last_active":"2024-05-08T21:20:03.185252+0000","last_peered":"2024-05-08T21:20:03.185252+0000","last_clean":"2024-05-08T21:20:03.185252+0000","last_became_active":"2024-05-08T21:10:03.331028+0000","last_became_peered":"2024-05-08T21:10:03.331028+0000","last_unstale":"2024-05-08T21:20:03.185252+0000","last_undegraded":"2024-05-08T21:20:03.185252+0000","last_fullsized":"2024-05-08T21:20:03.185252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-05-08T21:20:03.185228+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-05-08T21:20:03.185228+0000","last_clean_scrub_stamp":"2024-05-08T21:20:03.185228+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:53:13.030027+0000","scrub_duration":0.0031620390000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"32'12","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:25.390249+0000","last_change":"2024-05-08T21:20:25.390338+0000","last_active":"2024-05-08T21:20:25.390249+0000","last_peered":"2024-05-08T21:20:25.390249+0000","last_clean":"2024-05-08T21:20:25.390249+0000","last_became_active":"2024-05-08T21:10:03.746557+0000","last_became_peered":"2024-05-08T21:10:03.746557+0000","last_unstale":"2024-05-08T21:20:25.390249+0000","last_undegraded":"2024-05-08T21:20:25.390249+0000","last_fullsized":"2024-05-08T21:20:25.390249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-08T21:20:25.390223+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-08T21:20:25.390223+0000","last_clean_scrub_stamp":"2024-05-08T21:20:25.390223+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:51:54.540934+0000","scrub_duration":0.001723699,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"32'3739","reported_seq":3816,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:45.401479+0000","last_change":"2024-05-08T21:20:45.401621+0000","last_active":"2024-05-08T21:20:45.401479+0000","last_peered":"2024-05-08T21:20:45.401479+0000","last_clean":"2024-05-08T21:20:45.401479+0000","last_became_active":"2024-05-08T21:10:08.048453+0000","last_became_peered":"2024-05-08T21:10:08.048453+0000","last_unstale":"2024-05-08T21:20:45.401479+0000","last_undegraded":"2024-05-08T21:20:45.401479+0000","last_fullsized":"2024-05-08T21:20:45.401479+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3739","last_scrub_stamp":"2024-05-08T21:20:45.401452+0000","last_deep_scrub":"32'3739","last_deep_scrub_stamp":"2024-05-08T21:20:45.401452+0000","last_clean_scrub_stamp":"2024-05-08T21:20:45.401452+0000","objects_scrubbed":0,"log_size":3739,"log_dups_size":0,"ondisk_log_size":3739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:05:52.482418+0000","scrub_duration":0.049280170999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":0,"num_write":49340,"num_write_kb":639424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"32'8","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:01.265385+0000","last_change":"2024-05-08T21:20:01.265470+0000","last_active":"2024-05-08T21:20:01.265385+0000","last_peered":"2024-05-08T21:20:01.265385+0000","last_clean":"2024-05-08T21:20:01.265385+0000","last_became_active":"2024-05-08T21:10:03.330082+0000","last_became_peered":"2024-05-08T21:10:03.330082+0000","last_unstale":"2024-05-08T21:20:01.265385+0000","last_undegraded":"2024-05-08T21:20:01.265385+0000","last_fullsized":"2024-05-08T21:20:01.265385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-08T21:20:01.265361+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-08T21:20:01.265361+0000","last_clean_scrub_stamp":"2024-05-08T21:20:01.265361+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:02.229852+0000","scrub_duration":0.0021232669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"32'11","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:59.772591+0000","last_change":"2024-05-08T21:19:59.772720+0000","last_active":"2024-05-08T21:19:59.772591+0000","last_peered":"2024-05-08T21:19:59.772591+0000","last_clean":"2024-05-08T21:19:59.772591+0000","last_became_active":"2024-05-08T21:10:03.746755+0000","last_became_peered":"2024-05-08T21:10:03.746755+0000","last_unstale":"2024-05-08T21:19:59.772591+0000","last_undegraded":"2024-05-08T21:19:59.772591+0000","last_fullsized":"2024-05-08T21:19:59.772591+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'11","last_scrub_stamp":"2024-05-08T21:19:59.772568+0000","last_deep_scrub":"32'11","last_deep_scrub_stamp":"2024-05-08T21:19:59.772568+0000","last_clean_scrub_stamp":"2024-05-08T21:19:59.772568+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:41:47.304779+0000","scrub_duration":0.081020191000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"32'16","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:16.966368+0000","last_change":"2024-05-08T21:20:16.966368+0000","last_active":"2024-05-08T21:20:16.966368+0000","last_peered":"2024-05-08T21:20:16.966368+0000","last_clean":"2024-05-08T21:20:16.966368+0000","last_became_active":"2024-05-08T21:10:03.738338+0000","last_became_peered":"2024-05-08T21:10:03.738338+0000","last_unstale":"2024-05-08T21:20:16.966368+0000","last_undegraded":"2024-05-08T21:20:16.966368+0000","last_fullsized":"2024-05-08T21:20:16.966368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-05-08T21:20:16.966163+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-05-08T21:20:16.966163+0000","last_clean_scrub_stamp":"2024-05-08T21:20:16.966163+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:31:19.839424+0000","scrub_duration":0.0021440869999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"32'14","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:10.325371+0000","last_change":"2024-05-08T21:20:10.325371+0000","last_active":"2024-05-08T21:20:10.325371+0000","last_peered":"2024-05-08T21:20:10.325371+0000","last_clean":"2024-05-08T21:20:10.325371+0000","last_became_active":"2024-05-08T21:10:03.745362+0000","last_became_peered":"2024-05-08T21:10:03.745362+0000","last_unstale":"2024-05-08T21:20:10.325371+0000","last_undegraded":"2024-05-08T21:20:10.325371+0000","last_fullsized":"2024-05-08T21:20:10.325371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-05-08T21:20:10.325202+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-05-08T21:20:10.325202+0000","last_clean_scrub_stamp":"2024-05-08T21:20:10.325202+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:03:52.158974+0000","scrub_duration":0.007440164,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"32'20","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:28.336760+0000","last_change":"2024-05-08T21:20:28.336760+0000","last_active":"2024-05-08T21:20:28.336760+0000","last_peered":"2024-05-08T21:20:28.336760+0000","last_clean":"2024-05-08T21:20:28.336760+0000","last_became_active":"2024-05-08T21:10:03.744844+0000","last_became_peered":"2024-05-08T21:10:03.744844+0000","last_unstale":"2024-05-08T21:20:28.336760+0000","last_undegraded":"2024-05-08T21:20:28.336760+0000","last_fullsized":"2024-05-08T21:20:28.336760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-05-08T21:20:28.336626+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-05-08T21:20:28.336626+0000","last_clean_scrub_stamp":"2024-05-08T21:20:28.336626+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:48:19.087494+0000","scrub_duration":0.0016633170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"32'11","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:14.593913+0000","last_change":"2024-05-08T21:20:14.593913+0000","last_active":"2024-05-08T21:20:14.593913+0000","last_peered":"2024-05-08T21:20:14.593913+0000","last_clean":"2024-05-08T21:20:14.593913+0000","last_became_active":"2024-05-08T21:10:03.744908+0000","last_became_peered":"2024-05-08T21:10:03.744908+0000","last_unstale":"2024-05-08T21:20:14.593913+0000","last_undegraded":"2024-05-08T21:20:14.593913+0000","last_fullsized":"2024-05-08T21:20:14.593913+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'11","last_scrub_stamp":"2024-05-08T21:20:14.593768+0000","last_deep_scrub":"32'11","last_deep_scrub_stamp":"2024-05-08T21:20:14.593768+0000","last_clean_scrub_stamp":"2024-05-08T21:20:14.593768+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:57:46.848018+0000","scrub_duration":0.0021814820000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'9","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:23.936252+0000","last_change":"2024-05-08T21:20:23.936252+0000","last_active":"2024-05-08T21:20:23.936252+0000","last_peered":"2024-05-08T21:20:23.936252+0000","last_clean":"2024-05-08T21:20:23.936252+0000","last_became_active":"2024-05-08T21:10:03.748284+0000","last_became_peered":"2024-05-08T21:10:03.748284+0000","last_unstale":"2024-05-08T21:20:23.936252+0000","last_undegraded":"2024-05-08T21:20:23.936252+0000","last_fullsized":"2024-05-08T21:20:23.936252+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-05-08T21:20:23.936106+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-05-08T21:20:23.936106+0000","last_clean_scrub_stamp":"2024-05-08T21:20:23.936106+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:37:53.315045+0000","scrub_duration":0.0023145779999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"32'12","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:27.350706+0000","last_change":"2024-05-08T21:20:27.350706+0000","last_active":"2024-05-08T21:20:27.350706+0000","last_peered":"2024-05-08T21:20:27.350706+0000","last_clean":"2024-05-08T21:20:27.350706+0000","last_became_active":"2024-05-08T21:10:03.739522+0000","last_became_peered":"2024-05-08T21:10:03.739522+0000","last_unstale":"2024-05-08T21:20:27.350706+0000","last_undegraded":"2024-05-08T21:20:27.350706+0000","last_fullsized":"2024-05-08T21:20:27.350706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-08T21:20:27.350510+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-08T21:20:27.350510+0000","last_clean_scrub_stamp":"2024-05-08T21:20:27.350510+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:49:16.570425+0000","scrub_duration":0.047255268000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"32'11","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:33.106631+0000","last_change":"2024-05-08T21:20:33.106730+0000","last_active":"2024-05-08T21:20:33.106631+0000","last_peered":"2024-05-08T21:20:33.106631+0000","last_clean":"2024-05-08T21:20:33.106631+0000","last_became_active":"2024-05-08T21:10:03.745842+0000","last_became_peered":"2024-05-08T21:10:03.745842+0000","last_unstale":"2024-05-08T21:20:33.106631+0000","last_undegraded":"2024-05-08T21:20:33.106631+0000","last_fullsized":"2024-05-08T21:20:33.106631+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'11","last_scrub_stamp":"2024-05-08T21:20:33.106606+0000","last_deep_scrub":"32'11","last_deep_scrub_stamp":"2024-05-08T21:20:33.106606+0000","last_clean_scrub_stamp":"2024-05-08T21:20:33.106606+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:56:18.498259+0000","scrub_duration":0.0015256549999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"32'13","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:51.487466+0000","last_change":"2024-05-08T21:20:51.487599+0000","last_active":"2024-05-08T21:20:51.487466+0000","last_peered":"2024-05-08T21:20:51.487466+0000","last_clean":"2024-05-08T21:20:51.487466+0000","last_became_active":"2024-05-08T21:10:53.473615+0000","last_became_peered":"2024-05-08T21:10:53.473615+0000","last_unstale":"2024-05-08T21:20:51.487466+0000","last_undegraded":"2024-05-08T21:20:51.487466+0000","last_fullsized":"2024-05-08T21:20:51.487466+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'13","last_scrub_stamp":"2024-05-08T21:20:51.487441+0000","last_deep_scrub":"32'13","last_deep_scrub_stamp":"2024-05-08T21:20:51.487441+0000","last_clean_scrub_stamp":"2024-05-08T21:20:51.487441+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:03:44.977909+0000","scrub_duration":0.0020069580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"32'13","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:37.284245+0000","last_change":"2024-05-08T21:20:37.284352+0000","last_active":"2024-05-08T21:20:37.284245+0000","last_peered":"2024-05-08T21:20:37.284245+0000","last_clean":"2024-05-08T21:20:37.284245+0000","last_became_active":"2024-05-08T21:10:03.747059+0000","last_became_peered":"2024-05-08T21:10:03.747059+0000","last_unstale":"2024-05-08T21:20:37.284245+0000","last_undegraded":"2024-05-08T21:20:37.284245+0000","last_fullsized":"2024-05-08T21:20:37.284245+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'13","last_scrub_stamp":"2024-05-08T21:20:37.284218+0000","last_deep_scrub":"32'13","last_deep_scrub_stamp":"2024-05-08T21:20:37.284218+0000","last_clean_scrub_stamp":"2024-05-08T21:20:37.284218+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:04:07.083953+0000","scrub_duration":0.0021271319999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"32'17","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:19:57.701516+0000","last_change":"2024-05-08T21:19:57.701600+0000","last_active":"2024-05-08T21:19:57.701516+0000","last_peered":"2024-05-08T21:19:57.701516+0000","last_clean":"2024-05-08T21:19:57.701516+0000","last_became_active":"2024-05-08T21:10:03.746942+0000","last_became_peered":"2024-05-08T21:10:03.746942+0000","last_unstale":"2024-05-08T21:19:57.701516+0000","last_undegraded":"2024-05-08T21:19:57.701516+0000","last_fullsized":"2024-05-08T21:19:57.701516+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'17","last_scrub_stamp":"2024-05-08T21:19:57.701494+0000","last_deep_scrub":"32'17","last_deep_scrub_stamp":"2024-05-08T21:19:57.701494+0000","last_clean_scrub_stamp":"2024-05-08T21:19:57.701494+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:15:31.324653+0000","scrub_duration":0.0065830869999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"32'12","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:31.312658+0000","last_change":"2024-05-08T21:20:31.312791+0000","last_active":"2024-05-08T21:20:31.312658+0000","last_peered":"2024-05-08T21:20:31.312658+0000","last_clean":"2024-05-08T21:20:31.312658+0000","last_became_active":"2024-05-08T21:10:03.752486+0000","last_became_peered":"2024-05-08T21:10:03.752486+0000","last_unstale":"2024-05-08T21:20:31.312658+0000","last_undegraded":"2024-05-08T21:20:31.312658+0000","last_fullsized":"2024-05-08T21:20:31.312658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-08T21:20:31.312632+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-08T21:20:31.312632+0000","last_clean_scrub_stamp":"2024-05-08T21:20:31.312632+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:10:04.211847+0000","scrub_duration":0.001584551,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"32'19","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:17.586352+0000","last_change":"2024-05-08T21:20:17.586434+0000","last_active":"2024-05-08T21:20:17.586352+0000","last_peered":"2024-05-08T21:20:17.586352+0000","last_clean":"2024-05-08T21:20:17.586352+0000","last_became_active":"2024-05-08T21:10:03.753616+0000","last_became_peered":"2024-05-08T21:10:03.753616+0000","last_unstale":"2024-05-08T21:20:17.586352+0000","last_undegraded":"2024-05-08T21:20:17.586352+0000","last_fullsized":"2024-05-08T21:20:17.586352+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'19","last_scrub_stamp":"2024-05-08T21:20:17.586326+0000","last_deep_scrub":"32'19","last_deep_scrub_stamp":"2024-05-08T21:20:17.586326+0000","last_clean_scrub_stamp":"2024-05-08T21:20:17.586326+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:05:31.480211+0000","scrub_duration":0.0093599229999999992,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"32'10","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T21:20:15.967129+0000","last_change":"2024-05-08T21:20:15.967233+0000","last_active":"2024-05-08T21:20:15.967129+0000","last_peered":"2024-05-08T21:20:15.967129+0000","last_clean":"2024-05-08T21:20:15.967129+0000","last_became_active":"2024-05-08T21:10:03.744562+0000","last_became_peered":"2024-05-08T21:10:03.744562+0000","last_unstale":"2024-05-08T21:20:15.967129+0000","last_undegraded":"2024-05-08T21:20:15.967129+0000","last_fullsized":"2024-05-08T21:20:15.967129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-05-08T21:20:15.967103+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-05-08T21:20:15.967103+0000","last_clean_scrub_stamp":"2024-05-08T21:20:15.967103+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:41:31.805841+0000","scrub_duration":0.00156011,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1810,"num_read_kb":0,"num_write":1714405,"num_write_kb":22146371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132410,"ondisk_log_size":132410,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":773,"ondisk_log_size":773,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64612,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":15837416,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":328,"num_read_kb":39720,"num_write":2875,"num_write_kb":17766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17809408,"data_stored":31674832,"data_compressed":2933172,"data_compressed_allocated":3907584,"data_compressed_original":17833984,"omap_allocated":0,"internal_metadata":0},"log_size":2929,"ondisk_log_size":2929,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509574,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":913320,"kb_used_data":1888,"kb_used_omap":1,"kb_used_meta":911422,"kb_avail":93458520,"statfs":{"total":96636764160,"available":95701524480,"internally_reserved":0,"allocated":1933312,"data_stored":4343835,"data_compressed":576533,"data_compressed_allocated":724992,"data_compressed_original":3338240,"omap_allocated":1593,"internal_metadata":933296583},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:20:08 2024","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":1.831,"15min":1.587},"min":{"1min":0.32200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":5.5890000000000004,"5min":13.432,"15min":17.978999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.427,"15min":1.117},"min":{"1min":0.29699999999999999,"5min":0.24299999999999999,"15min":0.219},"max":{"1min":6.1020000000000003,"5min":10.097,"15min":11.362},"last":0.69499999999999995}]},{"osd":1,"last update":"Wed May 8 21:20:08 2024","interfaces":[{"interface":"back","average":{"1min":2.2080000000000002,"5min":2.9169999999999998,"15min":1.968},"min":{"1min":0.35499999999999998,"5min":0.219,"15min":0.219},"max":{"1min":17.797000000000001,"5min":49.942999999999998,"15min":49.942999999999998},"last":0.54100000000000004},{"interface":"front","average":{"1min":2.7869999999999999,"5min":2.7970000000000002,"15min":1.667},"min":{"1min":0.41699999999999998,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":16.221,"5min":27.733000000000001,"15min":27.733000000000001},"last":0.59899999999999998}]},{"osd":2,"last update":"Wed May 8 21:20:08 2024","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.6859999999999999,"15min":1.7190000000000001},"min":{"1min":0.39300000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":5.7640000000000002,"5min":17.858000000000001,"15min":58.450000000000003},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.611,"15min":1.159},"min":{"1min":0.35599999999999998,"5min":0.30199999999999999,"15min":0.27400000000000002},"max":{"1min":5.2110000000000003,"5min":13.568,"15min":14.746},"last":0.63200000000000001}]},{"osd":3,"last update":"Wed May 8 21:20:08 2024","interfaces":[{"interface":"back","average":{"1min":3.0169999999999999,"5min":4.1769999999999996,"15min":2.754},"min":{"1min":0.41199999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":23.302,"5min":68.728999999999999,"15min":74.570999999999998},"last":0.51000000000000001},{"interface":"front","average":{"1min":1.863,"5min":1.982,"15min":1.7090000000000001},"min":{"1min":0.35699999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":16.302,"5min":16.302,"15min":28.099},"last":0.61799999999999999}]},{"osd":4,"last update":"Wed May 8 21:20:08 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":1.468,"15min":1.1319999999999999},"min":{"1min":0.25,"5min":0.223,"15min":0.223},"max":{"1min":1.2010000000000001,"5min":27.963000000000001,"15min":29.731000000000002},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.81799999999999995,"5min":1.548,"15min":1.169},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":5.234,"5min":17.835999999999999,"15min":26.454999999999998},"last":0.44600000000000001}]},{"osd":5,"last update":"Wed May 8 21:20:08 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":1.1619999999999999,"15min":1.1879999999999999},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.25900000000000001},"max":{"1min":5.5190000000000001,"5min":17.780999999999999,"15min":65.373000000000005},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.874,"5min":1.28,"15min":1.0629999999999999},"min":{"1min":0.29099999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":5.1779999999999999,"5min":13.509,"15min":26.498999999999999},"last":0.52600000000000002}]},{"osd":7,"last update":"Wed May 8 21:20:08 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":1.631,"15min":1.0600000000000001},"min":{"1min":0.318,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.1459999999999999,"5min":16.808,"15min":16.808},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.89800000000000002,"5min":1.4399999999999999,"15min":0.98399999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":7.9930000000000003,"5min":18.100999999999999,"15min":18.100999999999999},"last":0.57599999999999996}]}]},{"osd":5,"up_from":15,"seq":64424509575,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":696156,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":695806,"kb_avail":93675684,"statfs":{"total":96636764160,"available":95923900416,"internally_reserved":0,"allocated":348160,"data_stored":148949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":712505798},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:20:20 2024","interfaces":[{"interface":"back","average":{"1min":2.4630000000000001,"5min":2.0369999999999999,"15min":1.5600000000000001},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":20.721,"5min":20.721,"15min":48.481999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":1.778,"5min":2.1440000000000001,"15min":1.5820000000000001},"min":{"1min":0.40999999999999998,"5min":0.28399999999999997,"15min":0.23999999999999999},"max":{"1min":10.145,"5min":17.164000000000001,"15min":30.004999999999999},"last":0.57499999999999996}]},{"osd":1,"last update":"Wed May 8 21:20:20 2024","interfaces":[{"interface":"back","average":{"1min":2.3650000000000002,"5min":2.6699999999999999,"15min":1.8420000000000001},"min":{"1min":0.30499999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":13.038,"5min":21.702999999999999,"15min":25.228000000000002},"last":0.60099999999999998},{"interface":"front","average":{"1min":2.3919999999999999,"5min":2.3980000000000001,"15min":1.5269999999999999},"min":{"1min":0.33300000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":13.071,"5min":17.396000000000001,"15min":21.869},"last":0.69499999999999995}]},{"osd":2,"last update":"Wed May 8 21:20:20 2024","interfaces":[{"interface":"back","average":{"1min":2.3940000000000001,"5min":2.8780000000000001,"15min":1.7929999999999999},"min":{"1min":0.33500000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":20.917000000000002,"5min":30.552,"15min":34.850000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":1.0740000000000001,"5min":2.2069999999999999,"15min":1.504},"min":{"1min":0.313,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":5.0270000000000001,"5min":29.623000000000001,"15min":29.623000000000001},"last":0.752}]},{"osd":3,"last update":"Wed May 8 21:20:20 2024","interfaces":[{"interface":"back","average":{"1min":2.2469999999999999,"5min":1.911,"15min":1.49},"min":{"1min":0.375,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":8.8480000000000008,"5min":19.395,"15min":23.234999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":2.2650000000000001,"5min":3.5459999999999998,"15min":2.161},"min":{"1min":0.378,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":10.65,"5min":40.954999999999998,"15min":40.954999999999998},"last":0.61099999999999999}]},{"osd":4,"last update":"Wed May 8 21:20:20 2024","interfaces":[{"interface":"back","average":{"1min":1.6819999999999999,"5min":1.2310000000000001,"15min":0.97699999999999998},"min":{"1min":0.25800000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":11.388999999999999,"5min":12.390000000000001,"15min":23.254000000000001},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.95499999999999996,"5min":1.095,"15min":0.96799999999999997},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.26600000000000001},"max":{"1min":9.2989999999999995,"5min":9.2989999999999995,"15min":17.550999999999998},"last":0.47099999999999997}]},{"osd":6,"last update":"Wed May 8 21:20:20 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.84999999999999998,"15min":0.89900000000000002},"min":{"1min":0.33200000000000002,"5min":0.26900000000000002,"15min":0.25800000000000001},"max":{"1min":2.4990000000000001,"5min":8.7249999999999996,"15min":17.856000000000002},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.81299999999999994,"5min":1.085,"15min":1.02},"min":{"1min":0.378,"5min":0.29299999999999998,"15min":0.26900000000000002},"max":{"1min":3.5,"5min":8.9269999999999996,"15min":17.827999999999999},"last":0.55000000000000004}]},{"osd":7,"last update":"Wed May 8 21:20:20 2024","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.226,"15min":0.96199999999999997},"min":{"1min":0.34799999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":7.7430000000000003,"5min":11.183999999999999,"15min":18.079000000000001},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.89900000000000002,"5min":1.4099999999999999,"15min":1.1859999999999999},"min":{"1min":0.35599999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":5.1520000000000001,"5min":13.496,"15min":30.050000000000001},"last":0.53900000000000003}]}]},{"osd":0,"up_from":14,"seq":60129542279,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":800100,"kb_used_data":1948,"kb_used_omap":1,"kb_used_meta":798142,"kb_avail":93571740,"statfs":{"total":96636764160,"available":95817461760,"internally_reserved":0,"allocated":1994752,"data_stored":3898840,"data_compressed":360679,"data_compressed_allocated":471040,"data_compressed_original":2588672,"omap_allocated":1594,"internal_metadata":817297862},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 8 21:20:14 2024","interfaces":[{"interface":"back","average":{"1min":5.1619999999999999,"5min":3.508,"15min":2.2450000000000001},"min":{"1min":0.19800000000000001,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":60.868000000000002,"5min":60.868000000000002,"15min":98.899000000000001},"last":0.40000000000000002},{"interface":"front","average":{"1min":4.266,"5min":3.2170000000000001,"15min":1.9119999999999999},"min":{"1min":0.224,"5min":0.185,"15min":0.185},"max":{"1min":61.276000000000003,"5min":61.276000000000003,"15min":61.276000000000003},"last":0.437}]},{"osd":2,"last update":"Wed May 8 21:20:14 2024","interfaces":[{"interface":"back","average":{"1min":3.8119999999999998,"5min":2.98,"15min":1.877},"min":{"1min":0.25600000000000001,"5min":0.23499999999999999,"15min":0.224},"max":{"1min":61.043999999999997,"5min":61.043999999999997,"15min":61.043999999999997},"last":0.57199999999999995},{"interface":"front","average":{"1min":3.762,"5min":2.3900000000000001,"15min":1.3069999999999999},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":60.700000000000003,"5min":60.700000000000003,"15min":60.700000000000003},"last":0.49199999999999999}]},{"osd":3,"last update":"Wed May 8 21:20:14 2024","interfaces":[{"interface":"back","average":{"1min":6.7050000000000001,"5min":3.8119999999999998,"15min":2.6110000000000002},"min":{"1min":0.25700000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":92.697000000000003,"5min":92.697000000000003,"15min":92.697000000000003},"last":0.55300000000000005},{"interface":"front","average":{"1min":5.7480000000000002,"5min":2.9590000000000001,"15min":2.0070000000000001},"min":{"1min":0.311,"5min":0.29199999999999998,"15min":0.28899999999999998},"max":{"1min":92.721000000000004,"5min":92.721000000000004,"15min":93.995999999999995},"last":0.59099999999999997}]},{"osd":4,"last update":"Wed May 8 21:20:14 2024","interfaces":[{"interface":"back","average":{"1min":4.1639999999999997,"5min":2.645,"15min":1.9690000000000001},"min":{"1min":0.40300000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":60.953000000000003,"5min":60.953000000000003,"15min":60.953000000000003},"last":0.68400000000000005},{"interface":"front","average":{"1min":4.4779999999999998,"5min":2.7410000000000001,"15min":1.73},"min":{"1min":0.39200000000000002,"5min":0.252,"15min":0.252},"max":{"1min":61.073,"5min":61.073,"15min":61.073},"last":0.60699999999999998}]},{"osd":5,"last update":"Wed May 8 21:20:14 2024","interfaces":[{"interface":"back","average":{"1min":4.5469999999999997,"5min":2.778,"15min":1.7609999999999999},"min":{"1min":0.42799999999999999,"5min":0.311,"15min":0.311},"max":{"1min":60.796999999999997,"5min":60.796999999999997,"15min":60.796999999999997},"last":0.63600000000000001},{"interface":"front","average":{"1min":4.5229999999999997,"5min":2.569,"15min":1.972},"min":{"1min":0.36799999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":61.005000000000003,"5min":61.005000000000003,"15min":61.005000000000003},"last":0.64600000000000002}]},{"osd":6,"last update":"Wed May 8 21:20:14 2024","interfaces":[{"interface":"back","average":{"1min":4.6319999999999997,"5min":2.448,"15min":1.679},"min":{"1min":0.41099999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":60.838000000000001,"5min":60.838000000000001,"15min":60.838000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":4.3200000000000003,"5min":2.819,"15min":1.6830000000000001},"min":{"1min":0.38500000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":61.100000000000001,"5min":61.100000000000001,"15min":61.100000000000001},"last":0.71999999999999997}]},{"osd":7,"last update":"Wed May 8 21:20:14 2024","interfaces":[{"interface":"back","average":{"1min":3.7330000000000001,"5min":2.4569999999999999,"15min":1.843},"min":{"1min":0.35599999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":53.844999999999999,"5min":53.844999999999999,"15min":53.844999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":4.0149999999999997,"5min":2.8159999999999998,"15min":1.6899999999999999},"min":{"1min":0.438,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":61.124000000000002,"5min":61.124000000000002,"15min":61.124000000000002},"last":0.745}]}]},{"osd":7,"up_from":14,"seq":60129542279,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":867812,"kb_used_data":7452,"kb_used_omap":1,"kb_used_meta":860350,"kb_avail":93504028,"statfs":{"total":96636764160,"available":95748124672,"internally_reserved":0,"allocated":7630848,"data_stored":12287392,"data_compressed":917593,"data_compressed_allocated":1265664,"data_compressed_original":6127616,"omap_allocated":1589,"internal_metadata":880998859},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:20:11 2024","interfaces":[{"interface":"back","average":{"1min":1.6100000000000001,"5min":2.2599999999999998,"15min":1.2529999999999999},"min":{"1min":0.26800000000000002,"5min":0.217,"15min":0.20999999999999999},"max":{"1min":6.5570000000000004,"5min":20.876999999999999,"15min":20.876999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":1.337,"5min":2.2280000000000002,"15min":1.5249999999999999},"min":{"1min":0.315,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":7.8840000000000003,"5min":23.748999999999999,"15min":62.033000000000001},"last":0.68600000000000005}]},{"osd":1,"last update":"Wed May 8 21:20:19 2024","interfaces":[{"interface":"back","average":{"1min":1.6619999999999999,"5min":2.8029999999999999,"15min":2.081},"min":{"1min":0.39600000000000002,"5min":0.251,"15min":0.246},"max":{"1min":14.566000000000001,"5min":44.164000000000001,"15min":44.645000000000003},"last":0.78200000000000003},{"interface":"front","average":{"1min":2.6560000000000001,"5min":2.7229999999999999,"15min":1.508},"min":{"1min":0.371,"5min":0.245,"15min":0.245},"max":{"1min":20.672999999999998,"5min":44.091000000000001,"15min":44.091000000000001},"last":0.63600000000000001}]},{"osd":2,"last update":"Wed May 8 21:20:11 2024","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":2.097,"15min":1.1699999999999999},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":6.1989999999999998,"5min":15.986000000000001,"15min":15.986000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.92400000000000004,"5min":1.782,"15min":1.0509999999999999},"min":{"1min":0.30399999999999999,"5min":0.29099999999999998,"15min":0.26100000000000001},"max":{"1min":5.4370000000000003,"5min":11.112,"15min":11.112},"last":0.77000000000000002}]},{"osd":3,"last update":"Wed May 8 21:20:11 2024","interfaces":[{"interface":"back","average":{"1min":2.0819999999999999,"5min":3.0950000000000002,"15min":1.6850000000000001},"min":{"1min":0.307,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":13.513999999999999,"5min":44.064999999999998,"15min":44.064999999999998},"last":0.81499999999999995},{"interface":"front","average":{"1min":1.857,"5min":2.512,"15min":1.788},"min":{"1min":0.38,"5min":0.28399999999999997,"15min":0.27500000000000002},"max":{"1min":13.789,"5min":44.607999999999997,"15min":44.607999999999997},"last":0.67100000000000004}]},{"osd":4,"last update":"Wed May 8 21:20:19 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":1.135,"15min":0.85199999999999998},"min":{"1min":0.28899999999999998,"5min":0.224,"15min":0.224},"max":{"1min":7.6420000000000003,"5min":10.51,"15min":21.338000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.474,"15min":1.002},"min":{"1min":0.26100000000000001,"5min":0.216,"15min":0.216},"max":{"1min":13.146000000000001,"5min":16.082999999999998,"15min":22.827000000000002},"last":0.55500000000000005}]},{"osd":5,"last update":"Wed May 8 21:20:19 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":1.121,"15min":0.86599999999999999},"min":{"1min":0.27500000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":2.5750000000000002,"5min":10.785,"15min":10.880000000000001},"last":0.59699999999999998},{"interface":"front","average":{"1min":1.097,"5min":1.137,"15min":0.88},"min":{"1min":0.35299999999999998,"5min":0.318,"15min":0.29699999999999999},"max":{"1min":7.8620000000000001,"5min":7.8620000000000001,"15min":8.157},"last":0.65000000000000002}]},{"osd":6,"last update":"Wed May 8 21:20:19 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":1.264,"15min":0.88},"min":{"1min":0.28399999999999997,"5min":0.254,"15min":0.254},"max":{"1min":6.2270000000000003,"5min":12.433,"15min":12.433},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.5780000000000001,"15min":1.075},"min":{"1min":0.38,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":3.8210000000000002,"5min":19.864999999999998,"15min":19.864999999999998},"last":0.70799999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574982,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":729956,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":729534,"kb_avail":93641884,"statfs":{"total":96636764160,"available":95889289216,"internally_reserved":0,"allocated":421888,"data_stored":242918,"data_compressed":4766,"data_compressed_allocated":8192,"data_compressed_original":24576,"omap_allocated":1594,"internal_metadata":747043270},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:20:13 2024","interfaces":[{"interface":"back","average":{"1min":2.1459999999999999,"5min":2.5619999999999998,"15min":1.627},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":17.690000000000001,"5min":17.789000000000001,"15min":24.859999999999999},"last":0.26600000000000001},{"interface":"front","average":{"1min":1.429,"5min":2.1419999999999999,"15min":1.4490000000000001},"min":{"1min":0.22500000000000001,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":11.759,"5min":17.835999999999999,"15min":49.606000000000002},"last":0.28299999999999997}]},{"osd":1,"last update":"Wed May 8 21:20:13 2024","interfaces":[{"interface":"back","average":{"1min":3.6709999999999998,"5min":2.6139999999999999,"15min":1.9690000000000001},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.19800000000000001},"max":{"1min":19.904,"5min":24.321999999999999,"15min":55.296999999999997},"last":0.35199999999999998},{"interface":"front","average":{"1min":1.4670000000000001,"5min":2.4399999999999999,"15min":1.782},"min":{"1min":0.254,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":6.3890000000000002,"5min":24.149999999999999,"15min":79.221000000000004},"last":0.313}]},{"osd":3,"last update":"Wed May 8 21:20:13 2024","interfaces":[{"interface":"back","average":{"1min":1.9950000000000001,"5min":4.7050000000000001,"15min":2.2690000000000001},"min":{"1min":0.26100000000000001,"5min":0.249,"15min":0.23699999999999999},"max":{"1min":10.680999999999999,"5min":69.888000000000005,"15min":69.888000000000005},"last":0.45900000000000002},{"interface":"front","average":{"1min":2.0720000000000001,"5min":4.7599999999999998,"15min":2.3100000000000001},"min":{"1min":0.30599999999999999,"5min":0.30199999999999999,"15min":0.23699999999999999},"max":{"1min":10.705,"5min":69.959000000000003,"15min":69.959000000000003},"last":0.52400000000000002}]},{"osd":4,"last update":"Wed May 8 21:20:13 2024","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.786,"15min":1.466},"min":{"1min":0.33700000000000002,"5min":0.29299999999999998,"15min":0.253},"max":{"1min":5.8810000000000002,"5min":17.716999999999999,"15min":32.457999999999998},"last":0.55800000000000005},{"interface":"front","average":{"1min":1.194,"5min":1.7689999999999999,"15min":1.2110000000000001},"min":{"1min":0.28299999999999997,"5min":0.25700000000000001,"15min":0.255},"max":{"1min":5.9640000000000004,"5min":13.827,"15min":18.315000000000001},"last":0.58599999999999997}]},{"osd":5,"last update":"Wed May 8 21:20:13 2024","interfaces":[{"interface":"back","average":{"1min":1.6679999999999999,"5min":1.7649999999999999,"15min":1.153},"min":{"1min":0.434,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":10.627000000000001,"5min":17.507999999999999,"15min":17.507999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":1.0669999999999999,"5min":2.4849999999999999,"15min":1.6519999999999999},"min":{"1min":0.318,"5min":0.30299999999999999,"15min":0.28299999999999997},"max":{"1min":5.9909999999999997,"5min":48.560000000000002,"15min":48.560000000000002},"last":0.54000000000000004}]},{"osd":6,"last update":"Wed May 8 21:20:13 2024","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.752,"15min":1.278},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":5.9160000000000004,"5min":13.933999999999999,"15min":16.399999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":1.837,"5min":2.1230000000000002,"15min":1.3740000000000001},"min":{"1min":0.33600000000000002,"5min":0.33100000000000002,"15min":0.27600000000000002},"max":{"1min":10.538,"5min":17.536000000000001,"15min":23.216000000000001},"last":0.623}]},{"osd":7,"last update":"Wed May 8 21:20:13 2024","interfaces":[{"interface":"back","average":{"1min":1.952,"5min":1.992,"15min":1.3839999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.33000000000000002},"max":{"1min":10.599,"5min":11.041,"15min":16.366},"last":0.64900000000000002},{"interface":"front","average":{"1min":1.946,"5min":1.9379999999999999,"15min":1.232},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.313},"max":{"1min":10.654999999999999,"5min":13.903,"15min":13.903},"last":0.60299999999999998}]}]},{"osd":3,"up_from":14,"seq":60129542275,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1284268,"kb_used_data":5284,"kb_used_omap":1,"kb_used_meta":1278974,"kb_avail":93087572,"statfs":{"total":96636764160,"available":95321673728,"internally_reserved":0,"allocated":5410816,"data_stored":8632198,"data_compressed":770600,"data_compressed_allocated":995328,"data_compressed_original":4419584,"omap_allocated":1592,"internal_metadata":1309669832},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:20:24 2024","interfaces":[{"interface":"back","average":{"1min":1.675,"5min":2.7679999999999998,"15min":1.4790000000000001},"min":{"1min":0.22,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":9.7050000000000001,"5min":39.801000000000002,"15min":39.801000000000002},"last":0.32800000000000001},{"interface":"front","average":{"1min":1.6930000000000001,"5min":1.825,"15min":1.847},"min":{"1min":0.22700000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":8.2379999999999995,"5min":12.999000000000001,"15min":60.847999999999999},"last":0.41199999999999998}]},{"osd":1,"last update":"Wed May 8 21:20:24 2024","interfaces":[{"interface":"back","average":{"1min":3.5579999999999998,"5min":3.7869999999999999,"15min":2.0659999999999998},"min":{"1min":0.28100000000000003,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":43.097000000000001,"5min":47.418999999999997,"15min":57.020000000000003},"last":0.309},{"interface":"front","average":{"1min":2.714,"5min":4.6520000000000001,"15min":2.165},"min":{"1min":0.23799999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":20.542000000000002,"5min":43.317,"15min":43.317},"last":0.377}]},{"osd":2,"last update":"Wed May 8 21:20:24 2024","interfaces":[{"interface":"back","average":{"1min":2.7080000000000002,"5min":1.9139999999999999,"15min":1.262},"min":{"1min":0.25800000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":20.440000000000001,"5min":20.440000000000001,"15min":32.247999999999998},"last":0.36899999999999999},{"interface":"front","average":{"1min":1.4330000000000001,"5min":2.8969999999999998,"15min":1.649},"min":{"1min":0.33600000000000002,"5min":0.312,"15min":0.26200000000000001},"max":{"1min":9.9209999999999994,"5min":39.386000000000003,"15min":39.386000000000003},"last":0.39200000000000002}]},{"osd":4,"last update":"Wed May 8 21:20:24 2024","interfaces":[{"interface":"back","average":{"1min":2.6779999999999999,"5min":1.7989999999999999,"15min":1.7809999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.309},"max":{"1min":13.068,"5min":13.068,"15min":58.072000000000003},"last":0.47199999999999998},{"interface":"front","average":{"1min":2.3319999999999999,"5min":2.4870000000000001,"15min":1.4850000000000001},"min":{"1min":0.38400000000000001,"5min":0.314,"15min":0.314},"max":{"1min":10.382999999999999,"5min":15.712,"15min":26.311},"last":0.49299999999999999}]},{"osd":5,"last update":"Wed May 8 21:20:24 2024","interfaces":[{"interface":"back","average":{"1min":2.113,"5min":1.792,"15min":1.724},"min":{"1min":0.41299999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":9.6630000000000003,"5min":13.962,"15min":60.375999999999998},"last":0.50700000000000001},{"interface":"front","average":{"1min":1.629,"5min":2.7160000000000002,"15min":1.6779999999999999},"min":{"1min":0.374,"5min":0.31,"15min":0.31},"max":{"1min":9.9510000000000005,"5min":39.274000000000001,"15min":39.274000000000001},"last":0.46100000000000002}]},{"osd":6,"last update":"Wed May 8 21:20:24 2024","interfaces":[{"interface":"back","average":{"1min":2.0249999999999999,"5min":3.5230000000000001,"15min":1.956},"min":{"1min":0.40699999999999997,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":11.105,"5min":30.25,"15min":30.25},"last":0.54900000000000004},{"interface":"front","average":{"1min":2.0059999999999998,"5min":3.254,"15min":1.9530000000000001},"min":{"1min":0.40000000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":11.394,"5min":41.323999999999998,"15min":41.323999999999998},"last":0.52800000000000002}]},{"osd":7,"last update":"Wed May 8 21:20:24 2024","interfaces":[{"interface":"back","average":{"1min":2.0680000000000001,"5min":3.536,"15min":1.929},"min":{"1min":0.42699999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":11.029999999999999,"5min":30.295000000000002,"15min":30.295000000000002},"last":0.51900000000000002},{"interface":"front","average":{"1min":2.2770000000000001,"5min":3.895,"15min":2.1219999999999999},"min":{"1min":0.45200000000000001,"5min":0.379,"15min":0.379},"max":{"1min":11.076000000000001,"5min":30.201000000000001,"15min":30.201000000000001},"last":0.443}]}]},{"osd":1,"up_from":15,"seq":64424509572,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1171168,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":1170814,"kb_avail":93200672,"statfs":{"total":96636764160,"available":95437488128,"internally_reserved":0,"allocated":352256,"data_stored":149019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1198913990},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:20:17 2024","interfaces":[{"interface":"back","average":{"1min":4.1159999999999997,"5min":2.488,"15min":1.8879999999999999},"min":{"1min":0.20200000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":35.555999999999997,"5min":35.555999999999997,"15min":68.346999999999994},"last":0.222},{"interface":"front","average":{"1min":2.496,"5min":2.5249999999999999,"15min":1.6120000000000001},"min":{"1min":0.22700000000000001,"5min":0.21199999999999999,"15min":0.19800000000000001},"max":{"1min":21.079000000000001,"5min":21.079000000000001,"15min":25.786000000000001},"last":0.28799999999999998}]},{"osd":2,"last update":"Wed May 8 21:20:17 2024","interfaces":[{"interface":"back","average":{"1min":4.5700000000000003,"5min":3.0409999999999999,"15min":2.468},"min":{"1min":0.217,"5min":0.191,"15min":0.191},"max":{"1min":59.341999999999999,"5min":59.341999999999999,"15min":70.688000000000002},"last":0.33900000000000002},{"interface":"front","average":{"1min":3.7210000000000001,"5min":2.488,"15min":1.9790000000000001},"min":{"1min":0.27900000000000003,"5min":0.22800000000000001,"15min":0.219},"max":{"1min":35.648000000000003,"5min":35.648000000000003,"15min":35.648000000000003},"last":0.35099999999999998}]},{"osd":3,"last update":"Wed May 8 21:20:17 2024","interfaces":[{"interface":"back","average":{"1min":4.2640000000000002,"5min":2.758,"15min":1.8580000000000001},"min":{"1min":0.25,"5min":0.224,"15min":0.224},"max":{"1min":35.601999999999997,"5min":35.601999999999997,"15min":35.658000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":3.4460000000000002,"5min":2.1760000000000002,"15min":1.782},"min":{"1min":0.29799999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":35.628,"5min":35.628,"15min":35.628},"last":0.41799999999999998}]},{"osd":4,"last update":"Wed May 8 21:20:17 2024","interfaces":[{"interface":"back","average":{"1min":3.6429999999999998,"5min":2.2730000000000001,"15min":1.6899999999999999},"min":{"1min":0.40699999999999997,"5min":0.34999999999999998,"15min":0.26900000000000002},"max":{"1min":24.457999999999998,"5min":24.457999999999998,"15min":43.401000000000003},"last":0.55900000000000005},{"interface":"front","average":{"1min":3.1720000000000002,"5min":2.3199999999999998,"15min":1.5049999999999999},"min":{"1min":0.32800000000000001,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":24.553999999999998,"5min":24.553999999999998,"15min":27.239000000000001},"last":0.627}]},{"osd":5,"last update":"Wed May 8 21:20:17 2024","interfaces":[{"interface":"back","average":{"1min":4.0490000000000004,"5min":2.6970000000000001,"15min":1.964},"min":{"1min":0.39800000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":59.378999999999998,"5min":59.378999999999998,"15min":59.378999999999998},"last":0.57499999999999996},{"interface":"front","average":{"1min":3.077,"5min":2.169,"15min":1.7430000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.32300000000000001},"max":{"1min":24.524000000000001,"5min":24.524000000000001,"15min":27.352},"last":0.59499999999999997}]},{"osd":6,"last update":"Wed May 8 21:20:17 2024","interfaces":[{"interface":"back","average":{"1min":4.7549999999999999,"5min":3.0579999999999998,"15min":2.028},"min":{"1min":0.44500000000000001,"5min":0.307,"15min":0.307},"max":{"1min":70.786000000000001,"5min":70.786000000000001,"15min":70.786000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":3.1099999999999999,"5min":2.1739999999999999,"15min":1.5740000000000001},"min":{"1min":0.46000000000000002,"5min":0.35999999999999999,"15min":0.35499999999999998},"max":{"1min":24.588999999999999,"5min":24.588999999999999,"15min":27.376999999999999},"last":0.65700000000000003}]},{"osd":7,"last update":"Wed May 8 21:20:17 2024","interfaces":[{"interface":"back","average":{"1min":3.5419999999999998,"5min":2.8239999999999998,"15min":2.1680000000000001},"min":{"1min":0.46300000000000002,"5min":0.315,"15min":0.315},"max":{"1min":35.683999999999997,"5min":35.683999999999997,"15min":68.287999999999997},"last":0.46700000000000003},{"interface":"front","average":{"1min":3.1389999999999998,"5min":2.1789999999999998,"15min":1.714},"min":{"1min":0.42599999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":24.613,"5min":24.613,"15min":27.312999999999999},"last":0.68000000000000005}]}]},{"osd":4,"up_from":15,"seq":64424509574,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":923444,"kb_used_data":2540,"kb_used_omap":1,"kb_used_meta":920894,"kb_avail":93448396,"statfs":{"total":96636764160,"available":95691157504,"internally_reserved":0,"allocated":2600960,"data_stored":4343289,"data_compressed":367613,"data_compressed_allocated":532480,"data_compressed_original":2482176,"omap_allocated":1593,"internal_metadata":942995911},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:20:23 2024","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.6599999999999999,"15min":1.105},"min":{"1min":0.26700000000000002,"5min":0.218,"15min":0.218},"max":{"1min":12.94,"5min":20.606999999999999,"15min":20.606999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":1.1499999999999999,"5min":2.3660000000000001,"15min":1.798},"min":{"1min":0.23799999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":11.648999999999999,"5min":20.541,"15min":45.499000000000002},"last":0.66000000000000003}]},{"osd":1,"last update":"Wed May 8 21:20:23 2024","interfaces":[{"interface":"back","average":{"1min":2.3500000000000001,"5min":5.2169999999999996,"15min":2.6179999999999999},"min":{"1min":0.28599999999999998,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":11.686,"5min":273.69299999999998,"15min":273.69299999999998},"last":0.627},{"interface":"front","average":{"1min":2.2309999999999999,"5min":5.1539999999999999,"15min":3.1669999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.26200000000000001},"max":{"1min":11.993,"5min":281.21699999999998,"15min":281.21699999999998},"last":0.69299999999999995}]},{"osd":2,"last update":"Wed May 8 21:20:23 2024","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.4319999999999999,"15min":1.446},"min":{"1min":0.377,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":11.568,"5min":11.568,"15min":96.177999999999997},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.628,"5min":1.29,"15min":1.3640000000000001},"min":{"1min":0.34699999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":2.8140000000000001,"5min":16.183,"15min":94.947000000000003},"last":0.56799999999999995}]},{"osd":3,"last update":"Wed May 8 21:20:23 2024","interfaces":[{"interface":"back","average":{"1min":2,"5min":2.286,"15min":1.5249999999999999},"min":{"1min":0.37,"5min":0.30399999999999999,"15min":0.23899999999999999},"max":{"1min":11.721,"5min":18.632000000000001,"15min":30.596},"last":0.57899999999999996},{"interface":"front","average":{"1min":1.3500000000000001,"5min":3.2509999999999999,"15min":1.857},"min":{"1min":0.33400000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":10.567,"5min":42.969000000000001,"15min":42.969000000000001},"last":0.64100000000000001}]},{"osd":5,"last update":"Wed May 8 21:20:23 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":1.3240000000000001,"15min":1.141},"min":{"1min":0.31,"5min":0.26700000000000002,"15min":0.221},"max":{"1min":4.7640000000000002,"5min":16.381,"15min":46.488999999999997},"last":0.42999999999999999},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.3260000000000001,"15min":1.018},"min":{"1min":0.378,"5min":0.307,"15min":0.26200000000000001},"max":{"1min":8.1210000000000004,"5min":16.681000000000001,"15min":45.445999999999998},"last":0.55800000000000005}]},{"osd":6,"last update":"Wed May 8 21:20:23 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":1.8879999999999999,"15min":1.167},"min":{"1min":0.34599999999999997,"5min":0.27500000000000002,"15min":0.26700000000000002},"max":{"1min":8.0980000000000008,"5min":35.289999999999999,"15min":35.289999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.8180000000000001,"15min":1.5389999999999999},"min":{"1min":0.36799999999999999,"5min":0.33600000000000002,"15min":0.28699999999999998},"max":{"1min":8.0660000000000007,"5min":35.311,"15min":46.576999999999998},"last":0.51200000000000001}]},{"osd":7,"last update":"Wed May 8 21:20:23 2024","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.927,"15min":1.1699999999999999},"min":{"1min":0.33400000000000002,"5min":0.29299999999999998,"15min":0.26200000000000001},"max":{"1min":11.592000000000001,"5min":19.077999999999999,"15min":19.077999999999999},"last":0.47999999999999998},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.7070000000000001,"15min":1.0820000000000001},"min":{"1min":0.39400000000000002,"5min":0.30299999999999999,"15min":0.28000000000000003},"max":{"1min":8.1449999999999996,"5min":31.617999999999999,"15min":31.617999999999999},"last":0.59699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32306,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32306,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1585152,"data_stored":3159613,"data_compressed":328373,"data_compressed_allocated":425984,"data_compressed_original":2015232,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":94059,"data_compressed":4766,"data_compressed_allocated":8192,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5066752,"data_stored":8483339,"data_compressed":770600,"data_compressed_allocated":995328,"data_compressed_original":4419584,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2256896,"data_stored":4194430,"data_compressed":367613,"data_compressed_allocated":532480,"data_compressed_original":2482176,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1589248,"data_stored":4194976,"data_compressed":576533,"data_compressed_allocated":724992,"data_compressed_original":3338240,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7221248,"data_stored":11548165,"data_compressed":885287,"data_compressed_allocated":1220608,"data_compressed_original":5554176,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T21:21:00.644 DEBUG:teuthology.orchestra.run.smithi080:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-05-08T21:21:00.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.796+0000 7f148b949700 1 Processor -- start 2024-05-08T21:21:00.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.796+0000 7f148b949700 1 -- start start 2024-05-08T21:21:00.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.797+0000 7f148b949700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f14840ccfe0 0x7f1484071be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:00.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.797+0000 7f148b949700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f14840c8380 0x7f14840c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:00.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.797+0000 7f148b949700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14840c9150 con 0x7f14840ccc00 2024-05-08T21:21:00.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.797+0000 7f148b949700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14840c99f0 con 0x7f14840c8380 2024-05-08T21:21:00.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.797+0000 7f148b949700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14841579c0 con 0x7f14840ccfe0 2024-05-08T21:21:00.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.798+0000 7f1489ee6700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f14840c8380 0x7f14840c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:00.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.798+0000 7f1488ee4700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f14840ccfe0 0x7f1484071be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:00.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.798+0000 7f1489ee6700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f14840c8380 0x7f14840c9e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.80:41886/0 (socket says 172.21.15.80:41886) 2024-05-08T21:21:00.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.798+0000 7f1488ee4700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f14840ccfe0 0x7f1484071be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.80:42086/0 (socket says 172.21.15.80:42086) 2024-05-08T21:21:00.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.798+0000 7f1489ee6700 1 -- 172.21.15.80:0/2116130170 learned_addr learned my addr 172.21.15.80:0/2116130170 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:21:00.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.798+0000 7f14896e5700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f14840ccc00 0x7f1484156ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.80:53442/0 (socket says 172.21.15.80:53442) 2024-05-08T21:21:00.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.798+0000 7f1489ee6700 1 -- 172.21.15.80:0/2116130170 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f14840ccfe0 msgr2=0x7f1484071be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:21:00.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.798+0000 7f1489ee6700 1 --2- 172.21.15.80:0/2116130170 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f14840ccfe0 0x7f1484071be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:00.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.798+0000 7f1489ee6700 1 -- 172.21.15.80:0/2116130170 >> v1:172.21.15.106:6789/0 conn(0x7f14840ccc00 legacy=0x7f1484156ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:00.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.798+0000 7f1489ee6700 1 -- 172.21.15.80:0/2116130170 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1484157ca0 con 0x7f14840c8380 2024-05-08T21:21:00.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.798+0000 7f147bfff700 1 -- 172.21.15.80:0/2116130170 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3797467344 0 0) 0x7f14840c9150 con 0x7f14840ccc00 2024-05-08T21:21:00.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.798+0000 7f1488ee4700 1 --2- 172.21.15.80:0/2116130170 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f14840ccfe0 0x7f1484071be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:21:00.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.798+0000 7f1489ee6700 1 --2- 172.21.15.80:0/2116130170 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14840c8380 0x7f14840c9e80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f147c00d150 tx=0x7f147c00d460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=892e58bf5ed1fe1d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:00.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.798+0000 7f147bfff700 1 -- 172.21.15.80:0/2116130170 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147c010070 con 0x7f14840c8380 2024-05-08T21:21:00.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.798+0000 7f147bfff700 1 -- 172.21.15.80:0/2116130170 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f147c00dd10 con 0x7f14840c8380 2024-05-08T21:21:00.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.798+0000 7f147bfff700 1 -- 172.21.15.80:0/2116130170 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147c00b310 con 0x7f14840c8380 2024-05-08T21:21:00.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.799+0000 7f148b949700 1 -- 172.21.15.80:0/2116130170 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14840c8380 msgr2=0x7f14840c9e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:00.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.799+0000 7f148b949700 1 --2- 172.21.15.80:0/2116130170 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14840c8380 0x7f14840c9e80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f147c00d150 tx=0x7f147c00d460 comp rx=0 tx=0).stop 2024-05-08T21:21:00.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.799+0000 7f148b949700 1 -- 172.21.15.80:0/2116130170 shutdown_connections 2024-05-08T21:21:00.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.799+0000 7f148b949700 1 --2- 172.21.15.80:0/2116130170 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14840c8380 0x7f14840c9e80 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:00.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.799+0000 7f148b949700 1 --2- 172.21.15.80:0/2116130170 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f14840ccfe0 0x7f1484071be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:00.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.799+0000 7f148b949700 1 -- 172.21.15.80:0/2116130170 >> 172.21.15.80:0/2116130170 conn(0x7f148406f140 msgr2=0x7f148406f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:00.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.799+0000 7f148b949700 1 -- 172.21.15.80:0/2116130170 shutdown_connections 2024-05-08T21:21:00.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.799+0000 7f148b949700 1 -- 172.21.15.80:0/2116130170 wait complete. 2024-05-08T21:21:00.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.800+0000 7f148b949700 1 Processor -- start 2024-05-08T21:21:00.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.800+0000 7f148b949700 1 -- start start 2024-05-08T21:21:00.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.801+0000 7f148b949700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f14840c8380 0x7f148414f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:00.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.801+0000 7f148b949700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14840ccc00 0x7f14841eb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:00.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.801+0000 7f148b949700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14840ccfe0 0x7f148414e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:00.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.801+0000 7f148b949700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1484149000 con 0x7f14840ccfe0 2024-05-08T21:21:00.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.801+0000 7f148b949700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f148414b4f0 con 0x7f14840ccc00 2024-05-08T21:21:00.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.801+0000 7f148b949700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f148414a970 con 0x7f14840c8380 2024-05-08T21:21:00.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.801+0000 7f1489ee6700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14840ccfe0 0x7f148414e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:00.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.801+0000 7f1489ee6700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14840ccfe0 0x7f148414e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51298/0 (socket says 172.21.15.80:51298) 2024-05-08T21:21:00.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.801+0000 7f1489ee6700 1 -- 172.21.15.80:0/1283812747 learned_addr learned my addr 172.21.15.80:0/1283812747 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:21:00.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.801+0000 7f14896e5700 1 --2- 172.21.15.80:0/1283812747 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f14840c8380 0x7f148414f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:00.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.801+0000 7f1488ee4700 1 --2- 172.21.15.80:0/1283812747 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14840ccc00 0x7f14841eb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:00.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.801+0000 7f1489ee6700 1 -- 172.21.15.80:0/1283812747 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f14840c8380 msgr2=0x7f148414f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:00.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.801+0000 7f1489ee6700 1 --2- 172.21.15.80:0/1283812747 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f14840c8380 0x7f148414f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:00.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.801+0000 7f1489ee6700 1 -- 172.21.15.80:0/1283812747 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14840ccc00 msgr2=0x7f14841eb9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:00.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.801+0000 7f1489ee6700 1 --2- 172.21.15.80:0/1283812747 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14840ccc00 0x7f14841eb9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:00.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.801+0000 7f1489ee6700 1 -- 172.21.15.80:0/1283812747 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14800094a0 con 0x7f14840ccfe0 2024-05-08T21:21:00.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.802+0000 7f1489ee6700 1 --2- 172.21.15.80:0/1283812747 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14840ccfe0 0x7f148414e1b0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f147c00d7b0 tx=0x7f147c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:00.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.802+0000 7f1479ffb700 1 -- 172.21.15.80:0/1283812747 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147c00b4c0 con 0x7f14840ccfe0 2024-05-08T21:21:00.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.802+0000 7f1479ffb700 1 -- 172.21.15.80:0/1283812747 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f147c00ad60 con 0x7f14840ccfe0 2024-05-08T21:21:00.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.802+0000 7f1479ffb700 1 -- 172.21.15.80:0/1283812747 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147c004280 con 0x7f14840ccfe0 2024-05-08T21:21:00.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.802+0000 7f148b949700 1 -- 172.21.15.80:0/1283812747 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f147c00bd40 con 0x7f14840ccfe0 2024-05-08T21:21:00.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.802+0000 7f148b949700 1 -- 172.21.15.80:0/1283812747 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f148414af30 con 0x7f14840ccfe0 2024-05-08T21:21:00.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.803+0000 7f148b949700 1 -- 172.21.15.80:0/1283812747 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14841593f0 con 0x7f14840ccfe0 2024-05-08T21:21:00.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.803+0000 7f1479ffb700 1 -- 172.21.15.80:0/1283812747 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f147c0043e0 con 0x7f14840ccfe0 2024-05-08T21:21:00.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.804+0000 7f1479ffb700 1 --2- 172.21.15.80:0/1283812747 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f146806ac90 0x7f146806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:00.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.804+0000 7f1479ffb700 1 -- 172.21.15.80:0/1283812747 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f147c08d490 con 0x7f14840ccfe0 2024-05-08T21:21:00.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.804+0000 7f14896e5700 1 --2- 172.21.15.80:0/1283812747 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f146806ac90 0x7f146806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:00.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.804+0000 7f14896e5700 1 --2- 172.21.15.80:0/1283812747 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f146806ac90 0x7f146806d150 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1474000f60 tx=0x7f1474007be0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:00.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:00.808+0000 7f1479ffb700 1 -- 172.21.15.80:0/1283812747 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f14841593f0 con 0x7f14840ccfe0 2024-05-08T21:21:01.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.007+0000 7f148b949700 1 -- 172.21.15.80:0/1283812747 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f14841593f0 con 0x7f14840ccfe0 2024-05-08T21:21:01.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.011+0000 7f1479ffb700 1 -- 172.21.15.80:0/1283812747 <== mon.0 v2:172.21.15.80:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f147c00bbc0 con 0x7f14840ccfe0 2024-05-08T21:21:01.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.011+0000 7f1479ffb700 1 -- 172.21.15.80:0/1283812747 <== mon.0 v2:172.21.15.80:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) v1 ==== 123+0+0 (secure 0 0 0) 0x7f14841593f0 con 0x7f14840ccfe0 2024-05-08T21:21:01.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.014+0000 7f148b949700 1 -- 172.21.15.80:0/1283812747 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f146806ac90 msgr2=0x7f146806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:01.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.014+0000 7f148b949700 1 --2- 172.21.15.80:0/1283812747 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f146806ac90 0x7f146806d150 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1474000f60 tx=0x7f1474007be0 comp rx=0 tx=0).stop 2024-05-08T21:21:01.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.014+0000 7f148b949700 1 -- 172.21.15.80:0/1283812747 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14840ccfe0 msgr2=0x7f148414e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:01.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.014+0000 7f148b949700 1 --2- 172.21.15.80:0/1283812747 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14840ccfe0 0x7f148414e1b0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f147c00d7b0 tx=0x7f147c004ad0 comp rx=0 tx=0).stop 2024-05-08T21:21:01.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.014+0000 7f148b949700 1 -- 172.21.15.80:0/1283812747 shutdown_connections 2024-05-08T21:21:01.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.014+0000 7f148b949700 1 --2- 172.21.15.80:0/1283812747 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f146806ac90 0x7f146806d150 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:01.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.014+0000 7f148b949700 1 --2- 172.21.15.80:0/1283812747 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14840ccfe0 0x7f148414e1b0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:01.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.014+0000 7f148b949700 1 --2- 172.21.15.80:0/1283812747 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f14840c8380 0x7f148414f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:01.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.014+0000 7f148b949700 1 --2- 172.21.15.80:0/1283812747 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14840ccc00 0x7f14841eb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:01.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.014+0000 7f148b949700 1 -- 172.21.15.80:0/1283812747 >> 172.21.15.80:0/1283812747 conn(0x7f148406f140 msgr2=0x7f14841491f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:01.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.014+0000 7f148b949700 1 -- 172.21.15.80:0/1283812747 shutdown_connections 2024-05-08T21:21:01.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.014+0000 7f148b949700 1 -- 172.21.15.80:0/1283812747 wait complete. 2024-05-08T21:21:01.028 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-08T21:21:01.028 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:21:01.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.148+0000 7f29b6641700 1 Processor -- start 2024-05-08T21:21:01.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.148+0000 7f29b6641700 1 -- start start 2024-05-08T21:21:01.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.149+0000 7f29b6641700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f29b01544f0 0x7f29b015d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:01.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.149+0000 7f29b6641700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29b00724c0 con 0x7f29b00b3150 2024-05-08T21:21:01.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.149+0000 7f29b6641700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29b006d300 con 0x7f29b006bad0 2024-05-08T21:21:01.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.149+0000 7f29b6641700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29b00ca4c0 con 0x7f29b01544f0 2024-05-08T21:21:01.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.149+0000 7f29affff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f29b01544f0 0x7f29b015d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:01.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.149+0000 7f29affff700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f29b01544f0 0x7f29b015d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51308/0 (socket says 172.21.15.80:51308) 2024-05-08T21:21:01.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.149+0000 7f29affff700 1 -- 172.21.15.80:0/3816560549 learned_addr learned my addr 172.21.15.80:0/3816560549 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:21:01.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.149+0000 7f29affff700 1 -- 172.21.15.80:0/3816560549 >> v1:172.21.15.106:6789/0 conn(0x7f29b006bad0 legacy=0x7f29b0070210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:21:01.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.149+0000 7f29affff700 1 -- 172.21.15.80:0/3816560549 >> v1:172.21.15.80:6789/0 conn(0x7f29b00b3150 legacy=0x7f29b0164a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:01.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.149+0000 7f29affff700 1 -- 172.21.15.80:0/3816560549 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b00cb5a0 con 0x7f29b01544f0 2024-05-08T21:21:01.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.149+0000 7f29affff700 1 --2- 172.21.15.80:0/3816560549 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29b01544f0 0x7f29b015d690 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f29a00098f0 tx=0x7f29a0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bca9387920d496a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:01.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.149+0000 7f29aeffd700 1 -- 172.21.15.80:0/3816560549 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a0004230 con 0x7f29b01544f0 2024-05-08T21:21:01.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.149+0000 7f29aeffd700 1 -- 172.21.15.80:0/3816560549 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f29a0004390 con 0x7f29b01544f0 2024-05-08T21:21:01.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.149+0000 7f29aeffd700 1 -- 172.21.15.80:0/3816560549 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a00036a0 con 0x7f29b01544f0 2024-05-08T21:21:01.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.150+0000 7f29b6641700 1 -- 172.21.15.80:0/3816560549 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29b01544f0 msgr2=0x7f29b015d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:01.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.150+0000 7f29b6641700 1 --2- 172.21.15.80:0/3816560549 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29b01544f0 0x7f29b015d690 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f29a00098f0 tx=0x7f29a0009c00 comp rx=0 tx=0).stop 2024-05-08T21:21:01.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.150+0000 7f29b6641700 1 -- 172.21.15.80:0/3816560549 shutdown_connections 2024-05-08T21:21:01.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.150+0000 7f29b6641700 1 --2- 172.21.15.80:0/3816560549 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29b01544f0 0x7f29b015d690 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:01.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.150+0000 7f29b6641700 1 -- 172.21.15.80:0/3816560549 >> 172.21.15.80:0/3816560549 conn(0x7f29b006a9c0 msgr2=0x7f29b006add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:01.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.150+0000 7f29b6641700 1 -- 172.21.15.80:0/3816560549 shutdown_connections 2024-05-08T21:21:01.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.150+0000 7f29b6641700 1 -- 172.21.15.80:0/3816560549 wait complete. 2024-05-08T21:21:01.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.151+0000 7f29b6641700 1 Processor -- start 2024-05-08T21:21:01.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.151+0000 7f29b6641700 1 -- start start 2024-05-08T21:21:01.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.152+0000 7f29b6641700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29b006bad0 0x7f29b00cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:01.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.152+0000 7f29b6641700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29b00b3150 0x7f29b0152b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:01.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.152+0000 7f29b6641700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f29b01544f0 0x7f29b014c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:01.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.152+0000 7f29b6641700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b00cdb10 con 0x7f29b00b3150 2024-05-08T21:21:01.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.152+0000 7f29b6641700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b01f0c00 con 0x7f29b006bad0 2024-05-08T21:21:01.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.152+0000 7f29b6641700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29b00ccb80 con 0x7f29b01544f0 2024-05-08T21:21:01.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.152+0000 7f29af7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29b00b3150 0x7f29b0152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:01.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.152+0000 7f29af7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29b00b3150 0x7f29b0152b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51320/0 (socket says 172.21.15.80:51320) 2024-05-08T21:21:01.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.152+0000 7f29af7fe700 1 -- 172.21.15.80:0/2227331253 learned_addr learned my addr 172.21.15.80:0/2227331253 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:21:01.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.152+0000 7f29affff700 1 --2- 172.21.15.80:0/2227331253 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29b006bad0 0x7f29b00cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:01.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.152+0000 7f29b4bde700 1 --2- 172.21.15.80:0/2227331253 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f29b01544f0 0x7f29b014c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:01.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.152+0000 7f29af7fe700 1 -- 172.21.15.80:0/2227331253 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f29b01544f0 msgr2=0x7f29b014c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:01.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.152+0000 7f29af7fe700 1 --2- 172.21.15.80:0/2227331253 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f29b01544f0 0x7f29b014c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:01.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.152+0000 7f29af7fe700 1 -- 172.21.15.80:0/2227331253 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29b006bad0 msgr2=0x7f29b00cd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:01.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.152+0000 7f29af7fe700 1 --2- 172.21.15.80:0/2227331253 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29b006bad0 0x7f29b00cd5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:01.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.152+0000 7f29af7fe700 1 -- 172.21.15.80:0/2227331253 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29a0009550 con 0x7f29b00b3150 2024-05-08T21:21:01.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.152+0000 7f29affff700 1 --2- 172.21.15.80:0/2227331253 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29b006bad0 0x7f29b00cd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:21:01.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.152+0000 7f29b4bde700 1 --2- 172.21.15.80:0/2227331253 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f29b01544f0 0x7f29b014c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:21:01.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.153+0000 7f29af7fe700 1 --2- 172.21.15.80:0/2227331253 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29b00b3150 0x7f29b0152b90 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f29a400c4d0 tx=0x7f29a400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:01.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.153+0000 7f29acff9700 1 -- 172.21.15.80:0/2227331253 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a40054e0 con 0x7f29b00b3150 2024-05-08T21:21:01.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.153+0000 7f29acff9700 1 -- 172.21.15.80:0/2227331253 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f29a4003680 con 0x7f29b00b3150 2024-05-08T21:21:01.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.153+0000 7f29acff9700 1 -- 172.21.15.80:0/2227331253 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a4003a50 con 0x7f29b00b3150 2024-05-08T21:21:01.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.153+0000 7f29b6641700 1 -- 172.21.15.80:0/2227331253 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29b00cd140 con 0x7f29b00b3150 2024-05-08T21:21:01.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.153+0000 7f29b6641700 1 -- 172.21.15.80:0/2227331253 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29b014d3b0 con 0x7f29b00b3150 2024-05-08T21:21:01.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.154+0000 7f29b6641700 1 -- 172.21.15.80:0/2227331253 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29b00cd2d0 con 0x7f29b00b3150 2024-05-08T21:21:01.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.154+0000 7f29acff9700 1 -- 172.21.15.80:0/2227331253 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f29a4003bb0 con 0x7f29b00b3150 2024-05-08T21:21:01.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.154+0000 7f29acff9700 1 --2- 172.21.15.80:0/2227331253 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f299c06ac90 0x7f299c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:01.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.155+0000 7f29acff9700 1 -- 172.21.15.80:0/2227331253 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f29a4088870 con 0x7f29b00b3150 2024-05-08T21:21:01.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.155+0000 7f29affff700 1 --2- 172.21.15.80:0/2227331253 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f299c06ac90 0x7f299c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:01.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.155+0000 7f29affff700 1 --2- 172.21.15.80:0/2227331253 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f299c06ac90 0x7f299c06d150 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f29a0009130 tx=0x7f29a0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:01.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.159+0000 7f29acff9700 1 -- 172.21.15.80:0/2227331253 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f29a4053540 con 0x7f29b00b3150 2024-05-08T21:21:01.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.402+0000 7f29b6641700 1 -- 172.21.15.80:0/2227331253 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f29b004ec60 con 0x7f29b00b3150 2024-05-08T21:21:01.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.402+0000 7f29acff9700 1 -- 172.21.15.80:0/2227331253 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+6255 (secure 0 0 0) 0x7f29a4003e60 con 0x7f29b00b3150 2024-05-08T21:21:01.404 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:21:01.404 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4937,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/1705999583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":1705999583},{"type":"v1","addr":"172.21.15.106:6833","nonce":1705999583}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:19:22.807886+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5158},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5158":{"gid":5158,"name":"d","rank":0,"incarnation":26,"state":"up:active","state_seq":27,"addr":"172.21.15.106:6836/959295764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":959295764},{"type":"v1","addr":"172.21.15.106:6836","nonce":959295764}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:21:01.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.405+0000 7f29b6641700 1 -- 172.21.15.80:0/2227331253 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f299c06ac90 msgr2=0x7f299c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:01.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.405+0000 7f29b6641700 1 --2- 172.21.15.80:0/2227331253 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f299c06ac90 0x7f299c06d150 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f29a0009130 tx=0x7f29a0008030 comp rx=0 tx=0).stop 2024-05-08T21:21:01.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.405+0000 7f29b6641700 1 -- 172.21.15.80:0/2227331253 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29b00b3150 msgr2=0x7f29b0152b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:01.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.405+0000 7f29b6641700 1 --2- 172.21.15.80:0/2227331253 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29b00b3150 0x7f29b0152b90 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f29a400c4d0 tx=0x7f29a400c890 comp rx=0 tx=0).stop 2024-05-08T21:21:01.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.405+0000 7f29b6641700 1 -- 172.21.15.80:0/2227331253 shutdown_connections 2024-05-08T21:21:01.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.405+0000 7f29b6641700 1 --2- 172.21.15.80:0/2227331253 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f299c06ac90 0x7f299c06d150 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:01.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.405+0000 7f29b6641700 1 --2- 172.21.15.80:0/2227331253 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f29b01544f0 0x7f29b014c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:01.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.405+0000 7f29b6641700 1 --2- 172.21.15.80:0/2227331253 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29b006bad0 0x7f29b00cd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:01.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.405+0000 7f29b6641700 1 --2- 172.21.15.80:0/2227331253 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f29b00b3150 0x7f29b0152b90 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:01.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.405+0000 7f29b6641700 1 -- 172.21.15.80:0/2227331253 >> 172.21.15.80:0/2227331253 conn(0x7f29b006a9c0 msgr2=0x7f29b0159890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:01.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.405+0000 7f29b6641700 1 -- 172.21.15.80:0/2227331253 shutdown_connections 2024-05-08T21:21:01.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.405+0000 7f29b6641700 1 -- 172.21.15.80:0/2227331253 wait complete. 2024-05-08T21:21:01.407 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 30 2024-05-08T21:21:01.418 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:21:01.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.538+0000 7f78be89f700 1 Processor -- start 2024-05-08T21:21:01.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.538+0000 7f78be89f700 1 -- start start 2024-05-08T21:21:01.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.539+0000 7f78be89f700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f78b8151010 0x7f78b815aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:01.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.539+0000 7f78be89f700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f78b8156dc0 0x7f78b80c8150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:01.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.539+0000 7f78be89f700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f78b815aff0 0x7f78b80c8690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:01.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.540+0000 7f78be89f700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78b815a3b0 con 0x7f78b8156dc0 2024-05-08T21:21:01.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.540+0000 7f78be89f700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78b815a690 con 0x7f78b8151010 2024-05-08T21:21:01.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.540+0000 7f78be89f700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78b8071850 con 0x7f78b815aff0 2024-05-08T21:21:01.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.540+0000 7f78b77fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f78b8156dc0 0x7f78b80c8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:01.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.540+0000 7f78b77fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f78b8156dc0 0x7f78b80c8150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51330/0 (socket says 172.21.15.80:51330) 2024-05-08T21:21:01.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.540+0000 7f78b77fe700 1 -- 172.21.15.80:0/1604013526 learned_addr learned my addr 172.21.15.80:0/1604013526 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:21:01.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.540+0000 7f78b7fff700 1 --2- 172.21.15.80:0/1604013526 >> v2:172.21.15.106:3300/0 conn(0x7f78b8151010 0x7f78b815aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:01.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.540+0000 7f78bce3c700 1 --2- 172.21.15.80:0/1604013526 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f78b815aff0 0x7f78b80c8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:01.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.540+0000 7f78b77fe700 1 -- 172.21.15.80:0/1604013526 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f78b815aff0 msgr2=0x7f78b80c8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:21:01.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.540+0000 7f78b77fe700 1 --2- 172.21.15.80:0/1604013526 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f78b815aff0 0x7f78b80c8690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:01.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.540+0000 7f78b77fe700 1 -- 172.21.15.80:0/1604013526 >> v2:172.21.15.106:3300/0 conn(0x7f78b8151010 msgr2=0x7f78b815aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:21:01.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.540+0000 7f78b77fe700 1 --2- 172.21.15.80:0/1604013526 >> v2:172.21.15.106:3300/0 conn(0x7f78b8151010 0x7f78b815aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:01.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.540+0000 7f78b77fe700 1 -- 172.21.15.80:0/1604013526 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b81572b0 con 0x7f78b8156dc0 2024-05-08T21:21:01.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.540+0000 7f78bce3c700 1 --2- 172.21.15.80:0/1604013526 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f78b815aff0 0x7f78b80c8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:21:01.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.540+0000 7f78b77fe700 1 --2- 172.21.15.80:0/1604013526 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78b8156dc0 0x7f78b80c8150 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f78b806cb90 tx=0x7f78ac009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ec07e62e45192d0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:01.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.540+0000 7f78b6ffd700 1 -- 172.21.15.80:0/1604013526 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ac011830 con 0x7f78b8156dc0 2024-05-08T21:21:01.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.540+0000 7f78b6ffd700 1 -- 172.21.15.80:0/1604013526 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f78ac011990 con 0x7f78b8156dc0 2024-05-08T21:21:01.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.540+0000 7f78b6ffd700 1 -- 172.21.15.80:0/1604013526 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ac011d40 con 0x7f78b8156dc0 2024-05-08T21:21:01.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.541+0000 7f78be89f700 1 -- 172.21.15.80:0/1604013526 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78b8156dc0 msgr2=0x7f78b80c8150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:01.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.541+0000 7f78be89f700 1 --2- 172.21.15.80:0/1604013526 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78b8156dc0 0x7f78b80c8150 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f78b806cb90 tx=0x7f78ac009c00 comp rx=0 tx=0).stop 2024-05-08T21:21:01.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.541+0000 7f78be89f700 1 -- 172.21.15.80:0/1604013526 shutdown_connections 2024-05-08T21:21:01.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.541+0000 7f78be89f700 1 --2- 172.21.15.80:0/1604013526 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f78b815aff0 0x7f78b80c8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:01.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.541+0000 7f78be89f700 1 --2- 172.21.15.80:0/1604013526 >> v2:172.21.15.106:3300/0 conn(0x7f78b8151010 0x7f78b815aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:01.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.541+0000 7f78be89f700 1 --2- 172.21.15.80:0/1604013526 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78b8156dc0 0x7f78b80c8150 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:01.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.541+0000 7f78be89f700 1 -- 172.21.15.80:0/1604013526 >> 172.21.15.80:0/1604013526 conn(0x7f78b80c9310 msgr2=0x7f78b80c9720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:01.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.541+0000 7f78be89f700 1 -- 172.21.15.80:0/1604013526 shutdown_connections 2024-05-08T21:21:01.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.541+0000 7f78be89f700 1 -- 172.21.15.80:0/1604013526 wait complete. 2024-05-08T21:21:01.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.542+0000 7f78be89f700 1 Processor -- start 2024-05-08T21:21:01.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.542+0000 7f78be89f700 1 -- start start 2024-05-08T21:21:01.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.543+0000 7f78be89f700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78b8151010 0x7f78b81f39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:01.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.543+0000 7f78be89f700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f78b8156dc0 0x7f78b81591f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:01.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.543+0000 7f78be89f700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f78b815aff0 0x7f78b81ef900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:01.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.543+0000 7f78be89f700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b81efe40 con 0x7f78b8151010 2024-05-08T21:21:01.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.543+0000 7f78be89f700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b8159bf0 con 0x7f78b815aff0 2024-05-08T21:21:01.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.543+0000 7f78be89f700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78b815a190 con 0x7f78b8156dc0 2024-05-08T21:21:01.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.543+0000 7f78b7fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78b8151010 0x7f78b81f39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:01.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.543+0000 7f78b7fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78b8151010 0x7f78b81f39f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51336/0 (socket says 172.21.15.80:51336) 2024-05-08T21:21:01.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.543+0000 7f78b7fff700 1 -- 172.21.15.80:0/1303974974 learned_addr learned my addr 172.21.15.80:0/1303974974 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:21:01.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.543+0000 7f78bce3c700 1 --2- 172.21.15.80:0/1303974974 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f78b815aff0 0x7f78b81ef900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:01.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.543+0000 7f78b77fe700 1 --2- 172.21.15.80:0/1303974974 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f78b8156dc0 0x7f78b81591f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:01.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.543+0000 7f78b7fff700 1 -- 172.21.15.80:0/1303974974 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f78b8156dc0 msgr2=0x7f78b81591f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:01.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.543+0000 7f78b7fff700 1 --2- 172.21.15.80:0/1303974974 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f78b8156dc0 0x7f78b81591f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:01.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.543+0000 7f78b7fff700 1 -- 172.21.15.80:0/1303974974 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f78b815aff0 msgr2=0x7f78b81ef900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:01.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.543+0000 7f78b7fff700 1 --2- 172.21.15.80:0/1303974974 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f78b815aff0 0x7f78b81ef900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:01.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.543+0000 7f78b7fff700 1 -- 172.21.15.80:0/1303974974 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78ac009550 con 0x7f78b8151010 2024-05-08T21:21:01.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.543+0000 7f78b7fff700 1 --2- 172.21.15.80:0/1303974974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78b8151010 0x7f78b81f39f0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f78a800e930 tx=0x7f78a800ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:01.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.544+0000 7f78b4ff9700 1 -- 172.21.15.80:0/1303974974 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a8009690 con 0x7f78b8151010 2024-05-08T21:21:01.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.544+0000 7f78b4ff9700 1 -- 172.21.15.80:0/1303974974 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f78a800c850 con 0x7f78b8151010 2024-05-08T21:21:01.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.544+0000 7f78b4ff9700 1 -- 172.21.15.80:0/1303974974 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a800cc00 con 0x7f78b8151010 2024-05-08T21:21:01.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.544+0000 7f78be89f700 1 -- 172.21.15.80:0/1303974974 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78b8159eb0 con 0x7f78b8151010 2024-05-08T21:21:01.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.544+0000 7f78be89f700 1 -- 172.21.15.80:0/1303974974 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78b81f31f0 con 0x7f78b8151010 2024-05-08T21:21:01.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.545+0000 7f78be89f700 1 -- 172.21.15.80:0/1303974974 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78b804ec60 con 0x7f78b8151010 2024-05-08T21:21:01.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.545+0000 7f78b4ff9700 1 -- 172.21.15.80:0/1303974974 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f78a8013470 con 0x7f78b8151010 2024-05-08T21:21:01.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.545+0000 7f78b4ff9700 1 --2- 172.21.15.80:0/1303974974 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f78a406ac90 0x7f78a406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:01.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.546+0000 7f78b4ff9700 1 -- 172.21.15.80:0/1303974974 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f78a8089a20 con 0x7f78b8151010 2024-05-08T21:21:01.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.546+0000 7f78b77fe700 1 --2- 172.21.15.80:0/1303974974 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f78a406ac90 0x7f78a406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:01.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.546+0000 7f78b77fe700 1 --2- 172.21.15.80:0/1303974974 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f78a406ac90 0x7f78a406d150 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f78ac009870 tx=0x7f78ac008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:01.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.550+0000 7f78b4ff9700 1 -- 172.21.15.80:0/1303974974 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f78a80545d0 con 0x7f78b8151010 2024-05-08T21:21:01.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.790+0000 7f78be89f700 1 -- 172.21.15.80:0/1303974974 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f78b80c96f0 con 0x7f78b8151010 2024-05-08T21:21:01.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.791+0000 7f78b4ff9700 1 -- 172.21.15.80:0/1303974974 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+6255 (secure 0 0 0) 0x7f78a8017090 con 0x7f78b8151010 2024-05-08T21:21:01.792 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:21:01.792 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2762323230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2762323230},{"type":"v1","addr":"172.21.15.106:6837","nonce":2762323230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/1121814432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":1121814432},{"type":"v1","addr":"172.21.15.80:6837","nonce":1121814432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6839/1867024080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6838","nonce":1867024080},{"type":"v1","addr":"172.21.15.80:6839","nonce":1867024080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/1947012643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":1947012643},{"type":"v1","addr":"172.21.15.80:6836","nonce":1947012643}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4937,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/1705999583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":1705999583},{"type":"v1","addr":"172.21.15.106:6833","nonce":1705999583}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T21:10:03.725481+0000","modified":"2024-05-08T21:19:22.807886+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5158},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5158":{"gid":5158,"name":"d","rank":0,"incarnation":26,"state":"up:active","state_seq":27,"addr":"172.21.15.106:6836/959295764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":959295764},{"type":"v1","addr":"172.21.15.106:6836","nonce":959295764}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:21:01.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.793+0000 7f78be89f700 1 -- 172.21.15.80:0/1303974974 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f78a406ac90 msgr2=0x7f78a406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:01.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.793+0000 7f78be89f700 1 --2- 172.21.15.80:0/1303974974 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f78a406ac90 0x7f78a406d150 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f78ac009870 tx=0x7f78ac008030 comp rx=0 tx=0).stop 2024-05-08T21:21:01.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.793+0000 7f78be89f700 1 -- 172.21.15.80:0/1303974974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78b8151010 msgr2=0x7f78b81f39f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:01.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.793+0000 7f78be89f700 1 --2- 172.21.15.80:0/1303974974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78b8151010 0x7f78b81f39f0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f78a800e930 tx=0x7f78a800ecf0 comp rx=0 tx=0).stop 2024-05-08T21:21:01.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.793+0000 7f78be89f700 1 -- 172.21.15.80:0/1303974974 shutdown_connections 2024-05-08T21:21:01.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.793+0000 7f78be89f700 1 --2- 172.21.15.80:0/1303974974 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f78a406ac90 0x7f78a406d150 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:01.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.793+0000 7f78be89f700 1 --2- 172.21.15.80:0/1303974974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78b8151010 0x7f78b81f39f0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:01.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.793+0000 7f78be89f700 1 --2- 172.21.15.80:0/1303974974 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f78b815aff0 0x7f78b81ef900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:01.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.793+0000 7f78be89f700 1 --2- 172.21.15.80:0/1303974974 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f78b8156dc0 0x7f78b81591f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:01.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.793+0000 7f78be89f700 1 -- 172.21.15.80:0/1303974974 >> 172.21.15.80:0/1303974974 conn(0x7f78b80c9310 msgr2=0x7f78b8154ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:01.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.793+0000 7f78be89f700 1 -- 172.21.15.80:0/1303974974 shutdown_connections 2024-05-08T21:21:01.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.793+0000 7f78be89f700 1 -- 172.21.15.80:0/1303974974 wait complete. 2024-05-08T21:21:01.796 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 30 2024-05-08T21:21:01.807 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T21:21:01.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.927+0000 7f573e493700 1 Processor -- start 2024-05-08T21:21:01.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.927+0000 7f573e493700 1 -- start start 2024-05-08T21:21:01.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.927+0000 7f573e493700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f57381433e0 0x7f5738071e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:01.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.927+0000 7f573e493700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f573806edd0 con 0x7f573806f4b0 2024-05-08T21:21:01.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.927+0000 7f573e493700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f573815a090 con 0x7f57380c7050 2024-05-08T21:21:01.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.927+0000 7f573e493700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f573806fa10 con 0x7f57381433e0 2024-05-08T21:21:01.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.928+0000 7f573ca30700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f573806f4b0 0x7f573815b580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:43148/0 (socket says 172.21.15.80:43148) 2024-05-08T21:21:01.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.928+0000 7f573ca30700 1 -- 172.21.15.80:0/1886734902 learned_addr learned my addr 172.21.15.80:0/1886734902 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:21:01.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.928+0000 7f5737fff700 1 --2- 172.21.15.80:0/1886734902 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f57381433e0 0x7f5738071e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:01.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.928+0000 7f5736ffd700 1 -- 172.21.15.80:0/1886734902 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 548354528 0 0) 0x7f573806edd0 con 0x7f573806f4b0 2024-05-08T21:21:01.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.928+0000 7f5736ffd700 1 -- 172.21.15.80:0/1886734902 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57200035b0 con 0x7f573806f4b0 2024-05-08T21:21:01.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.928+0000 7f5736ffd700 1 -- 172.21.15.80:0/1886734902 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2167077307 0 0) 0x7f57200035b0 con 0x7f573806f4b0 2024-05-08T21:21:01.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.928+0000 7f5736ffd700 1 -- 172.21.15.80:0/1886734902 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f57381433e0 msgr2=0x7f5738071e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:21:01.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.928+0000 7f5736ffd700 1 --2- 172.21.15.80:0/1886734902 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f57381433e0 0x7f5738071e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:01.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.928+0000 7f5736ffd700 1 -- 172.21.15.80:0/1886734902 >> v1:172.21.15.106:6789/0 conn(0x7f57380c7050 legacy=0x7f573806a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:01.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.928+0000 7f5736ffd700 1 -- 172.21.15.80:0/1886734902 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f573815a310 con 0x7f573806f4b0 2024-05-08T21:21:01.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.928+0000 7f5736ffd700 1 -- 172.21.15.80:0/1886734902 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3520646302 0 0) 0x7f57300019f0 con 0x7f573806f4b0 2024-05-08T21:21:01.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.928+0000 7f5736ffd700 1 -- 172.21.15.80:0/1886734902 >> v1:172.21.15.80:6789/0 conn(0x7f573806f4b0 legacy=0x7f573815b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:01.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.928+0000 7f5736ffd700 1 --2- 172.21.15.80:0/1886734902 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5720003a30 0x7f5720003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:01.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.928+0000 7f5736ffd700 1 --2- 172.21.15.80:0/1886734902 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57200043e0 0x7f57200048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:01.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.928+0000 7f5736ffd700 1 --2- 172.21.15.80:0/1886734902 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f57381433e0 0x7f5720005110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:01.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.928+0000 7f5736ffd700 1 -- 172.21.15.80:0/1886734902 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f573806fa10 con 0x7f57200043e0 2024-05-08T21:21:01.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.928+0000 7f5736ffd700 1 -- 172.21.15.80:0/1886734902 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f572000ba10 con 0x7f5720003a30 2024-05-08T21:21:01.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.928+0000 7f5736ffd700 1 -- 172.21.15.80:0/1886734902 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f572000bbd0 con 0x7f57381433e0 2024-05-08T21:21:01.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.928+0000 7f57377fe700 1 --2- 172.21.15.80:0/1886734902 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57200043e0 0x7f57200048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:01.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.928+0000 7f5737fff700 1 --2- 172.21.15.80:0/1886734902 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5720003a30 0x7f5720003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:01.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.928+0000 7f573ca30700 1 --2- 172.21.15.80:0/1886734902 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f57381433e0 0x7f5720005110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:01.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.928+0000 7f57377fe700 1 -- 172.21.15.80:0/1886734902 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f57381433e0 msgr2=0x7f5720005110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:21:01.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.928+0000 7f57377fe700 1 --2- 172.21.15.80:0/1886734902 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f57381433e0 0x7f5720005110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:01.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.928+0000 7f57377fe700 1 -- 172.21.15.80:0/1886734902 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5720003a30 msgr2=0x7f5720003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:21:01.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.928+0000 7f57377fe700 1 --2- 172.21.15.80:0/1886734902 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5720003a30 0x7f5720003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:01.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.929+0000 7f57377fe700 1 -- 172.21.15.80:0/1886734902 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57200035b0 con 0x7f57200043e0 2024-05-08T21:21:01.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.929+0000 7f57377fe700 1 --2- 172.21.15.80:0/1886734902 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57200043e0 0x7f57200048b0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f572c0018b0 tx=0x7f5720005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9549b4ad5ec56754 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:01.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.929+0000 7f5736ffd700 1 -- 172.21.15.80:0/1886734902 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572c001370 con 0x7f57200043e0 2024-05-08T21:21:01.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.929+0000 7f5736ffd700 1 -- 172.21.15.80:0/1886734902 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f572c00c6b0 con 0x7f57200043e0 2024-05-08T21:21:01.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.929+0000 7f5736ffd700 1 -- 172.21.15.80:0/1886734902 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572c00ca80 con 0x7f57200043e0 2024-05-08T21:21:01.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.929+0000 7f573e493700 1 -- 172.21.15.80:0/1886734902 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57200043e0 msgr2=0x7f57200048b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:01.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.929+0000 7f573e493700 1 --2- 172.21.15.80:0/1886734902 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57200043e0 0x7f57200048b0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f572c0018b0 tx=0x7f5720005880 comp rx=0 tx=0).stop 2024-05-08T21:21:01.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.929+0000 7f573ca30700 1 -- 172.21.15.80:0/1886734902 reap_dead start 2024-05-08T21:21:01.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.929+0000 7f573e493700 1 -- 172.21.15.80:0/1886734902 shutdown_connections 2024-05-08T21:21:01.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.929+0000 7f573e493700 1 -- 172.21.15.80:0/1886734902 >> 172.21.15.80:0/1886734902 conn(0x7f573806bad0 msgr2=0x7f573806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:01.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.929+0000 7f573e493700 1 -- 172.21.15.80:0/1886734902 shutdown_connections 2024-05-08T21:21:01.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.929+0000 7f573e493700 1 -- 172.21.15.80:0/1886734902 wait complete. 2024-05-08T21:21:01.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.931+0000 7f573e493700 1 Processor -- start 2024-05-08T21:21:01.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.931+0000 7f573e493700 1 -- start start 2024-05-08T21:21:01.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.931+0000 7f573e493700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57200043e0 0x7f57381f0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:01.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.931+0000 7f573e493700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f57380c8e60 0x7f57381595b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:01.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.931+0000 7f573e493700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f573813cdc0 0x7f57381f2e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:01.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.931+0000 7f573e493700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57380c9bb0 con 0x7f57200043e0 2024-05-08T21:21:01.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.931+0000 7f573e493700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f573813c930 con 0x7f57380c8e60 2024-05-08T21:21:01.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.931+0000 7f573e493700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57381f08a0 con 0x7f573813cdc0 2024-05-08T21:21:01.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.932+0000 7f5737fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57200043e0 0x7f57381f0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:01.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.932+0000 7f5737fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57200043e0 0x7f57381f0360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51342/0 (socket says 172.21.15.80:51342) 2024-05-08T21:21:01.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.932+0000 7f5737fff700 1 -- 172.21.15.80:0/2696183928 learned_addr learned my addr 172.21.15.80:0/2696183928 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:21:01.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.932+0000 7f57377fe700 1 --2- 172.21.15.80:0/2696183928 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f57380c8e60 0x7f57381595b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:01.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.932+0000 7f573ca30700 1 --2- 172.21.15.80:0/2696183928 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f573813cdc0 0x7f57381f2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:01.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.932+0000 7f5737fff700 1 -- 172.21.15.80:0/2696183928 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f573813cdc0 msgr2=0x7f57381f2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:01.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.932+0000 7f5737fff700 1 --2- 172.21.15.80:0/2696183928 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f573813cdc0 0x7f57381f2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:01.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.932+0000 7f5737fff700 1 -- 172.21.15.80:0/2696183928 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f57380c8e60 msgr2=0x7f57381595b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:01.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.932+0000 7f5737fff700 1 --2- 172.21.15.80:0/2696183928 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f57380c8e60 0x7f57381595b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:01.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.932+0000 7f5737fff700 1 -- 172.21.15.80:0/2696183928 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f573815b2c0 con 0x7f57200043e0 2024-05-08T21:21:01.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.932+0000 7f57377fe700 1 --2- 172.21.15.80:0/2696183928 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f57380c8e60 0x7f57381595b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:21:01.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.932+0000 7f5737fff700 1 --2- 172.21.15.80:0/2696183928 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57200043e0 0x7f57381f0360 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f57280119a0 tx=0x7f5728011d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:01.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.932+0000 7f5734ff9700 1 -- 172.21.15.80:0/2696183928 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572800f8e0 con 0x7f57200043e0 2024-05-08T21:21:01.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.932+0000 7f5734ff9700 1 -- 172.21.15.80:0/2696183928 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f572800fa40 con 0x7f57200043e0 2024-05-08T21:21:01.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.932+0000 7f573e493700 1 -- 172.21.15.80:0/2696183928 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57380c9310 con 0x7f57200043e0 2024-05-08T21:21:01.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.932+0000 7f5734ff9700 1 -- 172.21.15.80:0/2696183928 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572800fdf0 con 0x7f57200043e0 2024-05-08T21:21:01.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.932+0000 7f573e493700 1 -- 172.21.15.80:0/2696183928 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57380c98d0 con 0x7f57200043e0 2024-05-08T21:21:01.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.933+0000 7f573e493700 1 -- 172.21.15.80:0/2696183928 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f573806eb00 con 0x7f57200043e0 2024-05-08T21:21:01.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.934+0000 7f5734ff9700 1 -- 172.21.15.80:0/2696183928 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5728014440 con 0x7f57200043e0 2024-05-08T21:21:01.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.934+0000 7f5734ff9700 1 --2- 172.21.15.80:0/2696183928 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f572406ac90 0x7f572406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:01.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.934+0000 7f5734ff9700 1 -- 172.21.15.80:0/2696183928 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f5728089f60 con 0x7f57200043e0 2024-05-08T21:21:01.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.934+0000 7f57377fe700 1 --2- 172.21.15.80:0/2696183928 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f572406ac90 0x7f572406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:01.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.935+0000 7f57377fe700 1 --2- 172.21.15.80:0/2696183928 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f572406ac90 0x7f572406d150 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f572c014040 tx=0x7f572c005040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:01.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:01.939+0000 7f5734ff9700 1 -- 172.21.15.80:0/2696183928 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f5728054ba0 con 0x7f57200043e0 2024-05-08T21:21:02.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.137+0000 7f573e493700 1 -- 172.21.15.80:0/2696183928 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f573804ec60 con 0x7f57200043e0 2024-05-08T21:21:02.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.138+0000 7f5734ff9700 1 -- 172.21.15.80:0/2696183928 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+18793 (secure 0 0 0) 0x7f57280581c0 con 0x7f57200043e0 2024-05-08T21:21:02.141 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T21:21:02.141 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":32,"fsid":"44d31c1e-aad3-47ca-a4fa-85a63d4a60aa","created":"2024-05-08T21:09:46.467038+0000","modified":"2024-05-08T21:19:06.330550+0000","last_up_change":"2024-05-08T21:09:57.284675+0000","last_in_change":"2024-05-08T21:09:49.125444+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T21:09:58.238951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T21:10:02.177476+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T21:10:02.685535+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-08T21:10:05.753779+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c3f9d93e-ed6d-4a0c-b5c0-0e8d44c65fdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":47011},{"type":"v1","addr":"172.21.15.80:6817","nonce":47011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":47011},{"type":"v1","addr":"172.21.15.80:6819","nonce":47011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":47011},{"type":"v1","addr":"172.21.15.80:6823","nonce":47011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":47011},{"type":"v1","addr":"172.21.15.80:6821","nonce":47011}]},"public_addr":"172.21.15.80:6817/47011","cluster_addr":"172.21.15.80:6819/47011","heartbeat_back_addr":"172.21.15.80:6823/47011","heartbeat_front_addr":"172.21.15.80:6821/47011","state":["exists","up"]},{"osd":1,"uuid":"4ce2b4d6-6c40-43aa-8dd1-743fef8915df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":47010},{"type":"v1","addr":"172.21.15.80:6809","nonce":47010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":47010},{"type":"v1","addr":"172.21.15.80:6811","nonce":47010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":47010},{"type":"v1","addr":"172.21.15.80:6815","nonce":47010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":47010},{"type":"v1","addr":"172.21.15.80:6813","nonce":47010}]},"public_addr":"172.21.15.80:6809/47010","cluster_addr":"172.21.15.80:6811/47010","heartbeat_back_addr":"172.21.15.80:6815/47010","heartbeat_front_addr":"172.21.15.80:6813/47010","state":["exists","up"]},{"osd":2,"uuid":"e30cc3bc-6461-4fac-960a-de00c9488d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":47009},{"type":"v1","addr":"172.21.15.80:6801","nonce":47009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":47009},{"type":"v1","addr":"172.21.15.80:6803","nonce":47009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":47009},{"type":"v1","addr":"172.21.15.80:6807","nonce":47009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":47009},{"type":"v1","addr":"172.21.15.80:6805","nonce":47009}]},"public_addr":"172.21.15.80:6801/47009","cluster_addr":"172.21.15.80:6803/47009","heartbeat_back_addr":"172.21.15.80:6807/47009","heartbeat_front_addr":"172.21.15.80:6805/47009","state":["exists","up"]},{"osd":3,"uuid":"a415c099-9ea6-40be-98ed-f2932f98dfd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":47012},{"type":"v1","addr":"172.21.15.80:6825","nonce":47012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":47012},{"type":"v1","addr":"172.21.15.80:6827","nonce":47012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":47012},{"type":"v1","addr":"172.21.15.80:6831","nonce":47012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":47012},{"type":"v1","addr":"172.21.15.80:6829","nonce":47012}]},"public_addr":"172.21.15.80:6825/47012","cluster_addr":"172.21.15.80:6827/47012","heartbeat_back_addr":"172.21.15.80:6831/47012","heartbeat_front_addr":"172.21.15.80:6829/47012","state":["exists","up"]},{"osd":4,"uuid":"5ae1d51f-0918-4571-b79b-154308d46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6823","nonce":47114},{"type":"v1","addr":"172.21.15.106:6825","nonce":47114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":47114},{"type":"v1","addr":"172.21.15.106:6827","nonce":47114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":47114},{"type":"v1","addr":"172.21.15.106:6831","nonce":47114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":47114},{"type":"v1","addr":"172.21.15.106:6829","nonce":47114}]},"public_addr":"172.21.15.106:6825/47114","cluster_addr":"172.21.15.106:6827/47114","heartbeat_back_addr":"172.21.15.106:6831/47114","heartbeat_front_addr":"172.21.15.106:6829/47114","state":["exists","up"]},{"osd":5,"uuid":"a19ac74e-4282-4428-b167-26ba6b92f732","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6807","nonce":47111},{"type":"v1","addr":"172.21.15.106:6809","nonce":47111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":47111},{"type":"v1","addr":"172.21.15.106:6811","nonce":47111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":47111},{"type":"v1","addr":"172.21.15.106:6815","nonce":47111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":47111},{"type":"v1","addr":"172.21.15.106:6813","nonce":47111}]},"public_addr":"172.21.15.106:6809/47111","cluster_addr":"172.21.15.106:6811/47111","heartbeat_back_addr":"172.21.15.106:6815/47111","heartbeat_front_addr":"172.21.15.106:6813/47111","state":["exists","up"]},{"osd":6,"uuid":"bfe72edd-7acc-4805-807d-2000e76f2feb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":47112},{"type":"v1","addr":"172.21.15.106:6817","nonce":47112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":47112},{"type":"v1","addr":"172.21.15.106:6819","nonce":47112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":47112},{"type":"v1","addr":"172.21.15.106:6824","nonce":47112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":47112},{"type":"v1","addr":"172.21.15.106:6821","nonce":47112}]},"public_addr":"172.21.15.106:6817/47112","cluster_addr":"172.21.15.106:6819/47112","heartbeat_back_addr":"172.21.15.106:6824/47112","heartbeat_front_addr":"172.21.15.106:6821/47112","state":["exists","up"]},{"osd":7,"uuid":"99897f22-ed17-4c7c-9088-cc0c4a51f786","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":47113},{"type":"v1","addr":"172.21.15.106:6801","nonce":47113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":47113},{"type":"v1","addr":"172.21.15.106:6803","nonce":47113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":47113},{"type":"v1","addr":"172.21.15.106:6808","nonce":47113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":47113},{"type":"v1","addr":"172.21.15.106:6805","nonce":47113}]},"public_addr":"172.21.15.106:6801/47113","cluster_addr":"172.21.15.106:6803/47113","heartbeat_back_addr":"172.21.15.106:6808/47113","heartbeat_front_addr":"172.21.15.106:6805/47113","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.232670+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.277753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.050087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.349312+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.344080+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.348781+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.352539+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T21:09:54.275013+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.27","mappings":[{"from":3,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.106:6833/791920806":"2024-05-09T21:19:06.330456+0000","172.21.15.106:6832/791920806":"2024-05-09T21:19:06.330456+0000","172.21.15.106:6836/1949999190":"2024-05-09T21:12:06.228867+0000","172.21.15.106:6834/1949999190":"2024-05-09T21:12:06.228867+0000","172.21.15.106:6834/1499761952":"2024-05-09T21:17:21.292339+0000","172.21.15.106:6832/2289230272":"2024-05-09T21:14:41.256000+0000","172.21.15.106:6833/2289230272":"2024-05-09T21:14:41.256000+0000","172.21.15.106:6836/1499761952":"2024-05-09T21:17:21.292339+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T21:21:02.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.141+0000 7f573e493700 1 -- 172.21.15.80:0/2696183928 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f572406ac90 msgr2=0x7f572406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:02.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.141+0000 7f573e493700 1 --2- 172.21.15.80:0/2696183928 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f572406ac90 0x7f572406d150 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f572c014040 tx=0x7f572c005040 comp rx=0 tx=0).stop 2024-05-08T21:21:02.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.141+0000 7f573e493700 1 -- 172.21.15.80:0/2696183928 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57200043e0 msgr2=0x7f57381f0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:02.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.141+0000 7f573e493700 1 --2- 172.21.15.80:0/2696183928 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57200043e0 0x7f57381f0360 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f57280119a0 tx=0x7f5728011d60 comp rx=0 tx=0).stop 2024-05-08T21:21:02.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.141+0000 7f573e493700 1 -- 172.21.15.80:0/2696183928 shutdown_connections 2024-05-08T21:21:02.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.141+0000 7f573e493700 1 --2- 172.21.15.80:0/2696183928 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f572406ac90 0x7f572406d150 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:02.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.141+0000 7f573e493700 1 --2- 172.21.15.80:0/2696183928 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57200043e0 0x7f57381f0360 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:02.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.141+0000 7f573e493700 1 --2- 172.21.15.80:0/2696183928 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f573813cdc0 0x7f57381f2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:02.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.141+0000 7f573e493700 1 --2- 172.21.15.80:0/2696183928 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f57380c8e60 0x7f57381595b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:02.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.141+0000 7f573e493700 1 -- 172.21.15.80:0/2696183928 >> 172.21.15.80:0/2696183928 conn(0x7f573806bad0 msgr2=0x7f573806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:02.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.141+0000 7f573e493700 1 -- 172.21.15.80:0/2696183928 shutdown_connections 2024-05-08T21:21:02.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.141+0000 7f573e493700 1 -- 172.21.15.80:0/2696183928 wait complete. 2024-05-08T21:21:02.156 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-08T21:21:02.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.276+0000 7f6cb4d30700 1 Processor -- start 2024-05-08T21:21:02.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.276+0000 7f6cb4d30700 1 -- start start 2024-05-08T21:21:02.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.276+0000 7f6cb4d30700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6cb00ccc00 0x7f6cb0071be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:02.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.277+0000 7f6cb4d30700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cb00c9150 con 0x7f6cb00ccfe0 2024-05-08T21:21:02.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.277+0000 7f6cb4d30700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cb00c99f0 con 0x7f6cb00c8380 2024-05-08T21:21:02.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.277+0000 7f6cb4d30700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cb01579c0 con 0x7f6cb00ccc00 2024-05-08T21:21:02.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.277+0000 7f6cae59c700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6cb00ccc00 0x7f6cb0071be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:02.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.277+0000 7f6cadd9b700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f6cb00ccfe0 0x7f6cb0156ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:32812/0 (socket says 172.21.15.80:32812) 2024-05-08T21:21:02.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.277+0000 7f6cadd9b700 1 -- 172.21.15.80:0/2342634659 learned_addr learned my addr 172.21.15.80:0/2342634659 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T21:21:02.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.277+0000 7f6cae59c700 1 -- 172.21.15.80:0/2342634659 >> v1:172.21.15.106:6789/0 conn(0x7f6cb00c8380 legacy=0x7f6cb014d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:21:02.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.277+0000 7f6cae59c700 1 -- 172.21.15.80:0/2342634659 >> v1:172.21.15.80:6789/0 conn(0x7f6cb00ccfe0 legacy=0x7f6cb0156ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:02.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.277+0000 7f6cad59a700 1 -- 172.21.15.80:0/2342634659 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 449726340 0 0) 0x7f6cb00c9150 con 0x7f6cb00ccfe0 2024-05-08T21:21:02.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.277+0000 7f6cae59c700 1 -- 172.21.15.80:0/2342634659 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb0157ca0 con 0x7f6cb00ccc00 2024-05-08T21:21:02.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.277+0000 7f6cae59c700 1 --2- 172.21.15.80:0/2342634659 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cb00ccc00 0x7f6cb0071be0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f6c98009840 tx=0x7f6c98009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c80be265684cbf87 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:02.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.277+0000 7f6cad59a700 1 -- 172.21.15.80:0/2342634659 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c98011830 con 0x7f6cb00ccc00 2024-05-08T21:21:02.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.277+0000 7f6cad59a700 1 -- 172.21.15.80:0/2342634659 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f6c98011990 con 0x7f6cb00ccc00 2024-05-08T21:21:02.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.277+0000 7f6cad59a700 1 -- 172.21.15.80:0/2342634659 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c98011d40 con 0x7f6cb00ccc00 2024-05-08T21:21:02.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.278+0000 7f6cb4d30700 1 -- 172.21.15.80:0/2342634659 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cb00ccc00 msgr2=0x7f6cb0071be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:02.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.278+0000 7f6cb4d30700 1 --2- 172.21.15.80:0/2342634659 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cb00ccc00 0x7f6cb0071be0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f6c98009840 tx=0x7f6c98009b50 comp rx=0 tx=0).stop 2024-05-08T21:21:02.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.278+0000 7f6cb4d30700 1 -- 172.21.15.80:0/2342634659 shutdown_connections 2024-05-08T21:21:02.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.278+0000 7f6cb4d30700 1 --2- 172.21.15.80:0/2342634659 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cb00ccc00 0x7f6cb0071be0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:02.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.278+0000 7f6cb4d30700 1 -- 172.21.15.80:0/2342634659 >> 172.21.15.80:0/2342634659 conn(0x7f6cb006f140 msgr2=0x7f6cb006f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:02.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.278+0000 7f6cb4d30700 1 -- 172.21.15.80:0/2342634659 shutdown_connections 2024-05-08T21:21:02.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.278+0000 7f6cb4d30700 1 -- 172.21.15.80:0/2342634659 wait complete. 2024-05-08T21:21:02.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.279+0000 7f6cb4d30700 1 Processor -- start 2024-05-08T21:21:02.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.279+0000 7f6cb4d30700 1 -- start start 2024-05-08T21:21:02.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.280+0000 7f6cb4d30700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cb00c8380 0x7f6cb014a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:02.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.280+0000 7f6cb4d30700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6cb00ccc00 0x7f6cb0147430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:02.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.280+0000 7f6cb4d30700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6cb00ccfe0 0x7f6cb0147970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:02.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.280+0000 7f6cb4d30700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb01540c0 con 0x7f6cb00c8380 2024-05-08T21:21:02.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.280+0000 7f6cb4d30700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb01543a0 con 0x7f6cb00ccc00 2024-05-08T21:21:02.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.280+0000 7f6cb4d30700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb015ab70 con 0x7f6cb00ccfe0 2024-05-08T21:21:02.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.280+0000 7f6cae59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cb00c8380 0x7f6cb014a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:02.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.280+0000 7f6cae59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cb00c8380 0x7f6cb014a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50512/0 (socket says 172.21.15.80:50512) 2024-05-08T21:21:02.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.280+0000 7f6cae59c700 1 -- 172.21.15.80:0/3694686104 learned_addr learned my addr 172.21.15.80:0/3694686104 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:21:02.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.280+0000 7f6cadd9b700 1 --2- 172.21.15.80:0/3694686104 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6cb00ccc00 0x7f6cb0147430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:02.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.280+0000 7f6cae59c700 1 -- 172.21.15.80:0/3694686104 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6cb00ccfe0 msgr2=0x7f6cb0147970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:02.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.280+0000 7f6caed9d700 1 --2- 172.21.15.80:0/3694686104 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6cb00ccfe0 0x7f6cb0147970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:02.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.280+0000 7f6cae59c700 1 --2- 172.21.15.80:0/3694686104 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6cb00ccfe0 0x7f6cb0147970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:02.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.280+0000 7f6cae59c700 1 -- 172.21.15.80:0/3694686104 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6cb00ccc00 msgr2=0x7f6cb0147430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:02.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.280+0000 7f6cae59c700 1 --2- 172.21.15.80:0/3694686104 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6cb00ccc00 0x7f6cb0147430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:02.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.280+0000 7f6cae59c700 1 -- 172.21.15.80:0/3694686104 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c980094a0 con 0x7f6cb00c8380 2024-05-08T21:21:02.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.280+0000 7f6cadd9b700 1 --2- 172.21.15.80:0/3694686104 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6cb00ccc00 0x7f6cb0147430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:21:02.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.280+0000 7f6caed9d700 1 --2- 172.21.15.80:0/3694686104 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6cb00ccfe0 0x7f6cb0147970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:21:02.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.281+0000 7f6cae59c700 1 --2- 172.21.15.80:0/3694686104 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cb00c8380 0x7f6cb014a0c0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f6c980090b0 tx=0x7f6c98004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:02.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.281+0000 7f6ca6ffd700 1 -- 172.21.15.80:0/3694686104 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9801a980 con 0x7f6cb00c8380 2024-05-08T21:21:02.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.281+0000 7f6ca6ffd700 1 -- 172.21.15.80:0/3694686104 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f6c9801aae0 con 0x7f6cb00c8380 2024-05-08T21:21:02.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.281+0000 7f6ca6ffd700 1 -- 172.21.15.80:0/3694686104 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9801ae70 con 0x7f6cb00c8380 2024-05-08T21:21:02.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.281+0000 7f6cb4d30700 1 -- 172.21.15.80:0/3694686104 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cb015ae50 con 0x7f6cb00c8380 2024-05-08T21:21:02.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.281+0000 7f6cb4d30700 1 -- 172.21.15.80:0/3694686104 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cb0154680 con 0x7f6cb00c8380 2024-05-08T21:21:02.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.282+0000 7f6cb4d30700 1 -- 172.21.15.80:0/3694686104 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cb004ec60 con 0x7f6cb00c8380 2024-05-08T21:21:02.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.282+0000 7f6ca6ffd700 1 -- 172.21.15.80:0/3694686104 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6c98022070 con 0x7f6cb00c8380 2024-05-08T21:21:02.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.282+0000 7f6ca6ffd700 1 --2- 172.21.15.80:0/3694686104 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f6c9006acc0 0x7f6c9006d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:02.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.283+0000 7f6ca6ffd700 1 -- 172.21.15.80:0/3694686104 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f6c9808ac80 con 0x7f6cb00c8380 2024-05-08T21:21:02.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.283+0000 7f6cadd9b700 1 --2- 172.21.15.80:0/3694686104 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f6c9006acc0 0x7f6c9006d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:02.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.283+0000 7f6cadd9b700 1 --2- 172.21.15.80:0/3694686104 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f6c9006acc0 0x7f6c9006d180 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6cb00c5c20 tx=0x7f6ca0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:02.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.287+0000 7f6ca6ffd700 1 -- 172.21.15.80:0/3694686104 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f6c980558c0 con 0x7f6cb00c8380 2024-05-08T21:21:02.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.532+0000 7f6cb4d30700 1 -- 172.21.15.80:0/3694686104 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f6cb0072b60 con 0x7f6cb00c8380 2024-05-08T21:21:02.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.541+0000 7f6ca6ffd700 1 -- 172.21.15.80:0/3694686104 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v31) v1 ==== 161+0+0 (secure 0 0 0) 0x7f6c98015090 con 0x7f6cb00c8380 2024-05-08T21:21:02.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.544+0000 7f6cb4d30700 1 -- 172.21.15.80:0/3694686104 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f6c9006acc0 msgr2=0x7f6c9006d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:02.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.544+0000 7f6cb4d30700 1 --2- 172.21.15.80:0/3694686104 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f6c9006acc0 0x7f6c9006d180 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6cb00c5c20 tx=0x7f6ca0009040 comp rx=0 tx=0).stop 2024-05-08T21:21:02.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.544+0000 7f6cb4d30700 1 -- 172.21.15.80:0/3694686104 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cb00c8380 msgr2=0x7f6cb014a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:02.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.544+0000 7f6cb4d30700 1 --2- 172.21.15.80:0/3694686104 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cb00c8380 0x7f6cb014a0c0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f6c980090b0 tx=0x7f6c98004750 comp rx=0 tx=0).stop 2024-05-08T21:21:02.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.544+0000 7f6cb4d30700 1 -- 172.21.15.80:0/3694686104 shutdown_connections 2024-05-08T21:21:02.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.544+0000 7f6cb4d30700 1 --2- 172.21.15.80:0/3694686104 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f6c9006acc0 0x7f6c9006d180 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:02.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.544+0000 7f6cb4d30700 1 --2- 172.21.15.80:0/3694686104 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6cb00c8380 0x7f6cb014a0c0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:02.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.544+0000 7f6cb4d30700 1 --2- 172.21.15.80:0/3694686104 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6cb00ccfe0 0x7f6cb0147970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:02.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.544+0000 7f6cb4d30700 1 --2- 172.21.15.80:0/3694686104 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6cb00ccc00 0x7f6cb0147430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:02.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.544+0000 7f6cb4d30700 1 -- 172.21.15.80:0/3694686104 >> 172.21.15.80:0/3694686104 conn(0x7f6cb006f140 msgr2=0x7f6cb00c3730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:02.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.544+0000 7f6cb4d30700 1 -- 172.21.15.80:0/3694686104 shutdown_connections 2024-05-08T21:21:02.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.544+0000 7f6cb4d30700 1 -- 172.21.15.80:0/3694686104 wait complete. 2024-05-08T21:21:02.547 INFO:teuthology.orchestra.run.smithi080.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-08T21:21:02.558 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-08T21:21:02.582 INFO:tasks.ceph.mds.d.smithi106.stdout:starting mds.d at 2024-05-08T21:21:02.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.682+0000 7f7c09dd7700 1 Processor -- start 2024-05-08T21:21:02.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.682+0000 7f7c09dd7700 1 -- start start 2024-05-08T21:21:02.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.683+0000 7f7c09dd7700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7c04154420 0x7f7c040c99d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:02.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.683+0000 7f7c09dd7700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7c04072100 0x7f7c0415a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:02.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.683+0000 7f7c09dd7700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c0415e690 con 0x7f7c040c9f10 2024-05-08T21:21:02.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.683+0000 7f7c09dd7700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c04072d30 con 0x7f7c04154420 2024-05-08T21:21:02.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.683+0000 7f7c09dd7700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c04154800 con 0x7f7c04072100 2024-05-08T21:21:02.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.683+0000 7f7c037fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7c04154420 0x7f7c040c99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:02.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.683+0000 7f7c037fe700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7c04154420 0x7f7c040c99d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50524/0 (socket says 172.21.15.80:50524) 2024-05-08T21:21:02.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.683+0000 7f7c037fe700 1 -- 172.21.15.80:0/2821800075 learned_addr learned my addr 172.21.15.80:0/2821800075 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:21:02.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.683+0000 7f7c03fff700 1 --2- 172.21.15.80:0/2821800075 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7c04072100 0x7f7c0415a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:02.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.683+0000 7f7c037fe700 1 -- 172.21.15.80:0/2821800075 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7c04072100 msgr2=0x7f7c0415a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:21:02.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.683+0000 7f7c037fe700 1 --2- 172.21.15.80:0/2821800075 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7c04072100 0x7f7c0415a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:02.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.683+0000 7f7c037fe700 1 -- 172.21.15.80:0/2821800075 >> v1:172.21.15.106:6789/0 conn(0x7f7c040c9f10 legacy=0x7f7c0406a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:02.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.683+0000 7f7c037fe700 1 -- 172.21.15.80:0/2821800075 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c0415db30 con 0x7f7c04154420 2024-05-08T21:21:02.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.683+0000 7f7c037fe700 1 --2- 172.21.15.80:0/2821800075 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c04154420 0x7f7c040c99d0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f7bf40098f0 tx=0x7f7bf4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff56f7cc4ff51eaa server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:02.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.683+0000 7f7c027fc700 1 -- 172.21.15.80:0/2821800075 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf4011830 con 0x7f7c04154420 2024-05-08T21:21:02.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.683+0000 7f7c027fc700 1 -- 172.21.15.80:0/2821800075 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f7bf4011990 con 0x7f7c04154420 2024-05-08T21:21:02.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.683+0000 7f7c027fc700 1 -- 172.21.15.80:0/2821800075 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf4011d40 con 0x7f7c04154420 2024-05-08T21:21:02.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.684+0000 7f7c09dd7700 1 -- 172.21.15.80:0/2821800075 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c04154420 msgr2=0x7f7c040c99d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:02.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.684+0000 7f7c09dd7700 1 --2- 172.21.15.80:0/2821800075 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c04154420 0x7f7c040c99d0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f7bf40098f0 tx=0x7f7bf4009c00 comp rx=0 tx=0).stop 2024-05-08T21:21:02.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.684+0000 7f7c09dd7700 1 -- 172.21.15.80:0/2821800075 shutdown_connections 2024-05-08T21:21:02.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.684+0000 7f7c09dd7700 1 --2- 172.21.15.80:0/2821800075 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7c04072100 0x7f7c0415a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:02.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.684+0000 7f7c09dd7700 1 --2- 172.21.15.80:0/2821800075 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c04154420 0x7f7c040c99d0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:02.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.684+0000 7f7c09dd7700 1 -- 172.21.15.80:0/2821800075 >> 172.21.15.80:0/2821800075 conn(0x7f7c0406f140 msgr2=0x7f7c0406f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:02.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.684+0000 7f7c09dd7700 1 -- 172.21.15.80:0/2821800075 shutdown_connections 2024-05-08T21:21:02.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.684+0000 7f7c09dd7700 1 -- 172.21.15.80:0/2821800075 wait complete. 2024-05-08T21:21:02.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.685+0000 7f7c09dd7700 1 Processor -- start 2024-05-08T21:21:02.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.685+0000 7f7c09dd7700 1 -- start start 2024-05-08T21:21:02.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.686+0000 7f7c09dd7700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c04072100 0x7f7c040c69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:02.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.686+0000 7f7c09dd7700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c04154420 0x7f7c04159200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:02.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.686+0000 7f7c09dd7700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7c040c5290 0x7f7c040c5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:02.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.686+0000 7f7c09dd7700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c041ef8b0 con 0x7f7c04072100 2024-05-08T21:21:02.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.686+0000 7f7c09dd7700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c040c5c80 con 0x7f7c04154420 2024-05-08T21:21:02.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.686+0000 7f7c09dd7700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c041efac0 con 0x7f7c040c5290 2024-05-08T21:21:02.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.686+0000 7f7c037fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c04072100 0x7f7c040c69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:02.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.686+0000 7f7c037fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c04072100 0x7f7c040c69d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50532/0 (socket says 172.21.15.80:50532) 2024-05-08T21:21:02.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.686+0000 7f7c037fe700 1 -- 172.21.15.80:0/1135343211 learned_addr learned my addr 172.21.15.80:0/1135343211 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:21:02.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.686+0000 7f7c02ffd700 1 --2- 172.21.15.80:0/1135343211 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c04154420 0x7f7c04159200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:02.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.686+0000 7f7c03fff700 1 --2- 172.21.15.80:0/1135343211 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7c040c5290 0x7f7c040c5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:02.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.686+0000 7f7c037fe700 1 -- 172.21.15.80:0/1135343211 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7c040c5290 msgr2=0x7f7c040c5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:02.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.686+0000 7f7c037fe700 1 --2- 172.21.15.80:0/1135343211 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7c040c5290 0x7f7c040c5740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:02.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.686+0000 7f7c037fe700 1 -- 172.21.15.80:0/1135343211 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c04154420 msgr2=0x7f7c04159200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:02.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.686+0000 7f7c037fe700 1 --2- 172.21.15.80:0/1135343211 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c04154420 0x7f7c04159200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:02.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.686+0000 7f7c037fe700 1 -- 172.21.15.80:0/1135343211 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf4009550 con 0x7f7c04072100 2024-05-08T21:21:02.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.687+0000 7f7c037fe700 1 --2- 172.21.15.80:0/1135343211 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c04072100 0x7f7c040c69d0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f7bf4014040 tx=0x7f7bf4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:02.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.687+0000 7f7bebfff700 1 -- 172.21.15.80:0/1135343211 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf4004590 con 0x7f7c04072100 2024-05-08T21:21:02.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.687+0000 7f7bebfff700 1 -- 172.21.15.80:0/1135343211 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f7bf401e070 con 0x7f7c04072100 2024-05-08T21:21:02.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.687+0000 7f7bebfff700 1 -- 172.21.15.80:0/1135343211 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf4003900 con 0x7f7c04072100 2024-05-08T21:21:02.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.687+0000 7f7c09dd7700 1 -- 172.21.15.80:0/1135343211 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c041efda0 con 0x7f7c04072100 2024-05-08T21:21:02.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.687+0000 7f7c09dd7700 1 -- 172.21.15.80:0/1135343211 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c041f0360 con 0x7f7c04072100 2024-05-08T21:21:02.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.688+0000 7f7c09dd7700 1 -- 172.21.15.80:0/1135343211 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c040c50e0 con 0x7f7c04072100 2024-05-08T21:21:02.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.688+0000 7f7bebfff700 1 -- 172.21.15.80:0/1135343211 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7bf4003a60 con 0x7f7c04072100 2024-05-08T21:21:02.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.688+0000 7f7bebfff700 1 --2- 172.21.15.80:0/1135343211 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f7bf006ac90 0x7f7bf006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:02.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.688+0000 7f7bebfff700 1 -- 172.21.15.80:0/1135343211 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f7bf408a980 con 0x7f7c04072100 2024-05-08T21:21:02.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.688+0000 7f7c02ffd700 1 --2- 172.21.15.80:0/1135343211 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f7bf006ac90 0x7f7bf006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:02.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.689+0000 7f7c02ffd700 1 --2- 172.21.15.80:0/1135343211 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f7bf006ac90 0x7f7bf006d150 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7c0414ef30 tx=0x7f7bf8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:02.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.693+0000 7f7bebfff700 1 -- 172.21.15.80:0/1135343211 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f7bf40554e0 con 0x7f7c04072100 2024-05-08T21:21:02.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:02.936+0000 7f7c09dd7700 1 -- 172.21.15.80:0/1135343211 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f7c0404ec60 con 0x7f7c04072100 2024-05-08T21:21:03.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.543+0000 7f7bebfff700 1 -- 172.21.15.80:0/1135343211 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v32) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7bf4058b00 con 0x7f7c04072100 2024-05-08T21:21:03.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.546+0000 7f7c09dd7700 1 -- 172.21.15.80:0/1135343211 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f7bf006ac90 msgr2=0x7f7bf006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:03.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.546+0000 7f7c09dd7700 1 --2- 172.21.15.80:0/1135343211 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f7bf006ac90 0x7f7bf006d150 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7c0414ef30 tx=0x7f7bf8009040 comp rx=0 tx=0).stop 2024-05-08T21:21:03.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.546+0000 7f7c09dd7700 1 -- 172.21.15.80:0/1135343211 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c04072100 msgr2=0x7f7c040c69d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:03.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.546+0000 7f7c09dd7700 1 --2- 172.21.15.80:0/1135343211 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c04072100 0x7f7c040c69d0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f7bf4014040 tx=0x7f7bf4004750 comp rx=0 tx=0).stop 2024-05-08T21:21:03.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.546+0000 7f7c09dd7700 1 -- 172.21.15.80:0/1135343211 shutdown_connections 2024-05-08T21:21:03.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.546+0000 7f7c09dd7700 1 --2- 172.21.15.80:0/1135343211 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f7bf006ac90 0x7f7bf006d150 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:03.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.546+0000 7f7c09dd7700 1 --2- 172.21.15.80:0/1135343211 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7c04072100 0x7f7c040c69d0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:03.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.546+0000 7f7c09dd7700 1 --2- 172.21.15.80:0/1135343211 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7c040c5290 0x7f7c040c5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:03.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.546+0000 7f7c09dd7700 1 --2- 172.21.15.80:0/1135343211 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c04154420 0x7f7c04159200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:03.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.546+0000 7f7c09dd7700 1 -- 172.21.15.80:0/1135343211 >> 172.21.15.80:0/1135343211 conn(0x7f7c0406f140 msgr2=0x7f7c0414f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:03.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.546+0000 7f7c09dd7700 1 -- 172.21.15.80:0/1135343211 shutdown_connections 2024-05-08T21:21:03.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.546+0000 7f7c09dd7700 1 -- 172.21.15.80:0/1135343211 wait complete. 2024-05-08T21:21:03.563 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-08T21:21:03.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.691+0000 7f742baee700 1 Processor -- start 2024-05-08T21:21:03.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.692+0000 7f742baee700 1 -- start start 2024-05-08T21:21:03.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.692+0000 7f742baee700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f74241511b0 0x7f74240c7890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:03.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.692+0000 7f742baee700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7424071400 0x7f7424071840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:03.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.692+0000 7f742baee700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f742406eb30 0x7f742406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:03.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.692+0000 7f742baee700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7424071d80 con 0x7f74241511b0 2024-05-08T21:21:03.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.692+0000 7f742baee700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7424151590 con 0x7f742406eb30 2024-05-08T21:21:03.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.692+0000 7f742baee700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74240c96b0 con 0x7f7424071400 2024-05-08T21:21:03.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.693+0000 7f742988a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f74241511b0 0x7f74240c7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:03.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.693+0000 7f742988a700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f74241511b0 0x7f74240c7890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50536/0 (socket says 172.21.15.80:50536) 2024-05-08T21:21:03.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.693+0000 7f742988a700 1 -- 172.21.15.80:0/3050833407 learned_addr learned my addr 172.21.15.80:0/3050833407 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:21:03.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.693+0000 7f742a08b700 1 --2- 172.21.15.80:0/3050833407 >> v2:172.21.15.106:3300/0 conn(0x7f742406eb30 0x7f742406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:03.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.693+0000 7f7429089700 1 --2- 172.21.15.80:0/3050833407 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7424071400 0x7f7424071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:03.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.693+0000 7f742988a700 1 -- 172.21.15.80:0/3050833407 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7424071400 msgr2=0x7f7424071840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:21:03.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.693+0000 7f742988a700 1 --2- 172.21.15.80:0/3050833407 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7424071400 0x7f7424071840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:03.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.693+0000 7f742988a700 1 -- 172.21.15.80:0/3050833407 >> v2:172.21.15.106:3300/0 conn(0x7f742406eb30 msgr2=0x7f742406ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:21:03.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.693+0000 7f742988a700 1 --2- 172.21.15.80:0/3050833407 >> v2:172.21.15.106:3300/0 conn(0x7f742406eb30 0x7f742406ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:03.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.693+0000 7f742988a700 1 -- 172.21.15.80:0/3050833407 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74240c7f80 con 0x7f74241511b0 2024-05-08T21:21:03.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.693+0000 7f7429089700 1 --2- 172.21.15.80:0/3050833407 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7424071400 0x7f7424071840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:21:03.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.693+0000 7f742a08b700 1 --2- 172.21.15.80:0/3050833407 >> v2:172.21.15.106:3300/0 conn(0x7f742406eb30 0x7f742406ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:21:03.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.693+0000 7f742988a700 1 --2- 172.21.15.80:0/3050833407 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74241511b0 0x7f74240c7890 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f74240c8860 tx=0x7f741400be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e35393b6fac31337 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:03.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.693+0000 7f7428888700 1 -- 172.21.15.80:0/3050833407 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f741400dd30 con 0x7f74241511b0 2024-05-08T21:21:03.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.693+0000 7f7428888700 1 -- 172.21.15.80:0/3050833407 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f741400de90 con 0x7f74241511b0 2024-05-08T21:21:03.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.693+0000 7f7428888700 1 -- 172.21.15.80:0/3050833407 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74140106b0 con 0x7f74241511b0 2024-05-08T21:21:03.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.694+0000 7f742baee700 1 -- 172.21.15.80:0/3050833407 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74241511b0 msgr2=0x7f74240c7890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:03.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.694+0000 7f742baee700 1 --2- 172.21.15.80:0/3050833407 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74241511b0 0x7f74240c7890 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f74240c8860 tx=0x7f741400be70 comp rx=0 tx=0).stop 2024-05-08T21:21:03.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.694+0000 7f742baee700 1 -- 172.21.15.80:0/3050833407 shutdown_connections 2024-05-08T21:21:03.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.694+0000 7f742baee700 1 --2- 172.21.15.80:0/3050833407 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74241511b0 0x7f74240c7890 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:03.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.694+0000 7f742baee700 1 --2- 172.21.15.80:0/3050833407 >> v2:172.21.15.106:3300/0 conn(0x7f742406eb30 0x7f742406ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:03.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.694+0000 7f742baee700 1 --2- 172.21.15.80:0/3050833407 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7424071400 0x7f7424071840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:03.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.694+0000 7f742baee700 1 -- 172.21.15.80:0/3050833407 >> 172.21.15.80:0/3050833407 conn(0x7f742406bad0 msgr2=0x7f742406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:03.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.694+0000 7f742baee700 1 -- 172.21.15.80:0/3050833407 shutdown_connections 2024-05-08T21:21:03.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.694+0000 7f742baee700 1 -- 172.21.15.80:0/3050833407 wait complete. 2024-05-08T21:21:03.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.695+0000 7f742baee700 1 Processor -- start 2024-05-08T21:21:03.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.695+0000 7f742baee700 1 -- start start 2024-05-08T21:21:03.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.696+0000 7f742baee700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f742406eb30 0x7f74240cd070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:03.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.696+0000 7f742baee700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7424071400 0x7f74241de540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:03.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.696+0000 7f742baee700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74241511b0 0x7f74241dea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:03.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.696+0000 7f742baee700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74241de120 con 0x7f742406eb30 2024-05-08T21:21:03.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.696+0000 7f742baee700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74240cb4e0 con 0x7f74241511b0 2024-05-08T21:21:03.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.696+0000 7f742baee700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74240cb7c0 con 0x7f7424071400 2024-05-08T21:21:03.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.696+0000 7f742988a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f742406eb30 0x7f74240cd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:03.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.696+0000 7f742988a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f742406eb30 0x7f74240cd070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50550/0 (socket says 172.21.15.80:50550) 2024-05-08T21:21:03.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.696+0000 7f742988a700 1 -- 172.21.15.80:0/411686530 learned_addr learned my addr 172.21.15.80:0/411686530 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:21:03.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.696+0000 7f742988a700 1 -- 172.21.15.80:0/411686530 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7424071400 msgr2=0x7f74241de540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:03.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.696+0000 7f742988a700 1 --2- 172.21.15.80:0/411686530 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7424071400 0x7f74241de540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:03.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.696+0000 7f742988a700 1 -- 172.21.15.80:0/411686530 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74241511b0 msgr2=0x7f74241dea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:03.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.696+0000 7f742988a700 1 --2- 172.21.15.80:0/411686530 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74241511b0 0x7f74241dea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:03.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.696+0000 7f742988a700 1 -- 172.21.15.80:0/411686530 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f741400b7f0 con 0x7f742406eb30 2024-05-08T21:21:03.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.696+0000 7f742988a700 1 --2- 172.21.15.80:0/411686530 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f742406eb30 0x7f74240cd070 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f741400beb0 tx=0x7f7414004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:03.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.696+0000 7f741a7fc700 1 -- 172.21.15.80:0/411686530 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f741401f070 con 0x7f742406eb30 2024-05-08T21:21:03.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.696+0000 7f741a7fc700 1 -- 172.21.15.80:0/411686530 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f7414003d40 con 0x7f742406eb30 2024-05-08T21:21:03.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.696+0000 7f742baee700 1 -- 172.21.15.80:0/411686530 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74241ddd40 con 0x7f742406eb30 2024-05-08T21:21:03.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.696+0000 7f741a7fc700 1 -- 172.21.15.80:0/411686530 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74140106d0 con 0x7f742406eb30 2024-05-08T21:21:03.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.697+0000 7f742baee700 1 -- 172.21.15.80:0/411686530 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74241dfda0 con 0x7f742406eb30 2024-05-08T21:21:03.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.697+0000 7f742baee700 1 -- 172.21.15.80:0/411686530 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74241de260 con 0x7f742406eb30 2024-05-08T21:21:03.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.698+0000 7f741a7fc700 1 -- 172.21.15.80:0/411686530 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7414019400 con 0x7f742406eb30 2024-05-08T21:21:03.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.698+0000 7f741a7fc700 1 --2- 172.21.15.80:0/411686530 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f740806ac90 0x7f740806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:03.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.698+0000 7f7429089700 1 --2- 172.21.15.80:0/411686530 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f740806ac90 0x7f740806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:03.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.698+0000 7f741a7fc700 1 -- 172.21.15.80:0/411686530 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f741408ced0 con 0x7f742406eb30 2024-05-08T21:21:03.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.699+0000 7f7429089700 1 --2- 172.21.15.80:0/411686530 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f740806ac90 0x7f740806d150 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7420006fd0 tx=0x7f7420008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:03.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.703+0000 7f741a7fc700 1 -- 172.21.15.80:0/411686530 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f7414057ab0 con 0x7f742406eb30 2024-05-08T21:21:03.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:03.900+0000 7f742baee700 1 -- 172.21.15.80:0/411686530 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f742404ed00 con 0x7f742406eb30 2024-05-08T21:21:04.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:04.761+0000 7f741a7fc700 1 -- 172.21.15.80:0/411686530 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v34) v1 ==== 181+0+0 (secure 0 0 0) 0x7f741405b0d0 con 0x7f742406eb30 2024-05-08T21:21:04.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:04.765+0000 7f742baee700 1 -- 172.21.15.80:0/411686530 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f740806ac90 msgr2=0x7f740806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:04.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:04.765+0000 7f742baee700 1 --2- 172.21.15.80:0/411686530 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f740806ac90 0x7f740806d150 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7420006fd0 tx=0x7f7420008040 comp rx=0 tx=0).stop 2024-05-08T21:21:04.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:04.765+0000 7f742baee700 1 -- 172.21.15.80:0/411686530 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f742406eb30 msgr2=0x7f74240cd070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:04.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:04.765+0000 7f742baee700 1 --2- 172.21.15.80:0/411686530 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f742406eb30 0x7f74240cd070 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f741400beb0 tx=0x7f7414004750 comp rx=0 tx=0).stop 2024-05-08T21:21:04.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:04.765+0000 7f742baee700 1 -- 172.21.15.80:0/411686530 shutdown_connections 2024-05-08T21:21:04.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:04.765+0000 7f742baee700 1 --2- 172.21.15.80:0/411686530 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f740806ac90 0x7f740806d150 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:04.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:04.765+0000 7f742baee700 1 --2- 172.21.15.80:0/411686530 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f742406eb30 0x7f74240cd070 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:04.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:04.765+0000 7f742baee700 1 --2- 172.21.15.80:0/411686530 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74241511b0 0x7f74241dea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:04.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:04.765+0000 7f742baee700 1 --2- 172.21.15.80:0/411686530 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7424071400 0x7f74241de540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:04.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:04.765+0000 7f742baee700 1 -- 172.21.15.80:0/411686530 >> 172.21.15.80:0/411686530 conn(0x7f742406bad0 msgr2=0x7f7424154b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:04.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:04.766+0000 7f742baee700 1 -- 172.21.15.80:0/411686530 shutdown_connections 2024-05-08T21:21:04.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:04.766+0000 7f742baee700 1 -- 172.21.15.80:0/411686530 wait complete. 2024-05-08T21:21:04.770 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_metadata' removed 2024-05-08T21:21:04.785 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-08T21:21:04.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:04.913+0000 7f329e244700 1 Processor -- start 2024-05-08T21:21:04.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:04.913+0000 7f329e244700 1 -- start start 2024-05-08T21:21:04.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:04.914+0000 7f329e244700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f329815af00 0x7f3298153f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:04.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:04.914+0000 7f329e244700 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f329815db60 con 0x7f3298072e00 2024-05-08T21:21:04.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:04.914+0000 7f329e244700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f329815de20 con 0x7f32980731e0 2024-05-08T21:21:04.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:04.914+0000 7f329e244700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f329815e100 con 0x7f329815af00 2024-05-08T21:21:04.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:04.914+0000 7f3296ffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f329815af00 0x7f3298153f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:04.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:04.914+0000 7f3296ffd700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f329815af00 0x7f3298153f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50564/0 (socket says 172.21.15.80:50564) 2024-05-08T21:21:04.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:04.914+0000 7f3296ffd700 1 -- 172.21.15.80:0/777730843 learned_addr learned my addr 172.21.15.80:0/777730843 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:21:04.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:04.914+0000 7f32977fe700 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f3298072e00 0x7f329815a7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:32816/0 (socket says 172.21.15.80:32816) 2024-05-08T21:21:04.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:04.914+0000 7f3296ffd700 1 -- 172.21.15.80:0/777730843 >> v1:172.21.15.106:6789/0 conn(0x7f32980731e0 legacy=0x7f32980ca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:21:04.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:04.914+0000 7f3296ffd700 1 -- 172.21.15.80:0/777730843 >> v1:172.21.15.80:6789/0 conn(0x7f3298072e00 legacy=0x7f329815a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:04.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:04.914+0000 7f3296ffd700 1 -- 172.21.15.80:0/777730843 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f329815e3e0 con 0x7f329815af00 2024-05-08T21:21:04.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:04.914+0000 7f32967fc700 1 -- 172.21.15.80:0/777730843 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 772993616 0 0) 0x7f329815db60 con 0x7f3298072e00 2024-05-08T21:21:04.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:04.914+0000 7f3296ffd700 1 --2- 172.21.15.80:0/777730843 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f329815af00 0x7f3298153f20 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f328c0098f0 tx=0x7f328c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72c40fed80d4e11e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:04.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:04.914+0000 7f32967fc700 1 -- 172.21.15.80:0/777730843 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f328c004230 con 0x7f329815af00 2024-05-08T21:21:04.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:04.914+0000 7f32967fc700 1 -- 172.21.15.80:0/777730843 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f328c004390 con 0x7f329815af00 2024-05-08T21:21:04.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:04.914+0000 7f32967fc700 1 -- 172.21.15.80:0/777730843 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f328c0036a0 con 0x7f329815af00 2024-05-08T21:21:04.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:04.915+0000 7f329e244700 1 -- 172.21.15.80:0/777730843 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f329815af00 msgr2=0x7f3298153f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:04.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:04.915+0000 7f329e244700 1 --2- 172.21.15.80:0/777730843 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f329815af00 0x7f3298153f20 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f328c0098f0 tx=0x7f328c009c00 comp rx=0 tx=0).stop 2024-05-08T21:21:04.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:04.915+0000 7f329e244700 1 -- 172.21.15.80:0/777730843 shutdown_connections 2024-05-08T21:21:04.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:04.915+0000 7f329e244700 1 --2- 172.21.15.80:0/777730843 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f329815af00 0x7f3298153f20 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:04.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:04.915+0000 7f329e244700 1 -- 172.21.15.80:0/777730843 >> 172.21.15.80:0/777730843 conn(0x7f3298066780 msgr2=0x7f3298066b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:04.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:04.915+0000 7f329e244700 1 -- 172.21.15.80:0/777730843 shutdown_connections 2024-05-08T21:21:04.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:04.915+0000 7f329e244700 1 -- 172.21.15.80:0/777730843 wait complete. 2024-05-08T21:21:04.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:04.916+0000 7f329e244700 1 Processor -- start 2024-05-08T21:21:04.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:04.916+0000 7f329e244700 1 -- start start 2024-05-08T21:21:04.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:04.917+0000 7f329e244700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3298072e00 0x7f32980cd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:04.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:04.917+0000 7f329e244700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f32980731e0 0x7f32980cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:04.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:04.917+0000 7f329e244700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f329815af00 0x7f32981508f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:04.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:04.917+0000 7f329e244700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32981e6500 con 0x7f32980731e0 2024-05-08T21:21:04.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:04.917+0000 7f329e244700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32980ccee0 con 0x7f3298072e00 2024-05-08T21:21:04.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:04.917+0000 7f329e244700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32980cd1c0 con 0x7f329815af00 2024-05-08T21:21:04.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:04.917+0000 7f3296ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f32980731e0 0x7f32980cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:04.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:04.917+0000 7f3296ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f32980731e0 0x7f32980cdf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50570/0 (socket says 172.21.15.80:50570) 2024-05-08T21:21:04.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:04.917+0000 7f3296ffd700 1 -- 172.21.15.80:0/3114762856 learned_addr learned my addr 172.21.15.80:0/3114762856 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:21:04.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:04.917+0000 7f32977fe700 1 --2- 172.21.15.80:0/3114762856 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3298072e00 0x7f32980cd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:04.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:04.917+0000 7f3297fff700 1 --2- 172.21.15.80:0/3114762856 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f329815af00 0x7f32981508f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:04.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:04.917+0000 7f3296ffd700 1 -- 172.21.15.80:0/3114762856 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f329815af00 msgr2=0x7f32981508f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:04.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:04.917+0000 7f3296ffd700 1 --2- 172.21.15.80:0/3114762856 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f329815af00 0x7f32981508f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:04.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:04.917+0000 7f3296ffd700 1 -- 172.21.15.80:0/3114762856 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3298072e00 msgr2=0x7f32980cd9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:04.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:04.917+0000 7f3296ffd700 1 --2- 172.21.15.80:0/3114762856 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3298072e00 0x7f32980cd9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:04.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:04.917+0000 7f3296ffd700 1 -- 172.21.15.80:0/3114762856 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f328c009550 con 0x7f32980731e0 2024-05-08T21:21:04.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:04.917+0000 7f3297fff700 1 --2- 172.21.15.80:0/3114762856 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f329815af00 0x7f32981508f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:21:04.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:04.918+0000 7f3296ffd700 1 --2- 172.21.15.80:0/3114762856 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f32980731e0 0x7f32980cdf10 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f328c000c00 tx=0x7f328c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:04.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:04.918+0000 7f327ffff700 1 -- 172.21.15.80:0/3114762856 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f328c00b660 con 0x7f32980731e0 2024-05-08T21:21:04.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:04.918+0000 7f327ffff700 1 -- 172.21.15.80:0/3114762856 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f328c00b7e0 con 0x7f32980731e0 2024-05-08T21:21:04.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:04.918+0000 7f329e244700 1 -- 172.21.15.80:0/3114762856 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f329815d930 con 0x7f32980731e0 2024-05-08T21:21:04.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:04.918+0000 7f327ffff700 1 -- 172.21.15.80:0/3114762856 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f328c00bbb0 con 0x7f32980731e0 2024-05-08T21:21:04.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:04.918+0000 7f329e244700 1 -- 172.21.15.80:0/3114762856 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32981e6220 con 0x7f32980731e0 2024-05-08T21:21:04.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:04.919+0000 7f329e244700 1 -- 172.21.15.80:0/3114762856 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f329804ec60 con 0x7f32980731e0 2024-05-08T21:21:04.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:04.919+0000 7f327ffff700 1 -- 172.21.15.80:0/3114762856 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f328c00bd10 con 0x7f32980731e0 2024-05-08T21:21:04.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:04.920+0000 7f327ffff700 1 --2- 172.21.15.80:0/3114762856 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f328406ac90 0x7f328406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:04.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:04.920+0000 7f327ffff700 1 -- 172.21.15.80:0/3114762856 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6655+0+0 (secure 0 0 0) 0x7f328c08b250 con 0x7f32980731e0 2024-05-08T21:21:04.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:04.920+0000 7f32977fe700 1 --2- 172.21.15.80:0/3114762856 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f328406ac90 0x7f328406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:04.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:04.920+0000 7f32977fe700 1 --2- 172.21.15.80:0/3114762856 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f328406ac90 0x7f328406d150 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3288000f60 tx=0x7f3288009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:04.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:04.926+0000 7f327ffff700 1 -- 172.21.15.80:0/3114762856 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f328c055f60 con 0x7f32980731e0 2024-05-08T21:21:05.126 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.124+0000 7f329e244700 1 -- 172.21.15.80:0/3114762856 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f329815d780 con 0x7f32980731e0 2024-05-08T21:21:05.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.767+0000 7f327ffff700 1 -- 172.21.15.80:0/3114762856 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v35) v1 ==== 169+0+0 (secure 0 0 0) 0x7f328c059580 con 0x7f32980731e0 2024-05-08T21:21:05.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.771+0000 7f329e244700 1 -- 172.21.15.80:0/3114762856 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f328406ac90 msgr2=0x7f328406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:05.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.771+0000 7f329e244700 1 --2- 172.21.15.80:0/3114762856 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f328406ac90 0x7f328406d150 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3288000f60 tx=0x7f3288009040 comp rx=0 tx=0).stop 2024-05-08T21:21:05.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.771+0000 7f329e244700 1 -- 172.21.15.80:0/3114762856 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f32980731e0 msgr2=0x7f32980cdf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:05.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.771+0000 7f329e244700 1 --2- 172.21.15.80:0/3114762856 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f32980731e0 0x7f32980cdf10 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f328c000c00 tx=0x7f328c004750 comp rx=0 tx=0).stop 2024-05-08T21:21:05.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.771+0000 7f329e244700 1 -- 172.21.15.80:0/3114762856 shutdown_connections 2024-05-08T21:21:05.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.771+0000 7f329e244700 1 --2- 172.21.15.80:0/3114762856 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f328406ac90 0x7f328406d150 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:05.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.771+0000 7f329e244700 1 --2- 172.21.15.80:0/3114762856 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f329815af00 0x7f32981508f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:05.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.771+0000 7f329e244700 1 --2- 172.21.15.80:0/3114762856 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3298072e00 0x7f32980cd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:05.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.771+0000 7f329e244700 1 --2- 172.21.15.80:0/3114762856 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f32980731e0 0x7f32980cdf10 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:05.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.771+0000 7f329e244700 1 -- 172.21.15.80:0/3114762856 >> 172.21.15.80:0/3114762856 conn(0x7f3298066780 msgr2=0x7f3298070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:05.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.772+0000 7f329e244700 1 -- 172.21.15.80:0/3114762856 shutdown_connections 2024-05-08T21:21:05.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.772+0000 7f329e244700 1 -- 172.21.15.80:0/3114762856 wait complete. 2024-05-08T21:21:05.776 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data' removed 2024-05-08T21:21:05.791 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-05-08T21:21:05.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.916+0000 7f70f8c2b700 1 Processor -- start 2024-05-08T21:21:05.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.916+0000 7f70f8c2b700 1 -- start start 2024-05-08T21:21:05.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.917+0000 7f70f8c2b700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f70f41543d0 0x7f70f415a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:05.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.917+0000 7f70f8c2b700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f70f415e400 0x7f70f4072dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:05.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.917+0000 7f70f8c2b700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f70f406bad0 0x7f70f40c8600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:05.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.917+0000 7f70f8c2b700 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70f406c940 con 0x7f70f406bad0 2024-05-08T21:21:05.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.917+0000 7f70f8c2b700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70f415a6d0 con 0x7f70f41543d0 2024-05-08T21:21:05.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.917+0000 7f70f8c2b700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70f406c380 con 0x7f70f415e400 2024-05-08T21:21:05.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.917+0000 7f70f2d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f70f406bad0 0x7f70f40c8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:05.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.917+0000 7f70f2d9d700 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f70f406bad0 0x7f70f40c8600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50578/0 (socket says 172.21.15.80:50578) 2024-05-08T21:21:05.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.917+0000 7f70f2d9d700 1 -- 172.21.15.80:0/3324295987 learned_addr learned my addr 172.21.15.80:0/3324295987 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:21:05.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.918+0000 7f70f259c700 1 --2- 172.21.15.80:0/3324295987 >> v2:172.21.15.106:3300/0 conn(0x7f70f41543d0 0x7f70f415a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:05.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.918+0000 7f70f2d9d700 1 -- 172.21.15.80:0/3324295987 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f70f415e400 msgr2=0x7f70f4072dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:21:05.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.918+0000 7f70f1d9b700 1 --2- 172.21.15.80:0/3324295987 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f70f415e400 0x7f70f4072dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:05.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.918+0000 7f70f2d9d700 1 --2- 172.21.15.80:0/3324295987 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f70f415e400 0x7f70f4072dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:05.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.918+0000 7f70f2d9d700 1 -- 172.21.15.80:0/3324295987 >> v2:172.21.15.106:3300/0 conn(0x7f70f41543d0 msgr2=0x7f70f415a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:21:05.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.918+0000 7f70f2d9d700 1 --2- 172.21.15.80:0/3324295987 >> v2:172.21.15.106:3300/0 conn(0x7f70f41543d0 0x7f70f415a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:05.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.918+0000 7f70f2d9d700 1 -- 172.21.15.80:0/3324295987 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f406c660 con 0x7f70f406bad0 2024-05-08T21:21:05.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.918+0000 7f70f2d9d700 1 --2- 172.21.15.80:0/3324295987 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70f406bad0 0x7f70f40c8600 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f70f406dcb0 tx=0x7f70ec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f9020cfc07502b0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:05.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.918+0000 7f70f159a700 1 -- 172.21.15.80:0/3324295987 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ec00e070 con 0x7f70f406bad0 2024-05-08T21:21:05.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.918+0000 7f70f159a700 1 -- 172.21.15.80:0/3324295987 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f70ec00b9c0 con 0x7f70f406bad0 2024-05-08T21:21:05.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.918+0000 7f70f159a700 1 -- 172.21.15.80:0/3324295987 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ec00bd90 con 0x7f70f406bad0 2024-05-08T21:21:05.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.918+0000 7f70f8c2b700 1 -- 172.21.15.80:0/3324295987 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70f406bad0 msgr2=0x7f70f40c8600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:05.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.918+0000 7f70f8c2b700 1 --2- 172.21.15.80:0/3324295987 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70f406bad0 0x7f70f40c8600 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f70f406dcb0 tx=0x7f70ec00b330 comp rx=0 tx=0).stop 2024-05-08T21:21:05.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.919+0000 7f70f8c2b700 1 -- 172.21.15.80:0/3324295987 shutdown_connections 2024-05-08T21:21:05.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.919+0000 7f70f8c2b700 1 --2- 172.21.15.80:0/3324295987 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70f406bad0 0x7f70f40c8600 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:05.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.919+0000 7f70f8c2b700 1 --2- 172.21.15.80:0/3324295987 >> v2:172.21.15.106:3300/0 conn(0x7f70f41543d0 0x7f70f415a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:05.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.919+0000 7f70f8c2b700 1 --2- 172.21.15.80:0/3324295987 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f70f415e400 0x7f70f4072dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:05.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.919+0000 7f70f8c2b700 1 -- 172.21.15.80:0/3324295987 >> 172.21.15.80:0/3324295987 conn(0x7f70f406ec90 msgr2=0x7f70f4066780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:05.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.919+0000 7f70f8c2b700 1 -- 172.21.15.80:0/3324295987 shutdown_connections 2024-05-08T21:21:05.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.919+0000 7f70f8c2b700 1 -- 172.21.15.80:0/3324295987 wait complete. 2024-05-08T21:21:05.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.920+0000 7f70f8c2b700 1 Processor -- start 2024-05-08T21:21:05.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.920+0000 7f70f8c2b700 1 -- start start 2024-05-08T21:21:05.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.921+0000 7f70f8c2b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70f406bad0 0x7f70f40ccdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:05.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.921+0000 7f70f8c2b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f70f41543d0 0x7f70f41f2f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:05.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.921+0000 7f70f8c2b700 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f70f415e400 0x7f70f41f34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:05.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.921+0000 7f70f8c2b700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f4159e70 con 0x7f70f406bad0 2024-05-08T21:21:05.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.921+0000 7f70f8c2b700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f40cd9e0 con 0x7f70f41543d0 2024-05-08T21:21:05.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.921+0000 7f70f8c2b700 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70f40cdca0 con 0x7f70f415e400 2024-05-08T21:21:05.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.921+0000 7f70f259c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70f406bad0 0x7f70f40ccdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:05.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.921+0000 7f70f259c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70f406bad0 0x7f70f40ccdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50586/0 (socket says 172.21.15.80:50586) 2024-05-08T21:21:05.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.921+0000 7f70f259c700 1 -- 172.21.15.80:0/736247262 learned_addr learned my addr 172.21.15.80:0/736247262 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T21:21:05.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.921+0000 7f70f2d9d700 1 --2- 172.21.15.80:0/736247262 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f70f415e400 0x7f70f41f34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:05.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.921+0000 7f70f1d9b700 1 --2- 172.21.15.80:0/736247262 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f70f41543d0 0x7f70f41f2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:05.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.921+0000 7f70f259c700 1 -- 172.21.15.80:0/736247262 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f70f415e400 msgr2=0x7f70f41f34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:05.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.921+0000 7f70f259c700 1 --2- 172.21.15.80:0/736247262 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f70f415e400 0x7f70f41f34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:05.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.921+0000 7f70f259c700 1 -- 172.21.15.80:0/736247262 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f70f41543d0 msgr2=0x7f70f41f2f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:05.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.921+0000 7f70f259c700 1 --2- 172.21.15.80:0/736247262 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f70f41543d0 0x7f70f41f2f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:05.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.921+0000 7f70f259c700 1 -- 172.21.15.80:0/736247262 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70ec009b30 con 0x7f70f406bad0 2024-05-08T21:21:05.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.921+0000 7f70f259c700 1 --2- 172.21.15.80:0/736247262 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70f406bad0 0x7f70f40ccdc0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f70e800c7f0 tx=0x7f70e800cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:05.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.921+0000 7f70e2ffd700 1 -- 172.21.15.80:0/736247262 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e8004220 con 0x7f70f406bad0 2024-05-08T21:21:05.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.921+0000 7f70e2ffd700 1 -- 172.21.15.80:0/736247262 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f70e8004380 con 0x7f70f406bad0 2024-05-08T21:21:05.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.921+0000 7f70f8c2b700 1 -- 172.21.15.80:0/736247262 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70f415a0c0 con 0x7f70f406bad0 2024-05-08T21:21:05.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.921+0000 7f70e2ffd700 1 -- 172.21.15.80:0/736247262 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e80036a0 con 0x7f70f406bad0 2024-05-08T21:21:05.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.921+0000 7f70f8c2b700 1 -- 172.21.15.80:0/736247262 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70f41f2a70 con 0x7f70f406bad0 2024-05-08T21:21:05.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.922+0000 7f70f8c2b700 1 -- 172.21.15.80:0/736247262 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70f40c93f0 con 0x7f70f406bad0 2024-05-08T21:21:05.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.923+0000 7f70e2ffd700 1 -- 172.21.15.80:0/736247262 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f70e8003820 con 0x7f70f406bad0 2024-05-08T21:21:05.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.923+0000 7f70e2ffd700 1 --2- 172.21.15.80:0/736247262 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f70d406ac90 0x7f70d406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:05.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.923+0000 7f70f1d9b700 1 --2- 172.21.15.80:0/736247262 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f70d406ac90 0x7f70d406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:05.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.923+0000 7f70e2ffd700 1 -- 172.21.15.80:0/736247262 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6125+0+0 (secure 0 0 0) 0x7f70e8089070 con 0x7f70f406bad0 2024-05-08T21:21:05.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.924+0000 7f70f1d9b700 1 --2- 172.21.15.80:0/736247262 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f70d406ac90 0x7f70d406d150 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f70f406a2f0 tx=0x7f70e4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:05.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:05.928+0000 7f70e2ffd700 1 -- 172.21.15.80:0/736247262 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f70e8054020 con 0x7f70f406bad0 2024-05-08T21:21:06.021 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:21:06.024 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:21:06.089 INFO:tasks.ceph.osd.7.smithi106.stderr:2024-05-08T21:21:06.087+0000 7feb07413700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51996) UID: 0 2024-05-08T21:21:06.089 INFO:tasks.ceph.osd.4.smithi106.stderr:2024-05-08T21:21:06.087+0000 7f447b36c700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51996) UID: 0 2024-05-08T21:21:06.090 INFO:tasks.ceph.osd.5.smithi106.stderr:2024-05-08T21:21:06.087+0000 7f4cda205700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51996) UID: 0 2024-05-08T21:21:06.090 INFO:tasks.ceph.osd.6.smithi106.stderr:2024-05-08T21:21:06.087+0000 7f029e890700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51996) UID: 0 2024-05-08T21:21:06.095 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-05-08T21:21:06.093+0000 7f80031f2700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 66871) UID: 0 2024-05-08T21:21:06.096 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-05-08T21:21:06.093+0000 7f67792d8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 66871) UID: 0 2024-05-08T21:21:06.096 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-05-08T21:21:06.093+0000 7fb31b39a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 66871) UID: 0 2024-05-08T21:21:06.096 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-05-08T21:21:06.093+0000 7fbcd7a67700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 66871) UID: 0 2024-05-08T21:21:06.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:06.130+0000 7f70f8c2b700 1 -- 172.21.15.80:0/736247262 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f70f404ed00 con 0x7f70f406bad0 2024-05-08T21:21:06.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:06.774+0000 7f70e2ffd700 1 -- 172.21.15.80:0/736247262 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v36) v1 ==== 178+0+0 (secure 0 0 0) 0x7f70e801e0d0 con 0x7f70f406bad0 2024-05-08T21:21:06.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:06.808+0000 7f70f8c2b700 1 -- 172.21.15.80:0/736247262 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f70d406ac90 msgr2=0x7f70d406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:06.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:06.808+0000 7f70f8c2b700 1 --2- 172.21.15.80:0/736247262 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f70d406ac90 0x7f70d406d150 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f70f406a2f0 tx=0x7f70e4008040 comp rx=0 tx=0).stop 2024-05-08T21:21:06.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:06.808+0000 7f70f8c2b700 1 -- 172.21.15.80:0/736247262 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70f406bad0 msgr2=0x7f70f40ccdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:06.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:06.808+0000 7f70f8c2b700 1 --2- 172.21.15.80:0/736247262 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70f406bad0 0x7f70f40ccdc0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f70e800c7f0 tx=0x7f70e800cb00 comp rx=0 tx=0).stop 2024-05-08T21:21:06.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:06.814+0000 7f70f8c2b700 1 -- 172.21.15.80:0/736247262 shutdown_connections 2024-05-08T21:21:06.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:06.814+0000 7f70f8c2b700 1 --2- 172.21.15.80:0/736247262 >> [v2:172.21.15.80:6832/46731,v1:172.21.15.80:6833/46731] conn(0x7f70d406ac90 0x7f70d406d150 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:06.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:06.814+0000 7f70f8c2b700 1 --2- 172.21.15.80:0/736247262 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70f406bad0 0x7f70f40ccdc0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:06.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:06.814+0000 7f70f8c2b700 1 --2- 172.21.15.80:0/736247262 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f70f415e400 0x7f70f41f34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:06.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:06.814+0000 7f70f8c2b700 1 --2- 172.21.15.80:0/736247262 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f70f41543d0 0x7f70f41f2f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:06.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:06.814+0000 7f70f8c2b700 1 -- 172.21.15.80:0/736247262 >> 172.21.15.80:0/736247262 conn(0x7f70f406ec90 msgr2=0x7f70f4066780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:06.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:06.816+0000 7f70f8c2b700 1 -- 172.21.15.80:0/736247262 shutdown_connections 2024-05-08T21:21:06.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T21:21:06.816+0000 7f70f8c2b700 1 -- 172.21.15.80:0/736247262 wait complete. 2024-05-08T21:21:06.825 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data_ec' removed 2024-05-08T21:21:06.840 INFO:teuthology.misc:Shutting down mds daemons... 2024-05-08T21:21:06.840 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-08T21:21:06.840 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:21:06.853 INFO:tasks.ceph.mds.a:Stopped 2024-05-08T21:21:06.853 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-08T21:21:06.854 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:21:06.904 INFO:tasks.ceph.mds.c:Stopped 2024-05-08T21:21:06.905 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-05-08T21:21:06.905 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:21:06.957 INFO:tasks.ceph.mds.e:Stopped 2024-05-08T21:21:06.957 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-08T21:21:06.957 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:21:06.966 INFO:tasks.ceph.mds.b:Stopped 2024-05-08T21:21:06.966 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-08T21:21:06.967 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:21:07.016 INFO:tasks.ceph.mds.d:Stopped 2024-05-08T21:21:07.016 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-05-08T21:21:07.016 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:21:07.065 INFO:tasks.ceph.mds.f:Stopped 2024-05-08T21:21:07.065 INFO:teuthology.misc:Shutting down osd daemons... 2024-05-08T21:21:07.065 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-05-08T21:21:07.065 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:21:07.132 INFO:tasks.ceph.osd.0:Stopped 2024-05-08T21:21:07.133 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-05-08T21:21:07.133 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:21:07.220 INFO:tasks.ceph.osd.1:Stopped 2024-05-08T21:21:07.221 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-05-08T21:21:07.221 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:21:07.288 INFO:tasks.ceph.osd.2:Stopped 2024-05-08T21:21:07.288 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-05-08T21:21:07.289 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:21:07.371 INFO:tasks.ceph.osd.3:Stopped 2024-05-08T21:21:07.372 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-05-08T21:21:07.372 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:21:07.441 INFO:tasks.ceph.osd.4:Stopped 2024-05-08T21:21:07.441 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-05-08T21:21:07.441 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:21:07.509 INFO:tasks.ceph.osd.5:Stopped 2024-05-08T21:21:07.510 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-05-08T21:21:07.510 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:21:07.578 INFO:tasks.ceph.osd.6:Stopped 2024-05-08T21:21:07.579 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-05-08T21:21:07.579 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:21:07.641 INFO:tasks.ceph.osd.7:Stopped 2024-05-08T21:21:07.641 INFO:teuthology.misc:Shutting down mgr daemons... 2024-05-08T21:21:07.642 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-05-08T21:21:07.642 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:21:07.666 INFO:tasks.ceph.mgr.y:Stopped 2024-05-08T21:21:07.667 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-05-08T21:21:07.667 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:21:07.689 INFO:tasks.ceph.mgr.x:Stopped 2024-05-08T21:21:07.690 INFO:teuthology.misc:Shutting down mon daemons... 2024-05-08T21:21:07.690 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-05-08T21:21:07.690 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:21:07.718 INFO:tasks.ceph.mon.a:Stopped 2024-05-08T21:21:07.718 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-05-08T21:21:07.718 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:21:07.740 INFO:tasks.ceph.mon.b:Stopped 2024-05-08T21:21:07.740 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-05-08T21:21:07.740 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:21:07.791 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-05-08T21:21:07.791 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-05-08T21:21:07.791 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-05-08T21:21:07.791 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-05-08T21:21:07.791 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-05-08T21:21:07.791 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-05-08T21:21:07.791 INFO:tasks.ceph.mon.c:Stopped 2024-05-08T21:21:07.791 INFO:tasks.ceph:Checking cluster log for badness... 2024-05-08T21:21:07.792 DEBUG:teuthology.orchestra.run.smithi080:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v 'Replacing daemon mds' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-05-08T21:21:07.929 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi080.front.sepia.ceph.com 2024-05-08T21:21:07.929 DEBUG:teuthology.orchestra.run.smithi080:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-05-08T21:21:08.622 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi080.front.sepia.ceph.com 2024-05-08T21:21:08.622 DEBUG:teuthology.orchestra.run.smithi080:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-05-08T21:21:08.965 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi080.front.sepia.ceph.com 2024-05-08T21:21:08.965 DEBUG:teuthology.orchestra.run.smithi080:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-05-08T21:21:09.209 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi080.front.sepia.ceph.com 2024-05-08T21:21:09.209 DEBUG:teuthology.orchestra.run.smithi080:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-05-08T21:21:09.458 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi106.front.sepia.ceph.com 2024-05-08T21:21:09.458 DEBUG:teuthology.orchestra.run.smithi106:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-05-08T21:21:10.278 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi106.front.sepia.ceph.com 2024-05-08T21:21:10.278 DEBUG:teuthology.orchestra.run.smithi106:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-05-08T21:21:10.595 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi106.front.sepia.ceph.com 2024-05-08T21:21:10.595 DEBUG:teuthology.orchestra.run.smithi106:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-05-08T21:21:10.809 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi106.front.sepia.ceph.com 2024-05-08T21:21:10.810 DEBUG:teuthology.orchestra.run.smithi106:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-05-08T21:21:11.028 INFO:tasks.ceph:Archiving mon data... 2024-05-08T21:21:11.030 DEBUG:teuthology.misc:Transferring archived files from smithi080:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698040/data/mon.a.tgz 2024-05-08T21:21:11.030 DEBUG:teuthology.orchestra.run.smithi080:> mktemp 2024-05-08T21:21:11.068 INFO:teuthology.orchestra.run.smithi080.stdout:/tmp/tmp.VSyviFztsF 2024-05-08T21:21:11.068 DEBUG:teuthology.orchestra.run.smithi080:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.VSyviFztsF 2024-05-08T21:21:11.331 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 0666 /tmp/tmp.VSyviFztsF 2024-05-08T21:21:11.492 DEBUG:teuthology.orchestra.remote:smithi080:/tmp/tmp.VSyviFztsF is 315KB 2024-05-08T21:21:11.587 DEBUG:teuthology.orchestra.run.smithi080:> rm -fr /tmp/tmp.VSyviFztsF 2024-05-08T21:21:11.603 DEBUG:teuthology.misc:Transferring archived files from smithi106:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698040/data/mon.b.tgz 2024-05-08T21:21:11.603 DEBUG:teuthology.orchestra.run.smithi106:> mktemp 2024-05-08T21:21:11.645 INFO:teuthology.orchestra.run.smithi106.stdout:/tmp/tmp.QtG7DvcdXW 2024-05-08T21:21:11.645 DEBUG:teuthology.orchestra.run.smithi106:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.QtG7DvcdXW 2024-05-08T21:21:11.793 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 0666 /tmp/tmp.QtG7DvcdXW 2024-05-08T21:21:12.001 DEBUG:teuthology.orchestra.remote:smithi106:/tmp/tmp.QtG7DvcdXW is 323KB 2024-05-08T21:21:12.095 DEBUG:teuthology.orchestra.run.smithi106:> rm -fr /tmp/tmp.QtG7DvcdXW 2024-05-08T21:21:12.111 DEBUG:teuthology.misc:Transferring archived files from smithi106:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698040/data/mon.c.tgz 2024-05-08T21:21:12.111 DEBUG:teuthology.orchestra.run.smithi106:> mktemp 2024-05-08T21:21:12.167 INFO:teuthology.orchestra.run.smithi106.stdout:/tmp/tmp.Z0lhr47A5I 2024-05-08T21:21:12.167 DEBUG:teuthology.orchestra.run.smithi106:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.Z0lhr47A5I 2024-05-08T21:21:12.295 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 0666 /tmp/tmp.Z0lhr47A5I 2024-05-08T21:21:12.379 DEBUG:teuthology.orchestra.remote:smithi106:/tmp/tmp.Z0lhr47A5I is 323KB 2024-05-08T21:21:12.445 DEBUG:teuthology.orchestra.run.smithi106:> rm -fr /tmp/tmp.Z0lhr47A5I 2024-05-08T21:21:12.461 INFO:tasks.ceph:Cleaning ceph cluster... 2024-05-08T21:21:12.461 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-08T21:21:12.463 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-08T21:21:12.526 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-05-08T21:21:12.527 DEBUG:teuthology.orchestra.run.smithi080:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-05-08T21:21:12.528 DEBUG:teuthology.orchestra.run.smithi106:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-05-08T21:21:12.580 INFO:teuthology.orchestra.run.smithi080.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-05-08T21:21:12.593 INFO:teuthology.orchestra.run.smithi106.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-05-08T21:21:12.601 INFO:tasks.ceph:Archiving crash dumps... 2024-05-08T21:21:12.603 DEBUG:teuthology.misc:Transferring archived files from smithi080:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698040/remote/smithi080/crash 2024-05-08T21:21:12.604 DEBUG:teuthology.orchestra.run.smithi080:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-08T21:21:12.631 DEBUG:teuthology.misc:Transferring archived files from smithi106:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698040/remote/smithi106/crash 2024-05-08T21:21:12.632 DEBUG:teuthology.orchestra.run.smithi106:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-08T21:21:12.667 INFO:tasks.ceph:Shutting down logrotate 2024-05-08T21:21:12.792 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-05-08T21:21:12.792 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-05-08T21:21:12.793 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-05-08T21:21:12.793 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2024-05-08T21:21:12.793 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-05-08T21:21:12.793 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-05-08T21:26:14.482 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-08T21:26:14.543 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-08T21:26:14.623 INFO:tasks.ceph:Compressing logs... 2024-05-08T21:26:14.623 DEBUG:teuthology.orchestra.run.smithi080:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-08T21:26:14.626 DEBUG:teuthology.orchestra.run.smithi106:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-08T21:29:35.402 INFO:tasks.ceph:Archiving logs... 2024-05-08T21:29:35.418 DEBUG:teuthology.misc:Transferring archived files from smithi080:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698040/remote/smithi080/log 2024-05-08T21:29:35.419 DEBUG:teuthology.orchestra.run.smithi080:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-08T21:30:53.033 DEBUG:teuthology.misc:Transferring archived files from smithi106:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698040/remote/smithi106/log 2024-05-08T21:30:53.034 DEBUG:teuthology.orchestra.run.smithi106:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-08T21:31:55.458 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-08T21:31:55.468 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-08T21:31:55.468 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-08T21:31:55.471 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-08T21:31:55.567 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-08T21:31:55.577 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-08T21:31:55.577 DEBUG:teuthology.orchestra.run.smithi080:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T21:31:55.579 DEBUG:teuthology.orchestra.run.smithi106:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T21:31:55.595 INFO:teuthology.orchestra.run.smithi080.stderr:bash: ntpq: command not found 2024-05-08T21:31:55.599 INFO:teuthology.orchestra.run.smithi106.stderr:bash: ntpq: command not found 2024-05-08T21:31:55.634 INFO:teuthology.orchestra.run.smithi080.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T21:31:55.635 INFO:teuthology.orchestra.run.smithi080.stdout:=============================================================================== 2024-05-08T21:31:55.635 INFO:teuthology.orchestra.run.smithi080.stdout:^* hv01.front.sepia.ceph.com 3 7 377 50 +1596us[+1608us] +/- 65ms 2024-05-08T21:31:55.635 INFO:teuthology.orchestra.run.smithi080.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 51 -1785us[-1774us] +/- 71ms 2024-05-08T21:31:55.635 INFO:teuthology.orchestra.run.smithi080.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 114 -509us[ -502us] +/- 89ms 2024-05-08T21:31:55.635 INFO:teuthology.orchestra.run.smithi080.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T21:31:55.655 INFO:teuthology.orchestra.run.smithi106.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T21:31:55.655 INFO:teuthology.orchestra.run.smithi106.stdout:=============================================================================== 2024-05-08T21:31:55.655 INFO:teuthology.orchestra.run.smithi106.stdout:^* hv01.front.sepia.ceph.com 3 6 377 53 +1741us[+1738us] +/- 65ms 2024-05-08T21:31:55.655 INFO:teuthology.orchestra.run.smithi106.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 54 -1609us[-1612us] +/- 71ms 2024-05-08T21:31:55.655 INFO:teuthology.orchestra.run.smithi106.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 51 -379us[ -379us] +/- 90ms 2024-05-08T21:31:55.655 INFO:teuthology.orchestra.run.smithi106.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T21:31:55.656 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-08T21:31:55.666 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-08T21:31:55.666 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-08T21:31:55.675 DEBUG:teuthology.orchestra.run.smithi080:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-08T21:31:55.775 DEBUG:teuthology.orchestra.run.smithi106:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-08T21:31:55.875 DEBUG:teuthology.orchestra.run.smithi080:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-08T21:31:55.908 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T21:31:55.908 DEBUG:teuthology.orchestra.run.smithi106:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-08T21:31:55.945 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T21:31:55.945 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-08T21:31:55.955 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-08T21:31:56.088 INFO:teuthology.task.internal:Duration was 2157.268514 seconds 2024-05-08T21:31:56.088 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-08T21:31:56.098 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-08T21:31:56.098 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-08T21:31:56.101 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-08T21:31:56.178 INFO:teuthology.orchestra.run.smithi080.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T21:31:56.209 INFO:teuthology.orchestra.run.smithi106.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T21:31:56.629 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-08T21:31:56.629 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi080.front.sepia.ceph.com 2024-05-08T21:31:56.630 DEBUG:teuthology.orchestra.run.smithi080:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-08T21:31:56.652 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi106.front.sepia.ceph.com 2024-05-08T21:31:56.653 DEBUG:teuthology.orchestra.run.smithi106:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-08T21:31:56.683 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-08T21:31:56.684 DEBUG:teuthology.orchestra.run.smithi080:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-08T21:31:56.694 DEBUG:teuthology.orchestra.run.smithi106:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-08T21:31:56.770 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-08T21:31:56.770 DEBUG:teuthology.orchestra.run.smithi080:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-08T21:31:56.772 DEBUG:teuthology.orchestra.run.smithi106:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-08T21:31:56.889 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-08T21:31:56.899 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-08T21:31:56.899 DEBUG:teuthology.orchestra.run.smithi080:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-08T21:31:56.969 DEBUG:teuthology.orchestra.run.smithi106:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-08T21:31:57.010 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-08T21:31:57.021 DEBUG:teuthology.orchestra.run.smithi080:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-08T21:31:57.023 DEBUG:teuthology.orchestra.run.smithi106:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-08T21:31:57.059 INFO:teuthology.orchestra.run.smithi080.stdout:kernel.core_pattern = core 2024-05-08T21:31:57.088 INFO:teuthology.orchestra.run.smithi106.stdout:kernel.core_pattern = core 2024-05-08T21:31:57.136 DEBUG:teuthology.orchestra.run.smithi080:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-08T21:31:57.152 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T21:31:57.152 DEBUG:teuthology.orchestra.run.smithi106:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-08T21:31:57.191 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T21:31:57.192 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-08T21:31:57.203 INFO:teuthology.task.internal:Transferring archived files... 2024-05-08T21:31:57.204 DEBUG:teuthology.misc:Transferring archived files from smithi080:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698040/remote/smithi080 2024-05-08T21:31:57.204 DEBUG:teuthology.orchestra.run.smithi080:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-08T21:31:57.244 DEBUG:teuthology.misc:Transferring archived files from smithi106:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698040/remote/smithi106 2024-05-08T21:31:57.244 DEBUG:teuthology.orchestra.run.smithi106:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-08T21:31:57.283 INFO:teuthology.task.internal:Removing archive directory... 2024-05-08T21:31:57.284 DEBUG:teuthology.orchestra.run.smithi080:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-08T21:31:57.286 DEBUG:teuthology.orchestra.run.smithi106:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-08T21:31:57.333 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-08T21:31:57.345 INFO:teuthology.task.internal:Not uploading archives. 2024-05-08T21:31:57.345 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-08T21:31:57.356 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-08T21:31:57.356 DEBUG:teuthology.orchestra.run.smithi080:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-08T21:31:57.358 DEBUG:teuthology.orchestra.run.smithi106:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-08T21:31:57.372 INFO:teuthology.orchestra.run.smithi080.stdout: 262183 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 8 21:31 /home/ubuntu/cephtest 2024-05-08T21:31:57.390 INFO:teuthology.orchestra.run.smithi106.stdout: 262164 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 8 21:31 /home/ubuntu/cephtest 2024-05-08T21:31:57.392 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-08T21:31:57.409 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-08T21:31:57.450 INFO:teuthology.run:Summary data: description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mds 2-workunit/suites/ffsb}} duration: 2157.268513917923 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-05-08T21:31:57.450 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-08T21:31:57.553 INFO:teuthology.run:pass